Tag Info

New answers tagged

6

In addition to Cloudtrail, you should enable logging for your S3 buckets. After doing that, AWS will start logging the canonical user ID used to make authenticated requests to S3. Quote from AWS S3 Docs on logging fields: The canonical user ID of the requester, or the string "Anonymous" for unauthenticated requests. If the requester was an IAM user, ...


0

I've figured it out and I feel a little bit silly for not picking this up sooner. So for anyone that uses AWS::CloudFormation::Authentication path, the solution of course is: Make sure your BUCKET policy allows your aws-elasticbeanstalk-ec2-role. DOH!! It should look something like this: { "Id": "Policy1111Blah", "Version": "2012-10-17", ...


1

This all comes down to performance. If your NFS storage is fast enough then there is nothing to stop you putting all your web app & web content files on it so they are accessible to all your front end VM's. That said, the most common reason for people not doing this is because the extra network latency involved in retrieving files from networked storage ...


1

you simply have to authorize your IAM user to access to the buvket, within the S3 bucket policy, like so: { "Version": "2012-10-17", "Statement": [ { "Sid": "whatever", "Effect": "Allow", "Principal": { "AWS": [ "<ARN OF YOUR IAM USER>" ] ...


0

Accounts use different credentials. There's no way to sync from one account to another and provide separate credentials. The only way to do that is to allow public access to the second bucket with a temporary account. If that is not an option, then your best bet is to: s3 sync s3://acct1/bucket . --profile acct1 s3 sync . s3://acct2/bucket --profile acct2 ...


1

I hit this error and it was because I was setting the Host header wrong. Here's the config that ended up working: set $s3_bucket 's3-us-west-1.amazonaws.com'; ... proxy_set_header Host $s3_bucket; Note that the host header does not include http/https. That should be included in the proxy_pass line proxy_pass ...


0

This is a bit old, but I recently ran into the same symptoms with an different solution. We ended up with a bucket full of objects with no permissions. We could see them from the console, download them from the console, but not from our CLI tools. The objects showed in the console as having no permissions, but it was not possible to add or remove ...


2

Actually, you only need to configure S3 access using bucket policy: Open you AWS S3 Console Right click your bucket and choose Properties. You will see bucket properties in right side. In the Permission section, click Edit Bucket Policy. Fill with the following policy (adjust the IP address): { "Version": "2012-10-17", "Id": "S3PolicyId1", ...


1

I'd say it's most likely that either rvmsudo or s3cmd need extra environment variables to run successfully, which aren't set in the context of logrotate, but which are in your interactive shell session. I wouldn't be surprised if rvmsudo isn't available in the restrictive PATH which cron sets.


0

#!/usr/bin/env bash # List folders here that may or may not be under base path. # If folder isn't under base path we do nothing. # If it exists we back it up to S3. # S3 file is stamped to day of month. # So you have a months worth of backups. declare -a folders=( "elasticsearch" "jenkins" "some-cool-app" ) BASE_PATH="/home/ubuntu/" ...


1

As of 28th of July 2015 you can get this information via CloudWatch. aws cloudwatch get-metric-statistics --namespace AWS/S3 --start-time 2015-07-15T10:00:00 --end-time 2015-07-31T01:00:00 --period 86400 --statistics Average --region eu-west-1 --metric-name BucketSizeBytes --dimensions Name=BucketName,Value=toukakoukan.com ...


0

I think you should check the S3 web console under the Permission tab to verify the older objects policy. Normally API issued policy are valid for newly uploaded objects, but changing the bucket permission via web console should fix it.


1

For a really low-tech approach: use an S3 client that can calculate the size for you. I'm using Panic's Transmit, click on a bucket, do "Get Info" and click the "Calculate"-button. I'm not sure how fast or accurate it is in relation to other methods, but it seems to give back the size I had expected it to be.



Top 50 recent answers are included