This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

0
votes
1answer
207 views

DNS with name.com and Amazon S3

I have a website on a bucket in Amazon S3, and recently started to get emails from Google "Googlebot can't access your site". When I go to Webmaster Tools and I try to fetch in fact it doesn't work. ...
-1
votes
2answers
851 views

https download file with custom S3 URL

I believe the following question should be asked here and not @Super User. My web application is using S3 for users to download files. Prior customizing the url, files were downloaded from S3 with ...
1
vote
2answers
1k views

regex to match s3 urls in nginx location directive & proxy to amazon s3

In nginx location directive, how do I match s3 urls. for example, the wrong url is: http://example.com/https://s3.amazonaws.com/mybucket/logo.jpg?1404251306 from Logs, I can see nginx can that it ...
11
votes
1answer
11k views

Setting Access-Control-Allow-Origin on Cloudfront

I am having problems serving static assets to Firefox using AWS Cloudfront. Chrome works perfect, but Firefox is returning a CORS error. If I execute curl , I get: HTTP/1.1 200 OK Content-Type: ...
-1
votes
1answer
273 views

“Securely” download a file over https without using authentication

I need to securely download a file over https without using authentication. The reason I need to do this is I want to create a zap at Zapier.com that allows me the copy a file from a https post to my ...
0
votes
1answer
214 views

Access date of Amazon s3 resources

Anyone know of a way to ascertain the last accessed date for s3 files/buckets or if this is even recorded? Doesn't seem visible via the GUI and a basic try of s3cmd and boto shows last modified date ...
1
vote
0answers
58 views

svnadmin dump returns error insufficient disk space

I have a SVN repo that is around 35GB after dumping. I know this is huge, but our business requires that all revisions of all files and libraries be tracked. I have Apache Subversion hosted on an ...
0
votes
1answer
2k views

PHP error logging with AWS and EC2 [closed]

I'm setting up my site to run on AWS EC2. In some presentation for AWS services I saw that there are ways to store your PHP error logs in AWS S3 and analyze it with specific tools. Can't find this ...
4
votes
2answers
469 views

Does Amazon CloudFront charge for storage? [closed]

I've been reviewing the features and prices of Amazon S3 and Amazon CloudFront as well as similar services offered by other providers. One thing I can't understand is why Amazon CloudFront pricing ...
1
vote
1answer
474 views

Backing up onto S3 - do I want to use bucket in a different region?

We are using Amanda to send backups to S3. Each host is acting as its own Amanda "server". All hosts are currently using the same S3-bucket -- each has its own subfolder under it. The dumps are saved ...
4
votes
2answers
3k views

Amazon Cloudfront with S3 Redirect

I'm trying to do something that should be relatively straight-forward - I want to setup a few domains and subdomains to redirect to the core domain for our site, but I want to put the redirects out on ...
2
votes
1answer
2k views

using CloudFormation with an existing S3 bucket

Using CloudFormation, I want to set some of the properties in AWS::S3::Bucket on an existing bucket. In other words, I don't want to create the bucket, I just want to enforce some of the settings. ...
0
votes
1answer
253 views

Back up S3 bucket to another?

I am looking at duply and duplicity currently to mirror one bucket to another but it looks like I may be running in to a brick wall? So far I have been able to get things working backing up local ...
0
votes
1answer
80 views

Best practice for web applications and windows services remote configuration in AWS

we have a distributed system that contains windows services and web applications (.NET and Java based). Currently, most of the initial configuration for these applications are taken from various ...
4
votes
1answer
3k views

What IP range do I ask the system administrator to open in order for S3 to work?

I've written some programs for Raspberry Pi, which some small companies have shown interest in. I sold pre-configured Raspberry Pi:s to them, with my program on them, and it works for everybody except ...
0
votes
1answer
537 views

can't get s3 authentication to work to load data into redshift

I'm working on getting data into a sample Redshift cluster for a client, but I can't get authenticated to S3. There's been a recent change so that my own 'root user' access keys aren't available for ...
0
votes
1answer
4k views

s3cmd: Deleting files or folder does not work

s3cmd s3://MYBUCKET/FOLDER does not work. (folder is empty) s3cmd s3://MYBUCKET/FILE does not work. Output of both commands is "File FILE sucessfully deleted", yet the file remains on the bucket. ...
1
vote
1answer
4k views

How to best backup AWS-hosted systems? [closed]

We are deploying a number of servers at AWS and need to work-out a general-purpose backup strategy. The requirements are: Retain the ability to recover full systems or individual files or ...
0
votes
1answer
2k views

Redirect loop after setting up domains

I migrated domains from a service provider (ipage) to godaddy. The hosting has been setup on AWS S3. I have done such things before and they worked. However this time I'm hitting a redirect loop ...
3
votes
3answers
2k views

how to pipe a mysql dump to s3cmd

I want to transfer a mysql dump, compressed, to s3. I tried: mysqldump -u root -ppassword -all-databases | gzip -9 | s3cmd put s3://bucket/sql/databases.sql.gz but then I get: ERROR: Not enough ...
1
vote
0answers
234 views

Duplicity -> S3 backup failing with “[Errno 105] No buffer space available”

I have a nightly script on my Ubuntu 10.04 VPS which uses duplicity (0.6.24) to run incremental, encrypted backups to Amazon S3. This script had been working until a month or so ago when it started ...
0
votes
1answer
1k views

S3 static website hosting, which DNS CNAME record should I use?

I have created a S3 static website e.g. www.example.com The S3 endpoind is: www.example.com.s3-website-us-east-1.amazonaws.com When I dig this DNS www.example.com.s3-website-us-east-1.amazonaws.com....
0
votes
0answers
2k views

s3cmd 403 Access Denied error on put but not ls

I can access s3 using s3cmd on an ec2 instance to do s3cmd ls s3://myc bucketname but not using 'put' to add a file. It gives a 403 access denied error. I am using IAM and have group setup to access ...
5
votes
2answers
2k views

Restore a versioned S3 bucket to a particular point in time

Let's say I've got S3 versioning enabled for my bucket: http://docs.aws.amazon.com/AmazonS3/latest/dev/Versioning.html Then, let's say someone (for example, junior employee) messes up the S3 bucket (...
0
votes
1answer
1k views

How to ideally store images on Amazon S3

I want to store a huge number of images on Amazon S3 (served via Cloudfront). Currently the way I am doing is simply dumping the images and having basic HTTP Cache headers set to a month so that users ...
1
vote
1answer
1k views

Drop/Truncate DynamoDB table with AWS Data Pipeline

I have set up a Data Pipeline that imports files from an S3 bucket to a DynamoDB table, based on the predefined example. I want to truncate the table (or drop and create a new one) every time the ...
-1
votes
1answer
430 views

Is it possible to use PHP on a website hosted on AWS S3 without using EC2 or Elastic Beanstalk?

I have a bit of PHP (a contact form to be exact) that isn't working right now on my website. I'd like to activate the PHP and I heard one of the ways is to use Elastic Beanstalk. However, Elastic ...
8
votes
2answers
2k views

How can I reuse existing resources in CloudFormation?

I've have S3 bucket as resource in my CloudFormation template. With DeletionPolicy set to Retain. This works as expected, when deleting the stack, it does indeed retain the bucket. However, when I ...
2
votes
2answers
1k views

Is there a way to retrieve all contents from a versioned Amazon S3 bucket as of a particular datetime

Is it possible via the AWS CLI or via some third-party tool to easily download all contents of a versioned bucket as it was on a particular datetime? I.E. I would like to retrieve the version of each ...
17
votes
1answer
10k views

No targets available when trying to set alias target from Route 53 to S3

I'm trying to setup a simple Amazon AWS S3 based website, as explained here. I've setup the S3 bucket (simples3websitetest.com), gave it the (hopefully) right permissions: { "Version": "2012-10-...
2
votes
1answer
913 views

Amazon S3 - private file is still downloadable for everyone?

I have some secret files which I want to restrict anonymous user from viewing/downloading. I have tried to make it private by running something like: s3cmd setacl --acl-private s3://bucket/some/path/*...
13
votes
1answer
6k views

AWS IAM user access issues for S3

I have the following IAM policy for a user { "Version": "2012-10-17", "Statement": [ { "Sid": "Stmt1395161912000", "Effect": "Allow", "Action": [ "s3:ListBucket", ...
5
votes
3answers
5k views

Wildcard Subdomain (*.example.com) with Amazon Route53 DNS and S3

I am hosting a static website using Amazon Route53 for DNS and S3 for html files. It is working fine. Current Setup is: example.com. A ALIAS s3-website-us-east-1.amazonaws.com. www.example.com. ...
19
votes
2answers
17k views

Amazon Cloudfront with S3. Access Denied

We're trying to distribute out S3 buckets via Cloudfront but for some reason the only response is an AccessDenied XML document like the following: <Error> <Code>AccessDenied</Code&...
1
vote
1answer
113 views

CloudBerry Explorer PRO using 100% CPU [closed]

Does anyone have any experience with this product? I'm running a trial on in it now for a project to move about 800 GB of data to Amazon S3. After the initial move we'll keep a job running to continue ...
7
votes
4answers
9k views

Accessing Amazon S3 from a private VPC subnet

If I have a VPC running and some servers located in the private portion of that network that do backend processing by downloading files from amazon s3, can I access S3 internally to get at those files?...
1
vote
1answer
265 views

CloudFront, S3, EC2: how can you reroute request from CloudFront to EC2 unless file exist at S3?

My application uses all 3 service layers. Recent feature request to lower the outgoing traffic gives us some uncertainties. Say, we have a requirement to distribute the image.jpg file with CloudFront....
-1
votes
1answer
265 views

aws route 53 and vistualhost in ubuntu apache [closed]

I have added domain name in route 53 and creating a sub domain to land into virtualhost with a port. I am trying to add a sub domain as cname and cname is my servername in virtualhost. I am on ubuntu ...
0
votes
1answer
454 views

Ensuring data consistency in s3 with multiple users writing/reading

I need advice/ ideas about how can I ensure data consistency in my s3 bucket. I have 2-3 users pushing and reading resources from s3. As one can easily see this leads to data inconsistency( User A is ...
2
votes
1answer
529 views

Postgresql WAL-E - Replication falling behind + can't catch up

Does anyone know how I can have my replications process the WAL segments faster while using WAL-E? https://github.com/wal-e/wal-e I have one master that leverages WAL-E to upload to S3, and I have 6 ...
0
votes
1answer
389 views

Amazon S3 upload - bytes transferred is larger than actual file size

I just uploaded FEDORA ISO image to S3 via Visual Studio AWS Explorer (not using encryption). After upload completed status shows: 1,004,232,704 / 999,292,928 Bytes Actual file size on local disc ...
2
votes
2answers
2k views

Anonymous access to S3 bucket only from my EC2 instances

Is there a way to let anonymous access to a certain S3 bucket only from my EC2 instances (all of them) within a single AWS account? I know I can use IAM roles, but I found it's just too many moving ...
1
vote
2answers
2k views

Synchronize AWS EC2 instances

I have been looking for a way to synchronize files between my EC2 web servers . However in most of the places it is mentioned that S3 can be used in such cases . However my question is S3 provides for ...
1
vote
1answer
1k views

Cloud-front backed with Nginx (which proxies to S3) randomly missing already cached items?

I wish to serve images from a S3 bucket with Cloudfront as CDN frontend, for that I tried the following: What I wish to acheive (Attempt 2) -- (Misses cloudfront cache randomly) I have the ...
2
votes
3answers
1k views

Should I use ec2 as a file server?

I need to be able to share user uploaded content across multiple EC2 application servers. I have looked at rsync, mounted NFS, and S3 as potential options of being able to share this data in almost ...
3
votes
2answers
614 views

How to discourage a hacker with root access from deleting remote backups?

I'm currently researching the best backup solution for my CentOS webserver, and I'm thinking of going with either Tarsnap or straight-up Amazon S3. I am trying to figure out how to discourage a ...
0
votes
1answer
107 views

Glacier retrieval notification of s3 objects

I have some s3 buckets which send their objects to glacier after x days of creation. When I go to retrieve those objects on the s3 interface, I need to keep reloading page to see when restoration has ...
1
vote
0answers
639 views

Amazon S3: allow user access to subfolder only on any bucket

I'm trying to write a policy that will allow a user to read from any bucket (that part works) but only write to a specific subfolder on any bucket. This is my policy so far (reading works, but it ...
0
votes
1answer
826 views

Max number of elastic IPs that can be attached to single instance? [closed]

How many elastic IPs (publicly visible) can be attached to single instance?
1
vote
3answers
943 views

Dovecot with S3QL

Due to periodically running out of space on EBS volumes on AWS EC2, and looking to make the setup more fault resistant in case of server/volume failure, I'm considering moving a Dovecot maildir ...