This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

2
votes
1answer
2k views

HTTPS access to S3 bucket through Cloudflare

I'm trying to use Cloudflare to provide https access to an s3 bucket. I've setup the CNAME entry in Cloudfront with pointing to the bucket and I've verified I can access it via http but when I try and ...
0
votes
1answer
439 views

Pricing of Key Pairs and Security Groups on AWS?

My free AWS account expired. I deleted all S3 and EC2 resources, but am wandering if I can leave the Key Pairs and Security Groups without having to pay for them. (My account resources look like this ...
1
vote
1answer
360 views

Redirect warning when running s3cmd sync

When running s3cmd I get a redirect warning as follows: WARNING: Redirected to: xyz.s3-eu-west-1.amazonaws.com The script that produces the warning is this: s3cmd sync /var/backups/db/ ...
0
votes
2answers
1k views

No permissions for files in Amazon s3 for admin

We transferred files from one bucket to another bucket on a separate account with --acl-public as follows: s3cmd cp -v --recursive --acl-public s3://source-geo/webroot s3://dest-geo/webroot/ Now we ...
0
votes
1answer
794 views

Setting cache for already uploaded amazon s3 files

In amazon s3 for our site through s3cmd tool we uploaded around 60GB of files including mp3, jpg to a bucket. But now when we checked site slowness files are not caching and further checking we came ...
1
vote
1answer
1k views

Url rewriting in Amazon S3

I have a webapp hosted in Amazon S3, the webapp is build with jQuery Mobile and I use changePage lo navigate between pages, I'm not using the hash operator(#) when I change the page. I'm having ...
0
votes
1answer
118 views

How to configure Amazon S3 permissions to host files for my mobile app

I have a mobile app that uploads files to a server and needs to be able to download them. I'm using S3 to hold the files, and have a RoR backend to manage all this. Is it possible to have the ...
3
votes
3answers
2k views

Amazon AWS EC2 instance Exported to local machine

I have several Amazon AWS EC2 virtual machines that I created on AWS EC2. They were not imported, they were created there. I would like to export these machines in order to achieve local backups, ...
0
votes
1answer
298 views

version id of object in amazon s3 is unique to file, bucket or S3?

The doc says If you enable versioning for a bucket, Amazon S3 automatically generates a unique version ID for the object being stored When versioning is enabled for a bucket, can I say version ...
0
votes
1answer
732 views

AWSCLI s3 sync doesn't create directory

Hi try to sync a local directory to a S3 bucket. The files in the directory get synced perfectly, just the directory isn't created at all. Can you guys give me a hint how to do it? "newdir" contains ...
0
votes
1answer
154 views

Load times of S3 Static Website

We have recently decided to move our static single page website to AWS S3, the previous server was hosted by Godaddy(cpanel) in singapore. We are using Synthetics New Relic to monitor our website and ...
2
votes
0answers
36 views

What does a healthy CNAME to an S3 web access bucket look like? [duplicate]

I have feed.foodschmood.com configured according to Amazon's instructions (a CNAME to one of their endpoints, which is itself a CNAME), but I'm skeptical that this is a "proper" configuration. ...
0
votes
1answer
34 views

S3 dropouts in one region only - is this normal?

I'm using S3 to serve static image assets to a website. I'm a developer in Montréal, Quebec. My client's office is in LA. Once every month or three we're seeing S3 completely fail to serve images to ...
2
votes
1answer
350 views

s3 policy for quota

Is there a s3 policy rule that can only allow a user to upload so many GB of files? Basically looking to set a quota on the objects a user can upload. Here is the rule set that I have now: { ...
1
vote
2answers
249 views

Auto scale on Amazon S3 based on transfer

I'm waiting for Account confirmation in Amazon AWS, till then I can't experiment. First of all, I found the docs about auto scaling in Amazon AWS, but all of them mention Amazon EC2, there is no info ...
1
vote
1answer
210 views

What is the best way to backup logs in Amazon S3 in real time? [closed]

I want to backup all my logs in Amazon S3 in real time, which tool I should use?
0
votes
0answers
92 views

NGINX: proxy_cache altering headers

I have been having trouble building a proxy between my server and s3 to cache requests. I finally boiled it down to a single point of failure... http{ proxy_cache_path /home/cache levels=1:2 ...
1
vote
1answer
147 views

Nginx proxy cache invalidating request to s3

I have set up a proxy from my application server to a private s3 bucket to cache requests. I was having some trouble with it where s3 was rejecting my download requests (403 forbidden) and after some ...
1
vote
1answer
687 views

How to store a Cloudfront custom error page in S3?

I have a Cloudfront plugged on an AWS load balancer. I saw in the AWS documentation that I can customize Cloudfront custom error pages. I tried to store these error pages in S3 as it is recommended ...
0
votes
1answer
153 views

What should an s3 end point look like when configuring an ALIAS record in Route53?

I'm trying to point my root domain to an s3 bucket that redirects to www.mywebsite.com. However, when I try to configure my ALIAS record to point an s3 endpoint, the only endpoint that the dialogue ...
0
votes
1answer
313 views

Duplicity Backups (via Duply) to S3 - high server load

We have been doing incremental backups using Duply on our main server, to an S3 bucket. However, we've found that there is a high server load during the backups (its an Amazon EC2 server). We're ...
1
vote
0answers
662 views

s3cmd sync hangs forever. Never finishes

I am trying to backup a directory of around 350GB in size to S3. The command I run is s3cmd --progress -v -H sync /localdir s3://mybucket/ However, the process never moves past INFO: Compiling ...
1
vote
2answers
492 views

How does my registrar (Namecheap) let me set up a CNAME record on the apex domain?

Namecheap seems to let me create a CNAME record on the apex domain, which I thought was contrary to the definition of a CNAME record: It works (correctly loading up my static site from S3). ...
0
votes
1answer
1k views

s3fs “could not determine how to establish security credentials”

I'm trying to use s3fs to mount an S3 bucket on to a standard AWS Amazon Linux AMI (with all the necessary dependencies installed). However when following this tutorial when I run: s3fs mybucketname ...
1
vote
1answer
766 views

How do I place an SPA in a S3 state website subdirectory using rewrite rules?

I have successfully deployed AngularJS apps to S3 in the past with html5mode enabled in order to allow for hash-less URLs. For my current project, however, I need to place the Angular portion of the ...
3
votes
0answers
385 views

Strict-Transport-Security on CloudFront with S3 origin?

My company's site has a static homepage for speed and cost reasons. We use S3 as the origin for CloudFront. Now, we would like to declare Strict-Transport-Security for the entire domain, but S3 seems ...
0
votes
1answer
334 views

Will Amazon S3 comply with the UK Data Protection Act? [closed]

In order for our product to comply with the UK Data Protection Act, one requirement is that our data must be stored within a UK data centre. Is there a facility to configure Amazon S3 to use a ...
-1
votes
1answer
115 views

S3 - File, Compare, Delete [closed]

We're moving 10 Tb of data from local storage to S3. I'm mostly automating the task using s3express. However: the data technicians would like a tool similar to the VisaVersa 'compare' function; The ...
0
votes
1answer
334 views

rebuild yum index on aws s3

I am trying to rebuild yum repo on aws S3 after adding new packages. Here are few commands I am trying, but it is not helping. [root@chucks ~]$ createrepo --baseurl ...
0
votes
1answer
201 views

DNS with name.com and Amazon S3

I have a website on a bucket in Amazon S3, and recently started to get emails from Google "Googlebot can't access your site". When I go to Webmaster Tools and I try to fetch in fact it doesn't work. ...
-2
votes
2answers
729 views

https download file with custom S3 URL

I believe the following question should be asked here and not @Super User. My web application is using S3 for users to download files. Prior customizing the url, files were downloaded from S3 with ...
1
vote
2answers
1k views

regex to match s3 urls in nginx location directive & proxy to amazon s3

In nginx location directive, how do I match s3 urls. for example, the wrong url is: http://example.com/https://s3.amazonaws.com/mybucket/logo.jpg?1404251306 from Logs, I can see nginx can that it ...
9
votes
1answer
9k views

Setting Access-Control-Allow-Origin on Cloudfront

I am having problems serving static assets to Firefox using AWS Cloudfront. Chrome works perfect, but Firefox is returning a CORS error. If I execute curl , I get: HTTP/1.1 200 OK Content-Type: ...
-1
votes
1answer
253 views

“Securely” download a file over https without using authentication

I need to securely download a file over https without using authentication. The reason I need to do this is I want to create a zap at Zapier.com that allows me the copy a file from a https post to my ...
0
votes
1answer
175 views

Access date of Amazon s3 resources

Anyone know of a way to ascertain the last accessed date for s3 files/buckets or if this is even recorded? Doesn't seem visible via the GUI and a basic try of s3cmd and boto shows last modified date ...
1
vote
0answers
56 views

svnadmin dump returns error insufficient disk space

I have a SVN repo that is around 35GB after dumping. I know this is huge, but our business requires that all revisions of all files and libraries be tracked. I have Apache Subversion hosted on an ...
0
votes
1answer
2k views

PHP error logging with AWS and EC2 [closed]

I'm setting up my site to run on AWS EC2. In some presentation for AWS services I saw that there are ways to store your PHP error logs in AWS S3 and analyze it with specific tools. Can't find this ...
4
votes
2answers
420 views

Does Amazon CloudFront charge for storage? [closed]

I've been reviewing the features and prices of Amazon S3 and Amazon CloudFront as well as similar services offered by other providers. One thing I can't understand is why Amazon CloudFront pricing ...
1
vote
1answer
428 views

Backing up onto S3 - do I want to use bucket in a different region?

We are using Amanda to send backups to S3. Each host is acting as its own Amanda "server". All hosts are currently using the same S3-bucket -- each has its own subfolder under it. The dumps are saved ...
3
votes
1answer
2k views

Amazon Cloudfront with S3 Redirect

I'm trying to do something that should be relatively straight-forward - I want to setup a few domains and subdomains to redirect to the core domain for our site, but I want to put the redirects out on ...
2
votes
1answer
2k views

using CloudFormation with an existing S3 bucket

Using CloudFormation, I want to set some of the properties in AWS::S3::Bucket on an existing bucket. In other words, I don't want to create the bucket, I just want to enforce some of the settings. ...
0
votes
1answer
244 views

Back up S3 bucket to another?

I am looking at duply and duplicity currently to mirror one bucket to another but it looks like I may be running in to a brick wall? So far I have been able to get things working backing up local ...
0
votes
1answer
79 views

Best practice for web applications and windows services remote configuration in AWS

we have a distributed system that contains windows services and web applications (.NET and Java based). Currently, most of the initial configuration for these applications are taken from various ...
4
votes
1answer
2k views

What IP range do I ask the system administrator to open in order for S3 to work?

I've written some programs for Raspberry Pi, which some small companies have shown interest in. I sold pre-configured Raspberry Pi:s to them, with my program on them, and it works for everybody except ...
0
votes
1answer
484 views

can't get s3 authentication to work to load data into redshift

I'm working on getting data into a sample Redshift cluster for a client, but I can't get authenticated to S3. There's been a recent change so that my own 'root user' access keys aren't available for ...
0
votes
1answer
3k views

s3cmd: Deleting files or folder does not work

s3cmd s3://MYBUCKET/FOLDER does not work. (folder is empty) s3cmd s3://MYBUCKET/FILE does not work. Output of both commands is "File FILE sucessfully deleted", yet the file remains on the bucket. ...
1
vote
1answer
3k views

How to best backup AWS-hosted systems? [closed]

We are deploying a number of servers at AWS and need to work-out a general-purpose backup strategy. The requirements are: Retain the ability to recover full systems or individual files or ...
0
votes
1answer
1k views

Redirect loop after setting up domains

I migrated domains from a service provider (ipage) to godaddy. The hosting has been setup on AWS S3. I have done such things before and they worked. However this time I'm hitting a redirect loop ...
2
votes
3answers
2k views

how to pipe a mysql dump to s3cmd

I want to transfer a mysql dump, compressed, to s3. I tried: mysqldump -u root -ppassword -all-databases | gzip -9 | s3cmd put s3://bucket/sql/databases.sql.gz but then I get: ERROR: Not enough ...
1
vote
0answers
228 views

Duplicity -> S3 backup failing with “[Errno 105] No buffer space available”

I have a nightly script on my Ubuntu 10.04 VPS which uses duplicity (0.6.24) to run incremental, encrypted backups to Amazon S3. This script had been working until a month or so ago when it started ...