This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

0
votes
1answer
814 views

Anonymous access to S3 bucket only from my EC2 instances

Is there a way to let anonymous access to a certain S3 bucket only from my EC2 instances (all of them) within a single AWS account? I know I can use IAM roles, but I found it's just too many moving ...
0
votes
1answer
29 views

Pricing of Key Pairs and Security Groups on AWS?

My free AWS account expired. I deleted all S3 and EC2 resources, but am wandering if I can leave the Key Pairs and Security Groups without having to pay for them. (My account resources look like this ...
0
votes
1answer
13 views

Redirect warning when running s3cmd sync

When running s3cmd I get a redirect warning as follows: WARNING: Redirected to: xyz.s3-eu-west-1.amazonaws.com The script that produces the warning is this: s3cmd sync /var/backups/db/ ...
0
votes
1answer
27 views

No permissions for files in Amazon s3 for admin

We transferred files from one bucket to another bucket on a separate account with --acl-public as follows: s3cmd cp -v --recursive --acl-public s3://source-geo/webroot s3://dest-geo/webroot/ Now we ...
0
votes
0answers
20 views

Setting cache for already uploaded amazon s3 files

In amazon s3 for our site through s3cmd tool we uploaded around 60GB of files including mp3, jpg to a bucket. But now when we checked site slowness files are not caching and further checking we came ...
1
vote
2answers
292 views

Taking Cassandra Backups

We currently have 12 nodes running in our Cassandra cluster. Ultimately even if a couple of the nodes go down, we're still up and running. The paranoia in me would like to do at least one backup a day ...
1
vote
3answers
1k views

Wildcard Subdomain (*.example.com) with Amazon Route53 DNS and S3

I am hosting a static website using Amazon Route53 for DNS and S3 for html files. It is working fine. Current Setup is: example.com. A ALIAS s3-website-us-east-1.amazonaws.com. www.example.com. ...
53
votes
10answers
37k views

How can I get the size of an Amazon S3 bucket?

I'd like to graph the size (in bytes, and # of items) of an Amazon S3 bucket and am looking for an efficient way to get the data. The s3cmd tools provide a way to get the total file size using s3cmd ...
-1
votes
0answers
14 views

Url rewriting in Amazon S3

I have a webapp hosted in Amazon S3, the webapp is build with jQuery Mobile and I use changePage lo navigate between pages, I'm not using the hash operator(#) when I change the page. I'm having ...
11
votes
3answers
3k views

Any need to make backup of data on Amazon S3?

I'm hosting 200 GB of product images at S3 (this is my primary file host). Do I need to back that data up somewhere else, or is S3 safe as it is? I have been experimenting with mounting the S3 ...
0
votes
1answer
18 views

How to configure Amazon S3 permissions to host files for my mobile app

I have a mobile app that uploads files to a server and needs to be able to download them. I'm using S3 to hold the files, and have a RoR backend to manage all this. Is it possible to have the ...
1
vote
2answers
867 views

s3fs Input/output error

I'm trying to set up a backup system with s3fs and the Amazon S3 service. I followed this this guide and this guide. Tailing /var/log/messages I get: Aug 28 13:37:46 server s3fs:###response=403 I ...
0
votes
0answers
19 views

Override content type headers when using Apache as a reverse proxy

I'm using Apache 2.2 as a reverse proxy in front of my s3 buckets. S3 serve the hosted files with wrong content-type headers. Is there a way to configure Apache to automatically re write the ...
7
votes
5answers
9k views

How can one efficiently use S3 to back up files incrementally?

I understand how rsync works on a high-level, but there are 2 sides. With S3 there is no daemon to speak of — well there is, but it's basically just HTTP. There look to be a few approaches. s3rsync ...
0
votes
1answer
22 views

version id of object in amazon s3 is unique to file, bucket or S3?

The doc says If you enable versioning for a bucket, Amazon S3 automatically generates a unique version ID for the object being stored When versioning is enabled for a bucket, can I say version ...
0
votes
0answers
48 views

Amazon AWS EC2 instance Exported to local machine

I have several Amazon AWS EC2 virtual machines that I created on AWS EC2. They were not imported, they were created there. I would like to export these machines in order to achieve local backups, ...
0
votes
0answers
11 views

AWSCLI s3 sync doesn't create directory

Hi try to sync a local directory to a S3 bucket. The files in the directory get synced perfectly, just the directory isn't created at all. Can you guys give me a hint how to do it? "newdir" contains ...
0
votes
0answers
21 views

IAM user with full s3 access can't create directory

I've a AWS IAM user which has full access to Amazon S3 The policy is the following { "Statement": [ { "Effect": "Allow", "Action": "s3:ListAllMyBuckets", ...
0
votes
1answer
61 views

Load times of S3 Static Website

We have recently decided to move our static single page website to AWS S3, the previous server was hosted by Godaddy(cpanel) in singapore. We are using Synthetics New Relic to monitor our website and ...
2
votes
0answers
36 views

What does a healthy CNAME to an S3 web access bucket look like? [duplicate]

I have feed.foodschmood.com configured according to Amazon's instructions (a CNAME to one of their endpoints, which is itself a CNAME), but I'm skeptical that this is a "proper" configuration. ...
0
votes
1answer
22 views

S3 dropouts in one region only - is this normal?

I'm using S3 to serve static image assets to a website. I'm a developer in Montréal, Quebec. My client's office is in LA. Once every month or three we're seeing S3 completely fail to serve images to ...
2
votes
0answers
31 views

s3 policy for quota

Is there a s3 policy rule that can only allow a user to upload so many GB of files? Basically looking to set a quota on the objects a user can upload. Here is the rule set that I have now: { ...
0
votes
2answers
21 views

Auto scale on Amazon S3 based on transfer

I'm waiting for Account confirmation in Amazon AWS, till then I can't experiment. First of all, I found the docs about auto scaling in Amazon AWS, but all of them mention Amazon EC2, there is no info ...
1
vote
1answer
44 views

What is the best way to backup logs in Amazon S3 in real time? [closed]

I want to backup all my logs in Amazon S3 in real time, which tool I should use?
0
votes
4answers
1k views

Windows with IIS serving ASP files stored at Amazon S3

We have a website that is hosted in Windows Server 2008 R2, with IIS 7.5 The webserver hosts a couple of websites developed with ASP Classic and ASPX Is there a way to host the files for the dynamic ...
0
votes
0answers
39 views

NGINX: proxy_cache altering headers

I have been having trouble building a proxy between my server and s3 to cache requests. I finally boiled it down to a single point of failure... http{ proxy_cache_path /home/cache levels=1:2 ...
0
votes
0answers
34 views

Nginx proxy cache invalidating request to s3

I have set up a proxy from my application server to a private s3 bucket to cache requests. I was having some trouble with it where s3 was rejecting my download requests (403 forbidden) and after some ...
1
vote
1answer
46 views

How to store a Cloudfront custom error page in S3?

I have a Cloudfront plugged on an AWS load balancer. I saw in the AWS documentation that I can customize Cloudfront custom error pages. I tried to store these error pages in S3 as it is recommended ...
0
votes
1answer
31 views

What should an s3 end point look like when configuring an ALIAS record in Route53?

I'm trying to point my root domain to an s3 bucket that redirects to www.mywebsite.com. However, when I try to configure my ALIAS record to point an s3 endpoint, the only endpoint that the dialogue ...
0
votes
0answers
26 views

Benchmark network (internet) connection on server

I have a dedicated ubuntu server I rentet. Now I'm running a lot of ruby background processing on that server, that - among other things - does a lot of get requests to very small images (about 10kb) ...
0
votes
0answers
10 views

Include x-amz-storage-class Header When Calling Amazon S3 from Web.config

Any time my web app calls Amazon S3, it would be nice to conditionally include the following header. I am using a custom domain mapped to an S3 bucket. key: x-amz-storage-class value: ...
0
votes
1answer
53 views

Duplicity Backups (via Duply) to S3 - high server load

We have been doing incremental backups using Duply on our main server, to an S3 bucket. However, we've found that there is a high server load during the backups (its an Amazon EC2 server). We're ...
1
vote
0answers
62 views

s3cmd sync hangs forever. Never finishes

I am trying to backup a directory of around 350GB in size to S3. The command I run is s3cmd --progress -v -H sync /localdir s3://mybucket/ However, the process never moves past INFO: Compiling ...
9
votes
1answer
3k views

Amazon Cloudfront with S3. Access Denied

We're trying to distribute out S3 buckets via Cloudfront but for some reason the only response is an AccessDenied XML document like the following: <Error> ...
0
votes
2answers
78 views

How does my registrar (Namecheap) let me set up a CNAME record on the apex domain?

Namecheap seems to let me create a CNAME record on the apex domain, which I thought was contrary to the definition of a CNAME record: It works (correctly loading up my static site from S3). ...
0
votes
0answers
196 views

s3fs “could not determine how to establish security credentials”

I'm trying to use s3fs to mount an S3 bucket on to a standard AWS Amazon Linux AMI (with all the necessary dependencies installed). However when following this tutorial when I run: s3fs mybucketname ...
0
votes
1answer
125 views

How do I place an SPA in a S3 state website subdirectory using rewrite rules?

I have successfully deployed AngularJS apps to S3 in the past with html5mode enabled in order to allow for hash-less URLs. For my current project, however, I need to place the Angular portion of the ...
1
vote
1answer
214 views

Drop/Truncate DynamoDB table with AWS Data Pipeline

I have set up a Data Pipeline that imports files from an S3 bucket to a DynamoDB table, based on the predefined example. I want to truncate the table (or drop and create a new one) every time the ...
0
votes
0answers
33 views

Strict-Transport-Security on CloudFront with S3 origin?

My company's site has a static homepage for speed and cost reasons. We use S3 as the origin for CloudFront. Now, we would like to declare Strict-Transport-Security for the entire domain, but S3 seems ...
0
votes
0answers
30 views

Move query string to path in proxy - Apache

I am setting up Apache to proxy files from Amazon S3. The initial urls have query strings, but query strings can't be passed to S3, so they are stored as paths with question marks in them (which then ...
0
votes
1answer
53 views

Best practice for web applications and windows services remote configuration in AWS

we have a distributed system that contains windows services and web applications (.NET and Java based). Currently, most of the initial configuration for these applications are taken from various ...
0
votes
1answer
98 views

Will Amazon S3 comply with the UK Data Protection Act? [closed]

In order for our product to comply with the UK Data Protection Act, one requirement is that our data must be stored within a UK data centre. Is there a facility to configure Amazon S3 to use a ...
0
votes
1answer
94 views

rebuild yum index on aws s3

I am trying to rebuild yum repo on aws S3 after adding new packages. Here are few commands I am trying, but it is not helping. [root@chucks ~]$ createrepo --baseurl ...
3
votes
2answers
157 views

S3 based file system capable of requesting only part of file

I'm storing large datasets in s3, but on a given computer in my cluster, my program only needs to read a small subset of the data. I first tried s3fs, but it downlooads the entire file first, which ...
0
votes
1answer
980 views

Setting Access-Control-Allow-Origin on Cloudfront

I am having problems serving static assets to Firefox using AWS Cloudfront. Chrome works perfect, but Firefox is returning a CORS error. If I execute curl , I get: HTTP/1.1 200 OK Content-Type: ...
1
vote
1answer
2k views

How to copy all s3 buckets to another AWS account?

I'm copying all EC2 instances to another AWS account (creating the AMIs, sharing them with that account and running the instances from AMIs there). I also need to move my S3 buckets since the ...
0
votes
0answers
38 views

Nginx serves response with 200 even after calling ngx.exit()

I am trying to serve static content from S3. I am using nginx and lua script for its configuration. I am new to both nginx and lua. The task that I want to achieve is : Get request URL into nginx. ...
6
votes
4answers
3k views

How to move S3 bucket to different location

We use S3 for storing millions of entries in our webapp, now we move the whole thing to EC2, EU servers, and we also want to move that S3 data to EU. But the bucket we use is in US, and there seem to ...
-1
votes
1answer
46 views

S3 - File, Compare, Delete [closed]

We're moving 10 Tb of data from local storage to S3. I'm mostly automating the task using s3express. However: the data technicians would like a tool similar to the VisaVersa 'compare' function; The ...
0
votes
1answer
108 views

DNS with name.com and Amazon S3

I have a website on a bucket in Amazon S3, and recently started to get emails from Google "Googlebot can't access your site". When I go to Webmaster Tools and I try to fetch in fact it doesn't work. ...