This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

2
votes
2answers
412 views

Is there a way to retrieve all contents from a versioned Amazon S3 bucket as of a particular datetime

Is it possible via the AWS CLI or via some third-party tool to easily download all contents of a versioned bucket as it was on a particular datetime? I.E. I would like to retrieve the version of each ...
2
votes
1answer
5k views

How to config Amazon Route53 working without www in sub-domain

edit: Amazon now supports this. http://aws.typepad.com/aws/2012/12/root-domain-website-hosting-for-amazon-s3.html I have my domain config in Route53 at Amazon AWS exec ping command in my domain ...
2
votes
1answer
111 views

Performance issue in using Amazon S3 for run-time updates

I have a web application hosted in Amazon EC2 as well as in Rackspace. Users can upload files through this application and also modify them. Those files are stored in local storage in each of these ...
2
votes
1answer
887 views

Use Microsoft DPM 2010 with Azure or Amazon S3?

Does anyone know of any software that hooks up with Microsoft's DPM 2010 or even the new 2012 to ship data to cloud storage providers like Azure or S3? We utilize D2D backups today but want a more ...
2
votes
1answer
446 views

Hosting animated GIF banners on S3

I have uploaded some animated GIF banners to our S3 account and when we use the web url provided by S3 and try to view the banners in a browser, instead of display the banners in the browsers, I get ...
2
votes
2answers
819 views

How can I secure files on S3?

I want to control who can download a file via an app (as if it was held on the local FS). What's the right approach for doing this, considering S3 can't be mounted as a POSIX compliant file system?
2
votes
3answers
315 views

Bandwidth-friendly backup strategy using tar?

We've used tar to backup and compress (gzip) selected directories on our file server with very good results until recently. Each and every one of our backups are stored on mirrored (RAID) harddrives ...
2
votes
1answer
140 views

Amazon S3 Set Expires header

Is there any way to tell Amazon S3 that all existing and future files in some bucket should have some speicific Expires header?
2
votes
1answer
412 views

Simple command line storage tools for Azure Storage (like s3cmd, sdbShell)?

I'm currently backing up/migrating Amazon S3 and SimpleDB data from AWS to my on premise systems using sdbShell and s3cmd. Works great. Now we're putting an app up on Microsoft Azure and I want to ...
2
votes
1answer
129 views

Easiest way to switch many files to RRS in Amazon S3?

I have an S3 bucket with many thousands of files copied from a linux machine. I would like to switch all files within a folder to RRS (Reduced Redundancy Storage). How can I do this without deleting ...
2
votes
2answers
217 views

Can you have public and private files on the same Cloudfront distribution?

We have files serving through the Cloudfront CDN and we need to have some files to be public and some others to be private. One option would be to have two different buckets and distributions but it ...
2
votes
1answer
602 views

Is any place to change the default ACL to Amazon S3?

I host my image website to Amazon S3, and want keep direct access for everyone. When i upload new file to my S3 bucket, i must change the files acl manual. Is any idea to change the default acl for a ...
2
votes
1answer
505 views

Amazon S3 access control + bandwidth

I'm thinking about maybe using Amazon S3, but have a few questions: does it provide access control to limit GETs? does it provide "high-speed" transfer? I'm looking to serve large files to a vast ...
2
votes
1answer
2k views

What is the best way to copy large files from my workstation to a Windows Server based EC2 instance?

I would like to know if there is a better way to transfer data from my workstation to my Windows based EC2 instance. Currently I am using remote desktop copy/paste, but that is a drag as I always ...
2
votes
1answer
478 views

Amazon S3 Redirect

Is there a way to redirect your domain which you are pointing towards S3 to your home pages? Like I am hosting my videos on Amazon S3 but if someone try to access the my s3.mywebsite.com it result in ...
2
votes
1answer
1k views

CNAME causing “Server Not Found” with AWS S3

I have a goDaddy site with a CNAME record set up to look at a specific bucket in my S3 account. It works fine and loads files without problem. I have a server with SliceHost that has a CNAME record ...
2
votes
0answers
64 views

Set up a different index document per directory with S3 static website hosting

I am using S3 static website hosting, and trying to get the following redirects to work: example.com --> example.com/index.html example.com/foo --> example.com/foo/foo.html example.com/bar ...
2
votes
0answers
19 views

S3 + Cloudflare vs S3 + 2 Web Server + Cloudflate

Currently, I run two websites and each site own it own big server. Currently, all of those two sites has roughly 300GB of images. Its grow rate is 15GB of images per month. I know that eventually, one ...
2
votes
0answers
37 views

Most bandwidth efficient setup for video sharing [closed]

I built a video sharing platform for a popular french podcast I contribute to. Initially I used S3 and linked directly to it, bad idea. Then I used a pull CDN to better optimize my bandwidth, but s3 ...
2
votes
0answers
74 views

Solution for file data backup, versioning and replication

We have a growing set of data files (.wav files, image files etc) which are data, i.e not part of the application code - uploaded and modified by users. The number of files is in the 1000s and the ...
2
votes
0answers
36 views

What does a healthy CNAME to an S3 web access bucket look like? [duplicate]

I have feed.foodschmood.com configured according to Amazon's instructions (a CNAME to one of their endpoints, which is itself a CNAME), but I'm skeptical that this is a "proper" configuration. ...
2
votes
1answer
365 views

Postgresql WAL-E - Replication falling behind + can't catch up

Does anyone know how I can have my replications process the WAL segments faster while using WAL-E? https://github.com/wal-e/wal-e I have one master that leverages WAL-E to upload to S3, and I have 6 ...
2
votes
1answer
449 views

How can I whitelist oubound-from-private-subnet traffic to S3 on the NAT instance of an EC2 VPC?

I'm researching privacy-compliant high-security deployment options for AWS VPC. I'm looking for a method of tightening outbound traffic from the private subnets at the NAT instance. For example, how ...
2
votes
1answer
574 views

How backup files with logrotate and Amazon S3?

I would like to create a new standard of two things: how long would be generated and be rotated the logs generated by my applications ? how to transfer the logs to Amazon S3, as a backup server ?. ...
2
votes
1answer
957 views

Using Amazon s3 and Cloudfront what is the best way to set expires headers and cache expiration

We have a huge bucket of photos on s3. We add and remove from this daily but it currently has millions of photos that we don't want to rewrite or update if possible. We have not set any expires ...
2
votes
1answer
910 views

Best failover strategy for e-mail servers on AWS to ensure high availability

We have our e-mail server hosted on AWS. Last week Amazon had a failure in their East Coast region which brought down our server along with many others. We now want to implement a failover strategy ...
2
votes
1answer
657 views

Amazon S3 Website & MySQL Backup

I have a website (a digital asset management system/gallery - http://www.resourcespace.org) that has a huge amount of images. The total size of the website, including the images is approximately 6gb. ...
2
votes
0answers
219 views

Gluster with s3ql mounted brick?

I am trying to test run Gluster with a volume consisting of two local bricks, the first being a plain directory and the second being a s3ql based mount. Having just the plain directory as a unique ...
2
votes
0answers
369 views

Web-based file manager like File Thingie, but for S3?

At work, we use a little PHP script called File Thingie, which is a web-based file manager. Basically, an FTP replacement. It allows users to upload and download files, and most importantly, it has a ...
2
votes
1answer
546 views

How to access an Eucalyptus Walrus(S3) using Amazon AWS SDK

I have downloaded the Amazon AWS SDK for C#, I have no problem accessing the EC2 part of our private cloud running Eucalyptus, I can list, Images, Instances, Zones ... This is working fine : ...
2
votes
1answer
2k views

Can I share buckets in Amazon S3 so that multiple users see them in their management console?

Using account A, I can add user B to the permissions of a bucket, but that bucket does not then show up in user B's management console. What does it mean to give a user permissions in this way? Is ...
1
vote
4answers
2k views

Most cost efficient way to backup Subversion data to S3?

I'm looking at using S3 as an offsite backup repo for my Subversion database. When I dump my SVN database, it's about 10 gigabytes. I would like to avoid the charge of uploading that data ...
1
vote
1answer
1k views

Is Cloudfront inherently faster than S3 (without considering distance)?

Just a simple question but I can't find a definitive answer online. Of course cloudfront is good for serving content globally, but is the infrastructure there inherently different from s3, so tha even ...
1
vote
2answers
325 views

Amazon cloud: What should I backup exactly?

ec2 Micro type instance comes with only EBS storage - Should I backup everything critical from there? other ec2 instances come with local storage - Should I backup everything critical from there? s3 ...
1
vote
2answers
1k views

Amazon S3 tools for Debian?

I need to (programmatically, in a shell script) upload an EAR file to an Amazon S3 bucket on Debian (5.0.4). What, if any, Debian package provides simple, scriptable tools for that? Ideally this ...
1
vote
2answers
255 views

How does my registrar (Namecheap) let me set up a CNAME record on the apex domain?

Namecheap seems to let me create a CNAME record on the apex domain, which I thought was contrary to the definition of a CNAME record: It works (correctly loading up my static site from S3). ...
1
vote
1answer
745 views

Preventing Amazon S3 Bandwidth Stealing?

I have a Image Hosting Site that is using Amazon S3 as a main source for bandwith and storage. I have a few option here to prevent other sources from stealing my bandwith, but I am hoping there are ...
1
vote
2answers
185 views

How to show a “linked from site X” placeholder instead of actual photo?

I’m hosting a bunch of photos on Amazon S3 and also running Amazon CloudFront for them. Also, I’m running a custom domain name. Now, in case someone tries to embed the image to another website, I’d ...
1
vote
4answers
2k views

CNAME not resolving with nslookup, but dig works

I am trying to point a CNAME to a S3 bucket, but keep having problems with the CNAME not being found by nslookup (and by my browser, for that matter). When I use dig however, it shows me the correct ...
1
vote
2answers
2k views

CloudFlare CDN and static site with root on Amazon S3

I've set up an S3 bucket to host my static site. Now I am trying to wrap CloudFlare around this, but I get the following warning when adding a CNAME entry for the root domain in CloudFlare's DNS ...
1
vote
2answers
700 views

How to get a custom Amazon s3 url?

Right now when I upload a file to my Amazon s3 buckert the url to the file looks like this: https://s3.amazonaws.com/<MY BUCKET NAME>/filename.extension I would like to use something like ...
1
vote
1answer
417 views

Web-based file server solution

Like many companies, we're running a Windows-based file server which all users have access to the root, then each folder is access controlled appropriately. It's behind a VPN and works reasonably ...
1
vote
1answer
664 views

How do I prevent deletion of S3 buckets?

It looks like creating a bucket policy might do the trick, but I am having trouble creating the policy.
1
vote
2answers
796 views

CNAME to S3 not working

I have set up a CNAME record to point to an S3 bucket. It's been up for 4 days, and the results of a DIG Lookup show that it is in place: ;; QUESTION SECTION: ;railroad.odehengineers.com. IN A ...
1
vote
2answers
1k views

How frequently do Amazon CloudFront objects expire?

The answer I can find in the FAQ is as follows An object stays in an edge location until it expires. After the object expires, CloudFront must go back to the origin server the next time that ...
1
vote
1answer
63 views

Locating an AWS S3 physically in a private subnet (like RDS)

Similar to how an RDS instance requires you to pick the specific subnets (which can be in a VPC's private subnet), can AWS S3 stores also be physically located in a VPC's private subnet?
1
vote
1answer
515 views

Drop/Truncate DynamoDB table with AWS Data Pipeline

I have set up a Data Pipeline that imports files from an S3 bucket to a DynamoDB table, based on the predefined example. I want to truncate the table (or drop and create a new one) every time the ...
1
vote
2answers
1k views

Anonymous access to S3 bucket only from my EC2 instances

Is there a way to let anonymous access to a certain S3 bucket only from my EC2 instances (all of them) within a single AWS account? I know I can use IAM roles, but I found it's just too many moving ...
1
vote
3answers
1k views

How should secret files be pushed to an EC2 (on AWS) Ruby on Rails application?

How should secret files be pushed to an EC2 Ruby on Rails application using amazon web services with their elastic beanstalk? I add the files to a git repository, and I push to github, but I want to ...
1
vote
1answer
1k views

Cross Region S3 bucket policy

I would like to allow EC2 servers based in us-east-1 to read content from a bucket in us-west-2. Every time I try I get a "The Bucket you are attempting to access must be addressed using the ...