This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

2
votes
1answer
430 views

Hosting animated GIF banners on S3

I have uploaded some animated GIF banners to our S3 account and when we use the web url provided by S3 and try to view the banners in a browser, instead of display the banners in the browsers, I get ...
2
votes
2answers
811 views

How can I secure files on S3?

I want to control who can download a file via an app (as if it was held on the local FS). What's the right approach for doing this, considering S3 can't be mounted as a POSIX compliant file system?
2
votes
3answers
312 views

Bandwidth-friendly backup strategy using tar?

We've used tar to backup and compress (gzip) selected directories on our file server with very good results until recently. Each and every one of our backups are stored on mirrored (RAID) harddrives ...
2
votes
1answer
137 views

Amazon S3 Set Expires header

Is there any way to tell Amazon S3 that all existing and future files in some bucket should have some speicific Expires header?
2
votes
1answer
406 views

Simple command line storage tools for Azure Storage (like s3cmd, sdbShell)?

I'm currently backing up/migrating Amazon S3 and SimpleDB data from AWS to my on premise systems using sdbShell and s3cmd. Works great. Now we're putting an app up on Microsoft Azure and I want to ...
2
votes
1answer
129 views

Easiest way to switch many files to RRS in Amazon S3?

I have an S3 bucket with many thousands of files copied from a linux machine. I would like to switch all files within a folder to RRS (Reduced Redundancy Storage). How can I do this without deleting ...
2
votes
2answers
215 views

Can you have public and private files on the same Cloudfront distribution?

We have files serving through the Cloudfront CDN and we need to have some files to be public and some others to be private. One option would be to have two different buckets and distributions but it ...
2
votes
1answer
589 views

Is any place to change the default ACL to Amazon S3?

I host my image website to Amazon S3, and want keep direct access for everyone. When i upload new file to my S3 bucket, i must change the files acl manual. Is any idea to change the default acl for a ...
2
votes
1answer
503 views

Amazon S3 access control + bandwidth

I'm thinking about maybe using Amazon S3, but have a few questions: does it provide access control to limit GETs? does it provide "high-speed" transfer? I'm looking to serve large files to a vast ...
2
votes
1answer
2k views

What is the best way to copy large files from my workstation to a Windows Server based EC2 instance?

I would like to know if there is a better way to transfer data from my workstation to my Windows based EC2 instance. Currently I am using remote desktop copy/paste, but that is a drag as I always ...
2
votes
1answer
476 views

Amazon S3 Redirect

Is there a way to redirect your domain which you are pointing towards S3 to your home pages? Like I am hosting my videos on Amazon S3 but if someone try to access the my s3.mywebsite.com it result in ...
2
votes
1answer
1k views

CNAME causing “Server Not Found” with AWS S3

I have a goDaddy site with a CNAME record set up to look at a specific bucket in my S3 account. It works fine and loads files without problem. I have a server with SliceHost that has a CNAME record ...
2
votes
0answers
36 views

Most bandwidth efficient setup for video sharing [closed]

I built a video sharing platform for a popular french podcast I contribute to. Initially I used S3 and linked directly to it, bad idea. Then I used a pull CDN to better optimize my bandwidth, but s3 ...
2
votes
0answers
68 views

Solution for file data backup, versioning and replication

We have a growing set of data files (.wav files, image files etc) which are data, i.e not part of the application code - uploaded and modified by users. The number of files is in the 1000s and the ...
2
votes
0answers
36 views

What does a healthy CNAME to an S3 web access bucket look like? [duplicate]

I have feed.foodschmood.com configured according to Amazon's instructions (a CNAME to one of their endpoints, which is itself a CNAME), but I'm skeptical that this is a "proper" configuration. ...
2
votes
0answers
162 views

s3 policy for quota

Is there a s3 policy rule that can only allow a user to upload so many GB of files? Basically looking to set a quota on the objects a user can upload. Here is the rule set that I have now: { ...
2
votes
1answer
353 views

Postgresql WAL-E - Replication falling behind + can't catch up

Does anyone know how I can have my replications process the WAL segments faster while using WAL-E? https://github.com/wal-e/wal-e I have one master that leverages WAL-E to upload to S3, and I have 6 ...
2
votes
0answers
427 views

How can I whitelist oubound-from-private-subnet traffic to S3 on the NAT instance of an EC2 VPC?

I'm researching privacy-compliant high-security deployment options for AWS VPC. I'm looking for a method of tightening outbound traffic from the private subnets at the NAT instance. For example, how ...
2
votes
1answer
556 views

How backup files with logrotate and Amazon S3?

I would like to create a new standard of two things: how long would be generated and be rotated the logs generated by my applications ? how to transfer the logs to Amazon S3, as a backup server ?. ...
2
votes
1answer
941 views

Using Amazon s3 and Cloudfront what is the best way to set expires headers and cache expiration

We have a huge bucket of photos on s3. We add and remove from this daily but it currently has millions of photos that we don't want to rewrite or update if possible. We have not set any expires ...
2
votes
1answer
886 views

Best failover strategy for e-mail servers on AWS to ensure high availability

We have our e-mail server hosted on AWS. Last week Amazon had a failure in their East Coast region which brought down our server along with many others. We now want to implement a failover strategy ...
2
votes
1answer
648 views

Amazon S3 Website & MySQL Backup

I have a website (a digital asset management system/gallery - http://www.resourcespace.org) that has a huge amount of images. The total size of the website, including the images is approximately 6gb. ...
2
votes
0answers
216 views

Gluster with s3ql mounted brick?

I am trying to test run Gluster with a volume consisting of two local bricks, the first being a plain directory and the second being a s3ql based mount. Having just the plain directory as a unique ...
2
votes
0answers
359 views

Web-based file manager like File Thingie, but for S3?

At work, we use a little PHP script called File Thingie, which is a web-based file manager. Basically, an FTP replacement. It allows users to upload and download files, and most importantly, it has a ...
2
votes
1answer
539 views

How to access an Eucalyptus Walrus(S3) using Amazon AWS SDK

I have downloaded the Amazon AWS SDK for C#, I have no problem accessing the EC2 part of our private cloud running Eucalyptus, I can list, Images, Instances, Zones ... This is working fine : ...
2
votes
1answer
2k views

Can I share buckets in Amazon S3 so that multiple users see them in their management console?

Using account A, I can add user B to the permissions of a bucket, but that bucket does not then show up in user B's management console. What does it mean to give a user permissions in this way? Is ...
1
vote
4answers
2k views

Most cost efficient way to backup Subversion data to S3?

I'm looking at using S3 as an offsite backup repo for my Subversion database. When I dump my SVN database, it's about 10 gigabytes. I would like to avoid the charge of uploading that data ...
1
vote
1answer
1k views

Is Cloudfront inherently faster than S3 (without considering distance)?

Just a simple question but I can't find a definitive answer online. Of course cloudfront is good for serving content globally, but is the infrastructure there inherently different from s3, so tha even ...
1
vote
2answers
323 views

Amazon cloud: What should I backup exactly?

ec2 Micro type instance comes with only EBS storage - Should I backup everything critical from there? other ec2 instances come with local storage - Should I backup everything critical from there? s3 ...
1
vote
2answers
1k views

Amazon S3 tools for Debian?

I need to (programmatically, in a shell script) upload an EAR file to an Amazon S3 bucket on Debian (5.0.4). What, if any, Debian package provides simple, scriptable tools for that? Ideally this ...
1
vote
2answers
241 views

How does my registrar (Namecheap) let me set up a CNAME record on the apex domain?

Namecheap seems to let me create a CNAME record on the apex domain, which I thought was contrary to the definition of a CNAME record: It works (correctly loading up my static site from S3). ...
1
vote
1answer
724 views

Preventing Amazon S3 Bandwidth Stealing?

I have a Image Hosting Site that is using Amazon S3 as a main source for bandwith and storage. I have a few option here to prevent other sources from stealing my bandwith, but I am hoping there are ...
1
vote
2answers
183 views

How to show a “linked from site X” placeholder instead of actual photo?

I’m hosting a bunch of photos on Amazon S3 and also running Amazon CloudFront for them. Also, I’m running a custom domain name. Now, in case someone tries to embed the image to another website, I’d ...
1
vote
4answers
2k views

CNAME not resolving with nslookup, but dig works

I am trying to point a CNAME to a S3 bucket, but keep having problems with the CNAME not being found by nslookup (and by my browser, for that matter). When I use dig however, it shows me the correct ...
1
vote
2answers
2k views

CloudFlare CDN and static site with root on Amazon S3

I've set up an S3 bucket to host my static site. Now I am trying to wrap CloudFlare around this, but I get the following warning when adding a CNAME entry for the root domain in CloudFlare's DNS ...
1
vote
2answers
663 views

How to get a custom Amazon s3 url?

Right now when I upload a file to my Amazon s3 buckert the url to the file looks like this: https://s3.amazonaws.com/<MY BUCKET NAME>/filename.extension I would like to use something like ...
1
vote
1answer
413 views

Web-based file server solution

Like many companies, we're running a Windows-based file server which all users have access to the root, then each folder is access controlled appropriately. It's behind a VPN and works reasonably ...
1
vote
1answer
628 views

How do I prevent deletion of S3 buckets?

It looks like creating a bucket policy might do the trick, but I am having trouble creating the policy.
1
vote
2answers
787 views

CNAME to S3 not working

I have set up a CNAME record to point to an S3 bucket. It's been up for 4 days, and the results of a DIG Lookup show that it is in place: ;; QUESTION SECTION: ;railroad.odehengineers.com. IN A ...
1
vote
2answers
1k views

How frequently do Amazon CloudFront objects expire?

The answer I can find in the FAQ is as follows An object stays in an edge location until it expires. After the object expires, CloudFront must go back to the origin server the next time that ...
1
vote
1answer
470 views

Drop/Truncate DynamoDB table with AWS Data Pipeline

I have set up a Data Pipeline that imports files from an S3 bucket to a DynamoDB table, based on the predefined example. I want to truncate the table (or drop and create a new one) every time the ...
1
vote
3answers
1k views

How should secret files be pushed to an EC2 (on AWS) Ruby on Rails application?

How should secret files be pushed to an EC2 Ruby on Rails application using amazon web services with their elastic beanstalk? I add the files to a git repository, and I push to github, but I want to ...
1
vote
1answer
1k views

Cross Region S3 bucket policy

I would like to allow EC2 servers based in us-east-1 to read content from a bucket in us-west-2. Every time I try I get a "The Bucket you are attempting to access must be addressed using the ...
1
vote
1answer
334 views

Creating url from the cloudfront aws

I have my js files which I have uploaded into the Amazon S3 and linked it with the Cloudfront. I got a url something like this : dxxxxxxxx.cloudfront.net But opening that url in my browser ( I'm ...
1
vote
2answers
217 views

Store profile image of all users into single directory or per subdirectory id?

I'm using amazon s3 as storage for users profile pic. I see that many websites generates large random filenames and put them into the same root directory like: ...
1
vote
3answers
383 views

Backing up data (including mysqldumps) to S3

We have a web app on a number of servers and we want to add an additional layer of redundancy by backing up the key data to S3. The key data is the MySQL database and a folder containing dynamically ...
1
vote
1answer
208 views

How to configure S3 or DNS to handle incomplete name (sans www) for web site?

I have a set up a bucket called "www.mydomainname.com" to host my website and I have configured the CNAME such that "www.mydomainname.com" points to the my endopint ...
1
vote
1answer
1k views

Mounting an S3 bucket onto a AWS Ubuntu instance issues

i'm using s3fuse to mount an s3 bucket onto ubuntu, so that i can take advantage of the storage space. here are some environment info: System Info: Linux ip-xxx-xxx-xxx-xxx 2.6.38-8-virtual ...
1
vote
1answer
120 views

Cname and Amazon S3 failure

I had a quick question. If you set up a cname for your amazon bucket and lets say your main amazon s3 bucket goes down, does cname you created serve files, in other words, do your files get redirected ...
1
vote
4answers
568 views

Good simple VPS to S3 Backup scripts?

anyone has a nice, simple script for backing up a VPS to a S3 bucket? can be ruby, python, whatever... should be easy to configure! thanks