This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

2
votes
1answer
400 views

How backup files with logrotate and Amazon S3?

I would like to create a new standard of two things: how long would be generated and be rotated the logs generated by my applications ? how to transfer the logs to Amazon S3, as a backup server ?. ...
2
votes
1answer
784 views

Using Amazon s3 and Cloudfront what is the best way to set expires headers and cache expiration

We have a huge bucket of photos on s3. We add and remove from this daily but it currently has millions of photos that we don't want to rewrite or update if possible. We have not set any expires ...
2
votes
1answer
581 views

Amazon S3 Website & MySQL Backup

I have a website (a digital asset management system/gallery - http://www.resourcespace.org) that has a huge amount of images. The total size of the website, including the images is approximately 6gb. ...
2
votes
0answers
201 views

Gluster with s3ql mounted brick?

I am trying to test run Gluster with a volume consisting of two local bricks, the first being a plain directory and the second being a s3ql based mount. Having just the plain directory as a unique ...
2
votes
0answers
298 views

Web-based file manager like File Thingie, but for S3?

At work, we use a little PHP script called File Thingie, which is a web-based file manager. Basically, an FTP replacement. It allows users to upload and download files, and most importantly, it has a ...
2
votes
1answer
510 views

How to access an Eucalyptus Walrus(S3) using Amazon AWS SDK

I have downloaded the Amazon AWS SDK for C#, I have no problem accessing the EC2 part of our private cloud running Eucalyptus, I can list, Images, Instances, Zones ... This is working fine : ...
2
votes
1answer
1k views

Can I share buckets in Amazon S3 so that multiple users see them in their management console?

Using account A, I can add user B to the permissions of a bucket, but that bucket does not then show up in user B's management console. What does it mean to give a user permissions in this way? Is ...
1
vote
4answers
2k views

Most cost efficient way to backup Subversion data to S3?

I'm looking at using S3 as an offsite backup repo for my Subversion database. When I dump my SVN database, it's about 10 gigabytes. I would like to avoid the charge of uploading that data ...
1
vote
1answer
1k views

Is Cloudfront inherently faster than S3 (without considering distance)?

Just a simple question but I can't find a definitive answer online. Of course cloudfront is good for serving content globally, but is the infrastructure there inherently different from s3, so tha even ...
1
vote
5answers
3k views

Should I persist images on EBS or S3?

I am migrating my Java,Tomcat, Mysql server to AWS EC2. I have already attached EBS volume for storing Mysql data. In my web application people may upload images. So I should persist them. There ...
1
vote
2answers
321 views

Amazon cloud: What should I backup exactly?

ec2 Micro type instance comes with only EBS storage - Should I backup everything critical from there? other ec2 instances come with local storage - Should I backup everything critical from there? s3 ...
1
vote
2answers
1k views

Amazon S3 tools for Debian?

I need to (programmatically, in a shell script) upload an EAR file to an Amazon S3 bucket on Debian (5.0.4). What, if any, Debian package provides simple, scriptable tools for that? Ideally this ...
1
vote
1answer
603 views

Preventing Amazon S3 Bandwidth Stealing?

I have a Image Hosting Site that is using Amazon S3 as a main source for bandwith and storage. I have a few option here to prevent other sources from stealing my bandwith, but I am hoping there are ...
1
vote
2answers
172 views

How to show a “linked from site X” placeholder instead of actual photo?

I’m hosting a bunch of photos on Amazon S3 and also running Amazon CloudFront for them. Also, I’m running a custom domain name. Now, in case someone tries to embed the image to another website, I’d ...
1
vote
4answers
1k views

CNAME not resolving with nslookup, but dig works

I am trying to point a CNAME to a S3 bucket, but keep having problems with the CNAME not being found by nslookup (and by my browser, for that matter). When I use dig however, it shows me the correct ...
1
vote
2answers
1k views

CloudFlare CDN and static site with root on Amazon S3

I've set up an S3 bucket to host my static site. Now I am trying to wrap CloudFlare around this, but I get the following warning when adding a CNAME entry for the root domain in CloudFlare's DNS ...
1
vote
2answers
515 views

How to get a custom Amazon s3 url?

Right now when I upload a file to my Amazon s3 buckert the url to the file looks like this: https://s3.amazonaws.com/<MY BUCKET NAME>/filename.extension I would like to use something like ...
1
vote
1answer
474 views

How do I prevent deletion of S3 buckets?

It looks like creating a bucket policy might do the trick, but I am having trouble creating the policy.
1
vote
2answers
1k views

How frequently do Amazon CloudFront objects expire?

The answer I can find in the FAQ is as follows An object stays in an edge location until it expires. After the object expires, CloudFront must go back to the origin server the next time that ...
1
vote
3answers
1k views

How should secret files be pushed to an EC2 (on AWS) Ruby on Rails application?

How should secret files be pushed to an EC2 Ruby on Rails application using amazon web services with their elastic beanstalk? I add the files to a git repository, and I push to github, but I want to ...
1
vote
1answer
971 views

Cross Region S3 bucket policy

I would like to allow EC2 servers based in us-east-1 to read content from a bucket in us-west-2. Every time I try I get a "The Bucket you are attempting to access must be addressed using the ...
1
vote
1answer
294 views

Creating url from the cloudfront aws

I have my js files which I have uploaded into the Amazon S3 and linked it with the Cloudfront. I got a url something like this : dxxxxxxxx.cloudfront.net But opening that url in my browser ( I'm ...
1
vote
2answers
176 views

Store profile image of all users into single directory or per subdirectory id?

I'm using amazon s3 as storage for users profile pic. I see that many websites generates large random filenames and put them into the same root directory like: ...
1
vote
3answers
358 views

Backing up data (including mysqldumps) to S3

We have a web app on a number of servers and we want to add an additional layer of redundancy by backing up the key data to S3. The key data is the MySQL database and a folder containing dynamically ...
1
vote
1answer
202 views

How to configure S3 or DNS to handle incomplete name (sans www) for web site?

I have a set up a bucket called "www.mydomainname.com" to host my website and I have configured the CNAME such that "www.mydomainname.com" points to the my endopint ...
1
vote
1answer
1k views

Mounting an S3 bucket onto a AWS Ubuntu instance issues

i'm using s3fuse to mount an s3 bucket onto ubuntu, so that i can take advantage of the storage space. here are some environment info: System Info: Linux ip-xxx-xxx-xxx-xxx 2.6.38-8-virtual ...
1
vote
1answer
118 views

Cname and Amazon S3 failure

I had a quick question. If you set up a cname for your amazon bucket and lets say your main amazon s3 bucket goes down, does cname you created serve files, in other words, do your files get redirected ...
1
vote
1answer
263 views

Change Amazon S3 storage class on A LOT of files

We are using Amazon S3 and a great deal of our files have the STANDARD storage class. We want to change this to REDUCED_REDUNDANCY class to save the extra money. However, is has been hard to find a ...
1
vote
1answer
375 views

Web-based file server solution

Like many companies, we're running a Windows-based file server which all users have access to the root, then each folder is access controlled appropriately. It's behind a VPN and works reasonably ...
1
vote
3answers
525 views

Good simple VPS to S3 Backup scripts?

anyone has a nice, simple script for backing up a VPS to a S3 bucket? can be ruby, python, whatever... should be easy to configure! thanks
1
vote
3answers
1k views

uploading to amazon s3 using lftp

Is it possible to upload files from an ftp to an amazon s3 bucket using lftp? I tend to run this from an ec2 instance.
1
vote
2answers
2k views

Amazon EC2 migration from one region to the other

I'm using the following Amazon EC2 resources in the US East (Virginia) region: 1 Running Instance 1 Elastic IP 2 EBS Volumes 100 EBS Snapshots 1 Key Pair 2 Security Groups 5 My Own AMIs (customized ...
1
vote
2answers
693 views

Can I have SFTP for my domain resolve to a different host

OK, this is probably a really basic DNS question, so sorry... My small one-person company's domain, mikekellyconsulting.com, is hosted by Web.COM (a/k/a Interland) on a Windows hosting plan. ...
1
vote
1answer
3k views

Using .htaccess to serve files from Amazon S3 CloudFront

My ideal setup would be to take a current clients site, upload a .htaccess with a regex inside, that would match the URI, and if it finds a certain file extension, it would use the same path, but with ...
1
vote
2answers
207 views

Updateing files on Amazon’s CDN

is there any way to update files stored on Amazon's CDN service? Seems like it won't take any update of a file we make (eg. removing the file and storing the new one with the same file name as ...
1
vote
2answers
27 views

Auto scale on Amazon S3 based on transfer

I'm waiting for Account confirmation in Amazon AWS, till then I can't experiment. First of all, I found the docs about auto scaling in Amazon AWS, but all of them mention Amazon EC2, there is no info ...
1
vote
1answer
6k views

What is causing Access Denied when using the aws cli to download from Amazon S3?

I'm really flailing around in AWS trying to figure out what I'm missing here. I'd like to make it so that an IAM user can download files from an S3 bucket - without just making the files totally ...
1
vote
3answers
241 views

Hosting a site on Amazon S3, URL keeps redirecting

I am trying to use Amazon S3 to host my webiste. I have the domain registered though namecheap. Whenever I navigate to mywebsite.com the URL in the browser changes to ...
1
vote
1answer
499 views

How can I download an S3 binary file using Amazon's AWS CLI tool?

I am trying to download a binary file from an AWS S3 bucket using Amazon's new command-line interface. However, the tool responds with an error message. $ aws s3 get-object --bucket myBucketName ...
1
vote
2answers
226 views

Is it safe to use S3 over HTTP from EC2, as opposed to HTTPS

I found that there is a fair deal of overhead when uploading a lot of small files to S3. Some of this overhead comes from SSL itself. How safe is it to talk to S3 without SSL when running in EC2? ...
1
vote
1answer
283 views

Can a S3 mount be used as the document root for Apache?

Has anyone been successful in having their DocumentRoot reside on an S3 mount (using s3fs)? I currently have a mounted bucket at /mnt/s3. I can read and write files to it no problem. In my ...
1
vote
1answer
2k views

AWS - Status check fails when loading AMI created from snapshot

I have a running micro instance using an 8GB EBS that I've customized. To my understand there are two ways I can create an AMI from this. 1) EC2 console -> INSTANCES - Instances -> Right Click ...
1
vote
2answers
314 views

Configure non-destructive Amazon S3 bucket policy

There's a bucket into which some users may write their data for backup purposes. They use s3cmd to put new files into their bucket. I'd like to enforce a non-destruction policy on these buckets - ...
1
vote
2answers
76 views

Cloud storage options for client downloads

I'm looking for a way to distribute sample files to clients. Requirement is that it's (relatively) simple to upload files, a link can be sent to a client who can download the file with a browser, the ...
1
vote
4answers
355 views

Best practice for synchronizing sources across servers (Amazon EC2)

I'm moving from single app server to load balanced config. In the single server config I synchronized the sources by S3 cmd sync s3 every few minutes and on hostup (Scalr event) I sync the sources ...
1
vote
3answers
209 views

Is it secure to upload all kinds of file in website?

we have a website that allow the user to upload the files.Now if I am allowing the user to upload all the file extensions without restricting them is it secure?I am restricting only by the file size ...
1
vote
1answer
1k views

Using URL Rewrite to remap local image folder to an S3 bucket

I'm trying to implmenet a scenerio where my website's images are stored in an Amazon S3 bucket. So far, i've setup the bucket and the CNAME record so that images are correctly served from S3 via the ...
1
vote
1answer
255 views

S3 upload delayed

I have 2 servers using the same data located in AWS S3 storage. One is processing HTTP traffic, the other does longer lived jobs. How it works is that HTTP one saves data to S3, dispatches event to ...
1
vote
1answer
2k views

Cannot upload files bigger than 8GB to Amazon S3 by multi-part upload due to broken pipe

I implemented S3 multi-part upload, both high level and low level version, based on the sample code from http://docs.amazonwebservices.com/AmazonS3/latest/dev/index.html?HLuploadFileJava.html and ...
1
vote
1answer
692 views

Where would an S3 upload speed cap originate?

I do a ton of uploading to S3 and am experiencing capped speeds and I can't quite figure out how to address it. The setup: Windows Server 2008 R2 x64, external HD, using a Java based upload tool ...