This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

0
votes
1answer
147 views

Amazon S3 map url to backend server like Apache's <Location /api> ProxyPass

Is there a way to map a URL to a backend server in S3. I am not looking for redirects, but something on the lines of Apache's Location directive with ProxyPass. ...
3
votes
0answers
880 views

Amazon S3 + Cloudfront VS Rackspace CloudFiles

I know this question came up lot of time on the internet , But I couldn't find any latest updates on this . So I gathered the information what I found and putting here and have few questions on it . ...
1
vote
2answers
894 views

CloudFlare CDN and static site with root on Amazon S3

I've set up an S3 bucket to host my static site. Now I am trying to wrap CloudFlare around this, but I get the following warning when adding a CNAME entry for the root domain in CloudFlare's DNS ...
1
vote
1answer
212 views

Automatically sync git repo to Amazon S3 site

I'm using an Amazon S3 site to host a website. I'm aiming to use a git repo to store the content and versioning and I'd like the repo to automatically update the S3 site once something is checked into ...
2
votes
1answer
785 views

What is your general strategy to backup S3 buckets?

We are starting a project which involves storing large data quantities in S3. S3 is good at scaling and we've expect to have up to 5TB and million of files in bucket. While i may trust Amazon in ...
0
votes
1answer
97 views

S3 bucket alias

I have a S3 bucket called "abcd" that I would like to map to a subdomain, "abcd.mydomain.com", using a CNAME. Unfortunately I can't move files from the original "abcd" bucket to a new ...
0
votes
1answer
297 views

AWS EC2 Mailserver Failover Strategies done right

I'm researching in this topic really hard the last few days and i just want to discuss this with a few specific questions - i did not find any suitable thread here that is covering my needs and ...
0
votes
1answer
108 views

How continue sync with S3CMD after broken connection?

I'm using s3cmd to backup some logs into Amazon S3 buckets. Which is a great tool. But I notice that, very often, my sync's are broken, they just cancel and try to upload again, until they can upload ...
0
votes
0answers
254 views

s3cmd fails to put files

I'm trying to put mysql dump file on s3 bucket. It gives an error like ; sudo ./backup.sh WARNING: Module python-magic is not available. Guessing MIME types based on file extensions. ...
0
votes
0answers
32 views

Cloudformation Resource for a Cross Region S3 bucket policy [duplicate]

I know this is somewhat a duplicate of Cross Region S3 bucket policy but I don't have enough rep to comment and the answer wasn't detailed enough. I would like to allow EC2 servers based in ...
3
votes
2answers
238 views

Storing and serving files securely for multiple clients

We are working on a web app, where (among other features) our users can upload their files. However we can't store these files on our VPS because storage space is limited, so we decided to go with S3. ...
0
votes
1answer
35 views

To run python script when my Amazon instance boots up

Where should i place my script in amazon instance such that my script should run when my instance boots up? I tried placing it in rc.local but it didnt help. My script is about connecting to Amazon ...
0
votes
1answer
283 views

Unable to read S3 file from interactive pig job flow

I'm unable to read a simple test file on S3 from an interactive pig job flow (hadoop, elastic map reduce), and I'm not sure why. I have two S3 buckets. Let's call them unmounted_bucket, and ...
2
votes
1answer
300 views

How backup files with logrotate and Amazon S3?

I would like to create a new standard of two things: how long would be generated and be rotated the logs generated by my applications ? how to transfer the logs to Amazon S3, as a backup server ?. ...
0
votes
2answers
1k views

Create 301 Redirection in Amazon Route 53 for Wildcard Subdomains

My domain name hosted on Route 53 DNS. Amazon has a guide to do 301 redirection for www. To naked domain by point www. version to a S3 static website with 301 setted up. My question is, how can I ...
0
votes
1answer
216 views

Configure subdomain to point to S3 bucket using Route 53

How would I go about mapping files.example.com to an Amazon S3 bucket using Amazon's Route 53 service? I've attempted to add a CNAME record but I get the following:
1
vote
1answer
226 views

Taking Cassandra Backups

We currently have 12 nodes running in our Cassandra cluster. Ultimately even if a couple of the nodes go down, we're still up and running. The paranoia in me would like to do at least one backup a day ...
1
vote
1answer
372 views

How can I download an S3 binary file using Amazon's AWS CLI tool?

I am trying to download a binary file from an AWS S3 bucket using Amazon's new command-line interface. However, the tool responds with an error message. $ aws s3 get-object --bucket myBucketName ...
0
votes
0answers
422 views

How can I move s3 objects >5gb from one bucket to another?

Objects larger than 5GB are supported with multi-part uploading. We have 5gb+ files in one bucket already that I'd like to move to another, under the same AWS account. When I issue the command using ...
-2
votes
1answer
147 views

Which is better - AWS S3 or EBS? [closed]

I am trying to create a system where users can upload their data (audio, text) which can run into around 200 MB per user. I am trying to figure out what is the best way to go ahead - using S3 or EBS. ...
0
votes
1answer
79 views

Empty /mnt: store-backed instance launch from EBS-backed AMI

I have an EBS AMI which I want to publish in AWS Market Place. The AMI was created with data in /mnt. The snapshop includes both /dev/sda1 and /dev/sdb devices : Block Devices: ...
0
votes
1answer
104 views

Copy files over to s3 from ec2 instance

I have an FTP running on my ec2 instance and I'll like to move over those files (after some processing) to s3. Lots of posts on this to either use the Amazon .NET, php or python APIs or use a 3rd ...
0
votes
1answer
121 views

What sort of delay is there between reading an Amazon S3 object from an EC3 instance

I have a REST web service that contains a /image/view/ resource that displays an image. The image is currently stored as an object in Amazon S3. When /image/view/ is accessed, the web service ...
0
votes
1answer
102 views

autoscale static content on ec2 using local cache

Hello Serverfault members. I want to achieve the following setup on EC2: A load balancer starts and stops instances which only serve static content. (a javascript based application) I do not want to ...
0
votes
0answers
202 views

Getting a simple list of changed files from unison

I have a filesystem that is changed on two servers and also needs to be replicated to Amazon S3. Until recently, syncing the filesystem between the two servers using Unison, and then copying to S3 ...
2
votes
2answers
1k views

Create an Amazon EC2 instance with automatic access to private S3

I was wondering. Say I have a file in a private S3 bucket, and I then deploy an EC2 instance which has something like that in its rc.local: GET http://privateamazons3url.com How can I make it so ...
0
votes
1answer
204 views

Mounting a S3 bucket across multiple instances

I want to use Amazon S3 to store all of my files for my websites. I can set S3QL up properly so that it is mounted on /var/www and everything works fine. I want to do it this way so that I can ...
0
votes
2answers
408 views

Mixed Static and dynamic content site using AWS S3 and EC2

We are installing a Java web application in a EC2 running Tomcat. The application uses a folder for users pictures (static content)-> www.example.com/PICTURES We use mod_jk to exclude Tomcat from ...
4
votes
1answer
103 views

Is Amazon s3 required if am using Cloudfront for files

I am planning to host a website in Amazon Ec2 instant. I got some basics from the docs. But I have few confusions. If am using cloudfront for CDN, do i really need to server files from s3? The site ...
0
votes
1answer
343 views

s3cmd put only files that do not exist in destination bucket

I've been using s3cmd to sync local files on our server with the S3 bucket. There are over 200,000 files on the local server. Can't seem to find any documentation on the site that explains how to ...
0
votes
1answer
243 views

Amazon AWS Store Wordpress uploads on S3

I'm getting ready to move my company's website and order management application to AWS. We use wordpress as the 'face' of our company. Our order management app is for internal use. I'm using Elastic ...
3
votes
1answer
935 views

Setting up CloudFront CDN on a cookieless root domain

I have recently set up an AWS S3 bucket for my site's static content, along w/ a CloudFront distribution for my CDN. I have this working using a sub-domain. However, after running YSlow, I realized ...
2
votes
1answer
2k views

How to replace php.ini on elastic beanstalk EC2 instances for PHP?

I have been exploring Elastic Beanstalk for easy deployment of my PHP 5.4 application. For my application, I need to make changes in php.ini file. After some searching on internet i tried to use ...
0
votes
4answers
808 views

Windows with IIS serving ASP files stored at Amazon S3

We have a website that is hosted in Windows Server 2008 R2, with IIS 7.5 The webserver hosts a couple of websites developed with ASP Classic and ASPX Is there a way to host the files for the dynamic ...
2
votes
1answer
579 views

Using Amazon s3 and Cloudfront what is the best way to set expires headers and cache expiration

We have a huge bucket of photos on s3. We add and remove from this daily but it currently has millions of photos that we don't want to rewrite or update if possible. We have not set any expires ...
0
votes
2answers
227 views

Amazon Cloudfront, S3 and EC2

I'm trying to use Amazon Cloudfront as a CDN provider but unsure of what other services are meant to be. Do I have to use S3 and EC2 as Virtual Server to host my files and change hosting provider in ...
0
votes
1answer
222 views

Upload database backup from mysql to Amazon S3 or Glacier without creating local file

Is there a tool that makes possible to backup a Mysql database to Amazon S3 or Amazon Glacier without having o create a local file with the database contents? Something like that: mysqldump -u ...
1
vote
3answers
825 views

How should secret files be pushed to an EC2 (on AWS) Ruby on Rails application?

How should secret files be pushed to an EC2 Ruby on Rails application using amazon web services with their elastic beanstalk? I add the files to a git repository, and I push to github, but I want to ...
0
votes
0answers
81 views

Amazon S3 - Storage Class and Server Side Encryption

Ahhh! I am using Amazon S3 for some low price storage to clear down out SAN. I created the bucket and created a root folder. I set the storage class to standard and server side encryption AES. I ...
0
votes
1answer
113 views

Subsequent runs of rsync locally don't reduce data transferred

I have an EC2 instance with data I want to sync to a mounted, but remote, volume, as a backup. rsync seems like the way to go with this, so as a test I took my test file (a Postgres pg_dump file) and ...
1
vote
1answer
657 views

Cross Region S3 bucket policy

I would like to allow EC2 servers based in us-east-1 to read content from a bucket in us-west-2. Every time I try I get a "The Bucket you are attempting to access must be addressed using the ...
2
votes
1answer
137 views

How do I implement IP-based export restrictions for my data stored on Amazon S3?

A little background: Corporate wants to make our downloads unavailable to U.S. export-restricted countries like North Korea, Iran, Syria, etc. Restriction by IP-block is considered good enough. (Yes, ...
0
votes
1answer
130 views

configure s3fs mount for write-only

I am using s3fs to mount a S3 buckets on an Ubunutu server to store my daily backups there. Considering security this would allow a potential hacker to delete all my backups from the mounted bucket. ...
7
votes
6answers
1k views

Does a CDN still work even when my server is down?

I am a website owner planning to use Amazon's cloudfront S3. I have been reading all the stuffs about what a CDN can do but i still have an unanswered question. Does a CDN still work even when my ...
3
votes
2answers
3k views

Why S3 website redirect location is not followed by CloudFront?

I have a website hosted on Amazon S3. It is the new version of an old website hosted on WordPress. I have set up some files with the metadata Website Redirect Locationto handle old location and ...
1
vote
1answer
3k views

How to config Amazon Route53 working without www in sub-domain

edit: Amazon now supports this. http://aws.typepad.com/aws/2012/12/root-domain-website-hosting-for-amazon-s3.html I have my domain config in Route53 at Amazon AWS exec ping command in my domain ...
1
vote
0answers
214 views

AWS S3 - Prevent object overwrite [closed]

I'm trying to speed up a transfer of images from our web server to S3. Some of the images have been uploaded already, but the process was interrupted. We've written new scripts to upload images if ...
1
vote
1answer
816 views

Is Cloudfront inherently faster than S3 (without considering distance)?

Just a simple question but I can't find a definitive answer online. Of course cloudfront is good for serving content globally, but is the infrastructure there inherently different from s3, so tha even ...
0
votes
1answer
322 views

One Way Sync of a Bucket With Local Directory

I have a local directory that I would like to synchronize with an S3 bucket. I have two specific requirements: If local file is the same as the remote, do not re-transfer it to the bucket. If some ...
2
votes
1answer
309 views

Simple S3 -> Glacier Backup

I'm looking to backup a few terabytes of data in our S3 buckets to Amazon Glacier. I've seen the options for "automatic archival" of S3 -> Glacier, but I'd rather it just be a simple one time dump ...