This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

2
votes
3answers
536 views

Should I use ec2 as a file server?

I need to be able to share user uploaded content across multiple EC2 application servers. I have looked at rsync, mounted NFS, and S3 as potential options of being able to share this data in almost ...
2
votes
2answers
478 views

How to discourage a hacker with root access from deleting remote backups?

I'm currently researching the best backup solution for my CentOS webserver, and I'm thinking of going with either Tarsnap or straight-up Amazon S3. I am trying to figure out how to discourage a ...
0
votes
1answer
67 views

Glacier retrieval notification of s3 objects

I have some s3 buckets which send their objects to glacier after x days of creation. When I go to retrieve those objects on the s3 interface, I need to keep reloading page to see when restoration has ...
1
vote
0answers
330 views

Amazon S3: allow user access to subfolder only on any bucket

I'm trying to write a policy that will allow a user to read from any bucket (that part works) but only write to a specific subfolder on any bucket. This is my policy so far (reading works, but it ...
0
votes
1answer
475 views

Max number of elastic IPs that can be attached to single instance? [closed]

How many elastic IPs (publicly visible) can be attached to single instance?
1
vote
2answers
521 views

Dovecot with S3QL

Due to periodically running out of space on EBS volumes on AWS EC2, and looking to make the setup more fault resistant in case of server/volume failure, I'm considering moving a Dovecot maildir ...
-1
votes
1answer
39 views

Amazon AWS volume full although www folder has 88 megs [closed]

my mysql failed because, apparently, my volume is filled. All 8 gb of it. I only have put mongodb, nodejs, apache, mysql and in the www folder, wordpress and phpmyadmin. My question is, what happened ...
5
votes
1answer
8k views

What is causing Access Denied when using the aws cli to download from Amazon S3?

I'm really flailing around in AWS trying to figure out what I'm missing here. I'd like to make it so that an IAM user can download files from an S3 bucket - without just making the files totally ...
1
vote
4answers
1k views

CNAME not resolving with nslookup, but dig works

I am trying to point a CNAME to a S3 bucket, but keep having problems with the CNAME not being found by nslookup (and by my browser, for that matter). When I use dig however, it shows me the correct ...
0
votes
1answer
139 views

Configuring nginx server to handle requests from multiple domains

Use Case:- I am working on a web application which allows to create HTML templates and publish them on amazon S3.Now to publish the websites I use nginx as a proxy server. What the proxy server does ...
4
votes
2answers
1k views

How long before an s3 bucket can be created with same name after deletion?

Title is quite explanatory, but I have just deleted an s3 bucket as it was in the wrong region and am wanting to recreate it in the correct region with same name as the just deleted one. Is there any ...
0
votes
1answer
384 views

AWS: Best solution for syncing files across autoscaled EC2 instances?

I'm working on setting up autoscaling on EC2; Instances will be running a web app with big traffic spikes. The first solution I tried for syncing files across instances (since the web app will write ...
0
votes
1answer
372 views

How i can setup a nginx cache strategy that first try amazon s3, then memcache and do a fallback on miss?

i have a large site with lot of pages that almost never change, right now i am using two memcache servers (amazon elasticache), but this its really expensive. Thats why for this files that barely ...
0
votes
1answer
375 views

Move files from ftp server to s3

I would like to set up an ftp server, where users will upload files, and for each file, put it on s3 storage, and delete it from the ftp server. (the server runs on ec2 ubuntu) Here are the stuff I ...
8
votes
3answers
4k views

Backing up data stored on Amazon S3

I have an EC2 instance running a web server that stores users' uploaded files to S3. The files are written once and never change, but are retrieved occasionally by the users. We will likely accumulate ...
3
votes
2answers
2k views

I'm trying to use “aws s3 sync” on my EC2 instance. Is the '--exclude' option broken?

I'm trying to backup my EC2 instance to S3 using Amazon's official tools that come preinstalled on the EC2 instance. I'm having difficulty getting the sync command to exclude directories from the ...
0
votes
1answer
236 views

AWS S3 Static Hosting with Custom Domain - routing bare domain

I am trying to host some static content in an Amazon S3 bucket and to have that content available through my own domain. The bucket in question is called "e.tl-dr.org" and I have "index.html" set as ...
2
votes
0answers
370 views

How can I whitelist oubound-from-private-subnet traffic to S3 on the NAT instance of an EC2 VPC?

I'm researching privacy-compliant high-security deployment options for AWS VPC. I'm looking for a method of tightening outbound traffic from the private subnets at the NAT instance. For example, how ...
0
votes
2answers
206 views

Can I re-attach my EBS while a snapshot is pending?

I have my database backed up to an EBS drive. My current backup method is 1) queue all writes (not important how) 2) kill database process 3) detach + umount ebs volume 4) take snapshot 5) ...
0
votes
1answer
425 views

Nginx proxy to s3 bucket gets 400 Invalid Argument

I have a Django app in which I serve media files through an nginx proxy to s3. The relevant python code response = HttpResponse() response['X-Accel-Redirect'] = '/s3_redirect/%s' % ...
0
votes
1answer
133 views

AWS route53 forwarding

Essentially, I need to know how to point one URL/folder to a web server and a different URL/folder to an EC2 app server. I'm trying to setup a SAAS with the following URL configuration. ...
-2
votes
1answer
92 views

Sync EC2 instances [closed]

I know many people have asked how to sync multiple ec2 instances and it seems the usual answer is to store all the assets in S3. Would this still make sense if the only thing I am trying to share ...
1
vote
1answer
2k views

How to copy all s3 buckets to another AWS account?

I'm copying all EC2 instances to another AWS account (creating the AMIs, sharing them with that account and running the instances from AMIs there). I also need to move my S3 buckets since the ...
0
votes
1answer
193 views

Route53 pointing to cloudfront www

I have seen a lot of tutorials about having non-www domain hosting of S3 static websites but I've yet to see one which works on www domains, i.e www.jobkent.com. My steps so far is to create a bucket ...
2
votes
1answer
640 views

AWS Cloudfront multiple origins - how can we fallback to 2nd origin if not found in the 1st

We're trying to set up a Cloudfront distribution where the default origin is S3, but if the content is not found on S3, we want it to fetch it from an EC2 instance. Can we setup these multiple ...
1
vote
0answers
99 views

Handling multiple server blocks in nginx configuration

I am working on setting up a proxy server for my application.The use case is I want a specific set of requests to be redirect to say abc.com and rest of the request to be redirected to xyz.com. Eg:If ...
1
vote
3answers
276 views

Hosting a site on Amazon S3, URL keeps redirecting

I am trying to use Amazon S3 to host my webiste. I have the domain registered though namecheap. Whenever I navigate to mywebsite.com the URL in the browser changes to ...
1
vote
0answers
170 views

Amazon S3 sync theory

I'm setting up a backup of my vital data (database and images, mainly) to S3 from my Ubuntu box. I've set up Amazon S3, and installed S3FS to mount the bucket on my machine. This is working well, but ...
0
votes
2answers
131 views

Looking for a high IO s3 “compatible” storage solution

Help me serverfault! I am looking for a high IO (2 million mostly put transactions per day of 7-10k xml chunks) storage solution that is amazon s3 compatible that I can house in my datacenter. I am ...
0
votes
1answer
120 views

Can AWS S3 files in buckets get deleted by a download timing out?

A few AWS S3 files might have gotten deleted while trying to download everything for a local backup. The download/connection timed-out a couple times. The next day several HTML/JS files are missing ...
4
votes
1answer
1k views

Linux server sync to an Amazon S3 bucket

I am looking for a stable solution to replace a classic server backup to another server using rsync. I have to sync a whole filesystem (more than 1Tb) to Amazon S3. Where am I? Solution 1: I mapped ...
4
votes
1answer
354 views

Amazon S3 appears to be blocking cloudflare IP addresses. How do I fix it?

I have static content that is being served by Cloudflare. Cloudflare points to Amazon S3 to pick up the static content and serves it via a CNAME (cdn.mydomain.com). The bucket is setup properly and ...
1
vote
1answer
121 views

Multisite on AWS EC2

I'm working on a multi-site app targeted to run fully Amazon Web Services. Due to its nature, it will have significant traffic spikes, followed by long periods of low traffic, so the ability to scale ...
1
vote
1answer
581 views

Debugging logrotate postrotate script

Following is my logrotate conf. /mnt/je/logs/apache/jesites/web/*.log" { missingok rotate 0 size 5M copytruncate notifempty sharedscripts ...
0
votes
2answers
340 views

Can I limit user access to AWS S3 buckets?

I'm working on a site that is probably destined for AWS hosting. This leads to a question about access rights to stuff that would be stored in S3 buckets: I set up an EC2 server for the site, and ...
1
vote
1answer
815 views

s3cmd with --delete-removed

I'm currently writing a script to sync files in s3 buckets with s3cmd. I check the document and it says: s3cmd sync LOCAL_DIR s3://BUCKET[/PREFIX] or s3://BUCKET[/PREFIX] LOCAL_DIR also I find a ...
1
vote
1answer
230 views

Restore snapshot from other aws account?

I am new in this, so forgive my beginner question. I have an aws account which is currently in us-west-2c. It has a instance running, and also a couple of volumes which i made. I have multiple backups ...
-1
votes
2answers
552 views

Can I use Glacier to snapshot S3 like a point-in-time backup?

I have a series of directories on numerous computers that I backup to an S3 bucket nightly using dgsync. I'd like a solution that will permit me to archive occasionally: once a week for the past ...
0
votes
2answers
772 views

Enable Cross Origin Scripting on Nginx from retina.js to load files from another URL?

Im running a retina image plugin along with W3 Cache for CDN support. W3 cache moves images to S3, but the JS file won't server the files from there due to the difference in URL (it goes from h ...
0
votes
2answers
373 views

Move IIS logs to S3

I have a requirement to move IIS logs to S3 directly. There are tools that can be used to create a mount and set IIS to have logging to mounted S3 bucket. My question is is there a way where I can do ...
2
votes
1answer
3k views

Give EC2 IAM role read access to S3 bucket

I have an AWS Elastic Beanstalk Rails app that I am configuring via the config script to pull some files from an S3 bucket. When I start up the application, I keep receiving the following error in the ...
3
votes
0answers
3k views

s3put fails with “Connection reset by peer” for large files

I can upload small files quite fine using the same commands, however whenever I try to upload a 5 GB file to S3 then the s3 script fails: [backup]$ s3put --bucket john-murdoch-bucket --reduced ...
0
votes
1answer
221 views

Amazon S3 map url to backend server like Apache's <Location /api> ProxyPass

Is there a way to map a URL to a backend server in S3. I am not looking for redirects, but something on the lines of Apache's Location directive with ProxyPass. ...
3
votes
0answers
1k views

Amazon S3 + Cloudfront VS Rackspace CloudFiles [closed]

I know this question came up lot of time on the internet , But I couldn't find any latest updates on this . So I gathered the information what I found and putting here and have few questions on it . ...
1
vote
2answers
1k views

CloudFlare CDN and static site with root on Amazon S3

I've set up an S3 bucket to host my static site. Now I am trying to wrap CloudFlare around this, but I get the following warning when adding a CNAME entry for the root domain in CloudFlare's DNS ...
1
vote
1answer
415 views

Automatically sync git repo to Amazon S3 site

I'm using an Amazon S3 site to host a website. I'm aiming to use a git repo to store the content and versioning and I'd like the repo to automatically update the S3 site once something is checked into ...
2
votes
1answer
973 views

What is your general strategy to backup S3 buckets?

We are starting a project which involves storing large data quantities in S3. S3 is good at scaling and we've expect to have up to 5TB and million of files in bucket. While i may trust Amazon in ...
0
votes
1answer
185 views

S3 bucket alias

I have a S3 bucket called "abcd" that I would like to map to a subdomain, "abcd.mydomain.com", using a CNAME. Unfortunately I can't move files from the original "abcd" bucket to a new ...
0
votes
1answer
536 views

AWS EC2 Mailserver Failover Strategies done right

I'm researching in this topic really hard the last few days and i just want to discuss this with a few specific questions - i did not find any suitable thread here that is covering my needs and ...
0
votes
1answer
154 views

How continue sync with S3CMD after broken connection?

I'm using s3cmd to backup some logs into Amazon S3 buckets. Which is a great tool. But I notice that, very often, my sync's are broken, they just cancel and try to upload again, until they can upload ...