This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

-1
votes
1answer
138 views

aws route 53 and vistualhost in ubuntu apache [closed]

I have added domain name in route 53 and creating a sub domain to land into virtualhost with a port. I am trying to add a sub domain as cname and cname is my servername in virtualhost. I am on ubuntu ...
0
votes
1answer
228 views

Ensuring data consistency in s3 with multiple users writing/reading

I need advice/ ideas about how can I ensure data consistency in my s3 bucket. I have 2-3 users pushing and reading resources from s3. As one can easily see this leads to data inconsistency( User A is ...
2
votes
1answer
305 views

Postgresql WAL-E - Replication falling behind + can't catch up

Does anyone know how I can have my replications process the WAL segments faster while using WAL-E? https://github.com/wal-e/wal-e I have one master that leverages WAL-E to upload to S3, and I have 6 ...
0
votes
1answer
160 views

Amazon S3 upload - bytes transferred is larger than actual file size

I just uploaded FEDORA ISO image to S3 via Visual Studio AWS Explorer (not using encryption). After upload completed status shows: 1,004,232,704 / 999,292,928 Bytes Actual file size on local disc ...
1
vote
1answer
1k views

Anonymous access to S3 bucket only from my EC2 instances

Is there a way to let anonymous access to a certain S3 bucket only from my EC2 instances (all of them) within a single AWS account? I know I can use IAM roles, but I found it's just too many moving ...
1
vote
2answers
959 views

Synchronize AWS EC2 instances

I have been looking for a way to synchronize files between my EC2 web servers . However in most of the places it is mentioned that S3 can be used in such cases . However my question is S3 provides for ...
1
vote
1answer
608 views

Cloud-front backed with Nginx (which proxies to S3) randomly missing already cached items?

I wish to serve images from a S3 bucket with Cloudfront as CDN frontend, for that I tried the following: What I wish to acheive (Attempt 2) -- (Misses cloudfront cache randomly) I have the ...
2
votes
3answers
575 views

Should I use ec2 as a file server?

I need to be able to share user uploaded content across multiple EC2 application servers. I have looked at rsync, mounted NFS, and S3 as potential options of being able to share this data in almost ...
2
votes
2answers
482 views

How to discourage a hacker with root access from deleting remote backups?

I'm currently researching the best backup solution for my CentOS webserver, and I'm thinking of going with either Tarsnap or straight-up Amazon S3. I am trying to figure out how to discourage a ...
0
votes
1answer
71 views

Glacier retrieval notification of s3 objects

I have some s3 buckets which send their objects to glacier after x days of creation. When I go to retrieve those objects on the s3 interface, I need to keep reloading page to see when restoration has ...
1
vote
0answers
338 views

Amazon S3: allow user access to subfolder only on any bucket

I'm trying to write a policy that will allow a user to read from any bucket (that part works) but only write to a specific subfolder on any bucket. This is my policy so far (reading works, but it ...
0
votes
1answer
493 views

Max number of elastic IPs that can be attached to single instance? [closed]

How many elastic IPs (publicly visible) can be attached to single instance?
1
vote
2answers
540 views

Dovecot with S3QL

Due to periodically running out of space on EBS volumes on AWS EC2, and looking to make the setup more fault resistant in case of server/volume failure, I'm considering moving a Dovecot maildir ...
-1
votes
1answer
39 views

Amazon AWS volume full although www folder has 88 megs [closed]

my mysql failed because, apparently, my volume is filled. All 8 gb of it. I only have put mongodb, nodejs, apache, mysql and in the www folder, wordpress and phpmyadmin. My question is, what happened ...
5
votes
1answer
9k views

What is causing Access Denied when using the aws cli to download from Amazon S3?

I'm really flailing around in AWS trying to figure out what I'm missing here. I'd like to make it so that an IAM user can download files from an S3 bucket - without just making the files totally ...
1
vote
4answers
1k views

CNAME not resolving with nslookup, but dig works

I am trying to point a CNAME to a S3 bucket, but keep having problems with the CNAME not being found by nslookup (and by my browser, for that matter). When I use dig however, it shows me the correct ...
0
votes
1answer
139 views

Configuring nginx server to handle requests from multiple domains

Use Case:- I am working on a web application which allows to create HTML templates and publish them on amazon S3.Now to publish the websites I use nginx as a proxy server. What the proxy server does ...
5
votes
2answers
1k views

How long before an s3 bucket can be created with same name after deletion?

Title is quite explanatory, but I have just deleted an s3 bucket as it was in the wrong region and am wanting to recreate it in the correct region with same name as the just deleted one. Is there any ...
0
votes
1answer
396 views

AWS: Best solution for syncing files across autoscaled EC2 instances?

I'm working on setting up autoscaling on EC2; Instances will be running a web app with big traffic spikes. The first solution I tried for syncing files across instances (since the web app will write ...
0
votes
1answer
379 views

How i can setup a nginx cache strategy that first try amazon s3, then memcache and do a fallback on miss?

i have a large site with lot of pages that almost never change, right now i am using two memcache servers (amazon elasticache), but this its really expensive. Thats why for this files that barely ...
0
votes
1answer
399 views

Move files from ftp server to s3

I would like to set up an ftp server, where users will upload files, and for each file, put it on s3 storage, and delete it from the ftp server. (the server runs on ec2 ubuntu) Here are the stuff I ...
11
votes
3answers
4k views

Backing up data stored on Amazon S3

I have an EC2 instance running a web server that stores users' uploaded files to S3. The files are written once and never change, but are retrieved occasionally by the users. We will likely accumulate ...
3
votes
2answers
2k views

I'm trying to use “aws s3 sync” on my EC2 instance. Is the '--exclude' option broken?

I'm trying to backup my EC2 instance to S3 using Amazon's official tools that come preinstalled on the EC2 instance. I'm having difficulty getting the sync command to exclude directories from the ...
0
votes
1answer
249 views

AWS S3 Static Hosting with Custom Domain - routing bare domain

I am trying to host some static content in an Amazon S3 bucket and to have that content available through my own domain. The bucket in question is called "e.tl-dr.org" and I have "index.html" set as ...
2
votes
0answers
376 views

How can I whitelist oubound-from-private-subnet traffic to S3 on the NAT instance of an EC2 VPC?

I'm researching privacy-compliant high-security deployment options for AWS VPC. I'm looking for a method of tightening outbound traffic from the private subnets at the NAT instance. For example, how ...
0
votes
2answers
216 views

Can I re-attach my EBS while a snapshot is pending?

I have my database backed up to an EBS drive. My current backup method is 1) queue all writes (not important how) 2) kill database process 3) detach + umount ebs volume 4) take snapshot 5) ...
0
votes
1answer
449 views

Nginx proxy to s3 bucket gets 400 Invalid Argument

I have a Django app in which I serve media files through an nginx proxy to s3. The relevant python code response = HttpResponse() response['X-Accel-Redirect'] = '/s3_redirect/%s' % ...
0
votes
1answer
140 views

AWS route53 forwarding

Essentially, I need to know how to point one URL/folder to a web server and a different URL/folder to an EC2 app server. I'm trying to setup a SAAS with the following URL configuration. ...
-2
votes
1answer
93 views

Sync EC2 instances [closed]

I know many people have asked how to sync multiple ec2 instances and it seems the usual answer is to store all the assets in S3. Would this still make sense if the only thing I am trying to share ...
1
vote
1answer
2k views

How to copy all s3 buckets to another AWS account?

I'm copying all EC2 instances to another AWS account (creating the AMIs, sharing them with that account and running the instances from AMIs there). I also need to move my S3 buckets since the ...
0
votes
1answer
197 views

Route53 pointing to cloudfront www

I have seen a lot of tutorials about having non-www domain hosting of S3 static websites but I've yet to see one which works on www domains, i.e www.jobkent.com. My steps so far is to create a bucket ...
2
votes
1answer
683 views

AWS Cloudfront multiple origins - how can we fallback to 2nd origin if not found in the 1st

We're trying to set up a Cloudfront distribution where the default origin is S3, but if the content is not found on S3, we want it to fetch it from an EC2 instance. Can we setup these multiple ...
1
vote
0answers
103 views

Handling multiple server blocks in nginx configuration

I am working on setting up a proxy server for my application.The use case is I want a specific set of requests to be redirect to say abc.com and rest of the request to be redirected to xyz.com. Eg:If ...
1
vote
3answers
289 views

Hosting a site on Amazon S3, URL keeps redirecting

I am trying to use Amazon S3 to host my webiste. I have the domain registered though namecheap. Whenever I navigate to mywebsite.com the URL in the browser changes to ...
1
vote
0answers
177 views

Amazon S3 sync theory

I'm setting up a backup of my vital data (database and images, mainly) to S3 from my Ubuntu box. I've set up Amazon S3, and installed S3FS to mount the bucket on my machine. This is working well, but ...
0
votes
2answers
134 views

Looking for a high IO s3 “compatible” storage solution

Help me serverfault! I am looking for a high IO (2 million mostly put transactions per day of 7-10k xml chunks) storage solution that is amazon s3 compatible that I can house in my datacenter. I am ...
0
votes
1answer
128 views

Can AWS S3 files in buckets get deleted by a download timing out?

A few AWS S3 files might have gotten deleted while trying to download everything for a local backup. The download/connection timed-out a couple times. The next day several HTML/JS files are missing ...
4
votes
1answer
1k views

Linux server sync to an Amazon S3 bucket

I am looking for a stable solution to replace a classic server backup to another server using rsync. I have to sync a whole filesystem (more than 1Tb) to Amazon S3. Where am I? Solution 1: I mapped ...
4
votes
1answer
362 views

Amazon S3 appears to be blocking cloudflare IP addresses. How do I fix it?

I have static content that is being served by Cloudflare. Cloudflare points to Amazon S3 to pick up the static content and serves it via a CNAME (cdn.mydomain.com). The bucket is setup properly and ...
1
vote
1answer
124 views

Multisite on AWS EC2

I'm working on a multi-site app targeted to run fully Amazon Web Services. Due to its nature, it will have significant traffic spikes, followed by long periods of low traffic, so the ability to scale ...
1
vote
1answer
591 views

Debugging logrotate postrotate script

Following is my logrotate conf. /mnt/je/logs/apache/jesites/web/*.log" { missingok rotate 0 size 5M copytruncate notifempty sharedscripts ...
0
votes
2answers
378 views

Can I limit user access to AWS S3 buckets?

I'm working on a site that is probably destined for AWS hosting. This leads to a question about access rights to stuff that would be stored in S3 buckets: I set up an EC2 server for the site, and ...
1
vote
1answer
850 views

s3cmd with --delete-removed

I'm currently writing a script to sync files in s3 buckets with s3cmd. I check the document and it says: s3cmd sync LOCAL_DIR s3://BUCKET[/PREFIX] or s3://BUCKET[/PREFIX] LOCAL_DIR also I find a ...
1
vote
1answer
249 views

Restore snapshot from other aws account?

I am new in this, so forgive my beginner question. I have an aws account which is currently in us-west-2c. It has a instance running, and also a couple of volumes which i made. I have multiple backups ...
-1
votes
2answers
581 views

Can I use Glacier to snapshot S3 like a point-in-time backup?

I have a series of directories on numerous computers that I backup to an S3 bucket nightly using dgsync. I'd like a solution that will permit me to archive occasionally: once a week for the past ...
0
votes
2answers
795 views

Enable Cross Origin Scripting on Nginx from retina.js to load files from another URL?

Im running a retina image plugin along with W3 Cache for CDN support. W3 cache moves images to S3, but the JS file won't server the files from there due to the difference in URL (it goes from h ...
0
votes
2answers
385 views

Move IIS logs to S3

I have a requirement to move IIS logs to S3 directly. There are tools that can be used to create a mount and set IIS to have logging to mounted S3 bucket. My question is is there a way where I can do ...
2
votes
1answer
3k views

Give EC2 IAM role read access to S3 bucket

I have an AWS Elastic Beanstalk Rails app that I am configuring via the config script to pull some files from an S3 bucket. When I start up the application, I keep receiving the following error in the ...
3
votes
0answers
3k views

s3put fails with “Connection reset by peer” for large files

I can upload small files quite fine using the same commands, however whenever I try to upload a 5 GB file to S3 then the s3 script fails: [backup]$ s3put --bucket john-murdoch-bucket --reduced ...
0
votes
1answer
223 views

Amazon S3 map url to backend server like Apache's <Location /api> ProxyPass

Is there a way to map a URL to a backend server in S3. I am not looking for redirects, but something on the lines of Apache's Location directive with ProxyPass. ...