This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

1
vote
1answer
96 views

CloudFront, S3, EC2: how can you reroute request from CloudFront to EC2 unless file exist at S3?

My application uses all 3 service layers. Recent feature request to lower the outgoing traffic gives us some uncertainties. Say, we have a requirement to distribute the image.jpg file with ...
-1
votes
1answer
104 views

aws route 53 and vistualhost in ubuntu apache [closed]

I have added domain name in route 53 and creating a sub domain to land into virtualhost with a port. I am trying to add a sub domain as cname and cname is my servername in virtualhost. I am on ubuntu ...
0
votes
1answer
285 views

What is the significance of the s3 region, “US Standard” when it comes to “Amazon EC2 in the same region” pricing?

AWS S3 provides a special region called US Standard, US Standard Uses Amazon S3 servers in the United States Provides eventual consistency for all requests. This region automatically routes ...
0
votes
0answers
233 views

Amazon Powershell Write-S3Object can't resolve s3.amazonaws.com

Am seeing incredibly weird behavior for the Write-S3Object cmdlet provided by Amazon. I've got a backup script running Write-S3Object on my Windows Server 2008 R2 box. When I kick it off, it ...
0
votes
1answer
145 views

Ensuring data consistency in s3 with multiple users writing/reading

I need advice/ ideas about how can I ensure data consistency in my s3 bucket. I have 2-3 users pushing and reading resources from s3. As one can easily see this leads to data inconsistency( User A is ...
2
votes
1answer
204 views

Postgresql WAL-E - Replication falling behind + can't catch up

Does anyone know how I can have my replications process the WAL segments faster while using WAL-E? https://github.com/wal-e/wal-e I have one master that leverages WAL-E to upload to S3, and I have 6 ...
0
votes
1answer
100 views

Amazon S3 upload - bytes transferred is larger than actual file size

I just uploaded FEDORA ISO image to S3 via Visual Studio AWS Explorer (not using encryption). After upload completed status shows: 1,004,232,704 / 999,292,928 Bytes Actual file size on local disc ...
0
votes
1answer
666 views

Anonymous access to S3 bucket only from my EC2 instances

Is there a way to let anonymous access to a certain S3 bucket only from my EC2 instances (all of them) within a single AWS account? I know I can use IAM roles, but I found it's just too many moving ...
1
vote
2answers
539 views

Synchronize AWS EC2 instances

I have been looking for a way to synchronize files between my EC2 web servers . However in most of the places it is mentioned that S3 can be used in such cases . However my question is S3 provides for ...
0
votes
1answer
442 views

Cloud-front backed with Nginx (which proxies to S3) randomly missing already cached items?

I wish to serve images from a S3 bucket with Cloudfront as CDN frontend, for that I tried the following: What I wish to acheive (Attempt 2) -- (Misses cloudfront cache randomly) I have the ...
0
votes
0answers
240 views

Amazon S3 upload files of 2GB using the high level multipart loading sometimes fails

I tried to load files which are close to 2 GB, in code I used Amazon's api for multipart loading. Here is a sample from the code: ObjectMetadata o = new ObjectMetadata(); ...
0
votes
0answers
94 views

nginx passing assets from S3

I'm trying to configure Nginx to passing assets from S3.I have the below in the config but when am trying to access frontend, nginx return 404 on static resources. And nginx error log is empty. Can ...
2
votes
3answers
331 views

Should I use ec2 as a file server?

I need to be able to share user uploaded content across multiple EC2 application servers. I have looked at rsync, mounted NFS, and S3 as potential options of being able to share this data in almost ...
2
votes
2answers
444 views

How to discourage a hacker with root access from deleting remote backups?

I'm currently researching the best backup solution for my CentOS webserver, and I'm thinking of going with either Tarsnap or straight-up Amazon S3. I am trying to figure out how to discourage a ...
0
votes
1answer
54 views

Glacier retrieval notification of s3 objects

I have some s3 buckets which send their objects to glacier after x days of creation. When I go to retrieve those objects on the s3 interface, I need to keep reloading page to see when restoration has ...
1
vote
0answers
246 views

Amazon S3: allow user access to subfolder only on any bucket

I'm trying to write a policy that will allow a user to read from any bucket (that part works) but only write to a specific subfolder on any bucket. This is my policy so far (reading works, but it ...
0
votes
1answer
251 views

Max number of elastic IPs that can be attached to single instance? [closed]

How many elastic IPs (publicly visible) can be attached to single instance?
1
vote
2answers
310 views

Dovecot with S3QL

Due to periodically running out of space on EBS volumes on AWS EC2, and looking to make the setup more fault resistant in case of server/volume failure, I'm considering moving a Dovecot maildir ...
-1
votes
1answer
38 views

Amazon AWS volume full although www folder has 88 megs [closed]

my mysql failed because, apparently, my volume is filled. All 8 gb of it. I only have put mongodb, nodejs, apache, mysql and in the www folder, wordpress and phpmyadmin. My question is, what happened ...
1
vote
1answer
3k views

What is causing Access Denied when using the aws cli to download from Amazon S3?

I'm really flailing around in AWS trying to figure out what I'm missing here. I'd like to make it so that an IAM user can download files from an S3 bucket - without just making the files totally ...
0
votes
4answers
739 views

CNAME not resolving with nslookup, but dig works

I am trying to point a CNAME to a S3 bucket, but keep having problems with the CNAME not being found by nslookup (and by my browser, for that matter). When I use dig however, it shows me the correct ...
0
votes
1answer
120 views

Configuring nginx server to handle requests from multiple domains

Use Case:- I am working on a web application which allows to create HTML templates and publish them on amazon S3.Now to publish the websites I use nginx as a proxy server. What the proxy server does ...
1
vote
2answers
537 views

How long before an s3 bucket can be created with same name after deletion?

Title is quite explanatory, but I have just deleted an s3 bucket as it was in the wrong region and am wanting to recreate it in the correct region with same name as the just deleted one. Is there any ...
0
votes
1answer
308 views

AWS: Best solution for syncing files across autoscaled EC2 instances?

I'm working on setting up autoscaling on EC2; Instances will be running a web app with big traffic spikes. The first solution I tried for syncing files across instances (since the web app will write ...
0
votes
1answer
297 views

How i can setup a nginx cache strategy that first try amazon s3, then memcache and do a fallback on miss?

i have a large site with lot of pages that almost never change, right now i am using two memcache servers (amazon elasticache), but this its really expensive. Thats why for this files that barely ...
0
votes
1answer
171 views

Move files from ftp server to s3

I would like to set up an ftp server, where users will upload files, and for each file, put it on s3 storage, and delete it from the ftp server. (the server runs on ec2 ubuntu) Here are the stuff I ...
8
votes
3answers
3k views

Backing up data stored on Amazon S3

I have an EC2 instance running a web server that stores users' uploaded files to S3. The files are written once and never change, but are retrieved occasionally by the users. We will likely accumulate ...
3
votes
2answers
1k views

I'm trying to use “aws s3 sync” on my EC2 instance. Is the '--exclude' option broken?

I'm trying to backup my EC2 instance to S3 using Amazon's official tools that come preinstalled on the EC2 instance. I'm having difficulty getting the sync command to exclude directories from the ...
0
votes
1answer
157 views

AWS S3 Static Hosting with Custom Domain - routing bare domain

I am trying to host some static content in an Amazon S3 bucket and to have that content available through my own domain. The bucket in question is called "e.tl-dr.org" and I have "index.html" set as ...
2
votes
0answers
257 views

How can I whitelist oubound-from-private-subnet traffic to S3 on the NAT instance of an EC2 VPC?

I'm researching privacy-compliant high-security deployment options for AWS VPC. I'm looking for a method of tightening outbound traffic from the private subnets at the NAT instance. For example, how ...
0
votes
2answers
115 views

Can I re-attach my EBS while a snapshot is pending?

I have my database backed up to an EBS drive. My current backup method is 1) queue all writes (not important how) 2) kill database process 3) detach + umount ebs volume 4) take snapshot 5) ...
0
votes
1answer
293 views

Nginx proxy to s3 bucket gets 400 Invalid Argument

I have a Django app in which I serve media files through an nginx proxy to s3. The relevant python code response = HttpResponse() response['X-Accel-Redirect'] = '/s3_redirect/%s' % ...
0
votes
1answer
95 views

AWS route53 forwarding

Essentially, I need to know how to point one URL/folder to a web server and a different URL/folder to an EC2 app server. I'm trying to setup a SAAS with the following URL configuration. ...
-2
votes
1answer
85 views

Sync EC2 instances [closed]

I know many people have asked how to sync multiple ec2 instances and it seems the usual answer is to store all the assets in S3. Would this still make sense if the only thing I am trying to share ...
1
vote
1answer
1k views

How to copy all s3 buckets to another AWS account?

I'm copying all EC2 instances to another AWS account (creating the AMIs, sharing them with that account and running the instances from AMIs there). I also need to move my S3 buckets since the ...
0
votes
1answer
141 views

Route53 pointing to cloudfront www

I have seen a lot of tutorials about having non-www domain hosting of S3 static websites but I've yet to see one which works on www domains, i.e www.jobkent.com. My steps so far is to create a bucket ...
1
vote
1answer
380 views

AWS Cloudfront multiple origins - how can we fallback to 2nd origin if not found in the 1st

We're trying to set up a Cloudfront distribution where the default origin is S3, but if the content is not found on S3, we want it to fetch it from an EC2 instance. Can we setup these multiple ...
1
vote
0answers
81 views

Handling multiple server blocks in nginx configuration

I am working on setting up a proxy server for my application.The use case is I want a specific set of requests to be redirect to say abc.com and rest of the request to be redirected to xyz.com. Eg:If ...
1
vote
3answers
186 views

Hosting a site on Amazon S3, URL keeps redirecting

I am trying to use Amazon S3 to host my webiste. I have the domain registered though namecheap. Whenever I navigate to mywebsite.com the URL in the browser changes to ...
1
vote
1answer
194 views

Amazon EC2, S3, REST API, and how to correctly provide contents to users

I have deployed a REST server in an Amazon EC2 instance. I have also configured an Amazon S3 bucket to store all the data generated by users while interacting with the API. The main information stored ...
1
vote
0answers
122 views

Amazon S3 sync theory

I'm setting up a backup of my vital data (database and images, mainly) to S3 from my Ubuntu box. I've set up Amazon S3, and installed S3FS to mount the bucket on my machine. This is working well, but ...
0
votes
2answers
116 views

Looking for a high IO s3 “compatible” storage solution

Help me serverfault! I am looking for a high IO (2 million mostly put transactions per day of 7-10k xml chunks) storage solution that is amazon s3 compatible that I can house in my datacenter. I am ...
0
votes
1answer
72 views

Can AWS S3 files in buckets get deleted by a download timing out?

A few AWS S3 files might have gotten deleted while trying to download everything for a local backup. The download/connection timed-out a couple times. The next day several HTML/JS files are missing ...
3
votes
1answer
593 views

Linux server sync to an Amazon S3 bucket

I am looking for a stable solution to replace a classic server backup to another server using rsync. I have to sync a whole filesystem (more than 1Tb) to Amazon S3. Where am I? Solution 1: I mapped ...
4
votes
1answer
257 views

Amazon S3 appears to be blocking cloudflare IP addresses. How do I fix it?

I have static content that is being served by Cloudflare. Cloudflare points to Amazon S3 to pick up the static content and serves it via a CNAME (cdn.mydomain.com). The bucket is setup properly and ...
1
vote
1answer
101 views

Multisite on AWS EC2

I'm working on a multi-site app targeted to run fully Amazon Web Services. Due to its nature, it will have significant traffic spikes, followed by long periods of low traffic, so the ability to scale ...
1
vote
1answer
373 views

Debugging logrotate postrotate script

Following is my logrotate conf. /mnt/je/logs/apache/jesites/web/*.log" { missingok rotate 0 size 5M copytruncate notifempty sharedscripts ...
0
votes
2answers
184 views

Can I limit user access to AWS S3 buckets?

I'm working on a site that is probably destined for AWS hosting. This leads to a question about access rights to stuff that would be stored in S3 buckets: I set up an EC2 server for the site, and ...
0
votes
1answer
539 views

s3cmd with --delete-removed

I'm currently writing a script to sync files in s3 buckets with s3cmd. I check the document and it says: s3cmd sync LOCAL_DIR s3://BUCKET[/PREFIX] or s3://BUCKET[/PREFIX] LOCAL_DIR also I find a ...
1
vote
1answer
149 views

Restore snapshot from other aws account?

I am new in this, so forgive my beginner question. I have an aws account which is currently in us-west-2c. It has a instance running, and also a couple of volumes which i made. I have multiple backups ...