This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

1
vote
1answer
406 views

Drop/Truncate DynamoDB table with AWS Data Pipeline

I have set up a Data Pipeline that imports files from an S3 bucket to a DynamoDB table, based on the predefined example. I want to truncate the table (or drop and create a new one) every time the ...
-1
votes
1answer
205 views

Is it possible to use PHP on a website hosted on AWS S3 without using EC2 or Elastic Beanstalk?

I have a bit of PHP (a contact form to be exact) that isn't working right now on my website. I'd like to activate the PHP and I heard one of the ways is to use Elastic Beanstalk. However, Elastic ...
3
votes
2answers
847 views

How can I reuse existing resources in CloudFormation?

I've have S3 bucket as resource in my CloudFormation template. With DeletionPolicy set to Retain. This works as expected, when deleting the stack, it does indeed retain the bucket. However, when I ...
2
votes
2answers
333 views

Is there a way to retrieve all contents from a versioned Amazon S3 bucket as of a particular datetime

Is it possible via the AWS CLI or via some third-party tool to easily download all contents of a versioned bucket as it was on a particular datetime? I.E. I would like to retrieve the version of each ...
12
votes
1answer
4k views

No targets available when trying to set alias target from Route 53 to S3

I'm trying to setup a simple Amazon AWS S3 based website, as explained here. I've setup the S3 bucket (simples3websitetest.com), gave it the (hopefully) right permissions: { "Version": ...
2
votes
1answer
371 views

Amazon S3 - private file is still downloadable for everyone?

I have some secret files which I want to restrict anonymous user from viewing/downloading. I have tried to make it private by running something like: s3cmd setacl --acl-private ...
6
votes
1answer
3k views

AWS IAM user access issues for S3

I have the following IAM policy for a user { "Version": "2012-10-17", "Statement": [ { "Sid": "Stmt1395161912000", "Effect": "Allow", "Action": [ "s3:ListBucket", ...
3
votes
3answers
2k views

Wildcard Subdomain (*.example.com) with Amazon Route53 DNS and S3

I am hosting a static website using Amazon Route53 for DNS and S3 for html files. It is working fine. Current Setup is: example.com. A ALIAS s3-website-us-east-1.amazonaws.com. www.example.com. ...
12
votes
1answer
7k views

Amazon Cloudfront with S3. Access Denied

We're trying to distribute out S3 buckets via Cloudfront but for some reason the only response is an AccessDenied XML document like the following: <Error> ...
1
vote
1answer
67 views

CloudBerry Explorer PRO using 100% CPU [closed]

Does anyone have any experience with this product? I'm running a trial on in it now for a project to move about 800 GB of data to Amazon S3. After the initial move we'll keep a job running to continue ...
1
vote
4answers
4k views

Accessing Amazon S3 from a private VPC subnet

If I have a VPC running and some servers located in the private portion of that network that do backend processing by downloading files from amazon s3, can I access S3 internally to get at those ...
1
vote
1answer
167 views

CloudFront, S3, EC2: how can you reroute request from CloudFront to EC2 unless file exist at S3?

My application uses all 3 service layers. Recent feature request to lower the outgoing traffic gives us some uncertainties. Say, we have a requirement to distribute the image.jpg file with ...
-1
votes
1answer
148 views

aws route 53 and vistualhost in ubuntu apache [closed]

I have added domain name in route 53 and creating a sub domain to land into virtualhost with a port. I am trying to add a sub domain as cname and cname is my servername in virtualhost. I am on ubuntu ...
0
votes
1answer
252 views

Ensuring data consistency in s3 with multiple users writing/reading

I need advice/ ideas about how can I ensure data consistency in my s3 bucket. I have 2-3 users pushing and reading resources from s3. As one can easily see this leads to data inconsistency( User A is ...
2
votes
1answer
334 views

Postgresql WAL-E - Replication falling behind + can't catch up

Does anyone know how I can have my replications process the WAL segments faster while using WAL-E? https://github.com/wal-e/wal-e I have one master that leverages WAL-E to upload to S3, and I have 6 ...
0
votes
1answer
168 views

Amazon S3 upload - bytes transferred is larger than actual file size

I just uploaded FEDORA ISO image to S3 via Visual Studio AWS Explorer (not using encryption). After upload completed status shows: 1,004,232,704 / 999,292,928 Bytes Actual file size on local disc ...
1
vote
1answer
1k views

Anonymous access to S3 bucket only from my EC2 instances

Is there a way to let anonymous access to a certain S3 bucket only from my EC2 instances (all of them) within a single AWS account? I know I can use IAM roles, but I found it's just too many moving ...
1
vote
2answers
1k views

Synchronize AWS EC2 instances

I have been looking for a way to synchronize files between my EC2 web servers . However in most of the places it is mentioned that S3 can be used in such cases . However my question is S3 provides for ...
1
vote
1answer
641 views

Cloud-front backed with Nginx (which proxies to S3) randomly missing already cached items?

I wish to serve images from a S3 bucket with Cloudfront as CDN frontend, for that I tried the following: What I wish to acheive (Attempt 2) -- (Misses cloudfront cache randomly) I have the ...
2
votes
3answers
649 views

Should I use ec2 as a file server?

I need to be able to share user uploaded content across multiple EC2 application servers. I have looked at rsync, mounted NFS, and S3 as potential options of being able to share this data in almost ...
2
votes
2answers
484 views

How to discourage a hacker with root access from deleting remote backups?

I'm currently researching the best backup solution for my CentOS webserver, and I'm thinking of going with either Tarsnap or straight-up Amazon S3. I am trying to figure out how to discourage a ...
0
votes
1answer
74 views

Glacier retrieval notification of s3 objects

I have some s3 buckets which send their objects to glacier after x days of creation. When I go to retrieve those objects on the s3 interface, I need to keep reloading page to see when restoration has ...
1
vote
0answers
365 views

Amazon S3: allow user access to subfolder only on any bucket

I'm trying to write a policy that will allow a user to read from any bucket (that part works) but only write to a specific subfolder on any bucket. This is my policy so far (reading works, but it ...
0
votes
1answer
537 views

Max number of elastic IPs that can be attached to single instance? [closed]

How many elastic IPs (publicly visible) can be attached to single instance?
1
vote
2answers
582 views

Dovecot with S3QL

Due to periodically running out of space on EBS volumes on AWS EC2, and looking to make the setup more fault resistant in case of server/volume failure, I'm considering moving a Dovecot maildir ...
-1
votes
1answer
39 views

Amazon AWS volume full although www folder has 88 megs [closed]

my mysql failed because, apparently, my volume is filled. All 8 gb of it. I only have put mongodb, nodejs, apache, mysql and in the www folder, wordpress and phpmyadmin. My question is, what happened ...
8
votes
1answer
10k views

What is causing Access Denied when using the aws cli to download from Amazon S3?

I'm really flailing around in AWS trying to figure out what I'm missing here. I'd like to make it so that an IAM user can download files from an S3 bucket - without just making the files totally ...
1
vote
4answers
2k views

CNAME not resolving with nslookup, but dig works

I am trying to point a CNAME to a S3 bucket, but keep having problems with the CNAME not being found by nslookup (and by my browser, for that matter). When I use dig however, it shows me the correct ...
0
votes
1answer
142 views

Configuring nginx server to handle requests from multiple domains

Use Case:- I am working on a web application which allows to create HTML templates and publish them on amazon S3.Now to publish the websites I use nginx as a proxy server. What the proxy server does ...
5
votes
2answers
1k views

How long before an s3 bucket can be created with same name after deletion?

Title is quite explanatory, but I have just deleted an s3 bucket as it was in the wrong region and am wanting to recreate it in the correct region with same name as the just deleted one. Is there any ...
0
votes
1answer
419 views

AWS: Best solution for syncing files across autoscaled EC2 instances?

I'm working on setting up autoscaling on EC2; Instances will be running a web app with big traffic spikes. The first solution I tried for syncing files across instances (since the web app will write ...
0
votes
1answer
400 views

How i can setup a nginx cache strategy that first try amazon s3, then memcache and do a fallback on miss?

i have a large site with lot of pages that almost never change, right now i am using two memcache servers (amazon elasticache), but this its really expensive. Thats why for this files that barely ...
0
votes
1answer
442 views

Move files from ftp server to s3

I would like to set up an ftp server, where users will upload files, and for each file, put it on s3 storage, and delete it from the ftp server. (the server runs on ec2 ubuntu) Here are the stuff I ...
11
votes
3answers
4k views

Backing up data stored on Amazon S3

I have an EC2 instance running a web server that stores users' uploaded files to S3. The files are written once and never change, but are retrieved occasionally by the users. We will likely accumulate ...
3
votes
2answers
2k views

I'm trying to use “aws s3 sync” on my EC2 instance. Is the '--exclude' option broken?

I'm trying to backup my EC2 instance to S3 using Amazon's official tools that come preinstalled on the EC2 instance. I'm having difficulty getting the sync command to exclude directories from the ...
0
votes
1answer
271 views

AWS S3 Static Hosting with Custom Domain - routing bare domain

I am trying to host some static content in an Amazon S3 bucket and to have that content available through my own domain. The bucket in question is called "e.tl-dr.org" and I have "index.html" set as ...
2
votes
0answers
402 views

How can I whitelist oubound-from-private-subnet traffic to S3 on the NAT instance of an EC2 VPC?

I'm researching privacy-compliant high-security deployment options for AWS VPC. I'm looking for a method of tightening outbound traffic from the private subnets at the NAT instance. For example, how ...
0
votes
2answers
244 views

Can I re-attach my EBS while a snapshot is pending?

I have my database backed up to an EBS drive. My current backup method is 1) queue all writes (not important how) 2) kill database process 3) detach + umount ebs volume 4) take snapshot 5) ...
0
votes
1answer
464 views

Nginx proxy to s3 bucket gets 400 Invalid Argument

I have a Django app in which I serve media files through an nginx proxy to s3. The relevant python code response = HttpResponse() response['X-Accel-Redirect'] = '/s3_redirect/%s' % ...
0
votes
1answer
147 views

AWS route53 forwarding

Essentially, I need to know how to point one URL/folder to a web server and a different URL/folder to an EC2 app server. I'm trying to setup a SAAS with the following URL configuration. ...
-2
votes
1answer
93 views

Sync EC2 instances [closed]

I know many people have asked how to sync multiple ec2 instances and it seems the usual answer is to store all the assets in S3. Would this still make sense if the only thing I am trying to share ...
1
vote
1answer
2k views

How to copy all s3 buckets to another AWS account?

I'm copying all EC2 instances to another AWS account (creating the AMIs, sharing them with that account and running the instances from AMIs there). I also need to move my S3 buckets since the ...
0
votes
1answer
211 views

Route53 pointing to cloudfront www

I have seen a lot of tutorials about having non-www domain hosting of S3 static websites but I've yet to see one which works on www domains, i.e www.jobkent.com. My steps so far is to create a bucket ...
2
votes
1answer
744 views

AWS Cloudfront multiple origins - how can we fallback to 2nd origin if not found in the 1st

We're trying to set up a Cloudfront distribution where the default origin is S3, but if the content is not found on S3, we want it to fetch it from an EC2 instance. Can we setup these multiple ...
1
vote
0answers
103 views

Handling multiple server blocks in nginx configuration

I am working on setting up a proxy server for my application.The use case is I want a specific set of requests to be redirect to say abc.com and rest of the request to be redirected to xyz.com. Eg:If ...
1
vote
3answers
328 views

Hosting a site on Amazon S3, URL keeps redirecting

I am trying to use Amazon S3 to host my webiste. I have the domain registered though namecheap. Whenever I navigate to mywebsite.com the URL in the browser changes to ...
1
vote
0answers
188 views

Amazon S3 sync theory

I'm setting up a backup of my vital data (database and images, mainly) to S3 from my Ubuntu box. I've set up Amazon S3, and installed S3FS to mount the bucket on my machine. This is working well, but ...
0
votes
2answers
137 views

Looking for a high IO s3 “compatible” storage solution

Help me serverfault! I am looking for a high IO (2 million mostly put transactions per day of 7-10k xml chunks) storage solution that is amazon s3 compatible that I can house in my datacenter. I am ...
0
votes
1answer
142 views

Can AWS S3 files in buckets get deleted by a download timing out?

A few AWS S3 files might have gotten deleted while trying to download everything for a local backup. The download/connection timed-out a couple times. The next day several HTML/JS files are missing ...
4
votes
1answer
2k views

Linux server sync to an Amazon S3 bucket

I am looking for a stable solution to replace a classic server backup to another server using rsync. I have to sync a whole filesystem (more than 1Tb) to Amazon S3. Where am I? Solution 1: I mapped ...