-1
votes
0answers
31 views

How does one keeps Amazon EC2 mount point in sync?

I have /var/www/html/ on INSTANCE_ID=i-xxxxxxxxx and I MUST have same thing on another instance, but I can't use rsync or cron to manually trigger synchronization. How does one accomplish that goal? ...
-1
votes
0answers
32 views

Linux server backup to Amazon S3 using SSL

I have Linux box CentOS 6.5 and i want to backup daily files like SQL dumps and config files to Amazon S3 I have installed Ruby and S3Sync. But the problem when running the s3sync with these ...
0
votes
0answers
19 views

Best practice for web applications and windows services remote configuration in AWS

we have a distributed system that contains windows services and web applications (.NET and Java based). Currently, most of the initial configuration for these applications are taken from various ...
0
votes
1answer
57 views

How to best backup AWS-hosted systems? [closed]

We are deploying a number of servers at AWS and need to work-out a general-purpose backup strategy. The requirements are: Retain the ability to recover full systems or individual files or ...
-1
votes
1answer
61 views

S3 static website hosting, which DNS CNAME record should I use?

I have created a S3 static website e.g. www.example.com The S3 endpoind is: www.example.com.s3-website-us-east-1.amazonaws.com When I dig this DNS ...
1
vote
1answer
57 views

Restore a versioned S3 bucket to a particular point in time

Let's say I've got S3 versioning enabled for my bucket: http://docs.aws.amazon.com/AmazonS3/latest/dev/Versioning.html Then, let's say someone (for example, junior employee) messes up the S3 bucket ...
0
votes
0answers
64 views

Drop/Truncate DynamoDB table with AWS Data Pipeline

I have set up a Data Pipeline that imports files from an S3 bucket to a DynamoDB table, based on the predefined example. I want to truncate the table (or drop and create a new one) every time the ...
-1
votes
1answer
53 views

Is it possible to use PHP on a website hosted on AWS S3 without using EC2 or Elastic Beanstalk?

I have a bit of PHP (a contact form to be exact) that isn't working right now on my website. I'd like to activate the PHP and I heard one of the ways is to use Elastic Beanstalk. However, Elastic ...
1
vote
1answer
129 views

How can I reuse existing resources in CloudFormation?

I've have S3 bucket as resource in my CloudFormation template. With DeletionPolicy set to Retain. This works as expected, when deleting the stack, it does indeed retain the bucket. However, when I ...
1
vote
1answer
344 views

No targets available when trying to set alias target from Route 53 to S3

I'm trying to setup a simple Amazon AWS S3 based website, as explained here. I've setup the S3 bucket (simples3websitetest.com), gave it the (hopefully) right permissions: { "Version": ...
0
votes
0answers
91 views

AWS Cloudformation Bootstraping with S3 File and Autoscaling

I just started trying to use CloudFormation and am using it for some autoscaling. I am new to all this so bare with me. I am using the sample template for autoscaling found here. ...
1
vote
0answers
589 views

Amazon Cloudfront with S3. Access Denied

We're trying to distribute out S3 buckets via Cloudfront but for some reason the only response is an AccessDenied XML document like the following: <Error> ...
0
votes
3answers
555 views

Accessing Amazon S3 from a private VPC subnet

If I have a VPC running and some servers located in the private portion of that network that do backend processing by downloading files from amazon s3, can I access S3 internally to get at those ...
0
votes
1answer
128 views

What is the significance of the s3 region, “US Standard” when it comes to “Amazon EC2 in the same region” pricing?

AWS S3 provides a special region called US Standard, US Standard Uses Amazon S3 servers in the United States Provides eventual consistency for all requests. This region automatically routes ...
0
votes
1answer
286 views

Cloud-front backed with Nginx (which proxies to S3) randomly missing already cached items?

I wish to serve images from a S3 bucket with Cloudfront as CDN frontend, for that I tried the following: What I wish to acheive (Attempt 2) -- (Misses cloudfront cache randomly) I have the ...
0
votes
0answers
64 views

nginx passing assets from S3

I'm trying to configure Nginx to passing assets from S3.I have the below in the config but when am trying to access frontend, nginx return 404 on static resources. And nginx error log is empty. Can ...
1
vote
0answers
131 views

Amazon S3: allow user access to subfolder only on any bucket

I'm trying to write a policy that will allow a user to read from any bucket (that part works) but only write to a specific subfolder on any bucket. This is my policy so far (reading works, but it ...
1
vote
2answers
191 views

Dovecot with S3QL

Due to periodically running out of space on EBS volumes on AWS EC2, and looking to make the setup more fault resistant in case of server/volume failure, I'm considering moving a Dovecot maildir ...
-1
votes
1answer
38 views

Amazon AWS volume full although www folder has 88 megs [closed]

my mysql failed because, apparently, my volume is filled. All 8 gb of it. I only have put mongodb, nodejs, apache, mysql and in the www folder, wordpress and phpmyadmin. My question is, what happened ...
0
votes
1answer
209 views

AWS: Best solution for syncing files across autoscaled EC2 instances?

I'm working on setting up autoscaling on EC2; Instances will be running a web app with big traffic spikes. The first solution I tried for syncing files across instances (since the web app will write ...
7
votes
3answers
2k views

Backing up data stored on Amazon S3

I have an EC2 instance running a web server that stores users' uploaded files to S3. The files are written once and never change, but are retrieved occasionally by the users. We will likely accumulate ...
2
votes
2answers
546 views

I'm trying to use “aws s3 sync” on my EC2 instance. Is the '--exclude' option broken?

I'm trying to backup my EC2 instance to S3 using Amazon's official tools that come preinstalled on the EC2 instance. I'm having difficulty getting the sync command to exclude directories from the ...
1
vote
0answers
196 views

How can I whitelist oubound-from-private-subnet traffic to S3 on the NAT instance of an EC2 VPC?

I'm researching privacy-compliant high-security deployment options for AWS VPC. I'm looking for a method of tightening outbound traffic from the private subnets at the NAT instance. For example, how ...
0
votes
2answers
84 views

Can I re-attach my EBS while a snapshot is pending?

I have my database backed up to an EBS drive. My current backup method is 1) queue all writes (not important how) 2) kill database process 3) detach + umount ebs volume 4) take snapshot 5) ...
1
vote
1answer
536 views

How to copy all s3 buckets to another AWS account?

I'm copying all EC2 instances to another AWS account (creating the AMIs, sharing them with that account and running the instances from AMIs there). I also need to move my S3 buckets since the ...
0
votes
1answer
84 views

Route53 pointing to cloudfront www

I have seen a lot of tutorials about having non-www domain hosting of S3 static websites but I've yet to see one which works on www domains, i.e www.jobkent.com. My steps so far is to create a bucket ...
1
vote
1answer
277 views

AWS Cloudfront multiple origins - how can we fallback to 2nd origin if not found in the 1st

We're trying to set up a Cloudfront distribution where the default origin is S3, but if the content is not found on S3, we want it to fetch it from an EC2 instance. Can we setup these multiple ...
1
vote
0answers
69 views

Handling multiple server blocks in nginx configuration

I am working on setting up a proxy server for my application.The use case is I want a specific set of requests to be redirect to say abc.com and rest of the request to be redirected to xyz.com. Eg:If ...
1
vote
1answer
130 views

Amazon EC2, S3, REST API, and how to correctly provide contents to users

I have deployed a REST server in an Amazon EC2 instance. I have also configured an Amazon S3 bucket to store all the data generated by users while interacting with the API. The main information stored ...
0
votes
2answers
95 views

Looking for a high IO s3 “compatible” storage solution

Help me serverfault! I am looking for a high IO (2 million mostly put transactions per day of 7-10k xml chunks) storage solution that is amazon s3 compatible that I can house in my datacenter. I am ...
0
votes
1answer
47 views

Can AWS S3 files in buckets get deleted by a download timing out?

A few AWS S3 files might have gotten deleted while trying to download everything for a local backup. The download/connection timed-out a couple times. The next day several HTML/JS files are missing ...
1
vote
1answer
95 views

Multisite on AWS EC2

I'm working on a multi-site app targeted to run fully Amazon Web Services. Due to its nature, it will have significant traffic spikes, followed by long periods of low traffic, so the ability to scale ...
1
vote
1answer
203 views

Debugging logrotate postrotate script

Following is my logrotate conf. /mnt/je/logs/apache/jesites/web/*.log" { missingok rotate 0 size 5M copytruncate notifempty sharedscripts ...
0
votes
2answers
131 views

Can I limit user access to AWS S3 buckets?

I'm working on a site that is probably destined for AWS hosting. This leads to a question about access rights to stuff that would be stored in S3 buckets: I set up an EC2 server for the site, and ...
1
vote
1answer
116 views

Restore snapshot from other aws account?

I am new in this, so forgive my beginner question. I have an aws account which is currently in us-west-2c. It has a instance running, and also a couple of volumes which i made. I have multiple backups ...
1
vote
1answer
918 views

Give EC2 IAM role read access to S3 bucket

I have an AWS Elastic Beanstalk Rails app that I am configuring via the config script to pull some files from an S3 bucket. When I start up the application, I keep receiving the following error in the ...
2
votes
1answer
689 views

What is your general strategy to backup S3 buckets?

We are starting a project which involves storing large data quantities in S3. S3 is good at scaling and we've expect to have up to 5TB and million of files in bucket. While i may trust Amazon in ...
0
votes
1answer
256 views

AWS EC2 Mailserver Failover Strategies done right

I'm researching in this topic really hard the last few days and i just want to discuss this with a few specific questions - i did not find any suitable thread here that is covering my needs and ...
0
votes
0answers
31 views

Cloudformation Resource for a Cross Region S3 bucket policy [duplicate]

I know this is somewhat a duplicate of Cross Region S3 bucket policy but I don't have enough rep to comment and the answer wasn't detailed enough. I would like to allow EC2 servers based in ...
0
votes
1answer
35 views

To run python script when my Amazon instance boots up

Where should i place my script in amazon instance such that my script should run when my instance boots up? I tried placing it in rc.local but it didnt help. My script is about connecting to Amazon ...
0
votes
1answer
233 views

Unable to read S3 file from interactive pig job flow

I'm unable to read a simple test file on S3 from an interactive pig job flow (hadoop, elastic map reduce), and I'm not sure why. I have two S3 buckets. Let's call them unmounted_bucket, and ...
0
votes
1answer
185 views

Configure subdomain to point to S3 bucket using Route 53

How would I go about mapping files.example.com to an Amazon S3 bucket using Amazon's Route 53 service? I've attempted to add a CNAME record but I get the following:
1
vote
1answer
331 views

How can I download an S3 binary file using Amazon's AWS CLI tool?

I am trying to download a binary file from an AWS S3 bucket using Amazon's new command-line interface. However, the tool responds with an error message. $ aws s3 get-object --bucket myBucketName ...
0
votes
0answers
355 views

How can I move s3 objects >5gb from one bucket to another?

Objects larger than 5GB are supported with multi-part uploading. We have 5gb+ files in one bucket already that I'd like to move to another, under the same AWS account. When I issue the command using ...
-2
votes
1answer
129 views

Which is better - AWS S3 or EBS? [closed]

I am trying to create a system where users can upload their data (audio, text) which can run into around 200 MB per user. I am trying to figure out what is the best way to go ahead - using S3 or EBS. ...
0
votes
1answer
114 views

What sort of delay is there between reading an Amazon S3 object from an EC3 instance

I have a REST web service that contains a /image/view/ resource that displays an image. The image is currently stored as an object in Amazon S3. When /image/view/ is accessed, the web service ...
2
votes
2answers
1k views

Create an Amazon EC2 instance with automatic access to private S3

I was wondering. Say I have a file in a private S3 bucket, and I then deploy an EC2 instance which has something like that in its rc.local: GET http://privateamazons3url.com How can I make it so ...
0
votes
1answer
173 views

Mounting a S3 bucket across multiple instances

I want to use Amazon S3 to store all of my files for my websites. I can set S3QL up properly so that it is mounted on /var/www and everything works fine. I want to do it this way so that I can ...
0
votes
1answer
199 views

Amazon AWS Store Wordpress uploads on S3

I'm getting ready to move my company's website and order management application to AWS. We use wordpress as the 'face' of our company. Our order management app is for internal use. I'm using Elastic ...
3
votes
1answer
850 views

Setting up CloudFront CDN on a cookieless root domain

I have recently set up an AWS S3 bucket for my site's static content, along w/ a CloudFront distribution for my CDN. I have this working using a sub-domain. However, after running YSlow, I realized ...