Tagged Questions

0
votes
1answer
27 views

To run python script when my Amazon instance boots up

Where should i place my script in amazon instance such that my script should run when my instance boots up? I tried placing it in rc.local but it didnt help. My script is about connecting to Amazon ...
0
votes
1answer
49 views

Unable to read S3 file from interactive pig job flow

I'm unable to read a simple test file on S3 from an interactive pig job flow (hadoop, elastic map reduce), and I'm not sure why. I have two S3 buckets. Let's call them unmounted_bucket, and ...
0
votes
1answer
33 views

Empty /mnt: store-backed instance launch from EBS-backed AMI

I have an EBS AMI which I want to publish in AWS Market Place. The AMI was created with data in /mnt. The snapshop includes both /dev/sda1 and /dev/sdb devices : Block Devices: ...
0
votes
1answer
38 views

Copy files over to s3 from ec2 instance

I have an FTP running on my ec2 instance and I'll like to move over those files (after some processing) to s3. Lots of posts on this to either use the Amazon .NET, php or python APIs or use a 3rd ...
0
votes
1answer
49 views

What sort of delay is there between reading an Amazon S3 object from an EC3 instance

I have a REST web service that contains a /image/view/ resource that displays an image. The image is currently stored as an object in Amazon S3. When /image/view/ is accessed, the web service ...
0
votes
1answer
51 views

autoscale static content on ec2 using local cache

Hello Serverfault members. I want to achieve the following setup on EC2: A load balancer starts and stops instances which only serve static content. (a javascript based application) I do not want to ...
1
vote
2answers
100 views

Create an Amazon EC2 instance with automatic access to private S3

I was wondering. Say I have a file in a private S3 bucket, and I then deploy an EC2 instance which has something like that in its rc.local: GET http://privateamazons3url.com How can I make it so ...
0
votes
1answer
98 views

Mounting a S3 bucket across multiple instances

I want to use Amazon S3 to store all of my files for my websites. I can set S3QL up properly so that it is mounted on /var/www and everything works fine. I want to do it this way so that I can ...
0
votes
2answers
134 views

Mixed Static and dynamic content site using AWS S3 and EC2

We are installing a Java web application in a EC2 running Tomcat. The application uses a folder for users pictures (static content)-> www.example.com/PICTURES We use mod_jk to exclude Tomcat from ...
3
votes
1answer
60 views

Is Amazon s3 required if am using Cloudfront for files

I am planning to host a website in Amazon Ec2 instant. I got some basics from the docs. But I have few confusions. If am using cloudfront for CDN, do i really need to server files from s3? The site ...
1
vote
1answer
313 views

How to replace php.ini on elastic beanstalk EC2 instances for PHP?

I have been exploring Elastic Beanstalk for easy deployment of my PHP 5.4 application. For my application, I need to make changes in php.ini file. After some searching on internet i tried to use ...
0
votes
3answers
216 views

Windows with IIS serving ASP files stored at Amazon S3

We have a website that is hosted in Windows Server 2008 R2, with IIS 7.5 The webserver hosts a couple of websites developed with ASP Classic and ASPX Is there a way to host the files for the dynamic ...
0
votes
2answers
88 views

Amazon Cloudfront, S3 and EC2

I'm trying to use Amazon Cloudfront as a CDN provider but unsure of what other services are meant to be. Do I have to use S3 and EC2 as Virtual Server to host my files and change hosting provider in ...
0
votes
2answers
294 views

How should secret files be pushed to an EC2 (on AWS) Ruby on Rails application?

How should secret files be pushed to an EC2 Ruby on Rails application using amazon web services with their elastic beanstalk? I add the files to a git repository, and I push to github, but I want to ...
0
votes
1answer
80 views

Subsequent runs of rsync locally don't reduce data transferred

I have an EC2 instance with data I want to sync to a mounted, but remote, volume, as a backup. rsync seems like the way to go with this, so as a test I took my test file (a Postgres pg_dump file) and ...
0
votes
1answer
198 views

Cross Region S3 bucket policy

I would like to allow EC2 servers based in us-east-1 to read content from a bucket in us-west-2. Every time I try I get a "The Bucket you are attempting to access must be addressed using the ...
1
vote
1answer
597 views

How to config Amazon Route53 working without www in sub-domain

edit: Amazon now supports this. http://aws.typepad.com/aws/2012/12/root-domain-website-hosting-for-amazon-s3.html I have my domain config in Route53 at Amazon AWS exec ping command in my domain ...
1
vote
3answers
1k views

How to schedule automatic (daily) snapshots of AWS EC2 Windows Instance?

I have some Windows servers hosted on Amazon EC2. Some run Windows Server 2003 and other run Windows Server 2008. These are EBS-backed instances. Most of the instances also have some additional ...
0
votes
0answers
85 views

Backing up files from my EC2 instance to S3

Hi I have a set of neat scripts that backup my dbs into db.sql.gz files under a folder on on ec2 host. My files are of the form (as you can see they are weekly rolling backups) ...
1
vote
2answers
130 views

Is it safe to use S3 over HTTP from EC2, as opposed to HTTPS

I found that there is a fair deal of overhead when uploading a lot of small files to S3. Some of this overhead comes from SSL itself. How safe is it to talk to S3 without SSL when running in EC2? ...
0
votes
2answers
161 views

How to make s3fs work with IAM roles?

We are using IAM roles to maintain the machines. We now planning to mount the s3 to our ec2 instances and do the processing as per our need. We been using s3fs tool for mounting. But that doesn't ...
1
vote
1answer
119 views

Creating url from the cloudfront aws

I have my js files which I have uploaded into the Amazon S3 and linked it with the Cloudfront. I got a url something like this : dxxxxxxxx.cloudfront.net But opening that url in my browser ( I'm ...
0
votes
1answer
74 views

EC2 user-data and private s3 resources

I would like to set a user-data script on my EC2 instances like this: #include http://mybucket.s3.amazonaws.com/myapp/environment/aws_init.sh However the resource is acl private and cannot be ...
1
vote
1answer
143 views

How do I delete aws s3 bucket policy?

I've mistakenly configured a bucket policy with a name of nonexisting bucket (via cloudformation). Now I can't delete the stack (S3::DeleteBucketPolicy failed), and can't find any way to delete the ...
-2
votes
1answer
424 views

file transfer between s3 and ec2

I want to automate transfer of tomcat log files from micro instance to S3 account. However, all the scripts I find online use key pair in order to do this. I cant upload these key pair to the server ...
1
vote
1answer
153 views

Moving an Application to Amazon EC2 with S3

Recently I have created a web application. The application has some static parts (libraries, classes etc) and dynamic parts (images, cache, log etc) as well. However, some static parts of the app ...
2
votes
1answer
482 views

Why I'm getting MD5 Sums don't match! error?

I'm trying to upload my audit files to S3. Using s3cmd tools. I just run this command : sudo s3cmd put /var/log/audit/audit.log s3://audit-files But I get a error message like this : ...
0
votes
1answer
43 views

How to place my audit file in Amazon S3?

I have installed and configured the auditd package in Amazon Ec2 instance. I wish I need to place all the auditd log files in Amazon S3. I'm very new to Ubuntu can anyone explain me how to do it?
0
votes
1answer
42 views

Storing pages with only client-side code in S3 over full EC2?

Question: Would storing pages in S3 with only client-side code reduce costs in comparison to hosting them in Amazon's EC2? Background: Right now I use a cms to manage all of my pages and users for a ...
1
vote
1answer
587 views

AWS - Status check fails when loading AMI created from snapshot

I have a running micro instance using an 8GB EBS that I've customized. To my understand there are two ways I can create an AMI from this. 1) EC2 console -> INSTANCES - Instances -> Right Click ...
1
vote
1answer
330 views

Using TntDrive to mount Amazon S3 on a Windows Amazon EC2 instance

I currently have 2 Amazon EC2 Windows Server 2008 instances setup with a load balancer. My problem now is that I need both instances to be able to access a single file system source (I'm trying to use ...
2
votes
2answers
2k views

Which is the fastest way to copy 400G of files from an ec2 elastic block store volume to s3?

I have to copy 400G of files from an elastic block store volume to an s3 bucket... Those are about 300k files of ~1Mb I've tried s3cmd and s3fuse, both of them are really, really slow.. s3cmd ran for ...
2
votes
2answers
950 views

How do I create a EC2 S3 backed instance, starting from a Windows VHD?

I have a Windows VHD image created in Hyper-V, and I want it to exist as a S3-backed instance on EC2. I've found several articles (and a tutorial) on how to import my virtual machine to EC2. However, ...
2
votes
1answer
128 views

How can I turn an existing Windows Server 2008 EBS-backed instance into a S3-backed (instance-backed) AMI?

I understand there is no direct conversion to get from EBS to S3. But is there some series of steps that can make this happen, or is rebuilding the image from scratch the best option? Is there a way ...
0
votes
1answer
237 views

AWS instances: AMI bundles and snapshots and bears, oh my

I've googled a good amount and am still pretty confused and feeling like I'm missing or overlooking something. My goal is to restore a host using a bundle. I have an AMI bundle of a now-nonexistent ...
1
vote
2answers
143 views

Amazon CloudFrount on EC2

I know that i can mount s3 buckets with s3fs on EC2 instance. So i have next question can i somehow mount Amazon Cloud Front (my S3 buckets files) in EC2 instance?
2
votes
2answers
1k views

Snapshots == EBS backed instance, persistence, and S3 storage?

I want to clear up some confusion and clarify understanding on EC2 instances being EBS backed. If you start an AMI from a community image, configure your server as you want it configured, then use ...
3
votes
2answers
909 views

What design features make Joyent's ZFS and Amazon's EBS (S3) reliable?

I know this isn't exactly an apples to apples comparison, what I'm trying to evaluate is which one is safer - less likely to lose data. Joyent's SmartOS uses ZFS to store data whereas an EC2 machine ...
2
votes
1answer
229 views

Using an IP Address to Point to Amazon S3 Storage

Is there a way to get an IP address to refer to Amazon S3 Storage location? The current solution my company is thinking of going with involves setting up a EC2 server with an Elastic IP and using ...
0
votes
1answer
216 views

A uploaded file is 0 byte on Amazon S3 using django

I've symbolic linked a S3 directory on my EC2 server. But a uploaded file was 0 byte when I uploaded file. It was work well before (I used just web server directory) I don't have any idea dealing ...
7
votes
2answers
4k views

Is mounting S3 buckets directly into EC2 instances safe?

as the title of my question says, I would like to know whether this is a good practice or not, I know I can mount it in an EC2 instance but I was wondering if, as I will be adding more instances to ...
-1
votes
1answer
252 views

Which of snapshots I can safely remove?

If you make periodic snapshots of a volume, the snapshots are incremental so that only the blocks on the device that have changed since your last snapshot are incrementally saved in the new ...
2
votes
2answers
791 views

Amazon EC2 - What's the point of having Instance storage if it is non-permanent and EBS provides a permanent store?

I'm specifically looking at the Standard Large On-Demand instance which has 850 GB of instance storage. What I really don't understand is why have 850 GB of storage on the instance if that data will ...
-2
votes
3answers
282 views

amazon s3 vs amazon ec2 regarding cost, and which better for image hosting website? [closed]

I want to know which will cost more, s3 or ec2. I need to know by example to estimate my future payments. Also which of them will be better for an image hosting website?
1
vote
4answers
272 views

Best practice for synchronizing sources across servers (Amazon EC2)

I'm moving from single app server to load balanced config. In the single server config I synchronized the sources by S3 cmd sync s3 every few minutes and on hostup (Scalr event) I sync the sources ...
8
votes
2answers
3k views

EC2 - Shared Storage - S3FS or EBS?

Building my web service onto EC2 right now and have a single instance behind a load balancer. I will of course cater for multiple instances. My initial idea was to run all the instances a dumb ...
0
votes
1answer
466 views

Writing to an s3 mounted directory

hopefully someone can advise. I've recently mounted an s3 bucket to a directory /s3 on my ubuntu amazon ec2 instance -following: http://code.google.com/p/s3fs/wiki/FuseOverAmazon. This was set up in ...
2
votes
2answers
432 views

How can I secure files on S3?

I want to control who can download a file via an app (as if it was held on the local FS). What's the right approach for doing this, considering S3 can't be mounted as a POSIX compliant file system?
0
votes
2answers
335 views

Best practice for storing read-only instance data?

So, i'm currently writing my bachelor thesis and my job is to cloudify a webservice which recommends a soundtrack for images. The main part of the recommendation process is a lookup on a ~40gb index ...
1
vote
1answer
320 views

S3 Instead of NFS to Host H.A. Website on AWS

I've been looking at creating a highly available setup with EC2. It would involve several web server nodes acting as front-ends to multiple NFS and database serves (backends). Ideally, the platform ...

1 2