Amazon Web Services (AWS) delivers a set of services that together form a reliable, scalable, and inexpensive computing platform "in the cloud". If you have a question about a specific web service, consider asking on its tag, e.g., amazon-ec2.

learn more… | top users | synonyms (2)

49
votes
10answers
35k views

How can I get the size of an Amazon S3 bucket?

I'd like to graph the size (in bytes, and # of items) of an Amazon S3 bucket and am looking for an efficient way to get the data. The s3cmd tools provide a way to get the total file size using s3cmd ...
28
votes
10answers
19k views

Why should I use Amazon Route 53 over my registrar's DNS servers?

I am building a site that I anticipate will have high usage. Currently, my registrar (GoDaddy) is handling DNS. However, Amazon's Route 53 looks interesting. They promise high speed and offer globally ...
20
votes
3answers
7k views

How can I deploy a scalable, reliable haproxy cluster on Amazon EC2?

We need some more advanced functionality than ELB provides (mostly L7 inspection), but it's not obvious how to handle things like heartbeat and high availability with something like haproxy using EC2. ...
19
votes
1answer
4k views

Does Heartbleed affect AWS Elastic Load Balancer?

The Heartbleed OpenSSL vulnerability (http://heartbleed.com/) affects OpenSSL 1.0.1 through 1.0.1f (inclusive) I use Amazon Elastic Load Balancer to terminate my SSL connections. Is ELB vulnerable?
18
votes
2answers
1k views

In AWS, does an hour of usage get charged just for an instance being in the “running” state?

When AWS documentation and pricing refer to "usage" does this simply mean "if the instance is on" instead of "if the instance is on and doing work". E.g., if I had an EC2 instance running but it was ...
18
votes
2answers
5k views

Shrinking Amazon EBS volume size

I have seen this answer for growing EBS volumes, but I would like to shrink one. The default Ubuntu Server images are 15 GB while I really need only 2 GB max (I use a different volume for data). Is ...
17
votes
3answers
19k views

Where does Amazon publish the range of IP addresses used for EC2 instances by region?

How can I keep updated of changes to the range of IP addresses that Amazon will use for EC2 instances. I want to add a range of IPs to my firewall settings to allow access to my 'ground based' mysql ...
16
votes
2answers
2k views

Which AWS features are EBS backed?

I recently read an article AWS: The good, the bad and ugly, which mentioned that they've moved off of all EBS backed AWS features. What features are explicity (EBS backed EC2 instances) or implicitly ...
14
votes
4answers
14k views

How to download public key from Amazon AWS?

I have a running amazon ec2 linux instance associated with a keypair (p1) and I have downloaded the private key to my home desktop. Now at work, I created a keypair (p2) on my work desktop and ...
14
votes
8answers
8k views

How can I monitor daily spending on AWS?

Our infrastructure is on AWS. I want to get a daily report on how much spent on the previous day. What is the best way to do it?
13
votes
3answers
9k views

Internal DNS inside Amazon AWS VPC

I am getting started on understanding VPC but am not seeing a good internal DNS solution. For example, we're using a non-RDS database server which other servers in the VPC connect to. I would like ...
12
votes
2answers
4k views

How to resize Amazon EC2 instance?

Is it possible to resize an Amazon EC2 instance, e.g. convert from a small instance to a large instance? If so, what is the easiest way to resize Amazon EC2 instance? Like Rackspace Cloud Servers do ...
12
votes
4answers
2k views

Amazon EC2 spot instances - is there a catch?

I needed to start a new EC2 instance today and decided to try out the new spot instances, where you can reduce your instance cost by bidding on the maximum per-hour price you're prepared to pay. ...
12
votes
2answers
3k views

How to change the name and description of an AWS EC2 security group?

How do you change the name and description of a security group in AWS EC2? My security group is named quick-start-1 (the default) and I want to change it to "HTTP, HTTPS and Limited SSH".
12
votes
1answer
43k views

How to add user with SFTP/ FTP access to '/var/www/html/website_abc' folder on Amazon EC2 Centos?

Possible Duplicate: Linux directory permissions I'm working with some third-party developers and I would like to grant SFTP (or FTP) access to the root folder for a website they're working ...
11
votes
3answers
4k views

How to recreate a working AMI from recovery snapshot after Aug 8 outage?

After Amazon's Aug 8 outage, all (EBS based) AMIs stopped working for many users. This is due to corruption of some sectors in snapshots that the AMIs are based on. However, Amazon created recovery ...
11
votes
5answers
2k views

How do you keep up with Nagios/Capistrano configs when using EC2?

I use Amazon EC2 for my mobile app. Depending on load of the application at a given time, I might spawn new instances and then take them down when load is lower to save costs. How does one keep up ...
11
votes
5answers
4k views

Amazon EC2: possible to use elastic load balancing across web servers in multiple regions based on location of client?

Related to an another question I asked. This question seems similar but I'm wondering if there are any updates. To support a single site that has users all over the world, I will create EC2 web ...
10
votes
8answers
17k views

Why can't I ssh into my new EC2 Instance?

I created a new instance (tiny, 64 bit AMI linux from Amazon) Created a new key pair called "mir". I downloaded mir.pem and put it in my ~/.ssh folder. I even did ssh-add mir.pem. Then I tried to ...
10
votes
3answers
6k views

Are Amazon EC2 Private IPs reachable from any instance running in EC2?

After searching previous questions here, the general consensus seems to be if an instance that I own is assigned a private IP of 10.208.34.55, that only OTHER INSTANCES I OWN can reach it at that ...
10
votes
2answers
4k views

What is ephemeral storage good for?

I have been reading about the ephemeral storage with amazon ec2 and am trying to figure out what is the best way to use the 100s of GBs they supply you. If it isn't persistent, what can it be good ...
9
votes
4answers
3k views

set Google Apps SPF record in Amazon AWS Route 53

I'm using the new AWS GUI for Route 53 to setup my domain records. However, the AWS console won't accept the recommended Google Apps SPF record, v=spf1 include:_spf.google.com ~all (found here). It ...
8
votes
5answers
4k views

Which is faster for read access on EC2; local drive or EBS?

Which is faster for read access on an EC2 instance; the "local" drive or an attached EBS volume? I have some data that needs to be persisted so have placed this on an EBS volume. I'm using ...
8
votes
4answers
2k views

Why do AWS spot-instance prices spike above the “on demand” pricing?

Amazon Pricing on Spot Instance Inconsistencies This is something which will be best explained through screenshots of a historical chart of instance pricings. If you look at a lot of the instance ...
8
votes
3answers
16k views

Download existing EC2 key pair

I am playing around with Amazon EC2 and have (finally) managed to SSH into the box from my home machine. Now I want to connect from my work machine but neglected to copy the key pair on a USB key. Is ...
8
votes
2answers
492 views

How do Amazon Machine Images work?

I've seen many tutorials and such about creating AMI's, but I've never really understood the full concept of an AMI. Is a link to the instance, or is it stored and never changed. Also, does an image ...
8
votes
2answers
6k views

Which is the fastest way to copy 400G of files from an ec2 elastic block store volume to s3?

I have to copy 400G of files from an elastic block store volume to an s3 bucket... Those are about 300k files of ~1Mb I've tried s3cmd and s3fuse, both of them are really, really slow.. s3cmd ran for ...
8
votes
4answers
7k views

Is it possible to move an AWS EC2 AMI from one region to another region and if so how?

I have an AWS EC2 AMI in the EU region. I want to move it to the US region. The root device type is EBS and the OS is Linux. Is it possible to transfer the image to the US region and if so how?
8
votes
2answers
2k views

Can't upload certificate to AWS

I'm doing: aws iam upload-server-certificate --server-certificate-name MysiteCertificate --certificate-body Downloads/mysite/mysite.crt --private-key mysite.pem --certificate-chain ...
8
votes
1answer
1k views

AWS - removing ec2-user from sudo list

I'm running a production-level Amazon ec2 instance, and I want to close out root privileges to all users. Normally, when one logs in to the instance as ec2-user, the ec2-user immediately gets sudo ...
8
votes
1answer
3k views

AWS EC2 migration to new instance type with SSD Drives

I have MySQL running on an m1.xlarge instance with a 100GB EBS volume holding the data files. I would like to migrate to a m3.2xlarge instance and place the data files on the new 2 x 80GB SSD drives. ...
8
votes
3answers
3k views

Backing up data stored on Amazon S3

I have an EC2 instance running a web server that stores users' uploaded files to S3. The files are written once and never change, but are retrieved occasionally by the users. We will likely accumulate ...
8
votes
3answers
5k views

Root Device on SSD instance types. SSD vs EBS confusion

I have an AMI that was originally created from a t1.micro linux. The "Root Device Type" of this AMI is EBS (8 GB) and my web application software is "baked" into this root volume. Now I would like to ...
8
votes
3answers
2k views

Amazon S3 and Access-Control-Allow-Origin

Does Amazon S3 allow custom headers? Or am I out of luck? Access-Control-Allow-Origin: * Thanks in advance!
8
votes
2answers
4k views

EC2 - Shared Storage - S3FS or EBS?

Building my web service onto EC2 right now and have a single instance behind a load balancer. I will of course cater for multiple instances. My initial idea was to run all the instances a dumb ...
8
votes
3answers
2k views

How to cap bandwidth usage on AWS EC2?

I'm planning to use AWS EC2 for my web application and I need control over the bandwidth usage (don't want the instances to be compromised and ramping up bandwidth cost crazily). There are many ...
8
votes
2answers
871 views

How to upgrade to the latest AMI in AWS Elastic Beanstalk?

I'm running an application on AWS Elastic Beanstalk, and it looks like I need to create a new environment if I want to use the latest AMI. If I knew what the latest AMI id was, I could update it in ...
7
votes
3answers
17k views

how do i set the dns server on godaddy with AWS?

I have a domain name on godaddy and i also have a amazon web services account. I have an EC2 instance and i want to change the dns nameserver on the godaddy control panel to aws and i have no idea ...
7
votes
1answer
2k views

update-rc.d on Amazon Linux

I am fairly new to system administration and I am simply trying to make sure nginx runs at startup on my Amazon EC2 instance (running Amazon linux) I have placed the script in /etc/init.d, but it ...
7
votes
2answers
1k views

Convert file system format on AWS EC2 ephemeral storage disk from ext3 to ext4

I have an instance-store EC2 instance with Ubuntu 11.04 i386. At present my disk partition looks like this: Filesystem Size Used Avail Use% Mounted on /dev/xvda1 9.9G 529M ...
7
votes
3answers
7k views

Install SSL on Amazon Elastic Load Balancer with GoDaddy Wildcard Certificate

I'm a bit stuck installing an SSL Cert on an AWS Elastic Load Balancer. I have a wildcard certificate from GoDaddy and need to point it at the ELB. I have run the command (I ran it on one of the ...
7
votes
1answer
2k views

SSL redirect on EC2 instance behind SSL terminating load balancer

I'm trying to redirect all url's to https in a web application. I have an ec2 instance behind an elastic load balancer. SSL is terminated on the load balancer. Any attempts at redirection end up ...
7
votes
3answers
10k views

Why is uploading to S3 so slow?

I am using s3cmd to upload to S3: # s3cmd put 1gb.bin s3://my-bucket/1gb.bin 1gb.bin -> s3://my-bucket/1gb.bin [1 of 1] 366706688 of 1073741824 34% in 371s 963.22 kB/s I am uploading ...
7
votes
3answers
4k views

Accessing storage on an EC2 instance?

I am using a large EC2 instance but just realized that I don't have the space promised. I only get 8 gigs when it says I should have 850 GB. From what I understand two extra 420 gb drives should be ...
7
votes
3answers
389 views

Is it dangerous to reveal my EC2 instance ID?

In Stack Overflow answers (like this), I often take screenshots which include Instance ID's belonging to me. Is it a bad idea to reveal these?
7
votes
2answers
162 views

Storing AWS credentials securely on a personal machine

How can I securely store AWS credentials on personal machines? In detail: Everybody in our team requires AWS security credentials for doing administrative tasks (credentials are separated by role). ...
7
votes
2answers
4k views

How do I attach an Elastic IP to an Elastic Beanstalk app?

I can give a single instance an Elastic IP. No problem. But I have an Elastic Beanstalk app. It can create and remove instances as needed. It has a load balancer. How can I get these features ...
7
votes
4answers
502 views

Moving all internal servers to the cloud

Background One of my clients is an IT-dependent workflow-driven law firm with about 50 seats. They have been audited by one of their clients (an FSA regulated mortgage lender) and told that their ...
7
votes
1answer
1k views

XFS: no space left on device, (but I have 850GB available!)

I'm using a combination of mdadm, lvm2, and XFS on Amazon EC2. So far, I've had success running a RAID 5 volume built from a number of EBS volumes. The EBS volumes are attached and used with mdadm to ...
7
votes
2answers
3k views

RDS Replication across regions

We are using Amazon AWS for our web services but given the recent instabilities in their infrastructure, we are trying to figure out how to run our application across multiple regions for additional ...