Amazon Web Services (AWS) delivers a set of services that together form a reliable, scalable, and inexpensive computing platform "in the cloud". If you have a question about a specific web service, consider asking on its tag, e.g., amazon-ec2.

learn more… | top users | synonyms (2)

7
votes
3answers
11k views

Why is uploading to S3 so slow?

I am using s3cmd to upload to S3: # s3cmd put 1gb.bin s3://my-bucket/1gb.bin 1gb.bin -> s3://my-bucket/1gb.bin [1 of 1] 366706688 of 1073741824 34% in 371s 963.22 kB/s I am uploading ...
7
votes
4answers
4k views

How to get the amount of free disk space with CloudWatch?

Is it possible to get the amount of free disk space (df) with CloudWatch? If so, what metric represents the free disk space?
7
votes
3answers
4k views

Accessing storage on an EC2 instance?

I am using a large EC2 instance but just realized that I don't have the space promised. I only get 8 gigs when it says I should have 850 GB. From what I understand two extra 420 gb drives should be ...
7
votes
3answers
395 views

Is it dangerous to reveal my EC2 instance ID?

In Stack Overflow answers (like this), I often take screenshots which include Instance ID's belonging to me. Is it a bad idea to reveal these?
7
votes
1answer
2k views

Why does top report a different cpu usage than CloudWatch?

top shows an average CPU usage during peak times of about 20% while CloudWatch monitoring shows an average CPU usage of 40%. What causes this discrepancy?
7
votes
2answers
227 views

Storing AWS credentials securely on a personal machine

How can I securely store AWS credentials on personal machines? In detail: Everybody in our team requires AWS security credentials for doing administrative tasks (credentials are separated by role). ...
7
votes
2answers
3k views

AWS - Assign an Elastic IP to a ELB

Is it possible to assign an Elastic IP to a Load Balancer?
7
votes
2answers
4k views

How do I attach an Elastic IP to an Elastic Beanstalk app?

I can give a single instance an Elastic IP. No problem. But I have an Elastic Beanstalk app. It can create and remove instances as needed. It has a load balancer. How can I get these features ...
7
votes
4answers
523 views

Moving all internal servers to the cloud

Background One of my clients is an IT-dependent workflow-driven law firm with about 50 seats. They have been audited by one of their clients (an FSA regulated mortgage lender) and told that their ...
7
votes
2answers
4k views

Highest value of max_connections in AWS RDS micro instance

Currently, the value for the max_connections parameter in a MySQL RDS t1.micro server model is {DBInstanceClassMemory/12582880} is 32. Since my server does not allowing any more connections after 32, ...
7
votes
1answer
2k views

XFS: no space left on device, (but I have 850GB available!)

I'm using a combination of mdadm, lvm2, and XFS on Amazon EC2. So far, I've had success running a RAID 5 volume built from a number of EBS volumes. The EBS volumes are attached and used with mdadm to ...
7
votes
2answers
433 views

How to change assigned letter for Ephemeral drives automatically?

I have an AWS Windows box (Windows 2008 R2) with the following disks: C:\ 60 Gb (EBS) D:\ 200 Gb (EBS) Y:\ 40 Gb (Ephemeral SSD) Z:\ 40 Gb (Ephemeral SSD) Every time it boots I change ephemeral ...
7
votes
2answers
3k views

RDS Replication across regions

We are using Amazon AWS for our web services but given the recent instabilities in their infrastructure, we are trying to figure out how to run our application across multiple regions for additional ...
7
votes
1answer
841 views

Has anyone achieved Level 1 PCI compliance on AWS?

All the FAQs, documents and statements published by AWS aside, did any Level 1 merchant actually achieve PCI compliance on AWS yet? We're evaluating moving some of our services to EC2/VPC, but our ...
6
votes
4answers
1k views

Easy way to convert custom 32-bit AMI into 64-bit one?

I have customised (EBS-backed) AMI for running a demo version of an application of ours. (The AMI contains Ubuntu 11.04 with a Tomcat & MySQL setup for the app itself, and Jenkins for easy ...
6
votes
5answers
5k views

If I shut down Amazon EC2 instance then start it again, will everything be ok?

I have a web site that runs on an Amazon EC2 Linux-based instance, and is mapped to a regular domain name (x.com). This site talks to a database on a second EC2 instance. I need to shut down this ...
6
votes
2answers
413 views

How to address an EC2 instance from both inside and outside datacenter?

I'm trying to find a good way of being able to address my EC2 database instance from both inside and outside of the datacenter. Other EC2 instances need to be able to call into it, and other clients ...
6
votes
1answer
1k views

Can I SSH into my Amazon EC2 server instance if I don't have .pem file from when instance was created?

I am working with some Amazon EC2 servers that are up and running, and I need to SSH into the servers. I don't have any keys that were generated when the servers were first set up (someone else did it ...
6
votes
3answers
5k views

Forcing CloudFront to pass-through the latest HTML file from S3

Background I'm hosting a static site on S3, with CloudFront over the top. The issue I have is with my HTML files. According to CloudFront's FAQ: Amazon CloudFront uses these cache control ...
6
votes
2answers
5k views

Amazon RDS Instances: db.m1.large vs db.m3.large

Recently, Amazon announced new instance types for RDS. Currently, we are running db.m1.large, and it looks like the new db.m3.large is comparable but cheaper. We're new to AWS, so before moving ...
6
votes
2answers
517 views

Does Amazon EC2 and RDS have ECC memory?

I know that Amazon's Cluster GPU Instances have ECC memory as mentioned on their blog but there's no mention of other instance types. There's a forum post from back in 2007 that went unanswered. Does ...
6
votes
1answer
1k views

Does anyone have any experience when it comes to speed of Amazon RDS vs MySQL on a Small server?

EC2 Small vs Amazon RDS - which is faster for MySQL? (I have one database, well-indexed and tuned. About 10,000 rows on each table.) How's the performance like?
6
votes
5answers
3k views

Automated snapshots of EBS-backed EC2 instance running Ubuntu

I'm running an EBS-backed instance which acts as a software development team's build server (running Jenkins and host of other services). The server is running Linux (latest Ubuntu from the official ...
6
votes
2answers
334 views

AWS - how to serve faster to oversea users

We have our infras relying on AWS in the us-east-1 region. (EC2, CloudFront, RDS, ElastiCache) We are now having more and more users from the APAC. Users start to complain about network speed to our ...
6
votes
2answers
6k views

EC2: multiple ssh keys for an instance?

Is it possible to create more than one private key to SSH into an EC2 instance? What's the general best practice for this? We have multiple users who need to SSH into the servers and distributing one ...
6
votes
3answers
4k views

Is there a way to set an AWS instance's name from command line tools?

In the web console there is a field "Name" which you can edit to associate useful context with an instance, is there a way to set or retrieve this info from the command line?
6
votes
2answers
924 views

What are common strategies for configuration management on EC2?

Without using a 3rd party cloud configuration service, what are common patterns/strategies or whitepapers written on the subject of configuration management with EC2? Specifically on how to configure ...
6
votes
4answers
5k views

How to automate an Amazon EC2 instance startup, execution of some commands and shutdown?

I need to download 100 GB of files (it’s in about 150 files) within a 7 day period before they expire. The download is rate-limited by the host so it takes MUCH longer than the theoretical transfer ...
6
votes
1answer
569 views

Cannot create a EC2 server root volume greater than 8 GB

I am trying to create an EC2 large instance. AWS claims to say I shall get 850 GB instance storage if I go for Large Instance. I configure the VM to have the Root Volume size of 100 GB. But, when I ...
6
votes
1answer
1k views

How can I access instance storage on a Windows EC2 instance with an ebs root device?

I have created an AMI, but I would like to use instance storage for some scientific programs I want to run. They basically read a bunch of stuff from disk, write it back out to disk and then ...
6
votes
1answer
3k views

How do you recover you RDS master user username?

Resetting the RDS master user's password is simple enough, but how do you find your master users username?
6
votes
2answers
2k views

AWS S3 Backup Strategies - How should I approach backing up S3 buckets?

I am in the process of building a web-app with potential for a massive amount of storage requirements which can be satisfied by amazon S3. My main concern is the usage of API keys on the server, and ...
6
votes
1answer
2k views

Amazon SES e-mails ending in Yahoo & Hotmail Spam folders, even though SPF and SenderID and DKIM are set correctly

This is incredibly frustrating. My Amazon SES e-mails are ending in Yahoo & Hotmail Spam folders, even though my SPF, SenderID, and DKIM are setup correctly. Since this particular site requires ...
6
votes
1answer
2k views

At what point is EBS usage the bottleneck?

I've got a site hosted on Amazon using a EC2 instance backed by an EBS volume. On the weekends, traffic spikes and I make the instance larger which helps quite a bit -- I'm no longer seeing CPU usage ...
6
votes
2answers
471 views

Running docker in VPC and accessing container from another VPC machine

I'm having issues while running docker in AWS VPC. Here is my setup: I've got two machines running in VPC: 10.0.100.150 10.0.100.151 both having an elastic IPs assigned to them, both running in ...
6
votes
2answers
416 views

Strategy for maintaining Amazon RDS instance on prod vs development

How do you folks manage your Amazon RDS instances? In production I obviously want to use Amazon RDS with a master-slave replication setup going. Unfortunately this incurs substantial costs to bring ...
5
votes
5answers
12k views

Why Can't I Reach My Amazon EC2 Instance Via It's “Elastic IP Address?”

The server works fine via the Amazon assigned DNS entry, but I cannot reach it (using a browser) via the Elastic IP address Amazon assigned the box. Ping does not work either. I am trying to confirm ...
5
votes
9answers
3k views

EC2 IP Address : How can a web server identify db server ip address at startup?

I have a simple 2-tier arrangement - one web server (Websphere hosted on windows), and one oracle db server. The web server needs to connect the oracle database server. I am trying to write a script ...
5
votes
3answers
1k views

does having dedicated instances completely prevent noisy neighbor issues?

Due to sharing of hardware, AWS instances can be prone to 'noisy neighbor' issues, where one or more of your neighbor's instances hog resources from your instance. This article suggests: The most ...
5
votes
3answers
6k views

Nginx set_real_ip_from AWS ELB load balancer address

I have a set of Nginx servers behind an Amazon ELB load balancer. I am using set_real_ip (from the HttpRealIpModule) so that I can access the originating client IP address on these servers (for ...
5
votes
2answers
6k views

CNAME record for Amazon S3 — any drawbacks?

I'd like to make a CNAME record for my Amazon S3 domain, to have nicer URLs. There's not much discussion of this out there on the web, and nothing at all in the Amazon documentation (unless I'm ...
5
votes
4answers
4k views

On AWS do I have to open ports in an EC2 instance's firewall as well as security group?

If I change my SSH port from 22 to 23453, I can no longer ssh in. In more detail, I'm using a Red Hat EC2 instance on Amazon Web Services. This is the second change I've on a fresh install (first ...
5
votes
2answers
561 views

Is it feasible/common for people to use only AWS to host PHP/MySQL websites?

What are the drawbacks/limitations when compared to a more traditional managed shared/virtual/dedicated host?
5
votes
2answers
945 views

Load Balancing on Amazon (AWS) and staying up to date

I would like to have a load balancer for my site and have the site up to date. The load balancer will take the AMI I select and spin up more of those instances when processing power hits a certain ...
5
votes
4answers
1k views

Best Amazon AWS region for Australian website?

What is the best Amazon AWS region to host a website for an Australian audience? Amazon's marketing material seems to suggest that Singapore is the best place, but the ping tests I've performed have ...
5
votes
4answers
1k views

Multiple AWS instances and one database

I have a web app that lives on two AWS instances - one instance hosts the site, and the other hosts the actual database (MySQL). The instance hosting the site has an elastic IP pointing to it, which ...
5
votes
1answer
508 views

Lost passwordless sudo and no root access

I have a running AWS vm. The only access I have is using the ssh key (.pem file) to log in as ec2-user which is an unprivileged user. From there, I could user the sudo command without a password. ...
5
votes
1answer
3k views

How to export a hosted zone in AWS Route 53?

I see no option to export a backup of the settings for a domain. Maybe I should save the results of public DNS with dig but I would question whether a friend knows a better way.
5
votes
3answers
2k views

Amazon AWS EC2 + Puppet, get Puppet to know AWS instance tags

I am having a problem with my AWS deployment, fairly new to AWS and Puppet. So coming to my question - can you distinguish puppet nodes with AWS machine tags or CNAME domains? A little background ...
5
votes
1answer
5k views

Could not call sign: Could not find certificate request for puppet

I'm getting started with puppet on ec2 using the following guide. https://help.ubuntu.com/12.04/serverguide/puppet.html In the very last step when I try to sign the puppet client from the puppet ...