This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

1
vote
1answer
196 views

Moving an Application to Amazon EC2 with S3

Recently I have created a web application. The application has some static parts (libraries, classes etc) and dynamic parts (images, cache, log etc) as well. However, some static parts of the app ...
0
votes
1answer
1k views

Nginx static content with Amazon S3

Im using Nginx front-end server in front of glassfish app. server. I uploaded my static contents to Amazon S3. I need to implement passing static request to Amazon's URL. I did a conf file like below. ...
3
votes
3answers
2k views

What's the best way to backup cPanel WHM server to Amazon S3? [closed]

I would like to archive cPanel backups to Amazon S3 instead of FTP. I've done some googling, but I'm not finding anything authoritative. I found the following options: whms3backup.com - $250 for ...
0
votes
1answer
300 views

Disallow Deletion from S3 Bucket [closed]

I am wanting to create a S3 bucket that does not allow for the deletion of files. Does anyone know how I am able to achieve this?
-1
votes
1answer
173 views

Serving static site with Amazon S3 [closed]

I want to host my static site www.something.com on Amazon S3. I've followed these instructions however I'm still having trouble. Specifically when I browse to www.something.com I'm sent to whatever my ...
0
votes
1answer
107 views

DNS to an Amazon S3 bucket suddenly stopped working

My fairly ignorant opinion is this is some kind of DNS problem although I've made no DNS changes for weeks. Maybe S3 is having a problem but no one seems to be reporting and S3 issues. Sometime last ...
0
votes
1answer
181 views

Is whitelisting a CNAME enough?

We are working on setting up a list of domain names we need to have whitelisted for educational institutions who use our site. We are using AWS S3 as well as cloudfront. In our cloud front, we ...
1
vote
1answer
152 views

Point S3 bucket to top level domain?

I'm able to point a custom bucket named media.example.com to http://s3.amazonaws.com/media.example.com by creating a dns entry media > cname > http://s3.amazonaws.com/media.example.com on my ...
1
vote
0answers
224 views

s3fs-mounted S3 bucket shows bad filesizes

Background: I have an Amazon S3 bucket with data uploaded using the AWS web interface. Now I need to give permissions-based access to paths within my buckets to FTP users. To do this, I'm running ...
1
vote
3answers
301 views

Backing up data (including mysqldumps) to S3

We have a web app on a number of servers and we want to add an additional layer of redundancy by backing up the key data to S3. The key data is the MySQL database and a folder containing dynamically ...
3
votes
1answer
842 views

Why I'm getting MD5 Sums don't match! error?

I'm trying to upload my audit files to S3. Using s3cmd tools. I just run this command : sudo s3cmd put /var/log/audit/audit.log s3://audit-files But I get a error message like this : ...
0
votes
1answer
46 views

How to place my audit file in Amazon S3?

I have installed and configured the auditd package in Amazon Ec2 instance. I wish I need to place all the auditd log files in Amazon S3. I'm very new to Ubuntu can anyone explain me how to do it?
0
votes
1answer
46 views

Storing pages with only client-side code in S3 over full EC2?

Question: Would storing pages in S3 with only client-side code reduce costs in comparison to hosting them in Amazon's EC2? Background: Right now I use a cms to manage all of my pages and users for a ...
0
votes
1answer
123 views

Elastic Map Reduce with S3 Readonly Permissions

I'm running a few EMR jobflows, and populating hive tables directly from S3. Naturally, it would not be ideal to drop these tables, and so I'm wondering: Is it possible to run EMR jobflows such that ...
1
vote
1answer
176 views

Web client FTP server-like solution using S3

I have been tasked with setting up an FTP server to share files with our clients. I would like to forego the traditional FTP server/FTP client type of setup for one that would use S3 as the backend ...
0
votes
1answer
326 views

How to find out what's missing from my iptables, why it's blocking my AWS transfer?

I use ManageWP to backup WordPress on my VPS then upload that to Amazon S3. It's failing with "Error 503 Service Unavailable" at the upload part when I have iptables running. When the iptables ...
0
votes
1answer
124 views

Is CloudFront (backed by S3) a good way to serve user-uploaded pictures?

Is CloudFront (backed by S3) a good way to serve user-uploaded pictures? For example forum avatars. Or maybe there is a better way?
1
vote
1answer
166 views

Distributing Erlang binaries to new EC2 instances

I am using tools such as Chef and Puppet in order to bootstrap new EC2 instances. In order to autoscale, I try to keep the install times as fast as possible. For something such as Ruby, I compiled it ...
1
vote
2answers
340 views

How to get a custom Amazon s3 url?

Right now when I upload a file to my Amazon s3 buckert the url to the file looks like this: https://s3.amazonaws.com/<MY BUCKET NAME>/filename.extension I would like to use something like ...
1
vote
1answer
1k views

AWS - Status check fails when loading AMI created from snapshot

I have a running micro instance using an 8GB EBS that I've customized. To my understand there are two ways I can create an AMI from this. 1) EC2 console -> INSTANCES - Instances -> Right Click ...
1
vote
1answer
536 views

Using TntDrive to mount Amazon S3 on a Windows Amazon EC2 instance

I currently have 2 Amazon EC2 Windows Server 2008 instances setup with a load balancer. My problem now is that I need both instances to be able to access a single file system source (I'm trying to use ...
1
vote
2answers
463 views

s3fs changing s3 permissions?

My developer believes that s3fs is changing my bucket's permissions. Is this possible? I want my bucket to be public, but it keeps reverting back to private. Here's my fstab. s3fs#production ...
3
votes
1answer
621 views

Serve up s3 file with nginx

I have some static files sitting in an S3 bucket that I want to serve up from my nginx server. Basically, if a user goes to www.mywebsite.com/this/url I want to serve them up a file from the S3 ...
0
votes
1answer
211 views

Amazon S3 - can't upload files into the same folder using s3sync.exe

I'm trying to upload a file using S3sync.exe into a certain folder in my S3 bucket. This is the command line : S3Sync.exe -AWSAccessKeyId accKey -AWSSecretAccessKey secKey -RequestEndpoint ...
1
vote
2answers
71 views

How to list s3fs mounts?

How can I list the s3fs mounts that exist on an ubuntu system? I'd like to know to which bucket each mount is mapped. Specifically, I have a specific mount (e.g. ~/s3/mymount), and would like to know ...
2
votes
0answers
164 views

Gluster with s3ql mounted brick?

I am trying to test run Gluster with a volume consisting of two local bricks, the first being a plain directory and the second being a s3ql based mount. Having just the plain directory as a unique ...
0
votes
1answer
376 views

Amazon S3 - Automated Backup Using S3Sync, Windows Schedule & BAT file

I am trying to build an automated background backup program to backup my entire website and its heavy photo folders, using Amazon's cloud storage service, S3. I am using S3Sync from S3Tools and have ...
0
votes
4answers
953 views

Easiest to use backup software for live linux server [closed]

I need a backup software that is capable of: doing a full HDD image (from live server, if that's possible at all?)or just copy everything except /dev, /tmp, etc updates the backup incremental just ...
6
votes
2answers
3k views

Which is the fastest way to copy 400G of files from an ec2 elastic block store volume to s3?

I have to copy 400G of files from an elastic block store volume to an s3 bucket... Those are about 300k files of ~1Mb I've tried s3cmd and s3fuse, both of them are really, really slow.. s3cmd ran for ...
-2
votes
1answer
720 views

How do I calculate my bandwidth requirements?

We have a facility that needs to upload approximately 20 3MB photos per minute to Amazon S3. These are coming from 10 different machines on our local network. We need to do this continuously for 16 ...
2
votes
2answers
1k views

How do I create a EC2 S3 backed instance, starting from a Windows VHD?

I have a Windows VHD image created in Hyper-V, and I want it to exist as a S3-backed instance on EC2. I've found several articles (and a tutorial) on how to import my virtual machine to EC2. However, ...
2
votes
1answer
168 views

How can I turn an existing Windows Server 2008 EBS-backed instance into a S3-backed (instance-backed) AMI?

I understand there is no direct conversion to get from EBS to S3. But is there some series of steps that can make this happen, or is rebuilding the image from scratch the best option? Is there a way ...
4
votes
2answers
1k views

Duplicity not writing to a pre-existing S3 bucket

I'm trying to backup a directory to a pre-existing Amazon S3 bucket using the following command: duplicity --no-encryption system/ s3+http://MY_BUCKET_NAME/backup However, I'm getting the following ...
1
vote
2answers
257 views

Configure non-destructive Amazon S3 bucket policy

There's a bucket into which some users may write their data for backup purposes. They use s3cmd to put new files into their bucket. I'd like to enforce a non-destruction policy on these buckets - ...
-4
votes
1answer
104 views

Where to store social network photos and videos? [closed]

I have a social network with 100,000 users. I allow users to upload photos and videos now I feel like it is becoming too much for my dedicated server. Should I get another dedicated server? A content ...
3
votes
3answers
6k views

Why is uploading to S3 so slow?

I am using s3cmd to upload to S3: # s3cmd put 1gb.bin s3://my-bucket/1gb.bin 1gb.bin -> s3://my-bucket/1gb.bin [1 of 1] 366706688 of 1073741824 34% in 371s 963.22 kB/s I am uploading ...
1
vote
1answer
1k views

Deleting multiple objects in a AWS S3 bucket with s3curl.pl?

I have been trying to use the AWS "official" command line tool s3curl.pl to test out the recently announced multi-object delete. Here is what I have done: First, I tested out the s3curl.pl with a ...
0
votes
1answer
317 views

AWS instances: AMI bundles and snapshots and bears, oh my

I've googled a good amount and am still pretty confused and feeling like I'm missing or overlooking something. My goal is to restore a host using a bundle. I have an AMI bundle of a now-nonexistent ...
2
votes
1answer
404 views

Amazon S3 Website & MySQL Backup

I have a website (a digital asset management system/gallery - http://www.resourcespace.org) that has a huge amount of images. The total size of the website, including the images is approximately 6gb. ...
0
votes
1answer
83 views

apache sitemap rewrite to s3

I wanted to submit sitemap to google webmaster, google state only accept sitemap from my site Option 1 - simple rewrite I know this already working: RewriteRule /sitemap.txt http://S3_URL [L] ...
2
votes
2answers
188 views

Amazon CloudFrount on EC2

I know that i can mount s3 buckets with s3fs on EC2 instance. So i have next question can i somehow mount Amazon Cloud Front (my S3 buckets files) in EC2 instance?
4
votes
2answers
2k views

Snapshots == EBS backed instance, persistence, and S3 storage?

I want to clear up some confusion and clarify understanding on EC2 instances being EBS backed. If you start an AMI from a community image, configure your server as you want it configured, then use ...
2
votes
2answers
415 views

CloudFront - Users requests static files non-stop to make your bill high?

I had this weird wondering once. If I am using CloudFront as my CDN, I pay per requests made on my static files. So here comes the wondering. Can one keep requesting the same file in a non-stop ...
1
vote
2answers
2k views

How to calculate Amazon S3 prices

I am trying to estimate how much I need to pay to store images for my customers on Amazon S3. I use their calculator but the total seems to cheap. Feels like I am missing something. Each image is ...
4
votes
2answers
1k views

What design features make Joyent's ZFS and Amazon's EBS (S3) reliable?

I know this isn't exactly an apples to apples comparison, what I'm trying to evaluate is which one is safer - less likely to lose data. Joyent's SmartOS uses ZFS to store data whereas an EC2 machine ...
2
votes
1answer
552 views

Use Microsoft DPM 2010 with Azure or Amazon S3?

Does anyone know of any software that hooks up with Microsoft's DPM 2010 or even the new 2012 to ship data to cloud storage providers like Azure or S3? We utilize D2D backups today but want a more ...
1
vote
2answers
153 views

How to show a “linked from site X” placeholder instead of actual photo?

I’m hosting a bunch of photos on Amazon S3 and also running Amazon CloudFront for them. Also, I’m running a custom domain name. Now, in case someone tries to embed the image to another website, I’d ...
2
votes
1answer
347 views

Using an IP Address to Point to Amazon S3 Storage

Is there a way to get an IP address to refer to Amazon S3 Storage location? The current solution my company is thinking of going with involves setting up a EC2 server with an Elastic IP and using ...
2
votes
1answer
478 views

S3 to cloudfront edge location vs cloudfront to end user transfer ratio

We host videos in amazon S3 and use cloudfront to deliver them. Here is last months numbers: 4,2 TB total traffic from cloudfront to end user. 4 TB of this is in europe, the rest mainly in the US. ...
-1
votes
2answers
168 views

Cross platform, blob storage system

I have a couple of different servers around the house, and a lot of storage on each of these machines. I also have a couple of dedicated servers, and some VMs on these boxes... Most of the boxes and ...