This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

1
vote
1answer
13 views

Backing up onto S3 - do I want to use bucket in a different region?

We are using Amanda to send backups to S3. Each host is acting as its own Amanda "server". All hosts are currently using the same S3-bucket -- each has its own subfolder under it. The dumps are saved ...
0
votes
0answers
7 views

Tool to visualize S3 storage space taken by buckets recursively [on hold]

Is there a tool that visualizes how much space is taken by each S3 bucket recursively using a treemap? Preferably free, online. I know about s3cmd du, etc. - I need something visual.
-1
votes
0answers
32 views

How does one keeps Amazon EC2 mount point in sync?

I have /var/www/html/ on INSTANCE_ID=i-xxxxxxxxx and I MUST have same thing on another instance, but I can't use rsync or cron to manually trigger synchronization. How does one accomplish that goal? ...
0
votes
1answer
18 views

Amazon Cloudfront with S3 Redirect

I'm trying to do something that should be relatively straight-forward - I want to setup a few domains and subdomains to redirect to the core domain for our site, but I want to put the redirects out on ...
0
votes
1answer
15 views

using CloudFormation with an existing S3 bucket

Using CloudFormation, I want to set some of the properties in AWS::S3::Bucket on an existing bucket. In other words, I don't want to create the bucket, I just want to enforce some of the settings. ...
-1
votes
0answers
37 views

Linux server backup to Amazon S3 using SSL

I have Linux box CentOS 6.5 and i want to backup daily files like SQL dumps and config files to Amazon S3 I have installed Ruby and S3Sync. But the problem when running the s3sync with these ...
0
votes
1answer
28 views

Back up S3 bucket to another?

I am looking at duply and duplicity currently to mirror one bucket to another but it looks like I may be running in to a brick wall? So far I have been able to get things working backing up local ...
0
votes
0answers
20 views

Best practice for web applications and windows services remote configuration in AWS

we have a distributed system that contains windows services and web applications (.NET and Java based). Currently, most of the initial configuration for these applications are taken from various ...
3
votes
1answer
305 views

What IP range do I ask the system administrator to open in order for S3 to work?

I've written some programs for Raspberry Pi, which some small companies have shown interest in. I sold pre-configured Raspberry Pi:s to them, with my program on them, and it works for everybody except ...
0
votes
1answer
21 views

can't get s3 authentication to work to load data into redshift

I'm working on getting data into a sample Redshift cluster for a client, but I can't get authenticated to S3. There's been a recent change so that my own 'root user' access keys aren't available for ...
0
votes
1answer
36 views

s3cmd: Deleting files or folder does not work

s3cmd s3://MYBUCKET/FOLDER does not work. (folder is empty) s3cmd s3://MYBUCKET/FILE does not work. Output of both commands is "File FILE sucessfully deleted", yet the file remains on the bucket. ...
0
votes
1answer
58 views

How to best backup AWS-hosted systems? [closed]

We are deploying a number of servers at AWS and need to work-out a general-purpose backup strategy. The requirements are: Retain the ability to recover full systems or individual files or ...
0
votes
1answer
34 views

Redirect loop after setting up domains

I migrated domains from a service provider (ipage) to godaddy. The hosting has been setup on AWS S3. I have done such things before and they worked. However this time I'm hitting a redirect loop ...
0
votes
2answers
39 views

how to pipe a mysql dump to s3cmd

I want to transfer a mysql dump, compressed, to s3. I tried: mysqldump -u root -ppassword -all-databases | gzip -9 | s3cmd put s3://bucket/sql/databases.sql.gz but then I get: ERROR: Not enough ...
1
vote
0answers
71 views

Duplicity -> S3 backup failing with “[Errno 105] No buffer space available”

I have a nightly script on my Ubuntu 10.04 VPS which uses duplicity (0.6.24) to run incremental, encrypted backups to Amazon S3. This script had been working until a month or so ago when it started ...
-1
votes
1answer
61 views

S3 static website hosting, which DNS CNAME record should I use?

I have created a S3 static website e.g. www.example.com The S3 endpoind is: www.example.com.s3-website-us-east-1.amazonaws.com When I dig this DNS ...
0
votes
0answers
139 views

s3cmd 403 Access Denied error on put but not ls

I can access s3 using s3cmd on an ec2 instance to do s3cmd ls s3://myc bucketname but not using 'put' to add a file. It gives a 403 access denied error. I am using IAM and have group setup to access ...
1
vote
1answer
58 views

Restore a versioned S3 bucket to a particular point in time

Let's say I've got S3 versioning enabled for my bucket: http://docs.aws.amazon.com/AmazonS3/latest/dev/Versioning.html Then, let's say someone (for example, junior employee) messes up the S3 bucket ...
-1
votes
1answer
171 views

How to ideally store images on Amazon S3

I want to store a huge number of images on Amazon S3 (served via Cloudfront). Currently the way I am doing is simply dumping the images and having basic HTTP Cache headers set to a month so that users ...
0
votes
0answers
64 views

Drop/Truncate DynamoDB table with AWS Data Pipeline

I have set up a Data Pipeline that imports files from an S3 bucket to a DynamoDB table, based on the predefined example. I want to truncate the table (or drop and create a new one) every time the ...
-1
votes
1answer
54 views

Is it possible to use PHP on a website hosted on AWS S3 without using EC2 or Elastic Beanstalk?

I have a bit of PHP (a contact form to be exact) that isn't working right now on my website. I'd like to activate the PHP and I heard one of the ways is to use Elastic Beanstalk. However, Elastic ...
1
vote
1answer
132 views

How can I reuse existing resources in CloudFormation?

I've have S3 bucket as resource in my CloudFormation template. With DeletionPolicy set to Retain. This works as expected, when deleting the stack, it does indeed retain the bucket. However, when I ...
2
votes
2answers
37 views

Is there a way to retrieve all contents from a versioned Amazon S3 bucket as of a particular datetime

Is it possible via the AWS CLI or via some third-party tool to easily download all contents of a versioned bucket as it was on a particular datetime? I.E. I would like to retrieve the version of each ...
1
vote
1answer
354 views

No targets available when trying to set alias target from Route 53 to S3

I'm trying to setup a simple Amazon AWS S3 based website, as explained here. I've setup the S3 bucket (simples3websitetest.com), gave it the (hopefully) right permissions: { "Version": ...
0
votes
0answers
93 views

AWS Cloudformation Bootstraping with S3 File and Autoscaling

I just started trying to use CloudFormation and am using it for some autoscaling. I am new to all this so bare with me. I am using the sample template for autoscaling found here. ...
2
votes
1answer
78 views

Amazon S3 - private file is still downloadable for everyone?

I have some secret files which I want to restrict anonymous user from viewing/downloading. I have tried to make it private by running something like: s3cmd setacl --acl-private ...
3
votes
1answer
328 views

AWS IAM user access issues for S3

I have the following IAM policy for a user { "Version": "2012-10-17", "Statement": [ { "Sid": "Stmt1395161912000", "Effect": "Allow", "Action": [ "s3:ListBucket", ...
1
vote
2answers
260 views

Wildcard Subdomain (*.example.com) with Amazon Route53 DNS and S3

I am hosting a static website using Amazon Route53 for DNS and S3 for html files. It is working fine. Current Setup is: example.com. A ALIAS s3-website-us-east-1.amazonaws.com. www.example.com. ...
1
vote
0answers
609 views

Amazon Cloudfront with S3. Access Denied

We're trying to distribute out S3 buckets via Cloudfront but for some reason the only response is an AccessDenied XML document like the following: <Error> ...
1
vote
1answer
30 views

CloudBerry Explorer PRO using 100% CPU [closed]

Does anyone have any experience with this product? I'm running a trial on in it now for a project to move about 800 GB of data to Amazon S3. After the initial move we'll keep a job running to continue ...
0
votes
3answers
572 views

Accessing Amazon S3 from a private VPC subnet

If I have a VPC running and some servers located in the private portion of that network that do backend processing by downloading files from amazon s3, can I access S3 internally to get at those ...
1
vote
1answer
60 views

CloudFront, S3, EC2: how can you reroute request from CloudFront to EC2 unless file exist at S3?

My application uses all 3 service layers. Recent feature request to lower the outgoing traffic gives us some uncertainties. Say, we have a requirement to distribute the image.jpg file with ...
-1
votes
1answer
62 views

aws route 53 and vistualhost in ubuntu apache [closed]

I have added domain name in route 53 and creating a sub domain to land into virtualhost with a port. I am trying to add a sub domain as cname and cname is my servername in virtualhost. I am on ubuntu ...
0
votes
1answer
129 views

What is the significance of the s3 region, “US Standard” when it comes to “Amazon EC2 in the same region” pricing?

AWS S3 provides a special region called US Standard, US Standard Uses Amazon S3 servers in the United States Provides eventual consistency for all requests. This region automatically routes ...
0
votes
0answers
152 views

Amazon Powershell Write-S3Object can't resolve s3.amazonaws.com

Am seeing incredibly weird behavior for the Write-S3Object cmdlet provided by Amazon. I've got a backup script running Write-S3Object on my Windows Server 2008 R2 box. When I kick it off, it ...
0
votes
1answer
80 views

Ensuring data consistency in s3 with multiple users writing/reading

I need advice/ ideas about how can I ensure data consistency in my s3 bucket. I have 2-3 users pushing and reading resources from s3. As one can easily see this leads to data inconsistency( User A is ...
2
votes
1answer
143 views

Postgresql WAL-E - Replication falling behind + can't catch up

Does anyone know how I can have my replications process the WAL segments faster while using WAL-E? https://github.com/wal-e/wal-e I have one master that leverages WAL-E to upload to S3, and I have 6 ...
0
votes
1answer
60 views

Amazon S3 upload - bytes transferred is larger than actual file size

I just uploaded FEDORA ISO image to S3 via Visual Studio AWS Explorer (not using encryption). After upload completed status shows: 1,004,232,704 / 999,292,928 Bytes Actual file size on local disc ...
0
votes
1answer
342 views

Anonymous access to S3 bucket only from my EC2 instances

Is there a way to let anonymous access to a certain S3 bucket only from my EC2 instances (all of them) within a single AWS account? I know I can use IAM roles, but I found it's just too many moving ...
1
vote
2answers
210 views

Synchronize AWS EC2 instances

I have been looking for a way to synchronize files between my EC2 web servers . However in most of the places it is mentioned that S3 can be used in such cases . However my question is S3 provides for ...
0
votes
1answer
287 views

Cloud-front backed with Nginx (which proxies to S3) randomly missing already cached items?

I wish to serve images from a S3 bucket with Cloudfront as CDN frontend, for that I tried the following: What I wish to acheive (Attempt 2) -- (Misses cloudfront cache randomly) I have the ...
0
votes
0answers
193 views

Amazon S3 upload files of 2GB using the high level multipart loading sometimes fails

I tried to load files which are close to 2 GB, in code I used Amazon's api for multipart loading. Here is a sample from the code: ObjectMetadata o = new ObjectMetadata(); ...
0
votes
0answers
64 views

nginx passing assets from S3

I'm trying to configure Nginx to passing assets from S3.I have the below in the config but when am trying to access frontend, nginx return 404 on static resources. And nginx error log is empty. Can ...
2
votes
3answers
233 views

Should I use ec2 as a file server?

I need to be able to share user uploaded content across multiple EC2 application servers. I have looked at rsync, mounted NFS, and S3 as potential options of being able to share this data in almost ...
2
votes
2answers
422 views

How to discourage a hacker with root access from deleting remote backups?

I'm currently researching the best backup solution for my CentOS webserver, and I'm thinking of going with either Tarsnap or straight-up Amazon S3. I am trying to figure out how to discourage a ...
0
votes
1answer
42 views

Glacier retrieval notification of s3 objects

I have some s3 buckets which send their objects to glacier after x days of creation. When I go to retrieve those objects on the s3 interface, I need to keep reloading page to see when restoration has ...
1
vote
0answers
131 views

Amazon S3: allow user access to subfolder only on any bucket

I'm trying to write a policy that will allow a user to read from any bucket (that part works) but only write to a specific subfolder on any bucket. This is my policy so far (reading works, but it ...
0
votes
1answer
99 views

Max number of elastic IPs that can be attached to single instance? [closed]

How many elastic IPs (publicly visible) can be attached to single instance?
1
vote
2answers
193 views

Dovecot with S3QL

Due to periodically running out of space on EBS volumes on AWS EC2, and looking to make the setup more fault resistant in case of server/volume failure, I'm considering moving a Dovecot maildir ...
-1
votes
1answer
38 views

Amazon AWS volume full although www folder has 88 megs [closed]

my mysql failed because, apparently, my volume is filled. All 8 gb of it. I only have put mongodb, nodejs, apache, mysql and in the www folder, wordpress and phpmyadmin. My question is, what happened ...