This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

0
votes
0answers
10 views

looking for index.php while proxy_pass to s3 bucket

I am configuring my nginx proxy server to fetch data from s3 bucket in case of 502 error. This is my configuration file. error_page 502 @static; location @static{ rewrite ^/a/b /a_b break; ...
2
votes
1answer
18 views

AWS: Why is the bucket size on CloudWatch higher than when using S3 tools?

I use the awscli tools to verify the size of my buckets. First the S3 call (all files without versioning, just an ordinary upload): $ aws s3 ls s3://XXX --recursive --human-readable --summarize ...
0
votes
1answer
15 views

AWS backup on another attached drive

In AWS-EC2, I was thinking of backup my code data and database in RDS via bash script on separate attached drive on same instance. I want to do it like that way so it becomes easier for me during ...
5
votes
1answer
134 views

How can I tell where an Amazon AWS key is being used?

I have inherited an Amazon AWS environment in which the Root account key has been widely distributed for the purposes of making backups to S3 buckets. I need to track down where the key is being ...
0
votes
1answer
26 views

Elastic Beanstalk S3 access via .ebextensions

I have a simple file in my .ebextensions folder: 00-myconfig.config Resources: AWSEBAutoScalingGroup: Metadata: AWS::CloudFormation::Authentication: S3Access: ...
-1
votes
0answers
4 views

Use s3-parallel-put on Windows

I need to move a large number of files from a Windows EC2 instance to S3. How can I use s3-parallel-put or something similar to do this? I have attempted to use s3-parallel-put already with errors.
0
votes
0answers
7 views

CloudFront + S3 Access Denied Using Signed Cookies

I'm trying to integrate signed cookies for a CloudFront distribution that's fed off of an S3 bucket but getting access denied error messages: <Error> <Code>AccessDenied</Code> ...
0
votes
1answer
27 views

when to use NFS for web app

I am currently building a simple webapp architecture on AWS, as follow: Elastic Load Balancer - multiple front ends - RDS database. I have also set up an NFS server to store all images uploaded by ...
0
votes
0answers
27 views

Access denied for the request of data from s3 bucket on high load

I am trying to fetch static files from s3 bucket in case of 502 error. This is how I have configured nginx for requests : error_page 502 = @static; location / { index index.php; try_files $uri ...
0
votes
0answers
9 views

Amazon S3 - Upfront File Organization Architectural Decisions

I'm currently building a web application for a publishing platform, and I am using S3 for content storage. S3 is super simple to use, but I'd like to try to make the best possible file organization ...
-1
votes
0answers
22 views

Amazon Route 53 -> S3 Mask Root Alias URL [duplicate]

I'm new to DNS configurations, so please bear with me if my terminology is a bit off. I am using Amazon Route 53 for DNS to point my domain name to a static website hosted on Amazon S3. I have an A ...
0
votes
2answers
24 views

How to transfer data between s3 buckets of the different aws account using command line

How to transfer data between s3 buckets of the different aws account using s3cmd ? command will be like this: s3cmd rsync s3://acc1_bucket/folder/ s3://acc2_bucket/folder --recursive But then how ...
1
vote
1answer
32 views

S3 Static Website hosting - restricting access from IP Range

Is there way by which can we enforce the access only from a Particular IP Range for S3 Static Website hosted site ?
0
votes
0answers
25 views

logstash cloudfront codec plugin: Error: Object: #Version: 1.0 is not a legal argument to this wrapper, cause it doesn't respond to “read”

Logstash version 1.5.0.1 I am trying to use the logstash s3 input plugin to download cloudfront logs and the cloudfront codec plugin to filter the stream. I installed the cloudfront codec with ...
1
vote
1answer
26 views

Logrotate script not uploading to s3

I am trying to use logrotate to upload log files from my rails and nginx commands once a day. When I run the logrotate command manually the files successfully upload, but it never does it on its own. ...
0
votes
0answers
11 views

How to use the s3cmd setlifecycle command?

s3cmd has a setlifecycle subcommand that seems like it ought to let me configure a bucket into Amazon Glacier. However I can't find any documentation for it on the web or in the manpage. What's the ...
-1
votes
1answer
22 views

How can I easily backup multiple folders on EC2 to S3

I move dockers around a lot on EC2 instances. Each docker has a specific folder on the host where it stores it's data. I want to create a single backup script that will look for any of a list of ...
0
votes
0answers
17 views

aws hosted website not serving web pages to internal network and serving from s3 bucket instead

Sorry about more text to describe..(The issue has been resolved but the causes are un-known) We Have one website hosted via AWS Load Balancer and was working from last year perfectly. Recently an ...
2
votes
1answer
77 views

Why would a Image Hosting website, such as Imgur, use AWS EC2 instances over S3 buckets for uploads?

I was reading a Q&A with the creator of Imgur, and he went into detail explaining the server infrastructure that Imgur runs on. Here's a small quote from what he had to say: Most of the ...
0
votes
2answers
50 views

S3 backup with versioning plus lifecycle management to prevent malicious deletion of backups?

I just want to run this idea by some smarter people to make sure I'm not overlooking something obvious: I want to backup my Linux server to S3 using one of the many backup scripts that allow ...
1
vote
1answer
28 views

Why is AWS S3 Redirect Showing as 302 instead of 301?

I'm implementing a 301 redirect in S3 using this blog post from when the functionality was first announced. It explicitly says the redirect will be a 301, which is what I want. Screenshot of the ...
-2
votes
1answer
27 views

Sync files between AWS S3 and Rackspace cloudfiles [closed]

I am looking for a solution for syncing files between AWS S3 and Rackspace Cloudfiles on a regular basis. Preferably, using a third party service or low maintenance self-hosted solution.
0
votes
0answers
20 views

How to securely allow web apps to read/write to S3? (the new way with IAM)

I've been banging my head against a wall on this for two hours. It's frustrating that Amazon has made this so complicated when it doesn't need to be. Let's say I have a bucket called "test," and a ...
3
votes
0answers
75 views

Set up a different index document per directory with S3 static website hosting

I am using S3 static website hosting, and trying to get the following redirects to work: example.com --> example.com/index.html example.com/foo --> example.com/foo/foo.html example.com/bar ...
0
votes
0answers
53 views

DNS Based Load balancing on squid - odd issues

I'm attempting to do round-robin DNS based load balancing for two squid boxes running as simple HTTP(S) proxies. For testing I'm using AWS Route 53. To simulate round-robin I created two records ...
0
votes
0answers
30 views

Duplicity for remote backup to AWS S3

I am using Bacula with S3 for backups. I keep bacula volumes for 60 days or so. Using duplicity as I would like to use GPG encryption of the volumes. Is there any way to do an rsync style sync using ...
-1
votes
1answer
117 views

Use Apt Inside AWS VPC Without NAT Instance

I have several Ubuntu machines inside VPCs. For many of them, the only network access they need whatsoever is for "apt-get update && apt-get upgrade" and NTP. For NTP, I can simply have an NTP ...
0
votes
1answer
67 views

How best way to rsync from aws s3 to gcloud?

I must execute a rsync ( not only copy or move ) from all my buckets from s3 to google cloud. I need create the same infraestructure of s3 to google. I have like 2Tera in s3, and all days I receive ...
0
votes
0answers
106 views

AWS security group egress rules for S3

I manually created a new security group using the AWS CLI. I created ingress rules that allow incoming connections only from my company's public IP address using the known ports for SSH (22) and ...
0
votes
1answer
53 views

Is S3 a proper choice to keep live linux user home directories?

We are building an RDP cluster using Amazon EC2/S3. Users' home directories are on S3 (single bucket) and all EC2 nodes mount the same S3 bucket using S3FS. Each EC2 node uses the appropriate home ...
0
votes
1answer
72 views

Can I use an IAM role to grant my Heroku app access to my Amazon S3 bucket?

Heroku: Using AWS S3 to Store Static Assets and File Uploads suggests using my AWS security credentials to enable my Heroku app to access my Amazon S3 bucket. However, isn't it better practice (as ...
0
votes
0answers
23 views

Duplicity GPG key not available

I am using the following tutorial to get Duplicity to back up my mysql dumps to Amazon S3. http://kappataumu.com/articles/cloud-backups-duplicity-s3.html However I am getting an issue with the ...
0
votes
1answer
62 views

AWS/Route53/S3: Redirecting www.example.com to example.com works. Redirecting example.com to www.example.com doesn't

To set up a static site on S3 with DNS on Route53, we have two options. If we want the users to type www.example.com and have that auto-replaced in the address bar by example.com, we would do the ...
0
votes
0answers
28 views

Uploaded 0 object(s) to bucket from Write-S3Object command

When I upload a file with the Write-S3Object command and it seems work properly and in another tool I can see the file but I get the follow message: PS> Write-S3Object -BucketName my-bucket ...
0
votes
1answer
139 views

Amazon Cloud Formation: Import file from S3 bucket

I am struggling to get files from my S3 bucket to my EC2 instance using cloud formation. I have the following files: "files" : { "/var/www/text.txt": { "source": ...
0
votes
1answer
53 views

Using Duplicity with AWS S3 and IAM Folder policy

I'm trying to setup backups from multiple hosts to a single bucket. Each host has their own AWS login and credentials. The top most folder (prefix) maps to the AWS user id and I'm trying to limit ...
3
votes
0answers
28 views

S3 + Cloudflare vs S3 + 2 Web Server + Cloudflate

Currently, I run two websites and each site own it own big server. Currently, all of those two sites has roughly 300GB of images. Its grow rate is 15GB of images per month. I know that eventually, one ...
0
votes
0answers
37 views

EC2 websites & RDS databases backup

We have some Amazon EC2 machines on which different websites are working, and their database is being pulled from RDS-MySQL, I know for machine I can have images as backup and for RDP-MySQL it has ...
0
votes
0answers
238 views

Nginx as s3 proxy with private buckets

I'm trying to set up Nginx as a proxy for a static html/js webapp hosted on S3. I read a lots of tutorials and posts and I could make it work if my bucket is set as public. The reason I need Nginx as ...
0
votes
1answer
29 views

How to stop s3 from listing some of the content?

It is an example. What setting of S3 causes the s3 server to a listing of bucket content? EDIT: I have followed Céline Aussourd's answer and turned off the list of the s3 bucket. But ...
0
votes
0answers
89 views

duplicity s3 backup from centos

I'm trying to backup server data to S3 but getting no success. Below is the script which I run to start backup on S3. I have create a user using IAM and have granted all permissions to the user. ...
1
vote
1answer
66 views

Locating an AWS S3 physically in a private subnet (like RDS)

Similar to how an RDS instance requires you to pick the specific subnets (which can be in a VPC's private subnet), can AWS S3 stores also be physically located in a VPC's private subnet?
0
votes
1answer
17 views

What is the easiest way to duplicate an existing s3 bucket (excluding data)? [closed]

I want to be able to create a new bucket which mirror the settings of an existing bucket. What is the best way to do it? Ideally I want to be able to capture the settings via aws cli and create a ...
0
votes
0answers
15 views

How can I improve the space usage of duplicate content in S3?

In my project I have duplicated files in various folders in a S3 bucket. Based on the output of s3cmd du, each time I make a copy of some content in S3, the usage increases. I wonder does s3 support ...
0
votes
0answers
15 views

Read data from external bucket on Amazon EMR

I need to read data from a bucket that I don't own, and I get the IAM account key and secrete access key to the bucket. What is the best way I can access the data? How can I add another IAM with ...
0
votes
1answer
91 views

EC2 to S3 upload speed decrease with increase in instances

I have a job that gets data from a database, runs some code, and uploads the result to an S3 bucket. The code takes approximately 1 minute to run, and the result file is approximately 10MB. Both the ...
1
vote
1answer
80 views

AWS S3 bucket permissions

I've created AWS s3 buckets with several thousand objects, initially the access policy was restricted to authenticated users, but later due to some requirement we need to make all objects in this ...
3
votes
2answers
133 views

Replicated shared filesystem

I'm looking into setting up a shared filesystem/file server on AWS (EC2) infrastructure that offers replication and fairly painless failover. This filesystem would host potentially millions of files ...
1
vote
1answer
120 views

jboss cluster in ec2 with s3ping

Am trying to get s3ping discovery method working in wildfly 8.0.0. I am using default Amazon Linux AMI and using chef to launch instances in ec2 based on this tutorial ...
0
votes
1answer
44 views

Origin access identity and S3 permission

From http://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/PrivateContent.html , I have already created an OAI, as shown in this screenshot Am I supposed to grant the permission to ...