This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

0
votes
0answers
27 views

Jenkins aws elastic deployment plugin just create a new ec2 on each update

Here is something strange happening when I tries to deploy from Jenkins to Elastic Beanstalk , you can check my previous question for more clarity. ...
1
vote
1answer
178 views

Limiting bandwidth of the of Amazon aws s3 uploads

I'm currently having daily backups of my files on uploaded to S3 bucket using aws s3 mv command, i.e.: aws s3 mv $webroot/backups/db/ s3://my-backups/$date/db Everything works, except that recently ...
0
votes
0answers
91 views

S3FS and Fuse, scale out or scale up

I have an infra where I have multiple machines (eg FTP servers, get/put and Samba/NFS servers) that need to share out the same (HA) storage. So I figured to use s3fs and fuse. I got this all setup and ...
0
votes
1answer
81 views

Why are some big corporations still worried about cloud security? [closed]

My company sells an app subscription, which is hosted as SAAS on Amazon Cloud. I have had a few clients who weren't very keen on uploading their documents to my product because my product is hosted ...
1
vote
1answer
51 views

How to parse s3 logs?

I've been trying to parse AWS S3 logs following the documentation, but I've been running into some problems. Specifically, I keep running into new, rare log lines that break my regex. Every time this ...
1
vote
1answer
152 views

How to upload a large file using aws commandline when connection may be unreliable?

I've been having trouble uploading a large (800MB) file to s3, using the aws commandline tool. The first attempt completed (after many hours) but was not visible, and I was advised (here) that it has ...
0
votes
1answer
41 views

Amazon S3 putObject bucket policy

I am trying to create a User who only has access to PutObject to an S3 bucket called "desking". In IAM I have created a User, and applied this policy: { "Version": "2012-10-17", "Statement": ...
1
vote
1answer
265 views

Why can my IAM user create a bucket but not upload to it?

UPDATE: everything works fine the next day!?! So I think the answer might be that you have to wait some period of time, either after creating a new IAM user, or after creating a new bucket, before ...
0
votes
2answers
122 views

Sender address rejected: Domain not found - after Route 53 (Amazon AWS) changes

We had been getting these messages when customers try sending us emails. This is an automatically generated Delivery Status Notification THIS IS A WARNING MESSAGE ONLY. YOU DO NOT NEED ...
1
vote
0answers
128 views

aws s3 sync: how to exclude proc, sys directories

I can't seem to get the aws sync s3 command to exclude directories. I am backing up a mounted filesystem from OpenVZ which is located at /vz/root/100. My command is: aws s3 sync /vz/root/100 ...
0
votes
1answer
47 views

Cannot copy files from EC2 in VPC to S3 with EC2 role

From an EC2 instance running within a VPC I am in need of accessing an S3 bucket with awscli for copying files from EC2 to S3. I succesfully created an endpoint with an attached custom policy built ...
5
votes
1answer
243 views

Cant connect to S3 with nginx

im trying to serve static and media files from amazon S3 bucket but nginx cant connect to it Here is the error i get <Error> <Code>AccessDenied</Code> <Message> AWS ...
-1
votes
1answer
31 views

Can you target the logs from an S3 bucket to an S3 bucket in another account?

If I have an S3 bucket in account A that I'd like to turn logging on for I have to select a bucket for the logs to be written to. Is it possible to set permissions such that I can select a bucket in ...
2
votes
0answers
542 views

AWS CLI throws “Unable to locate credentials”, the second time it's run

I'm trying to download some files from S3 to an EC2 instance using the AWS CLI (1.8.7) on startup using a User-Data Script. This instance has a IAM Role & Instance Profile with the appropriate ...
0
votes
0answers
83 views

ERROR — : Response was: 307 — Temporary Redirect when trying to upload to bucket

I get 307 when uploading to a bucket with Amazon's Ruby gem (2.10.2). Another bucket works fine (both were created today). I checked the name and I didn't misspell it. What is causing the error?
1
vote
1answer
102 views

Route 53 configuration for Cloudfront distribution linked to S3 bucket for naked domain

I am using route 53 for a domain (example.com) linked to my app on Heroku. To handle naked domain redirection, I am using a S3 bucket as explained here: ...
0
votes
0answers
65 views

How to use Amazon S3 Ceph Interface on Windows

I have 4 ceph nodes running on virtual machines in our corporate network. I've installed a ceph object gateway on admin node. Can I somehow use it in Amazon S3 style from my windows machine in the ...
0
votes
1answer
173 views

Serving a S3 static website from a naked domain, without migrating to AWS Route53

I'm working on a site that I'd like to serve from a naked domain like foo.com, and serve it from AWS S3'. However, the documentation I can find with AWS gave me the impression that if I want to do ...
0
votes
0answers
107 views

Amazon S3 upload error: An exception occurred while uploading parts to a multipart upload

I am trying to upload a 30 GB file to Amazon S3 using the AWS PHP SDK. require('../vendor/autoload.php'); $client = new Aws\S3\S3Client([ 'version' => 'latest', 'region' => 'us-east-1' ]); ...
0
votes
3answers
147 views

Recursively changing the content-type for files of a given extension on Amazon S3

I have a large S3 bucket with a nested "folder" structure containing (among other things) static .json and .md files. Theses files are being served by S3 as text/plain rather than the correct ...
0
votes
0answers
60 views

How Do I Mask the CDN Domain with My Own Domain Name?

So i've been trying out cloudfront from AWS. Why is the URL 'example.com' resolving to 'example.com.s3.eu-west-1.amazonaws.com' in the Address Bar? I've tried googling loads of questions with this ...
1
vote
1answer
196 views

Deploy to Elastic Beanstalk from S3 gives “You do not have permission” — who is “You”?

I'm testing out AWS and Elastic Beanstalk and have Beanstalk running a version that was manually uploaded. When I try to update the version via the command line, the command line returns ok but ...
1
vote
1answer
224 views

AWS - Map URL to API Backend (Apache ProxyPass Like)

I have a web architecture using Apache as front-end and Nodejs as back-end. I want to migrate this architecture to AWS. Node.js is going to be an Elastic Beanstalk and Apache will be stored on Amazon ...
1
vote
1answer
60 views

How to move all files in a folder to s3, and delete local files?

and I think I can use aws s3 sync . s3://s3bucket But I'm not sure where to put the --delete Also I want to run this command from time to time to push all new files in my local folders to s3 ...
2
votes
1answer
61 views

How to secure the db dump taken from daily run script

In one of my mysql slave servers I have written a daily run script, which 1) stops slave, 2) takes a db dump, 3) starts slave again, 4) encrypts it, 5) copies it to my s3-bucket. I am using aws-cli ...
0
votes
1answer
890 views

Change nginx HTTP status code when using proxy_pass

I have the following scenario: a nginx serving static files to clients. For a request, the file is searched for in a local directory and, if not found, the request is forwarded to Amazon S3 via a ...
8
votes
2answers
1k views

Access Amazon S3 Static Website Through IPv6

I host a static website on Amazon S3 with DNS hosted on Amazon Route 53. I'd like my site to be accessible via IPv4 and IPv6 (because it's about time). When I use the Route 53 AWS Management Console ...
6
votes
3answers
168 views

Likely causes of NTPD dying unexpectedly and solutions

On a web application which uses s3 for physical document storage, we are experiencing issues with NTP continuously dying. This seems to happen roughly once or twice a day. There is very little ...
1
vote
2answers
395 views

How to configure AWS Route 53 to get equivalent of domain forwarding with masking

(I apologize in advance for not having enough technical depth to ask this intelligently) I currently have an AngularJS static website hosted on AWS S3. I'm using AWS Route 53 for DNS. I'm able to ...
0
votes
0answers
71 views

looking for index.php while proxy_pass to s3 bucket

I am configuring my nginx proxy server to fetch data from s3 bucket in case of 502 error. This is my configuration file. error_page 502 @static; location @static{ rewrite ^/a/b /a_b break; ...
3
votes
1answer
285 views

AWS: Why is the bucket size on CloudWatch higher than when using S3 tools?

I use the awscli tools to verify the size of my buckets. First the S3 call (all files without versioning, just an ordinary upload): $ aws s3 ls s3://XXX --recursive --human-readable --summarize ...
0
votes
1answer
21 views

AWS backup on another attached drive

In AWS-EC2, I was thinking of backup my code data and database in RDS via bash script on separate attached drive on same instance. I want to do it like that way so it becomes easier for me during ...
5
votes
1answer
211 views

How can I tell where an Amazon AWS key is being used?

I have inherited an Amazon AWS environment in which the Root account key has been widely distributed for the purposes of making backups to S3 buckets. I need to track down where the key is being ...
0
votes
1answer
837 views

Elastic Beanstalk S3 access via .ebextensions

I have a simple file in my .ebextensions folder: 00-myconfig.config Resources: AWSEBAutoScalingGroup: Metadata: AWS::CloudFormation::Authentication: S3Access: ...
0
votes
0answers
163 views

CloudFront + S3 Access Denied Using Signed Cookies

I'm trying to integrate signed cookies for a CloudFront distribution that's fed off of an S3 bucket but getting access denied error messages: <Error> <Code>AccessDenied</Code> ...
0
votes
1answer
108 views

when to use NFS for web app

I am currently building a simple webapp architecture on AWS, as follow: Elastic Load Balancer - multiple front ends - RDS database. I have also set up an NFS server to store all images uploaded by ...
0
votes
0answers
158 views

Access denied for the request of data from s3 bucket on high load

I am trying to fetch static files from s3 bucket in case of 502 error. This is how I have configured nginx for requests : error_page 502 = @static; location / { index index.php; try_files $uri ...
0
votes
0answers
70 views

Amazon S3 - Upfront File Organization Architectural Decisions

I'm currently building a web application for a publishing platform, and I am using S3 for content storage. S3 is super simple to use, but I'd like to try to make the best possible file organization ...
1
vote
3answers
250 views

How to transfer data between s3 buckets of the different aws account using command line

How to transfer data between s3 buckets of the different aws account using s3cmd ? command will be like this: s3cmd rsync s3://acc1_bucket/folder/ s3://acc2_bucket/folder --recursive But then how ...
1
vote
1answer
384 views

S3 Static Website hosting - restricting access from IP Range

Is there way by which can we enforce the access only from a Particular IP Range for S3 Static Website hosted site ?
0
votes
2answers
740 views

Getting cloudfront logs into logstash: ERROR: is not a legal argument to this wrapper, cause it doesn't respond to “read”

Logstash version 1.5.0.1 I am trying to use the logstash s3 input plugin to download cloudfront logs and the cloudfront codec plugin to filter the stream. I installed the cloudfront codec with ...
1
vote
1answer
135 views

Logrotate script not uploading to s3

I am trying to use logrotate to upload log files from my rails and nginx commands once a day. When I run the logrotate command manually the files successfully upload, but it never does it on its own. ...
0
votes
0answers
33 views

How to use the s3cmd setlifecycle command?

s3cmd has a setlifecycle subcommand that seems like it ought to let me configure a bucket into Amazon Glacier. However I can't find any documentation for it on the web or in the manpage. What's the ...
-1
votes
1answer
59 views

How can I easily backup multiple folders on EC2 to S3

I move dockers around a lot on EC2 instances. Each docker has a specific folder on the host where it stores it's data. I want to create a single backup script that will look for any of a list of ...
0
votes
0answers
41 views

aws hosted website not serving web pages to internal network and serving from s3 bucket instead

Sorry about more text to describe..(The issue has been resolved but the causes are un-known) We Have one website hosted via AWS Load Balancer and was working from last year perfectly. Recently an ...
3
votes
1answer
336 views

Why would a Image Hosting website, such as Imgur, use AWS EC2 instances over S3 buckets for uploads?

I was reading a Q&A with the creator of Imgur, and he went into detail explaining the server infrastructure that Imgur runs on. Here's a small quote from what he had to say: Most of the ...
0
votes
2answers
107 views

S3 backup with versioning plus lifecycle management to prevent malicious deletion of backups?

I just want to run this idea by some smarter people to make sure I'm not overlooking something obvious: I want to backup my Linux server to S3 using one of the many backup scripts that allow ...
1
vote
1answer
169 views

Why is AWS S3 Redirect Showing as 302 instead of 301?

I'm implementing a 301 redirect in S3 using this blog post from when the functionality was first announced. It explicitly says the redirect will be a 301, which is what I want. Screenshot of the ...
-2
votes
1answer
45 views

Sync files between AWS S3 and Rackspace cloudfiles [closed]

I am looking for a solution for syncing files between AWS S3 and Rackspace Cloudfiles on a regular basis. Preferably, using a third party service or low maintenance self-hosted solution.
0
votes
0answers
40 views

How to securely allow web apps to read/write to S3? (the new way with IAM)

I've been banging my head against a wall on this for two hours. It's frustrating that Amazon has made this so complicated when it doesn't need to be. Let's say I have a bucket called "test," and a ...