This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

1
vote
1answer
1k views

Using TntDrive to mount Amazon S3 on a Windows Amazon EC2 instance

I currently have 2 Amazon EC2 Windows Server 2008 instances setup with a load balancer. My problem now is that I need both instances to be able to access a single file system source (I'm trying to use ...
1
vote
1answer
1k views

Move files from ftp server to s3

I would like to set up an ftp server, where users will upload files, and for each file, put it on s3 storage, and delete it from the ftp server. (the server runs on ec2 ubuntu) Here are the stuff I ...
3
votes
2answers
3k views

Amazon Cloudfront with S3 Redirect

I'm trying to do something that should be relatively straight-forward - I want to setup a few domains and subdomains to redirect to the core domain for our site, but I want to put the redirects out on ...
1
vote
1answer
123 views

ERROR — : Response was: 307 — Temporary Redirect when trying to upload to bucket

I get 307 when uploading to a bucket with Amazon's Ruby gem (2.10.2). Another bucket works fine (both were created today). I checked the name and I didn't misspell it. What is causing the error?
0
votes
1answer
8 views

Logstash S3 input plugin re-scanning all bucket objects

I am using the Logstash S3 Input plugin to process S3 access logs. The access logs are all stored in a single bucket, and there are thousands of them. I have set up the plugin to only include S3 ...
0
votes
0answers
9 views

Access denied for sub-paths on CloudFront

I have a distribution on Cloudfront that use a S3 bucket. The first page works but not he sub-paths. For example, when I go to 'www.example.com' it works but not 'www.example.com/admin'. I always ...
17
votes
6answers
14k views

Which is the fastest way to copy 400G of files from an ec2 elastic block store volume to s3?

I have to copy 400G of files from an elastic block store volume to an s3 bucket... Those are about 300k files of ~1Mb I've tried s3cmd and s3fuse, both of them are really, really slow.. s3cmd ran for ...
0
votes
2answers
1k views

Enable Cross Origin Scripting on Nginx from retina.js to load files from another URL?

Im running a retina image plugin along with W3 Cache for CDN support. W3 cache moves images to S3, but the JS file won't server the files from there due to the difference in URL (it goes from h ttp://...
128
votes
22answers
93k views

How can I get the size of an Amazon S3 bucket?

I'd like to graph the size (in bytes, and # of items) of an Amazon S3 bucket and am looking for an efficient way to get the data. The s3cmd tools provide a way to get the total file size using s3cmd ...
5
votes
6answers
5k views

s3cmd run on command line not on cron

Many have said that the problem is with environment but I still can't seem to solve this problem. BTW I am using Ubuntu 9.10 login as user, then sudo -s using this command: s3cmd put file s3://bucket ...
1
vote
1answer
38 views

What is the right way to back up google authenticator emergency keys?

I'm implementing Google 2-Factor Authentication on some servers in my company. When configuring Google 2FA on client computers, 5 emergency codes are generated to be used if a user forgets his master ...
0
votes
1answer
1k views

Elastic Beanstalk S3 access via .ebextensions

I have a simple file in my .ebextensions folder: 00-myconfig.config Resources: AWSEBAutoScalingGroup: Metadata: AWS::CloudFormation::Authentication: S3Access: ...
0
votes
2answers
61 views

How to backup to s3 as rsync

I want to backup my server to s3, but I don't want to upload the entire container every time. Right now I use s3cmd put --recursive, but that uploads everything, and I don't want to waste space and ...
0
votes
2answers
47 views

What is the most efficient way to transfer files from AWS S3 to S3?

I have a large number of files stored in an AWS S3 bucket. I need to get those files to another S3 bucket owned by another user and in a different region. The files are stored in different locations ...
2
votes
1answer
63 views

What's the fastest way of getting data into an AWS Lambda?

I have something I'll call a "microservice" running on AWS Lambda (using node.js). Basically it serves up condensed summaries drawn from a few hundred megabytes of binary blob. There are a lot of ...
24
votes
3answers
41k views

What is causing Access Denied when using the aws cli to download from Amazon S3?

I'm really flailing around in AWS trying to figure out what I'm missing here. I'd like to make it so that an IAM user can download files from an S3 bucket - without just making the files totally ...
0
votes
0answers
16 views

list s3 object permissions via SDK / CLI / API?

I want to check which objects in the bucket are public available. I can run $s3->listObjectsV2 successfully, but I do not see any permissions here at all. What am I doing wrong? Also, I'd like to ...
0
votes
1answer
28 views

How to use one website with several amazon S3 buckets as a path suffixes?

I would like to host multiple S3 Amazon buckets under one site in next way: Access to bucket1 - http://example.com/bucket1(bucket2...) and so on. What now Amazon allows is access with links like http:/...
0
votes
0answers
19 views

S3/Cloudfront CORS working on some files only

I'm really struggling to get Cloudfront and S3 to add Access-Control-Allow-Origin: * to the headers of video files stored on S3 (for inline video on iPhones - seems to be working everywhere else ...
0
votes
1answer
54 views

Amazon route 53 + cloudfront + s3 -> with angularjs2 app in ec2

I am really confused about the setup I need for my angularjs2 app. It's simply a SPA application with html5 mode urls and all I want is: requests to www.mydomain.com/blabla... will be redirected ...
0
votes
1answer
1k views

s3fs “could not determine how to establish security credentials”

I'm trying to use s3fs to mount an S3 bucket on to a standard AWS Amazon Linux AMI (with all the necessary dependencies installed). However when following this tutorial when I run: s3fs mybucketname -...
0
votes
0answers
32 views

Permission issue in Riofs and Fuse with non root users

I am using fuse with riofs to mount local directory to s3 bucket. Below is the command I am running on the server. sudo /usr/local/bin/riofs -v -c /root/.config/riofs/riofs.conf.xml -l /var/log/...
0
votes
1answer
38 views

Is it possible to do database replication on aws s3

I have 4TB database in company. As many different analytics require that full data the current database is not able to handle concurrent session from 100s of users. Is it possible to have databse ...
0
votes
2answers
34 views

AWS - Symlink directory in EC2 to S3 bucket

I would like to create "infinite" directory in terms of storage in an EC2 instance. Is it possible to symlink directories to S3 bucket? I did not find any solution in the Internet, maybe somebody ...
0
votes
1answer
23 views

how to map my app to my domain in AWS

I am very new to AWS. I have a java app which runs in AWS instance and I am able to run that using following myIp:8080/myApp Also I have my domain (mydomain.com) registered with S3bucket, Now this ...
1
vote
1answer
30 views

AWS CloudFront Default Root Object and subdirectories

I'm hosting a Jekyll blog on S3 and CloudFront. Setting the default document on S3 works fine and all sub folders natively go to index.html. On my CloudFront distribution, I have set the Default Root ...
1
vote
2answers
1k views

s3fs Input/output error

I'm trying to set up a backup system with s3fs and the Amazon S3 service. I followed this this guide and this guide. Tailing /var/log/messages I get: Aug 28 13:37:46 server s3fs:###response=403 I ...
0
votes
0answers
9 views

AmazonS3 Exception in Windows Vista

I got an app that access and query data from AWS s3, it works fine in pcs with Win7, 8.1 and 10 (with NetFramework 4 or 4.5) But it fails when i run the same app in a PC with Windows Vista, it throws ...
1
vote
2answers
120 views

AWS S3 Sync options duplicates / weird behaviour

I am trying to sync a folder with 2M+ files to S3, everything went OK but then 40,000 files were not uploaded (server crashed randomly), when I tried to do a sync command again, it started from 0, ...
0
votes
0answers
29 views

Is not authorized to perform an operation while I have the full access of an aws service

I have created a simple nodejs script to handle the files in S3, and I want it to be executed on lambda. My admin has added me in IAM with full access to lambda and S3. However, when I select the "S3 ...
3
votes
2answers
3k views

CloudFront S3 Access denied

I have one account with privilege to manage S3 (S3_User), and another one to manage Cloud Front (Cloud_Front_User). Now, I've created a bucket "bucketname" with S3_User and a distribution with ...
1
vote
1answer
39 views

Encrypt on jenkins or S3 and decrypt on EC2 instance

I want to automate the deployment of new code on my application using AWS CodeDeploy. I'm using AWS to run my application. What I want to do is the following: Build the application in jenkins (runs ...
2
votes
2answers
82 views

Amazon Lambda for video and image processing?

The service I am building the architecture for has a video processing part in it. Basically, some people can upload videos (stored in S3) that will be split into frames with high resolution. From ...
0
votes
0answers
25 views

Does CloudFront support S3 signature version 4 for KMS encrypted objects?

I'm using Cloudfront with an S3 origin that is using KMS to encrypt objects. I'm getting the following error when sending a GET request for an object in the S3 bucket. Requests specifying Server ...
18
votes
2answers
16k views

Amazon Cloudfront with S3. Access Denied

We're trying to distribute out S3 buckets via Cloudfront but for some reason the only response is an AccessDenied XML document like the following: <Error> <Code>AccessDenied</Code&...
0
votes
1answer
25 views

Using a Gandi domain and a cloudfront default cert, how can I set up my CNAME records so that https works?

I have a website (www.foo.com), registered with Gandi. I have a static page on Amazon S3 (let's say s3.foo.us-west.com). I also have a Cloudfront distribution (foo.cloudfront.net). Originally, my ...
0
votes
0answers
32 views

Redirect one root domain to another all on AWS Route 53 / S3

Folks. I have been trying to configure a new domain I just bought to redirect to one I have successfully running on AWS Route 53, but cannot make this work. I am somewhat of a novice and have tried ...
1
vote
1answer
48 views

Confusion about Amazon EC2 and S3

Planning to host a PHP website with MySQL DB in Amazon Web Services, which AWS components should I choose? The website is just a dynamic website with a custom CMS, though a large amount of data are ...
0
votes
2answers
21 views

How to take EBS Volume snapshot and store to S3 Reduced Redundancy?

By default, EBS Volume snapshots on AWS are stored to S3 Standard storage. I would like to figure out how to direct those snapshots to Reduced Redundancy storage instead. I've been trudging through ...
1
vote
1answer
30 views

s3cmd error on sync: S3 error: 400 (InvalidRequest)

I'm trying to configure s3cmd to backup some directories on my server to my AWS S3 bucket. My problem is that when I do the sync command: s3cmd sync -r -p --no-delete-removed /path/to/dir s3://...
0
votes
1answer
63 views

Access s3 bucket from Ec2 service

I'm new to AWS and was looking for a bucket policy to enable my ec2 servers access to the S3 buckets on the same account. I tried using this policy which enables the account: { "Sid": "...
0
votes
1answer
21 views

restore backup files in another server using duplicity

I am using duplicity to backup the application files with gpg key to Amazon service S3 server. And then restore the same from S3 to own server. I want to restore the backed up files to another ...
0
votes
0answers
43 views

Reverse Proxy on cloudfront

I have an angular site / web application (Lets call this www.mysite.com) hosted on Amazon S3 as a static website. This s3 bucket serves as the origin for a cloudfront distribution and it works ...
0
votes
1answer
36 views

How to suppress file output from aws s3 ls?

I am using the aws cli to summarize the number of files and the total size of an s3 bucket using the following command (documentation): aws s3 ls s3://mybucket --recursive --human-readable --...
1
vote
0answers
26 views

fast backup script in linux

I have a server with more applications and do normal shell command to take backups. it took couple of days to complete. Tried to install duplicity. but its told some packages are not found. its Debian ...
-1
votes
1answer
64 views

How can I easily backup multiple folders on EC2 to S3

I move dockers around a lot on EC2 instances. Each docker has a specific folder on the host where it stores it's data. I want to create a single backup script that will look for any of a list of ...
3
votes
1answer
158 views

Cache-Control not working in AWS S3 object Metadata

Follow-up to my original question: No Cache-Control Header for files from AWS CloudFront with S3 Origin Im serving up static files using AWS CloudFront with AWS S3 as the origin. I tried to set the ...
13
votes
1answer
6k views

AWS IAM user access issues for S3

I have the following IAM policy for a user { "Version": "2012-10-17", "Statement": [ { "Sid": "Stmt1395161912000", "Effect": "Allow", "Action": [ "s3:ListBucket", ...