This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

0
votes
1answer
6 views

Origin access identity and S3 permission

From http://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/PrivateContent.html , I have already created an OAI, as shown in this screenshot Am I supposed to grant the permission to ...
0
votes
1answer
27 views

Copy directory structure intact to AWS S3 bucket

I want to use the AWS S3 cli to copy a full directory structure to an S3 bucket. So far, everything I've tried copies the files to the bucket, but the directory structure is collapsed. (to say it ...
0
votes
2answers
34 views

Most efficient way to batch delete S3 Files

I'd like to be able to batch delete thousands or tens of thousands of files at a time on S3. Each file would be anywhere from 1MB to 50MB. Naturally, I don't want the user (or my server) to be waiting ...
0
votes
1answer
11 views

s3 service using s3cmd tool through URL based firewalls

I am behind a URL based application firewall and currently using s3cmd tool to access amazon's s3 service. Doing a bit of searching has asked me to whitelist s3.amazonaws.com but I see that s3cmd uses ...
0
votes
1answer
9 views

AWS S3 Sync options duplicates / weird behaviour

I am trying to sync a folder with 2M+ files to S3, everything went OK but then 40,000 files were not uploaded (server crashed randomly), when I tried to do a sync command again, it started from 0, ...
0
votes
1answer
52 views

Where are AMIs stored?

It seems like an very simple question, but yet I could not find the answer. When I make an instance on Amazon AWS and then make some changes and create an AMI where is that AMI stored? S3? Will making ...
0
votes
2answers
41 views

How to restrict outbound EC2 to only access S3?

I want to restrict the outbound security group from an EC2 instance. The instance only needs to access an S3 bucket. I just learned that S3 uses port HTTPS (443). I could just put that rule in place ...
2
votes
0answers
28 views

Most bandwidth efficient setup for video sharing [closed]

I built a video sharing platform for a popular french podcast I contribute to. Initially I used S3 and linked directly to it, bad idea. Then I used a pull CDN to better optimize my bandwidth, but s3 ...
0
votes
1answer
68 views

How can I set up an SFTP server backed by S3 (or similar)

I need to set up an SFTP server that, essentially, has very large capacity. I need to give one of our partners SFTP login details to a server where they will upload millions of files, totalling a few ...
0
votes
1answer
30 views

Limit my S3 bucket read access to EC2 instances run by others?

For instance, if I store data in US Standard, the S3 Pricing Page indicates that it is $0.00 per GB transferred out to Amazon EC2 in the Northern Virginia Region. And it looks like GET requests are ...
2
votes
1answer
79 views

CloudFront S3 Access denied

I have one account with privilege to manage S3 (S3_User), and another one to manage Cloud Front (Cloud_Front_User). Now, I've created a bucket "bucketname" with S3_User and a distribution with ...
-1
votes
1answer
21 views

Route 53 subdomains and their redirects

I am having problems with my redirects. I have a bucket named example.com created in s3 which redirects to http://google.com (just an example). In route 53 I am able to point my example.com domain to ...
1
vote
2answers
104 views

Getting files from an s3 bucket using IAM role credentials

I am trying to retrieve some files from a private s3 bucket to a filesystem location elastic beanstalk ec2 instance, but with no success. I've created a bucket named dev-config containing a file ...
0
votes
1answer
50 views

Direct multiple domains to specific URLs under one domain: Amazon S3 or Apache

I have a site with user profiles and following address structure: www.mywebsite.com/user1 www.mywebsite.com/user2 I need to allow users to point/redirect their own domains to their respective page ...
0
votes
1answer
28 views

Amazon S3 Versions: log one line per version

Before I go down this rabbit hole, has anybody tried this? Is it crazy? Let's say I want to put a log file in Amazon S3. But S3 doesn't have the ability to append to an existing object without first ...
1
vote
1answer
73 views

Access denied copying files using S3 CLI

Attempting to pull down the contents of an S3 bucket using the AWS CLI, I'm getting the following: aws s3 cp --region us-east-1 s3://s3.amazonaws.com/my-bucket . --recursive A client error ...
0
votes
1answer
42 views

Transfer enterprise data - tiny volumes - to AWS S3 for Heroku app

What would you suggest is the best option to get "enterprise" data from a client into AWS S3 so we can provide Heroku hosted SaaS? The data volumes are tiny, it's just daily spreadsheet/csv records. ...
3
votes
1answer
81 views

Deny anonymous downloads in AWS S3

I have a bucket with several files publicly downloadable. I want to put up a bucket policy after which these files should only be downloadable by my IAM users. The policy I have got so far is this: { ...
2
votes
0answers
49 views

Solution for file data backup, versioning and replication

We have a growing set of data files (.wav files, image files etc) which are data, i.e not part of the application code - uploaded and modified by users. The number of files is in the 1000s and the ...
1
vote
1answer
53 views

How do I use SSL with Amazon S3 CNAME masked buckets?

I am successfully running an Amazon S3 bucket as media.mydomain.com. The problem is, I'm running an https site and I'm unable to link to files using https//media.mydomain.com. How can I switch to ...
3
votes
2answers
72 views

Move static files from EC2 to S3 (or cloudfront) without updating links

Right now, I have a site entirely on an EC2 instance including all static files like css, js, and images. I'm wondering about the best way to handle moving them. For example, in my <HEAD> on a ...
0
votes
1answer
46 views

Sync files from local filesystem with S3 - one way

I have a process that generates log files to the local filesystem, and files that are more than 2 weeks old are automatically purged. I want to use the aws command line tools to sync my folder with ...
2
votes
1answer
27 views

Does the AWS CLI mv command also do a copy-and-delete?

I am investigating renaming bundles in AWS S3. I would prefer to use the SDK, but it appears that the SDK only supports Copy and Delete. This because the object keys are used for partitoning the ...
0
votes
1answer
45 views

AWS EC2 and storage spreadsheets [closed]

Does anyone know of a way to obtain the raw pricing data from AWS for their various hardware components (specifically EC2 and S3)? I noticed they produced a spreadsheet back in 2010 that isn't ...
1
vote
2answers
204 views

HTTPS access to S3 bucket through Cloudflare

I'm trying to use Cloudflare to provide https access to an s3 bucket. I've setup the CNAME entry in Cloudfront with pointing to the bucket and I've verified I can access it via http but when I try and ...
0
votes
0answers
66 views

AWS Cloud Front with S3, serving static files- Redirects implemented via java script at browser level

We have our Java application on tomcat server webpages- the application fetch content from multiple services and Database to create page and respond. We are checking for a best method to improve the ...
0
votes
1answer
32 views

Pricing of Key Pairs and Security Groups on AWS?

My free AWS account expired. I deleted all S3 and EC2 resources, but am wandering if I can leave the Key Pairs and Security Groups without having to pay for them. (My account resources look like this ...
0
votes
1answer
87 views

Redirect warning when running s3cmd sync

When running s3cmd I get a redirect warning as follows: WARNING: Redirected to: xyz.s3-eu-west-1.amazonaws.com The script that produces the warning is this: s3cmd sync /var/backups/db/ ...
0
votes
1answer
136 views

No permissions for files in Amazon s3 for admin

We transferred files from one bucket to another bucket on a separate account with --acl-public as follows: s3cmd cp -v --recursive --acl-public s3://source-geo/webroot s3://dest-geo/webroot/ Now we ...
0
votes
1answer
275 views

Setting cache for already uploaded amazon s3 files

In amazon s3 for our site through s3cmd tool we uploaded around 60GB of files including mp3, jpg to a bucket. But now when we checked site slowness files are not caching and further checking we came ...
-1
votes
1answer
72 views

Url rewriting in Amazon S3

I have a webapp hosted in Amazon S3, the webapp is build with jQuery Mobile and I use changePage lo navigate between pages, I'm not using the hash operator(#) when I change the page. I'm having ...
0
votes
1answer
51 views

How to configure Amazon S3 permissions to host files for my mobile app

I have a mobile app that uploads files to a server and needs to be able to download them. I'm using S3 to hold the files, and have a RoR backend to manage all this. Is it possible to have the ...
0
votes
0answers
91 views

Override content type headers when using Apache as a reverse proxy

I'm using Apache 2.2 as a reverse proxy in front of my s3 buckets. S3 serve the hosted files with wrong content-type headers. Is there a way to configure Apache to automatically re write the ...
2
votes
2answers
229 views

Amazon AWS EC2 instance Exported to local machine

I have several Amazon AWS EC2 virtual machines that I created on AWS EC2. They were not imported, they were created there. I would like to export these machines in order to achieve local backups, ...
0
votes
1answer
62 views

version id of object in amazon s3 is unique to file, bucket or S3?

The doc says If you enable versioning for a bucket, Amazon S3 automatically generates a unique version ID for the object being stored When versioning is enabled for a bucket, can I say version ...
0
votes
0answers
75 views

AWSCLI s3 sync doesn't create directory

Hi try to sync a local directory to a S3 bucket. The files in the directory get synced perfectly, just the directory isn't created at all. Can you guys give me a hint how to do it? "newdir" contains ...
0
votes
0answers
182 views

IAM user with full s3 access can't create directory

I've a AWS IAM user which has full access to Amazon S3 The policy is the following { "Statement": [ { "Effect": "Allow", "Action": "s3:ListAllMyBuckets", ...
0
votes
1answer
89 views

Load times of S3 Static Website

We have recently decided to move our static single page website to AWS S3, the previous server was hosted by Godaddy(cpanel) in singapore. We are using Synthetics New Relic to monitor our website and ...
2
votes
0answers
36 views

What does a healthy CNAME to an S3 web access bucket look like? [duplicate]

I have feed.foodschmood.com configured according to Amazon's instructions (a CNAME to one of their endpoints, which is itself a CNAME), but I'm skeptical that this is a "proper" configuration. ...
0
votes
1answer
28 views

S3 dropouts in one region only - is this normal?

I'm using S3 to serve static image assets to a website. I'm a developer in Montréal, Quebec. My client's office is in LA. Once every month or three we're seeing S3 completely fail to serve images to ...
2
votes
0answers
107 views

s3 policy for quota

Is there a s3 policy rule that can only allow a user to upload so many GB of files? Basically looking to set a quota on the objects a user can upload. Here is the rule set that I have now: { ...
1
vote
2answers
55 views

Auto scale on Amazon S3 based on transfer

I'm waiting for Account confirmation in Amazon AWS, till then I can't experiment. First of all, I found the docs about auto scaling in Amazon AWS, but all of them mention Amazon EC2, there is no info ...
1
vote
1answer
65 views

What is the best way to backup logs in Amazon S3 in real time? [closed]

I want to backup all my logs in Amazon S3 in real time, which tool I should use?
0
votes
0answers
59 views

NGINX: proxy_cache altering headers

I have been having trouble building a proxy between my server and s3 to cache requests. I finally boiled it down to a single point of failure... http{ proxy_cache_path /home/cache levels=1:2 ...
1
vote
1answer
90 views

Nginx proxy cache invalidating request to s3

I have set up a proxy from my application server to a private s3 bucket to cache requests. I was having some trouble with it where s3 was rejecting my download requests (403 forbidden) and after some ...
1
vote
1answer
156 views

How to store a Cloudfront custom error page in S3?

I have a Cloudfront plugged on an AWS load balancer. I saw in the AWS documentation that I can customize Cloudfront custom error pages. I tried to store these error pages in S3 as it is recommended ...
0
votes
1answer
50 views

What should an s3 end point look like when configuring an ALIAS record in Route53?

I'm trying to point my root domain to an s3 bucket that redirects to www.mywebsite.com. However, when I try to configure my ALIAS record to point an s3 endpoint, the only endpoint that the dialogue ...
0
votes
0answers
39 views

Benchmark network (internet) connection on server

I have a dedicated ubuntu server I rentet. Now I'm running a lot of ruby background processing on that server, that - among other things - does a lot of get requests to very small images (about 10kb) ...
0
votes
0answers
19 views

Include x-amz-storage-class Header When Calling Amazon S3 from Web.config

Any time my web app calls Amazon S3, it would be nice to conditionally include the following header. I am using a custom domain mapped to an S3 bucket. key: x-amz-storage-class value: ...
0
votes
1answer
141 views

Duplicity Backups (via Duply) to S3 - high server load

We have been doing incremental backups using Duply on our main server, to an S3 bucket. However, we've found that there is a high server load during the backups (its an Amazon EC2 server). We're ...