Tagged Questions

This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

0
votes
2answers
16 views

Auto scale on Amazon S3 based on transfer

I'm waiting for Account confirmation in Amazon AWS, till then I can't experiment. First of all, I found the docs about auto scaling in Amazon AWS, but all of them mention Amazon EC2, there is no info ...
1
vote
1answer
36 views

What is the best way to backup logs in Amazon S3 in real time? [closed]

I want to backup all my logs in Amazon S3 in real time, which tool I should use?
0
votes
0answers
18 views

Show images from S3 bucket into Ruby-on-Rails application [migrated]

I have setup an S3 bucket with name 'mobiles' and populated it with around 2000 images. The bucket has a folder structure as well like 'mobiles / vendor-name / model-name / model-image.jpg'. In my ...
0
votes
0answers
25 views

NGINX: proxy_cache altering headers

I have been having trouble building a proxy between my server and s3 to cache requests. I finally boiled it down to a single point of failure... http{ proxy_cache_path /home/cache levels=1:2 ...
0
votes
0answers
12 views

Nginx proxy cache invalidating request to s3

I have set up a proxy from my application server to a private s3 bucket to cache requests. I was having some trouble with it where s3 was rejecting my download requests (403 forbidden) and after some ...
1
vote
1answer
30 views

How to store a Cloudfront custom error page in S3?

I have a Cloudfront plugged on an AWS load balancer. I saw in the AWS documentation that I can customize Cloudfront custom error pages. I tried to store these error pages in S3 as it is recommended ...
0
votes
1answer
23 views

What should an s3 end point look like when configuring an ALIAS record in Route53?

I'm trying to point my root domain to an s3 bucket that redirects to www.mywebsite.com. However, when I try to configure my ALIAS record to point an s3 endpoint, the only endpoint that the dialogue ...
0
votes
0answers
22 views

Benchmark network (internet) connection on server

I have a dedicated ubuntu server I rentet. Now I'm running a lot of ruby background processing on that server, that - among other things - does a lot of get requests to very small images (about 10kb) ...
0
votes
0answers
8 views

Include x-amz-storage-class Header When Calling Amazon S3 from Web.config

Any time my web app calls Amazon S3, it would be nice to conditionally include the following header. I am using a custom domain mapped to an S3 bucket. key: x-amz-storage-class value: ...
0
votes
1answer
36 views

Duplicity Backups (via Duply) to S3 - high server load

We have been doing incremental backups using Duply on our main server, to an S3 bucket. However, we've found that there is a high server load during the backups (its an Amazon EC2 server). We're ...
0
votes
0answers
29 views

s3cmd sync hangs forever. Never finishes

I am trying to backup a directory of around 350GB in size to S3. The command I run is s3cmd --progress -v -H sync /localdir s3://mybucket/ However, the process never moves past INFO: Compiling ...
0
votes
2answers
63 views

How does my registrar (Namecheap) let me set up a CNAME record on the apex domain?

Namecheap seems to let me create a CNAME record on the apex domain, which I thought was contrary to the definition of a CNAME record: It works (correctly loading up my static site from S3). ...
-1
votes
0answers
26 views

AWS for mobile tech start-up [duplicate]

I am representing a tech start-up who are currently meeting with investors. Basically we have calculated usage statistics and our server load requirements and once we gather investment we will be ...
0
votes
0answers
130 views

s3fs “could not determine how to establish security credentials”

I'm trying to use s3fs to mount an S3 bucket on to a standard AWS Amazon Linux AMI (with all the necessary dependencies installed). However when following this tutorial when I run: s3fs mybucketname ...
0
votes
1answer
83 views

How do I place an SPA in a S3 state website subdirectory using rewrite rules?

I have successfully deployed AngularJS apps to S3 in the past with html5mode enabled in order to allow for hash-less URLs. For my current project, however, I need to place the Angular portion of the ...
0
votes
0answers
30 views

Strict-Transport-Security on CloudFront with S3 origin?

My company's site has a static homepage for speed and cost reasons. We use S3 as the origin for CloudFront. Now, we would like to declare Strict-Transport-Security for the entire domain, but S3 seems ...
0
votes
0answers
27 views

Move query string to path in proxy - Apache

I am setting up Apache to proxy files from Amazon S3. The initial urls have query strings, but query strings can't be passed to S3, so they are stored as paths with question marks in them (which then ...
0
votes
1answer
76 views

Will Amazon S3 comply with the UK Data Protection Act? [closed]

In order for our product to comply with the UK Data Protection Act, one requirement is that our data must be stored within a UK data centre. Is there a facility to configure Amazon S3 to use a ...
0
votes
0answers
33 views

Nginx serves response with 200 even after calling ngx.exit()

I am trying to serve static content from S3. I am using nginx and lua script for its configuration. I am new to both nginx and lua. The task that I want to achieve is : Get request URL into nginx. ...
-1
votes
1answer
41 views

S3 - File, Compare, Delete [closed]

We're moving 10 Tb of data from local storage to S3. I'm mostly automating the task using s3express. However: the data technicians would like a tool similar to the VisaVersa 'compare' function; The ...
0
votes
1answer
65 views

rebuild yum index on aws s3

I am trying to rebuild yum repo on aws S3 after adding new packages. Here are few commands I am trying, but it is not helping. [root@chucks ~]$ createrepo --baseurl ...
0
votes
1answer
89 views

DNS with name.com and Amazon S3

I have a website on a bucket in Amazon S3, and recently started to get emails from Google "Googlebot can't access your site". When I go to Webmaster Tools and I try to fetch in fact it doesn't work. ...
-2
votes
2answers
65 views

https download file with custom S3 URL

I believe the following question should be asked here and not @Super User. My web application is using S3 for users to download files. Prior customizing the url, files were downloaded from S3 with ...
0
votes
0answers
53 views

Cloudfront - How to invalidate objects in a distribution that was transformed from secured to public?

The setting I have an Amazon Cloudfront distribution that was originally set as secured. Objects in this distribution required a URL signing. For example, a valid URL used to be of the following ...
0
votes
1answer
347 views

regex to match s3 urls in nginx location directive & proxy to amazon s3

In nginx location directive, how do I match s3 urls. for example, the wrong url is: http://example.com/https://s3.amazonaws.com/mybucket/logo.jpg?1404251306 from Logs, I can see nginx can that it ...
0
votes
1answer
539 views

Setting Access-Control-Allow-Origin on Cloudfront

I am having problems serving static assets to Firefox using AWS Cloudfront. Chrome works perfect, but Firefox is returning a CORS error. If I execute curl , I get: HTTP/1.1 200 OK Content-Type: ...
-1
votes
1answer
56 views

“Securely” download a file over https without using authentication

I need to securely download a file over https without using authentication. The reason I need to do this is I want to create a zap at Zapier.com that allows me the copy a file from a https post to my ...
0
votes
1answer
29 views

Access date of Amazon s3 resources

Anyone know of a way to ascertain the last accessed date for s3 files/buckets or if this is even recorded? Doesn't seem visible via the GUI and a basic try of s3cmd and boto shows last modified date ...
0
votes
0answers
117 views

Duplicati restore one file from s3

I am attempting to configure Duplicati to backup encrypted to Amazon S3. I configured it to run the CLI in a batch file that will be TaskSched'd to run nightly. This batch code seems to be working: ...
1
vote
0answers
38 views

svnadmin dump returns error insufficient disk space

I have a SVN repo that is around 35GB after dumping. I know this is huge, but our business requires that all revisions of all files and libraries be tracked. I have Apache Subversion hosted on an ...
0
votes
1answer
245 views

PHP error logging with AWS and EC2 [closed]

I'm setting up my site to run on AWS EC2. In some presentation for AWS services I saw that there are ways to store your PHP error logs in AWS S3 and analyze it with specific tools. Can't find this ...
3
votes
2answers
101 views

Does Amazon CloudFront charge for storage? [closed]

I've been reviewing the features and prices of Amazon S3 and Amazon CloudFront as well as similar services offered by other providers. One thing I can't understand is why Amazon CloudFront pricing ...
1
vote
1answer
64 views

Backing up onto S3 - do I want to use bucket in a different region?

We are using Amanda to send backups to S3. Each host is acting as its own Amanda "server". All hosts are currently using the same S3-bucket -- each has its own subfolder under it. The dumps are saved ...
0
votes
1answer
232 views

Amazon Cloudfront with S3 Redirect

I'm trying to do something that should be relatively straight-forward - I want to setup a few domains and subdomains to redirect to the core domain for our site, but I want to put the redirects out on ...
0
votes
1answer
209 views

using CloudFormation with an existing S3 bucket

Using CloudFormation, I want to set some of the properties in AWS::S3::Bucket on an existing bucket. In other words, I don't want to create the bucket, I just want to enforce some of the settings. ...
0
votes
0answers
98 views

Linux server backup to Amazon S3 using SSL

I have Linux box CentOS 6.5 and i want to backup daily files like SQL dumps and config files to Amazon S3 I have installed Ruby and S3Sync. But the problem when running the s3sync with these ...
0
votes
1answer
88 views

Back up S3 bucket to another?

I am looking at duply and duplicity currently to mirror one bucket to another but it looks like I may be running in to a brick wall? So far I have been able to get things working backing up local ...
0
votes
1answer
51 views

Best practice for web applications and windows services remote configuration in AWS

we have a distributed system that contains windows services and web applications (.NET and Java based). Currently, most of the initial configuration for these applications are taken from various ...
3
votes
1answer
476 views

What IP range do I ask the system administrator to open in order for S3 to work?

I've written some programs for Raspberry Pi, which some small companies have shown interest in. I sold pre-configured Raspberry Pi:s to them, with my program on them, and it works for everybody except ...
0
votes
1answer
103 views

can't get s3 authentication to work to load data into redshift

I'm working on getting data into a sample Redshift cluster for a client, but I can't get authenticated to S3. There's been a recent change so that my own 'root user' access keys aren't available for ...
0
votes
1answer
93 views

s3cmd: Deleting files or folder does not work

s3cmd s3://MYBUCKET/FOLDER does not work. (folder is empty) s3cmd s3://MYBUCKET/FILE does not work. Output of both commands is "File FILE sucessfully deleted", yet the file remains on the bucket. ...
0
votes
1answer
218 views

How to best backup AWS-hosted systems? [closed]

We are deploying a number of servers at AWS and need to work-out a general-purpose backup strategy. The requirements are: Retain the ability to recover full systems or individual files or ...
0
votes
1answer
166 views

Redirect loop after setting up domains

I migrated domains from a service provider (ipage) to godaddy. The hosting has been setup on AWS S3. I have done such things before and they worked. However this time I'm hitting a redirect loop ...
0
votes
2answers
174 views

how to pipe a mysql dump to s3cmd

I want to transfer a mysql dump, compressed, to s3. I tried: mysqldump -u root -ppassword -all-databases | gzip -9 | s3cmd put s3://bucket/sql/databases.sql.gz but then I get: ERROR: Not enough ...
1
vote
0answers
161 views

Duplicity -> S3 backup failing with “[Errno 105] No buffer space available”

I have a nightly script on my Ubuntu 10.04 VPS which uses duplicity (0.6.24) to run incremental, encrypted backups to Amazon S3. This script had been working until a month or so ago when it started ...
-1
votes
1answer
314 views

S3 static website hosting, which DNS CNAME record should I use?

I have created a S3 static website e.g. www.example.com The S3 endpoind is: www.example.com.s3-website-us-east-1.amazonaws.com When I dig this DNS ...
0
votes
0answers
531 views

s3cmd 403 Access Denied error on put but not ls

I can access s3 using s3cmd on an ec2 instance to do s3cmd ls s3://myc bucketname but not using 'put' to add a file. It gives a 403 access denied error. I am using IAM and have group setup to access ...
1
vote
1answer
308 views

Restore a versioned S3 bucket to a particular point in time

Let's say I've got S3 versioning enabled for my bucket: http://docs.aws.amazon.com/AmazonS3/latest/dev/Versioning.html Then, let's say someone (for example, junior employee) messes up the S3 bucket ...
0
votes
1answer
548 views

How to ideally store images on Amazon S3

I want to store a huge number of images on Amazon S3 (served via Cloudfront). Currently the way I am doing is simply dumping the images and having basic HTTP Cache headers set to a month so that users ...
1
vote
1answer
173 views

Drop/Truncate DynamoDB table with AWS Data Pipeline

I have set up a Data Pipeline that imports files from an S3 bucket to a DynamoDB table, based on the predefined example. I want to truncate the table (or drop and create a new one) every time the ...