Tagged Questions

This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

1
vote
0answers
85 views

Handling multiple server blocks in nginx configuration

I am working on setting up a proxy server for my application.The use case is I want a specific set of requests to be redirect to say abc.com and rest of the request to be redirected to xyz.com. Eg:If ...
1
vote
3answers
202 views

Hosting a site on Amazon S3, URL keeps redirecting

I am trying to use Amazon S3 to host my webiste. I have the domain registered though namecheap. Whenever I navigate to mywebsite.com the URL in the browser changes to ...
1
vote
1answer
206 views

Amazon EC2, S3, REST API, and how to correctly provide contents to users

I have deployed a REST server in an Amazon EC2 instance. I have also configured an Amazon S3 bucket to store all the data generated by users while interacting with the API. The main information stored ...
1
vote
0answers
132 views

Amazon S3 sync theory

I'm setting up a backup of my vital data (database and images, mainly) to S3 from my Ubuntu box. I've set up Amazon S3, and installed S3FS to mount the bucket on my machine. This is working well, but ...
0
votes
2answers
120 views

Looking for a high IO s3 “compatible” storage solution

Help me serverfault! I am looking for a high IO (2 million mostly put transactions per day of 7-10k xml chunks) storage solution that is amazon s3 compatible that I can house in my datacenter. I am ...
0
votes
1answer
78 views

Can AWS S3 files in buckets get deleted by a download timing out?

A few AWS S3 files might have gotten deleted while trying to download everything for a local backup. The download/connection timed-out a couple times. The next day several HTML/JS files are missing ...
3
votes
1answer
781 views

Linux server sync to an Amazon S3 bucket

I am looking for a stable solution to replace a classic server backup to another server using rsync. I have to sync a whole filesystem (more than 1Tb) to Amazon S3. Where am I? Solution 1: I mapped ...
4
votes
1answer
273 views

Amazon S3 appears to be blocking cloudflare IP addresses. How do I fix it?

I have static content that is being served by Cloudflare. Cloudflare points to Amazon S3 to pick up the static content and serves it via a CNAME (cdn.mydomain.com). The bucket is setup properly and ...
1
vote
1answer
104 views

Multisite on AWS EC2

I'm working on a multi-site app targeted to run fully Amazon Web Services. Due to its nature, it will have significant traffic spikes, followed by long periods of low traffic, so the ability to scale ...
1
vote
1answer
426 views

Debugging logrotate postrotate script

Following is my logrotate conf. /mnt/je/logs/apache/jesites/web/*.log" { missingok rotate 0 size 5M copytruncate notifempty sharedscripts ...
0
votes
2answers
209 views

Can I limit user access to AWS S3 buckets?

I'm working on a site that is probably destined for AWS hosting. This leads to a question about access rights to stuff that would be stored in S3 buckets: I set up an EC2 server for the site, and ...
0
votes
1answer
597 views

s3cmd with --delete-removed

I'm currently writing a script to sync files in s3 buckets with s3cmd. I check the document and it says: s3cmd sync LOCAL_DIR s3://BUCKET[/PREFIX] or s3://BUCKET[/PREFIX] LOCAL_DIR also I find a ...
1
vote
1answer
167 views

Restore snapshot from other aws account?

I am new in this, so forgive my beginner question. I have an aws account which is currently in us-west-2c. It has a instance running, and also a couple of volumes which i made. I have multiple backups ...
0
votes
2answers
410 views

Can I use Glacier to snapshot S3 like a point-in-time backup?

I have a series of directories on numerous computers that I backup to an S3 bucket nightly using dgsync. I'd like a solution that will permit me to archive occasionally: once a week for the past ...
0
votes
2answers
629 views

Enable Cross Origin Scripting on Nginx from retina.js to load files from another URL?

Im running a retina image plugin along with W3 Cache for CDN support. W3 cache moves images to S3, but the JS file won't server the files from there due to the difference in URL (it goes from h ...
0
votes
2answers
308 views

Move IIS logs to S3

I have a requirement to move IIS logs to S3 directly. There are tools that can be used to create a mount and set IIS to have logging to mounted S3 bucket. My question is is there a way where I can do ...
2
votes
1answer
2k views

Give EC2 IAM role read access to S3 bucket

I have an AWS Elastic Beanstalk Rails app that I am configuring via the config script to pull some files from an S3 bucket. When I start up the application, I keep receiving the following error in the ...
2
votes
0answers
2k views

s3put fails with “Connection reset by peer” for large files

I can upload small files quite fine using the same commands, however whenever I try to upload a 5 GB file to S3 then the s3 script fails: [backup]$ s3put --bucket john-murdoch-bucket --reduced ...
0
votes
1answer
189 views

Amazon S3 map url to backend server like Apache's <Location /api> ProxyPass

Is there a way to map a URL to a backend server in S3. I am not looking for redirects, but something on the lines of Apache's Location directive with ProxyPass. ...
3
votes
0answers
1k views

Amazon S3 + Cloudfront VS Rackspace CloudFiles [closed]

I know this question came up lot of time on the internet , But I couldn't find any latest updates on this . So I gathered the information what I found and putting here and have few questions on it . ...
1
vote
2answers
1k views

CloudFlare CDN and static site with root on Amazon S3

I've set up an S3 bucket to host my static site. Now I am trying to wrap CloudFlare around this, but I get the following warning when adding a CNAME entry for the root domain in CloudFlare's DNS ...
1
vote
1answer
288 views

Automatically sync git repo to Amazon S3 site

I'm using an Amazon S3 site to host a website. I'm aiming to use a git repo to store the content and versioning and I'd like the repo to automatically update the S3 site once something is checked into ...
2
votes
1answer
868 views

What is your general strategy to backup S3 buckets?

We are starting a project which involves storing large data quantities in S3. S3 is good at scaling and we've expect to have up to 5TB and million of files in bucket. While i may trust Amazon in ...
0
votes
1answer
131 views

S3 bucket alias

I have a S3 bucket called "abcd" that I would like to map to a subdomain, "abcd.mydomain.com", using a CNAME. Unfortunately I can't move files from the original "abcd" bucket to a new ...
0
votes
1answer
414 views

AWS EC2 Mailserver Failover Strategies done right

I'm researching in this topic really hard the last few days and i just want to discuss this with a few specific questions - i did not find any suitable thread here that is covering my needs and ...
0
votes
1answer
129 views

How continue sync with S3CMD after broken connection?

I'm using s3cmd to backup some logs into Amazon S3 buckets. Which is a great tool. But I notice that, very often, my sync's are broken, they just cancel and try to upload again, until they can upload ...
0
votes
0answers
355 views

s3cmd fails to put files

I'm trying to put mysql dump file on s3 bucket. It gives an error like ; sudo ./backup.sh WARNING: Module python-magic is not available. Guessing MIME types based on file extensions. ...
0
votes
0answers
40 views

Cloudformation Resource for a Cross Region S3 bucket policy [duplicate]

I know this is somewhat a duplicate of Cross Region S3 bucket policy but I don't have enough rep to comment and the answer wasn't detailed enough. I would like to allow EC2 servers based in ...
3
votes
2answers
328 views

Storing and serving files securely for multiple clients

We are working on a web app, where (among other features) our users can upload their files. However we can't store these files on our VPS because storage space is limited, so we decided to go with S3. ...
0
votes
1answer
36 views

To run python script when my Amazon instance boots up

Where should i place my script in amazon instance such that my script should run when my instance boots up? I tried placing it in rc.local but it didnt help. My script is about connecting to Amazon ...
0
votes
1answer
363 views

Unable to read S3 file from interactive pig job flow

I'm unable to read a simple test file on S3 from an interactive pig job flow (hadoop, elastic map reduce), and I'm not sure why. I have two S3 buckets. Let's call them unmounted_bucket, and ...
2
votes
1answer
355 views

How backup files with logrotate and Amazon S3?

I would like to create a new standard of two things: how long would be generated and be rotated the logs generated by my applications ? how to transfer the logs to Amazon S3, as a backup server ?. ...
0
votes
2answers
1k views

Create 301 Redirection in Amazon Route 53 for Wildcard Subdomains

My domain name hosted on Route 53 DNS. Amazon has a guide to do 301 redirection for www. To naked domain by point www. version to a S3 static website with 301 setted up. My question is, how can I ...
0
votes
1answer
285 views

Configure subdomain to point to S3 bucket using Route 53

How would I go about mapping files.example.com to an Amazon S3 bucket using Amazon's Route 53 service? I've attempted to add a CNAME record but I get the following:
1
vote
1answer
276 views

Taking Cassandra Backups

We currently have 12 nodes running in our Cassandra cluster. Ultimately even if a couple of the nodes go down, we're still up and running. The paranoia in me would like to do at least one backup a day ...
1
vote
1answer
444 views

How can I download an S3 binary file using Amazon's AWS CLI tool?

I am trying to download a binary file from an AWS S3 bucket using Amazon's new command-line interface. However, the tool responds with an error message. $ aws s3 get-object --bucket myBucketName ...
0
votes
0answers
595 views

How can I move s3 objects >5gb from one bucket to another?

Objects larger than 5GB are supported with multi-part uploading. We have 5gb+ files in one bucket already that I'd like to move to another, under the same AWS account. When I issue the command using ...
-2
votes
1answer
191 views

Which is better - AWS S3 or EBS? [closed]

I am trying to create a system where users can upload their data (audio, text) which can run into around 200 MB per user. I am trying to figure out what is the best way to go ahead - using S3 or EBS. ...
0
votes
1answer
96 views

Empty /mnt: store-backed instance launch from EBS-backed AMI

I have an EBS AMI which I want to publish in AWS Market Place. The AMI was created with data in /mnt. The snapshop includes both /dev/sda1 and /dev/sdb devices : Block Devices: ...
0
votes
1answer
117 views

Copy files over to s3 from ec2 instance

I have an FTP running on my ec2 instance and I'll like to move over those files (after some processing) to s3. Lots of posts on this to either use the Amazon .NET, php or python APIs or use a 3rd ...
0
votes
1answer
138 views

What sort of delay is there between reading an Amazon S3 object from an EC3 instance

I have a REST web service that contains a /image/view/ resource that displays an image. The image is currently stored as an object in Amazon S3. When /image/view/ is accessed, the web service ...
0
votes
1answer
106 views

autoscale static content on ec2 using local cache

Hello Serverfault members. I want to achieve the following setup on EC2: A load balancer starts and stops instances which only serve static content. (a javascript based application) I do not want to ...
0
votes
0answers
231 views

Getting a simple list of changed files from unison

I have a filesystem that is changed on two servers and also needs to be replicated to Amazon S3. Until recently, syncing the filesystem between the two servers using Unison, and then copying to S3 ...
2
votes
2answers
2k views

Create an Amazon EC2 instance with automatic access to private S3

I was wondering. Say I have a file in a private S3 bucket, and I then deploy an EC2 instance which has something like that in its rc.local: GET http://privateamazons3url.com How can I make it so ...
0
votes
1answer
265 views

Mounting a S3 bucket across multiple instances

I want to use Amazon S3 to store all of my files for my websites. I can set S3QL up properly so that it is mounted on /var/www and everything works fine. I want to do it this way so that I can ...
0
votes
2answers
500 views

Mixed Static and dynamic content site using AWS S3 and EC2

We are installing a Java web application in a EC2 running Tomcat. The application uses a folder for users pictures (static content)-> www.example.com/PICTURES We use mod_jk to exclude Tomcat from ...
4
votes
1answer
108 views

Is Amazon s3 required if am using Cloudfront for files

I am planning to host a website in Amazon Ec2 instant. I got some basics from the docs. But I have few confusions. If am using cloudfront for CDN, do i really need to server files from s3? The site ...
0
votes
1answer
423 views

s3cmd put only files that do not exist in destination bucket

I've been using s3cmd to sync local files on our server with the S3 bucket. There are over 200,000 files on the local server. Can't seem to find any documentation on the site that explains how to ...
0
votes
1answer
304 views

Amazon AWS Store Wordpress uploads on S3

I'm getting ready to move my company's website and order management application to AWS. We use wordpress as the 'face' of our company. Our order management app is for internal use. I'm using Elastic ...
3
votes
1answer
1k views

Setting up CloudFront CDN on a cookieless root domain

I have recently set up an AWS S3 bucket for my site's static content, along w/ a CloudFront distribution for my CDN. I have this working using a sub-domain. However, after running YSlow, I realized ...