The amazon-s3 tag has no wiki summary.
0
votes
2answers
44 views
Any need to make backup of data on Amazon S3?
I'm hosting 200 GB of product images at S3 (this is my primary file host).
Do I need to back that data up somewhere else, or is S3 safe as it is?
I have been experimenting with mounting the S3 ...
0
votes
1answer
31 views
A uploaded file is 0 byte on Amazon S3 using django
I've symbolic linked a S3 directory on my EC2 server. But a uploaded file was 0 byte when I uploaded file. It was work well before (I used just web server directory)
I don't have any idea dealing ...
0
votes
0answers
12 views
Changes applied to certain php files not reflecting at runtime
Problem
Today, all of a sudden, we found that certain things in our LAMP based web application are not displaying results. So, just to debug the issue, we modified some files and found that applying ...
-2
votes
1answer
24 views
Monitoring Amazon s3 data transfer
I'm hosting a few files on Amazon s3. These are just images for my website. Lately the traffic to my website has been growing. I'd like to monitor my data transfer from s3. How can I do this?
I've ...
3
votes
2answers
25 views
Tracking down “Connection reset” errors in Linux
I'm handling large numbers of concurrent downloads (approx. 500 per server) using Java.
All the files are being downloaded from Amazon S3, and the downloading server is an EC2 m1.large instance.
...
1
vote
2answers
163 views
Is mounting S3 buckets directly into EC2 instances safe?
as the title of my question says, I would like to know whether this is a good practice or not,
I know I can mount it in an EC2 instance but I was wondering if, as I will be adding more instances to ...
0
votes
2answers
40 views
projects or packages to emulate a tape drive with a Amazon S3 or OpenStack Swift compatible backend?
I've got some data that is being backed up to tape via bacula, and at some point soon I am going to need to migrate to non-tape storage.
Bacula supports to-disk archiving, but it occurred to me that ...
0
votes
1answer
27 views
Does anyone have a config to process AWS CloudFront/S3 logs with AWStats (or similar sw)?
I don't want to give an external company like s3stat access to my logs. I know that AWS logs S3 and Cloud Front in a format readable by AWStats. Has anyone used AWSats to analyze them?
S3stat used ...
-1
votes
1answer
46 views
Which of snapshots I can safely remove?
If you make periodic snapshots of a volume, the snapshots are
incremental so that only the blocks on the device that have changed
since your last snapshot are incrementally saved in the new ...
-3
votes
0answers
58 views
Restricted S3 bucket [closed]
i need to construct IAM policy that restricts usage on S3 bucket so as to grant users privileges to just upload files and they can't even list files they uploaded in that bucket
Thanks in advance
0
votes
0answers
68 views
Moving to the cloud for product building and testing of large Java product that uses databases [closed]
I currently build and test a large Java product based on Eclipse an Ubuntu machine using Jenkins (Hudson) and tested on both Ubuntu and Windows, the testing also involves all of the major databases. I ...
0
votes
2answers
103 views
How to move files between two S3 buckets with minimum cost?
I have millions of files in a Amazon S3 bucket and I'd like to move these files to other buckets and folders with minimum cost or no cost if possible. All buckets are in the same zone.
How could I ...
0
votes
1answer
56 views
Is uploading a 500mb file to s3 an expensive operation? Any way to limit cpu usage etc?
On a production server, I'm planning on uploading a single file or a set of files that may be 500 megs in size.
I havent' test it just yet, but just want some opinions on whether you think this will ...
0
votes
0answers
32 views
PostgreSQL and S3QL for storing/accessing lots of data
We're currently using Postgres 9 on Amazon's EC2 and are very satisfied with the performance. Now we're looking at adding ~2TB of data to Postgres, which is larger than our EC2 small instance can ...
2
votes
2answers
152 views
Forcing CloudFront to pass-through the latest HTML file from S3
Background
I'm hosting a static site on S3, with CloudFront over the top. The issue I have is with my HTML files.
According to CloudFront's FAQ:
Amazon CloudFront uses these cache control ...
2
votes
2answers
122 views
Amazon EC2 - What's the point of having Instance storage if it is non-permanent and EBS provides a permanent store?
I'm specifically looking at the Standard Large On-Demand instance which has 850 GB of instance storage.
What I really don't understand is why have 850 GB of storage on the instance if that data will ...
-2
votes
3answers
117 views
amazon s3 vs amazon ec2 regarding cost, and which better for image hosting website? [closed]
I want to know which will cost more, s3 or ec2.
I need to know by example to estimate my future payments.
Also which of them will be better for an image hosting website?
2
votes
3answers
246 views
Uploading 200GB of files to S3
What's the best way to upload 200GB tar.gz files to S3 in Linux? On researching I found that S3 limit on objects has been increased to 5TB and came to know about the multi part upload mechanism to ...
2
votes
1answer
50 views
Using amazon S3 as storage for attachments in a web-mail system
I am looking to use S3 as data storage service for a mail system.
The idea is to allow users to upload files that serve as attachments to their emails, which are then available to download from the ...
1
vote
0answers
73 views
Protected bucket @ S3 - Access Denied
I'm trying to grant RW access to a given bucket to a specific user using the following bucket policy:
{
"Id": "Policy1322043790167",
"Statement": [
{
"Sid": "Stmt9999043784080",
...
2
votes
0answers
48 views
Web-based file manager like File Thingie, but for S3?
At work, we use a little PHP script called File Thingie, which is a web-based file manager. Basically, an FTP replacement. It allows users to upload and download files, and most importantly, it has a ...
1
vote
1answer
266 views
s3cmd fails too many times
It used to be my favorite backup transport agent but now I frequently get this result from s3cmd on the very same Ubuntu server/network:
root@server:/home/backups# s3cmd put bkup.tgz s3://mybucket/
...
0
votes
1answer
54 views
How to configure S3 or DNS to handle incomplete name (sans www) for web site?
I have a set up a bucket called "www.mydomainname.com" to host my website and I have configured the CNAME such that "www.mydomainname.com" points to the my endopint ...
0
votes
1answer
52 views
Running my own CDN alongside Amazons S3 for nearby visitors
I am running a blog on shared webhosting. The website itself is on the hosting, but my files right now are on Amazons S3 CDN. I have made a bucket lockated in the US, and I have setup a virtual host ...
0
votes
0answers
25 views
PHP copying files to s3 via s3fs - Files not public?
I'm copying files with PHP to AWS S3 via s3fs mounted drive.
However, I don't seem to be able to set the files to public. How does AWS S3 Public functionality work? Is it CHMOD'ing, because the files ...
1
vote
2answers
56 views
Cloud storage options for client downloads
I'm looking for a way to distribute sample files to clients.
Requirement is that it's (relatively) simple to upload files, a link can be sent to a client who can download the file with a browser, the ...
1
vote
0answers
23 views
Integrate Amazon S3 files to web file manager
Is it possible to integrate Amazon s3 files to asp.net izwebfilemanager or any other file managers and how?
1
vote
1answer
179 views
Backing up AFP Shares from my FreeNAS server
I have chosen to use Amazon S3 to back up my AFP shares from my FreeNAS server. What is the best / most efficient (automated) way in which to get my data from the AFP shares to Amazon S3. I have ...
1
vote
4answers
120 views
Best practice for synchronizing sources across servers (Amazon EC2)
I'm moving from single app server to load balanced config.
In the single server config I synchronized the sources by S3 cmd sync s3 every few minutes and on hostup (Scalr event) I sync the sources ...
5
votes
2answers
360 views
EC2 - Shared Storage - S3FS or EBS?
Building my web service onto EC2 right now and have a single instance behind a load balancer. I will of course cater for multiple instances.
My initial idea was to run all the instances a dumb ...
0
votes
1answer
91 views
Mounting an S3 bucket onto a AWS Ubuntu instance issues
i'm using s3fuse to mount an s3 bucket onto ubuntu, so that i can take advantage of the storage space.
here are some environment info:
System Info:
Linux ip-xxx-xxx-xxx-xxx 2.6.38-8-virtual ...
0
votes
1answer
72 views
Writing to an s3 mounted directory
hopefully someone can advise.
I've recently mounted an s3 bucket to a directory /s3 on my ubuntu amazon ec2 instance -following: http://code.google.com/p/s3fs/wiki/FuseOverAmazon. This was set up in ...
0
votes
0answers
15 views
How can one write a custom certificate verification logic on Amazon S3?
From the developer guide:
When using virtual hosted-style buckets with SSL, the SSL wild card
certificate only matches buckets that do not contain periods. To work
around this, use HTTP or ...
1
vote
1answer
58 views
Hosting animated GIF banners on S3
I have uploaded some animated GIF banners to our S3 account and when we use the web url provided by S3 and try to view the banners in a browser, instead of display the banners in the browsers, I get ...
0
votes
1answer
73 views
Alternative storage for SVN backup with rsync
I've been backing up my SVN repo and trac environment using a weekly cron job and 2 custom scripts. This has been going to Joyent Strongspace; but since they have discontinued the service, I need an ...
0
votes
1answer
45 views
Restricting console permissions in IAM for S3
I want to be able to allow users created through IAM to be able to view one bucket in the management console. Furthermore, I want to restrict it to a folder within the bucket, such that the ...
1
vote
1answer
79 views
Cname and Amazon S3 failure
I had a quick question. If you set up a cname for your amazon bucket and lets say your main amazon s3 bucket goes down, does cname you created serve files, in other words, do your files get redirected ...
3
votes
0answers
49 views
S3 based file system capable of requesting only part of file
I'm storing large datasets in s3, but on a given computer in my cluster, my program only needs to read a small subset of the data.
I first tried s3fs, but it downlooads the entire file first, which ...
1
vote
2answers
87 views
How can I secure files on S3?
I want to control who can download a file via an app (as if it was held on the local FS). What's the right approach for doing this, considering S3 can't be mounted as a POSIX compliant file system?
0
votes
2answers
124 views
Best practice for storing read-only instance data?
So, i'm currently writing my bachelor thesis and my job is to cloudify a webservice which recommends a soundtrack for images. The main part of the recommendation process is a lookup on a ~40gb index ...
1
vote
1answer
40 views
Uploading to Amazon S3 from web link
I have huge amount of files on my old host... I would like to move all files to Amazon S3 since it seems very cheap. My internet connection at home is very slow, so I can't download them and upload it ...
1
vote
1answer
97 views
Change Amazon S3 storage class on A LOT of files
We are using Amazon S3 and a great deal of our files have the STANDARD storage class. We want to change this to REDUCED_REDUNDANCY class to save the extra money.
However, is has been hard to find a ...
3
votes
2answers
174 views
Webstats for large Amazon S3/Cloudfront logs?
I'm trying to find a way to parse our Amazon S3 access logs to get some webstats.
I've been trying to use AWStats 7, but I got to the point of where after day 9 of a given month it can't process any ...
2
votes
3answers
85 views
Bandwidth-friendly backup strategy using tar?
We've used tar to backup and compress (gzip) selected directories on our file server with very good results until recently.
Each and every one of our backups are stored on mirrored (RAID) harddrives ...
1
vote
1answer
87 views
S3 Instead of NFS to Host H.A. Website on AWS
I've been looking at creating a highly available setup with EC2. It would involve several web server nodes acting as front-ends to multiple NFS and database serves (backends). Ideally, the platform ...
2
votes
1answer
49 views
Restrict audio file access by domain on S3 and/or Apache
We has some proprietary audio files we are streaming via html5. These files sit in an Amazon S3 bucket.
The audio files have special high and low pass filters and other scientific alterations and ...
2
votes
2answers
183 views
Can you restore a MySQL dump file from an S3 bucket to an RDS instance?
I'm investigating running regular MySQL dumps to an S3 bucket as part of a disaster recovery strategy (partly spurred by the current zero cost of inbound data transfer!). In the event of a disaster, I ...
0
votes
1answer
47 views
Some users can't see my amazon s3 hosted images [closed]
I have a quite bizzare problem, some users have problems seeing photos that i host on s3. this is not browser related - when they try different browsers they still have the same problem.
for example, ...
1
vote
0answers
51 views
Amazon S3 Set Expires header
Is there any way to tell Amazon S3 that all existing and future files in some bucket should have some speicific Expires header?
1
vote
1answer
21 views
Amazon S3 preprocess request
Is there any way to preprocess Amazon S3 request by executing some logic in some programming logic (e. g. if I need to restrict access to resources by some dynamic condition)?
