This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

0
votes
0answers
6 views

Read Files from S3FS mount with PHP

We have a S3 bucket we use for video uploading. I also have a script for accessing the Youtube API so I can pull the upload files from a server rather than via the Web interface. This used to work ...
1
vote
2answers
65 views

Is Amazon S3 versioning really a reasonable backup options?

I am in the process of moving my web apps project storage to S3 and I am wondering if S3 versioning is really a good way to handle backups of the data or is there some better way? If the files were ...
0
votes
1answer
20 views

Access s3 bucket from Ec2 service

I'm new to AWS and was looking for a bucket policy to enable my ec2 servers access to the S3 buckets on the same account. I tried using this policy which enables the account: { "Sid": ...
0
votes
1answer
19 views

Rsync to AWS S3 bucket

For a server I am hosting a website on I want to backup the data and settings to an S3 bucket. I found out that you can't directly use rsync to backup to an S3 bucket. Is there another way to achieve ...
0
votes
1answer
28 views

Prevent Alias From Converting Domain Name in Browser Address Field

I'm using Amazon Web Services. I've set up my domain name in Route 53, set up static website hosting in S3, and I've successfully mapped the domain name to the S3 bucket using a DNS ALIAS record set. ...
0
votes
0answers
16 views

When s3cmd checks a bucket with thousands of files to sync it, does this count as one list request or thousands?

Trying to figure out pricing here so I don't get overcharged. I daily run a backup script where s3cmd checks a folder with over one hundred thousand files to see if any have changed (which by the way, ...
0
votes
0answers
12 views

Is there any way to restore an entire previous version of a folder in an s3 bucket?

I know folders are not folders within S3, but it would be extremely useful if you could restore a previous version of one when you have versioning enabled. I've been looking at it and I can only see ...
5
votes
3answers
38 views

Can I simulate an S3 bucket going down when it is accessible to root user?

I'm trying to test new network monitoring code for an application that runs on a Debian appliance. I am currently tasked with ensuring that an SNMP trap is thrown when external network shares (such as ...
0
votes
1answer
24 views

Is there any way to transfer S3 data between AWS locations and not be charged?

We need to transfer our São Paulo buckets to US East so we can make use of glacier. Those buckets have more than 4Tb each. We moved the first using AWS API using an instance at US East to send those ...
0
votes
1answer
14 views

Create AWS S3 bucket upload policy

I want to be able to let AWS upload billing CSV to S3. This requires an IAM policy. I have one IAM user that I gave AmazonS3FullAccess. In the bucket properties I can add a policy. Then a policy ...
0
votes
1answer
22 views

Are name servers enough to point a domain to an S3 bucket host?

I recently bought three domains via some site, planning on pointing them to an S3 bucket. The first one I succeeded in doing so, because I added both name servers, an A record, and a CNAME for the ...
0
votes
0answers
32 views

How to add AWS ELB access logs to logstash with S3 input?

I'm using an ELK stack for server monitoring. My application's access logs which are from AWS ELB are stored in AWS S3. I am trying to add them to logstash with the following input: input { s3 { ...
0
votes
0answers
18 views

Are blocked requests by S3 CORS billable?

I'm getting a large amount of POST requests to my S3 bucket. Ideally I'd like to block them all, so I've been looking into CORS. If a request is being blocked by the CORS policy, do I still pay for ...
0
votes
0answers
19 views

Is there a Policy template standard for secure S3 access?

I've created a policy below which restricts SSL access, and requires SSE. Is there a 'standard' policy template recommended by long time AWS S3 devs for locking down S3 buckets that is commonly ...
-1
votes
1answer
14 views

Amazon S3: encryption speed and keys

I have couple theoretical questions about Amazon S3 I need to encrypt all my files. What encryption speed Amazon provide for S3? After encryption Amazon gives my key for file (or files package), it ...
0
votes
0answers
14 views

How to make amazon s3 files fast from anywhere in the planet?

I'm working on a project with user created content, users basically upload long mp3 files to the server which can then be played by other users. Recently users not from europe reported slow "seek ...
0
votes
0answers
15 views

Move S3 bucket to another region [duplicate]

I want to move a S3 bucket from Tokyo to Seoul, and I don't want to re-create it. Is there any way doing this? (Move region without deleting and recreating) If not, what should I keep in mind? I ...
0
votes
0answers
20 views

Force hadoop to use for S3 connection

I'm trying to upload file to S3 using hadoop: hadoop fs -Dfs.s3a.connection.ssl.enabled=false -Dfs.s3a.proxy.host=127.0.0.1 -Dfs.s3a.proxy.port=8123 -put pig_1421167148680.log ...
0
votes
1answer
8 views

Differentiating between volume, snapshot and understanding Stop

I am not very clear in the difference between a Volume and a Snapshot. When a new instance is created, it automatically creates a snapshotID like snap-ad8e61t8 in Volume under Elastic Block Store but ...
3
votes
1answer
38 views

AWS Windows EC2 instance: daily EBS snapshot without downtime

I have one "Windows Server 2008" instance on "Amazon AWS EC2" with two "EBS-volumes" attached: D:\, E:\. I want to schedule a daily snapshot of only D:\ "EBS-volume" to "s3 bucket" so that we have ...
0
votes
1answer
36 views

What is the benefit of VPC Endpoints on AWS?

I learned a long time ago that if you want an EC2 instance to be able to talk to AWS services like SQS, Kinesis and the like, the instance has to either have a public IP address or there needs to be ...
0
votes
0answers
22 views

How to get nginx host variable to work with proxy_pass

I am trying to setup an nginx proxy in front of any s3 website that I point at it. In the example below I have my DNS records customsite.com pointing to my proxy. When I don't use any variable for the ...
0
votes
0answers
21 views

Jenkins aws elastic deployment plugin just create a new ec2 on each update

Here is something strange happening when I tries to deploy from Jenkins to Elastic Beanstalk , you can check my previous question for more clarity. ...
1
vote
1answer
48 views

Limiting bandwidth of the of Amazon aws s3 uploads

I'm currently having daily backups of my files on uploaded to S3 bucket using aws s3 mv command, i.e.: aws s3 mv $webroot/backups/db/ s3://my-backups/$date/db Everything works, except that recently ...
0
votes
0answers
40 views

S3FS and Fuse, scale out or scale up

I have an infra where I have multiple machines (eg FTP servers, get/put and Samba/NFS servers) that need to share out the same (HA) storage. So I figured to use s3fs and fuse. I got this all setup and ...
0
votes
1answer
79 views

Why are some big corporations still worried about cloud security? [closed]

My company sells an app subscription, which is hosted as SAAS on Amazon Cloud. I have had a few clients who weren't very keen on uploading their documents to my product because my product is hosted ...
1
vote
1answer
44 views

How to parse s3 logs?

I've been trying to parse AWS S3 logs following the documentation, but I've been running into some problems. Specifically, I keep running into new, rare log lines that break my regex. Every time this ...
1
vote
0answers
58 views

How to upload a large file using aws commandline when connection may be unreliable?

I've been having trouble uploading a large (800MB) file to s3, using the aws commandline tool. The first attempt completed (after many hours) but was not visible, and I was advised (here) that it has ...
0
votes
1answer
30 views

Amazon S3 putObject bucket policy

I am trying to create a User who only has access to PutObject to an S3 bucket called "desking". In IAM I have created a User, and applied this policy: { "Version": "2012-10-17", "Statement": ...
1
vote
1answer
106 views

Why can my IAM user create a bucket but not upload to it?

UPDATE: everything works fine the next day!?! So I think the answer might be that you have to wait some period of time, either after creating a new IAM user, or after creating a new bucket, before ...
0
votes
2answers
97 views

Sender address rejected: Domain not found - after Route 53 (Amazon AWS) changes

We had been getting these messages when customers try sending us emails. This is an automatically generated Delivery Status Notification THIS IS A WARNING MESSAGE ONLY. YOU DO NOT NEED ...
1
vote
0answers
66 views

aws s3 sync: how to exclude proc, sys directories

I can't seem to get the aws sync s3 command to exclude directories. I am backing up a mounted filesystem from OpenVZ which is located at /vz/root/100. My command is: aws s3 sync /vz/root/100 ...
0
votes
1answer
33 views

Cannot copy files from EC2 in VPC to S3 with EC2 role

From an EC2 instance running within a VPC I am in need of accessing an S3 bucket with awscli for copying files from EC2 to S3. I succesfully created an endpoint with an attached custom policy built ...
5
votes
1answer
121 views

Cant connect to S3 with nginx

im trying to serve static and media files from amazon S3 bucket but nginx cant connect to it Here is the error i get <Error> <Code>AccessDenied</Code> <Message> AWS ...
-1
votes
1answer
28 views

Can you target the logs from an S3 bucket to an S3 bucket in another account?

If I have an S3 bucket in account A that I'd like to turn logging on for I have to select a bucket for the logs to be written to. Is it possible to set permissions such that I can select a bucket in ...
1
vote
0answers
365 views

AWS CLI throws “Unable to locate credentials”, the second time it's run

I'm trying to download some files from S3 to an EC2 instance using the AWS CLI (1.8.7) on startup using a User-Data Script. This instance has a IAM Role & Instance Profile with the appropriate ...
0
votes
0answers
44 views

ERROR — : Response was: 307 — Temporary Redirect when trying to upload to bucket

I get 307 when uploading to a bucket with Amazon's Ruby gem (2.10.2). Another bucket works fine (both were created today). I checked the name and I didn't misspell it. What is causing the error?
1
vote
1answer
66 views

Route 53 configuration for Cloudfront distribution linked to S3 bucket for naked domain

I am using route 53 for a domain (example.com) linked to my app on Heroku. To handle naked domain redirection, I am using a S3 bucket as explained here: ...
0
votes
0answers
47 views

How to use Amazon S3 Ceph Interface on Windows

I have 4 ceph nodes running on virtual machines in our corporate network. I've installed a ceph object gateway on admin node. Can I somehow use it in Amazon S3 style from my windows machine in the ...
0
votes
1answer
102 views

Serving a S3 static website from a naked domain, without migrating to AWS Route53

I'm working on a site that I'd like to serve from a naked domain like foo.com, and serve it from AWS S3'. However, the documentation I can find with AWS gave me the impression that if I want to do ...
0
votes
0answers
78 views

Amazon S3 upload error: An exception occurred while uploading parts to a multipart upload

I am trying to upload a 30 GB file to Amazon S3 using the AWS PHP SDK. require('../vendor/autoload.php'); $client = new Aws\S3\S3Client([ 'version' => 'latest', 'region' => 'us-east-1' ]); ...
0
votes
2answers
57 views

Recursively changing the content-type for files of a given extension on Amazon S3

I have a large S3 bucket with a nested "folder" structure containing (among other things) static .json and .md files. Theses files are being served by S3 as text/plain rather than the correct ...
0
votes
0answers
47 views

How Do I Mask the CDN Domain with My Own Domain Name?

So i've been trying out cloudfront from AWS. Why is the URL 'example.com' resolving to 'example.com.s3.eu-west-1.amazonaws.com' in the Address Bar? I've tried googling loads of questions with this ...
1
vote
1answer
109 views

Deploy to Elastic Beanstalk from S3 gives “You do not have permission” — who is “You”?

I'm testing out AWS and Elastic Beanstalk and have Beanstalk running a version that was manually uploaded. When I try to update the version via the command line, the command line returns ok but ...
0
votes
1answer
160 views

AWS - Map URL to API Backend (Apache ProxyPass Like)

I have a web architecture using Apache as front-end and Nodejs as back-end. I want to migrate this architecture to AWS. Node.js is going to be an Elastic Beanstalk and Apache will be stored on Amazon ...
1
vote
1answer
42 views

How to move all files in a folder to s3, and delete local files?

and I think I can use aws s3 sync . s3://s3bucket But I'm not sure where to put the --delete Also I want to run this command from time to time to push all new files in my local folders to s3 ...
2
votes
1answer
59 views

How to secure the db dump taken from daily run script

In one of my mysql slave servers I have written a daily run script, which 1) stops slave, 2) takes a db dump, 3) starts slave again, 4) encrypts it, 5) copies it to my s3-bucket. I am using aws-cli ...
0
votes
1answer
571 views

Change nginx HTTP status code when using proxy_pass

I have the following scenario: a nginx serving static files to clients. For a request, the file is searched for in a local directory and, if not found, the request is forwarded to Amazon S3 via a ...
8
votes
2answers
787 views

Access Amazon S3 Static Website Through IPv6

I host a static website on Amazon S3 with DNS hosted on Amazon Route 53. I'd like my site to be accessible via IPv4 and IPv6 (because it's about time). When I use the Route 53 AWS Management Console ...
6
votes
3answers
96 views

Likely causes of NTPD dying unexpectedly and solutions

On a web application which uses s3 for physical document storage, we are experiencing issues with NTP continuously dying. This seems to happen roughly once or twice a day. There is very little ...