This is for questions on Amazon's cloud storage service.

learn more… | top users | synonyms (1)

0
votes
1answer
12 views

How to disable Last-Modified and ETag headers in a static website hosted on S3 + CloudFront?

Background: there are good reasons to want to disable Last-Modified and ETag headers for some website assets: to prevent browsers sending conditional requests (either using If-Modified-Since or If-...
0
votes
0answers
9 views

Is there an S3 storage backend for varnish cache?

I want to run varnish cache in a docker container on AWS ECS. If the container dies and a new one takes its place the new one should have easy immediate access to the the cached data so it can ...
0
votes
0answers
17 views

Secure Storage Requirements in the Cloud [on hold]

I'm trying to understand some low-level security requirements for a cloud based secure storage solution. Specifically, I'm interested in the following: What mode of encryption (and integrity ...
-1
votes
1answer
20 views

Accessing the logs from s3 bucket using logstash

Does accessing the logs from s3 bucket in logstash.conf file would change logs in the s3 bucket? Actually, I don't want it to alter actual logs in the s3 bucket as it is important for my organization. ...
-2
votes
0answers
9 views

How can I get the size of the folder inside an Amazon S3 bucket using php? [closed]

The below code is to get the size of S3 bucket.But how can I get the size of the folder inside an Amazon S3 bucket using PHP? require_once 's3.php'; $s3=new S3('**********','********************'); ...
1
vote
1answer
39 views

Best manner to access files in S3 Bucket from EC2 instance

I have tried several packages (goofys, s3fs, fuse) and have not been able to find a solution to my problem. I have an S3 Bucket with several thousand files currently in it and will continue to grow. ...
0
votes
1answer
29 views

Logstash S3 input plugin re-scanning all bucket objects

I am using the Logstash S3 Input plugin to process S3 access logs. The access logs are all stored in a single bucket, and there are thousands of them. I have set up the plugin to only include S3 ...
0
votes
0answers
14 views

Access denied for sub-paths on CloudFront

I have a distribution on Cloudfront that use a S3 bucket. The first page works but not he sub-paths. For example, when I go to 'www.example.com' it works but not 'www.example.com/admin'. I always ...
0
votes
2answers
58 views

What is the most efficient way to transfer files from AWS S3 to S3?

I have a large number of files stored in an AWS S3 bucket. I need to get those files to another S3 bucket owned by another user and in a different region. The files are stored in different locations ...
0
votes
0answers
20 views

list s3 object permissions via SDK / CLI / API?

I want to check which objects in the bucket are public available. I can run $s3->listObjectsV2 successfully, but I do not see any permissions here at all. What am I doing wrong? Also, I'd like to ...
0
votes
1answer
30 views

How to use one website with several amazon S3 buckets as a path suffixes?

I would like to host multiple S3 Amazon buckets under one site in next way: Access to bucket1 - http://example.com/bucket1(bucket2...) and so on. What now Amazon allows is access with links like http:/...
0
votes
1answer
71 views

Amazon route 53 + cloudfront + s3 -> with angularjs2 app in ec2

I am really confused about the setup I need for my angularjs2 app. It's simply a SPA application with html5 mode urls and all I want is: requests to www.mydomain.com/blabla... will be redirected ...
0
votes
0answers
41 views

Permission issue in Riofs and Fuse with non root users

I am using fuse with riofs to mount local directory to s3 bucket. Below is the command I am running on the server. sudo /usr/local/bin/riofs -v -c /root/.config/riofs/riofs.conf.xml -l /var/log/...
1
vote
0answers
33 views

S3/Cloudfront CORS working on some files only

I'm really struggling to get Cloudfront and S3 to add Access-Control-Allow-Origin: * to the headers of video files stored on S3 (for inline video on iPhones - seems to be working everywhere else ...
0
votes
2answers
47 views

AWS - Symlink directory in EC2 to S3 bucket

I would like to create "infinite" directory in terms of storage in an EC2 instance. Is it possible to symlink directories to S3 bucket? I did not find any solution in the Internet, maybe somebody ...
0
votes
1answer
23 views

how to map my app to my domain in AWS

I am very new to AWS. I have a java app which runs in AWS instance and I am able to run that using following myIp:8080/myApp Also I have my domain (mydomain.com) registered with S3bucket, Now this ...
0
votes
1answer
42 views

Is it possible to do database replication on aws s3

I have 4TB database in company. As many different analytics require that full data the current database is not able to handle concurrent session from 100s of users. Is it possible to have databse ...
1
vote
1answer
60 views

AWS CloudFront Default Root Object and subdirectories

I'm hosting a Jekyll blog on S3 and CloudFront. Setting the default document on S3 works fine and all sub folders natively go to index.html. On my CloudFront distribution, I have set the Default Root ...
0
votes
0answers
9 views

AmazonS3 Exception in Windows Vista

I got an app that access and query data from AWS s3, it works fine in pcs with Win7, 8.1 and 10 (with NetFramework 4 or 4.5) But it fails when i run the same app in a PC with Windows Vista, it throws ...
0
votes
0answers
32 views

Is not authorized to perform an operation while I have the full access of an aws service

I have created a simple nodejs script to handle the files in S3, and I want it to be executed on lambda. My admin has added me in IAM with full access to lambda and S3. However, when I select the "S3 ...
1
vote
1answer
39 views

What is the right way to back up google authenticator emergency keys?

I'm implementing Google 2-Factor Authentication on some servers in my company. When configuring Google 2FA on client computers, 5 emergency codes are generated to be used if a user forgets his master ...
1
vote
1answer
42 views

Encrypt on jenkins or S3 and decrypt on EC2 instance

I want to automate the deployment of new code on my application using AWS CodeDeploy. I'm using AWS to run my application. What I want to do is the following: Build the application in jenkins (runs ...
2
votes
1answer
78 views

What's the fastest way of getting data into an AWS Lambda?

I have something I'll call a "microservice" running on AWS Lambda (using node.js). Basically it serves up condensed summaries drawn from a few hundred megabytes of binary blob. There are a lot of ...
0
votes
0answers
29 views

Does CloudFront support S3 signature version 4 for KMS encrypted objects?

I'm using Cloudfront with an S3 origin that is using KMS to encrypt objects. I'm getting the following error when sending a GET request for an object in the S3 bucket. Requests specifying Server ...
0
votes
1answer
32 views

Using a Gandi domain and a cloudfront default cert, how can I set up my CNAME records so that https works?

I have a website (www.foo.com), registered with Gandi. I have a static page on Amazon S3 (let's say s3.foo.us-west.com). I also have a Cloudfront distribution (foo.cloudfront.net). Originally, my ...
0
votes
0answers
38 views

Redirect one root domain to another all on AWS Route 53 / S3

Folks. I have been trying to configure a new domain I just bought to redirect to one I have successfully running on AWS Route 53, but cannot make this work. I am somewhat of a novice and have tried ...
1
vote
1answer
49 views

Confusion about Amazon EC2 and S3

Planning to host a PHP website with MySQL DB in Amazon Web Services, which AWS components should I choose? The website is just a dynamic website with a custom CMS, though a large amount of data are ...
1
vote
1answer
54 views

s3cmd error on sync: S3 error: 400 (InvalidRequest)

I'm trying to configure s3cmd to backup some directories on my server to my AWS S3 bucket. My problem is that when I do the sync command: s3cmd sync -r -p --no-delete-removed /path/to/dir s3://...
0
votes
2answers
23 views

How to take EBS Volume snapshot and store to S3 Reduced Redundancy?

By default, EBS Volume snapshots on AWS are stored to S3 Standard storage. I would like to figure out how to direct those snapshots to Reduced Redundancy storage instead. I've been trudging through ...
0
votes
1answer
23 views

restore backup files in another server using duplicity

I am using duplicity to backup the application files with gpg key to Amazon service S3 server. And then restore the same from S3 to own server. I want to restore the backed up files to another ...
0
votes
0answers
52 views

Reverse Proxy on cloudfront

I have an angular site / web application (Lets call this www.mysite.com) hosted on Amazon S3 as a static website. This s3 bucket serves as the origin for a cloudfront distribution and it works ...
0
votes
1answer
45 views

How to suppress file output from aws s3 ls?

I am using the aws cli to summarize the number of files and the total size of an s3 bucket using the following command (documentation): aws s3 ls s3://mybucket --recursive --human-readable --...
1
vote
0answers
27 views

fast backup script in linux

I have a server with more applications and do normal shell command to take backups. it took couple of days to complete. Tried to install duplicity. but its told some packages are not found. its Debian ...
3
votes
1answer
230 views

Cache-Control not working in AWS S3 object Metadata

Follow-up to my original question: No Cache-Control Header for files from AWS CloudFront with S3 Origin Im serving up static files using AWS CloudFront with AWS S3 as the origin. I tried to set the ...
1
vote
1answer
216 views

No Cache-Control Header for files from AWS CloudFront with S3 Origin

We just migrated to Amazon AWS. We currently have an EC2 instance that's working well. It's running Nginx in front and Apache in the back-end. That's running well also. All sites are launched properly ...
2
votes
3answers
51 views

how does AWS S3 bucket Redundant storage works with filepicker/filestack

I am using Filestack https://www.filestack.com/ as fileserver and Amazon S3 as filestorage as complete storage solution for my clients. Filestack offers CDN (Content Delivery Network) which serves ...
0
votes
0answers
16 views

Enabling S3 bucket as website using cli

I figured out how to create an S3 bucket using aws command line. Is it possible to enable the s3 bucket I created as website using aws cli? The reason I'm doing this is because we're automating ...
0
votes
1answer
43 views

s3cmd restore recursive not working right

I am running the following command to restore the data from Amazon S3 to the web server. s3cmd restore --recursive s3://my-bucket/Weekly-Sunday/dbexports/ and getting this error: Restore is not ...
1
vote
1answer
74 views

Access S3 bucket from my EC2 instance using CF::Init via IAM role not working

I have a CloudFormation template I'm using to set up an ECS cluster and I am trying to drop some config files onto the box using CloudFormation::Init on the ASG and pulling them out of S3. "...
0
votes
0answers
16 views

AWS S3 “service user” for non-AWS server?

I'm setting up a server outside of AWS, but I'd like it to read and write from one of my AWS S3 buckets. I know that within AWS, best practice is to assign a role with S3 read/write permission to the ...
0
votes
2answers
57 views

CNAME to S3 returns the S3 URL

I've setup a static website on S3 under a www.mydomain.com bucket. I also created a CNAME record for it in Namecheap looking like this: Type: CNAME Record Host: www Value: www.mydomain.com.s3-...
0
votes
1answer
54 views

How to edit response header of Amazon s3

http://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/ServingCompressedFiles.html According to the above doc, for cloud-front to gzip compress files it receives from origin, the response ...
0
votes
2answers
73 views

How to backup to s3 as rsync

I want to backup my server to s3, but I don't want to upload the entire container every time. Right now I use s3cmd put --recursive, but that uploads everything, and I don't want to waste space and ...
2
votes
2answers
73 views

Any way to enable Amazon S3 Versioning for existing objects?

All the information that I have read on the AWS S3 Object Versioning specifically mentions this: Objects stored in your bucket before you set the versioning state have a version ID of null. When ...
1
vote
1answer
271 views

Nginx reverse proxy causing file downloads to take excessive time to start

Overview My web app allows users to upload files which are stored on s3 via my servers. When a user requests a file my web server retrieves it from s3 then sends it on to the client. I recently ...
0
votes
0answers
50 views

AWS CLI copy life-cycle configuration between buckets

I am trying to read-modify-write an existing life-cycle configuration. So the simpler thing I am staring out with is copying a life-cycle configuration between buckets. From reading through the ...
0
votes
0answers
14 views

Google Storage Sync from Amazon S3 is not running

I setup a new Google Storage bucket, then added the username and password from the S3 permissions, including the correct policy as instructed on Amazon S3 and then scheduled the sync for 3 hours in ...
1
vote
0answers
31 views

Is there a way to get the size of Amzon S3 bucket from S3 console?

I wonder if there is some way to get the size of Amazon S3 bucket directly from console https://console.aws.amazon.com/s3/ Clicking properties returns great deal of information, but not the size of ...
1
vote
0answers
54 views

Bucket policy that respects pre-signed URLs OR IP Address deny?

I would like to be able to restrict access to files in a S3 bucket in multiple ways. This is due to the fact that the files stored can be accessed in different manners. We do this because we have TBs ...
2
votes
2answers
106 views

Amazon Lambda for video and image processing?

The service I am building the architecture for has a video processing part in it. Basically, some people can upload videos (stored in S3) that will be split into frames with high resolution. From ...