Questions tagged [amazon-s3]
This is for questions on Amazon's cloud storage service.
3
votes
2answers
20 views
AWS Opsworks Chef deployment using S3 Archive without making archive public
I'm trying to use the S3 Archive method to do a Chef deployment in Opsworks. I put the Chef archive in S3 and copied the address of https://s3.us-east-2.amazonaws.com/redacted/redacted.tar.gz. I gave ...
0
votes
0answers
17 views
Cloudfront (w/ S3) Static Website Doesn't utilize index.html from sub directories
I have my website hosted on S3 with CloudFront as a CDN, and I need these two URLs to behave the same and to serve the index.html file within the directory:
example.com/directory
example.com/...
0
votes
0answers
9 views
pushStates / S3 : refreshing the page
I have a SPA (Single Page Application) exposed on a S3 server on which I have no control.
It has its (front) routing based on history pushstates in html5 mode.
Everything is in an "index.html" page.
...
0
votes
1answer
33 views
How can I create Cloudtrail trail to log events of only a specific user/resource
How can we monitor API usage only a specific user in Amazon-Web-Services.
I tried creating Cloudtrail trail but it logs events of all users' all activity to the s3 bucket I configured to log it to.
I ...
1
vote
1answer
44 views
AWS file strategy when reading large files that don't change often
We have a web (Rails) application where a small number of somewhat large (1 - 10MB) business logic files can be uploaded by administrators. The content files will not change frequently, maybe once a ...
0
votes
0answers
67 views
How to see folders and files in s3 by directory listing?
I have a s3 bucket link (foldername.s3.amazonaws.com). This is not my bucket.
I want to download some files from this bucket. When I go to this address I see the files and folders in XML format. How ...
0
votes
3answers
32 views
How to automatically archive AWS S3 whole buckets to S3 Glacier?
I'm required to archive around 200 AWS S3 buckets to S3 Glacier and I would like to do it automatically but I can't find how it can be done with aws-cli.
The only method I found, is through AWS UI... ...
-1
votes
0answers
12 views
Interacting with DigitalOcean Space from cyberduck or mountainduck
Whenever I create a file it's default permission is "private" and the default content-type is application/octet-stream.
How can I make an s3 bucket behave more like a proper FTP server? One where the ...
0
votes
0answers
19 views
Configure subdomain to point to AWS S3 [duplicate]
I have a domain www.test.com which points to a website which was created using WIX. Hence, the nameserver in my www.test.com (GoDaddy is the registrar, so I can edit my nameserver at https://dcc....
1
vote
1answer
35 views
Clever way to reduce rsync/rclone load with backups to Amazon S3?
I started running rclone to keep a set of files on my laptop that are synced up to the cloud and encrypted. I wanted to 'control' the encryption because of trust issues. Rclone does this pretty well, ...
0
votes
1answer
598 views
Amazon EC2 - launch jar from S3
My java application is configured on an AMI image (so that I can use Auto Scaling Groups). I want to have the ability to update the app, and as existing AMIs cannot be updated, I would set my launch ...
0
votes
0answers
24 views
possible for ec2 to have cross account bucket access without using iam user?
Currently I have an ec2 which accesses my own s3 bucket using role instead of iam user as I am trying to get ride of using the keys.
I have googled around and see some cross-account bucket access but ...
3
votes
1answer
59 views
How to make objects uploaded to S3 bucket readable without explicitly setting their permissions
I want to make objects uploaded to S3 bucket readable without explicitly setting their permissions.
Relevant discussion I found about Digital Ocean S3 is here.
As in the above and other discussions, ...
0
votes
1answer
30 views
Redirect with CloudFront but changing URL
I have an S3 static website and I want to redirect all the requests to the index page. So if you go to mysite.com/this_doesnt_exist it should redirect to mysite.com.
I was able to configure this ...
0
votes
1answer
16 views
Wildfly Cluster w/S3 Ping and IAM Instance Role?
I've successfully managed to deploy a Wildfly cluster in AWS, using the jGroups S3_Ping functionality rather than the normal broadcast method. However, all of the documentation I've seen requires me ...
2
votes
1answer
37 views
Serving backup/fail-safe object on AWS S3
What would be the easiest way to serve backup/fail-safe object when the originally requested object is not available in the bucket?
For example, currently our users can upload custom profile photos ...
0
votes
0answers
32 views
Nexus repository multipart upload for AWS s3 blob storage
I am trying to upload objects to nexus, using AWS S3 as a blob store, which are more than 5GB of size. This results in this Nexus error seen from the log:
com.amazonaws.services.s3.model....
2
votes
1answer
72 views
AWS S3 Static hosting - How to debug connection timeout?
I am following the Setting up a Static Website Using a Custom Domain tutorial to the letter but something doesn't work and I don't know how to debug it.
Custom domain bought on Namecheap: sankey.app
...
-1
votes
0answers
59 views
AWS S3 keep throwing 403 forbidden on Font awesome 5 web fonts files
I'm using Font awesome 5 in my application. Every time running "eb deploy", Font awesome icons show up with squares and throw 403 forbidden on the console. To fix that, I make the web fonts files ...
1
vote
3answers
124 views
How can you use Amazon S3 or S3-compatible Storage as NFS?
How can you use Amazon S3 or S3-compatible Storage as NFS?
Is there a way to achieve this?
Something that can be accessed through an external network (internet, public) using NFS protocol.
1
vote
2answers
54 views
Reverting S3 BucketPolicy
I was playing around with AWS S3 BucketPolicy. My intention was to allow access to bucket only to my username. I wrote following incorrect policy:
{
"Id": "Policy1542608345364",
"Version": "2012-...
0
votes
1answer
43 views
Cyberduck CLI: uploading public file to DigitalOcean Space/Amazon S3
I am trying to upload a file to DigitalOcean space with Cyberduck CLI https://duck.sh/ from Windows 10 box like that:
duck --upload digitalocean-ams3://myspace/dir/ test.txt
This works, but the ...
3
votes
2answers
60 views
Restrict access to S3 bucket folders to specific website users? (not using IAM Users)
I have a website where users need to log in. They can upload and delete their own pictures BUT these pictures are supposed to be private so images are not set to public that anyone can view.
I know ...
1
vote
1answer
33 views
Why does NGINX rewrite my url when I don't have a trailing slash? (url should not be rewritten)
I am trying to get a route such as example.com/misc/page to go to the same place as example.com/misc/page/. The route /misc goes to an s3 bucket that contains a bunch of other static pages that I am ...
3
votes
2answers
161 views
How to create an OFFLINE Incremental backup of an AWS S3 bucket
I'm looking for a way to take daily backups of an AWS bucket as incremental backups. These are to be stored offline and away from AWS.
For other storage systems (such as NAS drives) I use a daily ...
1
vote
2answers
86 views
Creating an S3 Bucket with Only Public Read and Download Permissions
I am trying to setup an S3 Bucket that has public read and download permissions, but not public upload.
I have the following permissions in the "Access Control List"
And Bucket Policy which allows ...
37
votes
2answers
7k views
AWS S3 charging for 4 TB of storage when only using less than 1 GB
I'm having trouble understanding my large S3 bill, and figured I'd ask here before dropping $30 on AWS monthly support.
Basically, I have an Amazon EC2 instance that makes an API to different ...
0
votes
1answer
55 views
InternalError when deploying to ECS using CodePipeline
I'm trying to deploy to ECS using AWS CodePipeline. Source and build stages are working fine, but deploy stage shows an error:
JobFailed: Internal Error
If I deploy my project to my ECS cluster ...
0
votes
1answer
32 views
Why does Amazon recommends reading 'all data' as soon as possible during S3 download?
While reading up official documentation on Amazon S3 Java SDK, I found an interesting note:
Your network connection remains open until you read all of the data or close the input stream. We ...
0
votes
0answers
12 views
Cloudfront with s3 file updates
I have an EC2 server with a website that allows logged-in users to upload very large files via a form for later download (these files are placed in a non-public s3 bucket). I want to use Cloudfront ...
1
vote
0answers
160 views
Setting up IIS reverse proxy to preserve host headers
I have an IIS server that is hosting a number of sites and apis. These sites include Confluence and Jira instances. These products actually run their own web servers so the Application Request Routing ...
2
votes
1answer
55 views
How to check which IAM performed an object modification of an s3 bucket
Is there a way to see which IAM did a modification on a aws s3 bucket object (with versioning enabled)?
I know that there is the aws s3api list-object-versions, but it only shows the owner's ...
2
votes
1answer
69 views
Backing up Apache access logs to S3
I am trying to backup Apache 2.4.27 logs on Amazon Linux 2016.03. I am trying to do so without writing a shell script, and I do not want to configure AWS access key and secret key on my Linux machine.
1
vote
3answers
79 views
Using S3 as a alternative to EFS for backup purpose
For centralised backup purpose of specific data from my instances, i was using EBS Volume mounted to that instances. Now we are planning to migrate to another region, but EFS service is not available ...
1
vote
2answers
61 views
AWS PowerShell Significantly Slower the AWS CLI
I'm having an issue in that a PowerShell Script takes 10 times as long as a batch file to download files from AWS S3.
I have an existing batch file script to move files from one S3 Bucket to another,...
0
votes
1answer
34 views
aws s3 cp files from the root of a subdirectory without getting subfolders as well? Powershell
s3://bucketname/yyyymmdd/foo/bar I have some files in the root directory and I want to copy them. I do not want to copy any subdirectories to the root (foo). I'm trying this in powershell:
aws s3 cp "...
0
votes
0answers
209 views
How to handle trailing slash in a redirect rule for an AWS S3 website?
I'm trying to build up some landing pages in my s3 hosted web site.
For example: http://www.example.com/products
That should redirect to http://www.example.com/products.html
To accomplish this, I ...
1
vote
1answer
32 views
Restricting S3 access to individual servers when using S3 endpoint in private VPC with no public IPs
Question
How can you restrict access to an S3 bucket to a single AWS instance when the instances have no public IP address and you're using an S3 endpoint in your VPC?
Background and Detail
We have ...
0
votes
0answers
49 views
Opsworks Stack and S3 access, can't get files.
For the life of me I can't figure out why I can't get opsworks to access the files in a bucket!
I have a chef 12 stack in opsworks. The repository is a zip file in an S3 bucket called "cheftest" (...
1
vote
1answer
137 views
Private s3 access from ec2 user-data script
I'm attempting to write an ec2 user-data script that will pull a file down from a private s3 bucket. The ec2 instances are located in multiple regions, which I believe eliminates the possibility of ...
1
vote
2answers
61 views
Determine which AWS account owns an S3 bucket
If someone gives me an S3 url with a bucket and an object, but I don't know which account owns the bucket, how can I determine which credentials to present in order to gain access to the object, ...
1
vote
1answer
256 views
Editable URL Rewrite Map for CloudFront/S3 Website using Lambda@Edge
I'm migrating a static website from IIS to Amazon S3, using CloudFront for https. The old site used the URL Rewrite module and had 301 redirect maps with over 200 entries. Here is an example:
example....
0
votes
0answers
67 views
log cloud foundry syslog to s3 using the syslog protocol
I want to send my syslog entries to an S3 bucket. Security restrictions have meant that this is the only ways that I can do this.
With cloud foundry, you can create a user provided server where I ...
1
vote
1answer
326 views
Amazon EKS: how to configure S3 access for worker nodes?
How can I configure an EKS cluster to automatically allow S3 access from worker nodes?
I've set up an EKS cluster following the Getting Started guide and have run the example Guest Book app. Now I ...
0
votes
2answers
54 views
Aws S3 encryption. Why use it?
I am not into the field at all. I am trying to understand what is the actual use of S3 encryption if the file is decrypted automatically when requested access to it.
Anyone with permissions to access ...
0
votes
1answer
48 views
Secure way to handle S3 uploads
I need to create an S3 bucket to host the assets uploaded by my users.
I've tried to create an IAM user dedicated to S3 which basically means:
- access only S3 and nothing else
- programmatically
- ...
2
votes
1answer
47 views
How to map subdomain in CloudFront to the same name in S3?
I have been searching for a way to do the following if someone can enlighten me would be greatly appreciated.
e.g. would the following mappings be possible in a single CloudFront instance?
feature-a....
0
votes
2answers
41 views
Making sure internal network is used
I am getting used to cloud computing, especially Amazon Web Services (AWS).
AWS has the concept of regions and availability zones. All availability zones of a Region are connected by a special, ...
1
vote
0answers
33 views
How to get s3 bucket policy update in cloud trail logs
Hi I have created a bucket and enabled cloud trail also including s3 object level api logging.
Now when I create some s3 ACL via UI the I get the logs in cloud trail but when I Create the same ACL ...
0
votes
0answers
302 views
How to use rclone to sync with s3 and acl public-read
Ref: Rsync to AWS S3 bucket
A reply to the above question suggests using rclone in a similar way to rsync. It seems like it might work, but it doesn't seem to use the ACL I want.
Previously, I use ...
