Questions tagged [amazon-s3]

This is for questions on Amazon's cloud storage service.

Filter by
Sorted by
Tagged with
0 votes
2 answers
273 views

Configuring S3 bucket as alternative storage for Dovecot sdbox

I'm trying to use an S3 bucket for long-term storage for emails, served with Dovecot, with a cron job to doveadm altmove everything older than a few weeks to alternative storage. I've been able to ...
0 votes
1 answer
16 views

Archive files in EC2 Instance

I want to create the archives of the files in EC2 instance to load them into the S3 bucket, but I am not getting a proper command to run on the AWS cli.
2 votes
1 answer
1k views

What is the purpose of version dates in AWS policy documents

AWS policies contain a date version. What is its purpose? In this example a bucket policy and a user policy both contain "Version": "2012-10-17" in the JSON. I don't see the ...
2 votes
2 answers
222 views

How can one copy an S3 bucket as faithfully as possible (e.g., copying all permission settings)?

I want to copy an S3 bucket as faithfully as possible (e.g., copying all permission settings). The standard: aws s3 sync s3://old-bucket s3://new-bucket --source-region us-west-1 --region us-west-2 ...
1 vote
1 answer
49 views

How can I efficiently move an S3 bucket to a new AWS region while keeping the same bucket name?

My current plan to move an S3 bucket from AWS region us-west-1 to AWS region us-west-2 while keeping the same bucket name seems highly inefficient as it's copying the entire bucket twice: # Create new ...
0 votes
0 answers
32 views

Velero cannot access same S3 from different EKS cluster

I have velero installed on two different EKS clusters in the same region. All velero installation configurations are same and installed using same charts and credentials, and uses same S3 bucket with ...
1 vote
1 answer
94 views

Is Mastodon remove-orphans safe when multiple instances sharing an S3 bucket?

I have two Mastodon v4.2.0 instances, a staging server and a live/production instance. They share an AWS S3 bucket for file storage. Both are hosted on DigitalOcean. Is the command RAILS_ENV=...
1 vote
5 answers
3k views

AWS Windows EC2 instance does not recognize assigned IAM role

Initially I launched a brand-new Windows Server 2016 server EC2. I assigned a S3 full admin IAM role to this instance when launching it. I installed CLI on it. I started a CMD window, and typed in "...
0 votes
0 answers
69 views

How to Deploy React App and WordPress on the Same CloudFront Distribution Domain Name with Different Origins and Behaviors?

I'm encountering challenges deploying both a React app and a WordPress site on the same CloudFront Distribution domain name while utilizing different origins and behaviors. Here's my setup: I have a ...
1 vote
1 answer
19k views

AWS S3 bucket - Allow download files to every IAM and Users from specific AWS Account

Look for a policy for S3 bucket that will allow all IAM roles and users from different account, to be able to download files from the bucket that is located in my AWS account. Thanks for help
2 votes
1 answer
1k views

Can I control frequency of AWS S3 bucket access log delivery?

I have enabled access logging for an AWS S3 bucket. Now I get log files delivered to my chosen destination. Each file has a name of the form YYYY-MM-DD-hh-mm-ss-guidguidguid with the time representing ...
2 votes
1 answer
582 views

Serving HTTPS images with Minio

I followed this documentation, but I can't make my images to be served with HTTPS. I have the following /etc/default/minio configuration file: MINIO_ACCESS_KEY="admin" MINIO_VOLUMES="/...
0 votes
1 answer
46 views

How to setup a S3 backed Media server with basic auth / password protection

Requirement Serve audios and videos stored in a S3 bucket Selectively protect folders with basic auth (username password); Low latency as much as possible but not necessary Cost is also a factor but ...
24 votes
2 answers
46k views

Deleting S3 files with a given prefix only

We have a bucket with more than 500,000 objects in it. I'm assigned a job where I've to delete files which have a specific prefix. There are around 300,000 files with the given prefix in the bucket. ...
0 votes
0 answers
41 views

How to get CloudTrail to record user-data script in the log

I have users who will be able to submit scripts to instances via the aws ec2 run-instances --user-data file://bla.sh option. I have setup CloudTrail to save almost all of the data that I need to log ...
1 vote
4 answers
7k views

using terraform to download zip file from aws s3

I can't seem to find a documentation that will help me download a zip file from aws s3 to an instance using terraform, can someone help me find a solution to this ? Thank you.
0 votes
1 answer
45 views

Choosing AWS hosting for flutter website

Choosing AWS hosting for flutter website I have a flutter website and i have been thinking to host the site in AWS. I have saw the below features in aws which I can use for hosting my website. AWS ...
2 votes
2 answers
610 views

How to point route53 records to bucket for *any*subdomain?

I have an S3 bucket called www.mybucket.com I have an A record: name = www.mybucket.com. It answers well with the index.html contained in the bucket. Now I want to send any subdomain to that bucket. I ...
0 votes
0 answers
70 views

Delete object everyday in S3 bucket

i'm trying to delete folders(objects) in the S3 bucket everyday (with lifecycle rule). I have this scenario : TestBucket -> connect/ -> test/ -> 2023/ -> 12/ -> 01/, 02/, 03/ etc. I ...
1 vote
1 answer
4k views

Domain to S3 Bucket AccessDenied

Hello i have a problem i recibe AccessDenied in my domain I upload my site in to a AWS S3 Bucket, i make public, create a static page, but when i access via my domain.com/mypage i get a AccessDenied. ...
11 votes
2 answers
12k views

Determine which AWS account owns an S3 bucket

If someone gives me an S3 url with a bucket and an object, but I don't know which account owns the bucket, how can I determine which credentials to present in order to gain access to the object, ...
0 votes
1 answer
188 views

S3 site in Cloudfront Preflight 302 Error

I have a static s3 website hosted through CloudFront. In it, I make a request that will result in a redirect if the user is not logged in. Preflight then fails because of a 302: Access to fetch at '...
0 votes
1 answer
356 views

My Cloudfront distribution is showing access denied despite enabling all public access to the bucket objects

I am using the following CF policy in my S3 bucket: { "Version": "2008-10-17", "Id": "PolicyForCloudFrontPrivateContent", "...
46 votes
11 answers
82k views

Most efficient way to batch delete S3 Files

I'd like to be able to batch delete thousands or tens of thousands of files at a time on S3. Each file would be anywhere from 1MB to 50MB. Naturally, I don't want the user (or my server) to be waiting ...
0 votes
1 answer
268 views

Best method to copy image files from AWS EC2 instance to S3 bucket based on query

What is the most efficient method to copy selected image files from a EC2 instance (Ubuntu 20.04) in production to a S3 bucket while checking if the file exists in EC2? This is a one-time operation. ...
2 votes
2 answers
8k views

How to find owner of a aws account with account number

I inherited a couple of AWS environments. I have been recently doing security audits of s3 and found several policies with principals containing aws account numbers I don't know and nobody at my ...
0 votes
0 answers
116 views

Oracle MySQL operator for kubernetes backup to S3 using service account

I've installed the operator, and trying to create the innodb cluster with backup profile which uses S3. There is no mention of S3 in the documentation, but they mentioned in a conference about S3 ...
0 votes
0 answers
91 views

Maximize duplicity efficiency

I'm creating incremental backups for a database. The size is around 8 GB per dump. I have a backup creation policy, that looks like this: (don't worry, I already avoided collisions) An increment ...
29 votes
7 answers
42k views

How to verify a AWS VPC (S3) endpoint works?

I added a VPC endpoint to my VPC using CloudFormation, and allowed s3 usage. The routes are visible in the AWS console, but not in the local routing tables of the EC2 instances: $ route -n Kernel IP ...
0 votes
0 answers
106 views

Why do I need to map separate s3 buckets for www subdomain requests in AWS?

I have a question about how DNS works in conjunction with AWS s3 buckets that I am trying to understand. I have a modest knowledge about DNS and AWS, but I don't understand why my routing solution ...
1 vote
1 answer
12k views

How do I extract a list of all folders of my AWS S3 storage bucket or directories?

Does Amazon provide an easy way extract a list of all folders that have files greater than 500 MB from a s3 bucket? want to limit the scope to the '/files/ftp_upload/' directories also This is so I ...
1 vote
2 answers
2k views

CloudFront distribution can't access S3 bucket for website static assets

The problem I'm trying to deploy an S3 bucket hosting my static website asset and a cloudfront distribution to access it, but the distribution still return a bare xml file for an 'access denied' error:...
0 votes
0 answers
307 views

Dropzone: How to upload video to S3 using presigned URL and play it in browser? Doesn't quite work

I have Dropzone set up to allow users to upload videos directly to an S3 presigned URL using the PUT method. Here is my Dropzone script: var presign = "#"; Dropzone.autoDiscover = false; var ...
4 votes
3 answers
13k views

How can I get a breakdown of s3 cost at per bucket level in Cost Explorer?

It seems like I can get total cost of S3 using the service level in the filter. However I want to get cost per bucket level. Can it be done in Cost Explorer? If not, can I get the breakdown with ...
0 votes
0 answers
356 views

minio A header you provided implies functionality that is not implemented

I'm trying to move object on MinIO yet running into weird issue (even though I'm able to move other objects fine without any issues) summary: mc: Failed to copy https://FQDN/path1/file.txt. A header ...
1 vote
2 answers
2k views

ansible - couldn't resolve module/action 'amazon.aws.s3_object' / The module amazon.aws.s3_object was not found in configured module paths

Per requirements, I did installed all the required packages, however amazon.aws.s3_object is one of those things: couldn't be resolved/found was not found in configured module paths step(s), I used ...
1 vote
1 answer
171 views

Scheduled task to upload a file to S3 with PowerShell ignores user profile settings

I am using Windows task scheduler with a user that has an AWS profile configuration under C:\Users<username>.aws\configuration (content below) [default] s3 = max_concurrent_requests = 300 ...
0 votes
1 answer
316 views

How to know if an S3 bucket with Cross-Region Replication is fully replicated?

I want to setup my S3 bucket to replicate in another region. Once it's fully replicated, I will make that bucket the main one (the idea is to migrate all data from one region to another). I know how ...
3 votes
2 answers
830 views

Why AWS encryption for EBS and S3 is disabled by default? [closed]

For EBS and S3 encryption (even via the default key from KMS) is disabled by default, as I understood from the documentation, there is no difference to the user if volume/objects is/are encrypted ...
0 votes
1 answer
133 views

Proper Setup for a simple AWS S3 website using CloudFront & Route, with base domain and www subdomain

Which is the better design, and why? (see 2 tables) 1. Here is the configuration of my working website (example.com is the prevent domain) as setup via a Youtube Tutorial... Route53 Cloudfront Dist ...
0 votes
0 answers
111 views

Multi-region internal, domain resolved static website hosted in S3

Statement I do have a website that has a single page application hosted in S3, and a web service hosted in AWS Lambda. To avoid cross-site requests, both share the same domain, and I route the ...
0 votes
1 answer
606 views

Restoring Terraform state from backend

My Terraform Git repository ended-up having some unreconciliable data error and I couldn't push a recent change. I exported my commit to a patch, recloned, applied the patch, and then realized I just ...
4 votes
3 answers
12k views

s3fs "could not determine how to establish security credentials"

I'm trying to use s3fs to mount an S3 bucket on to a standard AWS Amazon Linux AMI (with all the necessary dependencies installed). However when following this tutorial when I run: s3fs mybucketname -...
0 votes
1 answer
451 views

How to set correct Content-Type HTTP header for all files uploaded on S3 bucket?

What is please the correct way to set Content-Type HTTP header for files uploaded on S3 bucket? We use S3 bucket as an origin server for hosting static websites. Bucket is accessed through the ...
4 votes
4 answers
9k views

s3fs Input/output error

I'm trying to set up a backup system with s3fs and the Amazon S3 service. I followed this this guide and this guide. Tailing /var/log/messages I get: Aug 28 13:37:46 server s3fs:###response=403 I ...
55 votes
8 answers
49k views

Chrome S3 Cloudfront: No 'Access-Control-Allow-Origin' header on initial XHR request

I have a webpage (https://smartystreets.com/contact) that uses jQuery to load some SVG files from S3 through the CloudFront CDN. In Chrome I will open an Incognito window as well as the console. Then ...
9 votes
3 answers
23k views

s3cmd: Deleting files or folder does not work

s3cmd s3://MYBUCKET/FOLDER does not work. (folder is empty) s3cmd s3://MYBUCKET/FILE does not work. Output of both commands is "File FILE sucessfully deleted", yet the file remains on the bucket. ...
0 votes
0 answers
121 views

Enable MFA S3 delete

I have THALES TOTP hardware tokens (MFA) which I would like to use as and additional protection against the accidental S3 object deletion (https://docs.aws.amazon.com/AmazonS3/latest/userguide/...
0 votes
1 answer
106 views

Best practice for storing personal information on AWS that we shouldn't be able to see

We store customer information that we shouldn't have access to, and don't want to inconvenience users by making them lose information if they forget their passwords, is there a good way to solve this ...
0 votes
0 answers
86 views

AWS AppStream is unable to push session script logs to s3

I have configured session scripts to log stdout and stderr to s3 bucket as described in https://docs.aws.amazon.com/appstream2/latest/developerguide/use-session-scripts.html#enable-S3-bucket-storage-...

1
2 3 4 5
23