Questions tagged [amazon-s3]
This is for questions on Amazon's cloud storage service.
1,134
questions
1
vote
0
answers
273
views
How do I redirect https://example.com to https://www.example.com?
I recently transferred my website to AWS and added an SSL certificate. The transfer was successful, however, I can't figure out how to redirect https://example.com to https://www.example.com
Only ...
0
votes
2
answers
283
views
Configuring S3 bucket as alternative storage for Dovecot sdbox
I'm trying to use an S3 bucket for long-term storage for emails, served with Dovecot, with a cron job to doveadm altmove everything older than a few weeks to alternative storage. I've been able to ...
0
votes
1
answer
18
views
Archive files in EC2 Instance
I want to create the archives of the files in EC2 instance to load them into the S3 bucket, but I am not getting a proper command to run on the AWS cli.
2
votes
1
answer
1k
views
What is the purpose of version dates in AWS policy documents
AWS policies contain a date version. What is its purpose? In this example a bucket policy and a user policy both contain "Version": "2012-10-17" in the JSON. I don't see the ...
2
votes
2
answers
235
views
How can one copy an S3 bucket as faithfully as possible (e.g., copying all permission settings)?
I want to copy an S3 bucket as faithfully as possible (e.g., copying all permission settings).
The standard:
aws s3 sync s3://old-bucket s3://new-bucket --source-region us-west-1 --region us-west-2
...
1
vote
1
answer
51
views
How can I efficiently move an S3 bucket to a new AWS region while keeping the same bucket name?
My current plan to move an S3 bucket from AWS region us-west-1 to AWS region us-west-2 while keeping the same bucket name seems highly inefficient as it's copying the entire bucket twice:
# Create new ...
0
votes
0
answers
48
views
Velero cannot access same S3 from different EKS cluster
I have velero installed on two different EKS clusters in the same region. All velero installation configurations are same and installed using same charts and credentials, and uses same S3 bucket with ...
1
vote
1
answer
110
views
Is Mastodon remove-orphans safe when multiple instances sharing an S3 bucket?
I have two Mastodon v4.2.0 instances, a staging server and a live/production instance. They share an AWS S3 bucket for file storage. Both are hosted on DigitalOcean.
Is the command RAILS_ENV=...
1
vote
5
answers
3k
views
AWS Windows EC2 instance does not recognize assigned IAM role
Initially I launched a brand-new Windows Server 2016 server EC2. I assigned a S3 full admin IAM role to this instance when launching it. I installed CLI on it. I started a CMD window, and typed in "...
0
votes
0
answers
72
views
How to Deploy React App and WordPress on the Same CloudFront Distribution Domain Name with Different Origins and Behaviors?
I'm encountering challenges deploying both a React app and a WordPress site on the same CloudFront Distribution domain name while utilizing different origins and behaviors.
Here's my setup:
I have a ...
1
vote
1
answer
19k
views
AWS S3 bucket - Allow download files to every IAM and Users from specific AWS Account
Look for a policy for S3 bucket that will allow all IAM roles and users from different account, to be able to download files from the bucket that is located in my AWS account.
Thanks for help
2
votes
1
answer
1k
views
Can I control frequency of AWS S3 bucket access log delivery?
I have enabled access logging for an AWS S3 bucket. Now I get log files delivered to my chosen destination. Each file has a name of the form YYYY-MM-DD-hh-mm-ss-guidguidguid with the time representing ...
2
votes
1
answer
653
views
Serving HTTPS images with Minio
I followed this documentation, but I can't make my images to be served with HTTPS.
I have the following /etc/default/minio configuration file:
MINIO_ACCESS_KEY="admin"
MINIO_VOLUMES="/...
0
votes
1
answer
56
views
How to setup a S3 backed Media server with basic auth / password protection
Requirement
Serve audios and videos stored in a S3 bucket
Selectively protect folders with basic auth (username password);
Low latency as much as possible but not necessary
Cost is also a factor but ...
25
votes
2
answers
47k
views
Deleting S3 files with a given prefix only
We have a bucket with more than 500,000 objects in it.
I'm assigned a job where I've to delete files which have a specific prefix. There are around 300,000 files with the given prefix in the bucket.
...
0
votes
0
answers
49
views
How to get CloudTrail to record user-data script in the log
I have users who will be able to submit scripts to instances via the aws ec2 run-instances --user-data file://bla.sh option.
I have setup CloudTrail to save almost all of the data that I need to log ...
1
vote
4
answers
7k
views
using terraform to download zip file from aws s3
I can't seem to find a documentation that will help me download a zip file from aws s3 to an instance using terraform, can someone help me find a solution to this ?
Thank you.
0
votes
1
answer
49
views
Choosing AWS hosting for flutter website
Choosing AWS hosting for flutter website
I have a flutter website and i have been thinking to host the site in
AWS.
I have saw the below features in aws which I can use for hosting
my website.
AWS ...
2
votes
2
answers
614
views
How to point route53 records to bucket for *any*subdomain?
I have an S3 bucket called www.mybucket.com
I have an A record: name = www.mybucket.com. It answers well with the index.html contained in the bucket.
Now I want to send any subdomain to that bucket.
I ...
0
votes
0
answers
72
views
Delete object everyday in S3 bucket
i'm trying to delete folders(objects) in the S3 bucket everyday (with lifecycle rule). I have this scenario :
TestBucket -> connect/ -> test/ -> 2023/ -> 12/ -> 01/, 02/, 03/ etc.
I ...
1
vote
1
answer
4k
views
Domain to S3 Bucket AccessDenied
Hello i have a problem i recibe AccessDenied in my domain
I upload my site in to a AWS S3 Bucket, i make public, create a static page, but when i access via my domain.com/mypage i get a AccessDenied.
...
11
votes
2
answers
12k
views
Determine which AWS account owns an S3 bucket
If someone gives me an S3 url with a bucket and an object, but I don't know which account owns the bucket, how can I determine which credentials to present in order to gain access to the object, ...
0
votes
1
answer
201
views
S3 site in Cloudfront Preflight 302 Error
I have a static s3 website hosted through CloudFront. In it, I make a request that will result in a redirect if the user is not logged in. Preflight then fails because of a 302:
Access to fetch at '...
0
votes
1
answer
395
views
My Cloudfront distribution is showing access denied despite enabling all public access to the bucket objects
I am using the following CF policy in my S3 bucket:
{
"Version": "2008-10-17",
"Id": "PolicyForCloudFrontPrivateContent",
"...
46
votes
11
answers
82k
views
Most efficient way to batch delete S3 Files
I'd like to be able to batch delete thousands or tens of thousands of files at a time on S3. Each file would be anywhere from 1MB to 50MB. Naturally, I don't want the user (or my server) to be waiting ...
0
votes
1
answer
281
views
Best method to copy image files from AWS EC2 instance to S3 bucket based on query
What is the most efficient method to copy selected image files from a EC2 instance (Ubuntu 20.04) in production to a S3 bucket while checking if the file exists in EC2?
This is a one-time operation. ...
2
votes
2
answers
8k
views
How to find owner of a aws account with account number
I inherited a couple of AWS environments. I have been recently doing security audits of s3 and found several policies with principals containing aws account numbers I don't know and nobody at my ...
0
votes
0
answers
121
views
Oracle MySQL operator for kubernetes backup to S3 using service account
I've installed the operator, and trying to create the innodb cluster with backup profile which uses S3. There is no mention of S3 in the documentation, but they mentioned in a conference about S3 ...
0
votes
0
answers
94
views
Maximize duplicity efficiency
I'm creating incremental backups for a database. The size is around 8 GB per dump.
I have a backup creation policy, that looks like this: (don't worry, I already avoided collisions)
An increment ...
30
votes
7
answers
42k
views
How to verify a AWS VPC (S3) endpoint works?
I added a VPC endpoint to my VPC using CloudFormation, and allowed s3 usage. The routes are visible in the AWS console, but not in the local routing tables of the
EC2 instances:
$ route -n
Kernel IP ...
0
votes
0
answers
115
views
Why do I need to map separate s3 buckets for www subdomain requests in AWS?
I have a question about how DNS works in conjunction with AWS s3 buckets that I am trying to understand. I have a modest knowledge about DNS and AWS, but I don't understand why my routing solution ...
1
vote
1
answer
12k
views
How do I extract a list of all folders of my AWS S3 storage bucket or directories?
Does Amazon provide an easy way extract a list of all folders that have files greater than 500 MB from a s3 bucket? want to limit the scope to the '/files/ftp_upload/' directories also This is so I ...
1
vote
2
answers
3k
views
CloudFront distribution can't access S3 bucket for website static assets
The problem
I'm trying to deploy an S3 bucket hosting my static website asset and a cloudfront distribution to access it, but the distribution still return a bare xml file for an 'access denied' error:...
0
votes
0
answers
319
views
Dropzone: How to upload video to S3 using presigned URL and play it in browser? Doesn't quite work
I have Dropzone set up to allow users to upload videos directly to an S3 presigned URL using the PUT method. Here is my Dropzone script:
var presign = "#";
Dropzone.autoDiscover = false;
var ...
4
votes
3
answers
13k
views
How can I get a breakdown of s3 cost at per bucket level in Cost Explorer?
It seems like I can get total cost of S3 using the service level in the filter.
However I want to get cost per bucket level.
Can it be done in Cost Explorer?
If not, can I get the breakdown with ...
0
votes
0
answers
368
views
minio A header you provided implies functionality that is not implemented
I'm trying to move object on MinIO yet running into weird issue (even though I'm able to move other objects fine without any issues)
summary:
mc: Failed to copy https://FQDN/path1/file.txt. A header ...
1
vote
2
answers
2k
views
ansible - couldn't resolve module/action 'amazon.aws.s3_object' / The module amazon.aws.s3_object was not found in configured module paths
Per requirements, I did installed all the required packages, however amazon.aws.s3_object is one of those things:
couldn't be resolved/found
was not found in configured module paths
step(s), I used ...
1
vote
1
answer
173
views
Scheduled task to upload a file to S3 with PowerShell ignores user profile settings
I am using Windows task scheduler with a user that has an AWS profile configuration under C:\Users<username>.aws\configuration (content below)
[default]
s3 =
max_concurrent_requests = 300
...
0
votes
1
answer
342
views
How to know if an S3 bucket with Cross-Region Replication is fully replicated?
I want to setup my S3 bucket to replicate in another region. Once it's fully replicated, I will make that bucket the main one (the idea is to migrate all data from one region to another). I know how ...
3
votes
2
answers
833
views
Why AWS encryption for EBS and S3 is disabled by default? [closed]
For EBS and S3 encryption (even via the default key from KMS) is disabled by default, as I understood from the documentation, there is no difference to the user if volume/objects is/are encrypted ...
0
votes
1
answer
146
views
Proper Setup for a simple AWS S3 website using CloudFront & Route, with base domain and www subdomain
Which is the better design, and why? (see 2 tables)
1. Here is the configuration of my working website (example.com is the prevent domain)
as setup via a Youtube Tutorial...
Route53
Cloudfront Dist
...
0
votes
0
answers
114
views
Multi-region internal, domain resolved static website hosted in S3
Statement
I do have a website that has a single page application hosted in S3, and a web service hosted in AWS Lambda. To avoid cross-site requests, both share the same domain, and I route the ...
0
votes
1
answer
626
views
Restoring Terraform state from backend
My Terraform Git repository ended-up having some unreconciliable data error and I couldn't push a recent change. I exported my commit to a patch, recloned, applied the patch, and then realized I just ...
4
votes
3
answers
12k
views
s3fs "could not determine how to establish security credentials"
I'm trying to use s3fs to mount an S3 bucket on to a standard AWS Amazon Linux AMI (with all the necessary dependencies installed). However when following this tutorial when I run: s3fs mybucketname -...
0
votes
1
answer
471
views
How to set correct Content-Type HTTP header for all files uploaded on S3 bucket?
What is please the correct way to set Content-Type HTTP header for files uploaded on S3 bucket? We use S3 bucket as an origin server for hosting static websites. Bucket is accessed through the ...
4
votes
4
answers
9k
views
s3fs Input/output error
I'm trying to set up a backup system with s3fs and the Amazon S3 service.
I followed this this guide and this guide.
Tailing /var/log/messages I get:
Aug 28 13:37:46 server s3fs:###response=403
I ...
55
votes
8
answers
49k
views
Chrome S3 Cloudfront: No 'Access-Control-Allow-Origin' header on initial XHR request
I have a webpage (https://smartystreets.com/contact) that uses jQuery to load some SVG files from S3 through the CloudFront CDN.
In Chrome I will open an Incognito window as well as the console. Then ...
9
votes
3
answers
23k
views
s3cmd: Deleting files or folder does not work
s3cmd s3://MYBUCKET/FOLDER does not work. (folder is empty)
s3cmd s3://MYBUCKET/FILE does not work.
Output of both commands is "File FILE sucessfully deleted", yet the file remains on the bucket.
...
0
votes
0
answers
128
views
Enable MFA S3 delete
I have THALES TOTP hardware tokens (MFA) which I would like to use as and additional protection against the accidental S3 object deletion (https://docs.aws.amazon.com/AmazonS3/latest/userguide/...
0
votes
1
answer
110
views
Best practice for storing personal information on AWS that we shouldn't be able to see
We store customer information that we shouldn't have access to, and don't want to inconvenience users by making them lose information if they forget their passwords, is there a good way to solve this ...