Questions tagged [amazon-s3]
This is for questions on Amazon's cloud storage service.
1,022
questions
0
votes
0answers
18 views
AWS Glacier and Ransomware
I'm trying to understand the structure of how AWS Glacier works because I have a problem.
Problem:
I have a NAS that backs up to Glacier about once a week. About two weeks ago the NAS got infected ...
1
vote
0answers
16 views
Use increment instead of random string in AWS S3
When I upload files with similar filenames Amazon S3 adds random chars to the filename. How I can change it to use increment instead?
0
votes
0answers
243 views
CyberDuck S3 folder transfer fails
I have a Yandex Cloud S3-compatible object storage, mostly I use it's web GUI or boto3 Python library through my app. Recently I found CyberDuck app, and it seems really cool & handy, also it is ...
1
vote
0answers
26 views
Should I archive file copies from S3 into Glacier one-by-one Or should I zip them first?
I have an s3 bucket named media and in it I have a folder named contracts that stores pdf files ~400kb each. For the files in this folder I keep a record in a database as well with the following ...
0
votes
0answers
23 views
Cloudfront accepts only first Origin encountered even if S3 bucket CORS rules allow several
I have a web site that is available from different top domains for different countries (www.example.se and www.example.dk) that share all the kinds of static assets that are best served from CDN. My ...
0
votes
0answers
14 views
Samba Network drive files corrupted
I have samba network share configured on AmazonLinux, With S3 as a backend storage for the drive,
Samba drive path For ex: 192.0.0.1\Share\ (Path inside server /samba)
S3 Bucket mount path (/samba/...
0
votes
1answer
20 views
Using IAM Users for customer access to a bucket
For each of my customers, they have data stored on individual dropbox accounts and im in the process of consolidating all of these into AWS in the shape of a single s3 bucket where each customer has ...
0
votes
0answers
15 views
AWS - Serving two react apps on the same CloudFront distribution. How do I deal with the static directory?
I have two React apps I want to serve with one CloudFront distribution. They both rely on react-router for navigation.
I have two S3 buckets configured as origins. The default (*) behaviour is set to ...
0
votes
1answer
22 views
Cannot write to AWS S3 bucket using CLI
Im running a Github CD actions that takes some files from my repo and tries to upload them to a S3 bucket I have.
The action runs this command:
/usr/bin/docker run --name ...
0
votes
1answer
33 views
How to get complete bucket access of aws s3 as public?
When we set a file in s3 bucket as public, we can directly download it from its URL.
But, if I set a bucket or a sub folder in bucket to public, I am getting below error.
<Error>
<Code>...
0
votes
0answers
28 views
Copy old data from local Centos to AWS S3 bucket
I have the following task to complete. I hope someone can provide the feedback to get me started.
We have a directory with thousands of images in many folders and sub-folders
The goal is to have a ...
-1
votes
2answers
52 views
How do I share all resources between two AWS Root accounts?
We have one person that has been in charge of all AWS resources for our company, including EC2, elastic IPs, EBS storage, etc. Now we want a second person to also have access to ALL the resources in ...
1
vote
1answer
30 views
AWS S3 bucket - Allow download files to every IAM and Users from specific AWS Account
Look for a policy for S3 bucket that will allow all IAM roles and users from different account, to be able to download files from the bucket that is located in my AWS account.
Thanks for help
0
votes
0answers
29 views
Delete AWS RDS S3 Exported Snapshots
So I have created S3 Exports from existing snapshots in RDS. I would like to delete duplicated ones. But I don't see any button to delete them.
I have already deleted the files from the bucket. But ...
1
vote
0answers
26 views
Combination of S3 bucket, fuse, rclone mount and incron - not detecting changes
and thanks for reading.....
I'm trying to setup a method whereby I have an on-premise Centos 7 server which uses rclone (mount) to mount an AWS S3 bucket as a file system. I've installed fuse to make ...
0
votes
0answers
27 views
Uploading file from JS web app to S3 fails due to CORS
I have a JS web app and I'm trying to upload a file to AWS S3 from the client.
I've tried everything both locally (localhost:3000) and when deployed to production (Vercel serverless functions).
I ...
1
vote
1answer
1k views
Why don't I have permissions to edit an S3 bucket policy when logged on as the person who created the AWS account
I am new to AWS. I am setting up an S3 bucket that I want to use to store media files for a Django App I am developing.
I am logged in as the person who created the AWS account, but when I click on ...
0
votes
0answers
21 views
What data storage services in AWS provide strong consistency?
I am trying to draw a comparison of data storage solutions provided by Amazon AWS and one of the main aspects of such analysis I’m trying to address is consistency vs performance/throughput, as that ...
1
vote
0answers
24 views
Fastest way to import files in Spark?
I’m playing around with Spark 3.0.1 and I’m really impressed by the performance with Spark SQL on GB of data.
I’m trying to understand what’s the best way to import multiple JSON files in the Spark ...
1
vote
1answer
142 views
Unable to access S3 static website using https
I have followed all the steps from https://aws.amazon.com/premiumsupport/knowledge-center/cloudfront-https-requests-s3/ but my website still cannot be accessed using https.
My certificate was issued ...
-2
votes
1answer
114 views
Suggestions for AWS setup wanted
For my next project, I'm giving AWS and server-less a go, but I'm not sure how to reason about the different AWS services. So here's hoping that someone here has a good feel for it.
The project ...
0
votes
0answers
11 views
Performance Sending a file from one service to another within a cluster
I have a cluster with lots of different projects.
I thought it would be good to have a single S3 service that would manage all the functionality of sending files to the external S3 provider.
It would ...
0
votes
0answers
10 views
Amazon EC2 billing for CLOUDWATCH and S3
I am new user in Amazon Web services. I am using only EC2 instance in Mumbai region. When I saw the bill section, it had a bill for CLOUDWATCH and S3 request. But I am not using any of above services ...
0
votes
1answer
40 views
Split Traffic Between S3 Buckets
I have a static S3 site in bucket_old and will rebuild it route by route in S3 bucket_new using the strangler pattern.
URLs /home, /contact map to bucket_new
All other URLs map to bucket_old
What ...
0
votes
1answer
45 views
Cloudfront SSL with Subdomain pointing to S3 bucket works, but still redirects to S3 URL
I've set up an S3 Bucket that I want to use as a CDN but with my own subdomain.
For example, myfiles.mydomain.com.
So, I set up a Cloudfront web distribution that points to the bucket named "...
0
votes
0answers
41 views
Amazom S3 Bucket size is counting 1 extra file
Using AWS S3, Lets say i have a bucket called X which contains two folders called X1 & X2.
I have uploaded 1 file from a folder on my google drive and then uploaded the rest of the other files ...
0
votes
1answer
136 views
How to access an aws s3 bucket using Access Key ID and secret access Key?
I have a free account on AWS and somebody shared me an Access key ID and Secret access key to access their s3 bucket.
I am new in AWS, how can I access their s3 bucket using AWS web console?
1
vote
0answers
33 views
Best Practice: Ansys FEA Output Data Storage
I'm trying to make this as least subjective as possible by providing finite inputs and parameters. I truly want to know what is the most resource affective, given the constraints. Given my available ...
0
votes
0answers
34 views
AWS S3 unexpected bucket size increase
So I had a S3 bucket with 2.7M objects and around 1.03TB.
Server side encryption was not enabled so no objects were encrypted. Object versioning is also disabled.
I activated SSE-S3 and to encrypt the ...
1
vote
0answers
22 views
Data Ingress to S3 from an FTP Server
I have about 1.5TB of data on an FTP server from my web hosting provider that I want to migrate into S3.
From what I have read there are a number of ways to do this, including FileZilla Pro which ...
0
votes
0answers
50 views
s3fs mount does not work for read access
I have a Debian 10 server on AWS and it has a mount point on an S3Bucket. The bucket is really not that big, but when I do an ls or anything that attempts to read the bucket the system slows down to ...
9
votes
3answers
1k views
CNAME with S3 buckets
I have a Web and I wanted to move its images to AWS S3. Say it's called mypage.com and I can access to an image like this:
https://mypage.com/pics/one.jpg
I created a bucket called static.mypage.com ...
0
votes
0answers
52 views
Http response header to be returned on request for 206 status
I am facing a performance issue with my Nodejs server, i am getting a Big document from S3 (200mb+) by ID.
when client sends the request i take the ID and query a local table on my data base to get ...
0
votes
0answers
52 views
S3 multipart upload speed
S3 supports multipart uploads, where a file can be split into chunks and each chunk can be uploaded in parallel (up to a number N). According to my tests, this increases the upload speed.
Why is it ...
0
votes
1answer
52 views
Universally apply restriction to bucket policy, for all S3 buckets
I want to apply a specific restriction to all S3 buckets. Generally AWS published resources describe a per bucket solution. However this does not solve the issue of other users creating bucket ...
0
votes
1answer
60 views
Need some help granting access to AWS S3 bucket, without exposing to Public
I'm trying to set up an AWS S3 bucket for storing files that a website will dish up to users of the site. The site is an intranet (only logged in users can access any pages which provide links to the ...
0
votes
0answers
36 views
S3 Same-region-replication, auto create folder per source bucket in destination bucket
Hi i have two accounts account "A" and "B". Account A, cotains bucket b1a,b2a and b3a all bucket content are replicated to Account B bucket b1b.
all logs are successfuly replicated ...
0
votes
0answers
61 views
AWS error Unsupported: Not enough free disk space in /boot to proceed with import
a company would migrate they servers (they are VM) to Amazon AWS.
In this moment the virtual machine are running on a Hyper-V server.
I have exported one VM (it is a Ubuntu VM). After that I have ...
4
votes
1answer
80 views
AWS EC2 Windows server with S3 storage for Veeam backup
I want to create a remote repository for the backup of my local infrastructure.
I'm using Veeam v10.
I think I need a remote machine with a Veeam component installed, then I was wondering if I can ...
0
votes
0answers
24 views
Static WP website and web app are in different host with one domain
I don't know if this is the right place to post this but I am so much in deep confusion right now.
I have a static WP website hosted in Fastcomet with a domain name www.hpdc.com (namecheap) and also
a ...
0
votes
1answer
510 views
Is there a way to see the list of pending S3 Glacier retrievals in the AWS console?
I've initiated the retrieval of an S3 file using the Glacier Deep Archive storage class, using the AWS console. I just got a success message, and no link to a page where I can monitor the status of my ...
0
votes
1answer
33 views
How to analyze AWS S3 costs?
Into "Cost Explorer Monthly costs by service" report I saw $300 for S3 for certain month. But when I tried to drill-down into the bill for this month, I saw just $4 for the "Simple ...
2
votes
1answer
187 views
AWS S3 bucket cross account policy mixed with internal account
we use s3 bucket to share files between two companies. We created private S3 bucket and we have dedicated user for application which uses this bucket (using it's aws_key and aws_secret). We figured ...
1
vote
2answers
179 views
s3 bucket/IAM user policy “Deny takes priority above all other access”?
Two policies, got one "Deny", I should not be able to do any operations to bucket,
but I can still list and view bucket objects. Why? Thanks
S3 bucket policy
{
"Sid": "...
0
votes
1answer
26 views
VM ram requirement for aws s3 sync job
I have a VM setup to sync 15TB of data split in 25GB volumes to S3 using the latest awscli v.2. I have a 100Mbps upload capacity, and the job will probably take 16 days. I haven't had any experience ...
2
votes
1answer
58 views
Resizing images using AWS Lambda - issue
I'm trying to resize images automatically using Amazon S3/Lambda. The problem is I cannot get any connection to Amazon S3 buckets while creating a Lambda function.
Creating a new blank function in ...
0
votes
0answers
622 views
S3 – Connection Aborted / Broken Pipe when uploading to one bucket's presigned URLs, but other buckets are fine
I have an S3 bucket in a Cloudformation stack that holds artifacts. A lambda function in the same stack generates a presigned URL for clients to upload files into the bucket.
I already had the code ...
0
votes
1answer
388 views
Redirect apex domain to www with Route53 and CloudFront
I'm trying to setup redirect from the apex domain example.com to www.example.com with route53, cloudfront and s3.
I've seen many tutorials online and discussions here on the topic, but nothing has ...
1
vote
0answers
143 views
How to access a S3 bucket accessible only through a EKS Pod
We've got a S3 bucket we use to store files used by an application deployed on EKS, to access the bucket we have a secret web identity token.
The application maintenance guys sometime need to browse ...
0
votes
0answers
24 views
SPA from S3 and Java backend in the same domain. ALB fixed response limit
I would like to have S3 bucked stored Single Page Application and its backend in the same domain. Now I am using ALB Listeners configuration to serve a fixed response for my index.html (by path). The ...
