Questions tagged [amazon-s3]

This is for questions on Amazon's cloud storage service.

Filter by
Sorted by
Tagged with
0
votes
0answers
10 views

AWS S3 links return 403 when application is run using Docker Swarm, but works fine when run with Docker Compose

I have a Django application on EC2 (ubuntu) instance using S3 for static & media files, which is set up currently using Docker Compose. I'm trying to convert it to use Docker Swarm, but in doing ...
1
vote
2answers
64 views

How to *actually* exclude a directory in AWS S3 sync?

The aws s3 sync command has an --exclude flag which lets you exclude a folder from the sync. However, even though the files are not uploaded from that directory, the command still looks at and ...
1
vote
0answers
43 views

AWS SES Managing and Forwarding Incoming Mail

I'm probably in over my head with this one. Please bare with me while i fumble through my explanation of what it is that i am trying to accomplish here. We own a domain name. Have access to the back ...
0
votes
0answers
18 views

Image resizing and caching in NGINX after authentication and 302 redirect

I'm having issues with resizing and caching images. Here is my non-performant setup without caching: Client makes request for website.com/static/image.jpeg NGINX routes to API API authenticates user, ...
0
votes
0answers
18 views

S3 Security Policy for Bucket while allowing signed urls

ugh, bucket policies. I am trying to write a bucket security policy that would keep an outsider from listing the structure and data in the bucket but at the time my AWS users needs to be able to pull/...
1
vote
0answers
40 views

Converting specific folder of S3 into browsable directory list without making it public

I have a bucket that I'd like to access using a browser similar to http://data.openspending.org/ and I'd like only a subfolder to be visible. So if Bucket1 has multiple folders, I only wanna show and ...
1
vote
1answer
104 views

Why is AWS S3 Object count is measured iin units used to measure file size?

In AWS, the files/objects are stored in S3 bucket and the files/object count should list the total no of files/objects stored in S3 bucket as an INTEGER value. But I see the S3 object count as ...
2
votes
1answer
34 views

AWS S3 File Browser for Windows

Is there any official AWS GUI like S3 file explorer for Windows? I know there's plenty non-official like S3 Browser but, I am avoiding using third-party software.
0
votes
0answers
22 views

AWS: Read object file from S3 bucket to perform health checks with canary in Synthetics

Instead of doing health checks in the canary script I want to read all websites from an file that is located in an S3 bucket. Are there any way to do this? Script in canary: const s3 = new aws.S3({ ...
0
votes
1answer
95 views

Why is my database restore failing with ConnectFailure exception?

I am trying to restore a SQL Server database to an AWS RDS instance from a full backup file created on a different non-RDS server. I am running the operation from an EC2 Windows Server instance in the ...
1
vote
1answer
123 views

AWS S3 Policy: One non-public bucket, separate sub-folders for each user, restricted access

at the moment I'm struggling how to create a secure policy for my Amazon S3 bucket. My plan is to have one bucket with several sub-folders for separate (IAM) users. Access should only be ...
1
vote
0answers
13 views

AWS Elastic Beanstalk SNI SSL in S3

In our application we need to support customer ssl certificates and domains. Application stack: AWS Elastic Beanstalk, NodeJs and nginx server. I've found that we can use nginx variable "$...
0
votes
1answer
63 views

aws s3 mv command is not deleting the folder structure

aws s3 mv s3://test/paltest/ . --recursive All files within the paltest is been moved but paltest is not deleted. But i am able to remove paltest using aws s3 rm s3://test/paltest/
0
votes
0answers
9 views

Calling userdata from S3 bucket

What I am trying to do is that I want to call a yaml file from S3 Bucket using the transform parameter. The yaml file would have userdata stored in it. I am trying my best until now but whenever I try ...
0
votes
1answer
121 views

AWS Glacier and Ransomware

I'm trying to understand the structure of how AWS Glacier works because I have a problem. Problem: I have a NAS that backs up to Glacier about once a week. About two weeks ago the NAS got infected ...
1
vote
0answers
19 views

Use increment instead of random string in AWS S3

When I upload files with similar filenames Amazon S3 adds random chars to the filename. How I can change it to use increment instead?
0
votes
0answers
245 views

CyberDuck S3 folder transfer fails

I have a Yandex Cloud S3-compatible object storage, mostly I use it's web GUI or boto3 Python library through my app. Recently I found CyberDuck app, and it seems really cool & handy, also it is ...
1
vote
0answers
44 views

Should I archive file copies from S3 into Glacier one-by-one Or should I zip them first?

I have an s3 bucket named media and in it I have a folder named contracts that stores pdf files ~400kb each. For the files in this folder I keep a record in a database as well with the following ...
0
votes
0answers
26 views

Cloudfront accepts only first Origin encountered even if S3 bucket CORS rules allow several

I have a web site that is available from different top domains for different countries (www.example.se and www.example.dk) that share all the kinds of static assets that are best served from CDN. My ...
0
votes
0answers
16 views

Samba Network drive files corrupted

I have samba network share configured on AmazonLinux, With S3 as a backend storage for the drive, Samba drive path For ex: 192.0.0.1\Share\ (Path inside server /samba) S3 Bucket mount path (/samba/...
0
votes
1answer
23 views

Using IAM Users for customer access to a bucket

For each of my customers, they have data stored on individual dropbox accounts and im in the process of consolidating all of these into AWS in the shape of a single s3 bucket where each customer has ...
0
votes
0answers
26 views

AWS - Serving two react apps on the same CloudFront distribution. How do I deal with the static directory?

I have two React apps I want to serve with one CloudFront distribution. They both rely on react-router for navigation. I have two S3 buckets configured as origins. The default (*) behaviour is set to ...
0
votes
1answer
29 views

Cannot write to AWS S3 bucket using CLI

Im running a Github CD actions that takes some files from my repo and tries to upload them to a S3 bucket I have. The action runs this command: /usr/bin/docker run --name ...
0
votes
1answer
33 views

How to get complete bucket access of aws s3 as public?

When we set a file in s3 bucket as public, we can directly download it from its URL. But, if I set a bucket or a sub folder in bucket to public, I am getting below error. <Error> <Code>...
0
votes
0answers
28 views

Copy old data from local Centos to AWS S3 bucket

I have the following task to complete. I hope someone can provide the feedback to get me started. We have a directory with thousands of images in many folders and sub-folders The goal is to have a ...
-1
votes
2answers
65 views

How do I share all resources between two AWS Root accounts?

We have one person that has been in charge of all AWS resources for our company, including EC2, elastic IPs, EBS storage, etc. Now we want a second person to also have access to ALL the resources in ...
1
vote
1answer
117 views

AWS S3 bucket - Allow download files to every IAM and Users from specific AWS Account

Look for a policy for S3 bucket that will allow all IAM roles and users from different account, to be able to download files from the bucket that is located in my AWS account. Thanks for help
0
votes
0answers
62 views

Delete AWS RDS S3 Exported Snapshots

So I have created S3 Exports from existing snapshots in RDS. I would like to delete duplicated ones. But I don't see any button to delete them. I have already deleted the files from the bucket. But ...
1
vote
0answers
41 views

Combination of S3 bucket, fuse, rclone mount and incron - not detecting changes

and thanks for reading..... I'm trying to setup a method whereby I have an on-premise Centos 7 server which uses rclone (mount) to mount an AWS S3 bucket as a file system. I've installed fuse to make ...
0
votes
0answers
30 views

Uploading file from JS web app to S3 fails due to CORS

I have a JS web app and I'm trying to upload a file to AWS S3 from the client. I've tried everything both locally (localhost:3000) and when deployed to production (Vercel serverless functions). I ...
3
votes
1answer
3k views

Why don't I have permissions to edit an S3 bucket policy when logged on as the person who created the AWS account

I am new to AWS. I am setting up an S3 bucket that I want to use to store media files for a Django App I am developing. I am logged in as the person who created the AWS account, but when I click on ...
0
votes
0answers
22 views

What data storage services in AWS provide strong consistency?

I am trying to draw a comparison of data storage solutions provided by Amazon AWS and one of the main aspects of such analysis I’m trying to address is consistency vs performance/throughput, as that ...
1
vote
0answers
24 views

Fastest way to import files in Spark?

I’m playing around with Spark 3.0.1 and I’m really impressed by the performance with Spark SQL on GB of data. I’m trying to understand what’s the best way to import multiple JSON files in the Spark ...
1
vote
1answer
312 views

Unable to access S3 static website using https

I have followed all the steps from https://aws.amazon.com/premiumsupport/knowledge-center/cloudfront-https-requests-s3/ but my website still cannot be accessed using https. My certificate was issued ...
-1
votes
1answer
114 views

Suggestions for AWS setup wanted

For my next project, I'm giving AWS and server-less a go, but I'm not sure how to reason about the different AWS services. So here's hoping that someone here has a good feel for it. The project ...
0
votes
0answers
11 views

Performance Sending a file from one service to another within a cluster

I have a cluster with lots of different projects. I thought it would be good to have a single S3 service that would manage all the functionality of sending files to the external S3 provider. It would ...
0
votes
0answers
10 views

Amazon EC2 billing for CLOUDWATCH and S3

I am new user in Amazon Web services. I am using only EC2 instance in Mumbai region. When I saw the bill section, it had a bill for CLOUDWATCH and S3 request. But I am not using any of above services ...
0
votes
1answer
50 views

Split Traffic Between S3 Buckets

I have a static S3 site in bucket_old and will rebuild it route by route in S3 bucket_new using the strangler pattern. URLs /home, /contact map to bucket_new All other URLs map to bucket_old What ...
0
votes
1answer
73 views

Cloudfront SSL with Subdomain pointing to S3 bucket works, but still redirects to S3 URL

I've set up an S3 Bucket that I want to use as a CDN but with my own subdomain. For example, myfiles.mydomain.com. So, I set up a Cloudfront web distribution that points to the bucket named "...
0
votes
0answers
75 views

Amazom S3 Bucket size is counting 1 extra file

Using AWS S3, Lets say i have a bucket called X which contains two folders called X1 & X2. I have uploaded 1 file from a folder on my google drive and then uploaded the rest of the other files ...
0
votes
1answer
152 views

How to access an aws s3 bucket using Access Key ID and secret access Key?

I have a free account on AWS and somebody shared me an Access key ID and Secret access key to access their s3 bucket. I am new in AWS, how can I access their s3 bucket using AWS web console?
1
vote
0answers
34 views

Best Practice: Ansys FEA Output Data Storage

I'm trying to make this as least subjective as possible by providing finite inputs and parameters. I truly want to know what is the most resource affective, given the constraints. Given my available ...
0
votes
0answers
38 views

AWS S3 unexpected bucket size increase

So I had a S3 bucket with 2.7M objects and around 1.03TB. Server side encryption was not enabled so no objects were encrypted. Object versioning is also disabled. I activated SSE-S3 and to encrypt the ...
1
vote
0answers
25 views

Data Ingress to S3 from an FTP Server

I have about 1.5TB of data on an FTP server from my web hosting provider that I want to migrate into S3. From what I have read there are a number of ways to do this, including FileZilla Pro which ...
0
votes
0answers
67 views

s3fs mount does not work for read access

I have a Debian 10 server on AWS and it has a mount point on an S3Bucket. The bucket is really not that big, but when I do an ls or anything that attempts to read the bucket the system slows down to ...
9
votes
3answers
1k views

CNAME with S3 buckets

I have a Web and I wanted to move its images to AWS S3. Say it's called mypage.com and I can access to an image like this: https://mypage.com/pics/one.jpg I created a bucket called static.mypage.com ...
0
votes
0answers
52 views

Http response header to be returned on request for 206 status

I am facing a performance issue with my Nodejs server, i am getting a Big document from S3 (200mb+) by ID. when client sends the request i take the ID and query a local table on my data base to get ...
0
votes
0answers
62 views

S3 multipart upload speed

S3 supports multipart uploads, where a file can be split into chunks and each chunk can be uploaded in parallel (up to a number N). According to my tests, this increases the upload speed. Why is it ...
0
votes
1answer
88 views

Universally apply restriction to bucket policy, for all S3 buckets

I want to apply a specific restriction to all S3 buckets. Generally AWS published resources describe a per bucket solution. However this does not solve the issue of other users creating bucket ...
0
votes
1answer
70 views

Need some help granting access to AWS S3 bucket, without exposing to Public

I'm trying to set up an AWS S3 bucket for storing files that a website will dish up to users of the site. The site is an intranet (only logged in users can access any pages which provide links to the ...

1
2 3 4 5
21