Questions tagged [amazon-efs]
Amazon Elastic File System (Amazon EFS) is a managed cloud storage service, accessed using the NFS protocol version 4.1.
78
questions
0
votes
0
answers
47
views
Sharing EFS with Samba - missing files
I'm trying to share AWS EFS content using Samba (to use it on Windows based instances). The issue is that with some number of files per folder, Samba doesn't show all of them. I tried different linux ...
- 111
0
votes
0
answers
133
views
Why can't my ECS Fargate cluster write to my mounted EFS volume, all deployed with Terraform?
I've got a Terraform deployment that deploys a Docker image into ECS Fargate. It attaches an EFS volume to the container. When I SSH into the container, I see the volume mounted, but I am unable to ...
- 111
1
vote
0
answers
52
views
aws efs describe-access-points no filters?
When I run
aws efs describe-access-points --query 'AccessPoints[*].[AccessPointId]' --output table
I get back 5 different ID's.
There does not appear to be any filter options like there are for other ...
- 11
0
votes
0
answers
32
views
Can EFS be mounted over AWS Client VPN, or only Site-to-Site?
'Amazon EFS now supports AWS VPN', but that was published 23 October 2018; Client VPN was announced on 19 December that year, so 'AWS VPN' referred to what is in current docs usually called 'AWS Site-...
- 151
-1
votes
1
answer
164
views
how EBS and EFS achieve micro second-level latency [closed]
I once monitored the read/write iowait in my EC2 instance which is attached an EBS volume, the iowait column ouput of iostats is only 200 ~ 500us, as I known EBS is actually a network volume and I ...
- 101
0
votes
1
answer
752
views
ECS containers on EC2 cannot mount EFS volumes
I have created an ECS cluster backed by an EC2 auto-scaling group and launched a service in it that uses EFS for NFS storage. The service is running in awsvpc network mode so that I'm able to control ...
- 247
0
votes
0
answers
66
views
SFTP access to EFS - Security
I have recently configured an EFS to which several people in the compan need SFTP access.
I configured AWS transfer family which i've connect to using a VPC endpoint.
Everything is working fine, ...
- 11
0
votes
1
answer
60
views
Trouble with data synchronization and writable per-user subdirectories using EFS
I used this EFS walkthrough to mount my EFS and enable writable per-user subdirectories on my EC2 instance.
According to the documentation, All files and subdirectories the user creates in their home ...
- 111
0
votes
1
answer
25
views
Move Services From Servers in Aws
Could anyone advise the best method(s) to move service from one EC2 instance to another? For example Test-dev we want to spin up and replace with TEST (server) but we want to get CRON services and ...
- 71
0
votes
0
answers
82
views
Debugging reads and writes of an NFS (Amazon EFS)
I have a Kirby CMS website (PHP server behind nginx reverse proxy) running in Amazon EFS. The most recent update of the site lead to 502 Bad Gateway and 504 Gateway Timeout errors.
Looking at the ...
- 131
0
votes
0
answers
62
views
Access denied error on EFS volume from time to time from two EC2 instances
I have two identical EC2 instances with web servers, both have mounted the same EFS volume and everything in the same zone and EBS.
Here is the /etc/fstab output:
fs-12345678.efs.us-east-1.amazonaws....
- 1
0
votes
0
answers
36
views
Image Storage Options In AWS
In the case of my scenario, The loading issue seems to have been caused by making HTTP requests with no HTTP timeout set to our CDN. The synchronous requests held the page execution for many minutes ...
- 71
1
vote
0
answers
247
views
Mounting EC2 directory with existing data to Fargate container using EFS
I have an EC2 instance with a huge directory(ex. /large-dir) that containers need to access. Both instance and container share same network and security group. I'm able create and mount an EFS to ...
- 55
-2
votes
1
answer
180
views
How does efs pricing works lambda?
Does the pricing only applicable for storage or there are also other charges associated wit it?
for eg: if a lambda function puts 1Gb/s of file on efs via a private vpc then how much it will charge ...
- 109
1
vote
0
answers
254
views
PHP OpCache on Amazon EFS
Looking for some validation of my thought process here. I don't have the stats to hand to back up my claims, but have enough experience with web hosting with and without EFS to be comfortbale in ...
- 33
0
votes
0
answers
328
views
Recommended ways to manage / edit files on Amazon EFS remotely?
We're starting to use AWS, making use of EFS for application / user data and configuration. Now I wonder what are good ways to access and manage these files remotely, for instance in order to
edit a ...
- 101
0
votes
2
answers
137
views
Given an existing unencrypted AWS EFS volume, can somebody give me a path for encrypting it without data loss?
We have discovered that we really ought to have encrypted the MySql database and EFS volume on our application, at the time of creation. We are now attempting to correct the oversight.
I've read the ...
- 259
2
votes
1
answer
264
views
Hanging Apache requests using Ubuntu AMI on EFS volume
I noticed a strange behaviour on the setup that I created on AWS (eu-south-1 region) to evaluate the migration from our current provider.
I want to deploy 1-n EC2 instances that serves web requests ...
- 31
1
vote
0
answers
126
views
EC2 cannot access to EFS
Our website has mounted on 4 EC2 and 1 EFS. Sometimes EC2 servers cannot access to EFS. When I run commands like cd and ls, they are not responding when access is not available.
When I restart the ...
- 19
0
votes
1
answer
315
views
Dynamic nfs/efs volumes in kubernetes cluster
In the past we used the efs-provisioner to dynamically create volumes for our pods using nfs based storage.
This worked like a charm but it was moved to the kubernetes-retired/external-storage which ...
0
votes
1
answer
665
views
Schedule, Compress, and Transfer files from EC2/EFS to Glacier
I want to create a process to transfer files from EC2 / EFS, to Glacier - but with compression. Say there are directories with timestamps down to the hour. Every hour, I want a process that checks for ...
- 1,169
3
votes
0
answers
476
views
Why does setting NFS sync option for AWS EFS cause nginx/Chrome to chunk or break a file upload?
Question: Why does an NFS mount using the sync option cause nginx and/or Chrome (and only Chrome; not Safari, Firefox, Edge or curl) to chunk or restart the file upload?
Some background:
I have nginx ...
- 304
2
votes
1
answer
6k
views
Root has no write permission to EFS volume
I created a new EFS volume and mounted it with the EFS mount helper.
Here is the /etc/fstab:
LABEL=cloudimg-rootfs / ext4 defaults,discard 0 0
fs-deadbeef:/ /mnt/efs efs _netdev,tls 0 0
...
- 201
2
votes
1
answer
2k
views
Mounting EKS EFS with CSI Times Out before Pod Comes Up
I am using EKS with Kubernetes version 1.15 and when I create a Storageclass, Persistent-Volume, Persistent-Volume-Claim, and Deployment the pod fails with:
Warning FailedAttachVolume 71s (x2 over ...
- 21
1
vote
1
answer
1k
views
ECS container not starting: error looking up volume plugin amazon-ecs-volume-plugin
I have a EC2 + EFS + ECS setup on which I run a few docker containers.
My EC2 instance died, and a new one spun up, but when starting the tasks on the new instance, I get the following error message
...
- 13
1
vote
1
answer
79
views
What is the best practice to manage multiple servers and shared a source code in a storage in AWS
I have a monolithic e-commerce website in management and like to expand it to multiple servers using a load balancer and single database server.
load balancer -> server 1 -> db server
...
- 115
1
vote
1
answer
564
views
Amazon EFS performance mounted for a k8 cluster of ec2 instances with small frequent writes [duplicate]
How performant is a shared mounted EFS if there are multiple ec2 instances with multiple containers all writing to separate files in separate directories? Can write performance on one container be ...
- 113
4
votes
2
answers
1k
views
Encrypt at rest existing AWS EFS instances - is it possible?
Based on my understanding of AWS documentation it appears that the only way to encrypt at rest existing EFS instances with some data is to create new EFS instances with encryption enabled and copy the ...
- 195
2
votes
1
answer
3k
views
Why does df say my EFS disk has a capacity of 8 Exabytes?
This is a screenshot from my AWS EC2 instance, which the EFS disk is mounted on:
How can this be?
- 209
0
votes
1
answer
679
views
AWS EFS mount to EC2 Amazon linux
Alright everyone, I have no idea what I am doing wrong here. I am setting up Apache on a linux EC2 instance on AWS. The install for APACHE was fine following these white papers posted by amazon
...
- 13
0
votes
0
answers
1k
views
How can I setup an SQLite database for serverless Cloud Functions?
I have some Serverless Lambda Functions and I would like to host an SQLite database with about a GB of data for free or very cheaply (1 USD per month).
My initial thought is to use Amazon Elastic ...
google-cloud-platform
0
votes
1
answer
495
views
How do I know if a file has been fully written when using AWS EFS
So I decided to use EFS as a shared filesystem for my EC2 instances. Our microservices, which are deployed on different instances, need to read and write to a shared space. One service basically puts ...
- 111
7
votes
1
answer
3k
views
I want to put WordPress — all of it — on EFS. Should I?
I have a WordPress site that, as of now, I am running completely on an Amazon Lightsail instance. It gets properly backed up; availability is okay; security is good; it's a simple setup to maintain. ...
- 171
0
votes
1
answer
343
views
No route to host when trying to mount EFS on an EC2 instance
I am getting this output when running a mount -av on my EC2 instance:
I already have the allow incoming in the security group for the IP of EFS and the allow for the IP of the EC2 in the security ...
- 149
2
votes
0
answers
376
views
Failing fast with an EFS NFS mount
We run a Java application distributed across a number of servers, part of which involves the writing and reading of shared files. This side of the application is currently held together by a bunch of ...
- 33
1
vote
1
answer
323
views
How To Save NextCloud Files to EFS
So i have a nextcloud server in an EC2 instance, i have an EFS mounted to it but im not sure how to make nextcloud save the files on the EFS instead of EC2. Are there any guides or tutorials out there ...
1
vote
1
answer
161
views
Where do I store data in AWS AutoScaling Group?
I have been using the Bitnami multi-tier WordPress stack on AWS.
I know how to use autoscaling on AWS, but none of the documentation has showed me where to store changeable data files when using ...
- 868
1
vote
1
answer
1k
views
What is the difference between "Amazon Storage Gateway" and another storages?
I use "Amazon Web Services (AWS)" and I think about share storage with more instances "Elastic Compute Cloud (EC2)". Data grows by client usage, and may be searched in those data.
Obviously I should ...
- 819
0
votes
1
answer
1k
views
Mounting EFS volume fails on elastic beanstalk deployment
I am trying to learn deploying on elastic beanstalk. I am following this particular doc to deploy a wordpress application with load balancers. Application deployment keeps failing with this error
[...
- 121
1
vote
1
answer
101
views
Are there any benefits of using a dedicated NFS box on EC2 to using EFS directly?
Basically, since we have a bunch of EC2 instances that require a central attached drive, an NFS box was setup (this was before EFS was available in our zone). Is there any reason to (or not to) switch ...
- 123
3
votes
1
answer
781
views
How to share a EFS/s3 with code in a auto scaling group?
the main problem is:
Infrastructure:
Autoscaling (min 1 - max 3)
RDS
ELB
elasticache (redis)
elasticsearch
I want to share a volume (EFS / S3) with the code of my application;
The size of it is ...
- 71
0
votes
1
answer
3k
views
Use Amazon repo in Centos 7
I set up a Centos 7 instance on EC2 and i need to mount a couple of EFS filesystems.
Because Centos 7 and Amazon Linux 2 are pretty similar, I am wondering if could be possible to add Amazon Linux ...
- 347
2
votes
1
answer
240
views
AWS Instances breeding and dying for no apparent reason
This has happened a couple of times since we moved our cluster project from Google to AWS.
We have an EFS volume that's mounted on a load-balanced cluster in a Beanstalk project.
I will be in the ...
- 259
2
votes
3
answers
2k
views
AWS - EFS Replication
I'm looking to replicate an existing EFS to a new EFS and mount it to a cloned environment for testing purposes but can't seem to find any good information on it.
To clarify - I'll be replicating an ...
- 123
3
votes
3
answers
621
views
Using S3 as a alternative to EFS for backup purpose
For centralised backup purpose of specific data from my instances, i was using EBS Volume mounted to that instances. Now we are planning to migrate to another region, but EFS service is not available ...
- 481
1
vote
1
answer
87
views
Mounting EFS Volume in Non available region
Is there any way to mount EFS volume to multiple instances in Mumbai Region. EFS service is currently not available in Mumbai region.Or is there any other service which i can use instead of EFS. I ...
- 481
3
votes
1
answer
2k
views
Inotify does not work on EFS (remote filesystem)
I tried to use inotify notifications, to check for filesystem events, but it does not work. no file-system vent notifier worked.
Is there any inotify utility available for remote file system like EFS,...
- 4,279
1
vote
1
answer
1k
views
Set default file permission mode without ACLs
I have an AWS EFS share, which does not support filesystem ACLs. How can I set a folder inside the EFS share to default to mode 664?
- 1,043
0
votes
1
answer
455
views
pv and pvc - kube- efs
I am using PV with EFS. I have created a PV and PVC. My PV goes back to released status after I delete my StatefulSets. When I delete and re-apply my StatefulSets, it does not get attached to the same ...
- 27
2
votes
2
answers
27k
views
How to mount with uid and gid using NFS?
I would like to mount an AWS EFS location with the efs driver which internaly uses nfs. Now the question is: How do I automatically mount a location with specific uid and gid? With sshfs e.g. I would ...
- 209