Questions tagged [amazon-efs]
Amazon Elastic File System (Amazon EFS) is a managed cloud storage service, accessed using the NFS protocol version 4.1.
71
questions
0
votes
0
answers
32
views
Image Storage Options In AWS
In the case of my scenario, The loading issue seems to have been caused by making HTTP requests with no HTTP timeout set to our CDN. The synchronous requests held the page execution for many minutes ...
- 61
1
vote
0
answers
94
views
Mounting EC2 directory with existing data to Fargate container using EFS
I have an EC2 instance with a huge directory(ex. /large-dir) that containers need to access. Both instance and container share same network and security group. I'm able create and mount an EFS to ...
- 23
0
votes
0
answers
94
views
Can I mount an AWS EFS belonging to one AWS account on an EC2 instance belonging to another account?
We have a server hosted with Engine Yard (which uses EC2 behind the scenes).
We'd like to start a EFS that we own directly. Is it possible to mount this EFS on our engineyard server (they will help)? ...
- 131
0
votes
0
answers
54
views
Can one pre-populate a directory (e.g., on EFS) for an EKS cluster?
We want to run an interactive application on AWS that should be able to read and write a common workspace directory on a shared filesystem. Our approach so far was to use EFS for the shared data, and ...
- 101
-2
votes
1
answer
31
views
How does efs pricing works lambda?
Does the pricing only applicable for storage or there are also other charges associated wit it?
for eg: if a lambda function puts 1Gb/s of file on efs via a private vpc then how much it will charge ...
- 109
0
votes
0
answers
52
views
Can EFS claims live longer than the Kubernetes cluster?
We have been writing scripts for setting up an application on AWS via Pulumi, trying to automate everything from scratch to a running application (but via different intermediate stages). The idea was ...
- 101
0
votes
0
answers
237
views
Mount S3FS mount to EFS additionally and share to other Kubernetes pod
What I need to achieve that is almost done without the EFS/S3FS share:
SFTP pod used by some microservices that process content and deliver back processed content have sftp users that go to tenant ...
0
votes
0
answers
155
views
PHP OpCache on Amazon EFS
Looking for some validation of my thought process here. I don't have the stats to hand to back up my claims, but have enough experience with web hosting with and without EFS to be comfortbale in ...
- 23
0
votes
0
answers
39
views
Recommended ways to manage / edit files on Amazon EFS remotely?
We're starting to use AWS, making use of EFS for application / user data and configuration. Now I wonder what are good ways to access and manage these files remotely, for instance in order to
edit a ...
- 101
0
votes
2
answers
86
views
Given an existing unencrypted AWS EFS volume, can somebody give me a path for encrypting it without data loss?
We have discovered that we really ought to have encrypted the MySql database and EFS volume on our application, at the time of creation. We are now attempting to correct the oversight.
I've read the ...
- 219
2
votes
1
answer
192
views
Hanging Apache requests using Ubuntu AMI on EFS volume
I noticed a strange behaviour on the setup that I created on AWS (eu-south-1 region) to evaluate the migration from our current provider.
I want to deploy 1-n EC2 instances that serves web requests ...
- 31
1
vote
0
answers
59
views
EC2 cannot access to EFS
Our website has mounted on 4 EC2 and 1 EFS. Sometimes EC2 servers cannot access to EFS. When I run commands like cd and ls, they are not responding when access is not available.
When I restart the ...
- 19
0
votes
1
answer
241
views
Dynamic nfs/efs volumes in kubernetes cluster
In the past we used the efs-provisioner to dynamically create volumes for our pods using nfs based storage.
This worked like a charm but it was moved to the kubernetes-retired/external-storage which ...
0
votes
1
answer
466
views
Schedule, Compress, and Transfer files from EC2/EFS to Glacier
I want to create a process to transfer files from EC2 / EFS, to Glacier - but with compression. Say there are directories with timestamps down to the hour. Every hour, I want a process that checks for ...
- 1,119
3
votes
0
answers
319
views
Why does setting NFS sync option for AWS EFS cause nginx/Chrome to chunk or break a file upload?
Question: Why does an NFS mount using the sync option cause nginx and/or Chrome (and only Chrome; not Safari, Firefox, Edge or curl) to chunk or restart the file upload?
Some background:
I have nginx ...
- 295
1
vote
1
answer
5k
views
Root has no write permission to EFS volume
I created a new EFS volume and mounted it with the EFS mount helper.
Here is the /etc/fstab:
LABEL=cloudimg-rootfs / ext4 defaults,discard 0 0
fs-deadbeef:/ /mnt/efs efs _netdev,tls 0 0
...
- 171
2
votes
1
answer
1k
views
Mounting EKS EFS with CSI Times Out before Pod Comes Up
I am using EKS with Kubernetes version 1.15 and when I create a Storageclass, Persistent-Volume, Persistent-Volume-Claim, and Deployment the pod fails with:
Warning FailedAttachVolume 71s (x2 over ...
- 21
1
vote
1
answer
901
views
ECS container not starting: error looking up volume plugin amazon-ecs-volume-plugin
I have a EC2 + EFS + ECS setup on which I run a few docker containers.
My EC2 instance died, and a new one spun up, but when starting the tasks on the new instance, I get the following error message
...
- 13
1
vote
1
answer
54
views
What is the best practice to manage multiple servers and shared a source code in a storage in AWS
I have a monolithic e-commerce website in management and like to expand it to multiple servers using a load balancer and single database server.
load balancer -> server 1 -> db server
...
- 115
1
vote
1
answer
476
views
Amazon EFS performance mounted for a k8 cluster of ec2 instances with small frequent writes [duplicate]
How performant is a shared mounted EFS if there are multiple ec2 instances with multiple containers all writing to separate files in separate directories? Can write performance on one container be ...
- 113
4
votes
2
answers
1k
views
Encrypt at rest existing AWS EFS instances - is it possible?
Based on my understanding of AWS documentation it appears that the only way to encrypt at rest existing EFS instances with some data is to create new EFS instances with encryption enabled and copy the ...
- 195
1
vote
1
answer
1k
views
Why does df say my EFS disk has a capacity of 8 Exabytes?
This is a screenshot from my AWS EC2 instance, which the EFS disk is mounted on:
How can this be?
- 179
0
votes
1
answer
398
views
AWS EFS mount to EC2 Amazon linux
Alright everyone, I have no idea what I am doing wrong here. I am setting up Apache on a linux EC2 instance on AWS. The install for APACHE was fine following these white papers posted by amazon
...
- 13
0
votes
0
answers
850
views
How can I setup an SQLite database for serverless Cloud Functions?
I have some Serverless Lambda Functions and I would like to host an SQLite database with about a GB of data for free or very cheaply (1 USD per month).
My initial thought is to use Amazon Elastic ...
google-cloud-platform
0
votes
1
answer
357
views
How do I know if a file has been fully written when using AWS EFS
So I decided to use EFS as a shared filesystem for my EC2 instances. Our microservices, which are deployed on different instances, need to read and write to a shared space. One service basically puts ...
- 111
7
votes
1
answer
3k
views
I want to put WordPress — all of it — on EFS. Should I?
I have a WordPress site that, as of now, I am running completely on an Amazon Lightsail instance. It gets properly backed up; availability is okay; security is good; it's a simple setup to maintain. ...
- 171
0
votes
1
answer
225
views
No route to host when trying to mount EFS on an EC2 instance
I am getting this output when running a mount -av on my EC2 instance:
I already have the allow incoming in the security group for the IP of EFS and the allow for the IP of the EC2 in the security ...
- 109
2
votes
0
answers
285
views
Failing fast with an EFS NFS mount
We run a Java application distributed across a number of servers, part of which involves the writing and reading of shared files. This side of the application is currently held together by a bunch of ...
- 33
1
vote
1
answer
247
views
How To Save NextCloud Files to EFS
So i have a nextcloud server in an EC2 instance, i have an EFS mounted to it but im not sure how to make nextcloud save the files on the EFS instead of EC2. Are there any guides or tutorials out there ...
1
vote
1
answer
120
views
Where do I store data in AWS AutoScaling Group?
I have been using the Bitnami multi-tier WordPress stack on AWS.
I know how to use autoscaling on AWS, but none of the documentation has showed me where to store changeable data files when using ...
- 858
1
vote
1
answer
939
views
What is the difference between "Amazon Storage Gateway" and another storages?
I use "Amazon Web Services (AWS)" and I think about share storage with more instances "Elastic Compute Cloud (EC2)". Data grows by client usage, and may be searched in those data.
Obviously I should ...
- 809
0
votes
1
answer
878
views
Mounting EFS volume fails on elastic beanstalk deployment
I am trying to learn deploying on elastic beanstalk. I am following this particular doc to deploy a wordpress application with load balancers. Application deployment keeps failing with this error
[...
- 121
1
vote
1
answer
75
views
Are there any benefits of using a dedicated NFS box on EC2 to using EFS directly?
Basically, since we have a bunch of EC2 instances that require a central attached drive, an NFS box was setup (this was before EFS was available in our zone). Is there any reason to (or not to) switch ...
- 123
3
votes
1
answer
540
views
How to share a EFS/s3 with code in a auto scaling group?
the main problem is:
Infrastructure:
Autoscaling (min 1 - max 3)
RDS
ELB
elasticache (redis)
elasticsearch
I want to share a volume (EFS / S3) with the code of my application;
The size of it is ...
- 71
0
votes
1
answer
2k
views
Use Amazon repo in Centos 7
I set up a Centos 7 instance on EC2 and i need to mount a couple of EFS filesystems.
Because Centos 7 and Amazon Linux 2 are pretty similar, I am wondering if could be possible to add Amazon Linux ...
- 347
2
votes
1
answer
200
views
AWS Instances breeding and dying for no apparent reason
This has happened a couple of times since we moved our cluster project from Google to AWS.
We have an EFS volume that's mounted on a load-balanced cluster in a Beanstalk project.
I will be in the ...
- 219
2
votes
3
answers
1k
views
AWS - EFS Replication
I'm looking to replicate an existing EFS to a new EFS and mount it to a cloned environment for testing purposes but can't seem to find any good information on it.
To clarify - I'll be replicating an ...
- 123
3
votes
3
answers
555
views
Using S3 as a alternative to EFS for backup purpose
For centralised backup purpose of specific data from my instances, i was using EBS Volume mounted to that instances. Now we are planning to migrate to another region, but EFS service is not available ...
- 351
1
vote
1
answer
81
views
Mounting EFS Volume in Non available region
Is there any way to mount EFS volume to multiple instances in Mumbai Region. EFS service is currently not available in Mumbai region.Or is there any other service which i can use instead of EFS. I ...
- 351
2
votes
1
answer
1k
views
Inotify does not work on EFS (remote filesystem)
I tried to use inotify notifications, to check for filesystem events, but it does not work. no file-system vent notifier worked.
Is there any inotify utility available for remote file system like EFS,...
- 4,180
1
vote
1
answer
826
views
Set default file permission mode without ACLs
I have an AWS EFS share, which does not support filesystem ACLs. How can I set a folder inside the EFS share to default to mode 664?
- 1,033
0
votes
1
answer
364
views
pv and pvc - kube- efs
I am using PV with EFS. I have created a PV and PVC. My PV goes back to released status after I delete my StatefulSets. When I delete and re-apply my StatefulSets, it does not get attached to the same ...
- 27
2
votes
2
answers
23k
views
How to mount with uid and gid using NFS?
I would like to mount an AWS EFS location with the efs driver which internaly uses nfs. Now the question is: How do I automatically mount a location with specific uid and gid? With sshfs e.g. I would ...
- 199
1
vote
2
answers
429
views
Migrating EFS across regions
Have an EFS with two mount targets in US-N.California region and I need to move all the data over to US-Oregon region. Would appreciate any inputs around that.
- 135
1
vote
1
answer
578
views
Mount NFS4 share as different user
I have an AWS EFS NFS4 share (shareA) that is mounted by some servers where all files are owned by userA/uid=800. I'd like to mount that share onto the b-series servers, configured to look like userB/...
- 1,033
0
votes
1
answer
413
views
Tool to track folder changes recursively in ubuntu 16.04
Is there any tool with which I would be able to track any changes happening recursively inside a particular folder?
I have used inotifytools and fswatch but both are hitting the server performance ...
- 123
2
votes
3
answers
9k
views
NFS mount across EC2 instances as alternative to EFS
I'm configuring an application to run in AWS in "full-framework" deployment. One aspect of this deployment requires each server to be able to see a common storage location. They recommend using a ...
- 211
2
votes
2
answers
2k
views
Amazon EFS as code repository for auto-scaled EC2s
tl;dr: I need to set up a fast automatic sync from EFS to multiple EC2s
I've set up an EC2 Auto-Scaling Group in AWS and I'm looking for the best way to manage code deployments to my instances, with ...
- 143
1
vote
0
answers
113
views
The idiomatic approach to mounting "configuration" volumes on ECS?
I have a docker container that I would like to "port" to ECS. My Dockerfile contains a VOLUME instruction:
VOLUME /app/configuration
So using docker on a linux machine, you just point to the ...
- 111
0
votes
0
answers
2k
views
modifying httpd.conf file apache aws EC2
0
down vote
favorite
I have an EFS file system mounted to multiple EC2 instances. I am trying to change apache config file. I don't want my index.html to be on the EC2 instance hard drive. Instead I ...
- 103