Questions tagged [gcsfuse]
gcsfuse is a user-space file system for interacting with Google Cloud Storage.
66
questions
0
votes
1
answer
111
views
gcsfuse mount with fstab fail to apply 'exec' option
I've mounted gcp bucket with gcsfuse by fstab file.
To ellow execution of scripts and executable from the bucket, added option of 'exec' to the options in the fstab file.
Yet, this option isn't ...
0
votes
0
answers
79
views
Attach Cloud Storage as shared NFS storage for CloudRun
I want to attach a shared static storage that is not ephimeral after cloudrun instance gets terminated. Can we use gFuse with CloudStorage to achieve this ?
IF so by introducing CloudFuse, do we get ...
google-cloud-platform
0
votes
1
answer
59
views
What would happen if I rm -rf on a mounted gcsfuse directory
Let's say I have a mounted bucket at path ~/path/to/mount/point on my local machine. What would happen if I rm -rf ~/path/to/mount/point. Only the mount point directory would be deleted or also all ...
0
votes
1
answer
394
views
Input/output error while trying to mkdir in VM at the mounted location of GCS bucket
I m using gcsfuse in my VM in order to mount with google cloud storage bucket. while running the command "mkdir" as a root user in the mounted location, i am getting the error as below.
...
- 1
0
votes
3
answers
324
views
Google Cloud Storage FUSE Adapter: Use Case?
The README documentation says:
Please treat gcsfuse as beta-quality software.
My question is, would GCS Fuse ever be deployed in a production application? In other words, what is the use case?
0
votes
1
answer
484
views
How to mount on /mnt/ as non-root with gcsfuse
Introduction
I am using gcsfuse to mount my Cloud Storage bucket as a filesystem in my Linux instance hosted on GCE.
Following the documentation from gcsfuse, it recommends to not use "root" ...
0
votes
1
answer
389
views
gcsfuse terminating with error 1 on GKE Autopilot
I am trying to use gcsfuse from a kubernetes pods running in GKE Autopilot.
I read there may be issues with GKE autopilot, but the error I got is different from what is typically reported.
Is gcsfuse ...
0
votes
1
answer
1k
views
gcsfuse failed to open /dev/fuse: Permission denied
I'm running the following command inside a container as an ordinary, non-root user
gcsfuse --foreground --debug_fuse --debug_fs --debug_gcs --debug_http my-bucket /data
and it works locally when I ...
0
votes
0
answers
48
views
DeleteObject followed by UpdateObject
Whenever I delete a file on my gcsfuse mounted file system, the DeleteObject command is always followed by an UpdateObject command, which fails, because the file does not exist anymore. The delete ...
1
vote
2
answers
717
views
GCSFuse setting times of 'XX': Permission denied
Debian Bullseye running GCS Fuse, after a series of updates it now give me the setting times error, for example:
touch hi
touch: setting times of 'hi': Permission denied
I am really at a loss here. ...
1
vote
0
answers
45
views
Latest 0.39.1 version does not allow accessing objects without listing the directory content before
Our servers restart nightly and we noticed that as of yesterday (with the release of 0.39.1) our servers did not properly start up anymore.
We noticed that when we try to access files on a bucket (...
1
vote
1
answer
2k
views
Unable to mount FS as a non root user
I have a nginx image that runs as non root (user is nginx UID 101 GID 101 )in kubernetes. This image also has gcsfuse installed in it.
As the image runs with nginx user, I would like this user to ...
1
vote
1
answer
748
views
Confused about how to manipulate GCS bucket/object permissions
On my laptop I have a directory which contains a subdirectory, which in turn contains a bunch of HTML files. It looks like this:
% ls -lR 2000-09
2000-09:
total 12
drwxrwxr-x 2 skip skip 12288 Nov 18 ...
0
votes
0
answers
663
views
Bucket mounted using gcsfuse doesn't match what's in my cloud storage bucket
I have a Google Cloud Storage bucket and am experimenting with creating a website in Google Cloud Platform (using Python+Flask FWIW). For my initial experiment, I'm using gcsfuse to mount my GCS ...
2
votes
0
answers
425
views
GCSFuse using local disk space
I am having an issue with a bucket mounted on a GCP VM using gcsfuse. Based on the documentation :
Note that new and modified files are also fully staged in the local temporary directory until they ...
2
votes
1
answer
1k
views
gcsfuse failing to install on centos-7
Since Thursday 1st of April we have an issue on a GCP comoute VM which is launched from a base centos-7 image daily.
When launch the startup script will install gcsFuse using the commands listed here:
...
0
votes
1
answer
304
views
GCSFuse v0.33.2 - Large objects (11GB) upload to GCSBucket Fails
Receiving below errors when we try to upload 11 GB file to bucket; also, filesystem is going into "????????" as we can't list the objects available in the bucket.
This requires umount and ...
0
votes
1
answer
195
views
gcsfuse terminating itself on GKE
I have gcsfuse in a deployment on GKE, it was working fine and without any changes in the config it started failing since yesterday.
Received signal 15; terminating.
I have it deployed in 2 different ...
1
vote
1
answer
687
views
export gcsfuse mount so a third client can access files in a storage bucket
I mount a storage bucket to a local directory. /share
Then I try to make this directory - now populated with contents of the object store - available to another machine.
The goal is, that this other ...
0
votes
1
answer
406
views
Writing a Zero Byte File Before Total File Is Written to the Mounted Bucket
I have a mounted bucket using gcsfuse version 0.28. I have a file, say 200MB or greater that I am copying over to the mounted directory/bucket. GCSFUSE first writes a zero byte file, removes it in ...
1
vote
0
answers
1k
views
fusermount: mount failed: Operation not permitted
i want to mount gcp bucket in my lxc container but when i ran gscfuse command it gives me an error
Mounting file system...
daemonize.Run: readFromProcess: sub-process: mountWithArgs: mountWithConn: ...
0
votes
2
answers
1k
views
GCS fuse taking 10 minutes to perform ls
This used to work just fine but in the last two weeks it has been noticed that the connection seems to have slowed down significantly. Performing gsutil ls -lr gs://bucket/folder takes around 10 ...
1
vote
1
answer
327
views
unable to connect to VM in port 22
I unable to connect to my VM instance named "g14" while it already running under project id "vernal-dispatch-280822" using SSH on port 22 (PS attached).also i can't connect over ...
0
votes
1
answer
2k
views
gcsfuse automount on a non root user
Currently I have a VM that runs CentOS 7 and would like to auto mount a bucket using a non root user.
I have installed NextCloud and would like to point local data folder to Google Cloud Storage.
...
0
votes
0
answers
94
views
GCSFuse keeps generating dummy files on mounted bucket that can't be deleted due to retention policy
I'm currently setting up a GCP storage bucket on my instance which will be used for backups. I have currently configured fstab to mount the bucket on startup using the following config.
cpanel1-vm-...
1
vote
2
answers
1k
views
Prevent Cloud CDN from serving cached elements?
I have some problem with Cloud CDN.
I've added a CDN to a bucket connected on an instance.
I need to get an element from CDN, but this element is updated each 1 sec from my server.
What happen is ...
0
votes
1
answer
671
views
How to Change Cloud API access scopes on GCP Compute Engine with out stopping the Instance
I'm using gcsfuse inside Google Compute Engine. I mounted a folder with cloud storage bucket but, unable to create any file inside of it:
touch t1
with an error:
touch: cannot touch 't1': Input/...
0
votes
1
answer
1k
views
gcsfuse fstab configuration with google compute engine
I am running freepbx Centos on a GCE VM. Syncing stops when FreePBX/Asterisk tries to write and create a folder in the mounted folder and FreePBX is unable to write / create folder in the folder. ...
2
votes
1
answer
2k
views
Bad credentials for bucket
I'm getting Bad credentials for bucket trying to mount a GCS bucket using gcsfuse. What I've done:
Created a bucket "mac-gcs-fuse"
Created a service account in the same project with all storage ...
0
votes
1
answer
1k
views
Why can't I use gcsfuse command on a Google Instance with GPU and preinstalled TF and more?
My goal is to mount a Google Storage bucket in my Google Compute instance machine.
I created a Google Compute Instance of type
c2-deeplearning-tf-1-14-cu100
It came with various libraries ...
1
vote
2
answers
415
views
Reliability of (SFTP or WebDAV) with FUSE
I want to mount a Google Cloud Storage bucket as a network drive on my laptop using FUSE and SFTP or WebDAV. Can I use SMB or Samba?
From time to time, I may run a differencing and merging tool (aka ...
- 11
5
votes
3
answers
6k
views
gcsfuse on Alpine Docker
I try to use gcsfuse in order to store application source code on a GCP bucket, here's my Dockerfile:
ARG VERSION
FROM golang:1.12.5-alpine3.9 as gcsfuse-builder
ENV GOPATH /go
RUN apk --update ...
1
vote
2
answers
3k
views
how to make gcsfuse mounted path accessible by other container on same pod
Our goal is to use gcsfuse to mount a google bucket content to some path, and share this path with rest of the pod
So I tried to run our initContainer as privilege mode to run gcsfuse to mount bucket ...
- 11
0
votes
1
answer
1k
views
"no such file or directory" when mounting, built using the golang:alpine Docker image
I created a fork of the LinuxServer.io's docker-transmission image, adding support for Google Cloud Storage.
I used the Ernest (chiaen)'s docker-gcsfuse project to build gcsfuse, namely, extracting ...
3
votes
1
answer
745
views
Mount multiple buckets from different GCP projects with GCS-Fuse
I was able to setup GCP SDK with ease and mount a bucket from the SDK default project using GCS-Fuse. However, I can't find any documentation referring to multiple buckets from different projects. My ...
0
votes
1
answer
1k
views
sftp-server over gcsfuse - large uploads succeed but small uploads (<0.5MB) give error
I'm trying to setup a sftp server over GCS.
An example gcsfuse mount in the container is
gcsfuse -o nonempty --only-dir user1 $BUCKET /home/user1/ftp
When I upload two files using sftp:
sftp> ...
0
votes
1
answer
317
views
When I mmap to a file in a mounted storage bucket, how/when is it downloaded?
I'm using a library that mmaps a large resource file. I'm considering storing that resource file in a gcloud bucket and using GCSFuse to make the file available for mmapping, instead of building my ...
- 3
1
vote
1
answer
442
views
GCS Fuse Customer Managed Key Support
When using GCS Fuse to mount a bucket that uses Customer Managed Encryption Keys you are able to write to the bucket however you are unable to read anything.
When you run an ls against the mount ...
0
votes
0
answers
214
views
Google Cloud App Engine run custom app in privileged mode
I have an app deployed on app engine in Google cloud. I need to be able to use gcsfuse to access shared bucket but you need to run the docker image in privileged mode to access resources.
If I deploy ...
2
votes
2
answers
3k
views
mount GCPs buckets with write access
I can successfully mount my bucket using the following command
sudo mount -t gcsfuse -o rw,noauto,user,implicit_dirs,allow_other fakebucket thebucket/
I can go into the bucket find the subfolders ...
0
votes
1
answer
196
views
Cloud Storage access from PHP aplication
We configure PHP applications on 2 servers with databases in CloudSQL, they require read /write static content in a CloudStorage bucket from PHP applications.
What I did was install GCS Fuse to mount ...
0
votes
1
answer
308
views
Slash added automaticaly before bucket name with fstab and gcsfuse
I use gcsfuse to mount bucket in Google Compute Engine.
For this I use this syntax in my fstab:
my_bucket /my_bucket gcsfuse rw,uid=1001,gid=1002
But gcsfuse process is launched like this:
/usr/...
- 109
0
votes
0
answers
1k
views
Issues syncing when using gcsfuse mounted for a SFTP directory
I am having difficulty using gcsfuse mounting a storage bucket to a directory that is being used for SFTP uploads on a CentOS 7 compute engine VM in GCP. I initially tried to mount it using the basic ...
0
votes
1
answer
502
views
gcsfuse : connection to bucket drops and bucket has to be mounted again
I am running gcsfuse on a GCE and mounted a GCS bucket correctly. I am running a python program that needs to access data from that bucket. To avoid interrupting the program when the GCE connection ...
- 1
0
votes
1
answer
785
views
Error 429: rateLimitExceeded
When adding data continuously to the file on GCS buckets mounted from the VM instance, the following error occurred.
info info Aug 20 13:20:07 myserver gcsfuse gcsfuse: fuse: 2018/08/20 13:20:07....
1
vote
1
answer
953
views
gcsfuse in Google App Engine flexible custom runtime
I'm trying to use gcsfuse to mount GCS buckets in a docker container deployed in a GAE flexible custom runtime instance. This is part of the Dockerfile:
FROM gcr.io/google-appengine/python
RUN apt-...
0
votes
1
answer
2k
views
Trouble Mounting a Bucket
I am trying to mount this public bucket into my Google cloud shell:
gs://mssng-share/released/genomes/ILMN/VCF/*Using mount point:
/home/serdarrowanalytics/mount
I tried:
gcsfuse mssng-share ./...
2
votes
3
answers
4k
views
Can't write any file into bucket only read after gcfuse
I deployed an instance of Wowza Streaming Engine on Google Cloud thank Made a bucket in Google Cloud Storage and mounted it all with GCFUSE. My bucket connected with success and I can see in it and ...
0
votes
1
answer
592
views
Mount wp-content folder with gcsfuse
How do I mount a wp-content folder (wordpress) so the permissions stay in place and the web server can serve the files from the sub directory?
Problem I am facing are:
gcsfuse bucketname /var/www/...
3
votes
2
answers
2k
views
While accessing Fuse mounted Storage bucket, its showing 403 Forbidden Error
I have a google cloud project.
In that project. I have a VM instance.
I mounted uploads folder with Google Cloud Storage bucket using fuse.
While mounting I get an error like this,
Using mount point:...
- 131
Related Tags
google-cloud-storage × 17
fuse × 9
mount × 6
docker × 4
gcloud × 4
fstab × 2
cloud × 2
kubernetes × 2
sftp × 2
permissions × 2
linux × 2
ubuntu × 2
storage × 2
webdav × 1
upload × 1
ubuntu-14.04 × 1
ssh × 1
large-data × 1
nginx × 1
nfs4 × 1
nfs × 1
more related tags
Hot Network Questions
- How to show that two certain chords of a circle passing through the incentre of a given triangle are equal?
- How would you deal with an (actual) etymology that makes no sense in-game?
- My husband (her father) jokes/plays in ways my daughter doesn't always find funny, he says he should be able to do it if he wants
- When and how to make the jump to Assistant Prof
- Are freewheels compatible if they have the same number of sprockets and teeth?
- Airline forcibly changed return flight destination city over a month in advance. Are we eligible for compensation?
- why is Daily power usage measured in kWh and not just kW?
- History of right hand rule
- Why does ranges::for_each return the function?
- Origin of the verb "doppiare" in the nautical slang
- What size screws for this application
- Can lenses defend against lasers in space combat?
- Is it more correct to say "bias of the standard error of the estimator" or "bias of the standard error of the estimate"
- Why does the Psyche Spacecraft use cold gas thrusters?
- How can I convert a QR code from JPG to SVG with perfect clean squares?
- If a Ring-bearer loses all abilities, does that include The Ring's abilities?
- Active character can be defined, but not within \def?
- Best design practice when one python method passes most of its arguments to another method
- Are states required to divide into congressional districts?
- Same flight taking one hour longer with same aircraft on different dates
- After I put a paper on arXiv proving X, I found out someone had previously proved X already. What next?
- how to get the size of the folder in GB which are very large
- How do I intentionally fly into turbulence?
- Overkilling the opponent