Skip to main content

Questions tagged [gcsfuse]

gcsfuse is a user-space file system for interacting with Google Cloud Storage.

Filter by
Sorted by
Tagged with
0 votes
1 answer
143 views

Mounting the GCP Cloud Storage bucket to Directory as a non-root user

I'm running the one service on the Linux based instance in GCP. So for running the service, i have created the one user & group for that i.e.; user: test-user group: test-group Then i need to ...
RAM's user avatar
  • 1
0 votes
1 answer
293 views

gcsfuse mount with fstab fail to apply 'exec' option

I've mounted gcp bucket with gcsfuse by fstab file. To ellow execution of scripts and executable from the bucket, added option of 'exec' to the options in the fstab file. Yet, this option isn't ...
yosisviva's user avatar
0 votes
1 answer
125 views

What would happen if I rm -rf on a mounted gcsfuse directory

Let's say I have a mounted bucket at path ~/path/to/mount/point on my local machine. What would happen if I rm -rf ~/path/to/mount/point. Only the mount point directory would be deleted or also all ...
LucG's user avatar
  • 103
0 votes
1 answer
692 views

Input/output error while trying to mkdir in VM at the mounted location of GCS bucket

I m using gcsfuse in my VM in order to mount with google cloud storage bucket. while running the command "mkdir" as a root user in the mounted location, i am getting the error as below. ...
Prakash's user avatar
1 vote
3 answers
628 views

Google Cloud Storage FUSE Adapter: Use Case?

The README documentation says: Please treat gcsfuse as beta-quality software. My question is, would GCS Fuse ever be deployed in a production application? In other words, what is the use case?
Ronnie Royston's user avatar
0 votes
1 answer
762 views

How to mount on /mnt/ as non-root with gcsfuse

Introduction I am using gcsfuse to mount my Cloud Storage bucket as a filesystem in my Linux instance hosted on GCE. Following the documentation from gcsfuse, it recommends to not use "root" ...
BadProgrammer's user avatar
0 votes
1 answer
498 views

gcsfuse terminating with error 1 on GKE Autopilot

I am trying to use gcsfuse from a kubernetes pods running in GKE Autopilot. I read there may be issues with GKE autopilot, but the error I got is different from what is typically reported. Is gcsfuse ...
mimizone's user avatar
0 votes
1 answer
2k views

gcsfuse failed to open /dev/fuse: Permission denied

I'm running the following command inside a container as an ordinary, non-root user gcsfuse --foreground --debug_fuse --debug_fs --debug_gcs --debug_http my-bucket /data and it works locally when I ...
Kohányi Róbert's user avatar
0 votes
0 answers
58 views

DeleteObject followed by UpdateObject

Whenever I delete a file on my gcsfuse mounted file system, the DeleteObject command is always followed by an UpdateObject command, which fails, because the file does not exist anymore. The delete ...
lawrenceB's user avatar
1 vote
2 answers
944 views

GCSFuse setting times of 'XX': Permission denied

Debian Bullseye running GCS Fuse, after a series of updates it now give me the setting times error, for example: touch hi touch: setting times of 'hi': Permission denied I am really at a loss here. ...
user206106's user avatar
1 vote
0 answers
50 views

Latest 0.39.1 version does not allow accessing objects without listing the directory content before

Our servers restart nightly and we noticed that as of yesterday (with the release of 0.39.1) our servers did not properly start up anymore. We noticed that when we try to access files on a bucket (...
user3118980's user avatar
1 vote
1 answer
2k views

Unable to mount FS as a non root user

I have a nginx image that runs as non root (user is nginx UID 101 GID 101 )in kubernetes. This image also has gcsfuse installed in it. As the image runs with nginx user, I would like this user to ...
Jason Stanley's user avatar
1 vote
2 answers
1k views

Confused about how to manipulate GCS bucket/object permissions

On my laptop I have a directory which contains a subdirectory, which in turn contains a bunch of HTML files. It looks like this: % ls -lR 2000-09 2000-09: total 12 drwxrwxr-x 2 skip skip 12288 Nov 18 ...
smontanaro's user avatar
0 votes
1 answer
907 views

Bucket mounted using gcsfuse doesn't match what's in my cloud storage bucket

I have a Google Cloud Storage bucket and am experimenting with creating a website in Google Cloud Platform (using Python+Flask FWIW). For my initial experiment, I'm using gcsfuse to mount my GCS ...
smontanaro's user avatar
2 votes
0 answers
509 views

GCSFuse using local disk space

I am having an issue with a bucket mounted on a GCP VM using gcsfuse. Based on the documentation : Note that new and modified files are also fully staged in the local temporary directory until they ...
Machiel Richards's user avatar
2 votes
1 answer
2k views

gcsfuse failing to install on centos-7

Since Thursday 1st of April we have an issue on a GCP comoute VM which is launched from a base centos-7 image daily. When launch the startup script will install gcsFuse using the commands listed here: ...
TylrRssl1's user avatar
0 votes
1 answer
359 views

GCSFuse v0.33.2 - Large objects (11GB) upload to GCSBucket Fails

Receiving below errors when we try to upload 11 GB file to bucket; also, filesystem is going into "????????" as we can't list the objects available in the bucket. This requires umount and ...
JayKishan Bairagi's user avatar
0 votes
1 answer
206 views

gcsfuse terminating itself on GKE

I have gcsfuse in a deployment on GKE, it was working fine and without any changes in the config it started failing since yesterday. Received signal 15; terminating. I have it deployed in 2 different ...
Ivan Torrellas's user avatar
1 vote
1 answer
874 views

export gcsfuse mount so a third client can access files in a storage bucket

I mount a storage bucket to a local directory. /share Then I try to make this directory - now populated with contents of the object store - available to another machine. The goal is, that this other ...
geets's user avatar
  • 35
0 votes
1 answer
500 views

Writing a Zero Byte File Before Total File Is Written to the Mounted Bucket

I have a mounted bucket using gcsfuse version 0.28. I have a file, say 200MB or greater that I am copying over to the mounted directory/bucket. GCSFUSE first writes a zero byte file, removes it in ...
Gerard Spinks's user avatar
1 vote
0 answers
1k views

fusermount: mount failed: Operation not permitted

i want to mount gcp bucket in my lxc container but when i ran gscfuse command it gives me an error Mounting file system... daemonize.Run: readFromProcess: sub-process: mountWithArgs: mountWithConn: ...
Asad 's user avatar
  • 11
0 votes
2 answers
1k views

GCS fuse taking 10 minutes to perform ls

This used to work just fine but in the last two weeks it has been noticed that the connection seems to have slowed down significantly. Performing gsutil ls -lr gs://bucket/folder takes around 10 ...
Matthew's user avatar
1 vote
1 answer
406 views

unable to connect to VM in port 22

I unable to connect to my VM instance named "g14" while it already running under project id "vernal-dispatch-280822" using SSH on port 22 (PS attached).also i can't connect over ...
user580061's user avatar
0 votes
1 answer
3k views

gcsfuse automount on a non root user

Currently I have a VM that runs CentOS 7 and would like to auto mount a bucket using a non root user. I have installed NextCloud and would like to point local data folder to Google Cloud Storage. ...
el.severo's user avatar
0 votes
0 answers
116 views

GCSFuse keeps generating dummy files on mounted bucket that can't be deleted due to retention policy

I'm currently setting up a GCP storage bucket on my instance which will be used for backups. I have currently configured fstab to mount the bucket on startup using the following config. cpanel1-vm-...
Cody Rees's user avatar
1 vote
2 answers
2k views

Prevent Cloud CDN from serving cached elements?

I have some problem with Cloud CDN. I've added a CDN to a bucket connected on an instance. I need to get an element from CDN, but this element is updated each 1 sec from my server. What happen is ...
tidpe's user avatar
  • 211
1 vote
1 answer
772 views

How to Change Cloud API access scopes on GCP Compute Engine with out stopping the Instance

I'm using gcsfuse inside Google Compute Engine. I mounted a folder with cloud storage bucket but, unable to create any file inside of it: touch t1 with an error: touch: cannot touch 't1': Input/...
Shashikumar KL's user avatar
0 votes
1 answer
1k views

gcsfuse fstab configuration with google compute engine

I am running freepbx Centos on a GCE VM. Syncing stops when FreePBX/Asterisk tries to write and create a folder in the mounted folder and FreePBX is unable to write / create folder in the folder. ...
Tony Bagalini's user avatar
2 votes
1 answer
2k views

Bad credentials for bucket

I'm getting Bad credentials for bucket trying to mount a GCS bucket using gcsfuse. What I've done: Created a bucket "mac-gcs-fuse" Created a service account in the same project with all storage ...
Tiago Gouvêa's user avatar
0 votes
1 answer
1k views

Why can't I use gcsfuse command on a Google Instance with GPU and preinstalled TF and more?

My goal is to mount a Google Storage bucket in my Google Compute instance machine. I created a Google Compute Instance of type c2-deeplearning-tf-1-14-cu100 It came with various libraries ...
zuzaanto's user avatar
1 vote
2 answers
464 views

Reliability of (SFTP or WebDAV) with FUSE

I want to mount a Google Cloud Storage bucket as a network drive on my laptop using FUSE and SFTP or WebDAV. Can I use SMB or Samba? From time to time, I may run a differencing and merging tool (aka ...
mekineer's user avatar
5 votes
3 answers
6k views

gcsfuse on Alpine Docker

I try to use gcsfuse in order to store application source code on a GCP bucket, here's my Dockerfile: ARG VERSION FROM golang:1.12.5-alpine3.9 as gcsfuse-builder ENV GOPATH /go RUN apk --update ...
Guikingone's user avatar
2 votes
2 answers
3k views

how to make gcsfuse mounted path accessible by other container on same pod

Our goal is to use gcsfuse to mount a google bucket content to some path, and share this path with rest of the pod So I tried to run our initContainer as privilege mode to run gcsfuse to mount bucket ...
Mia's user avatar
  • 21
0 votes
1 answer
1k views

"no such file or directory" when mounting, built using the golang:alpine Docker image

I created a fork of the LinuxServer.io's docker-transmission image, adding support for Google Cloud Storage. I used the Ernest (chiaen)'s docker-gcsfuse project to build gcsfuse, namely, extracting ...
Amitie 10g's user avatar
3 votes
1 answer
978 views

Mount multiple buckets from different GCP projects with GCS-Fuse

I was able to setup GCP SDK with ease and mount a bucket from the SDK default project using GCS-Fuse. However, I can't find any documentation referring to multiple buckets from different projects. My ...
Jeff's user avatar
  • 309
0 votes
1 answer
2k views

sftp-server over gcsfuse - large uploads succeed but small uploads (<0.5MB) give error

I'm trying to setup a sftp server over GCS. An example gcsfuse mount in the container is gcsfuse -o nonempty --only-dir user1 $BUCKET /home/user1/ftp When I upload two files using sftp: sftp> ...
Jasper Humphrey's user avatar
0 votes
1 answer
387 views

When I mmap to a file in a mounted storage bucket, how/when is it downloaded?

I'm using a library that mmaps a large resource file. I'm considering storing that resource file in a gcloud bucket and using GCSFuse to make the file available for mmapping, instead of building my ...
aopal's user avatar
  • 3
1 vote
1 answer
470 views

GCS Fuse Customer Managed Key Support

When using GCS Fuse to mount a bucket that uses Customer Managed Encryption Keys you are able to write to the bucket however you are unable to read anything. When you run an ls against the mount ...
john whitaker's user avatar
0 votes
0 answers
252 views

Google Cloud App Engine run custom app in privileged mode

I have an app deployed on app engine in Google cloud. I need to be able to use gcsfuse to access shared bucket but you need to run the docker image in privileged mode to access resources. If I deploy ...
Graham Wharton's user avatar
2 votes
2 answers
3k views

mount GCPs buckets with write access

I can successfully mount my bucket using the following command sudo mount -t gcsfuse -o rw,noauto,user,implicit_dirs,allow_other fakebucket thebucket/ I can go into the bucket find the subfolders ...
user702846's user avatar
0 votes
1 answer
227 views

Cloud Storage access from PHP aplication

We configure PHP applications on 2 servers with databases in CloudSQL, they require read /write static content in a CloudStorage bucket from PHP applications. What I did was install GCS Fuse to mount ...
Hector Restrepo Jimenez's user avatar
0 votes
1 answer
329 views

Slash added automaticaly before bucket name with fstab and gcsfuse

I use gcsfuse to mount bucket in Google Compute Engine. For this I use this syntax in my fstab: my_bucket /my_bucket gcsfuse rw,uid=1001,gid=1002 But gcsfuse process is launched like this: /usr/...
Bastien D's user avatar
  • 109
0 votes
0 answers
1k views

Issues syncing when using gcsfuse mounted for a SFTP directory

I am having difficulty using gcsfuse mounting a storage bucket to a directory that is being used for SFTP uploads on a CentOS 7 compute engine VM in GCP. I initially tried to mount it using the basic ...
wali's user avatar
  • 51
0 votes
1 answer
591 views

gcsfuse : connection to bucket drops and bucket has to be mounted again

I am running gcsfuse on a GCE and mounted a GCS bucket correctly. I am running a python program that needs to access data from that bucket. To avoid interrupting the program when the GCE connection ...
Leo's user avatar
  • 1
0 votes
1 answer
908 views

Error 429: rateLimitExceeded

When adding data continuously to the file on GCS buckets mounted from the VM instance, the following error occurred. info info Aug 20 13:20:07 myserver gcsfuse gcsfuse: fuse: 2018/08/20 13:20:07....
yosuke's user avatar
  • 1
1 vote
1 answer
1k views

gcsfuse in Google App Engine flexible custom runtime

I'm trying to use gcsfuse to mount GCS buckets in a docker container deployed in a GAE flexible custom runtime instance. This is part of the Dockerfile: FROM gcr.io/google-appengine/python RUN apt-...
dablak's user avatar
  • 111
0 votes
1 answer
2k views

Trouble Mounting a Bucket

I am trying to mount this public bucket into my Google cloud shell: gs://mssng-share/released/genomes/ILMN/VCF/*Using mount point: /home/serdarrowanalytics/mount I tried: gcsfuse mssng-share ./...
James Kozubek's user avatar
2 votes
3 answers
5k views

Can't write any file into bucket only read after gcfuse

I deployed an instance of Wowza Streaming Engine on Google Cloud thank Made a bucket in Google Cloud Storage and mounted it all with GCFUSE. My bucket connected with success and I can see in it and ...
manuperro's user avatar
0 votes
1 answer
631 views

Mount wp-content folder with gcsfuse

How do I mount a wp-content folder (wordpress) so the permissions stay in place and the web server can serve the files from the sub directory? Problem I am facing are: gcsfuse bucketname /var/www/...
elhombre's user avatar
  • 435
3 votes
2 answers
2k views

While accessing Fuse mounted Storage bucket, its showing 403 Forbidden Error

I have a google cloud project. In that project. I have a VM instance. I mounted uploads folder with Google Cloud Storage bucket using fuse. While mounting I get an error like this, Using mount point:...
Eldhose Elias's user avatar