Questions tagged [gcsfuse]

gcsfuse is a user-space file system for interacting with Google Cloud Storage.

Filter by
Sorted by
Tagged with
0
votes
0answers
13 views

Getting a list of all project owners , folder path from GCP

I am trying to get a list of all GCP projects on the domain and the project owners and export it to a CSV, I have written a script which provide me details of projectid, name, projectnumber date and ...
-1
votes
2answers
50 views

GCSFuse setting times of 'XX': Permission denied

Debian Bullseye running GCS Fuse, after a series of updates it now give me the setting times error, for example: touch hi touch: setting times of 'hi': Permission denied I am really at a loss here. ...
0
votes
0answers
13 views

Latest 0.39.1 version does not allow accessing objects without listing the directory content before

Our servers restart nightly and we noticed that as of yesterday (with the release of 0.39.1) our servers did not properly start up anymore. We noticed that when we try to access files on a bucket (...
0
votes
1answer
42 views

Unable to mount FS as a non root user

I have a nginx image that runs as non root (user is nginx UID 101 GID 101 )in kubernetes. This image also has gcsfuse installed in it. As the image runs with nginx user, I would like this user to ...
1
vote
1answer
95 views

Confused about how to manipulate GCS bucket/object permissions

On my laptop I have a directory which contains a subdirectory, which in turn contains a bunch of HTML files. It looks like this: % ls -lR 2000-09 2000-09: total 12 drwxrwxr-x 2 skip skip 12288 Nov 18 ...
0
votes
0answers
76 views

Bucket mounted using gcsfuse doesn't match what's in my cloud storage bucket

I have a Google Cloud Storage bucket and am experimenting with creating a website in Google Cloud Platform (using Python+Flask FWIW). For my initial experiment, I'm using gcsfuse to mount my GCS ...
1
vote
0answers
116 views

GCSFuse using local disk space

I am having an issue with a bucket mounted on a GCP VM using gcsfuse. Based on the documentation : Note that new and modified files are also fully staged in the local temporary directory until they ...
2
votes
1answer
365 views

gcsfuse failing to install on centos-7

Since Thursday 1st of April we have an issue on a GCP comoute VM which is launched from a base centos-7 image daily. When launch the startup script will install gcsFuse using the commands listed here: ...
0
votes
1answer
108 views

GCSFuse v0.33.2 - Large objects (11GB) upload to GCSBucket Fails

Receiving below errors when we try to upload 11 GB file to bucket; also, filesystem is going into "????????" as we can't list the objects available in the bucket. This requires umount and ...
0
votes
1answer
93 views

gcsfuse terminating itself on GKE

I have gcsfuse in a deployment on GKE, it was working fine and without any changes in the config it started failing since yesterday. Received signal 15; terminating. I have it deployed in 2 different ...
1
vote
1answer
226 views

export gcsfuse mount so a third client can access files in a storage bucket

I mount a storage bucket to a local directory. /share Then I try to make this directory - now populated with contents of the object store - available to another machine. The goal is, that this other ...
0
votes
1answer
93 views

Writing a Zero Byte File Before Total File Is Written to the Mounted Bucket

I have a mounted bucket using gcsfuse version 0.28. I have a file, say 200MB or greater that I am copying over to the mounted directory/bucket. GCSFUSE first writes a zero byte file, removes it in ...
1
vote
0answers
555 views

fusermount: mount failed: Operation not permitted

i want to mount gcp bucket in my lxc container but when i ran gscfuse command it gives me an error Mounting file system... daemonize.Run: readFromProcess: sub-process: mountWithArgs: mountWithConn: ...
0
votes
2answers
356 views

GCS fuse taking 10 minutes to perform ls

This used to work just fine but in the last two weeks it has been noticed that the connection seems to have slowed down significantly. Performing gsutil ls -lr gs://bucket/folder takes around 10 ...
1
vote
1answer
120 views

unable to connect to VM in port 22

I unable to connect to my VM instance named "g14" while it already running under project id "vernal-dispatch-280822" using SSH on port 22 (PS attached).also i can't connect over ...
-1
votes
1answer
1k views

gcsfuse automount on a non root user

Currently I have a VM that runs CentOS 7 and would like to auto mount a bucket using a non root user. I have installed NextCloud and would like to point local data folder to Google Cloud Storage. ...
0
votes
0answers
60 views

GCSFuse keeps generating dummy files on mounted bucket that can't be deleted due to retention policy

I'm currently setting up a GCP storage bucket on my instance which will be used for backups. I have currently configured fstab to mount the bucket on startup using the following config. cpanel1-vm-...
1
vote
2answers
562 views

Prevent Cloud CDN from serving cached elements?

I have some problem with Cloud CDN. I've added a CDN to a bucket connected on an instance. I need to get an element from CDN, but this element is updated each 1 sec from my server. What happen is ...
0
votes
1answer
375 views

How to Change Cloud API access scopes on GCP Compute Engine with out stopping the Instance

I'm using gcsfuse inside Google Compute Engine. I mounted a folder with cloud storage bucket but, unable to create any file inside of it: touch t1 with an error: touch: cannot touch 't1': Input/...
0
votes
1answer
297 views

gcsfuse fstab configuration with google compute engine

I am running freepbx Centos on a GCE VM. Syncing stops when FreePBX/Asterisk tries to write and create a folder in the mounted folder and FreePBX is unable to write / create folder in the folder. ...
2
votes
1answer
1k views

Bad credentials for bucket

I'm getting Bad credentials for bucket trying to mount a GCS bucket using gcsfuse. What I've done: Created a bucket "mac-gcs-fuse" Created a service account in the same project with all storage ...
0
votes
1answer
430 views

Why can't I use gcsfuse command on a Google Instance with GPU and preinstalled TF and more?

My goal is to mount a Google Storage bucket in my Google Compute instance machine. I created a Google Compute Instance of type c2-deeplearning-tf-1-14-cu100 It came with various libraries ...
1
vote
2answers
279 views

Reliability of (SFTP or WebDAV) with FUSE

I want to mount a Google Cloud Storage bucket as a network drive on my laptop using FUSE and SFTP or WebDAV. Can I use SMB or Samba? From time to time, I may run a differencing and merging tool (aka ...
3
votes
3answers
4k views

gcsfuse on Alpine Docker

I try to use gcsfuse in order to store application source code on a GCP bucket, here's my Dockerfile: ARG VERSION FROM golang:1.12.5-alpine3.9 as gcsfuse-builder ENV GOPATH /go RUN apk --update ...
1
vote
2answers
1k views

how to make gcsfuse mounted path accessible by other container on same pod

Our goal is to use gcsfuse to mount a google bucket content to some path, and share this path with rest of the pod So I tried to run our initContainer as privilege mode to run gcsfuse to mount bucket ...
0
votes
1answer
766 views

"no such file or directory" when mounting, built using the golang:alpine Docker image

I created a fork of the LinuxServer.io's docker-transmission image, adding support for Google Cloud Storage. I used the Ernest (chiaen)'s docker-gcsfuse project to build gcsfuse, namely, extracting ...
2
votes
1answer
504 views

Mount multiple buckets from different GCP projects with GCS-Fuse

I was able to setup GCP SDK with ease and mount a bucket from the SDK default project using GCS-Fuse. However, I can't find any documentation referring to multiple buckets from different projects. My ...
0
votes
1answer
959 views

sftp-server over gcsfuse - large uploads succeed but small uploads (<0.5MB) give error

I'm trying to setup a sftp server over GCS. An example gcsfuse mount in the container is gcsfuse -o nonempty --only-dir user1 $BUCKET /home/user1/ftp When I upload two files using sftp: sftp> ...
0
votes
1answer
178 views

When I mmap to a file in a mounted storage bucket, how/when is it downloaded?

I'm using a library that mmaps a large resource file. I'm considering storing that resource file in a gcloud bucket and using GCSFuse to make the file available for mmapping, instead of building my ...
1
vote
1answer
369 views

GCS Fuse Customer Managed Key Support

When using GCS Fuse to mount a bucket that uses Customer Managed Encryption Keys you are able to write to the bucket however you are unable to read anything. When you run an ls against the mount ...
0
votes
0answers
155 views

Google Cloud App Engine run custom app in privileged mode

I have an app deployed on app engine in Google cloud. I need to be able to use gcsfuse to access shared bucket but you need to run the docker image in privileged mode to access resources. If I deploy ...
0
votes
2answers
2k views

mount GCPs buckets with write access

I can successfully mount my bucket using the following command sudo mount -t gcsfuse -o rw,noauto,user,implicit_dirs,allow_other fakebucket thebucket/ I can go into the bucket find the subfolders ...
0
votes
1answer
152 views

Cloud Storage access from PHP aplication

We configure PHP applications on 2 servers with databases in CloudSQL, they require read /write static content in a CloudStorage bucket from PHP applications. What I did was install GCS Fuse to mount ...
0
votes
1answer
219 views

Slash added automaticaly before bucket name with fstab and gcsfuse

I use gcsfuse to mount bucket in Google Compute Engine. For this I use this syntax in my fstab: my_bucket /my_bucket gcsfuse rw,uid=1001,gid=1002 But gcsfuse process is launched like this: /usr/...
0
votes
0answers
910 views

Issues syncing when using gcsfuse mounted for a SFTP directory

I am having difficulty using gcsfuse mounting a storage bucket to a directory that is being used for SFTP uploads on a CentOS 7 compute engine VM in GCP. I initially tried to mount it using the basic ...
0
votes
1answer
282 views

gcsfuse : connection to bucket drops and bucket has to be mounted again

I am running gcsfuse on a GCE and mounted a GCS bucket correctly. I am running a python program that needs to access data from that bucket. To avoid interrupting the program when the GCE connection ...
0
votes
1answer
525 views

Error 429: rateLimitExceeded

When adding data continuously to the file on GCS buckets mounted from the VM instance, the following error occurred. info info Aug 20 13:20:07 myserver gcsfuse gcsfuse: fuse: 2018/08/20 13:20:07....
1
vote
1answer
778 views

gcsfuse in Google App Engine flexible custom runtime

I'm trying to use gcsfuse to mount GCS buckets in a docker container deployed in a GAE flexible custom runtime instance. This is part of the Dockerfile: FROM gcr.io/google-appengine/python RUN apt-...
0
votes
1answer
1k views

Trouble Mounting a Bucket

I am trying to mount this public bucket into my Google cloud shell: gs://mssng-share/released/genomes/ILMN/VCF/*Using mount point: /home/serdarrowanalytics/mount I tried: gcsfuse mssng-share ./...
2
votes
3answers
3k views

Can't write any file into bucket only read after gcfuse

I deployed an instance of Wowza Streaming Engine on Google Cloud thank Made a bucket in Google Cloud Storage and mounted it all with GCFUSE. My bucket connected with success and I can see in it and ...
0
votes
1answer
431 views

Mount wp-content folder with gcsfuse

How do I mount a wp-content folder (wordpress) so the permissions stay in place and the web server can serve the files from the sub directory? Problem I am facing are: gcsfuse bucketname /var/www/...
1
vote
2answers
954 views

While accessing Fuse mounted Storage bucket, its showing 403 Forbidden Error

I have a google cloud project. In that project. I have a VM instance. I mounted uploads folder with Google Cloud Storage bucket using fuse. While mounting I get an error like this, Using mount point:...
0
votes
1answer
2k views

Can I mount google cloud storage bucket as disk to linux instance with custom size?

We can mount Google Cloud Storage Bucket as a disk to an instance using Cloud FUSE. By doing so, we are getting 1 PiB as disk size(bucket). Can anybody help me understand why we are getting 1 PiB ...
0
votes
1answer
830 views

Installing a binary on a k8s virtual machine with Container-Optimized OS

Pretty simple situation. I use container engine to create k8s clusters. I need to fuse some buckets to the nodes and want to use this project for that purpose: https://github.com/GoogleCloudPlatform/...
0
votes
2answers
1k views

Google Cloud Storage moun + nginx user

I'm able to mount my Google Cloud Storage with gcsfuse but I need nginx to write in it. How do I do that? I've added nginx to the mounting users group and nothing. Probably because the mount has 755 ...
1
vote
1answer
763 views

What shared, high volume storage technology should be used when hosting in Google Cloud?

Given an auto-scaling web server farm setup that needs access to a very large number of image files, we are currently using Google Cloud Storage with a mounted FUSE folder on each web server so that ...
2
votes
1answer
6k views

GCSFuse - Fusermount: mountpoint is not empty

Using gcsfuse to mount a point locally on a server within a script. Running on an Ubuntu 14 LTS server. I have two fuse mount points and the script transfers data from other mount points into them. ...
3
votes
1answer
923 views

Does gcsfuse sync all data to the system it is mounted on?

The scenario: I have mounted a gcsfuse drive to my docker container so I can store and read data from Google Cloud Storage The docker container only has a few gigs of storage, but I might have ...
0
votes
1answer
978 views

Store large files in Google Cloud Storage without local copy

I would like to store large binary files (mongodump bson files) in a Google Cloud Storage bucket mounted on a Google Compute instance through gcsfuse. Everything is working well, except that fuse is ...
0
votes
1answer
238 views

With gcsfuse, how much remaining space is available in a bucket when mounted?

I'm about to evaluate gcsfuse for use in a system with a database daemon. The daemon is peculiar. It computes its usable available disk space subtactively, rather than additively; that is, it ensures ...