Questions tagged [gcsfuse]

gcsfuse is a user-space file system for interacting with Google Cloud Storage.

Filter by
Sorted by
Tagged with
1
vote
0answers
24 views

GCSFuse using local disk space

I am having an issue with a bucket mounted on a GCP VM using gcsfuse. Based on the documentation : Note that new and modified files are also fully staged in the local temporary directory until they ...
2
votes
1answer
84 views

gcsfuse failing to install on centos-7

Since Thursday 1st of April we have an issue on a GCP comoute VM which is launched from a base centos-7 image daily. When launch the startup script will install gcsFuse using the commands listed here: ...
0
votes
1answer
52 views

GCSFuse v0.33.2 - Large objects (11GB) upload to GCSBucket Fails

Receiving below errors when we try to upload 11 GB file to bucket; also, filesystem is going into "????????" as we can't list the objects available in the bucket. This requires umount and ...
0
votes
1answer
57 views

gcsfuse terminating itself on GKE

I have gcsfuse in a deployment on GKE, it was working fine and without any changes in the config it started failing since yesterday. Received signal 15; terminating. I have it deployed in 2 different ...
1
vote
1answer
82 views

export gcsfuse mount so a third client can access files in a storage bucket

I mount a storage bucket to a local directory. /share Then I try to make this directory - now populated with contents of the object store - available to another machine. The goal is, that this other ...
0
votes
1answer
56 views

Writing a Zero Byte File Before Total File Is Written to the Mounted Bucket

I have a mounted bucket using gcsfuse version 0.28. I have a file, say 200MB or greater that I am copying over to the mounted directory/bucket. GCSFUSE first writes a zero byte file, removes it in ...
0
votes
0answers
432 views

fusermount: mount failed: Operation not permitted

i want to mount gcp bucket in my lxc container but when i ran gscfuse command it gives me an error Mounting file system... daemonize.Run: readFromProcess: sub-process: mountWithArgs: mountWithConn: ...
0
votes
2answers
162 views

GCS fuse taking 10 minutes to perform ls

This used to work just fine but in the last two weeks it has been noticed that the connection seems to have slowed down significantly. Performing gsutil ls -lr gs://bucket/folder takes around 10 ...
1
vote
1answer
93 views

unable to connect to VM in port 22

I unable to connect to my VM instance named "g14" while it already running under project id "vernal-dispatch-280822" using SSH on port 22 (PS attached).also i can't connect over ...
-1
votes
1answer
886 views

gcsfuse automount on a non root user

Currently I have a VM that runs CentOS 7 and would like to auto mount a bucket using a non root user. I have installed NextCloud and would like to point local data folder to Google Cloud Storage. ...
0
votes
0answers
46 views

GCSFuse keeps generating dummy files on mounted bucket that can't be deleted due to retention policy

I'm currently setting up a GCP storage bucket on my instance which will be used for backups. I have currently configured fstab to mount the bucket on startup using the following config. cpanel1-vm-...
1
vote
2answers
286 views

Prevent Cloud CDN from serving cached elements?

I have some problem with Cloud CDN. I've added a CDN to a bucket connected on an instance. I need to get an element from CDN, but this element is updated each 1 sec from my server. What happen is ...
0
votes
1answer
278 views

How to Change Cloud API access scopes on GCP Compute Engine with out stopping the Instance

I'm using gcsfuse inside Google Compute Engine. I mounted a folder with cloud storage bucket but, unable to create any file inside of it: touch t1 with an error: touch: cannot touch 't1': Input/...
0
votes
1answer
157 views

gcsfuse fstab configuration with google compute engine

I am running freepbx Centos on a GCE VM. Syncing stops when FreePBX/Asterisk tries to write and create a folder in the mounted folder and FreePBX is unable to write / create folder in the folder. ...
2
votes
1answer
1k views

Bad credentials for bucket

I'm getting Bad credentials for bucket trying to mount a GCS bucket using gcsfuse. What I've done: Created a bucket "mac-gcs-fuse" Created a service account in the same project with all storage ...
0
votes
1answer
301 views

Why can't I use gcsfuse command on a Google Instance with GPU and preinstalled TF and more?

My goal is to mount a Google Storage bucket in my Google Compute instance machine. I created a Google Compute Instance of type c2-deeplearning-tf-1-14-cu100 It came with various libraries ...
1
vote
2answers
240 views

Reliability of (SFTP or WebDAV) with FUSE

I want to mount a Google Cloud Storage bucket as a network drive on my laptop using FUSE and SFTP or WebDAV. Can I use SMB or Samba? From time to time, I may run a differencing and merging tool (aka ...
2
votes
2answers
2k views

gcsfuse on Alpine Docker

I try to use gcsfuse in order to store application source code on a GCP bucket, here's my Dockerfile: ARG VERSION FROM golang:1.12.5-alpine3.9 as gcsfuse-builder ENV GOPATH /go RUN apk --update ...
1
vote
2answers
1k views

how to make gcsfuse mounted path accessible by other container on same pod

Our goal is to use gcsfuse to mount a google bucket content to some path, and share this path with rest of the pod So I tried to run our initContainer as privilege mode to run gcsfuse to mount bucket ...
0
votes
1answer
622 views

“no such file or directory” when mounting, built using the golang:alpine Docker image

I created a fork of the LinuxServer.io's docker-transmission image, adding support for Google Cloud Storage. I used the Ernest (chiaen)'s docker-gcsfuse project to build gcsfuse, namely, extracting ...
2
votes
1answer
378 views

Mount multiple buckets from different GCP projects with GCS-Fuse

I was able to setup GCP SDK with ease and mount a bucket from the SDK default project using GCS-Fuse. However, I can't find any documentation referring to multiple buckets from different projects. My ...
0
votes
1answer
721 views

sftp-server over gcsfuse - large uploads succeed but small uploads (<0.5MB) give error

I'm trying to setup a sftp server over GCS. An example gcsfuse mount in the container is gcsfuse -o nonempty --only-dir user1 $BUCKET /home/user1/ftp When I upload two files using sftp: sftp> ...
0
votes
1answer
160 views

When I mmap to a file in a mounted storage bucket, how/when is it downloaded?

I'm using a library that mmaps a large resource file. I'm considering storing that resource file in a gcloud bucket and using GCSFuse to make the file available for mmapping, instead of building my ...
1
vote
1answer
317 views

GCS Fuse Customer Managed Key Support

When using GCS Fuse to mount a bucket that uses Customer Managed Encryption Keys you are able to write to the bucket however you are unable to read anything. When you run an ls against the mount ...
0
votes
0answers
119 views

Google Cloud App Engine run custom app in privileged mode

I have an app deployed on app engine in Google cloud. I need to be able to use gcsfuse to access shared bucket but you need to run the docker image in privileged mode to access resources. If I deploy ...
0
votes
2answers
1k views

mount GCPs buckets with write access

I can successfully mount my bucket using the following command sudo mount -t gcsfuse -o rw,noauto,user,implicit_dirs,allow_other fakebucket thebucket/ I can go into the bucket find the subfolders ...
0
votes
1answer
130 views

Cloud Storage access from PHP aplication

We configure PHP applications on 2 servers with databases in CloudSQL, they require read /write static content in a CloudStorage bucket from PHP applications. What I did was install GCS Fuse to mount ...
0
votes
1answer
210 views

Slash added automaticaly before bucket name with fstab and gcsfuse

I use gcsfuse to mount bucket in Google Compute Engine. For this I use this syntax in my fstab: my_bucket /my_bucket gcsfuse rw,uid=1001,gid=1002 But gcsfuse process is launched like this: /usr/...
0
votes
0answers
813 views

Issues syncing when using gcsfuse mounted for a SFTP directory

I am having difficulty using gcsfuse mounting a storage bucket to a directory that is being used for SFTP uploads on a CentOS 7 compute engine VM in GCP. I initially tried to mount it using the basic ...
0
votes
1answer
239 views

gcsfuse : connection to bucket drops and bucket has to be mounted again

I am running gcsfuse on a GCE and mounted a GCS bucket correctly. I am running a python program that needs to access data from that bucket. To avoid interrupting the program when the GCE connection ...
0
votes
1answer
471 views

Error 429: rateLimitExceeded

When adding data continuously to the file on GCS buckets mounted from the VM instance, the following error occurred. info info Aug 20 13:20:07 myserver gcsfuse gcsfuse: fuse: 2018/08/20 13:20:07....
0
votes
1answer
649 views

gcsfuse in Google App Engine flexible custom runtime

I'm trying to use gcsfuse to mount GCS buckets in a docker container deployed in a GAE flexible custom runtime instance. This is part of the Dockerfile: FROM gcr.io/google-appengine/python RUN apt-...
0
votes
1answer
1k views

Trouble Mounting a Bucket

I am trying to mount this public bucket into my Google cloud shell: gs://mssng-share/released/genomes/ILMN/VCF/*Using mount point: /home/serdarrowanalytics/mount I tried: gcsfuse mssng-share ./...
2
votes
3answers
2k views

Can't write any file into bucket only read after gcfuse

I deployed an instance of Wowza Streaming Engine on Google Cloud thank Made a bucket in Google Cloud Storage and mounted it all with GCFUSE. My bucket connected with success and I can see in it and ...
0
votes
1answer
384 views

Mount wp-content folder with gcsfuse

How do I mount a wp-content folder (wordpress) so the permissions stay in place and the web server can serve the files from the sub directory? Problem I am facing are: gcsfuse bucketname /var/www/...
1
vote
2answers
679 views

While accessing Fuse mounted Storage bucket, its showing 403 Forbidden Error

I have a google cloud project. In that project. I have a VM instance. I mounted uploads folder with Google Cloud Storage bucket using fuse. While mounting I get an error like this, Using mount point:...
0
votes
1answer
2k views

Can I mount google cloud storage bucket as disk to linux instance with custom size?

We can mount Google Cloud Storage Bucket as a disk to an instance using Cloud FUSE. By doing so, we are getting 1 PiB as disk size(bucket). Can anybody help me understand why we are getting 1 PiB ...
0
votes
1answer
820 views

Installing a binary on a k8s virtual machine with Container-Optimized OS

Pretty simple situation. I use container engine to create k8s clusters. I need to fuse some buckets to the nodes and want to use this project for that purpose: https://github.com/GoogleCloudPlatform/...
0
votes
2answers
949 views

Google Cloud Storage moun + nginx user

I'm able to mount my Google Cloud Storage with gcsfuse but I need nginx to write in it. How do I do that? I've added nginx to the mounting users group and nothing. Probably because the mount has 755 ...
1
vote
1answer
720 views

What shared, high volume storage technology should be used when hosting in Google Cloud?

Given an auto-scaling web server farm setup that needs access to a very large number of image files, we are currently using Google Cloud Storage with a mounted FUSE folder on each web server so that ...
2
votes
1answer
6k views

GCSFuse - Fusermount: mountpoint is not empty

Using gcsfuse to mount a point locally on a server within a script. Running on an Ubuntu 14 LTS server. I have two fuse mount points and the script transfers data from other mount points into them. ...
3
votes
1answer
853 views

Does gcsfuse sync all data to the system it is mounted on?

The scenario: I have mounted a gcsfuse drive to my docker container so I can store and read data from Google Cloud Storage The docker container only has a few gigs of storage, but I might have ...
0
votes
1answer
878 views

Store large files in Google Cloud Storage without local copy

I would like to store large binary files (mongodump bson files) in a Google Cloud Storage bucket mounted on a Google Compute instance through gcsfuse. Everything is working well, except that fuse is ...
0
votes
1answer
217 views

With gcsfuse, how much remaining space is available in a bucket when mounted?

I'm about to evaluate gcsfuse for use in a system with a database daemon. The daemon is peculiar. It computes its usable available disk space subtactively, rather than additively; that is, it ensures ...
1
vote
2answers
11k views

fusermount: fuse device not found, try 'modprobe fuse' first

I am running an instance on gcloud compute engine. I need to mount a Google storage bucket (which belongs to a different project) to my instance. The instance runs on Debian Wheezy. I have installed ...
10
votes
2answers
11k views

permission errors using gcsfuse as nonroot user on google compute instance

We are currently trying to demo the google cloud platform for some workloads that require lots of storage. We are trying to use google cloud storage but are having problems mounting the buckets using ...
-1
votes
3answers
9k views

Mounting google storage bucket folder using gcsfuse

0 down vote favorite I am not able to mount a specific folder inside the google storage bucket On OS X, this program allows you to mount buckets using the mount command. (On Linux, only root can do ...
1
vote
1answer
198 views

GCS Fuse not setting ContentType

We are using using GCS Fuse to manage content on some GCS buckets, but an issue we're running into is that files written by gcsfuse always seem to have the content-type of 'application/octet-stream' ...
1
vote
1answer
526 views

Fusing a google bucket on centos 6.7 permission error

Currently I'am trying to mount a google bucket to a VM running Centos 6.7. I have generated a .json file from the developer console and uploaded it to the server, I then went and pointed ...
0
votes
1answer
274 views

Does GCSFuse use a VFS?

I am running gcsfuse on a GCE(Debian Jessie) instance and successfully mounted my GCS bucket. If someone drops a file into my bucket, I'd like for it to trigger an event and publish to a topic using ...