Questions tagged [gcsfuse]

gcsfuse is a user-space file system for interacting with Google Cloud Storage.

Filter by
Sorted by
Tagged with
1
vote
1answer
78 views

Bad credentials for bucket

I'm getting Bad credentials for bucket trying to mount a GCS bucket using gcsfuse. What I've done: Created a bucket "mac-gcs-fuse" Created a service account in the same project with all storage ...
0
votes
0answers
48 views

Why can't I use gcsfuse command on a Google Instance with GPU and preinstalled TF and more?

My goal is to mount a Google Storage bucket in my Google Compute instance machine. I created a Google Compute Instance of type c2-deeplearning-tf-1-14-cu100 It came with various libraries ...
0
votes
0answers
27 views

error when running ls on a gcsfuse mounted directory in GCP

I get the following error ls: reading directory '/directory/': Input/output error when running: ls /directory directory is mounted with gcsfuse --implicit-dirs directory /director/ I can however ...
0
votes
2answers
267 views

gcsfuse on Alpine Docker

I try to use gcsfuse in order to store application source code on a GCP bucket, here's my Dockerfile: ARG VERSION FROM golang:1.12.5-alpine3.9 as gcsfuse-builder ENV GOPATH /go RUN apk --update ...
0
votes
0answers
39 views

how to make gcsfuse mounted path accessible by other container on same pod

Our goal is to use gcsfuse to mount a google bucket content to some path, and share this path with rest of the pod So I tried to run our initContainer as privilege mode to run gcsfuse to mount bucket ...
0
votes
1answer
107 views

“no such file or directory” when mounting, built using the golang:alpine Docker image

I created a fork of the LinuxServer.io's docker-transmission image, adding support for Google Cloud Storage. I used the Ernest (chiaen)'s docker-gcsfuse project to build gcsfuse, namely, extracting ...
0
votes
0answers
35 views

move within gcsfuse not available bug

Good Evening, so basically mv from the XFS mount into the fuse mount is working. Our Issue is that within the fuse we cannot move files via the mv command… Below the console output: (int-backup is ...
0
votes
1answer
150 views

sftp-server over gcsfuse - large uploads succeed but small uploads (<0.5MB) give error

I'm trying to setup a sftp server over GCS. An example gcsfuse mount in the container is gcsfuse -o nonempty --only-dir user1 $BUCKET /home/user1/ftp When I upload two files using sftp: sftp> ...
0
votes
1answer
74 views

When I mmap to a file in a mounted storage bucket, how/when is it downloaded?

I'm using a library that mmaps a large resource file. I'm considering storing that resource file in a gcloud bucket and using GCSFuse to make the file available for mmapping, instead of building my ...
0
votes
1answer
153 views

GCS Fuse Customer Managed Key Support

When using GCS Fuse to mount a bucket that uses Customer Managed Encryption Keys you are able to write to the bucket however you are unable to read anything. When you run an ls against the mount ...
0
votes
1answer
267 views

mount GCPs buckets with write access

I can successfully mount my bucket using the following command sudo mount -t gcsfuse -o rw,noauto,user,implicit_dirs,allow_other fakebucket thebucket/ I can go into the bucket find the subfolders ...
0
votes
1answer
85 views

Slash added automaticaly before bucket name with fstab and gcsfuse

I use gcsfuse to mount bucket in Google Compute Engine. For this I use this syntax in my fstab: my_bucket /my_bucket gcsfuse rw,uid=1001,gid=1002 But gcsfuse process is launched like this: /usr/...
0
votes
0answers
323 views

Issues syncing when using gcsfuse mounted for a SFTP directory

I am having difficulty using gcsfuse mounting a storage bucket to a directory that is being used for SFTP uploads on a CentOS 7 compute engine VM in GCP. I initially tried to mount it using the basic ...
0
votes
1answer
117 views

gcsfuse : connection to bucket drops and bucket has to be mounted again

I am running gcsfuse on a GCE and mounted a GCS bucket correctly. I am running a python program that needs to access data from that bucket. To avoid interrupting the program when the GCE connection ...
0
votes
1answer
198 views

Error 429: rateLimitExceeded

When adding data continuously to the file on GCS buckets mounted from the VM instance, the following error occurred. info info Aug 20 13:20:07 myserver gcsfuse gcsfuse: fuse: 2018/08/20 13:20:07....
0
votes
1answer
380 views

gcsfuse in Google App Engine flexible custom runtime

I'm trying to use gcsfuse to mount GCS buckets in a docker container deployed in a GAE flexible custom runtime instance. This is part of the Dockerfile: FROM gcr.io/google-appengine/python RUN apt-...
0
votes
1answer
514 views

Trouble Mounting a Bucket

I am trying to mount this public bucket into my Google cloud shell: gs://mssng-share/released/genomes/ILMN/VCF/*Using mount point: /home/serdarrowanalytics/mount I tried: gcsfuse mssng-share ./...
1
vote
2answers
819 views

Can't write any file into bucket only read after gcfuse

I deployed an instance of Wowza Streaming Engine on Google Cloud thank Made a bucket in Google Cloud Storage and mounted it all with GCFUSE. My bucket connected with success and I can see in it and ...
0
votes
1answer
296 views

Mount wp-content folder with gcsfuse

How do I mount a wp-content folder (wordpress) so the permissions stay in place and the web server can serve the files from the sub directory? Problem I am facing are: gcsfuse bucketname /var/www/...
1
vote
1answer
275 views

While accessing Fuse mounted Storage bucket, its showing 403 Forbidden Error

I have a google cloud project. In that project. I have a VM instance. I mounted uploads folder with Google Cloud Storage bucket using fuse. While mounting I get an error like this, Using mount point:...
0
votes
1answer
1k views

Can I mount google cloud storage bucket as disk to linux instance with custom size?

We can mount Google Cloud Storage Bucket as a disk to an instance using Cloud FUSE. By doing so, we are getting 1 PiB as disk size(bucket). Can anybody help me understand why we are getting 1 PiB ...
0
votes
1answer
496 views

Installing a binary on a k8s virtual machine with Container-Optimized OS

Pretty simple situation. I use container engine to create k8s clusters. I need to fuse some buckets to the nodes and want to use this project for that purpose: https://github.com/GoogleCloudPlatform/...
0
votes
2answers
535 views

Google Cloud Storage moun + nginx user

I'm able to mount my Google Cloud Storage with gcsfuse but I need nginx to write in it. How do I do that? I've added nginx to the mounting users group and nothing. Probably because the mount has 755 ...
1
vote
1answer
640 views

What shared, high volume storage technology should be used when hosting in Google Cloud?

Given an auto-scaling web server farm setup that needs access to a very large number of image files, we are currently using Google Cloud Storage with a mounted FUSE folder on each web server so that ...
1
vote
1answer
4k views

GCSFuse - Fusermount: mountpoint is not empty

Using gcsfuse to mount a point locally on a server within a script. Running on an Ubuntu 14 LTS server. I have two fuse mount points and the script transfers data from other mount points into them. ...
3
votes
1answer
606 views

Does gcsfuse sync all data to the system it is mounted on?

The scenario: I have mounted a gcsfuse drive to my docker container so I can store and read data from Google Cloud Storage The docker container only has a few gigs of storage, but I might have ...
0
votes
1answer
670 views

Store large files in Google Cloud Storage without local copy

I would like to store large binary files (mongodump bson files) in a Google Cloud Storage bucket mounted on a Google Compute instance through gcsfuse. Everything is working well, except that fuse is ...
0
votes
1answer
158 views

With gcsfuse, how much remaining space is available in a bucket when mounted?

I'm about to evaluate gcsfuse for use in a system with a database daemon. The daemon is peculiar. It computes its usable available disk space subtactively, rather than additively; that is, it ensures ...
1
vote
2answers
7k views

fusermount: fuse device not found, try 'modprobe fuse' first

I am running an instance on gcloud compute engine. I need to mount a Google storage bucket (which belongs to a different project) to my instance. The instance runs on Debian Wheezy. I have installed ...
6
votes
2answers
7k views

permission errors using gcsfuse as nonroot user on google compute instance

We are currently trying to demo the google cloud platform for some workloads that require lots of storage. We are trying to use google cloud storage but are having problems mounting the buckets using ...
-1
votes
3answers
5k views

Mounting google storage bucket folder using gcsfuse

0 down vote favorite I am not able to mount a specific folder inside the google storage bucket On OS X, this program allows you to mount buckets using the mount command. (On Linux, only root can do ...
1
vote
1answer
162 views

GCS Fuse not setting ContentType

We are using using GCS Fuse to manage content on some GCS buckets, but an issue we're running into is that files written by gcsfuse always seem to have the content-type of 'application/octet-stream' ...
0
votes
1answer
241 views

Does GCSFuse use a VFS?

I am running gcsfuse on a GCE(Debian Jessie) instance and successfully mounted my GCS bucket. If someone drops a file into my bucket, I'd like for it to trigger an event and publish to a topic using ...
2
votes
2answers
349 views

gcsfuse not enough free space error when trying to add file

I have successfully installed gcsfuse and can mount a bucket and explore its contents. However whenever I try to copy or save a file to the mount I get the error: The item “test.txt” can’t be ...
2
votes
1answer
2k views

Why doesn't gcsfuse return to the command prompt after mounting?

I've successfully installed gcsfuse. When I run it, it prints File system has been successfully mounted but I don't get back to the shell prompt. (See the transcript below.) What am I doing wrong? ...