Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

  7. current community

    your communities

    more stack exchange communities

    company blog
Server Fault

Questions tagged [google-cloud-storage]

Google Cloud Storage, also called GCS, is a cloud service for storing and accessing arbitrarily large objects.

90 questions
info Newest Frequent Votes Active Unanswered
-2
votes
1answer
33 views

Google Cloud SQL database increase [on hold]

My Google Cloud SQL automatic storage increased up to 31GB but still the database size is only 120Mb and all the above happens in 3 days?
1
vote
1answer
52 views

How to handle retention policies in GCP Container Registry

GCP Container Registry is built on top of GCP Cloud Storage and one can set quite complex retention policies there. However there's no such functionality in Container registry and as there's no ...
0
votes
0answers
14 views

Best method to do SFTP of GCP Cloud Storage files to Salesforce

Need setup a task to regularly SFTP some Cloud Storage files from a GCP project to Salesforce. Salesforce will whitelist the incoming fixed IPs from GCP and provide us the userID and password. Would ...
0
votes
0answers
38 views

NGINX proxy to GCS bucket with redirect all urls to index.html, getting 200 blank responses on nested routes

I am configuring a reverse-proxy from NGINX to a GCP Cloud Storage bucket containing static HTML, JS, image files, with a rewrite for all non-matching URLS to index.html since it is a single-page-...
0
votes
1answer
27 views

google-cloud-sdk - This account has no projects

When I accessed the project of a company that is a member from the Cloud SDK in the Gsuite account, it returned "This account has no projects." Logging in with the browser, I can log in to the company'...
1
vote
1answer
31 views

Is there a way to mount my Google Cloud storage account on Windows Server 2016?

I want to be able to host site images on Google Cloud Storage. One way I am thinking to get it does is by adding a drive on my windows server that point to the cloud. Then my site would read the ...
0
votes
1answer
56 views

How to use JSON keys with google cloud gsutil to manage multiple Keys

We have multiple GCP Service account keys from different environment such as DEV,STAGING,..PROD. I would like to run a command in my jenkins box which is there in Dev environment to create access DEV ...
0
votes
0answers
11 views

Error gsutil cp Service Exception: Transfer invalid cannot have start index greater than total size

I'm trying to download a lot of files from a Google Bucket. I run the command gsutil cp -r gs://bucket-link-info/files/ . and the download starts fine. However, after a while, it stops with the error ...
0
votes
1answer
49 views

Enable scope permission

I am trying to create a signed URL following this documentation but I fail to understand how to enable the scope for my Cloud Function. I am sure that my Cloud Function has cloudfunctions....
0
votes
1answer
28 views

Cloud Storage access from PHP aplication

We configure PHP applications on 2 servers with databases in CloudSQL, they require read /write static content in a CloudStorage bucket from PHP applications. What I did was install GCS Fuse to mount ...
0
votes
1answer
95 views

Get “gs_secret_key” and “gs_access_key” values for Google Bucket

I need to create a directory in a Google Cloud Bucket using Ansible. I would like to know where I can find the values to complete "gs_secret_key" and "gs_access_key" to use "gc_storage" module in ...
0
votes
0answers
132 views

Synology & HyperBackup on Google Cloud Storage via S3 fails when almost finished with “SignatureDoesNotMatchException” - too many files?

I am doing backups of a large number of files using HyperBackup from a Synology diskstation to Google S3. While backup jobs with less numbers of files work well, it always fails with the error "...
0
votes
1answer
42 views

Slash added automaticaly before bucket name with fstab and gcsfuse

I use gcsfuse to mount bucket in Google Compute Engine. For this I use this syntax in my fstab: my_bucket /my_bucket gcsfuse rw,uid=1001,gid=1002 But gcsfuse process is launched like this: /usr/...
0
votes
0answers
41 views

Using Google Cloud Buckets how to limit what source bucket can save usage logs in the destination bucket?

I have a bucket i use to store usage logs from other buckets in the same project. I followed the guide and set up the required ACL on the bucket logs as gsutil acl ch -g cloud-storage-analytics@...
1
vote
1answer
435 views

Loading data into BigQuery via Cloud Functions and Google Cloud Storage - Exceeding socket traffic quota limit

I've got a Google Cloud Function (GCF) that watches Google Cloud Storage (GCS). When a file drops into a particular bucket, the GCF fires up a LoadJob telling Big Query (BQ) to import the file. I'm ...
0
votes
1answer
39 views

Dataproc cannot create cluster: no storage.objects.list permission to `hadoop-lib`

I cannot create Dataproc Spark cluster for some reason. I run: gcloud dataproc \ --region us-west1 clusters create my-test1 \ --project some_project \ --scopes 'https://www.googleapis.com/...
0
votes
0answers
91 views

Google Cloud Bucket connection from Kubernetes deployment using Storage API

We have a java application running in Kubernetes cluster deployment. We're using Google Cloud Bucket as storage. We were using Java Files.move method to move files from our Persistent Volume Claim (...
0
votes
1answer
32 views

Deny Creating Public Buckets / Objects in GCP Buckets

Is it possible to create a policy in GCP that will disallow the creation of public buckets or items in buckets? If yes, how that policy will look like?
0
votes
0answers
117 views

Accessing a file in Google Cloud Storage from a web browser

I am trying to set up a file distribution to a couple of registered users. I am experimenting with GCS. The files must not be publicly available without logging in even temporarily. I have created a ...
1
vote
2answers
136 views

Parallel downloads in Google Cloud Storage

Does anyone have experience with Google Cloud Storage? Is it made for a potential 10K of parallel requests to download 10-70mb files? Or would that require a CDN?
1
vote
0answers
164 views

Configure Google Cloud Storage plugin with Curator cronjob on GKE Elasticsearch cluster

I deployed an Elasticsearch cluster on GKE, using this project as a starting point: https://github.com/pires/kubernetes-elasticsearch-cluster I would like to configure two Curator jobs by using ...
0
votes
1answer
63 views

Google Cloud Storage: serve both HTTP and HTTPS

I'm struggling to have both HTTPS and HTTP working with a Google Storage bucket as a backend. Let's say, I want www.example.com to be served HTTP and HTTPS. The files are in a Storage Bucket. In ...
0
votes
1answer
225 views

Trouble Mounting a Bucket

I am trying to mount this public bucket into my Google cloud shell: gs://mssng-share/released/genomes/ILMN/VCF/*Using mount point: /home/serdarrowanalytics/mount I tried: gcsfuse mssng-share ./...
1
vote
3answers
191 views

Copy data from GCP-instance as a local account to Google Cloud Storage bucket

I have successfully added the ability to connect and transfer files from a GCP instance using my own local account on the GCP-instance using a by adding the API access for a Google Cloud service-...
1
vote
2answers
254 views

Can't write any file into bucket only read after gcfuse

I deployed an instance of Wowza Streaming Engine on Google Cloud thank Made a bucket in Google Cloud Storage and mounted it all with GCFUSE. My bucket connected with success and I can see in it and ...
0
votes
1answer
59 views

Can I limit access to storage by subnet

With AWS, I can set a restriction to limit access to a bucket from specific IP addresses. This is important if you want to allow staff to access buckets from specific corporate systems ( or while ...
0
votes
1answer
216 views

GCP SSL on Cloud Storage with custom CNAME

I've set up a Cloud storage bucket for hosting images on my website, using a name to make it work with a subdomain of my app. After a bit of searching I'm still unsure what is the best practice for ...
0
votes
3answers
244 views

How to run gsutil rsync without auth?

aws s3 sync provides a parameter named --no-sign-request, so user can sync a publicly-visible bucket without any auth in advance. gsutil help anon says that: gsutil users can access publicly ...
1
vote
1answer
173 views

While accessing Fuse mounted Storage bucket, its showing 403 Forbidden Error

I have a google cloud project. In that project. I have a VM instance. I mounted uploads folder with Google Cloud Storage bucket using fuse. While mounting I get an error like this, Using mount point:...
0
votes
1answer
194 views

Connected my domain to a bucket on google cloud and getting bucket does not exist error

I connected my domain to serve static content by linking it to a bucket on google cloud , however I am getting the following error message when i type the website address on the browser NoSuchBucket ...
2
votes
1answer
495 views

Exporting GCP Compute Engine instance fails: Quota 'SSD_TOTAL_GB' exceeded

I'm following instruction on: https://cloud.google.com/compute/docs/images/export-image When running: gcloud compute images export --destination-uri gs://my-bucket/my-image.tar.gz \ --image my-image ...
0
votes
1answer
817 views

Can I mount google cloud storage bucket as disk to linux instance with custom size?

We can mount Google Cloud Storage Bucket as a disk to an instance using Cloud FUSE. By doing so, we are getting 1 PiB as disk size(bucket). Can anybody help me understand why we are getting 1 PiB ...
0
votes
1answer
120 views

Performance of Static website on Google Cloud Storage

I have some low-traffic static websites to host. As an alternative to hosting them on my own or self-managed web servers (eg AWS, Google Cloud, or Digial Ocean machines running Apache or Nginx), I'm ...
0
votes
0answers
74 views

Access to storage.cloud.google.com with a service account

Posted this on github and on SO with no real answer Hello! I am trying to implement custom authentication for my resources on Google Cloud Storage using this module with a service account. I am ...
0
votes
1answer
515 views

Is it a bad idea to use google cloud storage on heroku deployed projects?

So my app is deployed on Heroku and I'm using a google cloud storage bucket to handle uploads. Wouldn't communication from my app to google cloud platform be slow compared to using S3 given the fact ...
3
votes
2answers
2k views

getSignedUrl giving “SigningError: Failure from metadata server”

I'm using Google Cloud Functions with an HTTP trigger to create an endpoint for an API call. This endpoint is using the getSignedUrl function from the Cloud Storage package. I wanted to return a ...
1
vote
1answer
557 views

Upload large online files to google cloud

I would like to upload large image files to google cloud for machine learning purpose on RStudio. Each image zip is around 4.7gb and it takes longer to unzip than to download. I would like to know ...
0
votes
3answers
1k views

GCP: No access to Container Registry from Compute Engine

I have a Docker image pushed to Google Container Registry at gcr.io/my-project/my-image:latest. In the same project, I created a Google Compute Engine instance based on COS (Container-Optimized OS) ...
0
votes
1answer
307 views

URL for Google cloud storage in JAVA on localhost (testing)

This is partly related to use within the testing (localhost, from Eclipse) environment. I am using GCS with com.google.cloud.storage.Storage. using JAVA in the server (and GWT in the client). ...
0
votes
1answer
1k views

Backing up Google Cloud Storage Bucket

Is there a way I can regularly backup one bucket into another one so that in case files get deleted from one bucket, they can always be recovered from another?
0
votes
1answer
77 views

Mismatch in the number of Class A requests for Google cloud storage between the bill and logs

I have enabled access and storage logs on the cloud storage buckets. I am loading the access logs generated to a BigQuery table for analysis. I see that the number of class A requests (mainly POST ...
2
votes
1answer
3k views

Can I mount Google cloud storage bucket to a pod as a persistent disk. If yes how?

I have a gke cluster with nodes in 3 different Zones but same region. I want to use persistent disks to my pods. But the pods are created randomly in all the 3 zones.How can I use a gcePD (common for ...
1
vote
1answer
652 views

Lost Permissions to Google Cloud Storage Bucket

I accidentally deleted the "Storage Legacy Bucket Owner" permission on a bucket and now even though I'm the project owner and I created the bucket I cannot access it at all. What recourse do I have? ...
2
votes
1answer
908 views

An internal error occurred while creating a Google Cloud Storage bucket

I have started my google cloud setup today. Tried to follow instructions in interactive tutorial. Setting up my First App that uses Node.js worked fine. But deploying app to Compute Engine failed with ...
-4
votes
1answer
296 views

Is Google Cloud Storage expensive? [closed]

It's not a technical question. I'm using Google Cloud as secondary backup solution. I synchronize some log files and a shared folder which contains Word and Excel files from office. All files are less ...
1
vote
1answer
258 views

Compression of data during transfer to Google Cloud Coldline Storage

We are using Google Coldline Storage for backing up and archiving certain data. We've been using gsutil rsync to basically mirror weekly the contents of a local directory with Google Coldline Storage ...
1
vote
1answer
158 views

Google Storage ACL - write only for public, but don't allow read, list, delete or update operations

I need to setup Google Storage access for 3rd parties (public) to allow them to upload one or more files, but they shouldn't be allowed to read, list, delete or update an existing file. This structure ...
1
vote
1answer
543 views

Copy list of files (-I flag) with gsutil preserving path

I am trying to copy all pictures and static files to a bucket of mine in Google Cloud Platform. I am attempting this command from the root dir of my app: find -regextype posix-extended -iregex ".*\.(...
0
votes
1answer
151 views

How to create an IAM role to list images in the Google Container Registry

I need to be able to assign a new role to a user who should only have access to list the images in the Google Container Registry. From my research I can't seem to find any actions in relation to ...
1
vote
1answer
50 views

Appengine Serving Urls log

we're using Google Appengine image manipulation api (https://cloud.google.com/appengine/docs/standard/python/images/) and serving urls to produce urls that our clients can use to display images. ...

1 2