Server Fault
Sponsored by
Sponsored logo

Questions tagged [google-cloud-storage]

Ask Question

Google Cloud Storage, also called GCS, is a cloud service for storing and accessing arbitrarily large objects.

131 questions
Newest
Active
Bountied
Unanswered
Filter by
Sorted by
Tagged with
2
votes
1answer
53 views

Restrict Viewer Access to Cloud Storage Objects via ACL

I'm hosting a static site in a Cloud Storage Bucket with fine-grained permissions set. I'm attempting to set by-object ACL permissions so users can only access specific resources if they have a ...
-1
votes
1answer
17 views

Allow multiple service accounts to access multiple storage buckets

I have some devices, and each will be handled to the customers. I need each device to have read-access to some Google Cloud storage buckets. I would like each of device (or at least each customer) to ...
-4
votes
1answer
26 views

Google Cloud Storage free 50GB and pricing [closed]

I am using Google Cloud Storage for my node.js. I wonder after using the 50GB of free storage, the price will be *0.20$/gb? or starting from 0.2/gb? Thank you
0
votes
1answer
37 views

transferring/downloading files to bucket within a google cloud bucket causes disconnection

I am trying to download a file using wget into my GCP bucket, and just after the download is finished the following error shows: Transport endpoint is not connected Then the file is empty. Using scp ...
0
votes
1answer
50 views

GCSFuse v0.33.2 - Large objects (11GB) upload to GCSBucket Fails

Receiving below errors when we try to upload 11 GB file to bucket; also, filesystem is going into "????????" as we can't list the objects available in the bucket. This requires umount and ...
0
votes
0answers
18 views

Decreasing disk size on Google Virtual Machine Web Server [duplicate]

I am using Google Compute Engine VM for a web server. I currently have 3TB as disk space but want to bring it down to 1TB. Can someone tell me where I can do this from? Thanks.
1
vote
1answer
78 views

export gcsfuse mount so a third client can access files in a storage bucket

I mount a storage bucket to a local directory. /share Then I try to make this directory - now populated with contents of the object store - available to another machine. The goal is, that this other ...
0
votes
1answer
127 views

How do I go about VMs in the cloud I only need for specific times?

I am currently doing processing of videos on a local server which I'd like outsource to the Cloud. I am quite familiar with the Google Cloud which is why I would choose Google. The process would ...
0
votes
0answers
32 views

GCP Static Site Redirect domain.com and www.domains.com to domains.com

I the following configured so far backend buckets for domain.com and domains.com https load balancer with certificate, pointing to the domains.com bucket http load balancer redirecting traffic to the ...
0
votes
0answers
18 views

Google Cloud Storage - transfer data between 2 PVCs

I have 2 separated Kubernetes cluster both in the same zone (europe-west). Each cluster has some PVCs attached to them. I need to clone/copy the data of a PVC from cluster A to the same PVC in cluster ...
0
votes
1answer
230 views

Cloud bucket malware security

I have implemented an antivirus system using ClamAV on one of my apps which uses Google cloud storage for uploading files. Currently what I am doing is, listening to bucket upload, download it on one ...
0
votes
2answers
430 views

Find out which GCP project is hosting which appengine or which GCS bucket

We have many projects inside our Organization GCP account. We have many legacy GCS buckets and many legacy AppEngines hosted inside our various projects. All these buckets and AppEngines are served ...
0
votes
1answer
69 views

change storage class a folder gcp

change storage class in a folder into a bucket in GCP, I try with gsutil rewrite -s coldline gs://bucket-name/folder/ I see the gsutil stat gs://bucket-name/folder/ what am I doing wrong?
0
votes
1answer
109 views

Google cloud storage favicon for PDF File

I have some pdf files hosted on Google Cloud Storage. These files are public and I open them using their public link. Is there a way I can customize the favicon shown by the browser when I view those ...
0
votes
1answer
2k views

Access denied (SA doesn't have storage.objects.create access) when trying to upload using a preSigned url to google cloud storage

Having issues trying to allow a client to upload a file via a presigned url. Error received <?xml version='1.0' encoding='UTF-8'?> <Error> <Code>AccessDenied</Code> <Message&...
0
votes
0answers
56 views

Upload 300MB or more CSV file to GCP storage bucket

I am trying to upload a 3GB CSV file to Google Cloud Storage Bucket but every time I try it only processing 295.5MB and uploads 295.5MB. Why is this? I have set my bucket size limit to 15GB.
1
vote
2answers
88 views

moving 2TB files from on-premises to Google Cloud Storage

Our old infrastructure was hosted on an on-premises server, and now we are moving forward into Google Cloud Storage. The problem is, my outgoing server connection is pretty slow, any ideas about ...
0
votes
2answers
675 views

Recover deleted folder in Google Cloud Storage

I have accidentally deleted one folder from the Google Cloud Storage. How can I recover this folder?
0
votes
1answer
97 views

I'm on GCS's free trial; how do I increase my storage from 5gb to 25 gb?

So I'm playing around in a notebook that lets me experiment with the T5 model. When I try to fine-tune the model (it has 3B parameters), I get: WARNING:tensorflow:The `3B` model is too large to use ...
0
votes
1answer
38 views

Google Cloud load balancer redirect if from a certain region

I have two static pages (English, Danish) which are currently in Google Cloud Storage Bucket. This bucket contains en and dk folders for those static pages. Also, I have a Load Balancer with Google ...
0
votes
1answer
173 views

possible to set up GCS bucket lifecycle rule to archive rarely used objects?

GCS offers lifecycle management where you can, for example, "Downgrade the storage class of objects older than 365 days to Coldline Storage". I'd like to archive rarely used objects but keep ...
1
vote
1answer
612 views

Cloud Run service account does not have permission to sign

I'm working on a program that will run on Google Cloud Run and has files stored in Google Cloud storage. The problem I'm experiencing happens when attempting to generate a signed URL to download a ...
1
vote
2answers
276 views

Prevent Cloud CDN from serving cached elements?

I have some problem with Cloud CDN. I've added a CDN to a bucket connected on an instance. I need to get an element from CDN, but this element is updated each 1 sec from my server. What happen is ...
2
votes
1answer
6k views

How to get a download URL for files in Google Cloud Storage?

I have created a service using : storage.Client(project='project_name', credentials=credentials) https://googleapis.dev/python/storage/latest/client.html And I'm able to upload, delete and list the ...
0
votes
1answer
18 views

Search pdf content in google storage

could you help me with the following? How can I search pdf words hosted on google cloud storage? example: pdf1, pdf2, pdf3 hosted on storage. Look for the "father" word in all documents. Thanks
0
votes
1answer
273 views

How to Change Cloud API access scopes on GCP Compute Engine with out stopping the Instance

I'm using gcsfuse inside Google Compute Engine. I mounted a folder with cloud storage bucket but, unable to create any file inside of it: touch t1 with an error: touch: cannot touch 't1': Input/...
1
vote
1answer
448 views

Using Google Cloud Armor to Block Requests to Google Cloud Storage

Does Google Cloud Armor support blocking requests to public Google Cloud Storage buckets? I haven't been able to determine if GC Storage counts as a backend service. The scenario is I would like to ...
0
votes
1answer
52 views

GCS GoogleCredential

My application has requirement to download file from GCS bucket.I am able to download files from GCS using StorageClient DownloadObjects method. But performace is really slow. for 50MB file size it ...
2
votes
0answers
240 views

gsutil rsync fails on Ubuntu with UnicodeDecodeError

I'm trying to rsync between google cloud storage and amazon s3. On my local machine (MacOS) this command works gsutil rsync -d -r gs://mira-internal/data/exports/20191108 s3://mira-temp/raw/20191108 ...
0
votes
2answers
158 views

GCS ResumableDownload Class

My business application has requirement to download file from GCS bucket. File size can be in GBs also. Is there any class like ResumableUpload for download? I want to use ResumableDownload, so in ...
2
votes
2answers
206 views

How do you assign storage permissions to a group of GCP service accounts?

How does one assign Google Cloud Storage bucket permissions to a group of users? There's no bucket-level permissions that can be specified in roles, and there's no way to create a group as far as I ...
0
votes
1answer
349 views

ETL to bigquery using airflow without have permission cloud storage/ cloud sql

i have done ETL from MySql to bigQuery with python, but because i haven't permission to connect google cloud storage/ cloud sql, i must dump data and partition that by last date, this way easy but ...
0
votes
1answer
50 views

Where can I find Google Cloud Account: Email ID?

One of my clients has a WordPress site. He has stored his "Media content" (i.e. images) in Google Cloud Storage by using the WP-Stateless plugin. While trying to retrieve it, the client didn't know ...
0
votes
1answer
183 views

GCS bucket migration across different organisations

We are currently planning to migrate some GCS buckets across different organisations. After having a look at the documentation, it seems that that's something one can do between projects and buckets, ...
0
votes
1answer
2k views

Slow upload speeds when using gcloud compute scp and gsutil cp

I tried uploading a single file from a local drive directly to a google cloud compute vm instance using gcloud compute scp and to a google bucket using gsutil cp but in both cases the transfer speeds ...
2
votes
1answer
996 views

Bad credentials for bucket

I'm getting Bad credentials for bucket trying to mount a GCS bucket using gcsfuse. What I've done: Created a bucket "mac-gcs-fuse" Created a service account in the same project with all storage ...
2
votes
1answer
671 views

Restrict Access to google cloud buckets by domain name

I want to host files that my users upload to my web application in google cloud buckets...the problem there is that I need to have the permissions open to the public because I also need to retrieve ...
1
vote
3answers
2k views

Upload folder onto virtual machine

I created a VM instance on the Compute Engine in a Google Cloud project. I want to upload a folder from my computer's local storage onto the boot disk of the virtual machine. I tried using the scp ...
0
votes
1answer
565 views

After resize disk , can't ssh to GCP Cloud

I can't ssh to my instance after resize disk . I search for information and see some issue like - The disk if full - The ip I create a snapshot , and the snapshot only has size 8G , even my disk is ...
3
votes
1answer
453 views

gsutil rsync “too many values to unpack” error

I'm trying to sync a folder with over 3k files to a bucket on Google Cloud with gsutil. The problem is that less than half of the files are uploaded and then I get this error: too many values to ...
0
votes
1answer
394 views

Firewall rules for accessing Google-Cloud-Storage from the outside world

I'm deploying an application that relies on GCS at a customer's site. The customer's firewall allows whitelisting domains for outgoing connections, so I've whitelisted the known GCS domains (storage....
1
vote
1answer
178 views

How/why would ALL our Google Cloud Platform Service account keys suddenly disappear/be deleted?

We had a major issue with Google Cloud Platform some time between 2019-04-16T11:00:00Z and 2019-04-17T02:30:00Z, when all of our service accounts lost their access keys for an unknown reason, so our ...
0
votes
1answer
378 views

How can I set a Google Cloud Storage object to be publicly visible when uploading it via a signed URL?

I'm following this guide and have a solution which is uploading objects to Google Cloud storage using the signed URL and the XML REST API (e.g. curl -v -X POST $URL -F "file=@test.jpg"). ...
2
votes
1answer
1k views

Secure static web page hosted on Google Cloud Storage

I would like to add basic authentication to the website that hosts on Google Cloud Storage. The site is connected to a load balancer, has a working SSL certificate and CDN. Basic authentication ...
5
votes
1answer
6k views

Service account does not have storage.buckets.get access to bucket

I'm trying to get a list of buckets in a project, using python like this: from google.cloud import storage storage_client = storage.Client(project='[project-id]') bucket = storage_client.get_bucket([...
0
votes
1answer
52 views

Backend bucket versioning

We have bucket with some files behind the CDN, along with signed URLs. We are using query string with version to update content according to the best practices, e.g. file.ext?v=100. Everthing worked ...
1
vote
0answers
80 views

Access error when creating domain Storage Buckets via Deployment Manager

When I try to create storagebuckets via Deployment Manager I get the error message below. I have already tried adding 1058303916595@cloudservices.gserviceaccount.com to the list of Verified owners of ...
-2
votes
1answer
105 views

Google Cloud SQL database increase [closed]

My Google Cloud SQL automatic storage increased up to 31GB but still the database size is only 120Mb and all the above happens in 3 days?
2
votes
1answer
1k views

How to handle retention policies in GCP Container Registry

GCP Container Registry is built on top of GCP Cloud Storage and one can set quite complex retention policies there. However there's no such functionality in Container registry and as there's no ...
1
vote
2answers
4k views

NGINX proxy to GCS bucket with redirect all urls to index.html, getting 200 blank responses on nested routes

I am configuring a reverse-proxy from NGINX to a GCP Cloud Storage bucket containing static HTML, JS, image files, with a rewrite for all non-matching URLS to index.html since it is a single-page-...

1
2 3

Your privacy

By clicking “Accept all cookies”, you agree Stack Exchange can store cookies on your device and disclose information in accordance with our Cookie Policy.