I'm new to GCP and working under preexisting App Engine.

I have a task to do basically, hit a 3rd party website (HTTP GET) to download a zip file, extract a specific file from the archive (which happens to be a TSV file), do some very basic processing on it and then store the results in our internal systems (Happens to be a CloudSQL instance).

They already have some patterns of defining python cronjobs via cron.yaml in the App engine so I was looking toward putting in there. I'm avoiding wanting to do this all in memory since the file might be a few gigs. If I wasn't GCP with a local filesystem I could work with, I'd have it download the file and unzip on disk, open a file handle and read through the file stream that way.

Do I use blobstore in place of a local filesystem?

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.