We are performing backups for our Google Datastore documents through a cron as describere here. The database is about 55GB including indices and we do a full backup every 24 hours. The bucket we save into belongs to another project.
The backups succeed and we are able to restore them into our staging environment without problems!
Nonetheless, we see a lot of errors coming up while the backup is running. The errors are coming from the ah-builtin-python-bundle
module and the error message is Request was aborted after waiting too long to attempt to service your request.
This causes our monitoring to alert us (We have a threshold of 1,5 errors per second over a time of 3 minutes).
Obviously, we'd like to get rid of those errors to not have false positive alerts in our monitoring.