Questions tagged [gsutil]

The tag has no usage guidance.

7 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
2 votes
0 answers
398 views

gsutil rsync fails on Ubuntu with UnicodeDecodeError

I'm trying to rsync between google cloud storage and amazon s3. On my local machine (MacOS) this command works gsutil rsync -d -r gs://mira-internal/data/exports/20191108 s3://mira-temp/raw/20191108 ...
kellanburket's user avatar
1 vote
0 answers
87 views

gsutil fails with "OSError: Operation not permitted" when running from cron

I have a php script that does backups. The backups have been failing, because one of the first commands throws an error and stops the script. When I run the script in the terminal, it works just fine. ...
Kenny Wyland's user avatar
0 votes
0 answers
526 views

What is the difference between -i and -u options in gsutil rsync command?

The gsutil rsync documentation describes two options which sound identical: Option Description -i This forces rsync to skip any files which exist on the destination and have a modified time that is ...
AKd's user avatar
  • 101
0 votes
0 answers
82 views

Why would gsutil come up short when transferring files into a bucket?

I have a very large directory tree sitting in the file system of a Google Compute instance. If I do a "find foo -type f | wc -l" on it, it comes back with 34577, and I have no reason to assume that ...
hbquikcomjamesl's user avatar
0 votes
1 answer
2k views

gsutil "Copying mtime from src to dst" having moved source files?

I use gsutil to backup photos from a dedicated box to google nearline storage. Recently I moved all of my photos from that dedicated box to a new dedicated box. I made sure to use the relevant ...
Codemonkey's user avatar
  • 1,138
0 votes
0 answers
693 views

Why does gsutil rsync on CoreOS fail with 'CommandException: arg () does not name a directory, bucket, or bucket subdir'

On a recent Google Cloud Platform CoreOS VM, the command gsutil rsync -r gs://some-bucket-here dest fails with: CommandException: arg (dest) does not name a directory, bucket, or bucket subdir. $ ...
Ray Walker's user avatar
-2 votes
1 answer
856 views

CommandException: Caught non-retryable exception - aborting rsync

..... At destination listing 8360000... CommandException: Caught non-retryable exception - aborting rsync ..... I tried to locate the files with this sync problem but I am not able to do so. Is there ...
Marcel Kraan's user avatar