s3cmd is a simple command-line interface to storing and retrieving data to/from Amazon's S3 cloud storage service.

learn more… | top users | synonyms

2
votes
1answer
808 views

How backup files with logrotate and Amazon S3?

I would like to create a new standard of two things: how long would be generated and be rotated the logs generated by my applications ? how to transfer the logs to Amazon S3, as a backup server ?. ...
1
vote
1answer
20 views

s3cmd error on sync: S3 error: 400 (InvalidRequest)

I'm trying to configure s3cmd to backup some directories on my server to my AWS S3 bucket. My problem is that when I do the sync command: s3cmd sync -r -p --no-delete-removed /path/to/dir ...
0
votes
1answer
20 views

s3cmd restore recursive not working right

I am running the following command to restore the data from Amazon S3 to the web server. s3cmd restore --recursive s3://my-bucket/Weekly-Sunday/dbexports/ and getting this error: Restore is not ...
0
votes
1answer
228 views

How best way to rsync from aws s3 to gcloud?

I must execute a rsync ( not only copy or move ) from all my buckets from s3 to google cloud. I need create the same infraestructure of s3 to google. I have like 2Tera in s3, and all days I receive ...
0
votes
1answer
830 views

Setting cache for already uploaded amazon s3 files

In amazon s3 for our site through s3cmd tool we uploaded around 60GB of files including mp3, jpg to a bucket. But now when we checked site slowness files are not caching and further checking we came ...
2
votes
0answers
15 views

S3 restoration using s3api get-object is not working in aws china region

I have set up a daily backup script in my aws china instance which uploads my required files to be backed-up to s3 bucket. I have a restoration script which uses s3api to restore the objects to the ...
2
votes
0answers
111 views

Solution for file data backup, versioning and replication

We have a growing set of data files (.wav files, image files etc) which are data, i.e not part of the application code - uploaded and modified by users. The number of files is in the 1000s and the ...
0
votes
0answers
23 views

Syncing from a NAS drive to AWS S3 with s3cmd

I'm trying to use s3cmd to sync data from a NAS drive connected to a web server node, to AWS S3. I'm using this command: s3cmd sync ./logs/ s3://bucket/logs/ What's happening is there is a massive ...
0
votes
0answers
11 views

mysqldump pipe to s3cmd not working after enabling server side encryption

After we enabled server side encryption the below command is no longer working /usr/bin/mysqldump -ufoo -pbar -hmy-rds.us-east-1.rds.amazonaws.com --databases first_db | /usr/local/bin/s3cmd put - ...
0
votes
0answers
12 views

How can I get the size of an s3 bucket and ignore files in the glacier storage class

I created a lifecycle policy for an S3 bucket to move files to the glacier storage class. After confirming the file is type glacier storage class, I run s3cmd du -H s3://my-bucket but the size of the ...
0
votes
0answers
36 views

How to use the s3cmd setlifecycle command?

s3cmd has a setlifecycle subcommand that seems like it ought to let me configure a bucket into Amazon Glacier. However I can't find any documentation for it on the web or in the manpage. What's the ...
0
votes
0answers
1k views

s3cmd 403 Access Denied error on put but not ls

I can access s3 using s3cmd on an ec2 instance to do s3cmd ls s3://myc bucketname but not using 'put' to add a file. It gives a 403 access denied error. I am using IAM and have group setup to access ...