Tag Info

Hot answers tagged

2

One idea would be to use the stdout generated by Unison while it is running. There is some junk in stdout that Unison uses to create a dynamic effect in the terminal while it is "looking for changes." This junk can be removed fairly easily by deleting every line containing a Carriage Return (CR) character (in vim this would be something like ...


2

I believe sync is the method you want. Try this instead: aws s3 sync ./logdata s3://bucketname/


1

Using the official AWS s3 command line tools: aws s3 ls s3://bucket/folder --recursive | awk 'BEGIN {total=0}{total+=$3}END{print total/1024/1024" MB"}'


1

I recommend using S3 Usage Report for large buckets, see my How To on how to get it Basically you need to download Usage Report for S3 service for the last day with Timed Storage - Byte Hrs and parse it to get disk usage. cat report.csv | awk -F, '{printf "%.2f GB %s %s \n", $7/(1024**3 )/24, $4, $2}' | sort -n


1

You can also consider seting up Cross-Region Replication, which allows you to both copy and keep in sync data between regions https://aws.amazon.com/blogs/aws/new-cross-region-replication-for-amazon-s3/



Only top voted, non community-wiki answers of a minimum length are eligible