I need to backup/sync few hundred GB of files in S3 buckets to openstack swift containers.
I have thousands of files in several S3 buckets I want to copy/sync over openstack swift containers but I don't want to copy them over on the disk server then copy them to the swift container ( I can't store them). I also would like to avoid using the server bandwidth by mounting the s3 buckets and the openstack swift container using fuse.
The ideal setup would be using the api from one end to the other so when one file is copied over I could get the url of the file from openstack swift (example from aws to ovh cloud storage)
source : https://s3.amazonaws.com/bucket/file.txt destination : https://storage.bhs1.cloud.ovh.net/v1/AUTH_398y32kue/container/file.txt