Questions tagged [rsync]

Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon

Filter by
Sorted by
Tagged with
0
votes
1answer
29 views

rsync /home structure but only specific subdirectories [closed]

I need to copy / rsync the whole /home directory but only certain subdirectories. Sample: /home/100/someuser/Documents <-- copy with subdirs /home/100/someuser/scans <--- copy with subdirs /...
1
vote
1answer
77 views

Using rsync --remove-source-files & --include-from= options together

I have a central CentOS 7 backup server, where I run the following rsync command in a script to pull the Application logs from 100's of Linux machines and then delete them. rsync --remove-source-...
1
vote
1answer
23 views

Rsync using absolute paths

I have two RHEL 7 servers. On my Source I have the following directories /sourcestuff/testresync /sourcestuff/testresync/incl1 /sourcestuff/testresync/incl1/test1.txt /sourcestuff/testresync/incl2 /...
0
votes
0answers
42 views

PHP binaries are deleted every hour for no apparent reason and other issues

Since yesterday I am fighting with very strange issues on one of our servers. Environment: We use proxmox to run few LXC containers based Debian virtual machines. Yesterday night something happened ...
0
votes
1answer
28 views

OpenShift rsync error

I am developing a python3 script which replicates data from PersistentVolumeClaims mounted in a pod, via rsync. This script is executed in a pod, therefore, the rsync connection is from a pod to ...
0
votes
2answers
28 views

“chroot”, but with a VM?

I just backed up a remote system using rsync. I have a directory that I can chroot into and would now like to boot it up as a VM. I know that qemu has -kernel capability, as well as -drive file=fat: ...
0
votes
0answers
8 views

rsync only copied files with one extension format

I've been syncing with rsync with the following basic options: rsync -a -e "ssh -i MYKEYPATH" MYUSER@MYREMOTE:MYREMOTEPATH MYLOCALPATH I have many images on the remote with the same name in two ...
0
votes
1answer
33 views

rsync creates an empty directory on some hosts

I am running a backup script as a cron-job that looks (roughly) like this: # Generate temporary directory for output dest_file=backup-$(date +"%Y%m%d-%H%M") # e.g. backup-20200417-0400 abs_dest_file=/...
1
vote
0answers
28 views

restore centos vps with rsync [duplicate]

today morning I woke up and saw our MongoDB databases are removed and just this DB HOW_TO_RECOVERY_BASE is there. that have a collection which is README and here is content: { "_id": { "$...
0
votes
0answers
16 views

Can I fix this rsync syntax error during dry-run, or should I ignore it?

I formatted a hard drive and want to use it for a one-time backup (no future syncing) of one of our systems, that I will then put in a bank box. I am using rsync to copy files from the local machine's ...
1
vote
1answer
19 views

speeding up du (maybe use ncdu) for backups with hard links

du -hc --max-depth=1 /home/back/tvppclientarea/ | sort -k2 To show the size of backup directories that use rsync and hard links. The command lists each directory and shows the amount added to the ...
0
votes
0answers
21 views

rsync multiple remote directories with one single connect

I know how to rsync a remote directory through ssh. By the way, we have to rsync a lot of remote directories and can't run every single time a separate rsync command. That's because every rsync ...
0
votes
0answers
28 views

rsync postgres backup to another directory

I have CentOS 7 (3.10.0-1062.18.1.el7.x86_64) with SELinux enabled. PostgreSQL 12 installed (not sure if it is related). I try to backup database and move backup files to another disk. How I create ...
0
votes
0answers
42 views

Downgrading digital ocean droplet

I am trying to downgrade my digital ocean plan from $10 per month to $5 per month.That is not possible with resizing from the dashboard since i started with the $10 plan. Now following this link, I ...
0
votes
0answers
21 views

how to config rsync as deamon when a file change and not with cron

I have multiple folders that I rsync now with cron like in this example. rsync -aqz source1/ user1@machine1:/some/destination1 rsync -aqz source2/ user2@machine2:/some/destination2 ... and so on ...
2
votes
2answers
81 views

rsync command works in terminal, fails in rundeck

I'm trying to use rundeck to rsync files in a docker container volume to an offsite server. I can impersonate the rundeck user and run the rsync command in a terminal window just fine. When rundeck ...
0
votes
0answers
41 views

rsync failed to set permissions: operation not permitted

I am trying to replicate my domains group policy from my primary domain controller to my secondary domain controller. When I run the below command which I used from techmint https://www.tecmint.com/...
1
vote
1answer
29 views

rsync: Only update owner/group and permissions?

I'm in the process of duplicating a remote webserver and am using rsync to transfer the files: rsync -rvz --ignore-existing -e ssh . root@(localip):/usr/files It took about 12 hours to transfer ...
0
votes
0answers
16 views

Exclude files matching literal of wildcard

I would like use the rsync option --exclude-from to exclude a file containing expressions that exclude file paths with the following characters: |, :, ?, >, or <. It is unclear from the Rsync ...
1
vote
1answer
54 views

Rsync files to a server while changing their ownership without root access

I'm trying to allow users to rsync directories to a remote server, while changing the user and group of the uploaded files/directories to nobody:nogroup. Each user has SSH access to the server via ...
2
votes
1answer
70 views

How rsnapshot manages moved and/or renamed files and folders

I consider using rsnapshot for backuping large amount of data and I wonder how rsnapshot manage when a folder at the source is moved or rename, is it detected it and edit associated hard links or it ...
0
votes
1answer
58 views

How do I rsync distant files with restricted permissions?

I tried to rsync files through ssh with a distant 'user' that does not have the permissions to even read them. For instance file.conf which is: root:root rwxr----- What is best practice for ...
0
votes
0answers
58 views

Use rsnapshot to backup a remote docker volume content

We have a server with rsnapshot which use rsync to pull some VMs content. We are moving a part of these VM architecture to docker and we will need to backup the docker volume content. We are looking ...
1
vote
1answer
34 views

Allow rsync to write to httpd_user_content_t

We have rsyncd running as a daemon on our frontend web servers. We push web app updates out via rsync. We're looking at cutting down the noise in auditd and fixing up some of the issues from SELinux (...
0
votes
1answer
51 views

Rsync complex number pattern matching

I am working on migrating a large WordPress website migration and only want to migrate original images. I do not want to copy the images the WordPress creates. Using rsync, I am not seeing a way in ...
0
votes
0answers
25 views

sftp timing out due to multiple connections

I am using this command lftp -e 'mirror --parallel=5 --use-pget-n=10 /var/vtemp /var/vtemp' sftp://root@X.X.X.X to transfer thousands of files between two servers, the download started fine and used ~ ...
0
votes
1answer
68 views

Tar directories while sending with SSH

Nowadays, when I want to backup my server, I log in to it and then I execute the command below which tars the local directory "/ebs1" and sends it to another server at IP xxx.xxx.xxx.xxx and saves it ...
0
votes
1answer
55 views

What is a recommended way of thransferring am iocage jail from one host to another

Source iocage thick jail running on FreeBSD-12.0p12 Destination FreeBSD-12.1p1 Both hosts are using zfs. What is the recommended method to transfer an existing iocage thick jail from the source to ...
1
vote
1answer
363 views

Does AWS cli do a data integrity check on sync with s3?

I've been looking into using AWS cli for data integrity checks to verify a backup has been transferred from a Linux file server correctly to AWS s3. Likewise, I would like to verify when restoring a ...
0
votes
0answers
27 views

Moving files based on size with ascending order from one server to another in linux

How to move the files based on the size with ascending order from one server to another in Linux.
0
votes
0answers
44 views

rsync --delete-excluded not deleting destination folders when excluding

I know there are other similar questions on this topic, however none of them have been able to solve me issue. I am trying to copy srcdir to dstdir, excluding folders based on name, and removing them ...
0
votes
1answer
36 views

Windows rsync, why all files copied over c drive when i copy from d to f

So this is a bit questionable and confusing. I am using Debian subsystem on Windows. And through that i copy and backup files with rsync but i am running into problem where for some reason every file ...
0
votes
1answer
205 views

rsync how include all folder inside a folder

I've read dozens of other answers for this but none of them are working. Situation: I have a folder and inside it, more folden. I will with rsync send it, from a computer to a remote computer. When ...
0
votes
1answer
51 views

Transferring 87000+ files from one debian server to another efficiently?

I have two servers and need to copy 87000+ files from old server (Debian 9) to the new server (Debian 10), tried using sftp but the connection keeps getting dropped midway and it is taking too much ...
0
votes
1answer
134 views

Remotely restore a Centos 7 backup done with rsync

I have a server running CentOS 7. I did a backup to my local computer at home, using rsync (-aAXvhr and --exclude the "classic suggested folders"). So far so good. I messed up things on my server and ...
1
vote
2answers
140 views

Copying large snapshot images to remote storage Linux

I need to copy snapshots of virtual machines running on Proxmox (KVM) servers and copy the snapshots to offsite storage. Most snapshots are a few gb, but some are rather large, up to 200gb. I would ...
0
votes
1answer
148 views

permission denied publickey using rsync with GCP

I'm trying to connect with rsync to a GCP vm. Whenever I do, I'm getting weird errors related to permissions. I've checked that my username is part of the sudoers group so I can't really see where ...
4
votes
2answers
359 views

How to selectively rsync folders while retaining tree structure?

On my local machine I have a folder structure like this /a/b /a/c /d/e /d/f I want to rsync /a/c and /d/f to a remote server so that after which it has folder structure like /a/c /d/f Do I have to ...
0
votes
0answers
68 views

Rsync hangs and becomes uninterruptible

I have found several "rsync hangs" questions and answers, but none of them helped me. On Ubuntu 18.04 trying to backup some files with a cron job. Both the source and destination drives are internal ...
0
votes
0answers
283 views

Linux: rsync to mirror SMB mount to local disk is very slow

I try to mirror a share mounted via SMB to a local dir. The share is hosted on a Windows 2016 server on which I have no access nor can I install any tools. All I have therefore is an SMB share. The ...
1
vote
1answer
242 views

Is rsync slow on btrfs?

I have a large hard disk and a second hard disk, that I use as backup drive (with an USB 3 adapter), using rsync: rsync -ahHPxX --delete --delete-delay Rsync "pauses" a long time during sync, while ...
0
votes
1answer
186 views

rsync ignoring exclude directories and backing up itself

I know that there are few tickets with similar topic already but none of them helped with my issue. I am using rsync to backup contents of/to 2nd HD that is mounted under /media/. Of course, I would ...
0
votes
1answer
140 views

rsync output only the files transfered/deleted [closed]

I am running rsync in a cronjob and redirect the output of rsync in the cronjob using /opt/rsync.sh ... > /var/log/rsync.log 2>&1 I know, I can make rsync output just a summary of number ...
1
vote
1answer
257 views

Backup to remote server and create tar on the fly

I would like to backup a directory from my production server to a backup server using rsync. My current solution: tar directory on production server send to remote server via rsync My Problem with ...
0
votes
1answer
90 views

rsync delete files that were synced before only

Goal: I want to copy a local repository to a remote server. This includes new, modified, and deleted files. Problem: rsync --delete will delete (on the destination) anything that is not present in ...
0
votes
1answer
147 views

rsync closed failed error

I'm getting close failed error when copying files to nfs share randomly. what could be possible reason ? rsync version 3.1.1 rsync: close failed on "/nfs_share/data/.99865579700_0.gz.LgfpIk": Input/...
0
votes
0answers
537 views

Resuming very large rsync, hangs on 'sending incremental file list'

I am trying to rsync a large amount of data (over 750GB) from one EFS volume in AWS to another, across regions, though I don't know if that's causing the problem. Initial rsync attempt went fine: ...
3
votes
3answers
655 views

Rsync to /dev/null overwrites it

I am seeing a random behavior when copying from one server to another using rsync to the /dev/null of the destination server. This is as part my network performance testing, and I want to avoid Disk I/...
1
vote
3answers
82 views

How do i copy N images from server to my local machine using rsync?

I want to copy n images from my server to local machine i hve tried the command : rsync -P <Source>(.om[1,100]) <localmachine> but using this is not working
1
vote
1answer
93 views

Dirvish - rsync daemon mode - port

I am trying to make a dirvish config with unique rsync port. From the dirvish summary log: This is what the rsync try to do: rsync -vrltH --delete -D --numeric-ids -pgo --stats --exclude-from=/...

1
2 3 4 5
30