Questions tagged [rsync]
Rsync is a fast and extraordinarily versatile file copying tool. It can copy locally, to/from another host over any remote shell, or to/from a remote rsync daemon
1,588
questions
-1
votes
0
answers
20
views
Recommendation for offsite backup
My brother and I live about 100km apart and both have a local NAS which we also use for local backups of computers. In my network, two Macs make TimeMachine backups, in his network there is both a ...
0
votes
1
answer
30
views
rsync skip transferring files that take longer than n minutes
I run rsync as a cron job within a script. Sometimes transfer speed falls down and my large files (say over 1G) take so long to transfer and this stops my script functionality. Is there a way I can ...
- 35
2
votes
1
answer
198
views
Discrepancy in file usage after rsync
I copied files from an exFAT filesystem to an ext4 filesystem:
sudo rsync -avz /media/user/1TB-SD-EX/ -e ssh example.com:/data/pc/sd1tb
After successful run I check source and destination size with ...
- 453
0
votes
2
answers
174
views
How to install rsync 3.2.7 on Ubuntu 20.04.2
I want to isntall rsync 3.2.7 on Ubuntu 20.04 - however I'm not sure if that's possible; currently I have 3.1.3 installed on the system (which is installed by default).
I found this question but it ...
- 1,003
1
vote
1
answer
38
views
extract full path FIND with special character handling
Executing a comand like:
find /some_path -mtime -3 -type f -name "*.txt"
the out is something like:
/some_path/file 1.txt
/some_path/file2.txt
If I include this output in rsync with ...
- 11
1
vote
0
answers
23
views
Backup drive on Linux system keeps getting corrupt. How to troubleshoot?
My webserver (Debian BullsEye) has an internal 2TB harddrive which sole purpose is to hold a backup of the server's main HD. Every day a cronjob is started that creates a backup using rsync. But every ...
- 217
0
votes
1
answer
80
views
rsync Connection getting failed to remote server
I've configured a rsync server on a Windows Server 2019 (Server Name - ServerX).
rsync is working fine within the ServerX.
But none of my local machines are connected to ServerX via rsync.
rsync is ...
0
votes
0
answers
87
views
How to rsnapshot keep mirror backup and 'retain' directories have only deleted and changed files
I'm triyng/testing rsnapshot in my Ubuntu desktop to make incremental backups from a remote server to my desktop.
I use a custom config file where I set retain alpha 7
I executed rsnapshot -V -c /path-...
0
votes
0
answers
91
views
rsync is not preserving file timestamps with the 'a' option when writing to cifs mount
My Ubuntu 22.04 VM (on my synology nas) preserves file timestamps when writing to it's local filesystem, but not when writing to a cifs mount (on the nas). This causes it to re-grab the non-preserved ...
- 1
0
votes
1
answer
138
views
"rsync: [generator] mknod … failed: File name too long (36)" though file & path name lengths are way shorter than 255 & 4096
On a QNAP NAS I'm trying to copy a huge backup directory from internal to an USB disk. The backup set was created using back-in-time, therefore it uses hard-links for deduplication and encfs generated ...
- 141
0
votes
0
answers
44
views
backup /home over sftp - root
My current task is to set up a (remote) backup (using rsync/rsnapshot) over sftp of /home (linux). Obviously some files are read only for the owner (ie -r-------; and should stay that way) so i guess ...
- 1
0
votes
1
answer
45
views
rsync failure not detected by duply/duplicity; corrupted backup "successful"
First of all, I recognise these are not the most recent versions of duply and duplicity. The client runs servers on various OS versions, and we currently install duply and duplicity from the system ...
0
votes
1
answer
90
views
Does daily rsync OS backup push SSD drives to its limits?
Since past year I'm using Rsnapshot (which uses rsync) to do my daily laptop Linux Ubuntu OS backup to a local NAS.
Some months ago I started having serious problems with the OS stability. It seems ...
- 256
0
votes
1
answer
49
views
rsync: updated files to new folder
rsync allows to copy/synchronize folders without transferring files that already have been synchronized before and that did not change since last run. For that, you typically have to specify the ...
- 117
0
votes
0
answers
77
views
Does the rsync command will end once it is completed
I'm running a command to sync the folder.
I would like to know whether the rsync command will keep on running even if all files are synced.
Since I'm having script
#!/bin/bash
function simSync {
ssh ...
- 1
0
votes
0
answers
138
views
rsync --inplace does not update file
I try to use rsync to backup a virtual box vm. This does not succeed: the disk image is not updated. I tried it on the vdi file alone as a test. The virtual machine was not running.
The file is very ...
- 101
0
votes
0
answers
468
views
Is there a tool for copying files directly from any running Kubernetes pod to another?
I would like to move a large file set from a running Kubernetes pod to another (possibly in another cluster) in order to migrate quickly from one Storage Class to another with little or no downtime.
I ...
1
vote
1
answer
69
views
rsync Delete only Matching files
How can I use rsync (or another program) to delete identical files between directories? To be identical, location and metadata should match (permissions, ownership, timestamp)
For example, I backup ...
- 196
0
votes
0
answers
229
views
Ubuntu 20.04 / 22.04 - Remote ssh or rsync killing all process from user
I got a weird strange odd behavior (there's not enough adjectives for that) on Ubuntu 20.04 LTS and Ubuntu 22.04 LTS.
This is a IBM Db2 test server. The server runs a Db2 service under db2inst1 user ...
- 113
0
votes
0
answers
52
views
Rsync often stacks while I am connected to VPN through wsl
From time to time while running rsync command through wsl, it stacks, and I need to run it again. This only happens while I am connected to VPN. Not sure why this happens
RSYNC_COMMAND=avAXEWSlHhz
...
- 101
0
votes
1
answer
106
views
rsync: remote command not found (code 127) at io.c(254) [sender=3.1.2]
To establish a backup between a local file server and a remote webspace (with ssh and rsync access) I wanted to use rsync.
With the command
rsync -aPv -e "ssh -vv IonosSB" --delete /volume1/...
- 1
1
vote
0
answers
140
views
Samba AD sysvol sync unison permissions issue
I'm having an issue with syncing the unix permissions and ownership on the sysvol between two Ubuntu Samba AD DCs using unison. I have copied the idmap.ldb file from DC1 to DC2 and the Windows ...
0
votes
0
answers
121
views
Can I prevent rsync from setting attributes on the topmost directory?
I'm currently building a solution to rsync Gerrit data into a Kubernetes container which has storage (a persistent volume) mounted at /var/gerrit/logs/. I am trying to use the rsync command below, but ...
- 1
1
vote
1
answer
239
views
Rsync makes the destination folder unwritable before copying files to it (and then of course it fails with Permission Denied)
I want to use rsync to deploy a project from my dev machine (Windows 11, CygWin) to a remote server (Ubuntu) through SSH. I've made sure that my SSH user has full write access to the destination ...
- 123
0
votes
0
answers
2k
views
rsync error: /etc/ssh/ssh_config: Bad configuration option: clientaliveinterval / clientalivecountmax
I am trying to copy directories from one server to another using rsync using:
rsync -avr /home/<username> <username>@111.111.111.11:/home/<username>/
I get this error (on the ...
- 73
3
votes
0
answers
434
views
why `rsync --sparse` create much larger file than the source?
I try to rsync between 2 local disks, thus there is no compression. the sparse file has apparent size of 50GB, actual size of 16GB. I tried rsync -a -P --sparse, it did generate sparse file on ...
- 292
0
votes
1
answer
56
views
Optimize rsync for bandwidth usage
I need to use the minimum amount of bandwidth when patching files from a server. How can I configure rsync to achieve this?
I've tried the following for 10Mb file filled with random text, then made ...
- 101
2
votes
2
answers
157
views
rsync exclude file: correct syntax to exclude specific folders whose names include spaces
I'm having a hard time trying to exclude some folders whose names include spaces from a rsync command using the --exclude-from=excludefile.txt option.
So far I've tried:
"Spaces in Folder Name&...
- 43
0
votes
0
answers
187
views
How to enable rsync server on QNAP 5.0.0.2131
I'm trying to enable the HBS 3 rsync server on QNAP 5.0.0.2131 but I get "An unexpected error had occurred" when I'm trying to apply the changes.
On the logs there's only info when I try to ...
- 101
1
vote
1
answer
409
views
rsync "Operation not supported" errors for ACL on ZFS
While migrating our file server to a ZFS file system with rsync -avxHAXS ... I get errors like:
rsync: [generator] set_acl: sys_acl_set_file(path/to/file, ACL_TYPE_ACCESS): Operation not supported (95)...
- 121
1
vote
1
answer
136
views
how to force rscync to unmunge symlinks
I make backups with rsync (with -a) on my own rsync server, and all links are munged (added /rsync-munged/ before each symlink) - which is good
But today I need to restore my backup from rsync server ...
- 741
0
votes
0
answers
37
views
Tentative of shh->rsync to wrong IP; potential security risk?
I have set up a little RPI backup 'server' (with rpi OS) on my LAN. I use it to create a backup of my main personal machine data using rsync, and I reach it from outside my network through SSH (key-...
0
votes
0
answers
160
views
How suitable is a S3 backend for rsync operations?
I run a large server providing open source software (https://ftp.halifax.rwth-aachen.de), currently serving more than 30 TByte of data with Multi-Gigabit throughput. Data is synchronized and kept up-...
- 334
0
votes
0
answers
79
views
RSYNC :: How to copy only new files... if you delete the files you previously copied?
I have a remote server that is continuously generating log files and saving them to a directory. Unfortunately, the log files are generated at random times, so you can't predict when the next logfile ...
- 131
0
votes
1
answer
149
views
RedHat - Rsync files using SSH authentication via HTTP proxy
What it says on the tin. I've got a firewall I don't control, an HTTP proxy I also don't control, and need to rsync files through the web proxy.
I have Googled this to death, but the only things that ...
- 111
0
votes
1
answer
168
views
Is the approach of backuppc (or similar backup architecture) safe in principle?
I'm looking over a physical server that runs VMware and 4-6 VMs (mostly Linux but also Windows10/11). Currently I'm backuping only 2 Linux VMs (the others aren't critical), by mounting an NFS share ...
- 3
0
votes
0
answers
443
views
rsync - exclude error messages
I use rsync with --log-file option in crontab.
How can I exclude error messages from the rsync_out.log file?
$ rsync -ahW ./test.txt /media/nas/mycloudex2ultra/ --log-file=rsync_out.log
rsync: [sender]...
- 1
2
votes
0
answers
594
views
ansible.posix.synchronize fails with unknown rsync option
I am running an ansible playbook with the following task:
- name: Yada Yada Yada
ansible.posix.synchronize:
src: ../foo/bar/
dest: /home/tada/tokio
When i run this using AWX i get the ...
- 121
0
votes
1
answer
71
views
Sync-rsync keeps appending my localPath (including `Users/LOCAL_USER` folder) to my remotePath
I'm trying to use the sync-rsync VSCode extension to sync my local folder to my remote server.
This is my config on VSCode settings.json file:
"sync-rsync.onSaveIndividual": true,
"sync-...
- 101
0
votes
1
answer
1k
views
Disable linux cache memory
Currently i have a server with 4 gb of ram runing 2 rsyncs task (100gb each) every 5 minutes and some monitoring containers, eventually the linux cache eats all ram (rsync faults) and if the ...
0
votes
0
answers
238
views
How to rsync files/folder from some days ago?
I would like to run cron job that run rsync command to copy files from 3-4 days ago, I've already try some rsync command like this:
rsync -arogzv --ignore-existing --files-from=<(find . -type f,d -...
0
votes
0
answers
134
views
Script for automating rsync between two machines (ssh, rsync, mysqldump involved)
I'm trying to create a bash script to automate a process that backups my WordPress blog (on a VPS) on my NAS. I always do it manually, but I'd like to just launch a command and let the thing do its ...
- 1,322
0
votes
0
answers
49
views
rsync: failed to set times on "/opt/dcm4chee-2.18.3-mysql/server/default/archive/2021/11/16/15": Read-only file system (30)
Jul 24 22:41:28 simpelpacs systemd[1]: Stopping MySQL Community Server
Jul 24 22:41:28 simpelpacs systemd[1]: Stopped MySQL Community Server
Warning: Journal has been rotated since unit was started. ...
0
votes
0
answers
938
views
rsync: connection unexpectedly closed
I have a error in rsync after update to use iconv option. I search in everything but not find any solution
The command is:
rsync -rltPDvhbz -e 'ssh -vvvv' --progress --iconv=utf-8-mac,utf-8 --exclude={...
- 101
3
votes
1
answer
1k
views
Configuring rsync over SSL
I want to configure rsync to accept SSL/TLS connections from port 874 on my server. I've followed the steps in rsyncd.conf(5) man page, configured a domain and got an SSL certificate for it. However, ...
- 180
0
votes
1
answer
316
views
Slow rsync from Linux to Windows
I backup files using rsync from RHEL Linux to Windows 10 Pro using SMB/CIFS share. It works fine except it is much slower than Linux to Linux. Both computers are fairly modern Dell OptiPlex, having 6-...
- 21
0
votes
2
answers
678
views
How to have rsync split files into smaller bits and combine them upon finishing?
I have finicky home internet, rsync might get disconnected anytime and my large files will have to restart from the beginning.
Is there a way, to split per say a one GB file into 50MB increments, send ...
user760466
0
votes
0
answers
256
views
rsync between linux and windows
I am running a Windows machine (A) which is reachable from the internet and has a lot of data which I want to transfer to a linux machine (B). I can not make machine B reachable via ssh since the ...
- 101
0
votes
0
answers
168
views
Remote SSH connection from one server to another HANGS, no fail, no error
Trying to copy files from one server to another because the amount of files is not feasible to do by copying to my home pc and then out to second server.
SSH, rync, and scp all hang from either server,...
- 1
0
votes
0
answers
348
views
Backing up files to external drive with rsync
So my scenario is that I have been using rsync to backup files from an internal drive to an external USB drive. The backup is only about 50% done and I want to backup the remaining files to a second, ...
- 159