Questions tagged [duplicity]
duplicity is an open source software to backup data incrementally in an encrypted format. It can save/upload the backup to local or remote destination. It is written in python and uses librsync.
108
questions
0
votes
0
answers
11
views
Restore data from incremental duplicity backup when the encryption key has changed
To backup important files on a Ubuntu 22.04 machine, I run a daily incremental backup via duply. The backup is stored on an external SFTP server, therefore I configured a GPG_KEY in duply, causing ...
- 930
0
votes
0
answers
97
views
duplicity: how to search for file versions in all backup chains?
duplicity can show file changes in the most recent backup chain with collection-status --file-changed <relpath>
But what if I realized that I lost a file and wanted to search for it in all (many)...
- 187
0
votes
0
answers
66
views
S3 duplicity backup works, but restore gives error
Using Duplicity 0.8.21 on Ubuntu 22.04, I can back up to S3 OK, but when I try a restore I get:
Traceback (innermost last):
File "/usr/bin/duplicity", line 92, in <module>
...
- 567
0
votes
1
answer
52
views
duplicity: No signature chains found
Trying to use duplicity to list files in a backup that is in google drive. I get the error as in the title.
I can see the folder and contents if I go to drive.google.com in the browser.
I created a ...
- 1,127
0
votes
0
answers
138
views
Maximize duplicity efficiency
I'm creating incremental backups for a database. The size is around 8 GB per dump.
I have a backup creation policy, that looks like this: (don't worry, I already avoided collisions)
An increment ...
0
votes
2
answers
826
views
Is there a way to force duplicity to use IPv4 instead of IPv6?
In the below command, example.com has both IPv4 and IPv6 addresses but SSH server listens only on the IPv4 address.
Is there a way to request duplicity to use IPv4 only?
duplicity --progress --ssh-...
- 175
0
votes
1
answer
130
views
rsync failure not detected by duply/duplicity; corrupted backup "successful"
First of all, I recognise these are not the most recent versions of duply and duplicity. The client runs servers on various OS versions, and we currently install duply and duplicity from the system ...
1
vote
1
answer
1k
views
Why duplicity asks password for decryption even if .gpg files are encrypted with GPG key?
I created a backup with duplicity with GPG encryption used by below command. When I want to restore a file duplicity asks password for decryption. Any idea why? I use YubiKey 5 to store my GPG private ...
- 175
0
votes
2
answers
104
views
Duplicity Macos crontab (python errors )
I am having errors while running duplicity in macOS (crontab)
The duplicity command is as follows (works in Command-line)
/usr/local/bin/duplicity /Users/myname/go file:///Volumes/EVO840\ -\ IMPORTANT/...
- 193
3
votes
1
answer
174
views
Why does Duplicity allow a new symmetric passphrase on incremental backups?
I am new to Duplicity and trying to test it as a new backup tool. However, I have found that it permits incremental backups with new symmetric passphrases which then causes the backup to be ...
- 131
1
vote
0
answers
441
views
Duplicity local cache during remove-older-than operation
Let me preface this by saying that I really know nothing about Duplicity. The person in my organisation that has the knowledge has gone on leave and as usual, while he's away, unusual things happen.
...
- 11
-1
votes
2
answers
1k
views
Find file duplicates and convert them into links [WINDOWS] [closed]
My users tend to save tons of duplicate files what consumes more and more space and generate HW and archiving cost.
Im thinking to create some scheduled job, to:
find duplicate files (check file MD5 ...
- 133
0
votes
1
answer
167
views
duplicity SSH-RSA key fingerprint of format 102:
When I try to run duplicity between two Ubuntu servers, a message is displayed:
"The authenticity of host ...... can't be established.
SSH-RSA key fingerprint is 102:...:...:...:...:......."
...
2
votes
2
answers
976
views
Duplicity backup is unexpectedly slow
I have a home cloud server whose data directory contains about 400GB of data.
I've tried to do a full duplicity backup on the directory. It's been running for 17 hours and only about 19 GB of data (...
- 139
3
votes
0
answers
201
views
Duplicity "add-only" incremental backup
I have a large duplicity backup stored in a server that would be too slow and costly to fully restore, but I want to perform an incremental backup of a relatively small amount of data that was missing ...
- 129
2
votes
0
answers
231
views
Identify which volumes are needed for duplicity restore
Background
I've been running Duplicity backup with the --s3-use-glacier option, and I'd like to restore a single file. I'm running the command
duplicity restore --file-to-restore myfile.txt boto3+s3://...
- 121
1
vote
1
answer
606
views
How to check the content size of a Duplicity backup-set?
Short of restoring to a temp directory, how do I list the content of a Duplicity backup-set with retained size?
I want to find out what's caused it to swell but a complex existing set of excludes ...
- 113
2
votes
1
answer
591
views
How can I remove a particular directory from a duplicity backup archive without affecting the rest of the backups, to save space?
Due to some really buggy software that likes to write its own backup files to its working area even when that it disabled, duplicity has backed up those backups resulting in several hundred GBs of ...
- 481
2
votes
3
answers
1k
views
duplicity backup fails: "Private key file is encrypted"
I am trying to upload my first duplicity backup to a remote server and it fails. It is the first time I am using the tool and it did not work before.
duplicity /home/me/Documents/ scp://me@<ip-...
0
votes
1
answer
325
views
What happens if an owner on duplicity restore does not exist?
Similar to this answer, I would like to know how duplicity behaves if an owner of files / directories does not exist on restore? And what happens if the owner does not exist on backup? By non-...
- 21
2
votes
2
answers
2k
views
duplicity "CollectionsError: No backup chains found"
I'm using duplicity 0.7.06 to back up and 0.7.17 to restore a duplicity backup. But I'm getting the error "No backup chains found" when trying to restore a directory from it.
I'm not sure what that ...
- 567
1
vote
1
answer
1k
views
Where does duplicity store the key that it creates?
I started a backup via duplicity without giving it any options. I haven't created any GPG keys myself, so when I ran duplicity, it asked me for a passphrase, then created a key, and successfully ...
0
votes
1
answer
919
views
duplicity scp (ssh) working with IP-address, NOT with domain?
I'd like to use duplicity to create an encrypted remote backup. SSH-keys are in place and work:
sudo -u ssh-user -p 41111 domain.myfritz.net
opens a terminal on the remote host. Login is password-...
- 3
0
votes
0
answers
732
views
Duplicity /etc/ backup locked files issue
I am supposed to make System-Backups of the linux servers my employer is running. I tried rsnapshot and settled for duplicity, as it seems to be updated more frequently.
I need backups of /etc/, /bin/...
2
votes
1
answer
2k
views
How to get only the pub part of gpg --list-public-keys?
Okay, there is probably a better way to phrase this question. I am writing a script to configure my web servers on the first boot, but I hit a snag when generating the GPG key that will be used to ...
user497477
1
vote
3
answers
573
views
Duplicity error: BackendException: ssh connection to SERVER_IP:22 failed
This used to work just fine until I had to change the server ip.
I can sftp to the server. I can also run a simple python code using paramiko to connect to sftp, and it works ok.
But when I run ...
- 183
0
votes
1
answer
4k
views
How to restore subdirectory of a duplicity backup?
I have a duplicity backup script running under Ubuntu 18.04 which has backed up the contents of my /etc directory like this:
duplicity --archive-dir=/home/bkp/.cache /etc rsync://backup.host::/bkp/...
- 567
0
votes
1
answer
135
views
Split duply/duplicity backup into subdirectories
I have been running backups with duply for a while now. This works great so far, but recently I started getting the error message Attempt 1 failed. BackendException: Bad status code 507 reason ...
anon
0
votes
1
answer
2k
views
Back up using Duplicity through SCP with key-based authentication
I want to back up my system to a remote server through SCP using Duplicity. However, I use key-based authentication. How could I do this?
- 103
1
vote
1
answer
424
views
Have Duplicity use user's persistent gpg session when performing full filesystem backup?
I'm trying to set up automatic, full filesystem backups on my local system using Duplicity. I do not want to have to enter my password for it to encrypt a volume: what if I am not at the computer and ...
- 151
3
votes
0
answers
850
views
Duplicity keeps telling last full backup date: none
I am using duply wrapper script and made a full backup of my folder to another location, when I then try to run incr backup, Duplicity keeps telling me, that last full backup date is none.
Warning, ...
- 237
2
votes
2
answers
2k
views
duplicity: UnsupportedBackendScheme: scheme not supported in url: dpbx:///
I'm trying to use duplicity to backup a directory to DropBox in Debian Stretch. However, duplicity gives me the error:
UnsupportedBackendScheme: scheme not supported in url: dpbx:///
I have verified ...
- 123
0
votes
1
answer
129
views
duplicity: Is it possible to create each increment based on last full and not last increment?
Duplicity creates each increment on the top of chain of increments.
I wonder if it's possible to create each subsequent increment like the first one - with full backup as its base. Is it feasible ...
- 187
0
votes
1
answer
22
views
Duply adds an AT (@) before the path (Ubuntu 16)
After an update from Ubuntu 14 to Ubuntu 16, duply stopped working - or rather continued working, but stored the backup files into the wrong directory.
This is the duply configuration (excerpt):
...
- 930
3
votes
1
answer
2k
views
Make Duplicity list files to be backed up?
When using --dry-run with rsync it can list the files that will be backed up. But when I with duplicity do
duplicity --dry-run --name pchome --encrypt-sign-key xxx --include $HOME/Desktop --exclude '*...
- 2,630
0
votes
0
answers
167
views
Duplicity/Duply Backup of EFS filesystem on AWS: All files "possibly locked"
I have an EFS file-system on AWS being mounted by an EC2 instance in order to perform backups. The filesystem has appropriate permissions:
drwxr-xr-x
The ec2 instance is running duplicity/duply to ...
- 147
-1
votes
1
answer
2k
views
CRC error in several compressed files
I have a server which backs up itself on another server with duplicity (actually duply). The full backup is about 330 1-GB files. The full backup finished without problems, but the next day the ...
- 2,636
3
votes
4
answers
1k
views
Duplicity constant memory usage (duply)
I'm experiencing constant high memory usage from Duplicity on all servers running it as a backup tool to S3.
Isn't Duplicity supposed to run its backup task and kill its job afterwards, or am I ...
- 51
3
votes
1
answer
6k
views
How to restore a Duplicity backup to a new host?
Had a catastrophic failure on a RAID array and lost everything.
Have a full set of backups on S3 via duplicity (2003 files), encrypted with GPG.
I have the passphrase and a copy of the private key ...
- 492
1
vote
1
answer
297
views
Why is posix.lstat taking such a long time? (duplicity backing up of 9p virtio filesystem)
I have a filesystem mounted with 9p virtio through KVM, and am backing it up using duplicity to a remote SSH server. I' m trying to speed up the backup process, which seems unreasonably slow to me.
...
- 51
0
votes
1
answer
345
views
duply backup to specific dir instead of home
While setting up duply for backup I am facing the following problem:
Duply should backup a directory (/ruby-webapps/webapp-map/postgesqldata) to another local backup directory(/backup/webapp_database)...
- 103
0
votes
1
answer
320
views
duplicity states first hostname letter is uppercase
Can anyone guess, why duplicity suddenly started to make or treat the first hostname letter uppercase?
[root@crew shared_scripts]# duplicity --version
duplicity 0.7.10
[root@crew shared_scripts]# ...
- 103
5
votes
1
answer
2k
views
How can I set up automated, encrypted backups of live MySQL databases on a Ubuntu VPS to Google Drive using Duplicity?
We're using DigitalOcean as our VPS provider. They have a tutorial on how to set up Duplicity for encrypted backups, but it doesn't cover database backups or the Google Drive endpoint.
I found a few ...
- 371
2
votes
3
answers
3k
views
Duplicity 0.7.10 fails after upgrading librsync in Ubuntu 14.04
I've spent a few hours trying to configure Duplicity to perform automated remote backups to a Google Drive. At this point, it's safe to say that I'm in my own private dependency hell.
Using the ...
- 371
5
votes
1
answer
3k
views
Why does duplicity need a passphrase for OpenPGP encryption?
I'd like to use duplicity to backup files and I'd like to encrypt them with GnuPG. I was wondering why duplicity asks for a passphrase to encrypt the files. For asymmetric encryption the passphrase is ...
user199740
2
votes
1
answer
192
views
Prevent duplicity to download all manifests
I need to restore most recent duplicity backup into the clean VM. Backup interval is 1 hour. The oldest backup should be 6 months.
And every time I restore backup into clean VM duplicity downloads ...
- 329
0
votes
1
answer
609
views
Trouble getting duplicity + cron + shell script to play nicely together
I'm not sure if this is more appropriate here or over in Stackexchange so sorry if I got it wrong.
I was wondering if I could get some help: So I'm trying to use cron to run my shell script which ...
- 103
0
votes
1
answer
337
views
restore backup files in another server using duplicity
I am using duplicity to backup the application files with gpg key to Amazon service S3 server. And then restore the same from S3 to own server. I want to restore the backed up files to another ...
- 11
10
votes
3
answers
13k
views
Very Huge Sized Cache of Duplicity
I am currently using a duplicity script to backup my 110G/2T CentOS server to a 2T sftp server.
Since 4 days passed, duplicity backed up just 90G. This is not a problem. The main problem is; I have ...
- 205
0
votes
0
answers
1k
views
How to restore with Duplicty if Temp space has 0 available?
Normally this command works properly for restoring:
duplicity restore -t7D --file-to-restore folder/to_restore file:///where/is/the_backup/ /where_to_restore --no-encrypt
But today I am having this ...
- 1