Questions tagged [duplicity]

duplicity is an open source software to backup data incrementally in an encrypted format. It can save/upload the backup to local or remote destination. It is written in python and uses librsync.

Filter by
Sorted by
Tagged with
0 votes
0 answers
46 views

Why does Duplicity allow a new symmetric passphrase on incremental backups?

I am new to Duplicity and trying to test it as a new backup tool. However, I have found that it permits incremental backups with new symmetric passphrases which then causes the backup to be ...
user avatar
  • 101
1 vote
0 answers
144 views

Duplicity local cache during remove-older-than operation

Let me preface this by saying that I really know nothing about Duplicity. The person in my organisation that has the knowledge has gone on leave and as usual, while he's away, unusual things happen. ...
user avatar
-1 votes
2 answers
286 views

Find file duplicates and convert them into links [WINDOWS] [closed]

My users tend to save tons of duplicate files what consumes more and more space and generate HW and archiving cost. Im thinking to create some scheduled job, to: find duplicate files (check file MD5 ...
user avatar
  • 123
0 votes
1 answer
68 views

duplicity SSH-RSA key fingerprint of format 102:

When I try to run duplicity between two Ubuntu servers, a message is displayed: "The authenticity of host ...... can't be established. SSH-RSA key fingerprint is 102:...:...:...:...:......." ...
user avatar
0 votes
1 answer
384 views

Duplicity backup is unexpectedly slow

I have a home cloud server whose data directory contains about 400GB of data. I've tried to do a full duplicity backup on the directory. It's been running for 17 hours and only about 19 GB of data (...
user avatar
  • 109
2 votes
0 answers
73 views

Duplicity "add-only" incremental backup

I have a large duplicity backup stored in a server that would be too slow and costly to fully restore, but I want to perform an incremental backup of a relatively small amount of data that was missing ...
user avatar
  • 121
1 vote
0 answers
91 views

Identify which volumes are needed for duplicity restore

Background I've been running Duplicity backup with the --s3-use-glacier option, and I'd like to restore a single file. I'm running the command duplicity restore --file-to-restore myfile.txt boto3+s3://...
user avatar
  • 111
0 votes
1 answer
293 views

How to check the content size of a Duplicity backup-set?

Short of restoring to a temp directory, how do I list the content of a Duplicity backup-set with retained size? I want to find out what's caused it to swell but a complex existing set of excludes ...
user avatar
  • 103
2 votes
1 answer
228 views

How can I remove a particular directory from a duplicity backup archive without affecting the rest of the backups, to save space?

Due to some really buggy software that likes to write its own backup files to its working area even when that it disabled, duplicity has backed up those backups resulting in several hundred GBs of ...
user avatar
  • 433
2 votes
3 answers
774 views

duplicity backup fails: "Private key file is encrypted"

I am trying to upload my first duplicity backup to a remote server and it fails. It is the first time I am using the tool and it did not work before. duplicity /home/me/Documents/ scp://me@<ip-...
user avatar
0 votes
1 answer
209 views

What happens if an owner on duplicity restore does not exist?

Similar to this answer, I would like to know how duplicity behaves if an owner of files / directories does not exist on restore? And what happens if the owner does not exist on backup? By non-...
user avatar
  • 21
2 votes
2 answers
2k views

duplicity "CollectionsError: No backup chains found"

I'm using duplicity 0.7.06 to back up and 0.7.17 to restore a duplicity backup. But I'm getting the error "No backup chains found" when trying to restore a directory from it. I'm not sure what that ...
user avatar
1 vote
1 answer
669 views

Where does duplicity store the key that it creates?

I started a backup via duplicity without giving it any options. I haven't created any GPG keys myself, so when I ran duplicity, it asked me for a passphrase, then created a key, and successfully ...
user avatar
0 votes
1 answer
625 views

duplicity scp (ssh) working with IP-address, NOT with domain?

I'd like to use duplicity to create an encrypted remote backup. SSH-keys are in place and work: sudo -u ssh-user -p 41111 domain.myfritz.net opens a terminal on the remote host. Login is password-...
user avatar
  • 3
0 votes
0 answers
520 views

Duplicity /etc/ backup locked files issue

I am supposed to make System-Backups of the linux servers my employer is running. I tried rsnapshot and settled for duplicity, as it seems to be updated more frequently. I need backups of /etc/, /bin/...
user avatar
2 votes
1 answer
1k views

How to get only the pub part of gpg --list-public-keys?

Okay, there is probably a better way to phrase this question. I am writing a script to configure my web servers on the first boot, but I hit a snag when generating the GPG key that will be used to ...
user avatar
1 vote
2 answers
317 views

Duplicity error: BackendException: ssh connection to SERVER_IP:22 failed

This used to work just fine until I had to change the server ip. I can sftp to the server. I can also run a simple python code using paramiko to connect to sftp, and it works ok. But when I run ...
user avatar
  • 183
0 votes
1 answer
2k views

How to restore subdirectory of a duplicity backup?

I have a duplicity backup script running under Ubuntu 18.04 which has backed up the contents of my /etc directory like this: duplicity --archive-dir=/home/bkp/.cache /etc rsync://backup.host::/bkp/...
user avatar
0 votes
1 answer
95 views

Split duply/duplicity backup into subdirectories

I have been running backups with duply for a while now. This works great so far, but recently I started getting the error message Attempt 1 failed. BackendException: Bad status code 507 reason ...
user avatar
  • 246
0 votes
1 answer
1k views

Back up using Duplicity through SCP with key-based authentication

I want to back up my system to a remote server through SCP using Duplicity. However, I use key-based authentication. How could I do this?
user avatar
  • 103
1 vote
1 answer
282 views

Have Duplicity use user's persistent gpg session when performing full filesystem backup?

I'm trying to set up automatic, full filesystem backups on my local system using Duplicity. I do not want to have to enter my password for it to encrypt a volume: what if I am not at the computer and ...
user avatar
3 votes
0 answers
631 views

Duplicity keeps telling last full backup date: none

I am using duply wrapper script and made a full backup of my folder to another location, when I then try to run incr backup, Duplicity keeps telling me, that last full backup date is none. Warning, ...
user avatar
1 vote
2 answers
1k views

duplicity: UnsupportedBackendScheme: scheme not supported in url: dpbx:///

I'm trying to use duplicity to backup a directory to DropBox in Debian Stretch. However, duplicity gives me the error: UnsupportedBackendScheme: scheme not supported in url: dpbx:/// I have verified ...
user avatar
  • 113
0 votes
1 answer
111 views

duplicity: Is it possible to create each increment based on last full and not last increment?

Duplicity creates each increment on the top of chain of increments. I wonder if it's possible to create each subsequent increment like the first one - with full backup as its base. Is it feasible ...
user avatar
  • 177
0 votes
1 answer
18 views

Duply adds an AT (@) before the path (Ubuntu 16)

After an update from Ubuntu 14 to Ubuntu 16, duply stopped working - or rather continued working, but stored the backup files into the wrong directory. This is the duply configuration (excerpt): ...
user avatar
  • 860
3 votes
1 answer
2k views

Make Duplicity list files to be backed up?

When using --dry-run with rsync it can list the files that will be backed up. But when I with duplicity do duplicity --dry-run --name pchome --encrypt-sign-key xxx --include $HOME/Desktop --exclude '*...
user avatar
0 votes
0 answers
150 views

Duplicity/Duply Backup of EFS filesystem on AWS: All files "possibly locked"

I have an EFS file-system on AWS being mounted by an EC2 instance in order to perform backups. The filesystem has appropriate permissions: drwxr-xr-x The ec2 instance is running duplicity/duply to ...
user avatar
-1 votes
1 answer
2k views

CRC error in several compressed files

I have a server which backs up itself on another server with duplicity (actually duply). The full backup is about 330 1-GB files. The full backup finished without problems, but the next day the ...
user avatar
3 votes
4 answers
1k views

Duplicity constant memory usage (duply)

I'm experiencing constant high memory usage from Duplicity on all servers running it as a backup tool to S3. Isn't Duplicity supposed to run its backup task and kill its job afterwards, or am I ...
user avatar
  • 51
3 votes
1 answer
5k views

How to restore a Duplicity backup to a new host?

Had a catastrophic failure on a RAID array and lost everything. Have a full set of backups on S3 via duplicity (2003 files), encrypted with GPG. I have the passphrase and a copy of the private key ...
user avatar
  • 482
1 vote
1 answer
195 views

Why is posix.lstat taking such a long time? (duplicity backing up of 9p virtio filesystem)

I have a filesystem mounted with 9p virtio through KVM, and am backing it up using duplicity to a remote SSH server. I' m trying to speed up the backup process, which seems unreasonably slow to me. ...
user avatar
  • 41
0 votes
1 answer
240 views

duply backup to specific dir instead of home

While setting up duply for backup I am facing the following problem: Duply should backup a directory (/ruby-webapps/webapp-map/postgesqldata) to another local backup directory(/backup/webapp_database)...
user avatar
  • 103
0 votes
1 answer
257 views

duplicity states first hostname letter is uppercase

Can anyone guess, why duplicity suddenly started to make or treat the first hostname letter uppercase? [root@crew shared_scripts]# duplicity --version duplicity 0.7.10 [root@crew shared_scripts]# ...
user avatar
  • 103
5 votes
1 answer
2k views

How can I set up automated, encrypted backups of live MySQL databases on a Ubuntu VPS to Google Drive using Duplicity?

We're using DigitalOcean as our VPS provider. They have a tutorial on how to set up Duplicity for encrypted backups, but it doesn't cover database backups or the Google Drive endpoint. I found a few ...
user avatar
  • 371
2 votes
3 answers
3k views

Duplicity 0.7.10 fails after upgrading librsync in Ubuntu 14.04

I've spent a few hours trying to configure Duplicity to perform automated remote backups to a Google Drive. At this point, it's safe to say that I'm in my own private dependency hell. Using the ...
user avatar
  • 371
5 votes
1 answer
2k views

Why does duplicity need a passphrase for OpenPGP encryption?

I'd like to use duplicity to backup files and I'd like to encrypt them with GnuPG. I was wondering why duplicity asks for a passphrase to encrypt the files. For asymmetric encryption the passphrase is ...
user avatar
2 votes
1 answer
161 views

Prevent duplicity to download all manifests

I need to restore most recent duplicity backup into the clean VM. Backup interval is 1 hour. The oldest backup should be 6 months. And every time I restore backup into clean VM duplicity downloads ...
user avatar
  • 319
0 votes
1 answer
566 views

Trouble getting duplicity + cron + shell script to play nicely together

I'm not sure if this is more appropriate here or over in Stackexchange so sorry if I got it wrong. I was wondering if I could get some help: So I'm trying to use cron to run my shell script which ...
user avatar
  • 103
0 votes
1 answer
288 views

restore backup files in another server using duplicity

I am using duplicity to backup the application files with gpg key to Amazon service S3 server. And then restore the same from S3 to own server. I want to restore the backed up files to another ...
user avatar
9 votes
2 answers
11k views

Very Huge Sized Cache of Duplicity

I am currently using a duplicity script to backup my 110G/2T CentOS server to a 2T sftp server. Since 4 days passed, duplicity backed up just 90G. This is not a problem. The main problem is; I have ...
user avatar
0 votes
0 answers
1k views

How to restore with Duplicty if Temp space has 0 available?

Normally this command works properly for restoring: duplicity restore -t7D --file-to-restore folder/to_restore file:///where/is/the_backup/ /where_to_restore --no-encrypt But today I am having this ...
user avatar
  • 1
2 votes
1 answer
803 views

sftp backups with duplicity fail

I'm using duplicity on debian wheezy, which comes with version 0.6.18 as standard package. I also tried version 0.6.24 from wheezy-backports. I want to use sftp as backend, but if I run: duplicity --...
user avatar
  • 1,050
1 vote
1 answer
1k views

Cannot restore duplicity backup

I've created a backup of my home folder, to a remote system, using duplicity 0.6.26: duplicity --no-compression --no-encryption . scp://... while being in the home folder. Now I seem to be unable ...
user avatar
  • 1,281
2 votes
4 answers
3k views

Duplicity backup to S3: BackendException

I'm trying to configure my Duplicity installation to backup to an Amazon S3 bucket. I keep getting a BackendException error with no further details. EDIT: I've removed my Duply configuration from ...
user avatar
  • 163
-1 votes
1 answer
39 views

Strategy for migrating older files

I want to have a rock solid tool to move older files to a slower disk - a migration instead of a backup. I was thinking Duplicity would be a good candidate, though I would need a reliable way of ...
user avatar
  • 340
0 votes
1 answer
2k views

Duplicity for remote backup to AWS S3

I am using Bacula with S3 for backups. I keep bacula volumes for 60 days or so. Using duplicity as I would like to use GPG encryption of the volumes. Is there any way to do an rsync style sync using ...
user avatar
  • 58
0 votes
1 answer
1k views

Using Duplicity with AWS S3 and IAM Folder policy

I'm trying to setup backups from multiple hosts to a single bucket. Each host has their own AWS login and credentials. The top most folder (prefix) maps to the AWS user id and I'm trying to limit ...
user avatar
1 vote
1 answer
629 views

duplicity s3 backup from centos

I'm trying to backup server data to S3 but getting no success. Below is the script which I run to start backup on S3. I have create a user using IAM and have granted all permissions to the user. #!...
user avatar
0 votes
1 answer
818 views

Duplicity backup restore to the same system or other system had issue

I have installed the duplicity on centos-7 and I was able to encrypt the data and able to restored the same on other server. duplicity --encrypt-key='12005FB81112' etc.gz scp://xyz@104.111.108.101/...
user avatar
1 vote
1 answer
507 views

Restore from Amazon S3 with dupy - duplicity on a new machine

I am trying to restore a full backup in a new machine but it seems that is not working. I installed my pgp's and secret keys. Also I copied my project from duply but when I run duply test restore /...
user avatar