4
votes
4answers
875 views

ZFS: Memory issues with dedup even though zdb -DD looks fine

I've been experimenting with ZFS on a machine with Ubuntu 12.10, 32GB RAM (non-ECC, production system will have ECC) and a 2x2TB Linux-managed RAID1 (will be moved to RAIDZ1 for production). I just ...
10
votes
1answer
2k views

How large is my ZFS dedupe table at the moment?

I have read a lot of information about planning RAM requirements forZFS deduplication. I've just upgraded my file server's RAM to support some very limited dedupe on ZFS zvols which I cannot use ...
2
votes
2answers
386 views

Deduplication of tar archives

Now I'm trying to configure ZFS with deduplication on my linux backup server and have a question. For example I have 1k files in backup1.tar and 1k same files and 1 new in backup2.tar. This files ...
12
votes
1answer
414 views

Technical details for Server 2012 de-duplication feature

Now that Windows Server 2012 comes with de-duplication features for NTFS volumes I am having a hard time finding technical details about it. I can deduce from the TechNet documentation that the ...
1
vote
1answer
93 views

ZFS dedup block usage?

How can I list all the ZFS dedup blocks and the files that are associated with each one? e.g.: BLOCK FILES e6b678a /pool/a/file1 /pool/a/file2 If that's not possible, what about ...
1
vote
1answer
187 views

ZFS for offline backups

I'm thinking of using ZFS to backups files to single drives that are going to be kept mostly offline. Does anyone know if the FreeBSD ZFS implementation still uses memory if a dedupped pool is ...
8
votes
3answers
2k views

Backup storage server with ZFS

I am IT everything man at a small company. I want to design a new infrastructure including a new server and a separate backup server with company wide backup policy. The most important thing in the ...
1
vote
1answer
109 views

ZFS: can per-user encrypted filesystems be deduplicated on block-level?

Let's assume I build a storage system where each user gets his/her own encrypted filesystem on top of a ZFS pool. Would deduplication on pool-level still work when each fs is encrypted? What ...
2
votes
2answers
2k views

How does ZFS Block Level Deduplication fit with Variable Block Size?

According to The First Google Result for "ZFS Deduplication" ... What to dedup: Files, blocks, or bytes? ... Block-level dedup has somewhat higher overhead than file-level dedup when whole ...
1
vote
2answers
731 views

Should I use USB drive for Solaris 11 Express

Debating on if I should use a 16gb USB drive for my Solaris 11 Express SAN server. I intend to use Deduplication which I believe may be IO intensive for the DB. Though I can't be sure. The SAN ...
7
votes
2answers
2k views

ZFS - destroying deduplicated zvol or data set stalls the server. How to recover?

I'm using Nexentastor on a secondary storage server running on an HP ProLiant DL180 G6 with 12 Midline (7200 RPM) SAS drives. The system has an E5620 CPU and 8GB RAM. There is no ZIL or L2ARC device. ...
0
votes
5answers
840 views

Does (when?) OpenSolaris support ZFS deduplication and l2arc

Deduplication and L2ARC in ZFS would be nice to have. Does OpenSolaris support them? I can't quite figure out which version of Solaris they are in, and how that maps to OpenSolaris. Are they there? ...