The tag has no wiki summary.

learn more… | top users | synonyms

2
votes
1answer
29 views

How to interpret the results of DDPEval.exe?

I have read the documentation for DDPEval.exe and various blogs and so on and cannot find any information on how to interpret the results. I ran the tool on a drive on one of our servers and found ...
0
votes
1answer
29 views

HUGE ammount of duplicate files in this directory

I maintain our companies SBS2011 server, and I have duplicate file reports emailed to me on a monthly basis. I've noticed an increasing build up of duplicated files in the following directories: NT ...
1
vote
1answer
234 views

Mavericks permission issues with Windows Server deduplicated shares

We have a number of 10.9-10.9.3 - Mavericks - machines installed throughout our facility. Much of the user content is pulled from shares stored on our Windows Server 2012 fileservers with ...
1
vote
3answers
366 views

How to cut of Windows 2012 Server to save the disk space?

I have VPS Hosting windows 2012 Server + MSSQL Server 40GB storage. I am running out of space and I don't want to upgrade the hosting to more expensive variant. I have cleaned logs, temporary files, ...
4
votes
4answers
1k views

ZFS: Memory issues with dedup even though zdb -DD looks fine

I've been experimenting with ZFS on a machine with Ubuntu 12.10, 32GB RAM (non-ECC, production system will have ECC) and a 2x2TB Linux-managed RAID1 (will be moved to RAIDZ1 for production). I just ...
4
votes
1answer
493 views

Server 2012 deduplication: run on Hyper-V host or guest VM?

I have a Windows Server 2012 Hyper-V host with VMs on a dedicated RAID-5 volume. One VM is also running Server 2012 and is being used to serve files. The other VMs are smaller and mostly used for ...
3
votes
1answer
171 views

Production-ready disk deduplication for KVM (Linux)? [closed]

Multiple Windows VMs, all of them with identical software installed (they're clones in fact) that I have to run for administrative+licensing reasons, give me a headache storage-wise. KVM on Linux runs ...
0
votes
0answers
95 views

Data deduplication works vice versa

I have enabled data deduplication on one of my SSD's volumes and then run Start-DedupJob cmdlet with optimizastion parameter on this volume (Windows Server 2012). After dedup completed i check ...
4
votes
3answers
251 views

Store multiple versions of large binary file with minimal data duplication (preferably Linux)

I need to store multiple versions of a ~ 150 GB binary file (qcow2) on Linux servers with local storage, and was hoping there is some solution that involves just keeping diffs that can be merged as ...
10
votes
1answer
2k views

How large is my ZFS dedupe table at the moment?

I have read a lot of information about planning RAM requirements forZFS deduplication. I've just upgraded my file server's RAM to support some very limited dedupe on ZFS zvols which I cannot use ...
3
votes
4answers
1k views

What's the best way to copy deduplicated files onto a new Server 2012 drive?

We have a deduplicated volume on a Windows Server 2012 machine that is approaching it's limits. It is a 1.3TB drive with ~10TB of duplicated data. We want to copy all of this data onto a larger 4TB ...
1
vote
1answer
229 views

Backing up multiple git repos of the same project (deduplication)

I use a central git server (a gitlab instance). Developers clone projects to a samba share on another server. At the moment, I make backups of the gitlab server and all of the developers directorys on ...
2
votes
2answers
415 views

Deduplication of tar archives

Now I'm trying to configure ZFS with deduplication on my linux backup server and have a question. For example I have 1k files in backup1.tar and 1k same files and 1 new in backup2.tar. This files ...
3
votes
2answers
753 views

Accessing windows server deduplicated files from other operating systems

If you enable data deduplication on the Windows Server 2012, it will change certain files (according to the policy) and introduce reparse points. If the drive containing deduplicated volumes is ...
3
votes
2answers
1k views

Mixing Volume Shadow Copy and Data Deduplication in Windows Server

I'm using Windows Server 2012 and I'm creating a scheduled backup for multiple Hyper-V guests (all of them are Windows Server 2012) to a dynamic VHDX on a removable USB drive (so that I can alternate ...
1
vote
2answers
987 views

Server 2012 Data Deduplication Skipping Replica VHDs

I'm currently trying to use data deduplication on two seperate Windows Server 2012 Datacenter edition hyper-v hosts. On one, I am trying to dedupe replicas that are still being resync'd every 5 ...
12
votes
1answer
430 views

Technical details for Server 2012 de-duplication feature

Now that Windows Server 2012 comes with de-duplication features for NTFS volumes I am having a hard time finding technical details about it. I can deduce from the TechNet documentation that the ...
1
vote
1answer
93 views

ZFS dedup block usage?

How can I list all the ZFS dedup blocks and the files that are associated with each one? e.g.: BLOCK FILES e6b678a /pool/a/file1 /pool/a/file2 If that's not possible, what about ...
1
vote
0answers
215 views

HP D2D 4312 Bacula configuration

I have configured 5 libraries on the HP D2D system Discovery on the Bacula server shows only the last library and not all libraries. Why? [root@server bacula]# iscsiadm --mode discovery --type ...
1
vote
1answer
192 views

ZFS for offline backups

I'm thinking of using ZFS to backups files to single drives that are going to be kept mostly offline. Does anyone know if the FreeBSD ZFS implementation still uses memory if a dedupped pool is ...
1
vote
1answer
854 views

How to activate deduplication in Windows Server 2012?

I just installed Windows Server 2012, and while I see and read about a new deduplication feature, the Server Manager keeps reporting empty fields in the columns for deduplication rate and savings. How ...
8
votes
3answers
2k views

Backup storage server with ZFS

I am IT everything man at a small company. I want to design a new infrastructure including a new server and a separate backup server with company wide backup policy. The most important thing in the ...
3
votes
2answers
408 views

File System with Real-Time Data Deduplication

Is there a file system that stores files under a hash so there are no duplicates? It can be under any operating system. I know Git does that, but I'm looking for something that can run in real-time.
-1
votes
1answer
4k views

Free SAN Storage Software for Linux [closed]

I'm looking for a free solution to build virtual disk targets accessible over SAN (iSCSI). Primary requirement for me is data deduplication support. After much search on the internet i came across ...
1
vote
1answer
110 views

ZFS: can per-user encrypted filesystems be deduplicated on block-level?

Let's assume I build a storage system where each user gets his/her own encrypted filesystem on top of a ZFS pool. Would deduplication on pool-level still work when each fs is encrypted? What ...
2
votes
3answers
2k views

Fastest way to copy large file directory over slow internet

I need to copy a directory from one of our servers several hundred miles away. Both sites where I am and where the files are have business cable. The cable is 5 Mbps(Down) / 768 Kbps(Up). This poses a ...
2
votes
2answers
2k views

How does ZFS Block Level Deduplication fit with Variable Block Size?

According to The First Google Result for "ZFS Deduplication" ... What to dedup: Files, blocks, or bytes? ... Block-level dedup has somewhat higher overhead than file-level dedup when whole ...
1
vote
2answers
742 views

Should I use USB drive for Solaris 11 Express

Debating on if I should use a 16gb USB drive for my Solaris 11 Express SAN server. I intend to use Deduplication which I believe may be IO intensive for the DB. Though I can't be sure. The SAN ...
5
votes
3answers
2k views

Proper use of disk to disk to tape backup using de-duplication and LTO5

I currently have ~12TB of data for a full disk to tape (LTO3) backup. Needless to say, it's now requiring over 16 tapes so I'm looking at other solutions. Here is what I've come up with. I'd like ...
1
vote
1answer
707 views

Extracting and saving attachments from maildir, deduplicated

I would like to know if there exists a solution for archiving email, stripping out the attachments and saving them separately, deduplicated? The ideal would be a maildir-setup, with a script running ...
0
votes
2answers
610 views

Best filesystem for VM storage? [closed]

What is the best file system for storing VM images? I am looking for features that can save some disk space like compression, deduplication, etc. ZFS is known...but any other alternatives in Linux ...
5
votes
5answers
347 views

Full-featured online backup providers for medium-sized enterprise? [closed]

I've been banging my head against the wall trying to find an online backup service that supports all of the following enterprisey features: Full-system backup for Linux and Windows 2003/2008 ...
1
vote
2answers
211 views

Differential backup of dedup volume

We are currently doing a complete remote backup of our VM's once a week. This takes the whole weekend, and I'd like to speed up the process some if possible. We are backing up the VM's using Dedup, ...
7
votes
2answers
2k views

ZFS - destroying deduplicated zvol or data set stalls the server. How to recover?

I'm using Nexentastor on a secondary storage server running on an HP ProLiant DL180 G6 with 12 Midline (7200 RPM) SAS drives. The system has an E5620 CPU and 8GB RAM. There is no ZIL or L2ARC device. ...
1
vote
5answers
537 views

IMAP server that saves space on identical attachments [closed]

Looking for IMAP server that can detect duplicate attachments across mailboxes and would not waste space on them. So, if 4 local mailboxes receive the same attachment I would like it to be stored ...
1
vote
2answers
5k views

Deduplication option in Backup Exec 2010 - does it work like this?

We have a 6TB backup-to-disk system running with Backup Exec 2010. Each week, a full backup is carried out with differentials on the other days. We manage to get about four weeks of backups in there. ...
1
vote
1answer
817 views

VMware ESXi 4 On-Disk Data Deduplication - possible and supported?

Environment: We are running multiple web, database, and application servers which usually share a pretty common installation (gentoo linux) and similar configuration in VMware ESXi 4. The differences ...
7
votes
2answers
318 views

What is “deduplication”?

I mean, I can look up the dictionary definition, but why is everyone suddenly talking about it in reference to virtual tape libraries? What's "new" here so that it's so much in the news lately?
0
votes
5answers
840 views

Does (when?) OpenSolaris support ZFS deduplication and l2arc

Deduplication and L2ARC in ZFS would be nice to have. Does OpenSolaris support them? I can't quite figure out which version of Solaris they are in, and how that maps to OpenSolaris. Are they there? ...
4
votes
18answers
5k views

How to Eliminate Tape Backup and Off-site Storage Service?

PLEASE READ UPDATE AT THE BOTTOM. THANKS! ;) Environment Info (all Windows): 2 sites 30 servers site #1 (3TB of backup data) 5 servers site #2 (1TB of backup data) MPLS backbone tunnel connecting ...
9
votes
10answers
9k views

Block-level deduplication on Linux

NetApp provides block-level deduplication (ASIS). Do you know any filesystem (even FUSE-based) on Linux (or OpenSolaris, *BSD) that provides the same functionnality ? (I'm not interested in false ...
5
votes
6answers
567 views

Capacity Optimization / Deduplication Options for Primary Storage

I'm exploring options for making more efficient use of our primary storage. Our current NAS is an HP ProLiant DL380 G5 with an HP Storageworks MSA20, and one other disk shelf which I'm not sure what ...