541 reputation
37
bio website scottmcclenning.blogspot.com
location Oxnard, CA
age 41
visits member for 4 years, 11 months
seen Dec 7 at 22:37

Oct
11
comment Tips on efficiently storing 25TB+ worth million files in filesystem
FYI: Windows DFS is a way to keep files/folders on multiple server in sync. It won't allow you to use the storage on multiple servers as a single storage drive. microsoft.com/windowsserversystem/dfs/default.mspx
Oct
11
revised Tips on efficiently storing 25TB+ worth million files in filesystem
clarified the data is stripe across the RAIDz
Oct
11
revised Tips on efficiently storing 25TB+ worth million files in filesystem
added alternate method of fault tolerance using ZFS
Oct
11
answered Tips on efficiently storing 25TB+ worth million files in filesystem
Oct
10
comment ZFS Sync over unreliable, slow WAN. ZFS replication, or rsync?
In my case, I'm still learning rsync so I may not have set things up properly or was using rsync improperly, but eliminating rsync from having to check files that didn't change or just doing a copy was faster for me. (I was trying to use rsync to mirror some data on an external drive.) Perhaps what killed rsync was several thousands of small files. (Small being a few KB each.) I would expect with fewer and larger video files rsync would perform better. In my case I had to test and test to see what actually performed best for my setup.
Oct
10
awarded  Editor
Oct
10
revised ZFS on top of Hardware Mirroring, or just mirror in ZFS?
added RAID sync
Oct
10
answered ZFS on top of Hardware Mirroring, or just mirror in ZFS?
Oct
10
comment ZFS Sync over unreliable, slow WAN. ZFS replication, or rsync?
The only thing I would add is maybe not using rsync. I too experienced the slowness of rsync because I was using it as a transfer process, not sync process. Then I realized most of my existing data didn't change and only new data needed to be copied, for me, I used cp on only the new files and it was much faster. If I had files that changed (or only parts of files) then I would use rsync. So I suggest separating the new files out and pick a resumable transfer method. Also, compression would be a CPU & RAM/bandwidth trade-off (on both ends).
Oct
10
answered Can anyone think of a way of preventing an XP client from performing DNS lookups for external domains?
Oct
7
answered Zpool disk failure - Where am I at?
Oct
6
answered How to setup Remote Desktop to computers via subdomain?
Oct
6
answered ZFS and SAN — best practices?
Sep
26
answered How to add extra DNS server to handle my own TLD domains?
Jun
19
awarded  Supporter
Jan
21
comment Samba vs Windows File Sharing/Server, which one is faster?
I know this could be a religious war and I hadn't seen any benchmarks or done any tests myself, but my anecdotal opinion is samba was faster. However, when I look for a central file store I look for ease of administration and backup/restore. That for me usually determines the OS I use, which for me means Windows.
Jan
21
comment Samba vs Windows File Sharing/Server, which one is faster?
I know this could be a religious war and I hadn't seen any benchmarks or done any tests myself, but my anecdotal opinion is samba was faster. However, when I look for a central file store I look for ease of administration and backup/restore. That for me usually determines the OS I use, which for me means Windows.
Jan
9
comment Is there something (free) like ZFS or HadoopFS or GFS for Windows?
Agree with Matt, DFS is a way to replicate a directory across multiple servers. Not a way to utilize multiple server's storage as one directory.
Jan
7
answered Is there something (free) like ZFS or HadoopFS or GFS for Windows?
Dec
31
awarded  Teacher