The tag has no usage guidance.

learn more… | top users | synonyms

31
votes
7answers
52k views

How to interrupt software raid resync?

I want to interrupt a running resync operation on a debian squeeze software raid. (This is the regular scheduled compare resync. The raid array is still clean in such a case. Do not confuse this with ...
25
votes
7answers
7k views

Options to efficiently synchronize 1 million files with remote servers?

At a company I work for we have such a thing called "playlists" which are small files ~100-300 bytes each. There's about a million of them. About 100,000 of them get changed every hour. These ...
24
votes
3answers
18k views

How does dropbox version/upload large files? [closed]

I have a free dropbox account (2GB), and I was wondering how the versioning of large files works. I have a full backup of all my webfiles that sites @ just over 1GB. After the initial upload of 1GB, ...
23
votes
4answers
2k views

Pushing Large Files to 500+ Computers

I work with a team to manage 500-600 rented Windows 7 computers for an annual conference. We have a large amount of data that needs to be synced to these computers, up to 1 TiB. The computers are ...
21
votes
2answers
3k views

What's the advantage of synchronizing UID/GID across Linux machines?

Before I plunge into the depths of how to synchronize UID's/GID's across my different Linux machines, I would like to know what is actually the benefit? I know that this keeps file synchronization ...
20
votes
6answers
6k views

Bidirectional real-time sync of large file tree between two distant linux servers

By large file tree I mean about 200k files, and growing all the time. A relatively small number of files are being changed in any given hour though. By bidirectional I mean that changes may occur on ...
13
votes
5answers
9k views

Rsync : copying over timestamps only

Currently I have two directories A/ and B/ which are identical in every respect, with the exception of the timestamps. Therefore if I run the command : rsync --dry-run -crvv A/ B/ then all files ...
12
votes
6answers
20k views

Is it possible to sync two linux directories in real time ?

I would like to sync a directory of an internal hard drive to an external hard drive. When I write or modify a file on my internal hard drive, automatically the same file would be copied to the ...
11
votes
5answers
4k views

Synchronizing very large folder structures

We have a folder structure on our intranet which contains around 800,000 files divvied up into around 4,000 folders. We need to synchronize this to a small cluster of machines in our DMZs. The depth ...
10
votes
4answers
6k views

Is execution of sync(8) still required before shutting down linux?

I still see people recommend use of "sync; sync; sync; sleep 30; halt" incantations when talking about shutting down or rebooting Linux. I've been running Linux since its inception and although this ...
7
votes
2answers
7k views

rsync : transferring files in one direction only

Is it possible to use rsync to copy files in one direction only? For example, suppose we have: left/a.txt right/a.txt where the files are initially identical. If one then modifies right/a.txt, ...
6
votes
5answers
638 views

Is there a free tool that syncs files in both directions, on a schedule?

We have a directory of files (about 4GB) - and we'd like to synchronise between 3 locations across the internet. However, we're very conscious about bandwidth, so we need the following features: ...
6
votes
2answers
2k views

Copy directory tree without empty directories?

I have the following tree # upper letters = directory # lower letters = files A |-- B |-- C |-- D |-- e <= file |-- F |-- G I need to copy this tree to another destination, ...
6
votes
3answers
3k views

Is there any way to synchronize AD users with Office 365 but still be able to edit them online?

I'm performing a migration to Office 365 from a third-party mail server (MDaemon); the local Active Directory doesn't include any Exchange server, and never had any. We will need directory ...
6
votes
10answers
2k views

Synchronize with intelligent move and rename - windows

I'm looking to synchronize two windows folders over a wireless network. I'm currently using Syncback, but it doesn't seem suitable for large reorganisations over a slow network. i.e. if I move a ...
5
votes
2answers
14k views

How to upload a directory recursively to an FTP server by just using ftp or lftp?

I am writing a Linux shell script to copy a local directory to a remote server (removing any existing files). Local server: ftp and lftp commands are available, no ncftp or any graphical tools. ...
5
votes
3answers
1k views

What program to use for incremental backup of large single file

I'm looking for a program to make incremental backups of one large file (3GB) on windows systems over internet. Any idea? Thanks!
5
votes
7answers
993 views

What is the best way to keep data synchronized between two locations?

For example, I would like to keep a lot of music files synchronized on two different hard drives. What is the most efficient way to do this? The more automated the method, the better!
5
votes
3answers
3k views

Syncing user accounts across multiple servers

I have been wondering if there is a better way to manage user accounts across multiple servers. At the moment, I have a main user account (e.g. 'user') on my home/dev machine, and for each server I ...
5
votes
3answers
5k views

OpenLdap synchronize home directory between client and server

I have recently setup Ubuntu ldap client authentication on karmic and lucid desktop clients and the ldap server is running on an 10.04 LTS server and this is the link I followed for client setup and ...
5
votes
5answers
532 views

Do you know of an online back up & sync solution for Windows that actually works?

I've been looking for some time for a program that backups your data to the cloud and is also able to sync 2 or more computers. By syncing I mean, if I change something on one computer that it should ...
5
votes
4answers
1k views

Linux User Synchronization [closed]

What would you recommend as a way to manage users in a small Linux network, so that users only need to be created on one machine with them synchronized automatically on the others. Some are laptops ...
5
votes
4answers
318 views

Copying/syncing email from a live server over network

The scenario is as follows: Copying and then syncing from a live mail server via network(only) to another server. The mail server is live meaning that lots of files (mails) are being altered, ...
5
votes
1answer
3k views

Active Directory max photo size

We are looking at putting photos in Active Directory. We have many domain controllers, some are in areas with not a lot of bandwidth. What are the recommend/max files sizes for photos or is this a ...
5
votes
6answers
959 views

Internal Dropbox system

Is there a solution out there for a windows environment that would provide a two way, centralized sync between PCs? We have several PCs in our lab on which we need to automatically sync files across, ...
5
votes
2answers
2k views

csync2 ERROR: Connection to remote host failed

I was unable to find any articles to answer this question, so my best bet was to post this here: Scenario We have 2x application servers in production hosting a PHP website and I would like some ...
5
votes
1answer
726 views

Forward-sync to HDFS? (OR continue an incomplete hdfs upload?)

Anyone have a good suggestion for doing a forward sync to HDFS? ("forward-sync" in contrast to "bi-directional sync") Basically I have a large number of files I want to put into the HDFS. Its so ...
4
votes
8answers
6k views

Suggestions for using Active Directory credentials (user name/password) with Google Apps?

I run a small college network with approximately 150 user accounts both in my Active Directory and in Google Apps. I'm looking to link AD with G-Apps. Currently my users are required to maintain ...
4
votes
1answer
1k views

rsync copies unmodified files between different file systems

I try to synchronize files between two machines using rsync, but it seems to copy all the files regardless file modification time. Two consecutive call of the command produces the same results, so it ...
4
votes
3answers
4k views

Synchronize Active Directory to Database

We are in a situation where we would like to offer our customers to be able to manage their users themselves. It is around 300 customers with up to a total of 10.000 users. Besides creating, updating ...
4
votes
2answers
2k views

Upload a file using scp only if the file was updated/modified?

pscp is a very handful tool if you want to upload files to another server using SSH. The only problem is that it is not able to detect if the destination file is already updated (based on datetime). ...
4
votes
2answers
2k views

Keep AD Group Synced in OpenLDAP with POSIX Account Augmentation

What's the most obvious way of achieving the following: The site has an working AD infrastructure and certain parts of the infrastructure are tightly coupled GNU/Linux machines where people from the ...
4
votes
1answer
178 views

Hot/Lukewarm mail server setup

We have two mailservers ("dubone" and "dubdeuce"), one does all the work while the other sits idle. We want to have a setup where if dubone is busy or down, dubdeuce can accept/reject/filter emails ...
4
votes
1answer
408 views

DRBD as DR: syncing datastores of 2 ESXI hosts, vmdk consistency?

does anyone have experience with using DRBD (protocol C) to sync parts of the datastores of 2 esxi hosts for disaster recovery of selected guests? I have 2-3 guests that should be able to recover ...
4
votes
2answers
1k views

Please help to find a solution for two way, real-time synchronization on Centos 5.5 64Bit

I am in need of a real time, two way synchronization software for Centos 5.5 / 64Bit. Here's little explanation: It needs to be able to perform: Two way synchronization. It must be realtime. By ...
4
votes
2answers
1k views

File Replication to Branch Offices

We're currently using DFSR in Server 2008 to replicate from our head office to 3 branch offices across VPN links. This way we have a local copy of all the companies files in each site, for quick ...
4
votes
1answer
527 views

Need to make all the timestamps on local files match their corresponding ftp hosted file's timestamp

I screwed up and downloaded ~10GB worth of files from my offsite backup location (ftp server) without checking the 'preserve timestamp' option in the client. The PC with the local files is a netbook ...
4
votes
1answer
181 views

How to synchronize Windows 2003 updates from Production > Test server?

We are using a Virtual Private Server to host our production Windows Server 2003 R2 web server. The hosting provider automatically installs the Windows patches (updates) on their own schedule. We ...
4
votes
2answers
965 views

syncing local folders

What is a best way to keep in sync two local folders ? I know I can use rsync -Ra but I need to keep in sync all the time. Is it possible to make rsync sit in background and constantly sync local ...
3
votes
3answers
973 views

How to keep the time on multiple servers in sync

I want a cluster of servers to have the exact same time. All are using UTC time zone. Using NTP currently, i still see they seem to be off by 10-20 miliseconds each. Whats the best way to have them ...
3
votes
5answers
779 views

What is the most efficient way to push out/publish large sets files over a network?

Here's my scenario: We have a need to push out a set of files (a 'workspace') from a source server to multiple destination servers. The files are kept under version control (SVN) so the first step is ...
3
votes
5answers
954 views

Time synchronization and scheduled tasks

If NTP runs at 10:59:55, and fixes the time to 11:00:13, does chron run the 11:00:00, and *:00:00 tasks, or are they skipped? Alternately, if NTP runs at 11:00:00 and fixes the time to 10:59:48, do ...
3
votes
7answers
10k views

Simple one-way synchronisation of user password list between servers

Using a RedHat-derivative distro (CentOS), I'd like to keep the list of regular users (UID over 500), and group (and shadow files) pushed to a backup server. The sync is only one-way, from the main ...
3
votes
5answers
2k views

File synchronization for Ubuntu Server

I'm planning on setting up two Ubuntu Servers as backup solutions where people can store images and documents. What I have in mind is that if a user saves/updates a file on a specific directory(Samba ...
3
votes
5answers
1k views

very fast file syncing software

I am searching for a very fast file syncing software to synchronize data across multiple machines, across multiple sites. Something like Dropbox or Spideroak. The software should fulfill the ...
3
votes
3answers
2k views

TracError: Repository not found

I'm getting that error when trying to execute trac-admin /path/to/trac repository resync /path/to/svnroot/repo1 Both paths exist. I'm trying to use Trac 0.12 with several svn repositories. I could ...
3
votes
3answers
1k views

More efficient method to synchronize very large # of files

I have a large directory that needs to be synced from a local server to my web server and am looking for the most efficient method of doing this. This directory contains 113k files in 14k directories ...
3
votes
6answers
475 views

Lab User Accounts

I work for a school division (K-12). While I am most interested in what works well on the Mac, Windows and Linux administrators must face the same issue and have analogous solutions. Most of our ...
3
votes
1answer
1k views

Is it really necessary to call /bin/sync twice before an unmanaged power-off?

My company sells an "embedded device" which is implemented as a headless Linux box with ext4 on an internal SSD. Some of our users have a habit of doing a "save current settings" on this box, and ...
3
votes
1answer
242 views

Rsync: General file/folder synchronization

I have a file server, which is in-charge of pulling a folder tree from multiple workstations on a daily basis. My current method for this is by using rsync, (which works pretty well provided directory ...