Do you know which methods are used for file synchronization?

The meaning of file synchronization is to keep the files in two or more folders consistent, or to be consistent as needed.

The folders that need to be synchronized can be on the same computer, on different computers, or even offsite. If the folder to be synchronized is on the same computer, it is a stand-alone file synchronization. If the folder to be synchronized is on a different computer, the remote file is synchronized. When synchronizing, scan and analyze the files in the two folders, and then compare and find the files that have been modified or added or missing, transfer the files as needed or delete the unnecessary files, and finally keep the contents of the folders consistent, or partially maintain as needed. Consistent.

inotify + rsyncAs the number of files increases to 100W+, the list of files in the directory reaches 20M. In the case of poor network conditions or speed limit, the changed files may be up to 10 M, but the list of files to be sent is up to 20M, severely reducing the bandwidth usage efficiency and synchronization efficiency; more importantly, adding inotifywait to monitor 10 small files changes within 5s, it will trigger 10 rsync Synchronous operation, the result is the 2-3M file that really needs to be transmitted, and the list of matching files reaches 200M. The advantage of using these two combinations is that they are the most basic software, with very precise control through different options, such as excluding synchronized directories, synchronizing multiple modules or synchronizing to multiple hosts.

Sersyncsersync is a domestic developer open source, written in C++, using multi-threaded way to synchronize, there is retransmission mechanism after failure, temporary file filtering, comes with crontab timing synchronization function .

●Domestic open source, the documentation is not very full ● Adopt xml configuration file, which is more readable ● Multiple directory synchronization cannot be implemented. Multiple processes can be started only through multiple configuration files. ● File exclusion is too weak

FreeFileSyncFreeFileSync is a free file synchronization software (open source). And this software is also very green, although you need to download the installation package, but you can choose to install in portable mode. After the program runs, (although the interface is a bit ugly...) Select two folders, the first is the comparison operation, you can very intuitively see the difference between the folders (you can choose to decide based on the file content instead of the file name) . Moreover, I feel that the software can also be used to compare and analyze which code files have been modified in two different versions of the project.

 镭速Point-to-point synchronization software system, to meet the needs of real-time, cycle, timing synchronization, etc., with the built-in high-speed transmission protocol to quickly synchronize the powerful functions of enterprise data assets and speed synchronization software and :

● can perform multiple sets of simultaneous jobs at once ● Customize the synchronization mode according to your needs ● Supports storage and loading of synchronized settings ● Perform synchronization jobs using command line mode batches ●Support Unicode and intra-area synchronization ● Folder comparison, fast synchronization ● Provide free installation version, decompress can use

1. File is scattered, loss of value

Modern enterprise, almost every employee is equipped with computer for automation, some employees often use their own home computer, Tablet or mobile phone to participate in the office. Corporate documents are spread across different devices of different employees. In addition, each employee's file organization and naming habits are different, which documents are valuable and which are worthless, others are difficult to know. This further exacerbates the dispersion of the document. The more dispersed the enterprise documents, the worse the manageability. If managers are unable to collect documents and cannot be standardized, it is difficult to organize and reuse. In enterprises with severely decentralized documents, when employees leave their jobs and work are handed over, the loss of documents and knowledge gaps are the norm. Even often because there is no time to hand over, a large number of knowledge documents are not known and lose value.

2. The storage method is not scientific, the file is easy to lose

This is a huge potential problem that many managers are not aware of. Among the companies surveyed, more than 60% of the managers said that their company had had at least one serious file loss incident, which brought a lot of trouble to the company. In summary, there are several reasons for file loss: Storage devices (employee's computer, U disk, CD is stolen, human error deleted, or software and hardware failures are mistakenly modified, the computer is looted. Obviously, the above problems are It is caused by the fact that the files are not properly stored. However, an interesting phenomenon is that almost all managers who have not experienced file loss lack the vigilance of file loss, which further increases the seriousness of the problem.

3 Lack of effective file query methods

The greatest value of enterprise documents lies in reuse. Any problem solved, accumulated knowledge, completed projects, and customer information are valuable corporate assets that can be used by others. However, corporate documents exist in various forms, but most companies lack effective access methods and files are difficult to reuse. This kind of problem is mainly manifested in two aspects: the file is difficult to query: when someone needs to obtain knowledge information or other documents, there is no effective means of inquiry. They don't know if the company has the documents they need, or because they haven't been able to find the location. Unable to access anytime, anywhere: When traveling or visiting customers, it is often necessary to remotely access corporate documents, including project materials, bids, product documentation, and even work partner exchange files. If the company does not provide support for remote access to files, it will cause great inconvenience to the work.

4. Files are difficult to circulate, share

between departments and project teams, and usually need to exchange and share files frequently. If the company does not provide convenient file sharing means for its employees, then file sending and updating will become a waste of time and result in reduced work efficiency. The same problem is also likely to occur between sales and customers. If the sales cannot update the documents with the customer in time, it will easily lead to inconsistent understanding and prolong the sales cycle.

5. Confidential documents leaked, enterprises suffered losses

In the enterprise, except for some public materials, any file has its own authority. Classifying files and strictly controlling them helps prevent file disclosure, which is especially important in financial, legal, or enterprise-owned companies. Although most of the companies surveyed believe that their company's documents need to be subject to strict confidentiality measures, few companies actually put them into action.