Synchronization and backup programs (简体中文)
这个页面列出并比较了在两个或多个位置之间同步数据的应用程序,以及在此功能之上建立的以备份为目的的制作重要数据的增量副本的应用程序。因为它们的关系,这两组程序共享许多特征所有在同一篇文章里解释描述它们.
Contents
备份概览
备份重要数据是必须采取的措施,因为人和机器的处理错误随着时间推移非常可能产生损坏,并且存储数据的物理媒体也不可避免的注定损坏. 为了选择满足每个人的需求的程序,下面的一些问题要考虑:
- 存储数据的备份媒介, 比如. CD, DVD, 远程服务器, 外部硬盘, 等的种类.
- The planned frequency of backups, e.g. daily, weekly, monthly, etc.
- The features expected from the backup solution, e.g. compression, encryption, handles renames, etc.
- The planned method to restore backups if needed.
Data synchronization
These applications simply keep directories synchronized between multiple locations/machines, in a "mirror" fashion. Nonetheless, most of them still allow storing and reverting to old revisions of modified or deleted files.
See also:
- List of applications/Utilities#File synchronization
- List of applications/Internet#Cloud synchronization clients
- Wikipedia:Comparison of file synchronization software
Legend
- Name
- The application name, linking to the ArchWiki article or the official website.
- Package
- A link to the package.
- Implementation
- The programming language, library, or utility that the application is based on.
- Delta transfer
- Only the modified parts of files are transferred.
- Encrypted transfer
- Data is encrypted by default when transferred over the network.
- FS metadata
- File system permissions and attributes are synchronized.
- Resumable
- The synchronization can be resumed if interrupted.
- Handles renames
- Moved/renamed files are detected and not stored or transferred twice. It typically means that a checksum of files or its chunks is computed. Applications missing this functionality can be supplemented by combining with hsyncAUR, which only synchronizes renames.
- Version control
- The old version of files are backed up (reverse incremental backup).
- Change propagation
- Specifies in how many directions changes can be propagated.
- unidirectional means one-way synchronization of two locations,
- bidirectional means two-way synchronization of two locations and
- multidirectional means full synchronization of more than two locations.
- Conflict resolution
- The application handles file conflicts, either automatically or interactively, i.e. it does not silently discard conflicting files. This attribute does not apply to applications that only propagate changes in one direction.
- FS monitoring
- The application listens to file system events to trigger the synchronization.
- CLI
- The application provides a command-line interface.
- Other interfaces
- The application has the specified user interfaces, e.g. GUI, TUI, or web-based.
- License
- The license of the server and client applications.
- Other platforms
- Supported operating systems other than Linux.
- Maintained
- The project is maintained.
- Specificity
- Brief notes about special features that notably set the application apart from the others.
Table
Name | Package | Implementation | Delta transfer | Encrypted transfer | FS metadata | Resumable | Handles renames | Version control | Change propagation | Conflict resolution | FS monitoring | CLI | Other interfaces | License | Other platforms | Maintained | Specificity |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
FreeFileSync | freefilesyncAUR | C++ | ? | SFTP [1] | ? | ? | Yes [2] | Yes [3] | unidirectional / multidirectional | Yes | ? | No | Yes | GPL | Windows, macOS | Yes | |
git-annex | git-annex | Haskell, git | rsync [4] | rsync [5] | ? | ? | ? | Yes | multidirectional; with git remotes [6] | renames conflicting files [7] | ? | Yes | git-annex assistant | GPLv3 | macOS, Android | Yes | Manage files with git |
osync.sh | osyncAUR | Bash, based on rsync | rsync | rsync | ? | Yes | No | Yes | bidirectional | keeps multiple versions of a file [8] | optional [9] | Yes | No | BSD | Yes | ||
rclone | rclone | Go | No [10] | ? | ? | ? | ? | ? | unidirectional [11] | ? | ? | Yes | RcloneBrowser | MIT | *BSD, Plan9, Solaris, Windows, macOS | Yes | Optimized for synchronization with cloud storage, behavior varies with the features supported by the remote location. |
rdiff-backup | rdiff-backup | Python 2, librsync | rsync | rsync | Yes | ? | No | Yes | unidirectional | No | Yes | No | GPL | Win32 | ? | ||
Resilio Sync | rslsyncAUR | C++ | Yes | Yes | ? | Yes | ? | Yes | multidirectional | ? | ? | No | Web | Proprietary freemium | FreeBSD, Windows, macOS, Android, iOS, Windows Phone, Amazon Kindle Fire | Yes | P2P sync |
rsync | rsync | C | Yes | SSH or native protocol | Yes | Yes | No |
|
unidirectional | No | Yes | Rsync#Front-ends | GPLv3 | Win32 | Yes | Standard tool present on all Linux distributions. | |
SparkleShare | sparkleshare | C#, git | Yes | AES-256 [13] | ? | ? | Yes | Yes | ? | ? | ? | No | Yes | GPLv3 | Windows, macOS | Yes | It can sync with any Git server over SSH. |
Syncany | syncanyAUR | Java | ? | ? | ? | ? | ? | ? | ? | ? | ? | Yes | Yes | GPLv3 | No [14] | ||
Syncthing | syncthing | Go | Yes [15] | Yes [16] | partial [17] | Yes | ? | Yes [18], previous versions moved to archive folder | multidirectional | renames one file [19] | Yes | Yes | Web, GTK | MPL v2 | BSD, Windows, macOS, Android, Kindle Paperwhite | Yes | P2P sync |
Synkron | synkronAUR | C++ | ? | ? | ? | ? | ? | ? | multidirectional | ? | ? | No | Qt | GPLv2 | Windows, macOS | No | |
taskd | taskdAUR | C++, Python | Yes | Yes | ? | Yes | ? | ? | multidirectional | ? | No | Yes | No | MIT | Android | Yes | |
Unison | unison | OCaml | Yes | Yes | partial [20] | optional [21] | No | Yes [22] | bidirectional | interactive | No | Yes | GTK2 | GPL | FreeBSD, Windows, macOS, Android | Yes [23] |
Incremental backups
Applications that can do incremental backups remember and take into account what data has been backed up during the last run (so-called "diffs") and eliminate the need to have duplicates of unchanged data. Restoring the data to a certain point in time would require locating the last full backup and all the incremental backups from then to the moment when it is supposed to be restored. This sort of backup is useful for those who do it very often.
See also:
- List of applications/Security#Backup programs
- Wikipedia:List of backup software
- Wikipedia:Comparison of backup software
- Wikipedia:Comparison of online backup services
Legend:
- Name: the application name, linking to the ArchWiki article or the official website.
- Package: a link to the package.
- Implementation: the programming language, library, or utility that the application is based on.
- Compressed storage: compression is used for storage.
- Encrypted storage: encryption is used for storage.
- Delta transfer: only the modified parts of files are transferred.
- Encrypted transfer: data is encrypted by default when transferred over a network.
- FS metadata: file system permissions and attributes are backed up.
- Easy access: the backup is stored plainly in the file system, or is mountable as such.
- Resumable: the backup can be resumed without restarting it if interrupted.
- Handles renames: moved/renamed files are detected and not stored or transferred twice; it typically means that a checksum is computed for files or chunks thereof.
- CLI: the application is command-line driven, i.e. it is scriptable.
- Other interfaces: the application has the specified user interfaces, e.g. GUI, TUI, or web-based.
- Licence: the licence of the server and client applications.
- Other platforms: supported operating systems other than Linux.
- Maintained: whether the project is maintained.
- Specificity: brief notes about special features that notably set the application apart from the others.
Single machine
These applications are aimed at backing up data from the machine they are installed on, although the backup destination can be located on an external machine or storage media.
Chunk-based increments
If a file is modified, these applications store only its changed parts at the next snapshot. Compared to #File-based increments applications, these are more space-efficient, especially when large files receive small modifications; on the other hand, the archived snapshots have to be opened with the backup application that created them, since the files have to be reconstructed from the stored binary diffs.
Name | Package | Implementation | Compressed storage | Encrypted storage | Delta transfer | Encrypted transfer | FS metadata | Easy access | Resumable | Handles renames | CLI | Other interfaces | Licence | Other platforms | Maintained | Specificity |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Areca Backup | arecaAUR | Java | Zip, Zip64 | AES128, AES256 | Yes | Yes | Yes | No | Pausing only | No | Yes | Yes | GPLv2 | Windows | Yes | |
BorgBackup | borg | Python, C (Cython) | lz4, zlib, lzma, zstd | AES256 | Yes | SSH | Yes [24] | Yes [25] | Yes [26] | Yes | Yes | third party | BSD | *BSD, macOS, Windows (Cygwin / WSL)[27] | Yes | Deduplication based on variable length chunks; support both local and SSH-based remote backup destination. |
btar | btarAUR[broken link: archived in aur-mirror] | C | Yes | Yes | Yes | Yes | ? | No | ? | ? | Yes | No | GPLv3 | Yes | Redundancy, indexed extraction, multicore compression, input and output serialisation, tolerance to partial archive errors. | |
bup | bup bup-gitAUR | C, Python, git | Yes | No | Yes | Yes | Immature | Yes [28] | pick up where you left off [29] | Yes | Yes | bupsAUR | GPLv2 | NetBSD, Windows, macOS | Yes | Same storage format as git. |
Duplicati | duplicati-latestAUR | C# | Yes | Yes | Yes | Yes | scheduled for 2.0 release | No | Pausing only | No | Yes | Yes | LGPL | Windows | Yes | |
Duplicity | duplicity | librsync | gzip | gpg | Yes | Yes | ? | No | Yes | No | Yes | Yes | GPL | Yes | ||
Kup Backup System | kup | rsync, bup front-end | Yes | Yes | Yes | Yes | Immature | Yes | No | Yes | bup | Qt | GPLv2 | Yes | ||
obnam | obnamAUR | Python | Yes | GnuPG | Yes | Yes | ? | Yes | checkpoints every 100MB | ? | Yes | No | GPLv3 | No | ||
restic | restic restic-gitAUR | Go | No [30] | AES-256 [31] | Yes | Yes | Yes [32] | Yes [33] | Yes [34] | Yes | Yes | No [35] | BSD | OpenBSD, Windows, macOS | Yes | Supports storage on various cloud services natively and through rclone. |
ZBackup | zbackupAUR | C++ | LZMA, LZO | AES | Yes | Yes | ? | planned [36] | No | Kinda through tar | Yes | No | GPLv2 | Yes | Repository consists of immutable files. |
File-based increments
If a file is modified, these applications store its new version entirely at the next snapshot. Compared to #Chunk-based increments applications, these are less space-efficient, especially when large files receive small modifications; on the other hand, often the archived snapshots can be opened without the need to have the backup application installed.
Specific legend:
- Hard links: whether unmodified files are stored as hard links to previous versions.
Name | Package | Implementation | Compressed storage | Encrypted storage | Delta transfer | Encrypted transfer | FS metadata | Easy access | Resumable | Handles renames | Hard links | CLI | Other interfaces | Licence | Other platforms | Maintained | Specificity |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Back In Time | backintimeAUR | Python, rsync, diff | No | No | rsync | rsync | rsync | Yes | No | No | Yes [37] | Yes | Qt | GPLv2 | Yes | ||
DAR (Disk ARchive) | darAUR | C++ | special archive format | Yes | Yes | Yes | ? | ? | ? | ? | No [38] | Yes | darguiAUR | GPL | FreeBSD, NetBSD, Windows, macOS | Yes | |
Link-Backup | link-backupAUR | Python 2 | No | No | ? | SSH | ? | ? | Yes | Yes | No [39] | Yes | No | MIT | No | It copies itself to the server. | |
rdup | rdupAUR | C | tar.gz | gpg, blowfish and others | ? | ? | ? | Yes | ? | No | Yes | Yes | No | GPLv3 | No | Set of command-line tools. | |
rsnapshot | rsnapshot | rsync | No | No | Yes | Yes | ? | ? | ? | ? | Yes [40] | Yes | No | GPLv2 | Win32 | No [41] | |
sbackup | sbackupAUR | Python | gzip, bzip2 | No | ? | SSH | ? | No | No | No | No | No | GTK | GPLv3 | No | ||
TimeShift | timeshiftAUR | rsync | No | No | rsync | rsync | ? | ? | ? | ? | Yes | No | GTK | GPLv3 | Designed for full-system backups to dedicated devices. | Yes |
Network oriented
These applications have been designed to centralize the backup of several machines connected to a network, through a server-client model. In general they are more complicated to deploy, compared to #Single machine solutions.
Specific legend:
- Control direction: Pull: server logs into client. Push: client initiates backup session.
-
Increment type: the strategy used to reduce used space by deduplicating data (i.e., besides compression).
-
file-based: if a file is modified, the entire new version is stored at each snapshot.
- hard-links: whether unmodified files are stored as hard links to previous versions.
- chunk-based: only the modified parts of files are stored at each snapshot.
-
file-based: if a file is modified, the entire new version is stored at each snapshot.
Name | Package | Implementation | Control direction | Compressed storage | Encrypted storage | Delta transfer | Encrypted transfer | FS metadata | Easy access | Resumable | Handles renames | Increment type | CLI | Other interfaces | Licence | Other platforms | Maintained | Specificity |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
BackupPC | backuppc | Perl | Pull | Yes | No | Yes | Yes | Yes | No | Yes | ? | file-based, hard links [42] | No | Web | GPLv2 | Any (no client needed) | Yes | Identical files across backups of the same or different clients are stored only once. |
Bacula | bacula* in AUR | C++ | Pull | Yes | Yes | ? | Yes | ? | ? | Yes | ? | file-based [43] | Yes | GUI, Web | AGPLv3 | Windows, macOS | Yes | |
burp | burp-backupAUR | librsync | Push | Yes | Yes | Yes | Yes | Yes | ? | Yes | ? | chunk-based [44] | Yes | burp-ui | AGPLv3 | Windows, macOS | Yes | |
SafeKeep | safekeepAUR | rdiff-backup | Pull | No | No | ? | Yes | ? | ? | ? | ? | chunk-based [45] | Yes | Yes | GPL | No | Integrates with LVM and databases to create consistent backups. Bandwidth throttling. | |
Snebu | snebuAUR[broken link: archived in aur-mirror] | C | Push or Pull | Yes | No | ? | Yes | ? | ? | ? | ? | file-based [46] | Yes | No | GPLv3 | ? | Supports arbitrary retention schedules. | |
Synbak | synbak | Multitool wrapper | ? | Yes | No | Yes | Yes | Yes | ? | ? | ? | ? | No | Web | GPLv3 | Yes | Unifies several backup methods. | |
UrBackup | urbackup* in AUR | C++ | Pull | No | No | Yes | Internet transfers only | Yes | Yes | Yes | Yes | file-based,hard-links and symlinks[47]/chunk-based CoW-Snapshots[48] | Yes (client) | GUI, Web | AGPLv3+ | Windows, macOS | Yes | Identical files across backups of the same or different clients are stored only once. Integrates with LVM, dattobd and btrfs for file system snapshots. |
Version control systems
While version control systems are mostly used for source code, they can track any files in a directory.
See List of applications/Utilities#Version control systems and dotfiles.
See also
- Backing up Linux and other Unix(-like) systems
- Exhaustive list of backup solutions for Linux
- Performance comparison of five remote incremental backup tools: Rsync, Rdiff-backup, Duplicity, Areca and Link-Backup
- Mirroring an Entire Site using Rsync over SSH[dead link 2018-09-14]
- rsync-snapshot.sh[dead link 2018-09-14] — Local and remote snapshot backup using rsync with hard links