metarclone 0.0.1.dev2

Metadata-preserving backup with small file merging using Rclone

metarclone

metarclone is a command-line utility to sync files with file attributes to rclone remotes. It aggregates files smaller than a certain threshold into larger tarballs, thus useful for remotes where creating lots of small files are not feasible, e.g. Google Drive, S3 Glacier.

*Note: Still under development; partial download sync is not implemented currently

Features

• Small-file aggregation while preserving directory structure whenever possible
• File attributes preservation (ctime, mtime, sparse files; permission, owner, ACLs on Linux) using tar
• Partial sync based on whole-file content and/or timestamps
• Configurable compression methods