Skip to main content

Directory synchronization tool yd

Build and execute rsync commands from TOML configuration files.

(Un)Install

To install, run

uv tool install yd-cli

Then run

yd --install-completion

to install auto-completion in your shell.

In bash, the completion code is stored in ~/.bash_completions/yd.sh and that file is sourced from ~/.bashrc. Remove both and call uv tool uninstall yd-cli to remove this tool. The below mentioned configuration files need to be removed separately.

Create a config

Create a new configuration called photos (using a positive number of . as name is not allowed) with:

yd edit --new photos

This command

  • creates ~/.config/yd/photos.toml (or under $XDG_CONFIG_HOME/yd if set to a nonempty value; relative paths are resolved from your home directory), and
  • opens it with the executable selected via EDITOR, or nvim when EDITOR is unset. The selected editor must be available on PATH.

Reopen an existing configuration with:

yd edit photos

Configuration format

Example

# Phone backup
src_home = "/home/alice"
target_home = "/mnt/backup"
backup = "deleted/%Y-%m-%d"
exclude = [".venv/", "__pycache__/"]

[[commands]]
src = "Documents"
exclude = ["*.log"]

[[commands]]
src = "Pictures"
target = "pics-%Y-%m-%d"
delete_extra = "never"

Leading comment lines directly at the top of the file are treated as the configuration description and are shown by yd ls.

Top-level options

Key Meaning
src_home Base directory for all src paths. Relative paths are resolved from your home directory.
target_home Base directory for all target paths. Relative paths are resolved from your home directory.
mtp_target Use in-place syncing for MTP targets.
backup Backup directory for replaced or deleted files. Relative paths are resolved from target_home. strftime placeholders are supported.
exclude Exclude patterns applied to every command.

mtp_target matters because rsync normally copies to a temporary file and renames it afterward, but that is not possible when syncing via MTP.

Command options

Key Meaning
src Relative source directory below src_home.
target Relative target directory below target_home; defaults to src. strftime placeholders %Y, %m, and %d are supported. Each may appear at most once; no other use of % is allowed. A newly created dated target is removed if it contains only directories after synchronization.
delete_extra "when_safe" deletes files in the target that do not exist in the source when no target overlaps; "never" retains them. Defaults to "when_safe".
exclude Extra exclude patterns for this command only.

Notes

  • src and target must stay within src_home and target_home after path resolution. A single . selects the corresponding home directory; otherwise, . and .. path components are not allowed.
  • Literal targets are retained when they contain only empty directories. Dated targets serve as snapshots: if a dated target did not exist before synchronization and contains neither files nor symlinks afterward, yd removes its empty directory tree.
  • src_home or target_home may be omitted from the configuration, but every missing value must then be supplied when running (via CLI parameters).
  • Exactly one of --src-home - and --target-home - may read from standard input in a single run.
  • If backup is omitted, yd creates a timestamped backup directory automatically unless --no-backup is specified.
  • If a configured source directory exists but is empty, yd reports that no synchronization was performed for that command. E.g., forgetting to mount an external drive does not delete all corresponding copies on hard-drive.
  • If a valid date placeholder is included in the target, then the target_home is scanned for matching directories (possibly) created by this rule before today. The 20 most recent matches are included as additional comparison destinations in the synchronization: if a file in src is included in one of those reference directories, then it will not be copied to target.

Run a config

Run a saved configuration by name:

yd run photos

Options

Option Meaning
--dry-run Show what would happen without changing files.
--no-backup Disable backup handling for this run.
--keep-newer Skip updates when the target file is newer.
--rename-speedup Enable rsync options tuned for rename-heavy targets. This may require more disk space on the target.
--src-home PATH Override src_home from the config. Use - to read the value from standard input.
--target-home PATH Override target_home from the config. Use - to read the value from standard input.

Synchronization semantics

  • Synchronization does not cross mounted filesystems, and mount-point directories are omitted from the target.
  • Symlinks are copied as symlinks; symlinks pointing outside the individual source directories are ignored.
  • Permissions, modification times, access times, and hard links are preserved.
  • File owner or group are not preserved.

Environment variables

Name Description
HOME Home directory used to resolve relative paths. It must name an existing absolute directory and must not be empty.
XDG_CONFIG_HOME Base directory for configurations. yd stores them in yd below this path. An unset or empty value defaults to .config below the home directory; relative values are resolved from the home directory.
XDG_STATE_HOME Base directory for state files. yd stores logs in yd/yd.jsonl below this path. An unset or empty value defaults to .local/state below the home directory; relative values are resolved from the home directory.
EDITOR Editor used by yd edit. Defaults to nvim. The selected executable must be available on PATH.
YD_NPROC Maximum number of synchronizations that may run concurrently. Must be a positive integer. Defaults to one less than the available CPU count, with a minimum of one.
YD_RSYNC Executable name or path used for rsync. Defaults to rsync; it must be discoverable on PATH when a name is supplied.
YD_ECHO Executable name or path used to print messages. Defaults to echo; if it cannot be found, yd uses its built-in alternative.
YD_LOGLEVEL Nonnegative numeric Python logging level, such as 10 for debug, 20 for info, or 40 for errors. When set, yd appends JSON Lines records to $XDG_STATE_HOME/yd/yd.jsonl. Records contain time, level, logger, and message fields, plus exception type, message, and traceback when applicable. Invalid values cause startup to fail.

Logging is effectively disabled by default. Enable it by setting YD_LOGLEVEL when diagnosing a failed or interrupted run. When logging is enabled, yd run rejects any source, target, backup, or comparison tree that intersects with $XDG_STATE_HOME/yd. Until all synchronization paths have been validated, records are buffered in memory; if validation fails, those records are written as JSON Lines to standard error instead of the file.

List configs

List available configurations with:

yd ls

This shows the configuration name together with the optional leading-comment description.

Why yd?

  • Has one character from synchronize and one from directory.
  • Easy to type with both QWERTZ and QWERTY keyboards.
  • Name was still available on PyPI.

Metadata

Release files for yd-cli 0.16

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for yd-cli 0.16
File Size Uploaded
yd_cli-0.16.tar.gz 30.9 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for yd-cli 0.16
File Interpreter ABI Platform
yd_cli-0.16-py3-none-any.whl Python 3 none any Details

Total release size: 64.8 kB

Release files / yd_cli-0.16.tar.gz

Download URL yd_cli-0.16.tar.gz
Size 30.9 kB
Tags Source
SHA-256 checksum
How to use checksums
b8db8cd29ee46aff151614a66b9c8b8921f9ab3bbd8f812235dbf3d13acc6ff7
BLAKE2b-256 checksum
How to use checksums
8f7537f32387a85638b44572de358988cf7b2033a305d868a5f396226fcf9ef4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.2 {"installer":{"name":"uv","version":"0.12.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Release files / yd_cli-0.16-py3-none-any.whl

Download URL yd_cli-0.16-py3-none-any.whl
Size 33.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
15dc1e9318a60f10f6d85df8b80df664dd2355255f3194dea61d2580f13fbc6b
BLAKE2b-256 checksum
How to use checksums
134813f973bcb018dd0900035552bf41a3b69216b620eeb52da3bb4b684b9384
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.2 {"installer":{"name":"uv","version":"0.12.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Release history Release notifications | RSS feed

0.19

2 release files

0.18

2 release files

This release

0.16 This release

2 release files

0.14

2 release files

0.13

2 release files

0.12

2 release files

0.11

2 release files

0.10

2 release files

0.9

2 release files

0.8

2 release files

0.7

2 release files

0.6

2 release files

0.5

2 release files

0.4

2 release files

0.3

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page