Skip to main content

Directory synchronization tool yd

Build and execute rsync commands from TOML configuration files.

(Un)Install

To install, run

uv tool install yd-cli

Then run

yd --install-completion

to install auto-completion in your shell.

In bash, the completion code is stored in ~/.bash_completions/yd.sh and that file is sourced from ~/.bashrc. Remove both and call uv tool uninstall yd-cli to remove this tool. The below mentioned configuration files need to be removed separately.

Create a config

Create a new configuration called photos (using a positive number of . as name is not allowed) with:

yd edit --new photos

This command

  • creates ~/.config/yd/photos.toml (or under $XDG_CONFIG_HOME/yd if set; relative paths are resolved from your home directory), and
  • opens it with the executable selected via EDITOR, or nvim when EDITOR is unset. The selected editor must be available on PATH.

Reopen an existing configuration with:

yd edit photos

Configuration format

Example

# Phone backup
src_home = "/home/alice"
target_home = "/mnt/backup"
backup = "deleted/%Y-%m-%d"
exclude = [".venv/", "__pycache__/"]

[[commands]]
src = "Documents"
exclude = ["*.log"]

[[commands]]
src = "Pictures"
target = "pics-%Y-%m-%d"
delete_extra = "never"

Leading comment lines directly at the top of the file are treated as the configuration description and are shown by yd ls.

Top-level options

Key Meaning
src_home Base directory for all src paths. Relative paths are resolved from your home directory.
target_home Base directory for all target paths. Relative paths are resolved from your home directory.
mtp_target Use in-place syncing for MTP targets.
backup Backup directory for replaced or deleted files. Relative paths are resolved from target_home. strftime placeholders are supported.
exclude Exclude patterns applied to every command.

mtp_target matters because rsync normally copies to a temporary file and renames it afterward, but that is not possible when syncing via MTP.

Command options

Key Meaning
src Relative source directory below src_home.
target Relative target directory below target_home; defaults to src. strftime placeholders %Y, %m, and %d are supported. Each may appear at most once; no other use of % is allowed. A newly created dated target is removed if it contains only directories after synchronization.
delete_extra "when_safe" deletes files in the target that do not exist in the source when no target overlaps; "never" retains them. Defaults to "when_safe".
exclude Extra exclude patterns for this command only.

Notes

  • src and target must stay within src_home and target_home after path resolution.
  • Literal targets are retained when they contain only empty directories. Dated targets serve as snapshots: if a dated target did not exist before synchronization and contains neither files nor symlinks afterward, yd removes its empty directory tree.
  • src_home or target_home may be omitted from the configuration, but every missing value must then be supplied when running (via CLI parameters).
  • Exactly one of --src-home - and --target-home - may read from standard input in a single run.
  • If backup is omitted, yd creates a timestamped backup directory automatically unless --no-backup is specified.
  • If a configured source directory exists but is empty, yd reports that no synchronization was performed for that command. E.g., forgetting to mount an external drive does not delete all corresponding copies on hard-drive.
  • If a valid date placeholder is included in the target, then the target_home is scanned for matching directories (possibly) created by this rule before today. The 20 most recent matches are included as additional comparison destinations in the synchronization: if a file in src is included in one of those reference directories, then it will not be copied to target.

Run a config

Run a saved configuration by name:

yd run photos

Options

Option Meaning
--dry-run Show what would happen without changing files.
--no-backup Disable backup handling for this run.
--keep-newer Skip updates when the target file is newer.
--rename-speedup Enable rsync options tuned for rename-heavy targets. This may require more disk space on the target.
--src-home PATH Override src_home from the config. Use - to read the value from standard input.
--target-home PATH Override target_home from the config. Use - to read the value from standard input.

Synchronization semantics

  • Synchronization does not cross mounted filesystems, and mount-point directories are omitted from the target.
  • Symlinks are copied as symlinks; symlinks pointing outside the individual source directories are ignored.
  • Permissions, modification times, access times, and hard links are preserved.
  • File owner or group are not preserved.

Environment variables

Name Description
XDG_CONFIG_HOME Base directory for configurations. yd stores them in yd below this path. Defaults to .config below the home directory; relative values are resolved from the home directory.
EDITOR Editor used by yd edit. Defaults to nvim. The selected executable must be available on PATH.
YD_NPROC Maximum number of synchronizations that may run concurrently. Must be a positive integer. Defaults to one less than the available CPU count, with a minimum of one.
YD_RSYNC Executable name or path used for rsync. Defaults to rsync; it must be discoverable on PATH when a name is supplied.
YD_ECHO Executable name or path used to print messages. Defaults to echo; if it cannot be found, yd uses its built-in alternative.
YD_LOGLEVEL Numeric Python logging level, such as 10 for debug, 20 for info, or 40 for errors. When set, yd appends JSON Lines records to .yd.jsonl in the current working directory. Records contain time, level, logger, and message fields, plus exception type, message, and traceback when applicable.

Logging is effectively disabled by default. Enable it when diagnosing a failed or interrupted run.

List configs

List available configurations with:

yd ls

This shows the configuration name together with the optional leading-comment description.

Why yd?

  • Has one character from synchronize and one from directory.
  • Easy to type with both QWERTZ and QWERTY keyboards.
  • Name was still available on PyPI.

Metadata

Release files for yd-cli 0.14

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for yd-cli 0.14
File Size Uploaded
yd_cli-0.14.tar.gz 27.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for yd-cli 0.14
File Interpreter ABI Platform
yd_cli-0.14-py3-none-any.whl Python 3 none any Details

Total release size: 58.3 kB

Release files / yd_cli-0.14.tar.gz

Download URL yd_cli-0.14.tar.gz
Size 27.4 kB
Tags Source
SHA-256 checksum
How to use checksums
06f9cefe8d2ba3b88202f8ad6c2fff7689c855013f4e0911c198ef47a98f8a0d
BLAKE2b-256 checksum
How to use checksums
d7aae199534c6092abbfbd782759cd1898da21e8ccce5365e92ead2881e0b0f4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Release files / yd_cli-0.14-py3-none-any.whl

Download URL yd_cli-0.14-py3-none-any.whl
Size 30.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
2c10c891e3a92e03b9aab87f622d7e3d3eaf0dad0b83d4e7be2539da8ce7364a
BLAKE2b-256 checksum
How to use checksums
0f19f433372d28fba77de26f8f7d2d4c220f47613632fc23dd472d04ada41e6c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Release history Release notifications | RSS feed

0.19

2 release files

0.18

2 release files

0.16

2 release files

This release

0.14 This release

2 release files

0.13

2 release files

0.12

2 release files

0.11

2 release files

0.10

2 release files

0.9

2 release files

0.8

2 release files

0.7

2 release files

0.6

2 release files

0.5

2 release files

0.4

2 release files

0.3

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page