verisync — Interactive Directory Transfer with Checksum Verification

Table of Contents

• Features
• Requirements
• Installation
  • Via pip (recommended)
  • Via pipx (isolated)
  • Manual install
• Usage
  • Arguments
  • Examples
• Transfer Steps
• Modes: rsync vs zip
• Contributing
• License

Features

• 📁 File and directory — transfer a single file or an entire directory tree
• 📦 Batch mode — transfer multiple sources in one run with flexible destination mapping
• ✅ End-to-end SHA-256 verification — a checksum manifest is generated locally and re-verified remotely after transfer
• ♻️ rsync mode (default) — incremental, resumable, and bandwidth-efficient
• 🗜️ Zip mode (--zip) — packs each source into a .tar.gz, uploads, and auto-extracts on the remote
• 🔌 SSH multiplexing — a single SSH control socket is reused across all remote operations, including 2FA/password auth flows
• 📏 Space checks — remote free disk space is measured before transfer; warns if total exceeds 100 GiB
• 🖥️ Interactive + CLI — all parameters can be supplied as CLI flags or entered interactively at runtime
• 🤖 Auto-confirm (-y) — skip prompts for scripted/non-interactive usage
• 🛡️ Disconnect guard — auto-wraps in screen (or tmux) so SSH drops don't kill the transfer
• 🔍 Cross-node session discovery — verisync ls and verisync -r find and reattach to active sessions across login nodes (one-step SSH + screen -r, with shell fallback if the session is gone)
• 🚫 Duplicate-transfer detection — per (source → destination) pair check across active sessions on the same remote; abort, kill the conflicting session, or ignore. Runs before the screen wrap when full config is on the CLI so abort messages reach the terminal
• 🕒 Elapsed time — reports total transfer and verification duration

Requirements

Note: verisync only needs to be installed on the source machine. The remote side requires only sha256sum and standard POSIX shell tools — no remote installation needed.

Installation

Via pip (recommended)

pip install verisync

This places the verisync command on your PATH.

Via pipx (isolated)

pipx install verisync

Manual install

git clone https://github.com/whats2000/verisync.git
cd verisync
bash verisync.sh --help

Usage

verisync [OPTIONS]            Start a new transfer
verisync ls                   List active verisync sessions across login nodes
verisync -r | --reattach      Pick an active session and reattach
                              (cross-node sessions: SSH + auto screen -r)

Arguments

Any flag not supplied on the command line will be prompted interactively.

Examples

Interactive mode (prompts for all parameters):

verisync

Fully specified via CLI:

verisync --src /data/project --user alice --host hpc.example.com --dest /scratch/alice/

Batch mode (multiple sources to shared destination):

verisync -s /data/file1.txt -s /data/dir2 -d /remote/shared/ -u alice -H hpc.example.com

Batch mode (1:1 source-to-destination mapping):

verisync -s /local/a -s /local/b -d /remote/x -d /remote/y -u alice -H hpc.example.com

Use zip mode for compressed uploads:

verisync -s /data/project -u alice -H hpc.example.com -d /scratch/alice/ --zip

Non-interactive mode (auto-confirm all prompts):

verisync -s /data/project -u alice -H hpc.example.com -d /scratch/alice/ -y

List active sessions across login nodes:

verisync ls

Reattach to an active session (auto-SSH + screen -r for cross-node):

verisync -r

Transfer Steps

Modes: rsync vs zip

Contributing

Bug reports and pull requests are welcome at github.com/whats2000/verisync.

License

MIT — see LICENSE for details.