Skip to main content

Manage and sync multiple git, mercurial, and svn repos

Project description

$ vcspull · Python Package License Code Coverage

Manage and sync multiple git, svn, and mercurial repos via JSON or YAML file. Compare to myrepos, mu-repo. Built on libvcs.

Great if you use the same repos at the same locations across multiple machines or want to clone / update a pattern of repos without having to cd into each one.

  • clone / update to the latest repos with $ vcspull
  • use filters to specify a location, repo url or pattern in the manifest to clone / update
  • supports svn, git, hg version control systems
  • automatically checkout fresh repositories
  • supports pip-style URL's (RFC3986-based url scheme)

See the documentation, configuration examples, and config generators.

How to

Install

$ pip install --user vcspull

Or using uv:

$ uv tool install vcspull

For one-time use without installation:

$ uvx vcspull

Developmental releases

You can test the unpublished version of vcspull before its released.

  • pip:

    $ pip install --user --upgrade --pre vcspull
    
  • pipx:

    $ pipx install --suffix=@next 'vcspull' --pip-args '\--pre' --force
    

    Then use vcspull@next sync [config]....

  • uv:

    $ uv tool install --prerelease=allow vcspull
    

Configuration

Add your repos to ~/.vcspull.yaml. You can edit the file by hand or let vcspull add, vcspull discover, or vcspull import create entries for you.

~/code/:
  flask: "git+https://github.com/mitsuhiko/flask.git"
~/study/c:
  awesome: "git+git://git.naquadah.org/awesome.git"
~/study/data-structures-algorithms/c:
  libds: "git+https://github.com/zhemao/libds.git"
  algoxy:
    repo: "git+https://github.com/liuxinyu95/AlgoXY.git"
    remotes:
      tony: "git+ssh://git@github.com/tony/AlgoXY.git"

(see the author's .vcspull.yaml, more configuration)

$HOME/.vcspull.yaml and $XDG_CONFIG_HOME/vcspull/ (~/.config/vcspull) can be used as a declarative manifest to clone your repos consistently across machines. Subsequent syncs of initialized repos will fetch the latest commits.

Add repositories from the CLI

Register a single repository by pointing at the checkout:

$ vcspull add ~/projects/libs/my-lib
  • vcspull infers the name from the directory and detects the origin remote. Pass --url when you need to record a different remote.
  • Override the derived name with --name and the workspace root with -w/--workspace.
  • --dry-run previews the update, while --yes skips the confirmation prompt.
  • -f/--file selects an alternate configuration file.
  • Append --no-merge if you prefer to review duplicate workspace roots yourself instead of having vcspull merge them automatically.
  • Follow with vcspull sync my-lib to clone or update the working tree after registration.

Discover local checkouts and add en masse

Have a directory tree full of cloned Git repositories? Scan and append them to your configuration:

$ vcspull discover ~/code --recursive

The scan shows each repository before import unless you opt into --yes. Add --workspace ~/code/ to pin the resulting workspace root or -f/--file to write somewhere other than the default ~/.vcspull.yaml. Duplicate workspace roots are merged by default; include --no-merge to keep them separate while you review the log.

Import from remote services

Pull repository lists from GitHub, GitLab, Codeberg, Gitea, Forgejo, or AWS CodeCommit directly into your configuration:

$ vcspull import github myuser \
    --workspace ~/code/ \
    --mode user
$ vcspull import gitlab my-group \
    --workspace ~/work/ \
    --mode org

Use --dry-run to preview changes, --https for HTTPS clone URLs, and --language/--topics/--min-stars to filter results. See the import documentation for all supported services and options.

Inspect configured repositories

List what vcspull already knows about without mutating anything:

$ vcspull list
$ vcspull list --tree
$ vcspull list --json | jq '.[].name'

--json emits a single JSON array, while --ndjson streams newline-delimited objects that are easy to consume from shell pipelines.

Search across repositories with an rg-like query syntax:

$ vcspull search django
$ vcspull search name:django url:github
$ vcspull search --fixed-strings 'git+https://github.com/org/repo.git'

Check repository status

Get a quick health check for all configured workspaces:

$ vcspull status
$ vcspull status --detailed
$ vcspull status --ndjson | jq --slurp 'map(select(.reason == "summary"))'

The status command respects --workspace/-w filters and the global --color {auto,always,never} flag. JSON and NDJSON output mirrors the list command for automation workflows.

Normalize configuration files

After importing or editing by hand, run the formatter to tidy up keys, merge duplicate workspace sections, and keep entries sorted:

$ vcspull fmt \
    --file ~/.vcspull.yaml \
    --write

Use vcspull fmt --all --write to format every YAML file that vcspull can discover under the standard config locations. Add --no-merge if you only want duplicate roots reported, not rewritten.

Sync your repos

$ vcspull sync --all

Preview planned work with Terraform-style plan output or emit structured data for CI/CD:

$ vcspull sync --dry-run "*"
$ vcspull sync --dry-run --show-unchanged "workspace-*"
$ vcspull sync --dry-run --json "*" | jq '.summary'
$ vcspull sync --dry-run --ndjson "*" \
    | jq --slurp 'map(select(.type == "summary"))'

Dry runs stream a progress line when stdout is a TTY, then print a concise plan summary (+/~/✓/⚠/✗) grouped by workspace. Use --summary-only, --relative-paths, --long, or -v/-vv for alternate views, and --fetch/--offline to control how remote metadata is refreshed.

Keep nested VCS repositories updated too, lets say you have a mercurial or svn project with a git dependency:

external_deps.yaml in your project root (any filename will do):

./vendor/:
  sdl2pp: "git+https://github.com/libSDL2pp/libSDL2pp.git"

Clone / update repos via config file:

$ vcspull sync --file external_deps.yaml '*'

See the Quickstart for more.

Pulling specific repos

Have a lot of repos?

you can choose to update only select repos through fnmatch patterns. remember to add the repos to your ~/.vcspull.{json,yaml} first.

The patterns can be filtered by by directory, repo name or vcs url.

Any repo starting with "fla":

$ vcspull sync "fla*"

Any repo with django in the name:

$ vcspull sync "*django*"

Search by vcs + url, since urls are in this format +://:

$ vcspull sync "git+*"

Any git repo with python in the vcspull:

$ vcspull sync "git+*python*

Any git repo with django in the vcs url:

$ vcspull sync "git+*django*"

All repositories in your ~/code directory:

$ vcspull sync "$HOME/code/*"
image

Donations

Your donations fund development of new features, testing and support. Your money will go directly to maintenance and development of the project. If you are an individual, feel free to give whatever feels right for the value you get out of the project.

See donation options at https://tony.sh/support.html.

More information

Docs Build Status

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vcspull-1.59.0.tar.gz (2.5 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vcspull-1.59.0-py3-none-any.whl (141.5 kB view details)

Uploaded Python 3

File details

Details for the file vcspull-1.59.0.tar.gz.

File metadata

  • Download URL: vcspull-1.59.0.tar.gz
  • Upload date:
  • Size: 2.5 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for vcspull-1.59.0.tar.gz
Algorithm Hash digest
SHA256 63e6da45c5ab6697bd0d3ed706ad414c55125ecdee65ac81a6b82554867662dc
MD5 f25cea61106738aa8fa5cd5f384a6837
BLAKE2b-256 071ebd0bcb6a1631c13a4425cba88f60c6c45b7a97007a333c9a9e6e4bd97642

See more details on using hashes here.

Provenance

The following attestation bundles were made for vcspull-1.59.0.tar.gz:

Publisher: tests.yml on vcs-python/vcspull

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file vcspull-1.59.0-py3-none-any.whl.

File metadata

  • Download URL: vcspull-1.59.0-py3-none-any.whl
  • Upload date:
  • Size: 141.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for vcspull-1.59.0-py3-none-any.whl
Algorithm Hash digest
SHA256 865286f35b3c0aa6a1ead383472f67426b334492adebb8d3ad6316d4a3438f64
MD5 6e4f5062cc311f7e015ad192f5056fa0
BLAKE2b-256 5413f4471c17c044fa653e5f9b370a207b70bd2fc2dd63ae424ce8ce4afd451d

See more details on using hashes here.

Provenance

The following attestation bundles were made for vcspull-1.59.0-py3-none-any.whl:

Publisher: tests.yml on vcs-python/vcspull

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page