Skip to main content

cyborgdb-migrate

PyPI - Version PyPI - License PyPI - Python Version

A TUI wizard and CLI for migrating vector data from popular vector databases into CyborgDB — the encrypted vector database.

Supports Pinecone, Qdrant, Weaviate, ChromaDB, and Milvus as sources, with encrypted-at-rest indexes, checkpoint & resume, and post-migration verification built in.

Key Features

  • Interactive TUI — step-by-step wizard powered for migration
  • Headless CLI — non-interactive mode for scripts and CI/CD pipelines
  • Checkpoint & resume — automatically saves progress; resume interrupted migrations
  • Spot-check verification — post-migration vector and metadata integrity checks
  • Double-buffered I/O — overlaps extraction and upsert for maximum throughput

Getting Started

To get started in minutes, check out the CyborgDB Quickstart Guide.

Installation

pip install cyborgdb-migrate

Install with support for your source database:

# Individual sources
pip install "cyborgdb-migrate[pinecone]"
pip install "cyborgdb-migrate[qdrant]"
pip install "cyborgdb-migrate[weaviate]"
pip install "cyborgdb-migrate[chromadb]"
pip install "cyborgdb-migrate[milvus]"

# All sources at once
pip install "cyborgdb-migrate[all]"

Usage

Interactive (TUI)

cyborgdb-migrate

The wizard walks you through selecting a source, entering credentials, connecting to CyborgDB, and running the migration with live progress.

Headless (CLI)

Create a TOML config file (see example-config.toml):

[source]
type = "pinecone"
api_key = "${PINECONE_API_KEY}"
index = "my-index"

[destination]
host = "http://localhost:8000"
api_key = "${CYBORGDB_API_KEY}"
create_index = true
index_name = "my-cyborgdb-index"
# kms_name = "aws-kms"            # optional: use a KMS-wrapped key

[options]
batch_size = 200
checkpoint_every = 10
cyborgdb-migrate --config migration.toml

Resume an interrupted migration:

cyborgdb-migrate --config migration.toml --resume

Supported Sources

Source Extras Notes
Pinecone pinecone Supports namespaces
Qdrant qdrant Scroll-based pagination
Weaviate weaviate Supports named vectors
ChromaDB chromadb Local and remote modes
Milvus milvus Supports partitions, content field heuristic

Configuration Reference

For full configuration details, CLI options, and exit codes, see the Configuration Guide.

Documentation

For more information on CyborgDB, see the Cyborg Docs.

License

The CyborgDB Migration Tool is licensed under the MIT License.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cyborgdb_migrate-0.17.0.tar.gz (44.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

cyborgdb_migrate-0.17.0-py3-none-any.whl (47.3 kB view details)

Uploaded Python 3

File details

Details for the file cyborgdb_migrate-0.17.0.tar.gz.

File metadata

  • Download URL: cyborgdb_migrate-0.17.0.tar.gz
  • Upload date:
  • Size: 44.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for cyborgdb_migrate-0.17.0.tar.gz
Algorithm Hash digest
SHA256 4791b05d66f08f43a1e871a0518edf77dee407e4c2c077d1fa60b14b49874a44
MD5 319c4dabfec159317f0666581ca01d4f
BLAKE2b-256 551b61fb17df3f2087672e0b418c35be7265a1720a0c640308af2ecff29f3ce1

See more details on using hashes here.

Provenance

The following attestation bundles were made for cyborgdb_migrate-0.17.0.tar.gz:

Publisher: ci.yml on cyborginc/cyborgdb-migrate

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file cyborgdb_migrate-0.17.0-py3-none-any.whl.

File metadata

File hashes

Hashes for cyborgdb_migrate-0.17.0-py3-none-any.whl
Algorithm Hash digest
SHA256 60167fa87fed0bd857f4aa42415a51179dfb71f8905313873b41aa194b4a5e9e
MD5 54f24c29290d294d9789ab16bdda3890
BLAKE2b-256 827d51ff12cfec7120a5676a0c1709ce0cc3fa4a195d49288e88b9d2ceda552f

See more details on using hashes here.

Provenance

The following attestation bundles were made for cyborgdb_migrate-0.17.0-py3-none-any.whl:

Publisher: ci.yml on cyborginc/cyborgdb-migrate

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.17.0 This release

2 files

0.1.1

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page