Skip to main content

MamaDuck

MamaDuck is a command-line tool designed to facilitate the migration and synchronization of data between DuckDB and other databases like PostgreSQL, SQLite, and CSV. It provides an efficient way to load, export, and transfer data.


Demo

Update: The command is kwak instead of --kwak.

Installation

To install MamaDuck, use the following pip command:

pip install mamaduck

This command will install the latest version of the tool and its dependencies.


Interactive Mode

MamaDuck provides an interactive mode to work with migrations directly from the command line. This mode can be triggered by adding the --cli flag to any migration tool command.

For example, to run the load_csv command in interactive mode, use:

mamaduck kwak load_csv --cli

In interactive mode, you can interact with the database and execute migration tasks more interactively.


Usage

MamaDuck follows this general syntax:

mamaduck kwak <tool> [options]

Where <tool> is one of the following migration tools:

  • load_csv: Load data from a CSV file into DuckDB.
  • load_psql: Load data from PostgreSQL into DuckDB.
  • load_sqlite: Load data from an SQLite database into DuckDB.
  • to_csv: Export DuckDB tables to CSV.
  • to_psql: Transfer data from DuckDB to PostgreSQL.
  • to_sqlite: Transfer data from DuckDB to SQLite.

Available Commands and Arguments

Each command (tool) has its own set of arguments. Below are the arguments for each command.

1. load_csv: Load Data from CSV into DuckDB

mamaduck kwak load_csv --csv <CSV_FILE_PATH> --db <DUCKDB_DB_PATH> --table <TABLE_NAME>

Arguments:

  • --db: Path to DuckDB DB file (leave blank for in-memory).
  • --csv: Path to the CSV file to load into DuckDB.
  • --table: DuckDB table name to create.
  • --schema: Schema name (optional).
  • --cli: Launch interactive shell mode.

2. load_psql: Load Data from PostgreSQL into DuckDB

mamaduck kwak load_psql --psql_conn_string <PSQL_CONNECTION_STRING> --db <DUCKDB_DB_PATH> --schema <SCHEMA_NAME>

Arguments:

  • --db: Path to DuckDB DB file (leave blank for in-memory).
  • --psql_conn_string: PostgreSQL connection string.
  • --schema: Schema name to use for migration (optional).
  • --tables: Comma-separated list of table names to migrate (default: all tables).
  • --cli: Launch interactive shell mode.

3. load_sqlite: Load Data from SQLite into DuckDB

mamaduck kwak load_sqlite --sqlite <SQLITE_DB_PATH> --db <DUCKDB_DB_PATH> --tables <TABLE_NAMES>

Arguments:

  • --db: Path to DuckDB DB file (leave blank for in-memory).
  • --sqlite: Path to the SQLite database file.
  • --schema: Schema name to use for migration (optional).
  • --tables: Comma-separated list of table names to migrate (default: all tables).
  • --cli: Launch interactive shell mode.

4. to_csv: Export Data from DuckDB to CSV

mamaduck kwak to_csv --db <DUCKDB_DB_PATH> --table <TABLE_NAME> --output <CSV_FILE_PATH>

Arguments:

  • --db: Path to DuckDB DB file (leave blank for in-memory).
  • --table: Table name to export.
  • --schema: Optional schema for the table.
  • --output: Output CSV file path.
  • --cli: Run in interactive mode.

5. to_psql: Transfer Data from DuckDB to PostgreSQL

mamaduck kwak to_psql --db <DUCKDB_DB_PATH> --psql <PSQL_CONNECTION_STRING> --table <TABLE_NAME>

Arguments:

  • --cli: Launch interactive mode.
  • --db: Path to DuckDB DB file (leave blank for in-memory).
  • --psql: PostgreSQL connection string.
  • --table: Name of the source table in DuckDB.
  • --output: Name of the target table in PostgreSQL.

6. to_sqlite: Transfer Data from DuckDB to SQLite

mamaduck kwak to_sqlite --db <DUCKDB_DB_PATH> --sqlite <SQLITE_DB_PATH> --table <TABLE_NAME> --newtable <NEW_TABLE_NAME>

Arguments:

  • --cli: Start interactive mode.
  • --db: Path to DuckDB DB file (leave blank for in-memory).
  • --sqlite: SQLite database path.
  • --table: Source table in DuckDB.
  • --newtable: New table in SQLite.

License

This project is licensed under the MIT License. See the LICENSE file for more information.

Metadata

Release files for mamaduck 1.0.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for mamaduck 1.0.2
File Size Uploaded Provenance Actions
mamaduck-1.0.2.tar.gz 22.9 kB Without provenance Details for mamaduck-1.0.2.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for mamaduck 1.0.2
File Interpreter ABI Platform Actions
mamaduck-1.0.2-py3-none-any.whl Python 3 none any Details for mamaduck-1.0.2-py3-none-any.whl

Total release size: 39.5 kB

Release files / mamaduck-1.0.2.tar.gz

Download URL mamaduck-1.0.2.tar.gz
Size 22.9 kB
Tags Source
SHA-256 checksum
How to use checksums
03e18fd081cd753145a5f8111a7407176452dea515243e37d663f63831e7a772
BLAKE2b-256 checksum
How to use checksums
d4798d5f8826f7615b405e7e448066e3d0a1732272092bd733cc5f023c19b26a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.8.5 CPython/3.10.12 Linux/5.15.167.4-microsoft-standard-WSL2

Release files / mamaduck-1.0.2-py3-none-any.whl

Download URL mamaduck-1.0.2-py3-none-any.whl
Size 16.6 kB
Tags Python 3
SHA-256 checksum
How to use checksums
7cb5f728f95b543326046b3424179fcb86b011b0a0bf5220744d278ef6491ed6
BLAKE2b-256 checksum
How to use checksums
5da1d1ff5985c2aace1f72c13e58a90f97c1937b73dc51c9f0659f37ba4793fe
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.8.5 CPython/3.10.12 Linux/5.15.167.4-microsoft-standard-WSL2

Security for mamaduck 1.0.2

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page