Skip to main content

transferred

transferred

The most convenient batch data transfer tool. Inspired by dlt.

transferred moves table data between systems. Blazing fast, no transformations supported — hand them over to your Data Warehouse.

Install

pip install transferred

Requires Python 3.14.

Usage

from pathlib import Path

from transferred import FilesDestination, Parquet, PostgresSource, Transfer

source = PostgresSource(
    "postgres://user:pass@localhost:5432/db",
    table="public.orders",
)
destination = FilesDestination(
    Path("orders/"),
    format=Parquet(compression="zstd"),
)

report = Transfer(source, destination).run()

print(report)
# RunReport:
#   rows: 10,000,000
#   written: 243.04 MiB
#   duration: 13s 627ms
#   written objects:
#     orders/part-00001.parquet

10M rows of 22 diverse columns including jsonb and PostGIS geometry — peaking at 275 MiB RAM interpreter included.

Look at docs/DLT_COMPARISON.md for more performance insights.

More in examples/.

Supported

Sources:

  • Parquet file — FilesSource
  • Postgres table — PostgresSource
  • DataFrames — polars or pandas DataFrame, a duckdb result, a pa.Table, pyarrow's RecordBatch or RecordBatchReader
  • Python iterables of dict / @dataclass / pydantic.BaseModel (requires pip install transferred[iterable])

Destinations:

  • Parquet file — FilesDestination (zstd / snappy / uncompressed)
  • Postgres table — PostgresDestination (full replace, swapped in one transaction)

BigQuery, S3/GCS and incremental loads land later. See PLAN.md.

Promises

  • ✅ Make data transfers as simple as it could be
  • 🚧 Enforce best practices by default
  • 🚧 Blazing fast
  • ✅ No OOMs!

License

MIT. See LICENSE.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

transferred-0.1.3.tar.gz (155.1 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

transferred-0.1.3-cp315-cp315t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.7 MB view details)

Uploaded CPython 3.15tmanylinux: glibc 2.17+ x86-64

transferred-0.1.3-cp315-cp315t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.8 MB view details)

Uploaded CPython 3.15tmanylinux: glibc 2.17+ ARM64

transferred-0.1.3-cp315-cp315-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.7 MB view details)

Uploaded CPython 3.15manylinux: glibc 2.17+ x86-64

transferred-0.1.3-cp315-cp315-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.8 MB view details)

Uploaded CPython 3.15manylinux: glibc 2.17+ ARM64

transferred-0.1.3-cp314-cp314t-win_amd64.whl (5.0 MB view details)

Uploaded CPython 3.14tWindows x86-64

transferred-0.1.3-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.7 MB view details)

Uploaded CPython 3.14tmanylinux: glibc 2.17+ x86-64

transferred-0.1.3-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.8 MB view details)

Uploaded CPython 3.14tmanylinux: glibc 2.17+ ARM64

transferred-0.1.3-cp314-cp314t-macosx_11_0_arm64.whl (5.0 MB view details)

Uploaded CPython 3.14tmacOS 11.0+ ARM64

transferred-0.1.3-cp314-cp314-win_amd64.whl (5.0 MB view details)

Uploaded CPython 3.14Windows x86-64

transferred-0.1.3-cp314-cp314-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.7 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.17+ x86-64

transferred-0.1.3-cp314-cp314-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.8 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.17+ ARM64

transferred-0.1.3-cp314-cp314-macosx_11_0_arm64.whl (5.0 MB view details)

Uploaded CPython 3.14macOS 11.0+ ARM64

File details

Details for the file transferred-0.1.3.tar.gz.

File metadata

  • Download URL: transferred-0.1.3.tar.gz
  • Upload date:
  • Size: 155.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for transferred-0.1.3.tar.gz
Algorithm Hash digest
SHA256 abfb6260cdb4bcf2389ffb26afd3073cc2c3badcfb1c7688ab60a0f0bf891b1c
MD5 e17910bbfcdc8849df967f5fcd25b349
BLAKE2b-256 77cdc80fd5827a7665f282e60c768a416a18737355bd695983fc737f60ba03e4

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.3.tar.gz:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.3-cp315-cp315t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for transferred-0.1.3-cp315-cp315t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 f0d9758948c982c722f8833aeda713eb38603848f460915cd62b25aed77ae7e6
MD5 8420092edc2d55c9adbb8e14f1506bb0
BLAKE2b-256 1fea7a4b0dca177a2c36d97b6543261baa0ac96e403fa2c8863262a8536e611b

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.3-cp315-cp315t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.3-cp315-cp315t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for transferred-0.1.3-cp315-cp315t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 2940bcbdf7ca22996a68fd4c64d6d60d28d301e94e3ea53b4c80a2fc4210f540
MD5 2285f72e1f30209b7588dd0c91c85071
BLAKE2b-256 7a74bff0925f14dacdfb8cf6ef157457d8201c3716d0f680c199b2264dc9cd7b

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.3-cp315-cp315t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.3-cp315-cp315-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for transferred-0.1.3-cp315-cp315-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 deb9f48322f269da9ee2dd7ec278c80e241eabbfb1b85729647f546b2329d145
MD5 0ef278ef17efa250d7688e7a15f35f4f
BLAKE2b-256 83d05b8435c93ad739521c1bdfebd43417570eb6d27b3fa7a76083eb7671c767

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.3-cp315-cp315-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.3-cp315-cp315-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for transferred-0.1.3-cp315-cp315-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 a8cf1cc6ee75e0f8957c3645b8ada15cf709b63e963a975555dd502b901e4463
MD5 eb6bf3d09c02f5159ef8abb390462d7f
BLAKE2b-256 6cd74adbc85e305d6746c99a7b52fce5d99e36c02c68c669c4dad8f211d30570

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.3-cp315-cp315-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.3-cp314-cp314t-win_amd64.whl.

File metadata

File hashes

Hashes for transferred-0.1.3-cp314-cp314t-win_amd64.whl
Algorithm Hash digest
SHA256 d242feb5c1a0850f55102ead6d574636ef5bd65fee7758a6783d3f6eed7806d8
MD5 6132113ca47fc2c411ca971a9a3d661b
BLAKE2b-256 2f0940d0de23258c852ca5a04f8c8a96c8f542ade84d8ccaca6d543b3152d54c

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.3-cp314-cp314t-win_amd64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.3-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for transferred-0.1.3-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 07dfa2c59a5e9574a75f06bb755b6c95a9c3fbaa5209098a1fa964986e311937
MD5 30f7f304d126adb243ae581f0e575a6e
BLAKE2b-256 8956403b52ae2cdbb7f463e2120fa2d16ae3c505375e4ca16980f114872f9bbe

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.3-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.3-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for transferred-0.1.3-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 69c3e0fb928532fcaff7d2e66d064820e2142944be1509f32fa2d512bdcd8e05
MD5 f4cbfd660ea3fa6f08d4dc7dc65f8152
BLAKE2b-256 497d368601accfc497e71e94b6a365b2a940cf6dd9139319f609bed916c29c7f

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.3-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.3-cp314-cp314t-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for transferred-0.1.3-cp314-cp314t-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 df7fa4622852202222b6adbde9d75694afbbbcd39b613704d8a09dfb5a3c274b
MD5 06550cb4a91044edaacfa3e57ece7846
BLAKE2b-256 0e24a43c930a1cbeb4980c7326b593524e97996da4ab4f1708cc8040f993f738

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.3-cp314-cp314t-macosx_11_0_arm64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.3-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for transferred-0.1.3-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 42a9ee5a03e25d186a2afb422a844a68592a9c20d3abbba5809d7f5e7d6f018f
MD5 b6634ac0e6ba2657f2481246abc6a6bd
BLAKE2b-256 2f95fc337aee99ea5edbe83a1f370e46c3f75b714483beb0f2ca99c32260ed7d

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.3-cp314-cp314-win_amd64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.3-cp314-cp314-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for transferred-0.1.3-cp314-cp314-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 659a1df3db90b75c7c7ab522505a7355522ae5b26a66978dd3c5989414598842
MD5 5b54692ede0976d7ac3153c65b46a019
BLAKE2b-256 b31e56136f0d7721cdf8830372ed39149733041e641ee83a68a90d17875b69d5

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.3-cp314-cp314-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.3-cp314-cp314-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for transferred-0.1.3-cp314-cp314-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 ef45a6bcb4591adac9945b4fb71230274317ef52698f3d70781aeeb74a904b32
MD5 98b4cc8806f062dfc10ee64b8a7a75ce
BLAKE2b-256 960d6c390c6f43f5e159368c2d06c72b867664dabe559e6826ef480f4f95ab50

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.3-cp314-cp314-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.3-cp314-cp314-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for transferred-0.1.3-cp314-cp314-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 bab774e58eb94b5eb1b803e7e82eab697285d6630147dfe95bf52b1a3918c574
MD5 3cf88add7a335270e6223de6d661842a
BLAKE2b-256 ed984454adf9040f8e15b4da16df3331d7fa3df8f318ab2e9b91723b2680a5d6

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.3-cp314-cp314-macosx_11_0_arm64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.1.3 This release

13 files

0.1.2

13 files

0.1.1

13 files

0.1.0

13 files

0.0.3

7 files

0.0.2

7 files

0.0.1

7 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page