Skip to main content

transferred

transferred

The most convenient batch data transfer tool.

transferred moves table data between systems. Blazing fast, no transformations supported — hand them over to your Data Warehouse.

Install

pip install transferred

Requires Python 3.14.

Usage

from pathlib import Path

from transferred import FilesDestination, Parquet, PostgresSource, Transfer

source = PostgresSource(
    "postgres://user:pass@localhost:5432/db",
    table="public.orders",
)
destination = FilesDestination(
    Path("orders/"),
    format=Parquet(compression="zstd"),
)

report = Transfer(source, destination).run()

print(report)
# RunReport:
#   rows: 10,000,000
#   written: 64.98 MiB
#   duration: 3s 379ms
#   written objects:
#     orders/part-00001.parquet

That output is a real run: 10M rows of five columns out of a local Postgres, in one process, peaking at 137 MiB resident — interpreter included. docs/DLT_COMPARISON.md measures the same legs against duckdb and dlt on a wider table.

More in examples/.

Supported

Sources:

  • Parquet file — FilesSource
  • Postgres table — PostgresSource
  • DataFrames — polars or pandas DataFrame, a duckdb result, a pa.Table, pyarrow's RecordBatch or RecordBatchReader
  • Python iterables of dict / @dataclass / pydantic.BaseModel (requires pip install transferred[iterable])

Destinations:

  • Parquet file — FilesDestination (zstd / snappy / uncompressed)
  • Postgres table — PostgresDestination (full replace, swapped in one transaction)

BigQuery, S3/GCS and incremental loads land later. See PLAN.md.

Promises

  • ✅ Make data transfers as simple as it could be
  • 🚧 Enforce best practices by default
  • 🚧 Blazing fast
  • ✅ No OOMs!

License

MIT. See LICENSE.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

transferred-0.1.2.tar.gz (155.0 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

transferred-0.1.2-cp315-cp315t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.6 MB view details)

Uploaded CPython 3.15tmanylinux: glibc 2.17+ x86-64

transferred-0.1.2-cp315-cp315t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.8 MB view details)

Uploaded CPython 3.15tmanylinux: glibc 2.17+ ARM64

transferred-0.1.2-cp315-cp315-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.6 MB view details)

Uploaded CPython 3.15manylinux: glibc 2.17+ x86-64

transferred-0.1.2-cp315-cp315-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.8 MB view details)

Uploaded CPython 3.15manylinux: glibc 2.17+ ARM64

transferred-0.1.2-cp314-cp314t-win_amd64.whl (5.0 MB view details)

Uploaded CPython 3.14tWindows x86-64

transferred-0.1.2-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.6 MB view details)

Uploaded CPython 3.14tmanylinux: glibc 2.17+ x86-64

transferred-0.1.2-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.8 MB view details)

Uploaded CPython 3.14tmanylinux: glibc 2.17+ ARM64

transferred-0.1.2-cp314-cp314t-macosx_11_0_arm64.whl (5.0 MB view details)

Uploaded CPython 3.14tmacOS 11.0+ ARM64

transferred-0.1.2-cp314-cp314-win_amd64.whl (5.0 MB view details)

Uploaded CPython 3.14Windows x86-64

transferred-0.1.2-cp314-cp314-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.6 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.17+ x86-64

transferred-0.1.2-cp314-cp314-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.8 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.17+ ARM64

transferred-0.1.2-cp314-cp314-macosx_11_0_arm64.whl (5.0 MB view details)

Uploaded CPython 3.14macOS 11.0+ ARM64

File details

Details for the file transferred-0.1.2.tar.gz.

File metadata

  • Download URL: transferred-0.1.2.tar.gz
  • Upload date:
  • Size: 155.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for transferred-0.1.2.tar.gz
Algorithm Hash digest
SHA256 bd12b27e1290cb879b3f49db2ce983c49ab8f48d77ad5328aa60354a3ab79975
MD5 4a8a758d1284d7e0741e0c5de394afd3
BLAKE2b-256 4caca3aa9d5f370539b528d625f7e918e29f8f36468b01bec8547e3d18d287b8

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.2.tar.gz:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.2-cp315-cp315t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for transferred-0.1.2-cp315-cp315t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 fa3fbf6b9a1d25e87e367c572d1040965d0181839a8115d6fb1d26feb12962d0
MD5 378b9aba14dedc071cb9c44ef828e64c
BLAKE2b-256 b5d110c44e3779938acd9d5a4a749529e67a9a277a6ca6a34568df920626770f

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.2-cp315-cp315t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.2-cp315-cp315t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for transferred-0.1.2-cp315-cp315t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 9fa3d9c1b72536462a89a4fd7fe52cc1e1d48c998c6618524a465a2892d95265
MD5 f80825650352c40247a9fbc2db08fdc2
BLAKE2b-256 22f2dcb40fb292318339bab2707bb6c73af32ad5662ac3737c4a790b0429d3ec

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.2-cp315-cp315t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.2-cp315-cp315-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for transferred-0.1.2-cp315-cp315-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 c4b3c49eaea907cdb5c0a9050d0deba6e07366f8c333e3d1ad96e873a4d9a596
MD5 2cce188c83caab7e40f5c4ba32182261
BLAKE2b-256 7fb43a2abadf43e038e0ae7b8de0a68847fd41a958619af5a585d2cf7833a4a9

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.2-cp315-cp315-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.2-cp315-cp315-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for transferred-0.1.2-cp315-cp315-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 3d022fb77a76190669c62291d72ead0a63e6046f3d2d40b53b74fb876fafb6d1
MD5 d9fbb323c113a60d623179dc78f21244
BLAKE2b-256 bf5380459b1cc4f3f43783f41dfd88beccf111d23a7d6668308d236940b811f6

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.2-cp315-cp315-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.2-cp314-cp314t-win_amd64.whl.

File metadata

File hashes

Hashes for transferred-0.1.2-cp314-cp314t-win_amd64.whl
Algorithm Hash digest
SHA256 fafd50f30e86a90519add8cca5e4e685eb1fb34848c60dace49e217ac98517e3
MD5 e10daf7cf74e19b33c12687ad0f9b9d8
BLAKE2b-256 eeee07aa739e824cd143ea1f57617f641ad8e1d3ff4d3e1de914f5f58c1f5406

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.2-cp314-cp314t-win_amd64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.2-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for transferred-0.1.2-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 a3da641825158aedf44fbf74dffa65c5c506575d4366fad34550ed08c298d554
MD5 f7f8beed1072337bc3837320e332ce95
BLAKE2b-256 674244964e06b95e24c9912382c1db9e3150db683f5973fe03c1d6c3c7470980

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.2-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.2-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for transferred-0.1.2-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 f25dc9d8267dfab8130535e94882917509bfe0098d78c07430d413bb205ddfdb
MD5 7d192afb8e12c77d91b09e8512b70529
BLAKE2b-256 d81219d50a1a279b141007d7e30e683bd7c9a9cea4bbb33451fae62cbfd1604c

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.2-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.2-cp314-cp314t-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for transferred-0.1.2-cp314-cp314t-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 f0be6bb7206bd5efbae3b06f0f3b79f7b459f667218860af5f8e637eceba603b
MD5 d7d489b7a36f057a84ec18fb40915e5f
BLAKE2b-256 0fb875922ec4d9d8b1edbcf4aac823609674db213e38cebef717e201af2b9270

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.2-cp314-cp314t-macosx_11_0_arm64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.2-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for transferred-0.1.2-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 71f6a52cbac6223fbc9c15c7ff02f75b65030a85eb82a1d5c153bbc6309bbf75
MD5 a0f7ff321167c495505c936b3a9390a9
BLAKE2b-256 2b5ff40721603bf892b0fe3ffec0feb7759dc7e70cf7a419d63842ccb713f8f6

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.2-cp314-cp314-win_amd64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.2-cp314-cp314-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for transferred-0.1.2-cp314-cp314-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 ed3a2d2b88979f44e727b600ac205c480916414ed491d11bfb1a55a81a2f25c4
MD5 43a1836bba633cbf41c600d515ea12e0
BLAKE2b-256 e7f986ee830ae37a67c79878b868d0dcda9636b9344a3cf61dd4a78d00952824

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.2-cp314-cp314-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.2-cp314-cp314-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for transferred-0.1.2-cp314-cp314-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 8b68a5bc56be79aaa93f9e19f15a4451fa2eb0cca3b953c44142d3708ca4f7d8
MD5 9bdec5cec0606e24b945503b0eb2e518
BLAKE2b-256 09766e858dea991ab10dbe490b9578aa425dd8588ccadf4a2352f8e67a4fb7f0

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.2-cp314-cp314-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.1.2-cp314-cp314-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for transferred-0.1.2-cp314-cp314-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 38beaf83b61dcb191d49d7b8aa901d434929abf75fd471a0ce1613d0468c4cd7
MD5 b8c6d4fa5d81f0440a08ad1bad3c9a16
BLAKE2b-256 3d279594d9348e0726bfb855b5b4fa3b6a31d094533673eb5faee54b7452be62

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.1.2-cp314-cp314-macosx_11_0_arm64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.1.3

13 files

This release

0.1.2 This release

13 files

0.1.1

13 files

0.1.0

13 files

0.0.3

7 files

0.0.2

7 files

0.0.1

7 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page