Skip to main content

The most convenient data transfer tool.

Project description

transferred

transferred

The most convenient data transfer tool.

transferred moves table-shaped data between systems. Blazing fast, no transformations supported — hand them over to someone else.

Install

pip install transferred

Requires Python 3.14.

Usage

from transferred import FilesDestination, FilesSource, Parquet, Transfer

report = Transfer(
    source=FilesSource("in.parquet"),
    destination=FilesDestination("output_directory", format=Parquet(compression="zstd")),
).run()

print(report)
# RunReport:
#   rows: 12,481,902
#   written: 1.40 GiB
#   duration: 4s 218ms
#   written objects:
#     output_directory/part-00001.parquet
#     output_directory/part-00002.parquet

Supported

Sources:

  • Parquet file — FilesSource
  • Arrow RecordBatchReaderArrowSource (requires pip install transferred[arrow])
  • Python iterables of dict / @dataclass / pydantic.BaseModel (requires pip install transferred[iterable])

Destinations:

  • Parquet file — FilesDestination (zstd / snappy / uncompressed)

Postgres + BigQuery land later. See PLAN.md.

Promises

  • ✅ Make data transfers as simple as it could be
  • 🚧 Enforce best practices by default
  • 🚧 Blazing fast
  • ✅ No OOMs!

License

MIT. See LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

transferred-0.0.3.tar.gz (55.2 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

transferred-0.0.3-cp315-cp315-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB view details)

Uploaded CPython 3.15manylinux: glibc 2.17+ x86-64

transferred-0.0.3-cp314-cp314t-win_amd64.whl (3.2 MB view details)

Uploaded CPython 3.14tWindows x86-64

transferred-0.0.3-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.14tmanylinux: glibc 2.17+ ARM64

transferred-0.0.3-cp314-cp314t-macosx_11_0_arm64.whl (3.4 MB view details)

Uploaded CPython 3.14tmacOS 11.0+ ARM64

transferred-0.0.3-cp314-cp314-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.17+ x86-64

transferred-0.0.3-cp314-cp314-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.8 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.17+ ARM64

File details

Details for the file transferred-0.0.3.tar.gz.

File metadata

  • Download URL: transferred-0.0.3.tar.gz
  • Upload date:
  • Size: 55.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for transferred-0.0.3.tar.gz
Algorithm Hash digest
SHA256 70d4475ae5ff097f08291c6bdb00fe15695ffddab93cf7a0c234b47449f51f0a
MD5 4e7b53e273ed9032a59b8a33e49dff33
BLAKE2b-256 dbc6f514e96d6eb41747b3867f09c7547eff02868b7e2e553983af9f3f7e893a

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.0.3.tar.gz:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.0.3-cp315-cp315-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for transferred-0.0.3-cp315-cp315-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 9dfb54fa9fdc2030048c639c2eec9047aa2ef8480708c49096856872c90e1fcf
MD5 9e3acf4910af231a7a25b2dc393a23ab
BLAKE2b-256 7e7447eefa233c0ab35baecaca41170293585c23b7e8cfb912f0bbb0a087eee8

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.0.3-cp315-cp315-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.0.3-cp314-cp314t-win_amd64.whl.

File metadata

File hashes

Hashes for transferred-0.0.3-cp314-cp314t-win_amd64.whl
Algorithm Hash digest
SHA256 8fd98c9038dfbaa1cdd22815042100a765a855eccb7d8e8d3dae54114388cea1
MD5 2744a836cb549a5fe2c7dc7c29302114
BLAKE2b-256 0a040cbc1102a7f638c989aade719a256942f9e8f7e9d71fd26d54236a6e1fca

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.0.3-cp314-cp314t-win_amd64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.0.3-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for transferred-0.0.3-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 24f22073d79c25b563270cde0a102e55187f10d466aede7fa094105c26d75303
MD5 272ed1af6f04b5512da7c01bb0cae314
BLAKE2b-256 d0a7f7a7ba3c148a9cc1723e9fe973a0b7ef90bb49cb28330abec030ce0bffe2

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.0.3-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.0.3-cp314-cp314t-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for transferred-0.0.3-cp314-cp314t-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 059a531c42e448dd591c37818c59b2f16340ff6b26ddf92baf2862559c82a383
MD5 3b5ada04cfbff753804ad0efac11546a
BLAKE2b-256 dc679244738cb90c43ff291048ff533cfec8f57e090602713dbbb50e8608db95

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.0.3-cp314-cp314t-macosx_11_0_arm64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.0.3-cp314-cp314-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for transferred-0.0.3-cp314-cp314-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 b8917737d76de6340c354e1d276b45f6f0c5a5be669a294034af11fa28cbd09f
MD5 cc9e0c6059d0a35584342ae2c10d0b83
BLAKE2b-256 79a33540a0a7babef6e9a54252ad5ce88628870f0182ab93d6ac7c80f59d0693

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.0.3-cp314-cp314-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file transferred-0.0.3-cp314-cp314-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for transferred-0.0.3-cp314-cp314-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 98c443b42eabebedb254ba6d55a645e3a1dc7f0bf88ce5ce195725ada57dea04
MD5 c98ff9f910942c3df50400e62c8402a3
BLAKE2b-256 17b0bf1f48575f22e6a67b734b05be117cc4c685f40de1d4eb06c91d811abdd4

See more details on using hashes here.

Provenance

The following attestation bundles were made for transferred-0.0.3-cp314-cp314-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release.yml on skatromb/transferred

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page