Skip to main content

pyrofile

File-like object for accessing local and cloud storage. Built in Rust with growing support for major cloud storage platforms.

Install

pip install pyrofile

Usage

from pyrofile import PyroFile

# Local filesystem
with PyroFile("/tmp/model.pt", "w") as f:
    f.write(data)

with PyroFile("/tmp/model.pt", "r") as f:
    data = f.read()

# Azure Blob Storage
with PyroFile("az://account/container/model.pt", "w") as f:
    f.write(data)

Works with torch.save and torch.load:

import torch
from pyrofile import PyroFile

with PyroFile("az://account/container/checkpoint.pt", "w") as f:
    torch.save(model.state_dict(), f)

with PyroFile("az://account/container/checkpoint.pt", "r") as f:
    state = torch.load(f, weights_only=True)

Backends

Backend URI scheme Status
Local filesystem /path/to/file Stable
Azure Blob Storage az://account/container/blob Preview
Amazon S3 s3://bucket/key Planned
Google Cloud Storage gs://bucket/object Planned

Development

python -m venv .venv && source .venv/bin/activate
python -m pip install maturin pytest
maturin develop --release --features azure
cargo test --lib
python -m pytest tests/python/test_local.py
python -m pytest tests/python/test_azure_integration.py

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyrofile-0.3.2.tar.gz (43.3 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

pyrofile-0.3.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.17+ x86-64

pyrofile-0.3.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.7 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.17+ ARM64

pyrofile-0.3.2-cp313-cp313-macosx_11_0_arm64.whl (1.3 MB view details)

Uploaded CPython 3.13macOS 11.0+ ARM64

pyrofile-0.3.2-cp313-cp313-macosx_10_12_x86_64.whl (1.3 MB view details)

Uploaded CPython 3.13macOS 10.12+ x86-64

pyrofile-0.3.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.17+ x86-64

pyrofile-0.3.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.7 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.17+ ARM64

pyrofile-0.3.2-cp312-cp312-macosx_11_0_arm64.whl (1.3 MB view details)

Uploaded CPython 3.12macOS 11.0+ ARM64

pyrofile-0.3.2-cp312-cp312-macosx_10_12_x86_64.whl (1.3 MB view details)

Uploaded CPython 3.12macOS 10.12+ x86-64

pyrofile-0.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

pyrofile-0.3.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ ARM64

pyrofile-0.3.2-cp311-cp311-macosx_11_0_arm64.whl (1.3 MB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

pyrofile-0.3.2-cp311-cp311-macosx_10_12_x86_64.whl (1.3 MB view details)

Uploaded CPython 3.11macOS 10.12+ x86-64

pyrofile-0.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

pyrofile-0.3.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.7 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ ARM64

pyrofile-0.3.2-cp310-cp310-macosx_11_0_arm64.whl (1.3 MB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

pyrofile-0.3.2-cp310-cp310-macosx_10_12_x86_64.whl (1.3 MB view details)

Uploaded CPython 3.10macOS 10.12+ x86-64

File details

Details for the file pyrofile-0.3.2.tar.gz.

File metadata

  • Download URL: pyrofile-0.3.2.tar.gz
  • Upload date:
  • Size: 43.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for pyrofile-0.3.2.tar.gz
Algorithm Hash digest
SHA256 4360b96622193197b2bfdb57ff866ca238134a548a037ef3072d651d8cdbdaae
MD5 7c67be2a6226766f71cb8b7aca991f89
BLAKE2b-256 e9b392e94d0448fae77ed02393c55da93cfa5cbeb2d2fedc64a01fbd73c63a6c

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrofile-0.3.2.tar.gz:

Publisher: release.yml on nateprewitt/pyrofile

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pyrofile-0.3.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for pyrofile-0.3.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 97dcceb1155303eb1b891088bb04f099a64a3c94b51efe1e772fc7329e459d92
MD5 dae674a33e11f77359c402be556ecd7c
BLAKE2b-256 a0c84c92b827e5179da9f051ebd03d4bbf5e3cadb30ddd08fe32c9a7b2a765a1

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrofile-0.3.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on nateprewitt/pyrofile

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pyrofile-0.3.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for pyrofile-0.3.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 046dccbed6a7d828fb21fe1c8afaa03a404c4a33e32a0eaedffa995e352244cb
MD5 80fb87491d2f83ddbecb5656711c371c
BLAKE2b-256 b8490d14772a56b8eccb99b10c01c414be8844a5f72fa1a5675f2e70977b0cf7

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrofile-0.3.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release.yml on nateprewitt/pyrofile

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pyrofile-0.3.2-cp313-cp313-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for pyrofile-0.3.2-cp313-cp313-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 6e647eee32d1cf74051784ba034c9c1662fdd7d4ef61542865501c3ed03738cf
MD5 e442cf435ff24cac5755f69cd9fd1574
BLAKE2b-256 24d20a5343f81c264156f95aac1bdb5577906800301e647f548c29037be9b5b7

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrofile-0.3.2-cp313-cp313-macosx_11_0_arm64.whl:

Publisher: release.yml on nateprewitt/pyrofile

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pyrofile-0.3.2-cp313-cp313-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for pyrofile-0.3.2-cp313-cp313-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 08154e40abbc3c1246eae15f338f5914d0db14b4e79fcef62eb4e2536694fd3e
MD5 8a50d6f8175a03f4f3357b12645dae7a
BLAKE2b-256 e6be4ee8d95d0af9687af4cd80c9d358792ffa8e6d9b1a9ae7d6c20b9131fa16

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrofile-0.3.2-cp313-cp313-macosx_10_12_x86_64.whl:

Publisher: release.yml on nateprewitt/pyrofile

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pyrofile-0.3.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for pyrofile-0.3.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 366f12728f5ceeaeed1d3e5b5c04369c499a7e560a3387d52ff90ca489ea9d09
MD5 71fd125b813576efc1a0aa25c3d8d283
BLAKE2b-256 7acf69315abd00d39be7ec5afcf615dd70974d95c1204869843e0168a2382c53

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrofile-0.3.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on nateprewitt/pyrofile

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pyrofile-0.3.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for pyrofile-0.3.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 ee35c41bccd09a078bd04188567664adb2502a7ef61faf39577697c1204ecd37
MD5 3777f95523eecb4ea842dab901e17e1a
BLAKE2b-256 6b6d46cb912d0c4e5a045a4b7b43500b9e2f0a9b082a84a48f1e1cfa80319751

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrofile-0.3.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release.yml on nateprewitt/pyrofile

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pyrofile-0.3.2-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for pyrofile-0.3.2-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 f693f33af48fdb7249d7096a6cf5b171bc29824e9e64396adf49903c1cdbffa4
MD5 cfc7fc460f2b385d23f7c4d01965da5c
BLAKE2b-256 ae0a7b3f38ddcd28b2c06ee76c7bb8081ae44e98e689a927dfe4fdfaa6f64656

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrofile-0.3.2-cp312-cp312-macosx_11_0_arm64.whl:

Publisher: release.yml on nateprewitt/pyrofile

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pyrofile-0.3.2-cp312-cp312-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for pyrofile-0.3.2-cp312-cp312-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 2f67b3f6e5ce6331674be1ba1070743ef18bbdb9aae5e4b4517f53d98c3e7f3a
MD5 66a79a3b725055095c89654602b4101b
BLAKE2b-256 415564d4c2fb275fe61a643eab5ceefc3ea1d0ae9b14a282722f348c90a4942a

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrofile-0.3.2-cp312-cp312-macosx_10_12_x86_64.whl:

Publisher: release.yml on nateprewitt/pyrofile

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pyrofile-0.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for pyrofile-0.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 5b0b747a524c765a44a47dec776be378ea770e3aa1b2de84a747089e30b4c2d3
MD5 3042136d495de02c91d5dfebb31d812c
BLAKE2b-256 fd2b6a7e44d9010a2957dfc8ceec77b60e8be0b31f8fef9e6e24b7187eac7273

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrofile-0.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on nateprewitt/pyrofile

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pyrofile-0.3.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for pyrofile-0.3.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 1722e806a1aad2e0f774d6d483cb9a1beecdda69a8aa924b9ca979fd74f6fce4
MD5 91def1123d3a03bf218615f635133323
BLAKE2b-256 dc4803e54020e133989d833945c880eb3dbeb5b8d97e63dbf1c0c7ff9b009ff9

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrofile-0.3.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release.yml on nateprewitt/pyrofile

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pyrofile-0.3.2-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for pyrofile-0.3.2-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 caae41d5e559b78d3a3a9a8369147ce861b1d14a08e9c36f9534c8b7ed2f6d71
MD5 a31021cfc5577a07e9cd714c9ee7a0af
BLAKE2b-256 07ddf691e6122cf0b3c9ef2750f200a6c13400b474690c5547b4964b204804e2

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrofile-0.3.2-cp311-cp311-macosx_11_0_arm64.whl:

Publisher: release.yml on nateprewitt/pyrofile

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pyrofile-0.3.2-cp311-cp311-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for pyrofile-0.3.2-cp311-cp311-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 3f0c34d527bc6afad9de13a374038382e2b3dc24b26a596c043cfe993cd88b04
MD5 be7e37a3d44e0ddb01931e61d1ab0700
BLAKE2b-256 851a028ad95f349be1c5279fd52121fd5a21f2cade30c1f17a33de72a28614d7

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrofile-0.3.2-cp311-cp311-macosx_10_12_x86_64.whl:

Publisher: release.yml on nateprewitt/pyrofile

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pyrofile-0.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for pyrofile-0.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 ecf11c14b9b317db3d8f113fa01c93a84d2ff947f2cb8ecf97daf4c8dc1cb02e
MD5 718b9971292e70967609965d77105b80
BLAKE2b-256 bdf431416914ff67fe09a4877f744fa3ae0018282b352aed7be11fc7b50b41cd

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrofile-0.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on nateprewitt/pyrofile

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pyrofile-0.3.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for pyrofile-0.3.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 ecfe84d33940a24ee47620e70d77ff2822a7682bec5795e42216f3a821c5d283
MD5 317ed6c09dbdfa12bdefb5866a450c1f
BLAKE2b-256 b459cae3999a942b69ba112b97957000f97f3ecaa9f0f0bffae0ce59fe6371ae

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrofile-0.3.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release.yml on nateprewitt/pyrofile

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pyrofile-0.3.2-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for pyrofile-0.3.2-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 188771746d44b25c4b207089b79ad26ec01572509f1851656232489762445a71
MD5 be009b2da014235329c3681480a054c8
BLAKE2b-256 d44392bf43f5a0df89b658c9b720e5cd09ff35872c3e0388e57f486ffe2beff7

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrofile-0.3.2-cp310-cp310-macosx_11_0_arm64.whl:

Publisher: release.yml on nateprewitt/pyrofile

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pyrofile-0.3.2-cp310-cp310-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for pyrofile-0.3.2-cp310-cp310-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 a91a793fd92aae3fc4005de02cc927118e93c2e925a060f50bcccf1a8b740747
MD5 6bf60402ab70e706954e8e112dee13e3
BLAKE2b-256 94052eeda1e3274c2a1d34c1e587fecb9956c466af3000a8cf79cd6608a53d16

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrofile-0.3.2-cp310-cp310-macosx_10_12_x86_64.whl:

Publisher: release.yml on nateprewitt/pyrofile

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.3.2 This release

17 files

0.3.1

17 files

0.3.0

17 files

0.2.1

17 files

0.2.0

17 files

0.1.0

17 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page