Skip to main content

fsspec-data

Convert tabular formats and reconcile Arrow schemas over fsspec.

Build Status codecov License PyPI

fsspec-data plans schema mappings and executes them over Arrow record batches. Codecs handle Arrow IPC, Parquet, CSV, and JSONL. A read-only chained filesystem exposes converted files; a separate converter registry handles resources such as Xarray datasets and Zarr stores.

Start here

Convert CSV identifiers to Parquet walks through planning, batch iteration, and encoded output.

How-to guides

For application work, connect a batch producer or consumer, convert a file through an fsspec chain, or resolve schemas from files and registries. Convert Xarray and Zarr resources covers native resource routes and converter registration.

Reference and explanation

The interchange API reference covers codecs, policies, limits, and planning. Schema and converter reference describes resolution and resource routes. Read Interchange design for the boundaries between schemas, data, and consumers.

Metadata

Release files for fsspec-data 0.5.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for fsspec-data 0.5.0
File Size Uploaded Provenance Actions
fsspec_data-0.5.0.tar.gz 119.4 kB Without provenance Details for fsspec_data-0.5.0.tar.gz

Built distributions (wheels)

Table of built distributions (wheels) for fsspec-data 0.5.0
File Actions
fsspec_data-0.5.0-cp310-abi3-win_amd64.whl CPython 3.10 abi3 Windows x86-64 Details for fsspec_data-0.5.0-cp310-abi3-win_amd64.whl
fsspec_data-0.5.0-cp310-abi3-manylinux_2_28_x86_64.whl CPython 3.10 abi3 Linux glibc 2.28+ x86-64 Details for fsspec_data-0.5.0-cp310-abi3-manylinux_2_28_x86_64.whl
fsspec_data-0.5.0-cp310-abi3-manylinux_2_28_aarch64.whl CPython 3.10 abi3 Linux glibc 2.28+ ARM64 Details for fsspec_data-0.5.0-cp310-abi3-manylinux_2_28_aarch64.whl
fsspec_data-0.5.0-cp310-abi3-macosx_11_0_arm64.whl CPython 3.10 abi3 macOS 11.0+ ARM64 Details for fsspec_data-0.5.0-cp310-abi3-macosx_11_0_arm64.whl

Total release size: 20.5 MB

Release files / fsspec_data-0.5.0.tar.gz

Download URL fsspec_data-0.5.0.tar.gz
Size 119.4 kB
Tags Source
SHA-256 checksum
How to use checksums
19a2c795f1911b3a4f31cdc9a1d6037e2a8ac15c6bda93d150c33b5db2d7322e
BLAKE2b-256 checksum
How to use checksums
999f3c0838082d373a6b45ac1c0e7b937d530f76dfe6bc909b2850cb9244d399
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Release files / fsspec_data-0.5.0-cp310-abi3-win_amd64.whl

Download URL fsspec_data-0.5.0-cp310-abi3-win_amd64.whl
Size 4.9 MB
Tags CPython 3.10 Windows x86-64 abi3
SHA-256 checksum
How to use checksums
d291845ce9f170eae0ac18eb06728da7745a1d9c8c0356092467c442c5da4e73
BLAKE2b-256 checksum
How to use checksums
30b4582cd601367065516bb41e4512c6702b6ab100d4867a6691ec9aea439899
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Release files / fsspec_data-0.5.0-cp310-abi3-manylinux_2_28_x86_64.whl

Download URL fsspec_data-0.5.0-cp310-abi3-manylinux_2_28_x86_64.whl
Size 5.6 MB
Tags CPython 3.10 Linux glibc 2.28+ x86-64 abi3
SHA-256 checksum
How to use checksums
c8372bdfa3c21ca3242128fd9580d46b01adf3927d6c1f47c18410ef9233d8d2
BLAKE2b-256 checksum
How to use checksums
1893f70f1ecd58f4d86926347430121d2ba334a300fe1670d04ec5dccd5a9e06
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Release files / fsspec_data-0.5.0-cp310-abi3-manylinux_2_28_aarch64.whl

Download URL fsspec_data-0.5.0-cp310-abi3-manylinux_2_28_aarch64.whl
Size 5.3 MB
Tags CPython 3.10 Linux glibc 2.28+ ARM64 abi3
SHA-256 checksum
How to use checksums
92a853130c2daf469ae4a8946cf6294e3b0d18b1cacc5ddd0616781bfc5442e6
BLAKE2b-256 checksum
How to use checksums
941f9482233ada61e45d0fb2360fa91e500e3d8d4946066d95f0c1a619739091
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Release files / fsspec_data-0.5.0-cp310-abi3-macosx_11_0_arm64.whl

Download URL fsspec_data-0.5.0-cp310-abi3-macosx_11_0_arm64.whl
Size 4.7 MB
Tags CPython 3.10 abi3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
24384fef360f1e457b49f74c0f36d9f22db5b4607f779d8efe5971e770cdba9b
BLAKE2b-256 checksum
How to use checksums
1e6189a0849a85bd400672fb8ba6f657d1f2616a9f995d8a0a2f809abc355138
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Security for fsspec-data 0.5.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page