Skip to main content

fsspec-data

Convert tabular formats and reconcile Arrow schemas over fsspec.

Build Status codecov License PyPI

fsspec-data plans schema mappings and executes them over Arrow record batches. Codecs handle Arrow IPC, Parquet, CSV, and JSONL. A read-only chained filesystem exposes converted files; a separate converter registry handles resources such as Xarray datasets and Zarr stores.

Start here

Convert CSV identifiers to Parquet walks through planning, batch iteration, and encoded output.

How-to guides

For application work, connect a batch producer or consumer, convert a file through an fsspec chain, or resolve schemas from files and registries. Convert Xarray and Zarr resources covers native resource routes and converter registration.

Reference and explanation

The interchange API reference covers codecs, policies, limits, and planning. Schema and converter reference describes resolution and resource routes. Read Interchange design for the boundaries between schemas, data, and consumers.

Metadata

Release files for fsspec-data 0.4.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for fsspec-data 0.4.0
File Size Uploaded Provenance Actions
fsspec_data-0.4.0.tar.gz 77.3 kB Without provenance Details for fsspec_data-0.4.0.tar.gz

Built distributions (wheels)

Table of built distributions (wheels) for fsspec-data 0.4.0
File Actions
fsspec_data-0.4.0-cp310-abi3-win_amd64.whl CPython 3.10 abi3 Windows x86-64 Details for fsspec_data-0.4.0-cp310-abi3-win_amd64.whl
fsspec_data-0.4.0-cp310-abi3-manylinux_2_28_x86_64.whl CPython 3.10 abi3 Linux glibc 2.28+ x86-64 Details for fsspec_data-0.4.0-cp310-abi3-manylinux_2_28_x86_64.whl
fsspec_data-0.4.0-cp310-abi3-manylinux_2_28_aarch64.whl CPython 3.10 abi3 Linux glibc 2.28+ ARM64 Details for fsspec_data-0.4.0-cp310-abi3-manylinux_2_28_aarch64.whl
fsspec_data-0.4.0-cp310-abi3-macosx_11_0_arm64.whl CPython 3.10 abi3 macOS 11.0+ ARM64 Details for fsspec_data-0.4.0-cp310-abi3-macosx_11_0_arm64.whl

Total release size: 18.4 MB

Release files / fsspec_data-0.4.0.tar.gz

Download URL fsspec_data-0.4.0.tar.gz
Size 77.3 kB
Tags Source
SHA-256 checksum
How to use checksums
33398b3b225bd878761c2dc78606ede55ce9d2fb703e6d618fd00b0705f7be80
BLAKE2b-256 checksum
How to use checksums
7548301f046d6d4c890c02e1b0d8bb40ede698c34ad26e4746dd45258bb462ca
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Release files / fsspec_data-0.4.0-cp310-abi3-win_amd64.whl

Download URL fsspec_data-0.4.0-cp310-abi3-win_amd64.whl
Size 4.4 MB
Tags CPython 3.10 Windows x86-64 abi3
SHA-256 checksum
How to use checksums
18879dfcb40a94939e592c5ebe9ea379b908afda01d7e27ae681de90844d5b4e
BLAKE2b-256 checksum
How to use checksums
7b6fb1f8e46186746d87cc8ea3cae94caade450a6917f732f524a8c8996490bd
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Release files / fsspec_data-0.4.0-cp310-abi3-manylinux_2_28_x86_64.whl

Download URL fsspec_data-0.4.0-cp310-abi3-manylinux_2_28_x86_64.whl
Size 5.1 MB
Tags CPython 3.10 Linux glibc 2.28+ x86-64 abi3
SHA-256 checksum
How to use checksums
f5600e0ff305d847e9f653abbe504cffb70ac502180c94c15f0d9b35e9b5c422
BLAKE2b-256 checksum
How to use checksums
eb3078c190cc39db6ea083e3917b12a6298dba0b0634c678af06200c9a890807
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Release files / fsspec_data-0.4.0-cp310-abi3-manylinux_2_28_aarch64.whl

Download URL fsspec_data-0.4.0-cp310-abi3-manylinux_2_28_aarch64.whl
Size 4.7 MB
Tags CPython 3.10 Linux glibc 2.28+ ARM64 abi3
SHA-256 checksum
How to use checksums
339a20f2670d954eb0826b24433aa47e8b39a1f72df936dcf63a10755318119c
BLAKE2b-256 checksum
How to use checksums
a405e0dd3b573618e6b190ac5ce9f0b7cce99b62e95b70db1491bf64e24e44d8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Release files / fsspec_data-0.4.0-cp310-abi3-macosx_11_0_arm64.whl

Download URL fsspec_data-0.4.0-cp310-abi3-macosx_11_0_arm64.whl
Size 4.2 MB
Tags CPython 3.10 abi3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
de65e9296be87ca9f20c38439f7227936bb32fcc8b26cd6b054861922690a129
BLAKE2b-256 checksum
How to use checksums
0bf680c3529561e0d46c34a594287e112199db9c29e20a9e76f53c92efd79dc2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Security for fsspec-data 0.4.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page