Skip to main content

fsspec-data

Convert tabular formats and reconcile Arrow schemas over fsspec.

Build Status codecov License PyPI

fsspec-data plans schema mappings and executes them over Arrow record batches. Codecs handle Arrow IPC, Parquet, CSV, and JSONL. A read-only chained filesystem exposes converted files; a separate converter registry handles resources such as Xarray datasets and Zarr stores.

Start here

Convert CSV identifiers to Parquet walks through planning, batch iteration, and encoded output.

How-to guides

For application work, connect a batch producer or consumer, convert a file through an fsspec chain, or resolve schemas from files and registries. Convert Xarray and Zarr resources covers native resource routes and converter registration.

Reference and explanation

The interchange API reference covers codecs, policies, limits, and planning. Schema and converter reference describes resolution and resource routes. Read Interchange design for the boundaries between schemas, data, and consumers.

Metadata

Release files for fsspec-data 0.6.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for fsspec-data 0.6.0
File Size Uploaded Provenance Actions
fsspec_data-0.6.0.tar.gz 121.7 kB Without provenance Details for fsspec_data-0.6.0.tar.gz

Built distributions (wheels)

Table of built distributions (wheels) for fsspec-data 0.6.0
File Actions
fsspec_data-0.6.0-cp310-abi3-win_amd64.whl CPython 3.10 abi3 Windows x86-64 Details for fsspec_data-0.6.0-cp310-abi3-win_amd64.whl
fsspec_data-0.6.0-cp310-abi3-manylinux_2_28_x86_64.whl CPython 3.10 abi3 Linux glibc 2.28+ x86-64 Details for fsspec_data-0.6.0-cp310-abi3-manylinux_2_28_x86_64.whl
fsspec_data-0.6.0-cp310-abi3-manylinux_2_28_aarch64.whl CPython 3.10 abi3 Linux glibc 2.28+ ARM64 Details for fsspec_data-0.6.0-cp310-abi3-manylinux_2_28_aarch64.whl
fsspec_data-0.6.0-cp310-abi3-macosx_11_0_arm64.whl CPython 3.10 abi3 macOS 11.0+ ARM64 Details for fsspec_data-0.6.0-cp310-abi3-macosx_11_0_arm64.whl

Total release size: 22.5 MB

Release files / fsspec_data-0.6.0.tar.gz

Download URL fsspec_data-0.6.0.tar.gz
Size 121.7 kB
Tags Source
SHA-256 checksum
How to use checksums
489558b1f4480f706879bfa76571d9f3bf726677d7ab349947b5d7ab785928bc
BLAKE2b-256 checksum
How to use checksums
9f2ea72ee789c4276a882315a8093daa4494664f76177599db2787de8d144555
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / fsspec_data-0.6.0-cp310-abi3-win_amd64.whl

Download URL fsspec_data-0.6.0-cp310-abi3-win_amd64.whl
Size 5.5 MB
Tags CPython 3.10 Windows x86-64 abi3
SHA-256 checksum
How to use checksums
0bbefc40ca2aa738125afe6bdede5ca1e801caea12f65fc485a6304409a9503f
BLAKE2b-256 checksum
How to use checksums
bbf6f0724181ed058c50154e899450a0e3086770e92f5dae10c9bbb854860761
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / fsspec_data-0.6.0-cp310-abi3-manylinux_2_28_x86_64.whl

Download URL fsspec_data-0.6.0-cp310-abi3-manylinux_2_28_x86_64.whl
Size 6.3 MB
Tags CPython 3.10 Linux glibc 2.28+ x86-64 abi3
SHA-256 checksum
How to use checksums
c677181adf99cb37e154b32d739359f0b5856f5425622b94f63f4f73e4b75451
BLAKE2b-256 checksum
How to use checksums
c456f0f02b3250ca158af7c3b53bac0e56a2ec1a617d67d84b41b8459037a5f3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / fsspec_data-0.6.0-cp310-abi3-manylinux_2_28_aarch64.whl

Download URL fsspec_data-0.6.0-cp310-abi3-manylinux_2_28_aarch64.whl
Size 5.9 MB
Tags CPython 3.10 Linux glibc 2.28+ ARM64 abi3
SHA-256 checksum
How to use checksums
ae86e05c0664bbcbe67f351ffc923d11fdacfc43a47e86ab88d6648a0691d97f
BLAKE2b-256 checksum
How to use checksums
776fbb801dc909a0f6e4eb894e686dfc0aca0ae8facd0e9bef16f4c8dd3da473
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / fsspec_data-0.6.0-cp310-abi3-macosx_11_0_arm64.whl

Download URL fsspec_data-0.6.0-cp310-abi3-macosx_11_0_arm64.whl
Size 4.7 MB
Tags CPython 3.10 abi3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
903250e60131d5f3992ca2cd5c2971c6e406ce6a8a53c586dc06ac285ebf28f1
BLAKE2b-256 checksum
How to use checksums
e6e537faa3a5471e2d0017e41efdabdb155243411e81fa173ea7eba447c14f2c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Security for fsspec-data 0.6.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page