Skip to main content

fsspec-data

Convert tabular formats and reconcile Arrow schemas over fsspec.

Build Status codecov License PyPI

fsspec-data plans schema mappings and executes them over Arrow record batches. Codecs handle Arrow IPC, Parquet, CSV, and JSONL. The read-only dataview filesystem exposes converted files, schemas, and metadata of any source; a separate converter registry handles resources such as Xarray datasets and Zarr stores.

Start here

Convert CSV identifiers to Parquet walks through planning, batch iteration, and encoded output.

How-to guides

For application work, connect a batch producer or consumer, convert a file through an fsspec chain, or resolve schemas from files and registries. Convert Xarray and Zarr resources covers native resource routes and converter registration.

Reference and explanation

The interchange API reference covers codecs, policies, limits, and planning. Schema and converter reference describes resolution and resource routes. Read Interchange design for the boundaries between schemas, data, and consumers.

Metadata

Release files for fsspec-data 0.8.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for fsspec-data 0.8.0
File Size Uploaded Provenance Actions
fsspec_data-0.8.0.tar.gz 134.0 kB Without provenance Details for fsspec_data-0.8.0.tar.gz

Built distributions (wheels)

Table of built distributions (wheels) for fsspec-data 0.8.0
File Actions
fsspec_data-0.8.0-cp311-abi3-win_amd64.whl CPython 3.11 abi3 Windows x86-64 Details for fsspec_data-0.8.0-cp311-abi3-win_amd64.whl
fsspec_data-0.8.0-cp311-abi3-manylinux_2_28_x86_64.whl CPython 3.11 abi3 Linux glibc 2.28+ x86-64 Details for fsspec_data-0.8.0-cp311-abi3-manylinux_2_28_x86_64.whl
fsspec_data-0.8.0-cp311-abi3-manylinux_2_28_aarch64.whl CPython 3.11 abi3 Linux glibc 2.28+ ARM64 Details for fsspec_data-0.8.0-cp311-abi3-manylinux_2_28_aarch64.whl
fsspec_data-0.8.0-cp311-abi3-macosx_11_0_arm64.whl CPython 3.11 abi3 macOS 11.0+ ARM64 Details for fsspec_data-0.8.0-cp311-abi3-macosx_11_0_arm64.whl

Total release size: 22.5 MB

Release files / fsspec_data-0.8.0.tar.gz

Download URL fsspec_data-0.8.0.tar.gz
Size 134.0 kB
Tags Source
SHA-256 checksum
How to use checksums
d2190b00adf020c2aa245611c32c0c124c6ecc02491a8514fe2b228d3b179150
BLAKE2b-256 checksum
How to use checksums
1fac69546306129b60a40b518589e1fc894be046895fa9bfb870fc66e31f9ad6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Release files / fsspec_data-0.8.0-cp311-abi3-win_amd64.whl

Download URL fsspec_data-0.8.0-cp311-abi3-win_amd64.whl
Size 5.5 MB
Tags CPython 3.11 Windows x86-64 abi3
SHA-256 checksum
How to use checksums
1aeb8c19867b699bf7073cc824904d42fe42337ec2cbe1b1d596cdc76c1dedfd
BLAKE2b-256 checksum
How to use checksums
141cc3cc244a2018d86a612835bc4430b484c8631b09ad4b55edf8c95ff4098e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Release files / fsspec_data-0.8.0-cp311-abi3-manylinux_2_28_x86_64.whl

Download URL fsspec_data-0.8.0-cp311-abi3-manylinux_2_28_x86_64.whl
Size 6.2 MB
Tags CPython 3.11 Linux glibc 2.28+ x86-64 abi3
SHA-256 checksum
How to use checksums
1ccee8bfc41174c1df188b450288d3fdb282fbb54da8f9d92c34b8b20e10557f
BLAKE2b-256 checksum
How to use checksums
fcdd5db73ca11027f8457b40a4398f6156764e5c2dc8208e4e0ec1af17989ff3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Release files / fsspec_data-0.8.0-cp311-abi3-manylinux_2_28_aarch64.whl

Download URL fsspec_data-0.8.0-cp311-abi3-manylinux_2_28_aarch64.whl
Size 5.9 MB
Tags CPython 3.11 Linux glibc 2.28+ ARM64 abi3
SHA-256 checksum
How to use checksums
5ddff8c333a1e07c4e00f5f3e1f395eda691bfdb4c4a1f33a9ff41ab92cef8bd
BLAKE2b-256 checksum
How to use checksums
f22a6f35fbb7ce280af6787979a982efb67a6613a4f04d0898fd3490c6da3238
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Release files / fsspec_data-0.8.0-cp311-abi3-macosx_11_0_arm64.whl

Download URL fsspec_data-0.8.0-cp311-abi3-macosx_11_0_arm64.whl
Size 4.7 MB
Tags CPython 3.11 abi3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
45f13adcc4699d4bc7fd6a133e83b227c96ce638240160e7b2bec156eb123919
BLAKE2b-256 checksum
How to use checksums
02a9067634a7ea49fde5af39323681e36f428087542b0feecaae01edd6a25364
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Security for fsspec-data 0.8.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page