Skip to main content

fsspec-data

Convert tabular formats and reconcile Arrow schemas over fsspec.

Build Status codecov License PyPI

fsspec-data plans schema mappings and executes them over Arrow record batches. Codecs handle Arrow IPC, Parquet, CSV, and JSONL. A read-only chained filesystem exposes converted files; a separate converter registry handles resources such as Xarray datasets and Zarr stores.

Start here

Convert CSV identifiers to Parquet walks through planning, batch iteration, and encoded output.

How-to guides

For application work, connect a batch producer or consumer, convert a file through an fsspec chain, or resolve schemas from files and registries. Convert Xarray and Zarr resources covers native resource routes and converter registration.

Reference and explanation

The interchange API reference covers codecs, policies, limits, and planning. Schema and converter reference describes resolution and resource routes. Read Interchange design for the boundaries between schemas, data, and consumers.

Metadata

Release files for fsspec-data 0.7.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for fsspec-data 0.7.0
File Size Uploaded Provenance Actions
fsspec_data-0.7.0.tar.gz 134.3 kB Without provenance Details for fsspec_data-0.7.0.tar.gz

Built distributions (wheels)

Table of built distributions (wheels) for fsspec-data 0.7.0
File Actions
fsspec_data-0.7.0-cp311-abi3-win_amd64.whl CPython 3.11 abi3 Windows x86-64 Details for fsspec_data-0.7.0-cp311-abi3-win_amd64.whl
fsspec_data-0.7.0-cp311-abi3-manylinux_2_28_x86_64.whl CPython 3.11 abi3 Linux glibc 2.28+ x86-64 Details for fsspec_data-0.7.0-cp311-abi3-manylinux_2_28_x86_64.whl
fsspec_data-0.7.0-cp311-abi3-manylinux_2_28_aarch64.whl CPython 3.11 abi3 Linux glibc 2.28+ ARM64 Details for fsspec_data-0.7.0-cp311-abi3-manylinux_2_28_aarch64.whl
fsspec_data-0.7.0-cp311-abi3-macosx_11_0_arm64.whl CPython 3.11 abi3 macOS 11.0+ ARM64 Details for fsspec_data-0.7.0-cp311-abi3-macosx_11_0_arm64.whl

Total release size: 22.5 MB

Release files / fsspec_data-0.7.0.tar.gz

Download URL fsspec_data-0.7.0.tar.gz
Size 134.3 kB
Tags Source
SHA-256 checksum
How to use checksums
f601d3fe6b6df9febd107fd751bcab836e177e9c70bd7b9d60eb76e8a15a6dc1
BLAKE2b-256 checksum
How to use checksums
0f145e51ab82e2e67626446d99c5248749fa42da0736e53fc0c72c351b700655
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Release files / fsspec_data-0.7.0-cp311-abi3-win_amd64.whl

Download URL fsspec_data-0.7.0-cp311-abi3-win_amd64.whl
Size 5.5 MB
Tags CPython 3.11 Windows x86-64 abi3
SHA-256 checksum
How to use checksums
10494a4590a7b25d127c09d093c212bca5f369727b90e1beee58995762aa0b23
BLAKE2b-256 checksum
How to use checksums
30b9417968795b9cdaa747aec06a2f90bfa5b9fed6433b47f464288d22139136
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Release files / fsspec_data-0.7.0-cp311-abi3-manylinux_2_28_x86_64.whl

Download URL fsspec_data-0.7.0-cp311-abi3-manylinux_2_28_x86_64.whl
Size 6.2 MB
Tags CPython 3.11 Linux glibc 2.28+ x86-64 abi3
SHA-256 checksum
How to use checksums
a2fc9b164a07b84d306e314ea3677f3ad0dd56b0255b248403fa201748cc7ddc
BLAKE2b-256 checksum
How to use checksums
affe84368d28da37d46d99d56e87c76cbbae72e9d3df23d0f2292dbec00f43c3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Release files / fsspec_data-0.7.0-cp311-abi3-manylinux_2_28_aarch64.whl

Download URL fsspec_data-0.7.0-cp311-abi3-manylinux_2_28_aarch64.whl
Size 5.9 MB
Tags CPython 3.11 Linux glibc 2.28+ ARM64 abi3
SHA-256 checksum
How to use checksums
d9f5fd3e97ab45016c5af144fc11131c5939c5b0c8cd6fa7acd7c46d80eab1f0
BLAKE2b-256 checksum
How to use checksums
78739d15778a6ee377e8260523c4f3d29a089e13fade420d597c78de4362eb38
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Release files / fsspec_data-0.7.0-cp311-abi3-macosx_11_0_arm64.whl

Download URL fsspec_data-0.7.0-cp311-abi3-macosx_11_0_arm64.whl
Size 4.7 MB
Tags CPython 3.11 abi3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
8b779436a07dd8b8a45125fa3aca869a219ac1b688c8a860bc446ffa9d448f04
BLAKE2b-256 checksum
How to use checksums
9b4ea52263fa8dcb0d031aedf665d43cff0ab2185fe9e2ada7dbd58f3ab857e2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.15

Security for fsspec-data 0.7.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page