Skip to main content

Heavyweight serialization formats for xwsystem (schema, scientific, database, binary, RON). CSV/JSON/TOML/YAML/XML, BSON, and other core xwsystem codecs are not registered by this package

Project description

xwformats

Many serialization formats, one package. Schema (Protobuf, Parquet, Thrift, …), scientific (HDF5, Feather, Zarr, …), database (LMDB, LevelDB, …), plus binary and text. Same converter style as xwsystem; formats register on import. Pick lite, lazy, full, or dev extras to match how you deploy.

Company: eXonware.com · Author: eXonware Backend Team · Email: connect@exonware.com

Status Python License


📦 Install

Install What you get When to use
pip install exonware-xwformats Baseexonware-xwsystem[full] (shared text/JSON stack, etc.) + lazy hooks Heavier than core-only xwsystem; add [full] for extra heavyweight codecs.
pip install exonware-xwformats[lazy] Lazy - xwsystem[lazy] + lazy extras Matches lazy-optional stack in docs.
pip install exonware-xwformats[full] Full - common format deps installed up front Production or CI; on Windows, LevelDB/RocksDB wheels may be missing (see docs/REF_54_BENCH.md).
pip install exonware-xwformats[dev] Dev - pytest, black, mypy, … Contributors

Base install pulls exonware-xwsystem[full] (CSV, JSON, TOML, YAML, XML, and other xwsystem optionals) and enables xwlazy when available. [lazy], [dev], and [full] are extras on top.


🚀 Quick start

from exonware.xwformats import XWFormats

xf = XWFormats()
print(xf.list_formats())                       # All registered formats
data = xf.convert(json_bytes, "json", "yaml")  # Bidirectional conversion
ser = xf.get_serializer("parquet")
ser.encode(value)
ser.decode(data)

Importing xwformats registers its formats with xwsystem; use xwsystem's codec/facade for detection by file extension. See REF_14_DX and REF_15_API.


✨ What you get

Area What's in it
Schema Protobuf, Parquet, Thrift, ORC, Cap'n Proto, FlatBuffers, Arrow. Avro is optional (may be off default import on some platforms - see __init__.py and docs/_archive/KNOWN_ISSUES.md).
Scientific HDF5, Feather, Zarr, NetCDF, MAT.
Database LMDB, LevelDB, RocksDB, GraphDB.
Binary / text UBJSON, Bincode, Dill, Postcard, and RON are implemented in xwformats. BSON, CSV, JSON, TOML, YAML, XML, and other core xwsystem binaries are xwsystem-only — not registered or exported by xwformats.
Integration Same converter/facade as xwsystem; codec registry updated on import.

Lite = few deps. Lazy = optional format wheels on first use. Full = common optionals pre-installed. Platform notes (e.g. RocksDB on Windows): docs/logs/setup/. Known issues: docs/_archive/KNOWN_ISSUES.md and REF_22_PROJECT.md.


🌐 Ecosystem functional contributions

xwformats extends format coverage; sibling XW libs provide runtime loading strategy, registration, and downstream consumption layers. You can use xwformats standalone for broad serializer coverage and conversion tasks. Integrating with additional XW libraries is optional and mainly useful for enterprise and mission-critical pipelines that need unified runtime, storage, and query infrastructure.

Supporting XW lib What it provides to xwformats Functional requirement it satisfies
XWSystem Core codec registry/facade and serializer contracts that xwformats registers into. One unified serialization API despite many optional format backends.
XWLazy On-demand dependency loading/install behavior for optional format stacks. Practical deployment of many formats without forcing heavy installs.
XWData Higher-level data transformation workflows that consume xwformats codecs. Real pipeline usage beyond encode/decode-only primitives.
XWStorage Persistence engine integrations that use specialized format serializers. Storage interoperability for scientific/schema/database-oriented payloads.
XWJSON Binary JSON and local data-engine flows that can interoperate with format conversion paths. Efficient local format conversion and transition workflows.
XWQuery Query pipelines over data loaded via format serializers. End-to-end analytics/transform use cases after format normalization.

Competitive edge: instead of isolated serializer plugins, xwformats plugs into a shared runtime and data stack so advanced formats are immediately usable in storage/query/application workflows.


📖 Docs and tests

Aligned with project REFs and docs/GUIDE_01_USAGE.md (see GUIDE_63_README in the monorepo).


📜 License and links

Apache-2.0 - see LICENSE.

⏱️ Async Support

  • xwformats is primarily synchronous in its current implementation.
  • Source validation: 0 async def definitions and 0 await usages under src/.
  • This module still composes with async-capable xw libraries at integration boundaries when needed.

Version: 0.9.0.28 | Updated: 08-Apr-2026

Built with ❤️ by eXonware.com - Revolutionizing Python Development Since 2025

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

exonware_xwformats-0.9.0.28.tar.gz (57.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

exonware_xwformats-0.9.0.28-py3-none-any.whl (63.0 kB view details)

Uploaded Python 3

File details

Details for the file exonware_xwformats-0.9.0.28.tar.gz.

File metadata

  • Download URL: exonware_xwformats-0.9.0.28.tar.gz
  • Upload date:
  • Size: 57.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.13

File hashes

Hashes for exonware_xwformats-0.9.0.28.tar.gz
Algorithm Hash digest
SHA256 adfea52b74dba66303cf01ffd1e98d511e5b2094b0f38a2843e7252a84feb4d7
MD5 e6bd40063d34621c26f7fc9e0bf60cca
BLAKE2b-256 a2a10329b024603dcf5979f9162694817f6e9d3c30c0dea91604173ca020b80c

See more details on using hashes here.

File details

Details for the file exonware_xwformats-0.9.0.28-py3-none-any.whl.

File metadata

File hashes

Hashes for exonware_xwformats-0.9.0.28-py3-none-any.whl
Algorithm Hash digest
SHA256 0ba99fa97c46f26f8ed528d410fc9e24709acea70677c15f15df4f328658f467
MD5 94579d1a2349ff6dbd233d11cb1591a7
BLAKE2b-256 5453e814b0b98032e38e316e54e6c240f1b92d29df6bcdde45ada6ea212b1e16

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page