Skip to main content

Heavyweight serialization formats for xwsystem (schema, scientific, database, binary, RON). CSV/JSON/TOML/YAML/XML, BSON, and other core xwsystem codecs are not registered by this package

Project description

xwformats

Many serialization formats, one package. Schema (Protobuf, Parquet, Thrift, …), scientific (HDF5, Feather, Zarr, …), database (LMDB, LevelDB, …), plus binary and text. Same converter style as xwsystem; formats register on import. Pick lite, lazy, full, or dev extras to match how you deploy.

Company: eXonware.com · Author: eXonware Backend Team · Email: connect@exonware.com

Status Python License


📦 Install

Install What you get When to use
pip install exonware-xwformats Baseexonware-xwsystem[full] (shared text/JSON stack, etc.) + lazy hooks Heavier than core-only xwsystem; add [full] for extra heavyweight codecs.
pip install exonware-xwformats[lazy] Lazy - xwsystem[lazy] + lazy extras Matches lazy-optional stack in docs.
pip install exonware-xwformats[full] Full - common format deps installed up front Production or CI; on Windows, LevelDB/RocksDB wheels may be missing (see docs/REF_54_BENCH.md).
pip install exonware-xwformats[dev] Dev - pytest, black, mypy, … Contributors

Base install pulls exonware-xwsystem[full] (CSV, JSON, TOML, YAML, XML, and other xwsystem optionals) and enables xwlazy when available. [lazy], [dev], and [full] are extras on top.


🚀 Quick start

from exonware.xwformats import XWFormats

xf = XWFormats()
print(xf.list_formats())                       # All registered formats
data = xf.convert(json_bytes, "json", "yaml")  # Bidirectional conversion
ser = xf.get_serializer("parquet")
ser.encode(value)
ser.decode(data)

Importing xwformats registers its formats with xwsystem; use xwsystem's codec/facade for detection by file extension. See REF_14_DX and REF_15_API.


✨ What you get

Area What's in it
Schema Protobuf, Parquet, Thrift, ORC, Cap'n Proto, FlatBuffers, Arrow. Avro is optional (may be off default import on some platforms - see __init__.py and docs/_archive/KNOWN_ISSUES.md).
Scientific HDF5, Feather, Zarr, NetCDF, MAT.
Database LMDB, LevelDB, RocksDB, GraphDB.
Binary / text UBJSON, Bincode, Dill, Postcard, and RON are implemented in xwformats. BSON, CSV, JSON, TOML, YAML, XML, and other core xwsystem binaries are xwsystem-only — not registered or exported by xwformats.
Integration Same converter/facade as xwsystem; codec registry updated on import.

Lite = few deps. Lazy = optional format wheels on first use. Full = common optionals pre-installed. Platform notes (e.g. RocksDB on Windows): docs/logs/setup/. Known issues: docs/_archive/KNOWN_ISSUES.md and REF_22_PROJECT.md.


🌐 Ecosystem functional contributions

xwformats extends format coverage; sibling XW libs provide runtime loading strategy, registration, and downstream consumption layers. You can use xwformats standalone for broad serializer coverage and conversion tasks. Integrating with additional XW libraries is optional and mainly useful for enterprise and mission-critical pipelines that need unified runtime, storage, and query infrastructure.

Supporting XW lib What it provides to xwformats Functional requirement it satisfies
XWSystem Core codec registry/facade and serializer contracts that xwformats registers into. One unified serialization API despite many optional format backends.
XWLazy On-demand dependency loading/install behavior for optional format stacks. Practical deployment of many formats without forcing heavy installs.
XWData Higher-level data transformation workflows that consume xwformats codecs. Real pipeline usage beyond encode/decode-only primitives.
XWStorage Persistence engine integrations that use specialized format serializers. Storage interoperability for scientific/schema/database-oriented payloads.
XWJSON Binary JSON and local data-engine flows that can interoperate with format conversion paths. Efficient local format conversion and transition workflows.
XWQuery Query pipelines over data loaded via format serializers. End-to-end analytics/transform use cases after format normalization.

Competitive edge: instead of isolated serializer plugins, xwformats plugs into a shared runtime and data stack so advanced formats are immediately usable in storage/query/application workflows.


📖 Docs and tests

Aligned with project REFs and docs/GUIDE_01_USAGE.md (see GUIDE_63_README in the monorepo).


📜 License and links

Apache-2.0 - see LICENSE.

⏱️ Async Support

  • xwformats is primarily synchronous in its current implementation.
  • Source validation: 0 async def definitions and 0 await usages under src/.
  • This module still composes with async-capable xw libraries at integration boundaries when needed.

Version: 0.9.0.29 | Updated: 10-Apr-2026

Built with ❤️ by eXonware.com - Revolutionizing Python Development Since 2025

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

exonware_xwformats-0.9.0.29.tar.gz (58.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

exonware_xwformats-0.9.0.29-py3-none-any.whl (63.0 kB view details)

Uploaded Python 3

File details

Details for the file exonware_xwformats-0.9.0.29.tar.gz.

File metadata

  • Download URL: exonware_xwformats-0.9.0.29.tar.gz
  • Upload date:
  • Size: 58.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.13

File hashes

Hashes for exonware_xwformats-0.9.0.29.tar.gz
Algorithm Hash digest
SHA256 fb4bdc6fc4ede468cd8e9c99e549a64768c5101816dbe92e229d6e521aebda67
MD5 ba225b21f1730e1c44da3c3d49e9ed5b
BLAKE2b-256 fbf4a61f0feea8ce4a74f9ed1a158fa7d2f6692c255503cedb4f93df4d14515c

See more details on using hashes here.

File details

Details for the file exonware_xwformats-0.9.0.29-py3-none-any.whl.

File metadata

File hashes

Hashes for exonware_xwformats-0.9.0.29-py3-none-any.whl
Algorithm Hash digest
SHA256 8d375747b8fdf9b60e7c9ea1a92723ce9b7af01d4be92548c4c08cf15b6311e0
MD5 5e81adb32f5455cfa360d20800f25435
BLAKE2b-256 a35fcd37a8041721a70f7d9114b844381c1b9898f446e009b16a8d8149153952

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page