Skip to main content

BODtoJSON v2.3.1

BODtoJSON is a safe, enterprise-grade Python data liquidity engine designed to transform complex Infor OAGIS (XML) Business Object Documents into modern, AI-ready flattened JSON, streaming NDJSON, and declarative target schemas.

BODtoJSON Library Documentation

BOD2JSon

v2.3.1 establishes a safe core engine, introduces native single-pass ElementTree traversal, adds declarative schema projection (project() / to_records()) for Infor ION Scripting, and delivers a dual-pipeline streaming standard for Data Lakehouses and Vector Databases.

🚀 What’s New in v2.3.1 (vs. v1.0.0)

  • Safe Core Engine: Switched to defusedxml for secure XML parsing (rejects entity expansion and XXE) while retaining single-pass ElementTree traversal.

  • Infor ION Scripting Helpers (to_records & project): Eliminates boilerplate XML namespace parsing, json.loads() line-splitting loops, and manual boolean coercion in ION scripts. Captures ApplicationArea and DataArea/<Verb> header metadata automatically (include_header=True) and maps records directly into target REST/API JSON schemas.

  • Explicit Dual-Pipeline Architecture: Dedicated top-level API methods—to_json and to_ndjson—improve interface predictability and self-documentation.

  • Strict NDJSON Linearization: Features compact serialization via separators=(',', ':') and forced line termination (\n). Multi-noun batch payloads inside DataArea are automatically unpacked and emitted as individual, single-line text records.

  • 100% Backward Compatibility: The original convert() function remains active at the package root, routing to to_json() while emitting a non-breaking DeprecationWarning scheduled for removal in v3.0.0.

  • Enterprise REST API Tier (api.py): Added an optional, high-performance FastAPI microservice layer featuring zero-overhead streaming using raw Response classes and /project schema mapping.

📈 Architectural Comparison

Feature Legacy (v1.0.0) Enterprise Engine (v2.3.1)
Core Dependencies Relied on xmltodict defusedxml for secure XML parsing
Memory & Speed Double-pass XML $\rightarrow$ Dict $\rightarrow$ Flat Dict Single-pass ElementTree traversal (~50% lower memory)
Data Formats Standard Structured JSON string Standard JSON, Strict NDJSON, Native Dicts & Projected Schemas
Infor ION Scripting Manual XML + JSON loop boilerplate Declarative project() with automatic header context
Ingestion Target Application memory / NoSQL DBs Data Lakehouses (Snowflake/Databricks), Vector DBs & ION APIs
System Delivery Library imports only Library + Optional FastAPI Microservice Tier ([api])

🛠️ Installation

Core Library (Zero Dependencies)

Ideal for Infor ION Scripting, data-engineering pipelines, ETL workers, and air-gapped environments:

pip install BODtoJSON

With Enterprise REST API Tier

Includes fastapi and uvicorn for microservice deployment:

pip install "BODtoJSON[api]"

📂 Project Structure

BODtoJSON/
├── src/
│   └── BODtoJSON/
│       ├── __init__.py      # Package version (2.3.1) & API exports
│       ├── mapper.py        # Safe Dual-Pipeline & Projection Engine
│       └── api.py           # Optional FastAPI Microservice Ingestion Layer
├── tests/
│   ├── data/                # Raw OAGIS XML Test Datasets (.xml)
│   ├── config.py            # Test Data Configuration
│   ├── conftest.py          # Pytest Dataset Loader Fixtures
│   ├── test_mapper.py       # Core Engine Unit Tests, ION Projection & Regression Suite
│   └── test_api.py          # API Endpoint Verification
├── scripts/
│   └── inspect_payload.py   # Multi-Profile Business Validation Utility
├── pyproject.toml           # Build, Optional Extras & Pytest Configurations
└── README.md

🧪 Validation & Testing

1. Automated Testing (QA Suite)

Run the standardized pytest execution engine:

python -m pytest -v -p no:cacheprovider

2. Manual Payload Inspection (UAT Engine)

Verify transformation output profiles locally:

python scripts/inspect_payload.py

Toggle the mode parameter within inspect_payload.py between "ndjson", "json", "project", and "legacy" to inspect outputs in output_preview.json.

💻 Code Examples

1. Infor ION Scripting: Declarative Schema Projection (project)

Eliminates manual XML namespace handling, json.loads() loops, and boolean boilerplate.

import json
from BODtoJSON import project

SCHEMA = {
    "externalSystemId": "company[{Sync_AccountingEntityID}];DIMENSION1;{ChartOfAccounts_BaseChartOfAccounts_GLNominalAccount}",
    "isActive": "true",
    "companyId": "company[3100]",
    "dimensionName": "DIMENSION1",
    "usableInPurchase": "true",
}

# Automatically merges DataArea/Sync header context with each flattened Noun record
items = project(input_var, verb="Sync", schema=SCHEMA, include_header=True)
output_var = json.dumps(items)

2. Native Python Records (to_records)

Extracts a Python list[dict] directly with optional ApplicationArea and Verb header context.

from BODtoJSON import to_records

records = to_records(xml_input, verb="Sync", include_header=True)
for rec in records:
    print(rec["Sync_AccountingEntityID"], rec["PurchaseOrder_PurchaseOrderHeader_DisplayID"])

3. Modern Pipeline: Newline Delimited JSON (to_ndjson)

Optimized for Data Lakehouses (Snowflake/Databricks) and Vector Database ingestion.

from BODtoJSON import to_ndjson

xml_input = """<SyncPurchaseOrder>...</SyncPurchaseOrder>"""

# Returns a dense, single-line string per record with zero internal spaces, terminated by \n
linearized_ndjson = to_ndjson(xml_input, verb="Sync")

4. Modern Pipeline: Standard Flattened JSON (to_json)

Optimized for application-level consumption and document-store indexing.

from BODtoJSON import to_json

xml_input = """<SyncPurchaseOrder>...</SyncPurchaseOrder>"""

# Returns a standard flat JSON string
flattened_json = to_json(xml_input, verb="Sync")

5. Legacy Pipeline: Backward-Compatible Conversion (convert)

Maintained for smooth migration of existing production pipelines.

from BODtoJSON import convert

xml_input = """<SyncPurchaseOrder>...</SyncPurchaseOrder>"""

# DEPRECATED: Scheduled for removal in v3.0.0.
# Internally routes to to_json() and emits a DeprecationWarning.
legacy_json = convert(xml_input, verb="Sync")

6. Running the Enterprise API Tier

Launch the microservice locally:

uvicorn BODtoJSON.api:app --reload

Open http://127.0.0.1:8000/docs to test /convert/ndjson, /convert/json, and /project directly via Swagger UI.

🤝 Commercial Value

By normalizing complex ERP structures into safe, flat JSON, streaming NDJSON, and projected API payloads, BODtoJSON v2.3.1 eliminates third-party library bloat and reduces AI, Lakehouse, and Infor ION integration overhead by up to 90%.

Author: Niraj Kakodkar

License: MIT

Known Limitations

  • Flattening is lossy and one-way. There is no JSON → BOD reverse mapping.
  • to_json() returns only the first noun under DataArea. Use to_records() or to_ndjson() to get all nouns.
  • The optional FastAPI extra is unauthenticated. Deploy it only on a trusted network or behind your own authentication/authorization.
  • Secure XML parsing is provided by defusedxml (core dependency). Do not disable it.
  • Mixed content (text + child elements) preserves the direct text as _#text where present; tail text after children is not specially handled beyond ElementTree defaults.
  • Empty elements flatten to JSON null.

Metadata

Release files for BODtoJSON 2.3.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for BODtoJSON 2.3.1
File Size Uploaded Provenance Actions
bodtojson-2.3.1.tar.gz 32.8 kB Without provenance Details for bodtojson-2.3.1.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for BODtoJSON 2.3.1
File Interpreter ABI Platform Actions
bodtojson-2.3.1-py3-none-any.whl Python 3 none any Details for bodtojson-2.3.1-py3-none-any.whl

Total release size: 43.7 kB

Release files / bodtojson-2.3.1.tar.gz

Download URL bodtojson-2.3.1.tar.gz
Size 32.8 kB
Tags Source
SHA-256 checksum
How to use checksums
7f260e9b40ddf59fb6f617df0cfe03d4587f4bbe23229def16b0af623dd8a8a5
BLAKE2b-256 checksum
How to use checksums
6585b8e201ddd259ae25a0f29424a76a90d0118127781b1a3a277d8c94e90e61
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.11.9

Release files / bodtojson-2.3.1-py3-none-any.whl

Download URL bodtojson-2.3.1-py3-none-any.whl
Size 10.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
e26ea84e4562e9a00e9bfba99122f2398e2831f1a23af19f73b9eb80b2cb13ac
BLAKE2b-256 checksum
How to use checksums
f1e9369f84c137912223add0a3ee657452de7ed99f6923ff8eb94fb244442581
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.11.9

Security for BODtoJSON 2.3.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page