Skip to main content

A tool for data engineers to manage continuously evolving CSV/JSON schemas.

Project description

csv-json-schema-sync

A CLI tool for data engineers to manage continuously evolving CSV/JSON schemas.

Features

  • Infer Schema: Auto-generate JSON schema from CSV/JSON data files.
  • Validate Data: Validate data files against a JSON schema.
  • Compare Schemas: Detect changes between two schemas (new/missing columns).

Installation

pip install .

Usage

Infer Schema

schema-sync infer users.csv > schema.json

Validate Data

schema-sync validate users.csv schema.json

Development

pip install -e ".[dev]"
pytest

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

csv_json_schema_sync-0.1.1.tar.gz (4.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

csv_json_schema_sync-0.1.1-py3-none-any.whl (5.0 kB view details)

Uploaded Python 3

File details

Details for the file csv_json_schema_sync-0.1.1.tar.gz.

File metadata

  • Download URL: csv_json_schema_sync-0.1.1.tar.gz
  • Upload date:
  • Size: 4.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.5

File hashes

Hashes for csv_json_schema_sync-0.1.1.tar.gz
Algorithm Hash digest
SHA256 65bbd35c3ce6a4bdc93f9e88751befe7d89e3606aba0b3c35512e92ee49aa128
MD5 f1d4ac2a1640eaf190295f7987baf333
BLAKE2b-256 72d1511ded49673268c03658d98dfd99cd5f217d221719ee0503f67444202286

See more details on using hashes here.

File details

Details for the file csv_json_schema_sync-0.1.1-py3-none-any.whl.

File metadata

File hashes

Hashes for csv_json_schema_sync-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 fe12de8bd6d0f78b9d4123e6d24b0ac0801902453bb4e3b06dc5673b3383c066
MD5 94df85b3e34a7a0d9228b85118a4eb51
BLAKE2b-256 c4e85566af2174451266f28460954bdf5588c0ef5b8f02c05291f589b4dcef3f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page