Skip to main content

A tool for data engineers to manage continuously evolving CSV/JSON schemas.

Project description

csv-json-schema-sync

A CLI tool for data engineers to manage continuously evolving CSV/JSON schemas.

Features

  • Infer Schema: Auto-generate JSON schema from CSV/JSON data files.
  • Validate Data: Validate data files against a JSON schema.
  • Compare Schemas: Detect changes between two schemas (new/missing columns).

Installation

pip install .

Usage

Infer Schema

schema-sync infer users.csv > schema.json

Validate Data

schema-sync validate users.csv schema.json

Development

pip install -e ".[dev]"
pytest

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

csv_json_schema_sync-0.1.0.tar.gz (4.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

csv_json_schema_sync-0.1.0-py3-none-any.whl (5.0 kB view details)

Uploaded Python 3

File details

Details for the file csv_json_schema_sync-0.1.0.tar.gz.

File metadata

  • Download URL: csv_json_schema_sync-0.1.0.tar.gz
  • Upload date:
  • Size: 4.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.5

File hashes

Hashes for csv_json_schema_sync-0.1.0.tar.gz
Algorithm Hash digest
SHA256 db0b314938d53bd7a937cc0b41ee179600c511cc303e60219ba07f15c32400ad
MD5 eb78d46484aee7a05f8d9ca85f858c0b
BLAKE2b-256 669d4b6b0fcbd5be68cdd35154f36599974b97c0a2e29ff4feca42a54ad78e6c

See more details on using hashes here.

File details

Details for the file csv_json_schema_sync-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for csv_json_schema_sync-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 7286f01827cb6237b80f74181c3e3d81723eef60bdfa06c6edeca565f95d2be5
MD5 c8ea83183eae7eadbc23fb97ebb94ce7
BLAKE2b-256 0291cca4ddc9cd30868029da42c16fe00852a18d5fb1973dd0e336cb73b60fa0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page