Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json-file-split-0.0.51.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.51-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json-file-split-0.0.51.tar.gz.

File metadata

  • Download URL: json-file-split-0.0.51.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.0 CPython/3.8.10 Linux/5.15.0-1019-azure

File hashes

Hashes for json-file-split-0.0.51.tar.gz
Algorithm Hash digest
SHA256 9df0adc8d08e4a3c1887642a6eea64cb425a11d5225476e60fb57e4299a87901
MD5 3bfd1117e7511be98d7b75cbf4e489a2
BLAKE2b-256 c69cecd47aed0be768db0a613e3589cf6f2b8f50e74e226a5d4189e3cb67adba

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.51-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.51-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.0 CPython/3.8.10 Linux/5.15.0-1019-azure

File hashes

Hashes for json_file_split-0.0.51-py3-none-any.whl
Algorithm Hash digest
SHA256 fb3131220f0033d1c6c7a89edbc75d7ceca583d7793d08226cac0492af162f05
MD5 515a1b1419eb5b9ba4031ffcb0625efd
BLAKE2b-256 b04c42a5a145a03f12c84712861fdfd0b7f6e50191d9ac5c67a764fc827b56fb

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page