Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.221.tar.gz (3.6 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.221-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.221.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.221.tar.gz
  • Upload date:
  • Size: 3.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.10.12 Linux/6.5.0-1025-azure

File hashes

Hashes for json_file_split-0.0.221.tar.gz
Algorithm Hash digest
SHA256 9b2f5e0d692d497cf2aad60823fc48f6531dd39067d518aeba5fe5f543090e54
MD5 e7c779b6bfaa9e4bf96977735c1f0ee5
BLAKE2b-256 f32a85bda813b6071177635ad2c43293cf86934b0c1ca870cf345a6a9a703176

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.221-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.221-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.10.12 Linux/6.5.0-1025-azure

File hashes

Hashes for json_file_split-0.0.221-py3-none-any.whl
Algorithm Hash digest
SHA256 32c02e0bdca9b14c7b829be7a19b1479462b40b10070066e3272e630fb0048fb
MD5 46a6da50e3c096d70f2f7b339cb26f96
BLAKE2b-256 dcd84a9314639ef26185092f310a7263bb3c5758da849ffb3fb5a72c49c2698f

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page