Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.143.tar.gz (3.6 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.143-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.143.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.143.tar.gz
  • Upload date:
  • Size: 3.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.4.2 CPython/3.10.6 Linux/5.15.0-1036-azure

File hashes

Hashes for json_file_split-0.0.143.tar.gz
Algorithm Hash digest
SHA256 79f5436abc457ec7f8c5177a5f703becb1e589c4e13cdeb12490c5c5540ea197
MD5 341427c05c637d051d44323b90b9934d
BLAKE2b-256 8d7e7eabc3e374c1589d2551ef8061a0095d63590bfb15437f62319140424d0d

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.143-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.143-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.4.2 CPython/3.10.6 Linux/5.15.0-1036-azure

File hashes

Hashes for json_file_split-0.0.143-py3-none-any.whl
Algorithm Hash digest
SHA256 f0bbf21dccbad165fc1144a13f248aef8c3b53f4cf2a778cfd1fcc81c21c3c66
MD5 3977489530ad0b66b814195324ae2da4
BLAKE2b-256 9accc7e3ca1fee110293f7830f0db66a99a8f743d8f3ac28b55adda0a1cd3244

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page