Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.208.tar.gz (3.6 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.208-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.208.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.208.tar.gz
  • Upload date:
  • Size: 3.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.7.0 CPython/3.10.12 Linux/6.2.0-1015-azure

File hashes

Hashes for json_file_split-0.0.208.tar.gz
Algorithm Hash digest
SHA256 1a078c4753463cb9f84ce7877070ed2058e78a71bdf075c09fbd2c1cda0d9afc
MD5 b3ebeb9c1c05040b2e651d6339a0d14b
BLAKE2b-256 23bf6310f4a058e58ab23650c51aabf98f65fa2fafa46c1a4ee0c117e64d553d

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.208-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.208-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.7.0 CPython/3.10.12 Linux/6.2.0-1015-azure

File hashes

Hashes for json_file_split-0.0.208-py3-none-any.whl
Algorithm Hash digest
SHA256 64757b2bcf5cf6802d33ce30c1dbff9b8d260383076da32993523bf50b022d28
MD5 c1b91e4b1e7abdd3b0b97263f4cada34
BLAKE2b-256 201307a594c7c7f5f6fb45173c138e87f78552eadb0412df6db10e082bbabccc

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page