Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.83.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.83-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.83.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.83.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.8.10 Linux/5.15.0-1022-azure

File hashes

Hashes for json_file_split-0.0.83.tar.gz
Algorithm Hash digest
SHA256 1075e5f17b84f1e8cfcc02c01d0af1057c0f9030902c411111794eafa2a61123
MD5 59755339edf625beeadfc76637c6dae4
BLAKE2b-256 9a496abb6ea61ebe67f8b3927fc60a2ee243aef61842d1050555454afcbcbcac

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.83-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.83-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.8.10 Linux/5.15.0-1022-azure

File hashes

Hashes for json_file_split-0.0.83-py3-none-any.whl
Algorithm Hash digest
SHA256 f7279e266bcd527246caaa3ecc1b91ae4c6e8d041be485e906d0d23b6819d031
MD5 bd471f28d1b522d9507ec7a57bdbb780
BLAKE2b-256 7ebbc735df10a272388c777cebd3da5e6e72da030c97f0174be4fb0e2919324e

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page