Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.122.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.122-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.122.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.122.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.3.2 CPython/3.10.6 Linux/5.15.0-1033-azure

File hashes

Hashes for json_file_split-0.0.122.tar.gz
Algorithm Hash digest
SHA256 2389a64484c27b93a62e9bfaec3d0c6f9ccb05b1697187c324ab482790d3bfc8
MD5 f8f9230901d2b56b103b9c4fa17e32c2
BLAKE2b-256 c3a6bfc9869cadc9a95ce34ab66ba454cc1c0fa659e1e55084ccb576c5dffe32

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.122-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.122-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.3.2 CPython/3.10.6 Linux/5.15.0-1033-azure

File hashes

Hashes for json_file_split-0.0.122-py3-none-any.whl
Algorithm Hash digest
SHA256 8ff6f911e9d851fafbe47a99fdebb8460f9337ed4bedae1a836c325be521bcdb
MD5 91afb61d1a74eb762667b2c5e4165eaf
BLAKE2b-256 f531f8bac8d17f336c138c57180a7557cf8a5cff1cb99d806daffbfadbb26199

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page