Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.219.tar.gz (3.6 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.219-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.219.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.219.tar.gz
  • Upload date:
  • Size: 3.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.10.12 Linux/6.5.0-1025-azure

File hashes

Hashes for json_file_split-0.0.219.tar.gz
Algorithm Hash digest
SHA256 b2339295a659aac147942c06c84688069cb52d85719cd4d312f1ed38d8a45842
MD5 d7798799346892eee9471ab0c9554683
BLAKE2b-256 77a004a046411b55b5d88e31cbee1a82ca2b3327a95ebf1e936956fab5fea4d8

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.219-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.219-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.10.12 Linux/6.5.0-1025-azure

File hashes

Hashes for json_file_split-0.0.219-py3-none-any.whl
Algorithm Hash digest
SHA256 aaa972e11f7e69394ec10a4e00fe6ab78e3f4b36fe098ef298a797e512df7951
MD5 905038e11a4a0d63ec326cf1f1989069
BLAKE2b-256 4a7ad9e3045cbf6e346e3335e51b8be2326c46550e5fd8283fcbd7bc34c2b459

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page