Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.131.tar.gz (3.6 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.131-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.131.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.131.tar.gz
  • Upload date:
  • Size: 3.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.4.1 CPython/3.10.6 Linux/5.15.0-1034-azure

File hashes

Hashes for json_file_split-0.0.131.tar.gz
Algorithm Hash digest
SHA256 244caf9e3e14f9d7ababcba2774c2a657856cf954dc3e1734e2a3fc57eb5e186
MD5 3c5df94d645b466ad8573bf1d5adc9ea
BLAKE2b-256 badc625c0731fbd2e6b8a65fed3aa6399a6b79e2d483d7c199c869611e7282e3

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.131-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.131-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.4.1 CPython/3.10.6 Linux/5.15.0-1034-azure

File hashes

Hashes for json_file_split-0.0.131-py3-none-any.whl
Algorithm Hash digest
SHA256 1ec02590f083fd9c1c2b9720d6d6ce9c03d05b9e0d68c3fe04d0827f9cd9de69
MD5 2733c0724ae1d03fd7f5635eb253130e
BLAKE2b-256 8648181abff8d2ec77512e655ff4d2537b34c5e89ff15204ed5b2160ffadec2f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page