Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.212.tar.gz (3.6 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.212-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.212.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.212.tar.gz
  • Upload date:
  • Size: 3.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.7.0 CPython/3.10.12 Linux/6.2.0-1015-azure

File hashes

Hashes for json_file_split-0.0.212.tar.gz
Algorithm Hash digest
SHA256 0274d54487a04be7bc79fed89ecb0e88521cfd1725e12d17b9984b82d0429853
MD5 5813abb5a651a25e7a3bb60e3fad93bb
BLAKE2b-256 a62a80d521a559222a86a1e5383f1e0b7404efdb33d35f1e51b9445f17c94372

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.212-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.212-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.7.0 CPython/3.10.12 Linux/6.2.0-1015-azure

File hashes

Hashes for json_file_split-0.0.212-py3-none-any.whl
Algorithm Hash digest
SHA256 3d46505591f4a12530001ed63b13740cafe622359e08b72b14d5480b2229724f
MD5 80171def60e64571a9004c0b31d11d5b
BLAKE2b-256 c01c119cbe64f174942d686ad6c6f7516a8200c3fd946a115a43b796d1ea7181

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page