Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.168.tar.gz (3.6 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.168-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.168.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.168.tar.gz
  • Upload date:
  • Size: 3.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.5.1 CPython/3.10.6 Linux/5.15.0-1041-azure

File hashes

Hashes for json_file_split-0.0.168.tar.gz
Algorithm Hash digest
SHA256 9437e07f200cefa8eb88e77109a47f74b2d2f1cc0cefc34f2a175bcff538ef8d
MD5 0b14c3c32a5d1c0b78a8c098de3c0008
BLAKE2b-256 61c412d90ff180f8cbfbd88953fc82161cd163f936c5460cbed62a2cb63923db

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.168-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.168-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.5.1 CPython/3.10.6 Linux/5.15.0-1041-azure

File hashes

Hashes for json_file_split-0.0.168-py3-none-any.whl
Algorithm Hash digest
SHA256 8fcf386e1f6d83454fd04d649fae7b357198a971e554ca09cfb5a887d83774f6
MD5 c36387ce9b0e86b5bb41cdce195018d5
BLAKE2b-256 8d1982ab1101be58d07d5a64077c5319fdca66094b0419b035dd908c31528955

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page