Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json-file-split-0.0.37.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.37-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json-file-split-0.0.37.tar.gz.

File metadata

  • Download URL: json-file-split-0.0.37.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.0 CPython/3.8.10 Linux/5.15.0-1019-azure

File hashes

Hashes for json-file-split-0.0.37.tar.gz
Algorithm Hash digest
SHA256 aa8fbcbe965bb07ca58f3b53798cb93e10b04a25dc32b007fe6fa7ec563532e5
MD5 e840a0c76fd693657f7ee822e0bb16bf
BLAKE2b-256 f57d7f239e026861e6fc349d3130eba20a5db82a7f4b7154b41aeba7dbc816a4

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.37-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.37-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.0 CPython/3.8.10 Linux/5.15.0-1019-azure

File hashes

Hashes for json_file_split-0.0.37-py3-none-any.whl
Algorithm Hash digest
SHA256 4938b3f836427bea796af71f958c4f04add17c75384f43c33f9072e7cc99417c
MD5 6d9596e67748c08078496484fb2a5cd0
BLAKE2b-256 3ce320c24f9d00747c38119eddfa814f1f03acb0e77d80bed093295b3a85c913

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page