Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.167.tar.gz (3.6 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.167-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.167.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.167.tar.gz
  • Upload date:
  • Size: 3.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.5.1 CPython/3.10.6 Linux/5.15.0-1041-azure

File hashes

Hashes for json_file_split-0.0.167.tar.gz
Algorithm Hash digest
SHA256 55ec06bf972c2fc161837f47ec0fc7cdf804c6319a3cdde48face3afd65fac18
MD5 357407142addf1d2bda850a0c1e92842
BLAKE2b-256 c145bc0ab39f5ffc676c5b3a5e8eca2fca025c3b17d14f4db5abe85ac5c92499

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.167-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.167-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.5.1 CPython/3.10.6 Linux/5.15.0-1041-azure

File hashes

Hashes for json_file_split-0.0.167-py3-none-any.whl
Algorithm Hash digest
SHA256 078a311e9bdb3fb4c3bcf3c59cca2ea83e4fc61345463e2c0e7cabf4b87171a5
MD5 ec602c50fc505e6c6b92f0ab92ff8b36
BLAKE2b-256 8ba583a86814d3bb864982798880f60ea5f988592855a8ae97e6070e3890c1f3

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page