Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json-file-split-0.0.60.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.60-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json-file-split-0.0.60.tar.gz.

File metadata

  • Download URL: json-file-split-0.0.60.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.1 CPython/3.8.10 Linux/5.15.0-1020-azure

File hashes

Hashes for json-file-split-0.0.60.tar.gz
Algorithm Hash digest
SHA256 b600c706d63e41064dc78b295a1b1ee9712033bb8b7d734c7b677983621738cb
MD5 cd9e81b153304445ffdf99976281ef4b
BLAKE2b-256 1d73dc67215fe55580971a53e506b8b3de3a43aeb6575c6dd4f7b5f0f783b124

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.60-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.60-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.1 CPython/3.8.10 Linux/5.15.0-1020-azure

File hashes

Hashes for json_file_split-0.0.60-py3-none-any.whl
Algorithm Hash digest
SHA256 bce60816a88c3dec08811d617945da30987b55c378b53c92eabd54d58af0a170
MD5 942d3aeeb3bfa19cf75b113cf4db9cfc
BLAKE2b-256 443d8ac57d7516ab6fcad3d9cbef8e47527686f9b989c940bd115a6e57ac26e1

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page