Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.89.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.89-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.89.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.89.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.10.6 Linux/5.15.0-1024-azure

File hashes

Hashes for json_file_split-0.0.89.tar.gz
Algorithm Hash digest
SHA256 57f15ee68a37e3c5281a5d4d24bc727c998a16c51a0c9f2763291633655fec6f
MD5 e0d327a4dbc994dca640753bd52f29fa
BLAKE2b-256 f259f8cafa6532331d14825daf9ba1090bf871fe0cbb1486cd7a8b83da2b79bf

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.89-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.89-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.10.6 Linux/5.15.0-1024-azure

File hashes

Hashes for json_file_split-0.0.89-py3-none-any.whl
Algorithm Hash digest
SHA256 8672281eebc06f46712803d14f7f88e0d37eda45326de0702968e3efcc13cb3a
MD5 2d29fb1e42518b1d67fcc4cc70900528
BLAKE2b-256 e9e092848a665e022e0cdd963da11f1ebedc70de66333538027207a6ba404590

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page