Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.227.tar.gz (3.6 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.227-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.227.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.227.tar.gz
  • Upload date:
  • Size: 3.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.12.3 Linux/6.8.0-1020-azure

File hashes

Hashes for json_file_split-0.0.227.tar.gz
Algorithm Hash digest
SHA256 d4e0ea257718cb7b2fb1eeae54bb488d3b38e2373786806483d451f920030aee
MD5 8f297e6a9ef642e5ba110306afff907f
BLAKE2b-256 f369d1a18807d8a293d8520844bfda02cd6050f73005743a47c3a9e9c9b5400b

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.227-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.227-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.12.3 Linux/6.8.0-1020-azure

File hashes

Hashes for json_file_split-0.0.227-py3-none-any.whl
Algorithm Hash digest
SHA256 ad7a14bae09e74420f8b564037eef58d88dbb8dbc8746e45eb1e5899a439e976
MD5 ef5579674cf5d9d213f33aee56341d54
BLAKE2b-256 26aa1d8e3135e02d8dc61f83e73c29c8b895e998ffea325c5747d22833e4a42e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page