Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.91.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.91-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.91.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.91.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.10.6 Linux/5.15.0-1024-azure

File hashes

Hashes for json_file_split-0.0.91.tar.gz
Algorithm Hash digest
SHA256 06077de86e0d6a70c626673dcf22ec03102de37560de717a80377d2ba19b60e4
MD5 32ed8df2a2ac93fbf70ff27c6b6d5d1e
BLAKE2b-256 6f1e84882271eec6299c5a8facd6449c8eb7522b863615632cadbccf72ca9148

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.91-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.91-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.10.6 Linux/5.15.0-1024-azure

File hashes

Hashes for json_file_split-0.0.91-py3-none-any.whl
Algorithm Hash digest
SHA256 ca2b6ed54b13e55c11ee40f01a5c7b0bbfb0e0f2ff1c97d80e212c940f983896
MD5 f8c1003b31fb60622e9c0790219b39c4
BLAKE2b-256 f7efef69be3fea6377aa0d32d14a4658c8f214c251341d047c7ec0a35b83ad73

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page