Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json-file-split-0.0.58.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.58-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json-file-split-0.0.58.tar.gz.

File metadata

  • Download URL: json-file-split-0.0.58.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.1 CPython/3.8.10 Linux/5.15.0-1019-azure

File hashes

Hashes for json-file-split-0.0.58.tar.gz
Algorithm Hash digest
SHA256 82c7f135569fe4711b9c24caca93ea0baa58de9480d79d92c116822f1d91f93d
MD5 fafec9f0d2e2ef2a0ce589cf182c1545
BLAKE2b-256 e94e71f527bd7b94989ce4dc7a650b1826e46b7d1f5e9901d5a2d6c1caed4b3a

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.58-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.58-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.1 CPython/3.8.10 Linux/5.15.0-1019-azure

File hashes

Hashes for json_file_split-0.0.58-py3-none-any.whl
Algorithm Hash digest
SHA256 e98823a4d44a1972fda03b85243cc4328f2439043c19cb842fa061994e314add
MD5 910f0365f2a46ac7ab34ab9b46a79b87
BLAKE2b-256 85cfd4000027dfc50b7e5a9587bc091a30f95f2a2d3e4e0c267c720bd4b1d602

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page