Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.132.tar.gz (3.6 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.132-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.132.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.132.tar.gz
  • Upload date:
  • Size: 3.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.4.1 CPython/3.10.6 Linux/5.15.0-1034-azure

File hashes

Hashes for json_file_split-0.0.132.tar.gz
Algorithm Hash digest
SHA256 da5e64cc9bd6e5deab9ad8dfa1a5dbd559bfef7ba6c941d580060b88b9028e43
MD5 75c508969a6b7f588327452d6dff3613
BLAKE2b-256 c18bf0a78438a523418fb0a8056ce2697b53d0baff8c2f96ce2bcdc32efea091

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.132-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.132-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.4.1 CPython/3.10.6 Linux/5.15.0-1034-azure

File hashes

Hashes for json_file_split-0.0.132-py3-none-any.whl
Algorithm Hash digest
SHA256 62f117d5ff2c536417e2dcd84ccb02ce00a979cedeb790bde3dedb893787f2c8
MD5 eb0d0910780efd2efdbc9eac2afb1e45
BLAKE2b-256 ce6ef4a80c5c98e71ee51dcbf263f3c87ae236dd8f5ac589d59cbe96802bd2c0

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page