Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.85.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.85-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.85.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.85.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.8.10 Linux/5.15.0-1022-azure

File hashes

Hashes for json_file_split-0.0.85.tar.gz
Algorithm Hash digest
SHA256 79c02e73b824775c575b8797d9a95fec8cb927c5e999686d18caf91f515460ba
MD5 46c2dfcf96cb7e0740b890f3f8bc0739
BLAKE2b-256 c31ccba134df4702922e90638ba6955ad145b39b83b1623ebca6156bfd2acbca

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.85-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.85-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.8.10 Linux/5.15.0-1022-azure

File hashes

Hashes for json_file_split-0.0.85-py3-none-any.whl
Algorithm Hash digest
SHA256 9b02da5ec5cffbc6d3aca0990816749678c0ba3add6f981d2d1903400366f699
MD5 c5e4b0a58fbfcc0b81a0d90d2191e4e5
BLAKE2b-256 c075239a3d7b9c2cf4ddca74d38430511fded0af86001824d4b36076ff453353

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page