Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json-file-split-0.0.72.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.72-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json-file-split-0.0.72.tar.gz.

File metadata

  • Download URL: json-file-split-0.0.72.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.1 CPython/3.8.10 Linux/5.15.0-1020-azure

File hashes

Hashes for json-file-split-0.0.72.tar.gz
Algorithm Hash digest
SHA256 b3dc83637bdf7883be0d2289042dad7382e5131fe14d6daeee81e72b3804b5a9
MD5 fe689ec3723579ec87d3a8e561d47974
BLAKE2b-256 e24b2a9ae5e3a7756ce864e5f9191ffb91021ff0d1aa51b2c2977f82cbca538b

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.72-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.72-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.1 CPython/3.8.10 Linux/5.15.0-1020-azure

File hashes

Hashes for json_file_split-0.0.72-py3-none-any.whl
Algorithm Hash digest
SHA256 4be5e34494c760d58e1802a9cb79738b0ead1d01715729b7d8a6b923ce11fa9e
MD5 d2f78ffcfbbd4ba14715ae85d5b50692
BLAKE2b-256 82e5a73a64ff48e4f00f7712e0ff2af3ff6dd009cc867fff7b6d00a446f63b93

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page