Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json-file-split-0.0.38.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.38-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json-file-split-0.0.38.tar.gz.

File metadata

  • Download URL: json-file-split-0.0.38.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.0 CPython/3.8.10 Linux/5.15.0-1019-azure

File hashes

Hashes for json-file-split-0.0.38.tar.gz
Algorithm Hash digest
SHA256 fdbc7fe6adb3454fcedcfb8983597e8fed5b3290da0771bf31a32c91c56612db
MD5 5cd946b443a56a86294ad9b83339c802
BLAKE2b-256 2d6c13d370cf83279d6b443ce568ecd81e22556ac26bb50093d8f3d02cd6e1fc

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.38-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.38-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.0 CPython/3.8.10 Linux/5.15.0-1019-azure

File hashes

Hashes for json_file_split-0.0.38-py3-none-any.whl
Algorithm Hash digest
SHA256 d179c9d944c1418496ae51cecfed6c3480c785ed4b5250030a9613798eadcb99
MD5 a7d7259a5f47d2390354ae676182c486
BLAKE2b-256 6d074d89a006ea68c24060990f889e90b1df9c051a8463735f47e0618afa70a9

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page