Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.95.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.95-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.95.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.95.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.3.1 CPython/3.10.6 Linux/5.15.0-1024-azure

File hashes

Hashes for json_file_split-0.0.95.tar.gz
Algorithm Hash digest
SHA256 e82ed4235427d1aa4265e4d90b3c63ed95d774fd0c9454d0185a72f001a13e6e
MD5 70045179f126c7d24b27d76b4fd64c13
BLAKE2b-256 977a0aa81a1c50d7e4dd5be5cfdedae8da0f3101c4610b28a48454ff43a8eb3e

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.95-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.95-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.3.1 CPython/3.10.6 Linux/5.15.0-1024-azure

File hashes

Hashes for json_file_split-0.0.95-py3-none-any.whl
Algorithm Hash digest
SHA256 85b483a3965884952c9a745c26d2e670a0009e979a955b75ef151553b5e99dd2
MD5 a3c3255cfd5b95a2af984958977b8f05
BLAKE2b-256 de086aaff5d704bef4f0f13e1516832aaacbdfb047b1ef648cfb79aee67e3630

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page