Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.100.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.100-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.100.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.100.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.3.1 CPython/3.10.6 Linux/5.15.0-1024-azure

File hashes

Hashes for json_file_split-0.0.100.tar.gz
Algorithm Hash digest
SHA256 b39259c68aba95b0ebd088e806378bbf24836f8d1189daee7861953831f4d1f9
MD5 20fd87eee53d5ea2aa40c9323c4c687b
BLAKE2b-256 e1fd1d58d60f605eafd0d88ea9d01aa646f6b0dbb9a4268721fd920eb46ed09d

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.100-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.100-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.3.1 CPython/3.10.6 Linux/5.15.0-1024-azure

File hashes

Hashes for json_file_split-0.0.100-py3-none-any.whl
Algorithm Hash digest
SHA256 d6e4571c57ffd79a8c113bf5244d34a8413e1dbaed2088b0f6c26d8172fa9e6c
MD5 2dfd5c176511c904ba932763d3e7bce6
BLAKE2b-256 c566e716bc2c214b2f22af46ad849758a97d59b595aa72f26d80b2275ff576b7

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page