Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.113.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.113-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.113.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.113.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.3.2 CPython/3.10.6 Linux/5.15.0-1031-azure

File hashes

Hashes for json_file_split-0.0.113.tar.gz
Algorithm Hash digest
SHA256 f15b9a48f7c7dfeef0c5c91c1af261c507f5662763cde63728df91c95fda23ee
MD5 120dfe742ab4562e44ec3172ae48814b
BLAKE2b-256 62a203d5ee06f44986775db264e664fdc5ce59f36245b599d0669ea39c540f13

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.113-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.113-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.3.2 CPython/3.10.6 Linux/5.15.0-1031-azure

File hashes

Hashes for json_file_split-0.0.113-py3-none-any.whl
Algorithm Hash digest
SHA256 c61fc244bfe0754eb6e0c7697db127e00f290aec9707aadc7e9c1342f82df952
MD5 ddea8d93f52994af59d6faf61f86cc9c
BLAKE2b-256 171728605ea019d813584c92e941b9d10262791e1c780e302a0912cfdf24bab1

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page