Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.180.tar.gz (3.6 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.180-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.180.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.180.tar.gz
  • Upload date:
  • Size: 3.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.6.1 CPython/3.10.12 Linux/5.15.0-1041-azure

File hashes

Hashes for json_file_split-0.0.180.tar.gz
Algorithm Hash digest
SHA256 be5b5b6e9a807f5fec5bdcb995975c3d269e03fad0fc6c8decd39cb86958023b
MD5 e315858920a4aa05222f00b2d5c46633
BLAKE2b-256 50456ed02a064e0f7d895afaff17d947b83d93395a700b7a5bfce91e40e6a1b9

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.180-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.180-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.6.1 CPython/3.10.12 Linux/5.15.0-1041-azure

File hashes

Hashes for json_file_split-0.0.180-py3-none-any.whl
Algorithm Hash digest
SHA256 3cce1ea132fb1e9195a9319cd628866bba6a5ca2c4f3ab4a1f3ce5e933b318e1
MD5 65b53479205e1a1e28ab851e677139f8
BLAKE2b-256 ee37fd501daf7cc234ec92bbdd58f003fc5092f469bd4690c7481912c427bae4

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page