Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.223.tar.gz (3.6 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.223-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.223.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.223.tar.gz
  • Upload date:
  • Size: 3.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.4 CPython/3.10.12 Linux/6.5.0-1025-azure

File hashes

Hashes for json_file_split-0.0.223.tar.gz
Algorithm Hash digest
SHA256 fba03c7adf2adc06c034b2af96afb578157f998cde77bd3480f1ba42db52b2db
MD5 f6d841aadaddc932c2d0fa1d7f266694
BLAKE2b-256 5a57d4a54ae54c4d17c5131e31605c455a331775cf7332f247d30bb73e6f19f3

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.223-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.223-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.4 CPython/3.10.12 Linux/6.5.0-1025-azure

File hashes

Hashes for json_file_split-0.0.223-py3-none-any.whl
Algorithm Hash digest
SHA256 c383703e6363886e391f28b5376435cd709a47fd20c19b70ff564497455d21ba
MD5 7de1063de6efb3c5884bcf25f647dd7d
BLAKE2b-256 fa12da9e97ea73b5eab84c12f6f3c7b2d27d3bf2fa54c0b230a8a536b02282c3

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page