Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json-file-split-0.0.43.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.43-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json-file-split-0.0.43.tar.gz.

File metadata

  • Download URL: json-file-split-0.0.43.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.0 CPython/3.8.10 Linux/5.15.0-1019-azure

File hashes

Hashes for json-file-split-0.0.43.tar.gz
Algorithm Hash digest
SHA256 5e5081175b9229c26688463fa71fd4ac4d4d6e8ad46698f2e9616a11f0bb56a9
MD5 c078c9ef2835dc23e9dcb386296a33b7
BLAKE2b-256 efe48f89e76ec701f5e0197898780bfacdf8eb25deda634ec9f4d5410fa909e6

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.43-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.43-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.0 CPython/3.8.10 Linux/5.15.0-1019-azure

File hashes

Hashes for json_file_split-0.0.43-py3-none-any.whl
Algorithm Hash digest
SHA256 04f4b7aaf91e5565f79c5c6b1623cb0da9cf3b016f87dca28148acf4abc6d51d
MD5 3e44ddff22209662a3afc44775de817f
BLAKE2b-256 741431dbc72413a85cb0e782c905fefe92620eb6cbfe42ebac46f55c0aab2299

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page