Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.124.tar.gz (3.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

json_file_split-0.0.124-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.124.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.124.tar.gz
  • Upload date:
  • Size: 3.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.4.0 CPython/3.10.6 Linux/5.15.0-1033-azure

File hashes

Hashes for json_file_split-0.0.124.tar.gz
Algorithm Hash digest
SHA256 0f9847227abb3e48ec0bac49f77645c4d458173da506785ea73484e356aec0be
MD5 d834ecfa26a59cad70e1f380149b6755
BLAKE2b-256 53863ecc4dadb0b44abdb1e2a965df097763f2f838fff4a129d23e4468e57f74

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.124-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.124-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.4.0 CPython/3.10.6 Linux/5.15.0-1033-azure

File hashes

Hashes for json_file_split-0.0.124-py3-none-any.whl
Algorithm Hash digest
SHA256 13535a0212f01f1dc1f18c0edb64df5891b57cddbf10bc43de130397feaa61ba
MD5 a508877608ab30d9932618553b43e9a2
BLAKE2b-256 0c1daddb050492397cecf904ee1a231a6f71af0365147ef4a3463e2597ae0785

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page