Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.96.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.96-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.96.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.96.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.3.1 CPython/3.10.6 Linux/5.15.0-1024-azure

File hashes

Hashes for json_file_split-0.0.96.tar.gz
Algorithm Hash digest
SHA256 bc3442fe4497addc2ccc23027e448f54ef908726504e7b45d5c6c0d7e0199c26
MD5 650ca5f9a22b5f0a7c7faf1e0f641f43
BLAKE2b-256 02f04699a482399ae61fc7ef9d1de2906f111a95ae39b8f2fcd3e8e1ee612e1a

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.96-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.96-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.3.1 CPython/3.10.6 Linux/5.15.0-1024-azure

File hashes

Hashes for json_file_split-0.0.96-py3-none-any.whl
Algorithm Hash digest
SHA256 6223c6a802a00843545ef2f16fdeae769cef97cca959bf8d9b9e55b8806c2120
MD5 401a37116530c0826be4cbd9cb1851f5
BLAKE2b-256 d9cf59c15be8148b1274cde70575e9e86c2027f2a1b219637378da6b25c48968

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page