Skip to main content

Split a json or jsonl file into equal chunks.

Project description

json-file-split

Split a json or jsonl file into different chunks.

Installation

pip install json-file-split

Usage

json-file-split \
--input_file_path ./tests/data/test.jsonl \
--save_to_dir /tmp/output/ \
--output_file_name test.jsonl \
--split_by number_of_buckets \
--batch_size 10

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

json_file_split-0.0.200.tar.gz (3.6 kB view details)

Uploaded Source

Built Distribution

json_file_split-0.0.200-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file json_file_split-0.0.200.tar.gz.

File metadata

  • Download URL: json_file_split-0.0.200.tar.gz
  • Upload date:
  • Size: 3.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.6.1 CPython/3.10.12 Linux/6.2.0-1012-azure

File hashes

Hashes for json_file_split-0.0.200.tar.gz
Algorithm Hash digest
SHA256 c44a2c6cf219aaf4e7feefa14b72a0392e6085eeb54721bf79e8925f4f97240e
MD5 8d3921757d70f48600d0e805d715bd93
BLAKE2b-256 1fbc7339cd343a1c24e94f53f5ace01c2cb940b57cdcff0719cf5bd89f896d22

See more details on using hashes here.

File details

Details for the file json_file_split-0.0.200-py3-none-any.whl.

File metadata

  • Download URL: json_file_split-0.0.200-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.6.1 CPython/3.10.12 Linux/6.2.0-1012-azure

File hashes

Hashes for json_file_split-0.0.200-py3-none-any.whl
Algorithm Hash digest
SHA256 296aa5623414ad04c0f455c933d28a2bb7449e47c89886e598b53d774eb6ea3a
MD5 41fa20dc0e38727acac6f573b6c17ebf
BLAKE2b-256 68241a4dfc82c12006ee59312400c530e73a2b9e63aa70977777b7c7fcbd56be

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page