Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

dolma-rust-components

Rust components for Dolma - a toolkit for pre-processing large language model training data.

This package contains the low-level Rust implementations that provide high-performance data processing capabilities for the Dolma toolkit.

Metadata

Release files for dolma-rust-components 1.3.0.dev0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dolma-rust-components 1.3.0.dev0
File Size Uploaded
dolma_rust_components-1.3.0.dev0.tar.gz 64.8 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for dolma-rust-components 1.3.0.dev0
File Interpreter ABI Platform
dolma_rust_components-1.3.0.dev0-cp312-cp312-macosx_11_0_arm64.whl CPython 3.12 CPython 3.12 macOS 11.0+ ARM64 Details

Total release size: 8.4 MB

Release files / dolma_rust_components-1.3.0.dev0.tar.gz

Download URL dolma_rust_components-1.3.0.dev0.tar.gz
Size 64.8 kB
Tags Source
SHA-256 checksum
How to use checksums
e671523492ecb9f81eb6920d8b7865d875d7f004a5a224cdab40c60959af7007
BLAKE2b-256 checksum
How to use checksums
414c270940af2d571946e0b0604e4c215372729986eccceb7f263fdef358bf1d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.9.4

Release files / dolma_rust_components-1.3.0.dev0-cp312-cp312-macosx_11_0_arm64.whl

Download URL dolma_rust_components-1.3.0.dev0-cp312-cp312-macosx_11_0_arm64.whl
Size 8.4 MB
Tags CPython 3.12 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
383aa976d130a8f9f66a4c750349a038b1215650bfe1db4a7cc63ae2c11470b0
BLAKE2b-256 checksum
How to use checksums
6657e636b3b24ee0cde368b6fe4e7629c2b8a81a734a5c5282514c98db6811fa
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.9.4

Release history Release notifications | RSS feed

This release

1.3.0.dev0 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page