Skip to main content

Efficient, Flexible and Portable Structured Generation

Project description

XGrammar

Documentation License

Efficient, Flexible and Portable Structured Generation

Get Started | Documentation | Blogpost | Technical Report

Overview

XGrammar is an open-source library for efficient, flexible, and portable structured generation. It supports general context-free grammar to enable a broad range of structures while bringing careful system optimizations to enable fast executions. XGrammar features a minimal and portable C++ backend that can be easily integrated into multiple environments and frameworks, and is co-designed with the LLM inference engine and enables zero-overhead structured generation in LLM inference.

Get Started

Please visit our documentation to get started with XGrammar.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

xgrammar-0.1.9-cp312-cp312-win_amd64.whl (278.8 kB view details)

Uploaded CPython 3.12 Windows x86-64

xgrammar-0.1.9-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (340.4 kB view details)

Uploaded CPython 3.12 manylinux: glibc 2.27+ x86-64 manylinux: glibc 2.28+ x86-64

xgrammar-0.1.9-cp311-cp311-win_amd64.whl (278.2 kB view details)

Uploaded CPython 3.11 Windows x86-64

xgrammar-0.1.9-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (340.8 kB view details)

Uploaded CPython 3.11 manylinux: glibc 2.27+ x86-64 manylinux: glibc 2.28+ x86-64

xgrammar-0.1.9-cp310-cp310-win_amd64.whl (276.7 kB view details)

Uploaded CPython 3.10 Windows x86-64

xgrammar-0.1.9-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (339.8 kB view details)

Uploaded CPython 3.10 manylinux: glibc 2.27+ x86-64 manylinux: glibc 2.28+ x86-64

xgrammar-0.1.9-cp39-cp39-win_amd64.whl (275.4 kB view details)

Uploaded CPython 3.9 Windows x86-64

xgrammar-0.1.9-cp39-cp39-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (340.0 kB view details)

Uploaded CPython 3.9 manylinux: glibc 2.27+ x86-64 manylinux: glibc 2.28+ x86-64

File details

Details for the file xgrammar-0.1.9-cp312-cp312-win_amd64.whl.

File metadata

  • Download URL: xgrammar-0.1.9-cp312-cp312-win_amd64.whl
  • Upload date:
  • Size: 278.8 kB
  • Tags: CPython 3.12, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for xgrammar-0.1.9-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 d3ba9ec2c18fbb94bdee36e66e026770e8f47398127b0192b36b9c80b6d2b868
MD5 a2928f55d067db4eaf8eadec292ba64e
BLAKE2b-256 82111166292a39a8bdb4ab1ff0e987a4e9b38e483f761ae07350f265a5ad050d

See more details on using hashes here.

Provenance

The following attestation bundles were made for xgrammar-0.1.9-cp312-cp312-win_amd64.whl:

Publisher: wheel_windows.yaml on mlc-ai/xgrammar

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file xgrammar-0.1.9-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for xgrammar-0.1.9-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 473a6dc30cba150faa2f1102f576deace98342a293ceb2757a7d5ddd240f6260
MD5 4d5caa09e777f4812fa1e63cb43ef80d
BLAKE2b-256 25934b667e4c5c14fa6f040d085a99affa1e6743dfa878e4734ed27737e36501

See more details on using hashes here.

Provenance

The following attestation bundles were made for xgrammar-0.1.9-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl:

Publisher: wheel_manylinux.yaml on mlc-ai/xgrammar

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file xgrammar-0.1.9-cp311-cp311-win_amd64.whl.

File metadata

  • Download URL: xgrammar-0.1.9-cp311-cp311-win_amd64.whl
  • Upload date:
  • Size: 278.2 kB
  • Tags: CPython 3.11, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for xgrammar-0.1.9-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 63893935796af60bdb5afd2b656baddbaf5dfa9d42a71fe347eda33b4584cb51
MD5 ec1f355034cafc60b9a37abe99c510e4
BLAKE2b-256 12ce205b53ecd07f1c351c7beb65bc2fa0bda6d0e39df30a5567b92b9e96bc2c

See more details on using hashes here.

Provenance

The following attestation bundles were made for xgrammar-0.1.9-cp311-cp311-win_amd64.whl:

Publisher: wheel_windows.yaml on mlc-ai/xgrammar

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file xgrammar-0.1.9-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for xgrammar-0.1.9-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 344f02ed0f550d7fcb3ea837f8369faf357c44051974c86b7363517412829700
MD5 eb3500eaaa7570409f3bee69526c2e61
BLAKE2b-256 59aa3bf6e104e72cfaf1e8404392ee7b9fdf47b8385a7c903fb8bafeecf8c6d4

See more details on using hashes here.

Provenance

The following attestation bundles were made for xgrammar-0.1.9-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl:

Publisher: wheel_manylinux.yaml on mlc-ai/xgrammar

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file xgrammar-0.1.9-cp310-cp310-win_amd64.whl.

File metadata

  • Download URL: xgrammar-0.1.9-cp310-cp310-win_amd64.whl
  • Upload date:
  • Size: 276.7 kB
  • Tags: CPython 3.10, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for xgrammar-0.1.9-cp310-cp310-win_amd64.whl
Algorithm Hash digest
SHA256 938493a26204d8d7900cd3805cea97c5a4e08c3b3c9b7bea5e53820280b41af8
MD5 725033028c39bc7489b74adf180721bf
BLAKE2b-256 044dafde6dd045785c72e6563e8d93e7a3bdd06fe9070fe619ab0fecc771a108

See more details on using hashes here.

Provenance

The following attestation bundles were made for xgrammar-0.1.9-cp310-cp310-win_amd64.whl:

Publisher: wheel_windows.yaml on mlc-ai/xgrammar

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file xgrammar-0.1.9-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for xgrammar-0.1.9-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 d8dd6955267b53604a8888db56166e1a1a62dc30082fb09ae97d0a680fd46527
MD5 2e0d220736a5a8e3386622ee5845a52a
BLAKE2b-256 3f082d2014988c71900a8ac7f76f2952cb4e68af97a56c415dcf2a1f5ff41e5b

See more details on using hashes here.

Provenance

The following attestation bundles were made for xgrammar-0.1.9-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl:

Publisher: wheel_manylinux.yaml on mlc-ai/xgrammar

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file xgrammar-0.1.9-cp39-cp39-win_amd64.whl.

File metadata

  • Download URL: xgrammar-0.1.9-cp39-cp39-win_amd64.whl
  • Upload date:
  • Size: 275.4 kB
  • Tags: CPython 3.9, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for xgrammar-0.1.9-cp39-cp39-win_amd64.whl
Algorithm Hash digest
SHA256 c1a7fd1bce1edd6e2727ab426e11878b0f9ff117dae8c02ea03835c5138d943a
MD5 95825df588697886762a85bb7fb54512
BLAKE2b-256 b88086e43c7b101f64888da4e7c6285b8d73cc2a9234907fc11f746350e7cc3b

See more details on using hashes here.

Provenance

The following attestation bundles were made for xgrammar-0.1.9-cp39-cp39-win_amd64.whl:

Publisher: wheel_windows.yaml on mlc-ai/xgrammar

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file xgrammar-0.1.9-cp39-cp39-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for xgrammar-0.1.9-cp39-cp39-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 4e99200b16462d71850b41cf77b5dff0157e1c7615737d20ddc6b1e001085f2a
MD5 205d038448abe00461451692da0941d3
BLAKE2b-256 1431520d718e429f96d5aca8c8035a9301046e45a3f33692097b135b6122cc99

See more details on using hashes here.

Provenance

The following attestation bundles were made for xgrammar-0.1.9-cp39-cp39-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl:

Publisher: wheel_manylinux.yaml on mlc-ai/xgrammar

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page