vLLM plugin for Spyre hardware support
Project description
SenDNN Inference
| Documentation | Users Forum | #sig-spyre |
IBM Spyre is the first production-grade Artificial Intelligence Unit (AIU) accelerator born out of the IBM Research AIU family, and is part of a long-term strategy of developing novel architectures and full-stack technology solutions for the emerging space of generative AI. Spyre builds on the foundation of IBM's internal AIU research and delivers a scalable, efficient architecture for accelerating AI in enterprise environments.
SenDNN Inference (sendnn-inference) is a vLLM plugin that enables seamless integration of IBM Spyre Accelerator with vLLM. It follows the architecture described in vLLM's Plugin System, making it easy to integrate IBM's advanced AI acceleration into existing vLLM workflows.
For more information, check out the following:
- 📚 Meet the IBM Artificial Intelligence Unit
- 📽️ AI Accelerators: Transforming Scalability & Model Efficiency
- 🚀 Spyre Accelerator for IBM Z
- 🚀 Spyre Accelerator for IBM POWER
Getting Started
Visit our documentation:
Contributing
We welcome and value any contributions and collaborations. Please check out Contributing to SenDNN Inference for how to get involved.
Contact
You can reach out for discussion or support in the #sig-spyre channel in the vLLM Slack workspace or by opening an issue.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file sendnn_inference-2.0.0.tar.gz.
File metadata
- Download URL: sendnn_inference-2.0.0.tar.gz
- Upload date:
- Size: 1.1 MB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
eec959e478405c7da4caf6cbf34bde33f05ba4805ac169e13c193fa4690950aa
|
|
| MD5 |
938d6a6361cbbe1a3240ee9878c46591
|
|
| BLAKE2b-256 |
5f310b569555813f7845f069d5549746b81bdd92b087f1e466083ee132beda48
|
Provenance
The following attestation bundles were made for sendnn_inference-2.0.0.tar.gz:
Publisher:
build_and_publish.yaml on torch-spyre/sendnn-inference
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
sendnn_inference-2.0.0.tar.gz -
Subject digest:
eec959e478405c7da4caf6cbf34bde33f05ba4805ac169e13c193fa4690950aa - Sigstore transparency entry: 1402914307
- Sigstore integration time:
-
Permalink:
torch-spyre/sendnn-inference@5ede22854839df4c47ef61df8a092feb55a78010 -
Branch / Tag:
refs/tags/v2.0.0 - Owner: https://github.com/torch-spyre
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
build_and_publish.yaml@5ede22854839df4c47ef61df8a092feb55a78010 -
Trigger Event:
release
-
Statement type:
File details
Details for the file sendnn_inference-2.0.0-py3-none-any.whl.
File metadata
- Download URL: sendnn_inference-2.0.0-py3-none-any.whl
- Upload date:
- Size: 109.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c7ee7af26bf1a1f0acd63b6b8c473efd14bd82031c4ff9026badb33a184564dd
|
|
| MD5 |
e9bfa9355a96e96e049bfc6e7e3260f4
|
|
| BLAKE2b-256 |
d4de8e8509244b3cc4b366a1bcd0773da8ff9e3d346a2260f2c04671cdc299d3
|
Provenance
The following attestation bundles were made for sendnn_inference-2.0.0-py3-none-any.whl:
Publisher:
build_and_publish.yaml on torch-spyre/sendnn-inference
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
sendnn_inference-2.0.0-py3-none-any.whl -
Subject digest:
c7ee7af26bf1a1f0acd63b6b8c473efd14bd82031c4ff9026badb33a184564dd - Sigstore transparency entry: 1402914407
- Sigstore integration time:
-
Permalink:
torch-spyre/sendnn-inference@5ede22854839df4c47ef61df8a092feb55a78010 -
Branch / Tag:
refs/tags/v2.0.0 - Owner: https://github.com/torch-spyre
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
build_and_publish.yaml@5ede22854839df4c47ef61df8a092feb55a78010 -
Trigger Event:
release
-
Statement type:
