Skip to main content

Custom CUDA Kernels for BatchGen Project

Project description

MoE Gen Kernel

This project is MoE Gen Kernel, providing CUDA implementations for MoE Model.

Build Instructions

Make sure Python and required dependencies are installed. Then, run the following command in the project root directory:

bash build.sh 3.10 12.8

After building, a Python wheel file (.whl) will be generated for installation and distribution in the dist directory.

Upload to PyPI

To upload the generated wheel file to PyPI, use the following command:

twine upload dist/mgn_kernel-*.whl --repository-url https://test.pypi.org/legacy/

License

See the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file test_kernel_0ab602a9-0.1.3-cp39-abi3-manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for test_kernel_0ab602a9-0.1.3-cp39-abi3-manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 b72c110a76c04239eedf03f4fdc72dbee79d5b046c7c8c9ee1d1d660955f2c25
MD5 de65daac4003a2c2e257ef63ac5d5964
BLAKE2b-256 ddee3c17957a7aca1730dade5e922a3eebd9cd420645c4ba22db9c2b7b26a27a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page