cformers

SoTA Transformers with C-backend for fast inference on your CPU.

These details have not been verified by PyPI

Project description

We identify three pillers to enable fast inference of SoTA AI models on your CPU:

Fast C/C++ LLM inference kernels for CPU.
Machine Learning Research & Exploration front - Compression through quantization, sparsification, training on more data, collecting data and training instruction & chat models.
Easy to use API for fast AI inference in dynamically typed language like Python.

This project aims to address the third using LLaMa.cpp and GGML.

These details have not been verified by PyPI

This version

0.0.4

Mar 31, 2023

0.0.3

Mar 31, 2023

0.0.2

Mar 31, 2023

0.0.1

Mar 31, 2023

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Uploaded Mar 31, 2023 Source

Uploaded Mar 31, 2023 Python 3

Details for the file cformers-0.0.4.tar.gz.

Hashes for cformers-0.0.4.tar.gz
Algorithm	Hash digest
SHA256	`ac93556304e4966ed08f0b64fa6a0a01a878eefe9284dd11e47bf16694dc4ba6`
MD5	`b4bea6f5cd76f9d8f12a17338b6ce39b`
BLAKE2b-256	`9c277505402180b2bd111ce2a3835cd9f2cc9466352c9cfaf5e0d6bd2279a9b6`

Details for the file cformers-0.0.4-py3-none-any.whl.

Hashes for cformers-0.0.4-py3-none-any.whl
Algorithm	Hash digest
SHA256	`f7c769d6a6b39fadcdc1833f5ca89ba005fd999165ab8ad3a8f61a17726902b9`
MD5	`ffc7030acdd3afa45a2eac9f68dc3d5f`
BLAKE2b-256	`eee6f9ede7542994a9b94d58a3b0cf106c7ccef788acfe1292b5607ca8e08cfb`