Skip to main content

A neural network compiler for AI accelerators

Project description

nncase

GitHub repository Gitee repository GitHub release

nncase is a neural network compiler for AI accelerators.

nncase 是一个为 AI 加速器设计的神经网络编译器。

技术交流 QQ 群:790699378

Telegram: nncase community

Install from binaries

从二进制安装

Download prebuilt binaries from Release.

下载预编译的二进制文件 Release

Build from source

从源码编译

Build from source

Supported operators

支持的算子

K210/K510

K230

Resources

资源

K210


Architecture

架构

nncase arch

Features

  • Supports multiple inputs and outputs and multi-branch structure
  • Static memory allocation, no heap memory acquired
  • Operators fusion and optimizations
  • Support float and quantized uint8 inference
  • Support post quantization from float model with calibration dataset
  • Flat model with zero copy loading

功能

  • 支持多输入输出网络,支持多分支结构
  • 静态内存分配,不需要堆内存
  • 算子合并和优化
  • 支持 float 和量化 uint8 推理
  • 支持训练后量化,使用浮点模型和量化校准集
  • 平坦模型,支持零拷贝加载

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

nncase-2.8.1-cp310-cp310-win_amd64.whl (19.7 MB view hashes)

Uploaded CPython 3.10 Windows x86-64

nncase-2.8.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (30.6 MB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

nncase-2.8.1-cp310-cp310-macosx_10_15_x86_64.whl (25.4 MB view hashes)

Uploaded CPython 3.10 macOS 10.15+ x86-64

nncase-2.8.1-cp39-cp39-win_amd64.whl (19.7 MB view hashes)

Uploaded CPython 3.9 Windows x86-64

nncase-2.8.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (30.6 MB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

nncase-2.8.1-cp39-cp39-macosx_10_15_x86_64.whl (25.4 MB view hashes)

Uploaded CPython 3.9 macOS 10.15+ x86-64

nncase-2.8.1-cp38-cp38-win_amd64.whl (19.7 MB view hashes)

Uploaded CPython 3.8 Windows x86-64

nncase-2.8.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (30.6 MB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

nncase-2.8.1-cp38-cp38-macosx_10_15_x86_64.whl (25.4 MB view hashes)

Uploaded CPython 3.8 macOS 10.15+ x86-64

nncase-2.8.1-cp37-cp37m-win_amd64.whl (19.7 MB view hashes)

Uploaded CPython 3.7m Windows x86-64

nncase-2.8.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (30.6 MB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.17+ x86-64

nncase-2.8.1-cp37-cp37m-macosx_10_15_x86_64.whl (25.4 MB view hashes)

Uploaded CPython 3.7m macOS 10.15+ x86-64

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page