Skip to main content

NanoFlow v0.7: Sparse Streaming Inference Engine

Project description

An I/O-bound inference engine optimized for running massive models on consumer hardware via sparse tiling.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nanoflow_llm-0.7.0.tar.gz (9.9 kB view details)

Uploaded Source

File details

Details for the file nanoflow_llm-0.7.0.tar.gz.

File metadata

  • Download URL: nanoflow_llm-0.7.0.tar.gz
  • Upload date:
  • Size: 9.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.12

File hashes

Hashes for nanoflow_llm-0.7.0.tar.gz
Algorithm Hash digest
SHA256 26931147d7da250ef97f176527bf31f3c31f98cb4f313504394e79d7d0a4fbf9
MD5 76294110e0bdd06a16bc25a2ca73801d
BLAKE2b-256 e48bc1c608734b604b1cbe7a85b084bbe2b8768e006a9d04aa8600afb85f2e5a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page