4 projects
language-pipes
Peer-to-peer distributed inference for open-source language models
distributed-state-network
Peer-to-peer encrypted state-sharing network over HTTP
llm-layer-collector
Load and dispatch individual transformer layers from HuggingFace model checkpoints
ansinout
A dependency-free Python library for building Terminal User Interfaces.