3 projects
ollamabench
A benchmark tool for consumer hardware for AI inference using llm models, with version and quantization detection.
fastapi-cached
A simple package to pre-compute and cache FastAPI endpoints with discrete parameters.
fastapi-simple-profiler
A dead simple FastAPI profiler with CSV export for Google Sheets.
