3 projects
razors-edge-batching-scheduler
A DP-based dynamic batching scheduler for inference workloads
strongmock
StrongMock is a powerful mocking library for Python that leverages low-level ctypes functionality to provide extensive mocking capabilities. Some care may be needed while using this.
auto-function-serving
A python package to offload a function call to an http server automatically using a decorator.