Avatar for Nathan Tam from gravatar.com

Nathan Tam

Username    nathan1295
Date joined   Joined

2 projects

mlx-textgen

Last released

An OpenAI-compatible API LLM engine with smart prompt caching, batch processing, structured output with guided decoding, and function calling for all models using MLX.

llmflex

Last released

A python package for developing AI applications with local LLMs.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page