Avatar for wangduyi from gravatar.com

wangduyi

Username    wangduyi
Date joined   Joined

6 projects

xfastertransformer-gnr

Last released

Boost large language model inference performance on CPU platform.

xfastertransformer-icx

Last released

Boost large language model inference performance on CPU platform.

xfastertransformer

Last released

Boost large language model inference performance on CPU platform.

vllm-xft

Last released

A high-throughput and memory-efficient inference and serving engine for LLMs

xfastertransformer-devel

Last released

Boost large language model inference performance on CPU platform.

xfastertransformer-devel-icx

Last released

Boost large language model inference performance on CPU platform.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page