优秘智能 · 内容中心

inference ·

sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

原始来源:https://github.com/sgl-project/sglang