moe
8 published repositories.
| Repository | |||||
|---|---|---|---|---|---|
| 1 |
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
|
97k | +0.0% | +0.4% | 71 |
| 2 |
hiyouga/LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
|
76k | +0.0% | +0.1% | 60 |
| 3 |
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
|
38.9k | +0.1% | +0.8% | 37 |
| 4 |
FlashML-org/FreeToken
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
|
17.2k | +0.2% | +2.3% | 146 |
| 5 |
modelscope/ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
|
16.1k | +0.0% | +0.3% | 13 |
| 6 |
NVIDIA/TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
|
15.1k | +0.0% | +0.3% | 13 |
| 7 |
FareedKhan-dev/kimi-k3-in-c
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
|
12.1k | +0.6% | +7.4% | 114 |
| 8 |
mw00/project-maya
Run GLM-5.3 (744B), GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard, OpenAI- and Anthropic-compatible API.
|
2.9k | +0.9% | +9.1% | 73 |