gitpulse

moe

8 published repositories.

Repository
1
vllm-project/vllm A high-throughput and memory-efficient inference and serving engine for LLMs
97k +0.0%+0.4%+3.4% 71
2
hiyouga/LlamaFactory Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
76k +0.0%+0.1%+0.8% 60
3
sgl-project/sglang SGLang is a high-performance serving framework for large language models and multimodal models.
38.9k +0.1%+0.8%+4.8% 37
4
FlashML-org/FreeToken FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
17.2k +0.2%+2.3%+18.8% 146
5
modelscope/ms-swift Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
16.1k +0.0%+0.3%+1.6% 13
6
NVIDIA/TensorRT-LLM TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
15.1k +0.0%+0.3%+1.8% 13
7
FareedKhan-dev/kimi-k3-in-c A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
12.1k +0.6%+7.4%+34.0% 114
8
mw00/project-maya Run GLM-5.3 (744B), GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard, OpenAI- and Anthropic-compatible API.
2.9k +0.9%+9.1%— 73