gitpulse

llm-inference

7 published repositories.

Repository
1
ray-project/ray Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
44.3k +0.0%+0.1%+0.6% 12
2
gitleaks/gitleaks Find secrets with Gitleaks 🔑
31k +0.1%+0.9%+3.8% 10
3
liguodongiot/llm-action 本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
25.3k +0.0%+0.1%+0.5% 20
4
FareedKhan-dev/kimi-k3-in-c A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
12.1k +0.6%+7.4%+34.0% 114
5
bojieli/ai-infra-book 《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
7.8k +2.1%+5.5%+20.3% 92
6
mw00/project-maya Run GLM-5.3 (744B), GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard, OpenAI- and Anthropic-compatible API.
2.9k +0.9%+9.1%— 73
7
incoai/splash A local inference engine for Apple silicon, built around the model.
2.3k +1.1%+7.3%— 40