gitpulse

llm-inference

7 个已发布仓库。

仓库
1
ray-project/ray Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
44.3k +0.0%+0.1%+0.5% 12
2
gitleaks/gitleaks Find secrets with Gitleaks 🔑
31.1k +0.1%+0.8%+3.4% 10
3
liguodongiot/llm-action 本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
25.3k +0.0%+0.1%+0.4% 20
4
FareedKhan-dev/kimi-k3-in-c A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
12.2k +0.6%+7.0%+34.2% 114
5
bojieli/ai-infra-book 《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
7.9k +1.3%+6.3%+18.8% 92
6
mw00/project-maya Run GLM-5.3 (744B), GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard, OpenAI- and Anthropic-compatible API.
2.9k +1.1%+8.2%— 72
7
incoai/splash A local inference engine for Apple silicon, built around the model.
2.3k +1.1%+7.1%— 39