llm-inference
7 个已发布仓库。
| 仓库 | |||||
|---|---|---|---|---|---|
| 1 |
ray-project/ray
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
|
44.3k | +0.0% | +0.1% | 12 |
| 2 |
gitleaks/gitleaks
Find secrets with Gitleaks 🔑
|
31.1k | +0.1% | +0.8% | 10 |
| 3 |
liguodongiot/llm-action
本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
|
25.3k | +0.0% | +0.1% | 20 |
| 4 |
FareedKhan-dev/kimi-k3-in-c
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
|
12.2k | +0.6% | +7.0% | 114 |
| 5 |
bojieli/ai-infra-book
《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
|
7.9k | +1.3% | +6.3% | 92 |
| 6 |
mw00/project-maya
Run GLM-5.3 (744B), GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard, OpenAI- and Anthropic-compatible API.
|
2.9k | +1.1% | +8.2% | 72 |
| 7 |
incoai/splash
A local inference engine for Apple silicon, built around the model.
|
2.3k | +1.1% | +7.1% | 39 |