gitpulse

inference

13 个已发布仓库。

仓库
1
vllm-project/vllm A high-throughput and memory-efficient inference and serving engine for LLMs
97k +0.0%+0.4%+3.4% 71
2
ultralytics/yolov5 Ultralytics YOLOv5 in PyTorch for object detection, instance segmentation, classification, training, and export.
58.3k +0.0%+0.0%+0.2% 25
3
ggml-org/whisper.cpp Port of OpenAI's Whisper model in C/C++
55.2k +0.0%+0.4%+1.6% 37
4
deepspeedai/DeepSpeed DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
43.3k -0.0%+0.0%+0.2% 17
5
hpcaitech/ColossalAI Making large AI models cheaper, faster and more accessible
41.4k -0.0%-0.0%-0.0% 22
6
sgl-project/sglang SGLang is a high-performance serving framework for large language models and multimodal models.
38.9k +0.1%+0.8%+4.8% 37
7
google-ai-edge/mediapipe Cross-platform, customizable ML solutions for live and streaming media.
37.7k +0.1%+0.3%+1.1% 14
8
SYSTRAN/faster-whisper Faster Whisper transcription with CTranslate2
26.8k +0.1%+0.7%+3.5% 19
9
Tencent/ncnn ncnn is a high-performance neural network inference framework optimized for the mobile platform
24.1k +0.0%+0.1%+0.4% 7
10
stas00/ml-engineering Machine Learning Engineering Open Book
19.7k +0.0%+0.2%+1.0% 9
11
FlashML-org/FreeToken FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
17.2k +0.2%+2.3%+18.8% 146
12
gvergnaud/ts-pattern 🎨 The exhaustive Pattern Matching library for TypeScript, with smart type inference.
15.2k -0.0%+0.0%+0.2% 6
13
FlashML-org/FreeVideo Make videos on the computer you already own. FreeVideo runs MiniMax H3 in as little as 8 GB of VRAM and 16 GB of RAM, and adapts its acceleration path to your hardware.
3.1k +0.9%+9.6%— 49