inference
13 个已发布仓库。
| 仓库 | |||||
|---|---|---|---|---|---|
| 1 |
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
|
97k | +0.0% | +0.4% | 71 |
| 2 |
ultralytics/yolov5
Ultralytics YOLOv5 in PyTorch for object detection, instance segmentation, classification, training, and export.
|
58.3k | +0.0% | +0.0% | 25 |
| 3 |
ggml-org/whisper.cpp
Port of OpenAI's Whisper model in C/C++
|
55.2k | +0.0% | +0.4% | 37 |
| 4 |
deepspeedai/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
|
43.3k | -0.0% | +0.0% | 17 |
| 5 |
hpcaitech/ColossalAI
Making large AI models cheaper, faster and more accessible
|
41.4k | -0.0% | -0.0% | 22 |
| 6 |
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
|
38.9k | +0.1% | +0.8% | 37 |
| 7 |
google-ai-edge/mediapipe
Cross-platform, customizable ML solutions for live and streaming media.
|
37.7k | +0.1% | +0.3% | 14 |
| 8 |
SYSTRAN/faster-whisper
Faster Whisper transcription with CTranslate2
|
26.8k | +0.1% | +0.7% | 19 |
| 9 |
Tencent/ncnn
ncnn is a high-performance neural network inference framework optimized for the mobile platform
|
24.1k | +0.0% | +0.1% | 7 |
| 10 |
stas00/ml-engineering
Machine Learning Engineering Open Book
|
19.7k | +0.0% | +0.2% | 9 |
| 11 |
FlashML-org/FreeToken
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
|
17.2k | +0.2% | +2.3% | 146 |
| 12 |
gvergnaud/ts-pattern
🎨 The exhaustive Pattern Matching library for TypeScript, with smart type inference.
|
15.2k | -0.0% | +0.0% | 6 |
| 13 |
FlashML-org/FreeVideo
Make videos on the computer you already own. FreeVideo runs MiniMax H3 in as little as 8 GB of VRAM and 16 GB of RAM, and adapts its acceleration path to your hardware.
|
3.1k | +0.9% | +9.6% | 49 |