JustVugg/colibri
A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own.
星标动能
今日+272 (+0.5%)
本周+2,243 (+4.6%)
本月+9,034 (+21.3%)