gitpulse

llmops

9 published repositories.

Repository
1
BerriAI/litellm The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
63.3k +0.1%+0.6%+3.4% 52
2
langfuse/langfuse 🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.
37.4k +0.1%+0.8%+4.6% 29
3
ComposioHQ/composio Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.
31.1k +0.1%+0.3%+1.8% 31
4
mlflow/mlflow The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
28.8k +0.0%+0.3%+1.6% 9
5
promptfoo/promptfoo Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
27.2k +0.2%+1.0%+4.7% 21
6
liguodongiot/llm-action 本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
25.3k +0.0%+0.1%+0.5% 20
7
comet-ml/opik Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
23.4k +0.1%+0.7%+3.7% 18
8
dipakkr/awesome-ai-engineering 🚀 A curated collection of AI engineering resources, roadmaps, tools, and projects covering LLMs, RAG, AI Agents, MCP, fine-tuning, evaluations, and production AI systems.
22.6k +0.0%+0.1%+0.8% 8
9
vibrantlabsai/ragas Supercharge Your LLM Application Evaluations 🚀
16.3k +0.1%+0.4%+1.9% 13