llm-observability

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework

Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to monitoring.

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

Observal is an Observability and Evaluation platform for human-in-the-loop agents