Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

BCC - Tools for BPF-based Linux IO analysis, networking, monitoring, and more

LLM inference in C/C++

Incredibly fast JavaScript runtime, bundler, test runner, and package manager – all in one

A high-throughput and memory-efficient inference and serving engine for LLMs

LLM inference in C/C++

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

The token-efficient agentic coding workbench. Built for a future where every token counts — it optimizes token usage at the agent-loop level, saving 70%+ on long sessions, while planning, rememberi…