June 17, 2026
Middleware v2.7.6 expands LLM observability with request details, a playground, evaluations, and GPU monitoring. The release also adds Amazon S3 telemetry routing, Kafka monitoring on Kubernetes, and OpsAI actions.
LLM Observability and GPU Monitoring#
- Request details: Inspect token usage, cost, model, spans, stack traces, chat input, and related logs when investigating an LLM request.

- Playground: Try models, output schemas, and tools with sample prompts to inspect responses.

- LLM-as-a-judge evaluations: Select an evaluator model, scope, rules, and acceptance criteria to assess response quality.

- GPU monitoring: Review host and device utilization, occupancy, memory, temperature, power, bandwidth, and processes to investigate resource bottlenecks.

- Dashboards: Added 50+ graphs covering tokens, cost, error rate, duration, LLM calls, evaluations, latency, and tool metrics.
Linux Setup and Cloud Integrations#
- Linux setup: Configure detected databases and integrations directly from the Linux Instrumentation screen.
- Kafka on Kubernetes: Added integration support for monitoring Kafka in Kubernetes environments.
- AWS RDS: Added support for eight additional regions, including regions in Asia.
Telemetry Routing to Amazon S3#
Route metrics, logs, and traces to your own Amazon S3 bucket. Configure your AWS account ID, bucket name, and region under Settings → S3 Routing.

Log Anomaly Investigation#
Inspect log anomalies such as count spikes, behavior drift, and inactive patterns. Open an anomaly to review log properties, related logs, and AI analysis when investigating changes in logging behavior.


OpsAI Investigation and Chat Actions#
- Kubernetes commands: Run commands directly from an investigation or chat.

- Dashboard creation: Describe a dashboard in chat and receive a link to the generated dashboard.
- Vercel issues: Investigate Vercel logs and fatal errors from the issue list and prepare pull requests for proposed fixes.
- Synthetic tests: Ask questions about synthetic tests or create new tests from New Chat.
Middleware MCP Access and Loading Performance#
- MCP access: Review and revoke third-party application access to Middleware data from the MCP Server access page.

- Loading performance: Improved APM, MongoDB, and OpsAI list and detail screens when working with large datasets.
Need assistance or want to learn more about Middleware? Get in touch with us via our Contact Us or join our Slack channel.
What did you think of this content?