Versus Workspace – Side-by-Side Benchmarking
Supports dual-system, side-by-side benchmarking for instant comparison with real-time charts for GPU/CPU usage, throughput, latency, and telemetry metrics.
User Support Agent Upgrades
User support agent now supports chat-based project creation, management, and execution, as well as auto-generation of run analysis, performance summaries, and debugging insights.
Bring Your Own Endpoint (BYOE)
Support for users to bring their own custom inference endpoints into Metrum Insights, and benchmark them on varying concurrency levels, different input prompt and output response lengths, and accuracy evaluation datasets.
