AI benchmarks

Gimlet Labs Joins MLCommons to Define Agentic Inference Benchmarks

Gimlet Labs Joins MLCommons to Define Agentic Inference Benchmarks

AI, Application Development, DevOps, Infrastructure /

Gimlet Labs has joined MLCommons to contribute to new benchmarks for agentic inference through the MLPerf working group. The move addresses a real measurement gap: existing benchmarks weren’t designed for multi-step, multi-model agentic workloads. For enterprise buyers, standardized agentic inference benchmarks are a precondition for credible infrastructure procurement decisions.

Gimlet Labs Joins MLCommons to Define Agentic Inference Benchmarks Read More »

NVIDIA Nemotron 3 Nano Omni Leads MediaPerf on Cost and Speed

NVIDIA Nemotron 3 Nano Omni Leads on Cost and Speed

AI, Application Development, Infrastructure, Open Source /

NVIDIA’s Nemotron 3 Nano Omni has posted the highest throughput and lowest inference cost on video tagging across all models benchmarked by MediaPerf v.2026.02, open and closed-source alike. The results carry direct implications for media organizations processing large video catalogs, where inference cost and speed are the primary deployment constraints. For technical leaders evaluating video AI infrastructure, this benchmark shifts the economics of open model deployment.

NVIDIA Nemotron 3 Nano Omni Leads on Cost and Speed Read More »

Cielara Code: AI Coding Agent Accuracy Beyond Claude & OpenAI

Cielara Code: AI Coding Agent Accuracy Beyond Claude & OpenAI

AI, Application Development, DevOps, Enterprise Software /

Causal Dynamics Lab has released Cielara Code, an AI coding agent layer that beats both Claude Code and OpenAI Codex on code localization benchmarks. The product addresses a fundamental navigation problem: agents spend more than 80% of their time searching for files rather than editing them. ECI Research analysts examine the competitive, economic, and governance implications for enterprise buyers.

Cielara Code: AI Coding Agent Accuracy Beyond Claude & OpenAI Read More »