LLM evaluation

Dynatrace Acquires Arize: The AI Observability Platform Bet

Dynatrace Acquires Arize: The AI Observability Platform Bet

Dynatrace has acquired Arize, an AI observability and LLM evaluation platform, to close the gap between pre-production AI testing and production monitoring. The deal positions Dynatrace as a full-lifecycle AI observability platform as agents proliferate across enterprise workloads. ECI Research data shows compliance friction and governance requirements make this consolidation especially valuable in regulated environments.

Dynatrace Acquires Arize: The AI Observability Platform Bet Read More »

AI A/B Testing: Why Nondeterminism Changes Everything

AI A/B Testing: Why Nondeterminism Changes Everything

Generative AI breaks the foundational assumptions of traditional A/B testing, but Pearl EVP Rob Ellison argues that nondeterminism creates new experimental surface area rather than eliminating experimentation. ECI Research analyst commentary examines the LLM-as-judge pattern, its real limitations, and what evaluation infrastructure should look like in a compliance-constrained environment.

AI A/B Testing: Why Nondeterminism Changes Everything Read More »