AI Inference

NVIDIA Confidential Computing Powers Apple's Private Cloud AI

NVIDIA Confidential Computing Powers Apple’s Private Cloud AI

Apple has deployed NVIDIA Confidential Computing GPUs on Google Cloud to power inference for its Foundation Models, validating privacy-preserving AI infrastructure at hyperscale. The move directly addresses the security concerns blocking enterprise AI adoption. ITDMs and security architects should treat this as a reference architecture, not a consumer story.

NVIDIA Confidential Computing Powers Apple’s Private Cloud AI Read More »

Ainekko's Open Edge AI Silicon Joins OpenHW Foundation

Ainekko’s Open Edge AI Silicon Joins OpenHW Foundation

Ainekko has donated its CORE-ET Silicon Platform to the OpenHW Foundation, placing open RISC-V AI inference hardware under neutral governance. The move signals a broader shift toward open silicon for edge AI deployments. ECI Research examines what this means for enterprise buyers and developers building the next generation of embedded AI systems.

Ainekko’s Open Edge AI Silicon Joins OpenHW Foundation Read More »

Mirantis & Saturn Cloud: Full-Stack AI Infrastructure Governance

Mirantis & Saturn Cloud: Full-Stack AI Infrastructure Governance

Mirantis has announced a full-stack AI platform partnership with Saturn Cloud and new k0rdent AI capabilities for model governance and inference routing. Together, these moves position Mirantis as an operational layer between raw GPU hardware and production AI. The announcements arrive one week after the IREN acquisition disclosure and build on Mirantis’s status as a founding NVIDIA AI Cloud Ready ISV partner.

Mirantis & Saturn Cloud: Full-Stack AI Infrastructure Governance Read More »

MinIO MemKV: Purpose-Built AI Inference Cache Storage

MinIO MemKV: Purpose-Built AI Inference Cache Storage

MinIO has launched MemKV, a purpose-built KV cache storage product targeting NVIDIA’s G3.5 memory tier via NVMe/RDMA. The product promises a 75x improvement in inference time-to-first-token and up to $2M in annual GPU efficiency savings for a typical enterprise deployment. ECI Research examines the business case, technical architecture, and what buyers need to validate before committing.

MinIO MemKV: Purpose-Built AI Inference Cache Storage Read More »

VCF 9.1: Broadcom Bets on Private AI Infrastructure

VCF 9.1: Broadcom Bets on Private AI Infrastructure

Broadcom has released VMware Cloud Foundation 9.1, positioning private cloud as the preferred platform for production AI inference and agentic workloads. The release combines significant cost reduction claims with zero-trust security integration and open hardware ecosystem support across AMD, Intel, and NVIDIA. ECI Research examines what this means for ITDMs weighing private versus public cloud for AI infrastructure, and for developers building agentic applications at scale.

VCF 9.1: Broadcom Bets on Private AI Infrastructure Read More »