Bringing Gemini and Google Agentspace to You On-Premises

/ AI, Cloud, Google Cloud Next 2025, Infrastructure
Bringing Gemini and Google Agentspace to You On-Premises

The News

At Google Cloud Next 2025, Google announced that its Gemini AI models and Google Agentspace search capabilities will be available on Google Distributed Cloud (GDC), with a public preview starting in Q3 2025. This allows enterprises with strict data residency or regulatory requirements to leverage Google’s most powerful AI tools within their own infrastructure. Read the original article here.

Analysis:

The introduction of Gemini and Google Agentspace to GDC helps democratize access to advanced AI within controlled environments. According to McKinsey, AI adoption in secure sectors lags behind by 20-30% compared to cloud-native enterprises. Google’s approach allows those sectors to leapfrog legacy constraints, reduce technical friction, and move toward AI-driven transformation—on their terms.

AI at the Edge: Expanding Enterprise Access to Generative AI

As generative AI reshapes industries, enterprise developers face challenges in leveraging large language models (LLMs) due to data sovereignty, privacy, and security regulations. Google’s extension of Gemini and Agentspace to GDC enables secure, on-premises deployment of state-of-the-art multimodal models, eliminating the trade-off between data locality and innovation. This reflects a growing trend: industry analysts project over 65% of enterprise infrastructure will be outside centralized data centers by 2026, with distributed AI playing a critical role.

Lowering the Barrier for On-Premises AI Adoption

Partnering with NVIDIA and leveraging Blackwell systems, Google removes the operational complexity of setting up and managing high-performance AI workloads locally. Developers can access Gemini via API with support for multimodal inputs and one million-token contexts—without managing OS or model lifecycle overhead. Built-in integrations like RAG, OCR, speech-to-text, and pre-trained APIs accelerate application development across industries from finance to public safety.

From Search to Specialized Agents: Unlocking Enterprise Knowledge

With Google Agentspace available on-prem, organizations gain a unified, secure, and permission-aware search layer across legacy and modern enterprise systems. Combined with Vertex AI and AlloyDB vector search, this allows organizations to create company-branded search agents, transform siloed knowledge into accessible answers, and deploy domain-specific agents—without requiring AI expertise. This addresses a key pain point: industry experts estimate over 70% of enterprise data remains untapped due to fragmented repositories.

AI Governance and Sovereignty

GDC’s support for air-gapped environments and compliance with government-grade security standards positions it for use in regulated industries and national security applications. Google’s inclusion of governance tools like Apigee, Agentspace ACL enforcement, and integrations with Vertex AI ensures that enterprises retain full control over their AI applications—critical for sectors like healthcare, finance, and government.

Looking Ahead:

As enterprises increasingly look to deploy AI at the edge or within sovereign boundaries, hybrid and on-prem AI infrastructure is becoming a key strategic investment. Industry experts predict that by 2027, 40% of AI model training and inference will occur outside public cloud environments.

Google’s move to make Gemini and Agentspace available via GDC meets this demand head-on, offering organizations a powerful and flexible path to deploy multimodal AI securely and at scale. As competition intensifies in the on-prem AI space—alongside offerings from Microsoft Azure Stack and AWS Outposts—Google’s focus on developer experience, extensibility, and turnkey infrastructure may become a key differentiator.

Author

  • Paul Nashawaty, Practice Leader and Lead Principal Analyst, specializes in application modernization across build, release and operations. With a wealth of expertise in digital transformation initiatives spanning front-end and back-end systems, he also possesses comprehensive knowledge of the underlying infrastructure ecosystem crucial for supporting modernization endeavors. With over 25 years of experience, Paul has a proven track record in implementing effective go-to-market strategies, including the identification of new market channels, the growth and cultivation of partner ecosystems, and the successful execution of strategic plans resulting in positive business outcomes for his clients.

    View all posts