Scaling AI Infrastructure at Open Source Summit Day 2

Scaling AI Infrastructure at Open Source Summit Day 2

Summary

Day 2 of the 2025 Open Source Summit spotlighted the critical intersection of open source with three global imperatives: environmental and climate justice, AI infrastructure evolution, and internet security. Keynote speakers shared real-world examples, from environmental data preservation and AI workload orchestration to global HTTPS adoption efforts led by Let’s Encrypt.

Analysis

The Expanding Role of Open Source in Societal Infrastructure

The application development landscape is experiencing a structural shift. We have found that  developers increasingly play a role in solving large-scale societal challenges, far beyond traditional software delivery. The keynote underscored this trend by highlighting how open source technologies enable community-driven climate monitoring, AI workload scaling, and global internet security.

For developers, this reflects a broader industry pattern: open systems and community governance models are now foundational for both technical scalability and social impact. This aligns with our findings, which emphasize the developer’s evolving role in driving ethical innovation and infrastructure modernization.

Developers as Infrastructure Stewards

Environmental and climate justice presentations, led by Shannon Dosmegen, illustrated how open data, open hardware, and open collaboration models enable communities to collect, govern, and act on environmental information. Tools like MapKnitter and open science hardware empower grassroots monitoring and advocacy.

Key developer implications:

  • Building and maintaining open infrastructure that’s resilient to political and institutional shifts.
  • Supporting community-driven governance models for data collection and control.
  • Designing for accessibility, ensuring open source tools work in resource-constrained or frontline environments.

This echoes theCUBE Research’s observation that developer communities must now consider sustainability, data sovereignty, and social equity as core design constraints.

Open Source Becomes the Default Stack

Robert Nishihara’s session on AI infrastructure offered a technical deep dive into how modern AI workloads have reshaped infrastructure layers, with open source playing a central role.

Key trends for developers:

  • The modern AI stack is evolving toward GPU-accelerated, multimodal, and agentic workloads.
  • Open source tools like PyTorch, Ray, and Kubernetes dominate across layers: training, distributed compute, and orchestration.
  • Enterprises like Uber, Pinterest, and Instacart leverage these tools to reduce costs, improve scalability, and accelerate time-to-insight, saving tens of millions in operational expenses.

Our research highlights this broader shift: open source frameworks and engines now underpin production-grade AI infrastructure, making open source fluency a non-negotiable skill set for application developers working with AI.

Internet Security: Trust Through Transparency and Automation

In the realm of internet security, Josh Haas from Let’s Encrypt showcased how open standards and open source software have driven HTTPS adoption to over 90% in the U.S., up from below 50% in 2015.

Developer takeaways:

  • Automation, enabled by open APIs and tooling, is essential for scalability in certificate management and infrastructure security.
  • The success of Let’s Encrypt shows the effectiveness of open, community-driven security infrastructure at internet scale.
  • As AI and IoT workloads continue to grow, developers must prioritize automated and open security models to maintain trust.

This supports industry observations, which emphasize the growing importance of developer-led security automation and open security frameworks in maintaining digital trust.

What Developers Should Expect

The Day 2 keynote at Open Source Summit emphasized that open source is no longer just a developer preference; it is now a societal infrastructure requirement. Moving forward, we expect that developers may play an even greater role in solving cross-domain challenges, ranging from environmental monitoring to AI orchestration and cybersecurity. Community governance, data ownership, and sustainability could become foundational design principles within developer toolchains. Additionally, open source fluency across AI, security, and data infrastructure may evolve into a baseline requirement for engineering teams operating in both enterprise and public sector environments.

Authors

  • Paul Nashawaty

    Paul Nashawaty, Practice Leader and Lead Principal Analyst, specializes in application modernization across build, release and operations. With a wealth of expertise in digital transformation initiatives spanning front-end and back-end systems, he also possesses comprehensive knowledge of the underlying infrastructure ecosystem crucial for supporting modernization endeavors. With over 25 years of experience, Paul has a proven track record in implementing effective go-to-market strategies, including the identification of new market channels, the growth and cultivation of partner ecosystems, and the successful execution of strategic plans resulting in positive business outcomes for his clients.

    View all posts
  • With over 15 years of hands-on experience in operations roles across legal, financial, and technology sectors, Sam Weston brings deep expertise in the systems that power modern enterprises such as ERP, CRM, HCM, CX, and beyond. Her career has spanned the full spectrum of enterprise applications, from optimizing business processes and managing platforms to leading digital transformation initiatives.

    Sam has transitioned her expertise into the analyst arena, focusing on enterprise applications and the evolving role they play in business productivity and transformation. She provides independent insights that bridge technology capabilities with business outcomes, helping organizations and vendors alike navigate a changing enterprise software landscape.

    View all posts