Production-Grade AI Systems with Fred Roma
Engineering teams around the world are building AI-focused applications or integrating AI features into existing products. The AI development ecosystem is maturing, which is accelerating how quickly these applications can be prototyped. However, taking AI applications to production remains a notoriously complex process. Modern AI stacks demand LLMs, embeddings, vector search, observability, new caching layers,
The post Production-Grade AI Systems with Fred Roma appeared first on Software Engineering Daily.
---
Production-Grade AI Systems with Fred Roma
[Image: SEDaily]
By SEDaily
Podcast
Tuesday, January 27 2026
Podcast: Play in new window | Download
Subscribe: RSS
Engineering teams around the world are building AI-focused applications or integrating AI features into existing products. The AI development ecosystem is maturing, which is accelerating how quickly these applications can be prototyped. However, taking AI applications to production remains a notoriously complex process. Modern AI stacks demand LLMs, embeddings, vector search, observability, new caching layers, and constant adaptation as the landscape shifts week to week. Increasingly, the data layer has become both the foundation and the bottleneck to AI app productionization.
MongoDB has been expanding beyond its core document database into a full AI-ready database platform with integrated capabilities for operational data, search, real-time analytics, and AI-powered data retrieval. The company also recently acquired Voyage AI to provide accurate and cost-effective embedding models and rerankers to its users.
Fred Roma is a veteran engineer and is currently the SVP of Product and Engineering at MongoDB. He joins the show with Kevin Ball to talk about the state of AI application development, the role of vector search and reranking, schema evolution in the LLM era, the Voyage AI acquisition, how data platforms must evolve to keep up with AI’s breakneck pace, and more.
Kevin Ball or KBall, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He co-founded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI inaction discussion group through Latent Space.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
[Image: SEDaily]
SEDaily
POPULAR
- Amazon’s IDE for Spec-Driven Development with David Yanacek 67 views
- Gas Town, Beads, and the Rise of Agentic Development with Steve Yegge 43 views
- Inside China’s Great Firewall with Jackson Sippe 15 views
- Why We Switched from Python to Go 15 views
- Elegant Puzzle with Will Larson 13 views
#### Software Daily
[Image: Software Daily]
Subscribe to Software Daily, a curated newsletter featuring the best and newest from the software engineering community.
Exclusive Articles
VMware Tanzu GemFire and Next-Generation Real-Time Application Development
Uber’s LedgerStore and its Trillions of Indexes with Kaushik Devarajaiah
GraphQL vs. REST: What Are They, and Which Is Better for You?
Cloud Engineering
CodeRabbit and RAG for Code Review with Harjot Gill
Building Chess.com with Jay Severson
Mastodon with Eugen Rochko
Business and Philosophy
Startup Investing with George Mathew
KubeCon Special: Docker with Justin Cormack
Software Architecture with Josh Prismon
Greatest Hits
Hardening C++ with Bjarne Stroustrup
Surviving ChatGPT with Christian Hubicki
Special Episode with George Hotz
Hackers
Making React 70% faster with Aiden Bai of Million.js
Cross-functional Incident Management with Ashley Sawatsky and Niall Murphy
SDKs for your API with Sagar Batchu
Data
Hyperscaling SQL with Sam Lambert
Spring AI and Java in 2024
Iceberg at Netflix and Beyond with Ryan Blue
---
[Original source](https://softwareengineeringdaily.com/2026/01/27/production-grade-ai-systems-with-fred-roma/?utm_source=rss&utm_medium=rss&utm_campaign=production-grade-ai-systems-with-fred-roma)