Big Ideas in App Architecture

Cockroach Labs

Cockroach Lab’s Big Ideas in App Architecture is a podcast for architects and engineers building modern data-intensive applications and systems. In every weekly episode, an innovator joins the show to share useful insights from their experiences building reliable, scalable, maintainable systems. Welcome to Big Ideas in App Architecture!

About PodLP

PodLP is the leading podcast app for feature phones. With 10M+ installs in nearly every country, PodLP is available for KaiOS on the KaiStore and JioStore, as well as Cloud Phone and Android. If you're interested in promoting "Big Ideas in App Architecture" on PodLP, contact sales@podlp.com.

Screenshots are mockup renders of PodLP for KaiOS. Actual design may vary based on platform, operating system, and app version.

Big Ideas in App Architecture

Episodes (67)

Today Why Inference Engineering Is the Next Big Role in AI with Philip Kiely
May 20th Distributed Systems, Linkerd, and the Cost of Network Calls with William Morgan from Buoyant
Apr 15th Making Software as Durable as Data with Peter Kraft from DBOS

Big Ideas in App Architecture

Jun 17, 2026
52 minutes
47 MB

Most teams moving AI into production quickly discover that generating an output is the easy part; running it reliably, efficiently, and at scale is a discipline of its own.In this episode, David talks with Philip Kiely, engineer at Baseten and author of Inference Engineering, a free guide to building and operating AI inference systems. Philip argues that every company will soon need a dedicated team to own inference, and draws on his work at Baseten to explain why it demands fluency across GPU optimization, distributed systems, model correctness, and developer experience all at once. He walks through how agentic wor...

Big Ideas in App Architecture

Why Inference Engineering Is the Next Big Role in AI with Philip Kiely

Cockroach Labs

00:00 -51:44