Lessons from Deploying AI at Enterprise Scale | ft ServiceTitan, Indeed & Twilio

Chain of Thought

This week, a panel of experts (Mehmet Murat Ezbiderli, ServiceTitan; Grant Ledford, Indeed; and Vinnie Giarrusso, Twilio) join Atin Sanyal (CTO, Galileo) and Conor Bronsdon (Developer Awareness, Galileo) to explore the challenges and opportunities of deploying GenAI at enterprise scale in a conversation that's a wake-up call for any business leader looking to harness the power of AI.

Together, Atin & Conor break down key considerations like performance, cost, and model selection, emphasizing the need for robust evaluation frameworks and a shift in developer mindset.

Atin then sits down with our panel of AI engineering experts to discuss their firsthand experiences with enterprise AI, including the trade-offs of building AI systems, the evolving tools and frameworks available, and the impact these technologies are having on their organizations.

Chapters:

01:27 Enterprise Scale Deployment

05:17 Cost, Performance, and Model Selection

08:59 Building and Integrating GenAI Systems

15:26 Emerging Enterprise Use Cases

18:12 Predictions for AI in 2025

27:28 Panel Discussion: Deploying AI at Enterprise Scale

31:19 Gen AI Solutions and Challenges

33:12 Building & Deploying Traditional Infrastructure vs GenAI Infrastructure

34:36 How to Assemble Your GenAI Stack

40:39 Today's Best GenAI Use Cases

48:15 Enterprise AI Trends for 2025

50:36 Closing Remarks and Future Outlook

Show Notes:

• ⁠⁠⁠⁠⁠Watch Productionize 2.0⁠⁠⁠⁠⁠
• ⁠⁠⁠⁠Check out Galileo⁠⁠⁠⁠⁠

• Follow⁠ ⁠⁠⁠ ⁠⁠⁠Atin Sanyal
• Follow⁠ ⁠⁠⁠ ⁠⁠⁠⁠Mehmet Murat Ezbiderli
• Follow ⁠Grant Ledford
• Follow Vinnie Giarrusso