The AI Agent Trust Gap: Bridging Risk to Reliability

https://is1-ssl.mzstatic.com/image/thumb/Podcasts211/v4/31/9a/aa/319aaaf4-a155-9f35-4383-74655a625ed5/mza_1227157986456528628.jpg/600x600bb.jpg

Chain of Thought

Conor Bronsdon

45 episodes

1 week ago

Host Conor Bronsdon explores artificial intelligence through conversations with the founders, engineers, and researchers building breakthrough AI systems. Each episode examines AI infrastructure, machine learning strategy, and emerging technologies, translating technical depth into insights for both builders and decision-makers. Whether you're developing AI applications, leading engineering teams, or making strategic business bets on the future of technology, Chain of Thought helps you identify the patterns that matter. New episodes monthly.

Technology

RSS

All content for Chain of Thought is the property of Conor Bronsdon and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.

Technology

https://d3t3ozftmdmh3i.cloudfront.net/staging/podcast_uploaded_nologo/42310277/42310277-1748630694291-4f161b64beb06.jpg

The AI Agent Trust Gap: Bridging Risk to Reliability | Elastic’s Philipp Krenn

Chain of Thought

44 minutes 11 seconds

4 months ago

The AI Agent Trust Gap: Bridging Risk to Reliability | Elastic’s Philipp Krenn

The age of ubiquitous AI agents is here, bringing immense potential - and unprecedented risk.

Hosts Conor Bronsdon and Vikram Chatterji open the episode by discussing the urgent need for building trust and reliability into next-generation AI agents. Vikram unveils Galileo's free AI reliability platform for agents, featuring Luna 2 SLMs for real-time guardrails and its Insights Engine for automatic failure mode analysis. This platform enables cost-effective, low-latency production evaluations, significantly transforming debugging. Achieving trustworthy AI agents demands rigorous testing, continuous feedback, and robust guardrailing—complex challenges requiring powerful solutions from partners like Elastic.

Conor welcomes Philipp Krenn, Director of Developer Relations at Elastic, to discuss their collaboration in ensuring AI agent reliability, including how Elastic leverages Galileo's platform for evaluation. Philipp details Elastic's evolution from a search powerhouse to a key AI enabler, transforming data access with Retrieval-Augmented Generation (RAG) and new interaction modes. He discusses Elastic's investment in SLMs for efficient re-ranking and embeddings, emphasizing robust evaluation and observability for production. This collaborative effort aims to equip developers to build reliable, high-performing AI systems for every enterprise.

Chapters:

00:00 Introduction

01:09 Galileo's AI Reliability Platform

01:43 Challenges in AI Agent Reliability

06:17 Insights Engine and Its Importance

11:00 Luna 2: Small Language Models

14:42 Custom Metrics and Agent Leaderboard

19:16 Galileo's Integrations and Partnerships

21:04 Philipp Krenn from Elastic

24:47 Optimizing LLM Responses

25:41 Galileo and Elastic: A Powerful Partnership

28:20 Challenges in AI Production and Trust