Architecting Reliable Agentic AI | Cisco’s Giovanna Carofiglio on the AGNTCY Collective

https://is1-ssl.mzstatic.com/image/thumb/Podcasts211/v4/31/9a/aa/319aaaf4-a155-9f35-4383-74655a625ed5/mza_1227157986456528628.jpg/600x600bb.jpg

Chain of Thought

Conor Bronsdon

45 episodes

1 week ago

Host Conor Bronsdon explores artificial intelligence through conversations with the founders, engineers, and researchers building breakthrough AI systems. Each episode examines AI infrastructure, machine learning strategy, and emerging technologies, translating technical depth into insights for both builders and decision-makers. Whether you're developing AI applications, leading engineering teams, or making strategic business bets on the future of technology, Chain of Thought helps you identify the patterns that matter. New episodes monthly.

Technology

RSS

All content for Chain of Thought is the property of Conor Bronsdon and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.

Technology

https://d3t3ozftmdmh3i.cloudfront.net/staging/podcast_uploaded_nologo/42310277/42310277-1748630694291-4f161b64beb06.jpg

Architecting Reliable Agentic AI | Cisco’s Giovanna Carofiglio on the AGNTCY Collective

Chain of Thought

41 minutes 2 seconds

4 months ago

Architecting Reliable Agentic AI | Cisco’s Giovanna Carofiglio on the AGNTCY Collective

The Internet of Agents is rapidly taking shape, necessitating innovative foundational standards, protocols, and evaluation methods for its success.

Recorded at Cisco's office in San Jose, we welcome Giovanna Carofiglio, Distinguished Engineer and Senior Director at Outshift by Cisco. As a leader of the AGNTCY Collective (an open-source initiative by Cisco, Galileo, LangChain, and many other participating companies), Giovanna outlines the vision for agents to collaborate seamlessly across the enterprise and the internet. She details the collective's pillars, from agent discovery and deployment using new agentic protocols like Slim, to ensuring a secure, low-latency communication transport layer. This groundbreaking work aims to make distributed agentic communication a reality.

The conversation then explores the critical role of observability and evaluation in building trustworthy agent applications, including defining an interoperable standard schema for communications. Giovanna highlights the complex challenges of scaling agents to thousands or millions, emphasizing the need for robust security (agent identity with OSF schema) and predictable agent behavior through extensive testing and characterization. She distinguishes between protocols like MCP (agent-to-tool) and A2A (agent-to-agent), advocating for open standards and underlying transport layers akin to TCP.

Chapters:

00:00 Introduction

01:00 Overview of Agent Interoperability

02:20 What is AGNTCY

03:45 Agent Discovery and Composition

04:38 Agent Protocols and Communication

05:45 Observability and Evaluation

07:00 Metrics and Standards for Agents

09:45 Challenges in Agent Evaluation

14:15 Low Latency and Active Evaluation

23:34 Synthetic Data and Ground Truth

25:07 Interoperable Agent Schema