Proactive Agents for the Web with Devi Parikh - #756

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

内容由TWIML and Sam Charrington提供。所有播客内容（包括剧集、图形和播客描述）均由 TWIML and Sam Charrington 或其播客平台合作伙伴直接上传和提供。如果您认为有人在未经您许可的情况下使用您的受版权保护的作品，您可以按照此处概述的流程进行操作https://zh.player.fm/legal。

17d ago 56:04

MP3•单集首页

Today, we're joined by Devi Parikh, co-founder and co-CEO of Yutori, to discuss browser use models and a future where we interact with the web through proactive, autonomous agents. We explore the technical challenges of creating reliable web agents, the advantages of visually-grounded models that operate on screenshots rather than the browser’s more brittle document object model, or DOM, and why this counterintuitive choice has proven far more robust and generalizable for handling complex web interfaces. Devi also shares insights into Yutori’s training pipeline, which has evolved from supervised fine-tuning to include rejection sampling and reinforcement learning. Finally, we discuss how Yutori’s “Scouts” agents orchestrate multiple tools and sub-agents to handle complex queries, the importance of background, "ambient" operation for these systems, and what the path looks like from simple monitoring to full task automation on the web.

The complete show notes for this episode can be found at https://twimlai.com/go/756.

777集单集