Kate Park: Data Engines for Vision and Language

The Gradient: Perspectives on AI

内容由Daniel Bashir提供。所有播客内容（包括剧集、图形和播客描述）均由 Daniel Bashir 或其播客平台合作伙伴直接上传和提供。如果您认为有人在未经您许可的情况下使用您的受版权保护的作品，您可以按照此处概述的流程进行操作https://zh.player.fm/legal。

10M ago 41:34

MP3•单集首页

In episode 116 of The Gradient Podcast, Daniel Bashir speaks to Kate Park.

Kate is the Director of Product at Scale AI. Prior to joining Scale, Kate worked on Tesla Autopilot as the AI team’s first and lead product manager building the industry’s first data engine. She has also published research on spoken natural language processing and a travel memoir.

Have suggestions for future podcast guests (or other feedback)? Let us know here or reach us at editor@thegradient.pub

Subscribe to The Gradient Podcast: Apple Podcasts | Spotify | Pocket Casts | RSSFollow The Gradient on Twitter

Outline:

* (00:00) Intro

* (01:11) Kate’s background

* (03:22) Tesla and cameras vs. Lidar, importance of data

* (05:12) “Data is key”

* (07:35) Data vs. architectural improvements

* (09:36) Effort for data scaling

* (10:55) Transfer of capabilities in self-driving

* (13:44) Data flywheels and edge cases, deployment

* (15:48) Transition to Scale

* (18:52) Perspectives on shifting to transformers and data

* (21:00) Data engines for NLP vs. for vision

* (25:32) Model evaluation for LLMs in data engines

* (27:15) InstructGPT and data for RLHF

* (29:15) Benchmark tasks for assessing potential labelers

* (32:07) Biggest challenges for data engines

* (33:40) Expert AI trainers

* (36:22) Future work in data engines

* (38:25) Need for human labeling when bootstrapping new domains or tasks

* (41:05) Outro

Links:

* Scale Data Engine

* OpenAI case study

Get full access to The Gradient at thegradientpub.substack.com/subscribe

150集单集

#Science #Tech #Gradient