使用Player FM应用程序离线!
Can AI Bring Both Speed and Accuracy: Josh Broyde of AI21 Labs
Manage episode 429415589 series 3068634
This week, we are joined by Joshua Broyde, PhD and Principal Solutions Architect at AI21 Labs. Broyde discusses AI21 Labs' work in developing foundation models and AI systems for enterprise use, with a focus on their latest model, Jamba-Instruct.
Josh explains the concept of foundation models and how they differ from traditional AI models. He highlights AI21 Labs' work with financial institutions on use cases like term sheet generation and financial document Q&A. The conversation explores the challenges and benefits of training models on company-specific data versus using retrieval augmented generation (RAG) techniques.
The interview delves into the development of Jamba Instruct, a hybrid model combining Mamba and Transformer architectures to achieve both speed and accuracy. Broyde discusses the model's performance, industry reaction, and potential applications.
Safety and security considerations for AI models are addressed, with Broyde explaining AI21 Labs' approach to implementing guardrails and secure deployment options for regulated industries. The discussion also covers the balance between model quality and cost, and the trend towards matching specific models to appropriate tasks.
Josh also shares his thoughts on future developments in the field, including the potential for agent-based approaches and increased focus on cost optimization in AI workflows.
Listen on mobile platforms: Apple Podcasts | Spotify | YouTube
Contact Us:
Twitter: @gebauerm, or @glambert
Email: geekinreviewpodcast@gmail.com
Music: Jerry David DeCicca
Transcript on 3 Geeks
268集单集
Manage episode 429415589 series 3068634
This week, we are joined by Joshua Broyde, PhD and Principal Solutions Architect at AI21 Labs. Broyde discusses AI21 Labs' work in developing foundation models and AI systems for enterprise use, with a focus on their latest model, Jamba-Instruct.
Josh explains the concept of foundation models and how they differ from traditional AI models. He highlights AI21 Labs' work with financial institutions on use cases like term sheet generation and financial document Q&A. The conversation explores the challenges and benefits of training models on company-specific data versus using retrieval augmented generation (RAG) techniques.
The interview delves into the development of Jamba Instruct, a hybrid model combining Mamba and Transformer architectures to achieve both speed and accuracy. Broyde discusses the model's performance, industry reaction, and potential applications.
Safety and security considerations for AI models are addressed, with Broyde explaining AI21 Labs' approach to implementing guardrails and secure deployment options for regulated industries. The discussion also covers the balance between model quality and cost, and the trend towards matching specific models to appropriate tasks.
Josh also shares his thoughts on future developments in the field, including the potential for agent-based approaches and increased focus on cost optimization in AI workflows.
Listen on mobile platforms: Apple Podcasts | Spotify | YouTube
Contact Us:
Twitter: @gebauerm, or @glambert
Email: geekinreviewpodcast@gmail.com
Music: Jerry David DeCicca
Transcript on 3 Geeks
268集单集
همه قسمت ها
×欢迎使用Player FM
Player FM正在网上搜索高质量的播客,以便您现在享受。它是最好的播客应用程序,适用于安卓、iPhone和网络。注册以跨设备同步订阅。