使用Player FM应用程序离线!
Are long context windows the end of RAG?
Manage episode 410126509 series 1123725
DBRX, an open, general-purpose LLM created by Databricks, reportedly outperforms GPT-3.5 and is competitive with Gemini 1.0 Pro.
Recent research found that large, complex LLMs use a simple mechanism to retrieve stored knowledge in response to a user prompt. These mechanisms can help researchers reveal what the model knows and potentially even correct false information it has stored.
FTX co-founder Sam Bankman-Fried, whose downfall began in late 2022, was sentenced last week to 25 years in prison for conspiracy and fraud.
Find Michael on LinkedIn.
Find Cassidy on her website.
Stack Overflow user Bucket received a well-deserved Lifeboat badge for rescuing How to calculate decimal(x, y) max value in SQL Server from an ocean of ignorance.
Chapters (please note that these timestamps may not be exact):
00:00 Introduction and White Paper Discussion
02:01 Long Context Windows and Retrieval Augmented Generation
05:56 Models' Ability to Recall Relevant Information
07:18 Models' Creativity and Thinking Outside the Box
09:41 Advantages and Limitations of Models' Knowledge
15:09 Databricks' Open Language Model
22:25 Sam Bankman-Fried’s Sentence and the Effects on Crypto/Blockchain
31:28 Closing Remarks and Lifeboat Badge
697集单集
Manage episode 410126509 series 1123725
DBRX, an open, general-purpose LLM created by Databricks, reportedly outperforms GPT-3.5 and is competitive with Gemini 1.0 Pro.
Recent research found that large, complex LLMs use a simple mechanism to retrieve stored knowledge in response to a user prompt. These mechanisms can help researchers reveal what the model knows and potentially even correct false information it has stored.
FTX co-founder Sam Bankman-Fried, whose downfall began in late 2022, was sentenced last week to 25 years in prison for conspiracy and fraud.
Find Michael on LinkedIn.
Find Cassidy on her website.
Stack Overflow user Bucket received a well-deserved Lifeboat badge for rescuing How to calculate decimal(x, y) max value in SQL Server from an ocean of ignorance.
Chapters (please note that these timestamps may not be exact):
00:00 Introduction and White Paper Discussion
02:01 Long Context Windows and Retrieval Augmented Generation
05:56 Models' Ability to Recall Relevant Information
07:18 Models' Creativity and Thinking Outside the Box
09:41 Advantages and Limitations of Models' Knowledge
15:09 Databricks' Open Language Model
22:25 Sam Bankman-Fried’s Sentence and the Effects on Crypto/Blockchain
31:28 Closing Remarks and Lifeboat Badge
697集单集
Wszystkie odcinki
×欢迎使用Player FM
Player FM正在网上搜索高质量的播客,以便您现在享受。它是最好的播客应用程序,适用于安卓、iPhone和网络。注册以跨设备同步订阅。