使用Player FM应用程序离线!
Automated Evaluation of LLMs
Manage episode 416961426 series 3370867
Anand Kannappan is the cofounder and CEO of Patronus AI, an automated AI evaluation and security company. They have raised funding from Lightspeed Venture Partners, Replit CEO Amjad Masad, Gokul Rajaram, and Fortune 500 executives. He was previously at Meta and Vertis. He was also the cofounder of Kyber Technologies, which was a service to systematically predict market events using AI and remote sensing data. It evolved into a futures quant hedge fund managing $15M for partners.
Anand's favorite book: Harry Potter series (Author: JK Rowling)
(00:00) Introduction and Common Failure Modes of Large Language Models
(03:02) Challenges of Automated Evaluation in AI Models
(06:08) The Importance of Fine-Tuning and Retrieval Augmented Generation
(09:02) Addressing Copyright Detection in Language Models
(11:51) The Liability of Companies Using AI Models
(15:02) Advancements in Multimodal Models and State Space Models
(20:48) The Role of Fine-Tuning in the Evolution of Language Models
(23:51) The Significance of Adversarial Testing in AI
(25:56) The Role of Retrieval Augmented Generation in AI
(28:05) The Need for Continuous Function Optimization in Prompting
(29:02) Rapid Fire Round
--------
Where to find Prateek Joshi:
Newsletter: https://prateekjoshi.substack.com
Website: https://prateekj.com
LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19
Twitter: https://twitter.com/prateekvjoshi
153集单集
Manage episode 416961426 series 3370867
Anand Kannappan is the cofounder and CEO of Patronus AI, an automated AI evaluation and security company. They have raised funding from Lightspeed Venture Partners, Replit CEO Amjad Masad, Gokul Rajaram, and Fortune 500 executives. He was previously at Meta and Vertis. He was also the cofounder of Kyber Technologies, which was a service to systematically predict market events using AI and remote sensing data. It evolved into a futures quant hedge fund managing $15M for partners.
Anand's favorite book: Harry Potter series (Author: JK Rowling)
(00:00) Introduction and Common Failure Modes of Large Language Models
(03:02) Challenges of Automated Evaluation in AI Models
(06:08) The Importance of Fine-Tuning and Retrieval Augmented Generation
(09:02) Addressing Copyright Detection in Language Models
(11:51) The Liability of Companies Using AI Models
(15:02) Advancements in Multimodal Models and State Space Models
(20:48) The Role of Fine-Tuning in the Evolution of Language Models
(23:51) The Significance of Adversarial Testing in AI
(25:56) The Role of Retrieval Augmented Generation in AI
(28:05) The Need for Continuous Function Optimization in Prompting
(29:02) Rapid Fire Round
--------
Where to find Prateek Joshi:
Newsletter: https://prateekjoshi.substack.com
Website: https://prateekj.com
LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19
Twitter: https://twitter.com/prateekvjoshi
153集单集
所有剧集
×欢迎使用Player FM
Player FM正在网上搜索高质量的播客,以便您现在享受。它是最好的播客应用程序,适用于安卓、iPhone和网络。注册以跨设备同步订阅。