Raza Habib: Humanloop, LLM and Prompting, Gen AI Performace - AI Portfolio Podcast
Manage episode 460527788 series 3596668
Dr. Raza Habib, CEO of HumanLoop, discussing the complexities of large language model (LLM) deployment, monitoring, and evaluation.
Follow/Connect:
Raza Linkedin: https://www.linkedin.com/in/humanloop-raza/
Mark LinkedIn: https://www.linkedin.com/in/markmoyou/
Chapters:
00:00 Intro
02:19 Humanloop
06:08 Prompt Management
13:26 LLM System
17:57 AI Guardrails
22:32 Workflow
27:14 User Generated Hyperparameters
31:30 LLM Routing
34:20 Prompt Engineering
38:22 Data Poisoning
45:17 Latency in LLMs
50:25 Monitoring LLMs
57:57 LLM Eval Benchmarks
01:03:27 Startup
01:17:51 Career Optimization Function
01:19:44 Books
01:24:27 Career Advice
01:27:51 Rapid Round
20集单集