19 subscribers
使用Player FM应用程序离线!
值得一听的播客
赞助


Learning the internals of Machine Learning systems and tips for PhD | Maithra Raghu, Google Brain
Manage episode 303480800 series 2859018
Dr. Maithra Raghu is a senior research scientist at Google working on analyzing the internal workings of deep neural networks so that we can deploy them better keeping humans in the loop. She recently graduated from Cornell University with a PhD in CS and previously graduated from Cambridge University with BA and Masters in Mathematics. She has received multiple awards for her research work including the Forbes 30 under 30.
Questions that we cover
00:00:00 Introductions
00:01:00 To understand more about your research interests, can you tell us what kind of research questions you are interested in while working at Google Brain?
00:04:45 What interested you about it and how did you get started?
00:15:00 What is one thing that surprises/puzzles you about deep learning effectiveness to date?
00:22:05 What’s the difference between being a researcher in academia/PhD student vs being a researcher at a big organization (Google)?
00:28:35 In what use cases do you think ViTs might be a good choice to perform image analysis over CNN vs where do you think CNNs still have an undoubted advantage?
00:37:15 Why does ViT perform better than ResNet only on larger datasets and not on mid-sized datasets or smaller?
00:43:55 In regards to medical imaging tasks, would it be theoretically wrong to pre-train the model on dataset A and fine-tune it on dataset B?
00:47:35 Do you think ViT or transformer-based models already have/have the potential to cause a paradigm shift in the way we approach imaging tasks? Why?
00:5:25 Medical datasets are often limited in size, what are your views on tackling these problems in the near future
00:55:55 From an internal representation perspective, do you think deep neural networks can have the ability of reasoning?
00:58:20 How did you decide on your own PhD research topic? Advice you would give to graduate researchers trying to find a research problem for their thesis?
01:04:00 Many times researchers/students feel stuck/overwhelmed with a particular project they are working on, how do you suggest based on experience to tackling that?
01:10:35 How do you now/as a graduate student used to keep up with the latest research in ML/DL?
Maithra's Homepage: https://maithraraghu.com
Blogpost talked about: https://maithraraghu.com/blog/2020/Reflections_on_my_Machine_Learning_PhD_Journey/
Her Twitter: https://twitter.com/maithra_raghu
About the Host:
Jay is a PhD student at Arizona State University, doing research on building Interpretable AI models for Medical Diagnosis.
Jay Shah: https://www.linkedin.com/in/shahjay22/
You can reach out to https://www.public.asu.edu/~jgshah1/ for any queries.
Stay tuned for upcoming webinars!
#explainableai #reliableai #robustai #machinelearning
***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***
Checkout these Podcasts on YouTube: https://www.youtube.com/c/JayShahml
About the author: https://www.public.asu.edu/~jgshah1/
95集单集
Manage episode 303480800 series 2859018
Dr. Maithra Raghu is a senior research scientist at Google working on analyzing the internal workings of deep neural networks so that we can deploy them better keeping humans in the loop. She recently graduated from Cornell University with a PhD in CS and previously graduated from Cambridge University with BA and Masters in Mathematics. She has received multiple awards for her research work including the Forbes 30 under 30.
Questions that we cover
00:00:00 Introductions
00:01:00 To understand more about your research interests, can you tell us what kind of research questions you are interested in while working at Google Brain?
00:04:45 What interested you about it and how did you get started?
00:15:00 What is one thing that surprises/puzzles you about deep learning effectiveness to date?
00:22:05 What’s the difference between being a researcher in academia/PhD student vs being a researcher at a big organization (Google)?
00:28:35 In what use cases do you think ViTs might be a good choice to perform image analysis over CNN vs where do you think CNNs still have an undoubted advantage?
00:37:15 Why does ViT perform better than ResNet only on larger datasets and not on mid-sized datasets or smaller?
00:43:55 In regards to medical imaging tasks, would it be theoretically wrong to pre-train the model on dataset A and fine-tune it on dataset B?
00:47:35 Do you think ViT or transformer-based models already have/have the potential to cause a paradigm shift in the way we approach imaging tasks? Why?
00:5:25 Medical datasets are often limited in size, what are your views on tackling these problems in the near future
00:55:55 From an internal representation perspective, do you think deep neural networks can have the ability of reasoning?
00:58:20 How did you decide on your own PhD research topic? Advice you would give to graduate researchers trying to find a research problem for their thesis?
01:04:00 Many times researchers/students feel stuck/overwhelmed with a particular project they are working on, how do you suggest based on experience to tackling that?
01:10:35 How do you now/as a graduate student used to keep up with the latest research in ML/DL?
Maithra's Homepage: https://maithraraghu.com
Blogpost talked about: https://maithraraghu.com/blog/2020/Reflections_on_my_Machine_Learning_PhD_Journey/
Her Twitter: https://twitter.com/maithra_raghu
About the Host:
Jay is a PhD student at Arizona State University, doing research on building Interpretable AI models for Medical Diagnosis.
Jay Shah: https://www.linkedin.com/in/shahjay22/
You can reach out to https://www.public.asu.edu/~jgshah1/ for any queries.
Stay tuned for upcoming webinars!
#explainableai #reliableai #robustai #machinelearning
***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***
Checkout these Podcasts on YouTube: https://www.youtube.com/c/JayShahml
About the author: https://www.public.asu.edu/~jgshah1/
95集单集
所有剧集
×

1 Differential Privacy, Creativity & future of AI research in the LLM era | Niloofar Mireshghallah 1:29:23


1 Future of Software Development with LLMs, Advice on Building Tech startups & more | Pritika Mehta 37:31

1 Instruction Tuning, Prompt Engineering and Self Improving Large Language Models | Dr. Swaroop Mishra 1:31:39







1 P1 Adversarial robustness in Neural Networks, Quantization and working at DeepMind | David Stutz 1:32:28


1 How do you decide which research problems to work on? Manish Gupta, Director of Google Research, India 13:44

1 Building a research lab from scratch & using AI for Social Good, Manish Gupta Google Research India 1:12:26


1 CNNs & ViTs (Vision Transfomers) - Comparing the internal structures, Maithra Raghu, Google 5:21


1 Learning the internals of Machine Learning systems and tips for PhD | Maithra Raghu, Google Brain 1:15:27




欢迎使用Player FM
Player FM正在网上搜索高质量的播客,以便您现在享受。它是最好的播客应用程序,适用于安卓、iPhone和网络。注册以跨设备同步订阅。