Gradcheck PyTorch Developer podcast

Artwork

Tech PyTorch Edward Yang Team PyTorch Deep Learning Machine Learning

内容由PyTorch, Edward Yang, and Team PyTorch提供。所有播客内容（包括剧集、图形和播客描述）均由 PyTorch, Edward Yang, and Team PyTorch 或其播客平台合作伙伴直接上传和提供。如果您认为有人在未经您许可的情况下使用您的受版权保护的作品，您可以按照此处概述的流程进行操作https://zh.player.fm/legal。

PyTorch Developer Podcast « »
gradcheck

4+ y ago 16:58

分享

MP3•单集首页

内容由PyTorch, Edward Yang, and Team PyTorch提供。所有播客内容（包括剧集、图形和播客描述）均由 PyTorch, Edward Yang, and Team PyTorch 或其播客平台合作伙伴直接上传和提供。如果您认为有人在未经您许可的情况下使用您的受版权保护的作品，您可以按照此处概述的流程进行操作https://zh.player.fm/legal。

We talk about gradcheck, the property based testing mechanism that we use to verify the correctness of analytic gradient formulas in PyTorch. I'll talk a bit about testing in general, property based testing and why gradcheck is a particularly useful property based test. There will be some calculus, although I've tried to keep the math mostly to intuitions and pointers on what to read up on elsewhere.

Further reading.

Gradcheck mechanics, a detailed mathematical explanation of how it works https://pytorch.org/docs/stable/notes/gradcheck.html In particular, it also explains how gradcheck extends to complex numbers
JAX has a pretty good explanation about vjp and jvp at https://jax.readthedocs.io/en/latest/notebooks/autodiff_cookbook.html
Fast gradcheck tracking issue https://github.com/pytorch/pytorch/issues/53876

… continue reading

83集单集

#Tech #PyTorch #Edward Yang #Team PyTorch #Deep Learning #Machine Learning

Artwork

gradcheck

PyTorch Developer Podcast

26 subscribers

published 4+ y ago

分享

MP3•单集首页

内容由PyTorch, Edward Yang, and Team PyTorch提供。所有播客内容（包括剧集、图形和播客描述）均由 PyTorch, Edward Yang, and Team PyTorch 或其播客平台合作伙伴直接上传和提供。如果您认为有人在未经您许可的情况下使用您的受版权保护的作品，您可以按照此处概述的流程进行操作https://zh.player.fm/legal。

We talk about gradcheck, the property based testing mechanism that we use to verify the correctness of analytic gradient formulas in PyTorch. I'll talk a bit about testing in general, property based testing and why gradcheck is a particularly useful property based test. There will be some calculus, although I've tried to keep the math mostly to intuitions and pointers on what to read up on elsewhere.

Further reading.

Gradcheck mechanics, a detailed mathematical explanation of how it works https://pytorch.org/docs/stable/notes/gradcheck.html In particular, it also explains how gradcheck extends to complex numbers
JAX has a pretty good explanation about vjp and jvp at https://jax.readthedocs.io/en/latest/notebooks/autodiff_cookbook.html
Fast gradcheck tracking issue https://github.com/pytorch/pytorch/issues/53876

… continue reading

83集单集

#Tech #PyTorch #Edward Yang #Team PyTorch #Deep Learning #Machine Learning

Semua episod

×

欢迎使用Player FM

Player FM正在网上搜索高质量的播客，以便您现在享受。它是最好的播客应用程序，适用于安卓、iPhone和网络。注册以跨设备同步订阅。

收听超过500个主题

边探索边听这个节目