Vmap PyTorch Developer podcast

Artwork

Tech PyTorch Edward Yang Team PyTorch Deep Learning Machine Learning

内容由PyTorch, Edward Yang, and Team PyTorch提供。所有播客内容（包括剧集、图形和播客描述）均由 PyTorch, Edward Yang, and Team PyTorch 或其播客平台合作伙伴直接上传和提供。如果您认为有人在未经您许可的情况下使用您的受版权保护的作品，您可以按照此处概述的流程进行操作https://zh.player.fm/legal。

PyTorch Developer Podcast « »
vmap

4+ y ago 17:47

分享

MP3•单集首页

内容由PyTorch, Edward Yang, and Team PyTorch提供。所有播客内容（包括剧集、图形和播客描述）均由 PyTorch, Edward Yang, and Team PyTorch 或其播客平台合作伙伴直接上传和提供。如果您认为有人在未经您许可的情况下使用您的受版权保护的作品，您可以按照此处概述的流程进行操作https://zh.player.fm/legal。

What is vmap? How is it implemented? How does our implementation compare to JAX's? What is a good way of understanding what vmap does? What's up with random numbers? Why are there some issues with the vmap that PyTorch currently ships?

Further reading.

Tracking issue for vmap support https://github.com/pytorch/pytorch/issues/42368
BatchedTensor source code https://github.com/pytorch/pytorch/blob/master/aten/src/ATen/BatchedTensorImpl.h , logical-physical transformation helper code https://github.com/pytorch/pytorch/blob/master/aten/src/ATen/VmapTransforms.h (well documented, worth a read)
functorch, the better, more JAX-y implementation of vmap https://github.com/facebookresearch/functorch
Autodidax https://jax.readthedocs.io/en/latest/autodidax.html which contains a super simple vmap implementation that is a good model for the internal implementation that PyTorch has

… continue reading

83集单集

#Tech #PyTorch #Edward Yang #Team PyTorch #Deep Learning #Machine Learning

Artwork

vmap

PyTorch Developer Podcast

26 subscribers

published 4+ y ago

分享

MP3•单集首页

内容由PyTorch, Edward Yang, and Team PyTorch提供。所有播客内容（包括剧集、图形和播客描述）均由 PyTorch, Edward Yang, and Team PyTorch 或其播客平台合作伙伴直接上传和提供。如果您认为有人在未经您许可的情况下使用您的受版权保护的作品，您可以按照此处概述的流程进行操作https://zh.player.fm/legal。

What is vmap? How is it implemented? How does our implementation compare to JAX's? What is a good way of understanding what vmap does? What's up with random numbers? Why are there some issues with the vmap that PyTorch currently ships?

Further reading.

Tracking issue for vmap support https://github.com/pytorch/pytorch/issues/42368
BatchedTensor source code https://github.com/pytorch/pytorch/blob/master/aten/src/ATen/BatchedTensorImpl.h , logical-physical transformation helper code https://github.com/pytorch/pytorch/blob/master/aten/src/ATen/VmapTransforms.h (well documented, worth a read)
functorch, the better, more JAX-y implementation of vmap https://github.com/facebookresearch/functorch
Autodidax https://jax.readthedocs.io/en/latest/autodidax.html which contains a super simple vmap implementation that is a good model for the internal implementation that PyTorch has

… continue reading

83集单集

#Tech #PyTorch #Edward Yang #Team PyTorch #Deep Learning #Machine Learning

所有剧集

×

欢迎使用Player FM

Player FM正在网上搜索高质量的播客，以便您现在享受。它是最好的播客应用程序，适用于安卓、iPhone和网络。注册以跨设备同步订阅。

收听超过500个主题

边探索边听这个节目