CUDA Graph Trees PyTorch Developer podcast

Artwork

Tech PyTorch Edward Yang Team PyTorch Deep Learning Machine Learning

内容由PyTorch, Edward Yang, and Team PyTorch提供。所有播客内容（包括剧集、图形和播客描述）均由 PyTorch, Edward Yang, and Team PyTorch 或其播客平台合作伙伴直接上传和提供。如果您认为有人在未经您许可的情况下使用您的受版权保护的作品，您可以按照此处概述的流程进行操作https://zh.player.fm/legal。

PyTorch Developer Podcast « »
CUDA graph trees

1+ y ago 20:50

分享

MP3•单集首页

内容由PyTorch, Edward Yang, and Team PyTorch提供。所有播客内容（包括剧集、图形和播客描述）均由 PyTorch, Edward Yang, and Team PyTorch 或其播客平台合作伙伴直接上传和提供。如果您认为有人在未经您许可的情况下使用您的受版权保护的作品，您可以按照此处概述的流程进行操作https://zh.player.fm/legal。

CUDA graph trees are the internal implementation of CUDA graphs used in PT2 when you say mode="reduce-overhead". Their primary innovation is that they allow the reuse of memory across multiple CUDA graphs, as long as they form a tree structure of potential paths you can go down with the CUDA graph. This greatly reduced the memory usage of CUDA graphs in PT2. There are some operational implications to using CUDA graphs which are described in the podcast.

… continue reading

83集单集

#Tech #PyTorch #Edward Yang #Team PyTorch #Deep Learning #Machine Learning

Artwork

CUDA graph trees

PyTorch Developer Podcast

26 subscribers

published 1+ y ago

分享

MP3•单集首页

内容由PyTorch, Edward Yang, and Team PyTorch提供。所有播客内容（包括剧集、图形和播客描述）均由 PyTorch, Edward Yang, and Team PyTorch 或其播客平台合作伙伴直接上传和提供。如果您认为有人在未经您许可的情况下使用您的受版权保护的作品，您可以按照此处概述的流程进行操作https://zh.player.fm/legal。

CUDA graph trees are the internal implementation of CUDA graphs used in PT2 when you say mode="reduce-overhead". Their primary innovation is that they allow the reuse of memory across multiple CUDA graphs, as long as they form a tree structure of potential paths you can go down with the CUDA graph. This greatly reduced the memory usage of CUDA graphs in PT2. There are some operational implications to using CUDA graphs which are described in the podcast.

… continue reading

83集单集

#Tech #PyTorch #Edward Yang #Team PyTorch #Deep Learning #Machine Learning

Minden epizód

×

欢迎使用Player FM

Player FM正在网上搜索高质量的播客，以便您现在享受。它是最好的播客应用程序，适用于安卓、iPhone和网络。注册以跨设备同步订阅。

收听超过500个主题

边探索边听这个节目