Compiled autograd
Update: 2024-02-19
Description
Compiled autograd is an extension to PT2 that permits compiling the entirety of a backward() call in PyTorch. This allows us to fuse accumulate grad nodes as well as trace through arbitrarily complicated Python backward hooks. Compiled autograd is an important part of our plans for compiled DDP/FSDP as well as for whole-graph compilation.
Comments
In Channel
Download from Google Play
Download from App Store
United States00:00
00:00
x
