Learning rate schedulers
Update: 2022-06-13
Description
What’s a learning rate? Why might you want to schedule it? How does the LR scheduler API in PyTorch work? What the heck is up with the formula implementation? Why is everything terrible?
Comments
In Channel