Glossary: Computer Vision Beyond the Basics
OneCycleLR
Also written: learning rate scheduler
A learning-rate schedule that warms the rate up and then decays it. The warm-up keeps a random new head from wrecking pretrained layers early in training.
Glossary: Computer Vision Beyond the Basics
Also written: learning rate scheduler
A learning-rate schedule that warms the rate up and then decays it. The warm-up keeps a random new head from wrecking pretrained layers early in training.