Optimizers: SGD, Momentum, Adam

An optimizer is the rule that turns a computed gradient into an actual change to the model's weights — SGD, Momentum, and Adam are three different rules for…

This lesson is part of BitBootcamp Pro. Unlock it with Pro, or browse the free courses.