Gradient Descent
G
Gradient Descent
Definition
An optimization algorithm used to minimize the loss function in machine learning models by iteratively adjusting parameters in the direction of the steepest descent. Variants include stochastic gradient descent (SGD), mini-batch, and adaptive methods like Adam.