版权声明:原创博客,转载请标明出处! https://blog.csdn.net/caipengbenren/article/details/89469771
[Machine Learning notebook by NG] Gradient Descent
Linear Regression Model(线性模型)
Gradient Descent algorithm
repeat until convergence {
}
means learning rate,that is to say:it means the size of gradient step
Correct: Simultaneous update
Notice that:update and simultaneously
different Start point may obtion result,as than pictures show。
the size of learning rate
if
is too small,gradient descent can be slow.
if
is too large, gradient descent can overshoot the minimum it may fail to converge, or even diverge.