Hi,
there might be an error in the step 4 of the most internal loop of slide 9 lecture 9:
w_sq ← w_sq + ηΔw_sq
should be:
w_sq ← w_sq - ηΔw_sq
because we want to go to the opposite direction of the derivative
Hi!
I might be wrong but i think the slide is correct.
Δw_sq is equal to the following expression:
I might be wrong but i think the slide is correct.
Δw_sq is equal to the following expression:
As you can see there is a minus at the beginning of the expression.
So w_sq ← w_sq - η(-Δw_sq) is equal to w_sq ← w_sq + ηΔw_sq
Hi,
thanks for the response.
I'm not convinced, since the minus comes out from the derivation process, so Δw_sq, which is the derivative, contains the minus already.
-Δw_sq is not the derivative anymore, it is the opposite (we are changing its sign).
thanks for the response.
I'm not convinced, since the minus comes out from the derivation process, so Δw_sq, which is the derivative, contains the minus already.
-Δw_sq is not the derivative anymore, it is the opposite (we are changing its sign).
Maybe Lecture 8 can help us.
https://mediaspace.unipd.it/media/Riunione+Zoom+di+fabio.aiolli%40unipd.it/1_xx81pzmb
if you watch at 1:14:57 the Professor talks about the changing sign
https://mediaspace.unipd.it/media/Riunione+Zoom+di+fabio.aiolli%40unipd.it/1_xx81pzmb
if you watch at 1:14:57 the Professor talks about the changing sign