Numbers forward, gradients back
Why it matters Before building the engine, see exactly what it must do, on five numbers.
Play the animation and step through it slowly. Notice two things. Going forward, each box needs only its inputs. Going backward, each box needs only the gradient arriving from the box after it, and its own local slope. That locality is what makes an engine possible: every operation only has to know its own little rule.
Recap Gradient at a box = gradient arriving from after it, times the box's local slope. Where a box feeds two others, add up what comes back from both.
New numbers, same formula L = (a * b + c) ** 2, with a = 1, b = 4, c = -2. Work out by hand (no code needed beyond the numbers) and set grad_a, grad_b and grad_c.
Spotted a problem in this lesson? Report it · Ask about this lesson
This exercise opens soon
Finish the lesson before it and this one unlocks. The whole course is free, no account needed, and you can read this lesson right now.
This browser is blocking cookies for learn.floati.life, so lessons you finished here cannot open in order. Allow cookies for this site and reload.