nablaC ∇C

the gradient of the cost, made visible · little neurons → intelligence · [2·8·8·2] / η 0.30

Task

data shape φ

Descent

η learning rate 0.30 speed fast seed

step0

C cost—

acc—

‖∇C‖—

warm edges excite, cool edges inhibit; thickness is |w|. the forward sweep lights the neurons; the backward sweep is ∇C, the cost flooding back to tell every weight which way is downhill.

input space · P(B | x,y)

cost C C ‖∇C‖

idle · press TRAIN