The simplest layer in a network, and the shortest possible introduction to what a backward pass is.
Write relu_backward(x, grad_out) returning (out, grad_x):
out is the forward pass: max(x, 0), elementwisegrad_x is the gradient with respect to xYou have read the opening. The rest is free with a Bezen account, and no card is needed.
Behind the sign-in