We present an input to a network, work out the error, and change the weights.