When teaching or learning neural networks, many fall into the trap of thinking that the perceptron is a mathematical model of a neuron.