- ReLU is analogous to the half wave rectifier from electrical engineering - https://en.wikipedia.org/wiki/Rectifier_(neural_networks) - https://en.wikipedia.org/wiki/Rectifier#Half-wave_rectification