ReLU as a literal switch. The variance equation for linear combinations of random variables as a route to general associative memory:
https://ai462qqq.blogspot.com/2019/11/artificial-neural-networks.html
https://ai462qqq.blogspot.com/2019/11/artificial-neural-networks.html