John D. Kelleher did an amazing job with Deep Learning from The MIT Press Essential Knowledge Series. This tiny little book contains all the essential information about the topic, from the brief history of deep learning (née connectionism) through various activation functions to backprop and gradient descent.

(more…)