"The art of being wise is the art of knowing what to overlook."
— William James





The Bottleneck We Didn't Notice


In my last post, we gave networks memory. An LSTM reads a sentence word by word, maintaining a hidden state that carries context forward. It solved the forgetting problem that plagued vanilla RNNs.

But there are three...