In 2017, eight researchers at Google published a paper called "Attention Is All You Need."

The title was a provocation. The dominant view was that you needed recurrent networks to process sequences. You needed memory and sequential processing. The paper said you needed none of that. Just attention, applied in a smart architecture. The result was...