We all tend to anthropomorphize AI, and the AI industry particularly likes to borrow terminology from neuroscience and human cognition. “Neural networks,” for example, are named after, but only loosely similar to, biological neurons. One...
In 2017, a team of researchers published “Attention Is All You Need”, the paper that introduced the Transformer architecture and launched the current era of Generative AI. The title was bold, catchy, and deliberately provocative....