Teaching Small Language Models to Remember: Giving LLMs a Notebook with Differentiable Neural Computers

«"Large models memorize the world in their weights. Small models need a notepad." The Problem: Small Models Forget Facts Large Language Models (LLMs) like GPT-4 are remarkably good at recalling facts — "De...»