The Frozen Context Pattern: Adding State to Deep Equilibrium Models

«DEQ models converge only if their update function is a contraction. We found a design pattern that lets you inject arbitrary external state — Mamba memory, attention, anything — without touching the Lipschitz bound. tags...»