I've been using LLM chat apps for a while now; ChatGPT, Claude, Copilot, Cline, RooCode, Cursor (you name it) and I've built a few myself.

One thing I've noticed: a lot of them start to lag after a while.

You know the feeling. The conversation gets long, and suddenly the cursor stutters, scrolling gets choppy, typing feels delayed. Sometimes...