Replacing gaze annotations with language-driven attention masking makes robot perception annotation-free and up to 5x faster at inference. Here is how I got there.



Picture a robot arm sitting across a table from you. You say: "Put the black bowl in the drawer." The arm moves. But not toward the bowl. It hovers. It hesitates. Then it grabs the...