Human-in-the-Loop Is Not a Control: The Case for Human Resilience Engineering

We have developed an oddly comforting habit in AI governance. Whenever we encounter a problem we cannot quite solve technically, legally, or organizationally, we put a human in the loop. The model might hallucinate, so a human should check it. The agent can take consequential action, so a human should approve it. The reasoning is opaque, so a...