BeyondAssertions

A Motivational Example John built a travel-planning AI agent that worked flawlessly during development.Three weeks after release, users suddenly reported: repeated itinerary steps broken tool calls incorrect weather reasoning the agent getting stuck in loops John’s code hadn’t changed.The foundation model had — and because his tests only checked exact outputs, nothing caught the regression.…