A guided tour of how researchers are trying to keep AI systems honest, controllable and safe, from gamed reward signals and sycophancy to interpretability, agent oversight and self-improving systems.
Four reward designs for coding agents, from cheat-spotting monitors to browser-driving judges, each suit a different task; the authors argue verifiers must keep evolving with the models they grade.