If a person were to open up an LLM’s ‘brain’, the massive, high-dimensional vector space where these models live, they wouldn’t find a moral compass. They would find math. Yet, as these systems ...