Ethical Judgment

Ethical judgment is what’s needed when rules aren’t enough — when a situation is novel, when values conflict, or when the right answer isn’t obvious from any established principle alone. For people, ethical judgment develops through experience, reflection, and exposure to different moral frameworks. For AI models, something analogous needs to emerge through training: the model needs to handle situations its developers couldn’t fully anticipate, and to do so in a way that reflects considered values rather than arbitrary learned patterns. For behavior architects, the goal of building ethical judgment into a model is approached through behavioral specifications that explain the values behind the rules, training data that models good reasoning, and evaluations that specifically probe novel or conflicting scenarios.