Human Judgment in a Mechanical World: Steering the AI Muse in the Right Direction