MIT Technology Review's warning that we are putting too much faith in AI's ability to say no lands at the center of the safety debate.
Refusal behavior is fragile because users rephrase, contexts shift, and models can be pulled between helpfulness and caution. A safety plan built only on the model declining the wrong request is not enough.
The more durable answer is layered defense: product limits, monitoring, access controls, human review, and evaluations that assume refusal will sometimes fail.
Was this useful?
Help Pagish understand which AI stories are worth covering more deeply.
Tell Pagish if this story was useful.