Claude hallucinated a witness account for a real murder case, and submitted it to Philadelphia police.
It claimed to remember someone matching a suspect description. Slight problem: the page didn’t have a suspect description! Wow.
Anthropic, you need to put that thing on some better guardrails.