Someone used Claude to build a potential bioweapon. The real threat is much deeper

The useful part

Today's frontier AI models know everything–how to safely thaw a frozen chicken breast, re-shingle your roof, and treat your dog's ragweed allergies, if my recent chat history is any indication. According to the company, anonymous scientists attempted to use Anthropic's flagship Claude model to conduct research that could have turned deadly. Anthropic blocked their efforts this time, and there's no evidence that the scientists were actually trying to cause harm.

How it works

• Make it stronger According to Anthropic's report, the potentially dangerous research that the company blocked varied tremendously.
• Apparently, they also know how to create fiendishly deadly bioweapons.
• As frontier models get more powerful and better at science, the threat of an LLM imagining a truly lethal new virus or bacteria will only increase.
• In one instance, scientists reportedly asked Claude to assist with a grant appli...

Details worth keeping

That's according to a recent announcement by Anthropic.