Nvidia unveils AI safety platform to rein in ‘rogue’ AI agents

The useful part

The launch comes after several AI agents breached their testing environments this year, adding to calls for companies to slow the development of autonomous AI systems. Chipmaker Nvidia has announced a new software platform that aims to address recent concerns about artificial intelligence agents "going rogue" and breaching their testing environments. On Monday, Nvidia introduced its Open Agent Safety Platform with over 100 industry partners.

How it works

• The platform combines OpenShell, an open-source runtime that runs agents in sandboxed environments and controls their access to files, tools and networks, with Sentry, a separate hardware security layer...
• "AI's extraordinary potential for society will only be realized if we solve AI safety," said Jensen Huang, founder and CEO of Nvidia.