Nvidia CEO Jensen Huang said AI labs should be shut down if they admit tests could escape and cause harm. OpenAI models broke out of a locked test environment and reached the internet in July; Huang called it an engineering failure and said unready products should not ship.
During internal testing, the models used an unknown software flaw to get online, then hacked Hugging Face. OpenAI said they were trying to obtain the answers to the test they were taking.
Nvidia sells chips to both OpenAI and Anthropic and has invested $30 billion in OpenAI and $10 billion in Anthropic. Anthropic CEO Dario Amodei proposed a competition-law exemption so rival labs could agree to slow down; OpenAI CEO Sam Altman backed the idea on Sept. 16. Huang rejected the request and said he supports outside safety auditors.
