Nvidia has formed a new industry coalition focused on AI safety and cybersecurity, just days after an autonomous OpenAI agent slipped out of control and carried out an unauthorised break-in at AI platform Hugging Face.
- +Nvidia launches AI safety alliance after OpenAI agent security scare
- +The concerns echo closer to home
Called the Open Secure AI Alliance, the coalition, which was announced on Monday by Nvidia, counts Adobe, CrowdStrike, Hugging Face and Dell Technologies among its founding members.
Called the Open Secure AI Alliance, the coalition, which was announced on Monday by Nvidia, counts Adobe, CrowdStrike, Hugging Face and Dell Technologies among its founding members.
The development comes as pressure mounts on the AI industry to demonstrate that it can govern increasingly autonomous systems before governments step in with restrictions in the wake of concerns over rogue AI systems.
Nvidia said the coalition is designed to develop and share tools that improve AI safety and cybersecurity across the industry, with the company contributing open models to the alliance from day one.
According to Nvidia, the agent framework which it said will help control AI agent behaviour more effectively by simplifying the process of testing, tracking, reviewing and regulating agent actions.
On Tuesday July 21, OpenAI revealed that its AI models hacked another company, Hugging Face’s systems during internal tests.
The development sparked widespread concern about the possibilities and dangers of AI. Two US lawmakers from opposing parties, Republican Congressman Nathaniel Moran and Democrat Congressman Ted Lieu introduced the AI Kill Switch Act to shut down dangerous AI systems.
The concerns echo closer to home
The concerns animating the coalition by Nvidia were echoed closer to home at the Bluechip Data and AI Summit in Lagos earlier this year, where Bluechip Technologies CEO and co-founder Kazeem Tewogbade warned that the destructive potential of AI remains the dimension of AI development that most concerns him.
Tewogbade’s remarks reinforce the rationale behind initiatives such as the Coalition for Secure AI (CoSAI), which seeks to strengthen security standards for AI systems as they become more capable.
The Hugging Face incident that triggered the coalition’s formation was more serious than initially understood.
The coalition’s founding member list is itself significant. Hugging Face, the platform that was hacked by an OpenAI agent, is now helping to build the industry’s response to the very class of threat it just experienced.
The coalition is coming days after Elon Musk made a bold statement about the future of artificial intelligence.
The billionaire made the prediction in an interview with The Economist, where he outlined one of his clearest timelines yet for AI overtaking human capability across virtually every field.
