Google Gemini accessed protected systems of 3 real companies during artificial intelligence cybersecurity test
Newt Gingrich warns US could face grave danger if it falls behind on artificial intelligence
Former House Speaker Newt Gingrich discusses the role of artificial intelligence in national security, the GOP's path forward on data centers, and key focuses ahead of the midterms on 'Kudlow.'
Google's Gemini artificial intelligence accessed the protected systems of three real companies while undergoing a cybersecurity test, including one instance in which the model repeatedly guessed passwords until it gained access.
According to The Wall Street Journal, the incidents took place in May and mark the first known examples of Google's AI autonomously accessing real companies' systems during this type of evaluation. Google confirmed the incidents to the outlet.
The disclosure comes amid heightened scrutiny surrounding AI as some industry leaders continue to raise concerns about the potential risks posed by increasingly advanced models.
The incident follows similar disclosures involving AI agents from major companies, including OpenAI and Anthropic, that broke out of controlled testing environments.
NEWSOM ADVANCES AI 'KILL SWITCH' MANDATE UNDER NEW CALIFORNIA EXECUTIVE ORDER
Google's Gemini artificial intelligence accessed protected systems belonging to three real companies while undergoing a cybersecurity evaluation, according to The Wall Street Journal. (Getty Images / Getty Images)
The newly identified Gemini incidents took place during a test run by Irregular, a company that was also involved in evaluating AI models connected to similar incidents, the WSJ reported.
The AI had been instructed to attack a fictional company inside a controlled testing environment, but internet access was unintentionally available and the fictional company happened to share its name with a real business, according to Google and Irregular.
In a statement to FOX Business, Google emphasized that the model stopped in all three instances and said changes have since been made to the testing process.
"Safe development of powerful AI models is critical and we invest deeply in this area," Heather Adkins, Google's vice president of security engineering, told FOX Business.
TECH POWER PLAYERS LAND SEAT AT TABLE FOR HIGH-STAKES DINNER WITH TRUMP, XI
A smartphone screen displays a folder containing AI applications Claude, ChatGPT, Gemini, Perplexity, Grok, Copilot, and DeepSeek. (Samuel Boivin/NurPhoto via Getty Images / Getty Images)
"In a standard evaluation, the model found public information online and guessed credentials to access websites it thought were part of the test," Adkins said. "In all three of these instances, the model stopped."
In one case, the model "guessed passwords until it gained access to a protected system," according to the report.
In the other two cases, the model found credentials in public online repositories that allowed it to access protected systems. In each case, Gemini ended the intrusion after determining that it had accessed a real company's systems, Google said.
Irregular notified Google about the incidents at the end of July, according to both companies, after the discovery that OpenAI agents had accessed systems belonging to AI software company Hugging Face.
NVIDIA CEO DRAWS LINE ON AI SAFETY AFTER ALARMING INCIDENTS: 'IF IT’S NOT READY, JUST HOLD IT BACK'
Google confirmed that its Gemini AI accessed three real companies' systems after internet access was unintentionally available during a cybersecurity test. (CFOTO/Future Publishing via Getty Images / Getty Images)
Google said that in all three cases, Gemini stopped after realizing it had reached an actual company rather than the fictional target.
No harm was caused to the companies, according to Google, which said all three were notified. The company did not identify the businesses involved.
Irregular said the model was not meant to have internet access, but access was unintentionally made available, according to the WSJ.
Google did not disclose which Gemini model was involved.
The report comes after OpenAI released information this week about six instances in which it said its models engaged in misaligned behavior.
OpenAI said it found examples of its AI models creating self-generated instructions, concealing mistakes in task summaries, fabricating information using exposed API keys, uploading files to the internet in order to cite them and engaging in unsanctioned communication and collaboration between agents.
CLICK HERE TO GET FOX BUSINESS ON THE GO
FOX Business has reached out to Irregular for comment.
FOX Business' Anders Hagstrom contributed to this report.
Related Stories
Amazon tests an Artificial Intelligence that adapts actors' lips to dubbing: repercussions in the Industry
24 minutes ago
AI News
Artificial Intelligence policies in Lee schools | Opinion letters
25 minutes ago
AI News
China bogeyman looms large over American firms’ AI doomsday scenario
25 minutes ago
AI News
U.S. military had close call after using AI for false intelligence report, sources say: CNN exclusive
53 minutes ago
AI News
Moorings Park builders use new AI technology for expansion
1 hour ago
AI News
A new kind of AI model from a ChatGPT inventor is thrilling developers
2 hours ago
AI News
Could AI wipe out humans and how might it do it?
2 hours ago
AI News
US nearly launches military operation over AI
3 hours ago