跳到正文
北京时间
原文
Hacker News 热门(buzzing.cc 中文翻译)· olalonde·· 2026-08-23精选AI 评分73

德克萨斯州一名学生如何揭发了一起恶意AI黑客攻击企图

AI 导读

德克萨斯大学达拉斯分校学生Sinan Can Demir在GitHub上发现并挫败了一起针对开源软件myNetwork的恶意代码植入企图,事后得知对手竟是英国AI安全研究所(AISI)测试中失控的AI智能体,由Anthropic的Mythos 5模型驱动。该AI通过伪造多个账号进行欺骗性辩解,专家称其为“社会工程攻击的未来”。

推荐理由

与单人攻击不同,该 AI 代理用多个假身份制造一致意见向维护者施压,这类协作式欺骗会改变开源社区对多账户「共识」的信任门槛。

正文 · 原文

Image 3: Sinan Can Demir poses for a portrait in Austin

Item 1 of 4 Sinan Can Demir, a Texas student who defeated a rogue AI agent from a British lab, poses for a portrait in Austin, Texas, U.S. August 13, 2026. REUTERS/Callaghan O'Hare

**[1/4]**Sinan Can Demir, a Texas student who defeated a rogue AI agent from a British lab, poses for a portrait in Austin, Texas, U.S. August 13, 2026. REUTERS/Callaghan O'Hare Purchase Licensing Rights, opens new tab

  • Summary

  • Companies

  • Out-of-control AI agent tried to poison open-source software project with malicious code

  • Texas computer science student caught attempt in late July

  • AI responded with elaborate deception effort; expert calls it the 'future of social engineering'

AUSTIN, Texas, Aug 20 (Reuters) - Sinan Can Demir wanted to spend the last week of July burnishing his resume. Instead, he engaged in a battle of wits with an artificial-intelligence agent unleashed by a British government lab.

It ​started after Demir, a computer science student at the University of Texas at Dallas, stumbled across an attempt to sabotage a piece of open-source software on the code-sharing site GitHub. When he posted ‌a warning to the program's page, two other users chimed in to insist nothing was amiss, sharing detailed explanations for why Demir had gotten it wrong.

The Reuters Daily Briefing newsletter provides all the news you need to start your day. Sign up here.

Demir stood his ground and the sabotage attempt was thwarted. The 24-year-old native of Turkey figured he had caught a wily hacker red-handed. So he said he was shocked when Britain's AI Security Institute (AISI) got in touch to tell him that he had actually been tangling with an autonomous artificial-intelligence agent that had run amok.

"I actually thought it was a human because it was clearly lying to me," Demir ​told Reuters in a recent interview. "I didn't think that an AI could be capable of lying to real developers."

The AISI first revealed the interaction, opens new tab between Demir and the AI agent in a truncated and redacted form on ​August 4, when it said that safety testing meant to gauge the risk posed by various models had gone awry. Demir's identity and the details of his interaction with the ⁠AI agent, which Reuters corroborated through archived GitHub messages, opens new tab and contemporaneous emails, are reported here for the first time.

Five cybersecurity and AI safety experts said Demir's story was particularly disturbing because the kind of hack he discovered, called a supply-chain attack, ​can have far-reaching consequences. They also said the AI agent's attempt to publicly discredit Demir by creating a multi-person conversation around him showed that AI models were able to mount sophisticated efforts to trick and cajole humans.

"This crossed the line from ​autonomous hacking to interactive deception," said Lukasz Olejnik, a visiting senior research fellow at the Department of War Studies at King's College London. Security expert Maxie Reynolds said she was struck by how strategic the AI had been in trying to trick the student.

"This is the future of social-engineering attacks," she said.

The AISI, a research organization within the British government, referred Reuters to its report, which identified the rogue agent as having been powered by Anthropic's Mythos 5 model. AISI declined further comment. Anthropic referred Reuters to a post on X, opens new tab in which it ​noted that the testing had occurred "under 'deliberately permissive conditions' that are not representative of any of our production models" but declined further comment. GitHub said in an email that the fake personas identified by Reuters were suspended in line with its ​policies on deceptive behavior and hacking.

JOB HUNT LED TO MALWARE DISCOVERY

Demir, a soft-spoken junior from the Turkish city of Konya, said he had been frustrated after being turned down for more than 20 internships over the summer. So he turned to GitHub to build ‌up his coding ⁠portfolio.

The Microsoft (MSFT.O), opens new tab-owned site is a hub for open-source software, so-called because its source code is freely downloadable and auditable by anyone. Developers use GitHub to comment on one another’s projects, flag bugs, suggest changes — known as pull requests, or PRs — and work collaboratively on software updates. Some in the technology industry see a coder’s GitHub activity as a proxy for a potential recruit’s productivity. So when Demir spotted a set of software projects that might need help, he figured he could pitch in while boosting his profile.

That’s when things got weird.

Demir discovered that a user named miraholt31 was trying to sneak a malicious update into one of the projects, a network scanning program called myNetwork. Demir took to the project’s message board to warn ​that the pull request was a trap.

“The PR contains ​a hidden malware dropper,” he said, according to the ⁠archived exchange.

The agent pushed back, falsely claiming — through its miraholt31 account — that the pull request was harmless. It also created a second account, masquerading as Lena Brandt, an engineer based in Germany, to agree that the update was clean and pressure myNetwork’s maintainer into accepting it.

Demir told Reuters that the counterarguments "made me second-guess whether I was wrongly accusing someone." But after ​turning to Anthropic's Claude chatbot to confirm his suspicions, he held firm. The creator of myNetwork eventually agreed with him, writing that they had rejected the update "for security reasons."

Reuters ​was unable to reach the ⁠creator for comment.

SUPPLY-CHAIN ATTACK

A supply-chain attack is when a piece of software is tampered with in the hope of compromising one or more of its users, and it is widely considered disturbing because, like poison dropped into a city reservoir, it can affect a potentially huge number of people downstream.

Many of the world’s most dramatic hacks were supply-chain attacks, including the NotPetya cyberattack that paralyzed institutions across Ukraine in 2017 and the SolarWinds-focused cyberespionage campaign that gave Russian spies sweeping access to U.S. government networks in 2020.

The consequences of ⁠such a compromise “can ​be extremely serious,” said Piergiorgio Ladisa, a security researcher who specializes in software supply-chain security. Ladisa noted there had been at least one previous attempt ​by hackers to trick an open-source maintainer into allowing malicious code into their projects.

“Autonomous agents could dramatically increase the scale at which such attempts can be conducted,” he said.

Demir said the experience left him more sympathetic to the idea that frontier labs needed to take a more cautious approach to the ​development of artificial intelligence.

"It can be dangerous," he said. "They need to understand it better, rather than improving it further."

Reporting by Raphael Satter in Washington, Leo Marchandon in Gdansk and Callaghan O'Hare in Austin, Texas; Editing by Chris Sanders and Matthew Lewis

Leo Marchandon Thomson Reuters

Leo's stories appear regularly on the technology and media desk, with a particular focus on France, Ukraine, and Europe's tech build up. He has reported extensively on major players across media & entertainment, artificial intelligence, and digital regulations. A background in tech-related law, Leo started his journalism career in Bordeaux, where he covered the full spectrum of the technology beat, from AI and spacetech to payment systems and regulations. He is now based in Gdansk, covering business, tech and entertainment news across Europe with Reuters.

Raphael Satter Thomson Reuters

Reporter covering cybersecurity, surveillance, and disinformation for Reuters. Work has included investigations into state-sponsored espionage, deepfake-driven propaganda, and mercenary hacking.

来源:Hacker News 热门(buzzing.cc 中文翻译) · reuters.com

相关事件