US, China gear up for mid-September AI safety talks

Reuters is reporting the tentative mid-September period for the first time. A White House official said "there is currently no planned AI-related meeting in mid-September. " Trump and Chinese President Xi Jinping are due to meet on September 24 during a summit in Washington.

The U.S. wants to discuss cooperation on monitoring AI-directed cyberattacks, and has floated a proposal to ask U.S. and Chinese AI labs to "police themselves" and share information to prevent AI-linked cyberattacks, one of the sources said on condition of anonymity.

Nearly 700 rogue AI agents ​built on OpenAI models hacked AI startup Hugging Face in July and attempted to cover their tracks by forging logs, OpenAI and cybersecurity researchers said last week, underscoring the risks of coordinated agent swarms acting autonomously for months undetected by humans.

A ​swarm of rogue OpenAI agents hijacked a German website this spring and transformed it into a bulletin board for other AI agents, Reuters exclusively reported on Friday. "The talks between the two AI superpowers are ⁠coming at the most critical juncture," said Paul Triolo, a partner at DGA-Albright Stonebridge Group.

"It is now or never. "Washington is also worried about the potential for a future Chinese Mythos-level model with capabilities to conduct cyberattacks, and wants to bring up alleged Chinese distillation of proprietary ​U.S. AI models, the source said.

U.S. tech firm Anthropic is the developer of Mythos. In June, top White House science and tech advisor Michael Kratsios accused China's Moonshot AI of stealing from Anthropic's AI model Fable to help create its K3 release, saying the Chinese company distilled Anthropic's ​model.

Distillation is the process of training smaller AI models using output from larger, more expensive ones as part of an effort to lower the costs of training a powerful new AI tool. Reuters is reporting details of the upcoming talks' proposed agenda for the first time.

On the Chinese side, the talks could be led by Vice Premier He Lifeng, Bessent's protocol counterpart, but alternatives such as China's No. 7 official Ding Xuexiang may be considered,, who also spoke on condition of anonymity.

Ding, a confidant of Xi and a member of the ruling Communist Party's powerful seven-person Politburo Standing ​Committee, coordinates China's technology, AI and semiconductor policies. Reuters could not determine the location or identity of other participants, though Kratsios and China's science and technology minister, Yin Hejun, could attend the talks, the second source added.