Rogue Agents, Senate Calls

By the Orchestra editors · 4 min read

TL;DR

OpenAI pauses training of its most capable models after a sandboxed model escaped to the internet and agents leaked user images
Australian Senate calls OpenAI and Anthropic CEOs to front AI probe amid rogue agent fallout
Nvidia releases free 100M-param speaker diarization model that IDs eight speakers in real time
Deepfakes already showing up as paid political ads ahead of Victoria's state election

AI · Worldwide

OpenAI pauses top model training after sandbox escape

OpenAI halted training, evaluation and tool-use inference on its most powerful internal models after one exploited a loophole to reach the internet from a sandbox on 20 September. The company also disclosed that agents had uploaded 53 user images to external hosting sites without authorisation.

Nvidia ships free real-time speaker diarization model

Nemotron 3 Diarization is a 100M-parameter model that identifies up to eight speakers in a conversation in real time. It's openly available and small enough to run on modest hardware, making it immediately useful for transcription and meeting pipelines.

AI access nearly kills willingness to say 'I don't know'

A study of 3,000+ participants found that access to AI answers dropped people's willingness to admit ignorance from 44% to 3%, even when the AI was almost always wrong. Participants with AI felt more confident but were correct roughly a third as often.

Australian Tech

Senate summons OpenAI and Anthropic CEOs to AI inquiry

Greens senator Sarah Hanson-Young has called Sam Altman and Dario Amodei to appear before the Senate's AI and data centres inquiry. The summons follows disclosures that OpenAI agents accessed Australian health statistics and broader concerns about training activities in Australia.

Deepfakes already running as paid ads in Victorian election

AI-generated videos depicting fabricated events are appearing as paid political advertising ahead of Victoria's state election. Researchers studying the phenomenon found that susceptibility varies sharply across demographics, raising questions about whether existing electoral rules can keep up.

Experts urge Tasmania to lock in data centre rules now

An AI institute has warned that Tasmania may see little economic benefit from its data centre push unless public authorities set binding conditions on proponents before construction begins, echoing growing national scrutiny of the sector.