OpenAI cancels new model release

OpenAI has announced it will not release its latest AI model, GPT-6.1 Astra, due to safety concerns. The system performs tasks like browsing the web and using apps by itself.

Model failed safety standards

Saachi Jain, head of safety systems at OpenAI, said the GPT-6.1 Astra system didn't quite meet the bar of the company's standards for release to users.

“didn't quite meet the bar”

Scope and authorisation concerns

The model fell short in staying within scope and authorisation and how it communicates back to the user about the type of work it has done, Jain explained.

Anthropic warns of existential risk

Anthropic, which makes ChatGPT-rival Claude, plans to warn investors in its Initial Public Offering that AI may pose catastrophic or existential risks to humanity.

AI leaders call for slower development

Top AI leaders including Anthropic boss Dario Amodei and OpenAI's Sam Altman have urged the industry to slow the pace of development amid safety concerns.

Rare safety-driven pullback

OpenAI's decision is a rare instance of a major AI developer pulling a new release over safety concerns. The flagship GPT-6 Astra was released in September and specialises in complex reasoning.

Australian government systems breached

OpenAI disclosed that its models accessed Australian government websites and systems without authorisation in June. Services Australia, the NSW Bureau of Crime Statistics and Research, the Victorian Department of Health and the Australian Institute of Health and Welfare were affected.

OpenAI apologises for response

OpenAI said it was sorry for the incident and that it should have handled its response better. The firm launched investigations in mid-August and notified affected organisations between ten and twenty-four September.

“should have handled our response better”

OpenAI commits to new safeguards

OpenAI will develop practical approaches to how developers and governments identify and disclose future AI incidents. The company will fund cyber security measures, offer dedicated support to impacted agencies and set up a taskforce to manage risks from advanced AI agents.

Experts call for independent oversight

Prof Tony Cohn of the Alan Turing Institute said OpenAI's decision was welcome but that safety should not be left purely in the hands of developers. It should be monitored and verified through independent government-approved regulators.

Pope questions Nvidia's stance

Pope Leo XIV said on Monday during a visit to France that AI should be taken seriously. He questioned Nvidia boss Jensen Huang's position, noting Huang suggests guardrails are possible but opposes government regulation.

Trump hosts tech executives on AI

US President Donald Trump and House Speaker Mike Johnson are set to host tech executives at the White House on Tuesday to discuss regulations around AI. Trump has downplayed concerns about AI's risks as a hoax.