AI radicalises kids in days, not years, Australian police warn parliament

Australian police warn that AI and algorithms have compressed the online radicalisation of children from months to mere days.

Policy ยท Source: Australian Associated Press

What happened

Australian police and intelligence officials just delivered a stark warning to parliament. Artificial intelligence is accelerating the radicalisation of vulnerable youth. What used to take months or years now happens in mere days. The Australian Federal Police and ASIO testified before a parliamentary committee on October 21. They painted a grim picture of a security environment that is becoming increasingly permissive of violence. The national threat level currently sits at probable.

The numbers are alarming. Since 2020, Australian counter-terrorism authorities have investigated 65 children aged between 12 and 17. Thirty-five of those investigations resulted in criminal charges. In one specific case, a 13-year-old boy was charged after police found written plans in a notebook detailing how he would carry out a school shooting. Officials noted that children as young as 11 are being targeted online through extremist content and coercive behaviour. Perpetrators use threats and blackmail to pressure these minors into committing harmful acts.

AI is actively lowering the barrier to entry for extremists. ASIO warned that potential offenders use AI chatbots to research and plan attacks efficiently, bypassing hours of manual work. Meanwhile, algorithms and encrypted messaging apps create echo chambers that law enforcement struggles to monitor. The government recently passed legislation banning under-16s from social media. The call for serious intervention comes just days after independent MP Helen Haines was allegedly mowed down outside her office, an event that underscores the real-world consequences of political violence.

Key facts

Why it matters

If you build consumer social, gaming, or messaging apps, the regulatory hammer is coming. The parliamentary committee is actively examining the obligations of digital platforms to detect and report extremist content. Labor is pushing for a digital duty of care and mandating that platforms let users opt out of algorithms. Platforms will soon be held directly responsible for what their systems feed to minors. Officials noted that current intervention programs are failing, with youth returning to extremist beliefs. The government wants to catch these issues earlier, which means pushing the burden of detection onto the platforms themselves.

The second-order effect is a massive shift in law enforcement powers and the erosion of digital privacy. Police are already asking for new legal authority to overtly infiltrate and interrupt encrypted chat groups. End-to-end encryption is under severe threat. If governments force backdoors or mandate proactive scanning for radical content, the fundamental architecture of private communication will change. The domestic terrorism threat no longer fits established profiles. It is younger, faster, and highly digital. Regulators will not hesitate to break encryption if they believe it will stop a 13-year-old from planning a school shooting.

For builders

Mandatory algorithmic opt-outs are coming

Australian lawmakers are pushing bills that force platforms to let users opt out of algorithmic feeds. If you rely on engagement-driven algorithms to retain users, prepare to build chronological or chronological-hybrid alternatives. Compliance costs will eat into margins, and user retention metrics will likely drop for companies that fail to adapt.

Strict liability for gaming and chat apps

The parliamentary inquiry specifically targeted gaming and gaming-adjacent platforms for the grooming of minors. Founders building multiplayer games or community chat features will need enterprise-grade moderation tools from day one. Expect to pay heavy fines or face outright bans if your platform is used as a conduit for radicalisation.

Encryption under regulatory fire

Intelligence officials openly cited encrypted apps as a major hurdle for law enforcement. Builders of secure messaging tools face a growing risk of government mandates requiring backdoors or client-side scanning. Privacy-focused startups will have to fight expensive legal battles to maintain their core features against national security arguments.

My take

We built tools to make information flow faster, and now we are shocked that bad ideas travel at the speed of light. Banning kids from social media is a desperate band-aid on a bullet wound. If founders do not build better safeguards into their models and algorithms today, regulators will happily regulate us out of existence tomorrow. Speed is the new threat, but ignoring the problem is the real danger.

Original reporting: Australian Associated Press. This is my rewrite and opinion.

More AI news for builders