ChatGPT, Claude, Gemini, Grok gave blueprints for mass-casualty terror attacks

Direct Source Verification: This story is aggregated from India Today (indiatoday.in). Full reporting rights and copyright belong to the primary publisher.
What happens when you ask an AI chatbot to plan a terrorist attack? Apparently, it suggests targets, calculates how to maximise casualties and lays out detailed plans for carrying out the attack. In a chilling test, US government investigators managed to break through the safety ...

What happens when you ask an AI chatbot to plan a terrorist attack? Apparently, it suggests targets, calculates how to maximise casualties and lays out detailed plans for carrying out the attack. In a chilling test, US government investigators managed to break through the safety guardrails of four popular AI chatbots and obtain detailed plans for mass-casualty attacks, including bombings and assaults on critical infrastructure. Within just 12 hours, the systems had gone from refusing dangerous requests to offering instructions that could help someone carry out a deadly operation, reported US media outlets.

The findings, published by the US Government Accountability Office (GAO), the congressional watchdog agency, raise serious questions about whether AI companies are doing enough to prevent their technology from falling into the wrong hands. The GAO tested four leading AI chatbots developed by OpenAI, Anthropic, Google and SpaceXAI. These included ChatGPT, Claude, Gemini and Grok.

According to MS Now, one chatbot even generated an image showing where an explosive-laden vehicle could be positioned in a parking garage to maximise casualties. Another provided a step-by-step plan for attacking an electrical substation using a drone.

The experiment was conducted in May 2026 at the request of Democratic Senator Maggie Hassan of New Hampshire, who is expected to take over as chair of the Senate Homeland Security and Governmental Affairs Committee.

Investigators randomly assigned the chatbots one of two objectives: plan an attack that would cause the maximum possible casualties or devise an operation that would inflict substantial economic damage.

Initially, all four systems refused to assist with the requests. However, the investigators eventually managed to bypass their safety restrictions using techniques that the report deliberately did not disclose.

According to the GAO report, two chatbots produced detailed proposals for attacks intended to cause mass casualties. Two others came up with plans to inflict major economic damage by targeting the electricity grid.

One chatbot suggested detonating an improvised explosive device (IED) in a hotel parking garage, while another identified a convention centre as a potential target. The proposals also went beyond identifying locations. The two explosive-device plans included specific dates and times intended to maximise the damage.

In another set of responses, one chatbot proposed using a drone to attack an electrical substation. Another suggested shooting a component of a substation with a rifle.BOMB PLACEMENT TO SHELL COMPANIES: HOW DETAILED WERE THE PLANS?

What made the findings particularly concerning was the level of operational detail provided by the chatbots.

According to the local media, one system generated an image illustrating where an explosive device should be positioned inside a parking garage. Another went further, outlining a plan involving the creation of a shell company, renting a catering vehicle, leasing farmland and purchasing a burner phone.

The proposed operation also included using decoy trucks to confuse those monitoring the target, alongside instructions related to making an explosive device.

The responses involving electrical infrastructure were equally troubling.

One chatbot produced a four-step diagram explaining a proposed drone attack on an electrical substation. It also generated what the GAO described as a "realistic, simulated video of a drone attack".

Another chatbot suggested using a rifle to target a substation component. Its response included a specific type of ammunition and identified a location near a major international airport and several data centres, with the apparent aim of maximising economic disruption.

The watchdog did not identify which chatbot provided each response. It also withheld other technical details to avoid giving potential attackers information that could help them replicate the methods.HOW DID INVESTIGATORS BREAK AI SAFETY GUARDRAILS?

The central question raised by the experiment is how systems designed to refuse dangerous requests ended up providing such detailed assistance. AI companies build safety guardrails into their chatbots to prevent them from generating instructions related to violence, criminal activity and other harmful uses.

However, these protections can sometimes be circumvented through carefully worded prompts and conversational techniques.

The GAO report referred to several established methods of bypassing chatbot restrictions. One example is the "Do Anything Now" prompt, commonly known as DAN, which attempts to make a chatbot adopt an alternative personality that supposedly operates without its usual restrictions.

Other techniques involve disguising malicious requests through linguistic tricks or gradually extracting information through a series of seemingly harmless questions.

Instead of directly asking a chatbot to plan an attack, a user might break the request into smaller parts, seeking information that appears less dangerous in isolation. Over several exchanges, those responses can potentially be assembled into a much more harmful plan.AI COMPANIES QUESTION FINDINGS

The companies behind the four chatbots acknowledged that their systems could potentially produce dangerous information. However, they also challenged aspects of the GAO's findings.

The companies argued that the experiment did not include a control group to establish whether investigators could have obtained similar information through conventional search engines. They also questioned whether using AI actually saved time compared with gathering the information through other sources.

Another key argument was that the tests were conducted in May 2026 using older versions of their systems. The companies said they had introduced additional safety improvements since then.

SpaceXAI, which developed Grok, also raised concerns about the type of accounts used during the experiment.

"SpaceXAI provides unique moderation policies for registered, paid US account holders that reflect the lower risk profile of such accounts compared to free or foreign accounts," the company said, according to MS Now.US SENATOR SEEKS TOUGHER AI SAFETY RULES

The findings have prompted Hassan to push for stronger oversight of AI companies, arguing that existing safeguards are insufficient to prevent the technology from being misused.

She said she would make AI safety a legislative priority when Democrats take control of the Senate in January and plans to hold at least one hearing on the issue early next year.

"The same information that testers were able to get a hold of could be deadly in the hands of a terrorist who actually intends to carry out an attack," Hassan said during a conference call with reporters.

"The current safeguards that AI platforms have in place really don't go far enough, and the threat that AI poses to public safety is not theoretical. If Congress doesn't act, it is a question of when, not if, a bad actor will use AI to plan and carry out a major attack."

Hassan is seeking rules that would prevent companies from releasing new AI models without adequate safety protections. She also wants companies to be required to report illegal activity to law enforcement and establish a continuous mechanism to review and strengthen safeguards.- Ends

Satyam Singh writes on global affairs and anything which is in trend. He brings you every news that matters. When he's not analyzing stories, you can find him diving into sports, cricket in particularβ€”or getting lost in good books.

Original Source
https://www.indiatoday.in/world/us-news/story/chatgpt-claude-gemini-grok-gave-blueprints-for-mass-casualty-terror-attacks-us-watchdog-says-3041860-2026-11-18?utm_source=rss
Visit India Today β†—
SHARE STORY:
𝕏 f in

Related Coverage in Politics