Technology
MI5 chief warns AI could change stakes in bioweapons development
The Guardian reports that the MI5 head and outside experts say AI could help unskilled actors and states, though substantial hurdles remain.
The short version
- MI5 head Sir Ken McCallum warned in an annual threats speech that AI could change the stakes on existing and new bioweapons.[The Guardian]
- Experts say AI chatbots could help unskilled actors or terrorist groups plan experiments, though substantial barriers remain.[The Guardian]
- Cited cases include an alleged Indian ricin plot aided by AI queries and Anthropic's reported September misuse attempts involving its Claude chatbot.[The Guardian]
- Prof Tom Inglesby says no country has formal policies yet to guard against this misuse and urges independent evaluations of AI models before release.[The Guardian]
Key facts
- Sir Ken McCallum, head of MI5, warned in his annual speech that AI has the potential to change the stakes on existing and new bioweapons.[The Guardian]
- Experts say AI chatbots could help rogue, unskilled actors or terrorist groups compile information, plan experiments, and troubleshoot problems with existing pathogens and toxins.[The Guardian]
- Police in India uncovered a suspected bioterrorism plot last year in which a doctor and others allegedly used AI chatbot queries and AI-driven search to help make ricin.[The Guardian]
- Anthropic reported in September five cases of scientists in unnamed countries trying to use its Claude chatbot for potentially dangerous work on viruses or toxins.[The Guardian]
- In an MIT exercise, non-science students used AI chatbots to list potential pandemic pathogens and DNA synthesis companies unlikely to screen orders within an hour.[The Guardian]
- Tacit expertise, access to biological materials and equipment, experimental validation, scale-up, and delivery remain substantial barriers, according to experts.[The Guardian]
- Prof Tom Inglesby, of the Johns Hopkins Center for Health Security, says no country has formal government policies yet to protect against this kind of misuse.[The Guardian]
What remains uncertain
- The India ricin plot and the Anthropic cases are described as suspected or allegedly, and the reporting does not independently verify them.[The Guardian]
- How far AI actually lowers barriers to bioweapons development is disputed, with experts stressing that significant technical hurdles remain.[The Guardian]
Sources
Outlet counts describe coverage, not independent confirmation. Reports may share a wire service or original source.
- Could AI ‘change the stakes’ in the development of bioweapons?The Guardian - Science