← Back to the Places: London tiles

Safety

17 records Generated from this page's data. Click a name to open its panel on the Places: London page. Records resting on one source are tagged "one source".
RecordWhat it isPlaceLinksConfidence
Apollo ResearchCompaniesTests the most advanced AI models for deceptive "scheming" behaviour and sells monitoring tools that watch and block unwanted actions by AI agents.
Profile
Owner or parent
independent; a Public Benefit Corporation as of 2026 (footer: EIN 93-4310599, Delaware, USA)
Founded or opened
Not stated on pages opened
Lab director or lead
Marius Hobbhahn — CEO and Co-Founder
Other leaders
Chris Akin — COO; Dr Charlotte Stix — Chief Governance Officer; Alexander Meinke — Head of Research; Jérémy Scheurer — Member of Technical Staff (Science); Rusheb Shah — Member of Technical Staff (Infrastructure & Security)
Site and address as published
London base not stated on pages opened (LISA lists Apollo as a resident); San Francisco office opened 2026; Washington DC office planned for June 2026
Headcount
Not stated. San Francisco office: 3 people, aiming for 10+ by the end of 2026 — 13 May 2026 (single source)
What it does
An AI safety organisation focused on "scheming", meaning AI systems covertly pursuing goals their developers did not intend. It studies the science of scheming, runs evaluations for frontier developers, works on governance of loss of control and internal deployment, and sells Watcher, a tool that monitors AI coding agents and can block unsafe actions.
Research groups or focus
Science (science of scheming; evaluations now second priority); Monitoring & Product; Governance (loss of control, internal deployment, automated AI R&D); Infrastructure & Security; Operations
Notable outputs
Watcher — control and security for coding-agent deployments, with Watcher Live (real-time blocking) and Watcher Analyze (observability) — 2026; pre-deployment testing of OpenAI's o1 — Dec 2024; anti-scheming research with OpenAI — date not stated
Selected papers
"Frontier Models are Capable of In-context Scheming" (Meinke, Schoen, Scheurer, Balesni, Shah, Hobbhahn) — arXiv — 6 Dec 2024 (v2 14 Jan 2025) — https://arxiv.org/abs/2412.04984 ; "Behind Closed Doors: A Primer on the Governance of Internal Deployment" — Apollo Research — date not stated — https://www.apolloresearch.ai/governance/ai-behind-closed-doors-a-primer-on-the-governance-of-internal-deployment/ ; "The Loss of Control Playbook: Degrees, Dynamics, and Preparedness" — arXiv — date not stated — https://arxiv.org/pdf/2511.15846 (link taken from Apollo's May 2026 update; I did not open the arXiv page to match it to the title) ; chapter on loss of control in the International AI Safety Report 2026, led by Charlotte Stix — 2026 — https://internationalaisafetyreport.org/publication/international-ai-safety-report-2026
Partners named
OpenAI — pre-deployment testing of o1, and anti-scheming research; UK Frontier AI Taskforce — policy recommendations; EU AI Office; a UN Advisory Body; US Congress
Uk government links
shared policy recommendations with the UK Frontier AI Taskforce
Status now
Active: now a Public Benefit Corporation, with a San Francisco office and a planned Washington office.

Labs Round 8 deep profile (31 Oct 2026), as the researchers wrote it; confidence: one source (status change to PBC from Apollo's own page only).

Sources

  1. apolloresearch.ai/about
  2. apolloresearch.ai/blog/apollo-update-may-2026
  3. arxiv.org/abs/2412.04984
  4. safeai.org.uk/
London (WC2A 2JR)Companies House · find-and-update.company-information.service.gov. · apolloresearch.ai/about · apolloresearch.ai/blog/apollo-update-may-2026 · apolloresearch.ai/blog/apollo-update-may-2026verified
Arcadia ImpactNetworks, bodies, events and mediaLondon non-profit doing AI safety field-building: Safe AI London, London AI Safety Research Labs, student groups and the LEAH office.Londonforum.effectivealtruism.org/posts/2M4KQWBoNiLpWF · openphilanthropy.org/grants/arcadia-impact-ea-anverified
ArchestraCompaniesMakes open-source software that connects AI agents to company data while adding security layers to stop data leaking.LondonCompanies House · uktech.news/ai/archestra-raises-2-5m-to-protect- · find-and-update.company-information.service.gov. · find-and-update.company-information.service.gov. · tech.eu/2026/06/02/archestraai-raises-10m-to-unlverified
ARENASchemes, programmes and AI linesAI safety mentorship and upskilling programme hosted at LISA's London office.Londonlesswrong.com/posts/P7dbHRYfwykEJiDYX/announcing · safeai.org.uk/verified
BlueDot ImpactNetworks, bodies, events and mediaAI safety organisation based at LISA's London hub, named at LISA's launch and still listed on LISA's site.Londonlesswrong.com/posts/P7dbHRYfwykEJiDYX/announcing · safeai.org.uk/verified
Chatterbox LabsCompaniesSells AIMI, software that measures the risks of AI models and agents, such as safety, security and bias, as numbers that firms can act on.London (SE1 7ND)Companies House · chatterbox.co/about-us/ · find-and-update.company-information.service.gov. · qmul.ac.uk/eecs/research/industry-partnerships--verified
CheckstepCompaniesLondon trust and safety software that combines moderation models with Online Safety Act and DSA enforcement workflows, appeals and transparency reports.LondonWebsite · Companies Houseone source
Faculty AI evaluations and red teamingSchemes, programmes and AI linesFaculty's team that tests the most powerful AI models for dangerous abilities and weak safeguards before release, for frontier AI labs.Londonfaculty.ai/en-gb/ai-evaluations-redteaming · faculty.ai/en-gb/insights/articles/accenture-to- · newsroom.accenture.com/news/2026/accenture-complverified
Harmonic SecurityCompaniesSoftware that lets companies control what staff share with AI tools, to stop sensitive data leaking.London (registered office)Companies House · tech.eu/2026/10/19/european-tech-weekly-recap-mo · find-and-update.company-information.service.gov.verified
LASR Labs (London AI Safety Research Labs)Schemes, programmes and AI linesLondon AI safety research programme that runs regular cohorts; hosted at LISA and funded through Arcadia Impact's Open Philanthropy grant.Londonlesswrong.com/posts/P7dbHRYfwykEJiDYX/announcing · openphilanthropy.org/grants/arcadia-impact-ea-anverified
Leap LabsCompaniesAI safety organisation hosted in LISA's London office when LISA launched in 2024. listedLondonlesswrong.com/posts/P7dbHRYfwykEJiDYX/announcingone source
London Initiative for Safe AI (LISA)Networks, bodies, events and mediaA shared research centre in London that houses AI safety researchers and small AI safety organisations.
Profile
Owner or parent
Safe AI London Ltd, a registered charity (1211693) and company (14942848) in England and Wales
Founded or opened
Not stated on pages opened
Lab director or lead
Krzysztof Bar — CEO — date not stated
Other leaders
Emma Hall — Director of Ecosystem; David Arnold — Director of Transformation; Nina Wolff-Ingham — Operations Lead; trustees Charles Ciumei, Andrew Sutton, Adam Gleave, Ryan Kidd, David Norman, Connor Campbell
Site and address as published
central London, "the heart of London's AI corridor" (no street address)
What it does
A charity that runs an AI safety centre in central London. It houses AI safety organisations, training programmes, independent researchers and visiting experts, with the stated mission of building the ecosystem needed to navigate transformative AI safely. Named residents: Apollo Research, BlueDot and IAPS. Programmes named: LASR Labs, Pivotal Research, ARENA, the Princint residency and the Tarbell Center.
Research groups or focus
hosted organisations and programmes as listed above
Funding or budget as published
backers not named
Partners named
Apollo Research, BlueDot, IAPS — resident organisations; LASR Labs, Pivotal Research, ARENA, Princint, Tarbell Center — programmes (dates not stated)
Status now
Active, per its website read on 31 Oct 2026.

Labs Round 8 deep profile (31 Oct 2026), as the researchers wrote it; confidence: one source.

Sources

  1. safeai.org.uk/
  2. safeai.org.uk/team
Londonforum.effectivealtruism.org/posts/4pnr37kpDKTDvu · safeai.org.uk/team · safeai.org.uk/ · lesswrong.com/posts/P7dbHRYfwykEJiDYX/announcingone source
MindgardCompaniesAttacks AI models, agents and AI-based applications the way a hacker would, to find and block security weaknesses.London (EC3M 7AT)Companies House · find-and-update.company-information.service.gov. · uktech.news/ai/lancaster-spinout-mindgard-raises · uktech.news/tag/mindgard · plexal.com/news/future-ai-security-lasr-lates-loone source
Safe AI London (SAIL)Schemes, programmes and AI linesArcadia Impact project helping people in London into careers that reduce risks from advanced AI: reading groups, upskilling and outreach.Londonforum.effectivealtruism.org/posts/2M4KQWBoNiLpWF · openphilanthropy.org/grants/arcadia-impact-ea-anverified
Safe IntelligenceCompaniesSells software that checks how a trained AI model behaves across very many possible inputs, to find hidden weak points before it is used.
Profile
Founded
Not stated (spin-out from Imperial College London)
Founders
Alessio Lomuscio — founder and CTO (Professor of Safe Artificial Intelligence, Imperial College London)
Chief executive
Steven Willmott — from Feb 2025 (earlier led product and engineering; founded 3scale, acquired by Red Hat)
Chief scientist or research lead
Alessio Lomuscio — CTO
Hq
London (England: London) per release dateline; other_offices: not stated
What it does
Safe Intelligence sells tools that check whether AI systems behave as intended. It began with formal verification and "robustification" of machine-learning models (vision and tabular), and in April 2026 launched Spec27, which writes tests from a specification and validates AI applications and agents before and after deployment.
Research focus
Formal verification and robustness of neural networks and tree ensembles; specification-driven validation of AI agents.
Models and products
Spec27 — "automated specification-driven validation platform for AI applications and agents", early access — 8 Apr 2026; verification and robustification platform and command-line tools — Feb 2025
Customers or partners named
Not stated (target sectors: finance, mobility, robotics, aviation)
Selected papers
Scalable Neural Network Geometric Robustness Validation via Hölder Optimisation (Y. Zhang, P. Kouvaros, A. Lomuscio) — NeurIPS 2025 — Dec 2025 — https://openreview.net/pdf?id=Va1IHqY3jG
Rounds found
20 Feb 2025 — seed — £4.15m — Amadeus Capital Partners — OTB Ventures, Vsquared Ventures (already DEAL-LAB-2017 / DEAL-SAFE-002)
Status now
Trading; launched Spec27 in early access in April 2026.

Labs Round 8 deep profile (31 Oct 2026), as the researchers wrote it; confidence: one source.

Sources

  1. safeintelligence.ai/safe-intelligence-raises-4m-
  2. safeintelligence.ai/introducing-spec27-spec-driv
  3. safeintelligence.ai/scalable-neural-network-geom
London (registered office N8 0RL)Companies House · find-and-update.company-information.service.gov. · find-and-update.company-information.service.gov. · uktech.news/ai/safe-intelligence-raises-4m-20250 · safeintelligence.ai/safe-intelligence-raises-4m-verified
SafeToNetCompaniesLondon maker of on-device child safeguarding software (HarmBlock) that blocks sextortion, grooming and abuse content on phones.LondonWebsite · Companies Houseone source
VerifyMyCompaniesLondon company selling privacy-preserving age estimation, identity verification and AI-plus-human moderation of content before it is published.LondonWebsite · Companies Houseone source

Tile photo: Bletchley Park Mansion, DeFacto, CC BY-SA 4.0 (Wikimedia Commons).