Image: A visual interpretation of AI training. The training sequence is x0, x1, x2. The yellow and red are high error (mountains/hills), and the blue (valleys) is a low error. The sequence moves in the direction of steepest descent. So far in this series of posts, I haven’t really discussed much of my own research […]
Today, I will be talking about a topic in AI governance called “Agent Infrastructure”. It answers the question: “How do we build and enforce protocols for safe and secure interactions with AI?” We’ve done this before many times with new technology: radio and television, traffic (cars, trains, ships, planes), space, financial securities, and closest to […]
Is it possible to steal an AI? It turns out it can be done quite easily! Last week I spoke about the differences between AI Safety and AI Security and today I’d like to talk about a topic that is very much in the category of AI Security known as Model Exfiltration. I will also […]
Ensuring the safe, secure, and responsible development of AI technology is, in part, being coordinated through an emerging governance structure: a network of AI Safety Institutes (AISI). Canada, the United States, Singapore, Korea, and the United Kingdom count among other countries who are attempting to set up AISIs. Some of these institutes are called AI […]
Deep research and AlphaEvolve are recent developments in AI that point to the promise of automating scientific research. AI Pioneer Yoshua Bengio suggests that constructing “Scientist AI” is the most promising solution for AI Safety. In this post I will explain why an AI scientist misses the point of science, is not solution for AI […]
In previous posts, I highlighted some of the real risks of artificial intelligence. Today, I’d like to talk about solutions. My PhD work is on an emerging solution that has been pioneered Dalhousie: Digital Locks for Machine Learning. I won’t be getting into the technical details of how they work but many people are familiar […]
The word “agents” is about to become a buzzword. This is mostly due to the marketing of companies and researchers seeking funds. I recently attended a conference where a senior member of the research community said, “I remember [in the 90s] when agents became a bad word.” This researcher was implicitly warning us about the […]
I study Artificial Intelligence (AI) Safety so this is, of course, the first thing people ask me: “Should we be scared of artificial intelligence?” While the short answer is “yes,” I want to convince you that we should really be asking: “should we be scared of humans using AI”. Current risks I encourage the reader […]
