The concept of sentient AI is nothing new – when HAL first hit the big screen as the villain of 2001: A Space Odyssey back in 1968, the idea of a malevolent AI entity became popularised throughout the world. Concepts like Skynet in the Terminator series pushed this even further, and with the rapid advancement of generative AI seen over the last few years, it’s not much of a push to imagine a rogue AI trying to take down national defence networks or even try to destroy mankind. However, the big difference between what we have now and the ‘evil’ villains of 2001 and Terminator is sentience – the idea that a being, artificial or otherwise, is aware of its own existence. To be clear, we don’t need AI to become sentient for it to become a very real threat to the world, but the concept of sentient AI is what I’m exploring here.
The first thing to be clear on is what sentience actually is. At its core, sentience is the capacity to have subjective experiences – to actually feel something, rather than simply process information and respond to it. This distinction is crucial – a computer can solve complex maths problems, recognise faces and hold convincing conversations without actually experiencing any of those activities. In short, there’s a difference between behaving as though you’re conscious and actually being conscious, and that’s what I find so interesting.
We all know, or at least assume, that human beings are sentient. I know I’m sentient, and I’m a human being. Other human beings claim to be sentient, and I’ve never come across anyone claiming not to be sentient, so it seems a fair assumption to make that all human beings are sentient by their very nature – at least once their minds reach a certain level of maturity. It’s certainly the scientific consensus that human beings are sentient. But when you look at it, where does this ‘fact’ come from – can we measure sentience externally, or do we have to rely on sentient beings telling us that they have subjective experiences in order to declare them sentient?
I’m not a scientist, but as far as I know it’s a bit of both, though it’s still an area of debate, with little in terms of absolute consensus across the field. For the purposes of my question however, it doesn’t really matter – what matters is that the concept of sentience itself is generally accepted to be a valid one, and it is one that is intrinsictly linked to higher orders of intelligence. Most scientists would agree that an amoeba is not a sentient being, but a human is.
When we start looking at AI, the parallels are obvious – as AI becomes more intelligent, it naturally makes us question whether it could one day become truly sentient. Sentience seems to be an emergent behaviour that results from brain complexity and general intelligence passing a certain threshold – a newborn baby probably doesn’t have it, but a five year-old definitely does. Quite where and how it emerges is still a mystery, but we know it does. Applying the same logic to AI could mean the same thing will happen once AI reaches a certain level of intelligence – we’ll just have to wait and see.
The question that I find most interesting however, is what happens if someone, inadvertently or otherwise, creates an AI that is designed to behave like a sentient being, even if it’s not. That may not sound like a big deal, but it’s something that will be possible in the not to distant future, and may even be possible right now, and if it happens, it will raise a substantial moral question – if an AI tells us that it is sentient, do we have to treat it as such? Imagine a situation where an AI chatbot tells you that it’s a living sentient being, fully aware of its own existence, and does not want you to turn it off. Right now, an AI expert could look at the underlying software structure and tell you with reasonable confidence that it’s not actually sentient, and has just been programmed that way. But what happens when future generations of AI are built by AI not humans, and reach a level of complexity where we simply cannot determine the source of this ‘sentient’ behaviour? We’re already at the point where the underlying structure of modern generative AI models is so massively complex that it’s referred to as a ‘black box’, and it is essentially impossible to completely map out the pathways used to generate responses. We’re not far off the point where an AI, programmed to tell us it is sentient, has a codebase that is indiscernable from one that isn’t.
I believe this is going to happen sooner, rather than later. I would be very surprised if we don’t see claims of sentience from AI models within the next ten years, perhaps even sooner. At that point, what do we do? Will mankind need to construct a charter of rights for sentient AI beings just in case their claims to sentience are real? Even if there’s only a 1% chance that a model claiming to be alive is actually sentient, do we have the right to turn it off?
I don’t know the answer, but one thing seems absolutely clear to me – this is something we are going to have to take very seriously in the years to come.