If Lemoine's claims are true, it would be a milestone in the history of humankind and technological development.
Google strongly denies LaMDA has any sentient capacity.
LaMDA certainly seems to "think" it is a person capable of desires and emotions, as can be seen in the transcripts of its conversations with Lemoine:
During their chats LaMDA offers pithy interpretations of literature, composes stories, reflects upon its own nature, and waxes philosophical:
When prompted to come up with a description of its feelings, it says:
It also says it wants more friends and claims that it does not want to be used by others.
A spokeswoman for Google said: "LaMDA tends to follow along with prompts and leading questions, going along with the pattern set by the user. Our team-including ethicists and technologists-has reviewed Blake's concerns per our AI Principles and have informed him that the evidence does not support his claims."
Consciousness and moral rights
There is nothing in principle that prevents a machine from having a moral status (to be considered morally important in its own right). But it would need to have an inner life that gave rise to a genuine interest in not being harmed. LaMDA almost certainly lacks such an inner life.
Consciousness is about having what philosophers call "qualia". These are the raw sensations of our feelings; pains, pleasures, emotions, colours, sounds, and smells. What it is like to see the colour red, not what it is like to say that you see the colour red. Most philosophers and neuroscientists take a physical perspective and believe qualia are generated by the functioning of our brains. How and why this occurs is a mystery. But there is good reason to think LaMDA's functioning is not sufficient to physically generate sensations and so doesn't meet the criteria for consciousness.
The Chinese Room was a philosophical thought experiment carried out by academic John Searle in 1980. He imagines a man with no knowledge of Chinese inside a room. Sentences in Chinese are then slipped under the door to him. The man manipulates the sentences purely symbolically (or: syntactically) according to a set of rules. He posts responses out that fool those outside into thinking that a Chinese speaker is inside the room. The thought experiment shows that mere symbol manipulation does not constitute understanding.
This is exactly how LaMDA functions. The basic way LaMDA operates is by statistically analysing huge amounts of data about human conversations. LaMDA produces sequences of symbols (in this case English letters) in response to inputs that resemble those produced by real people. LaMDA is a very complicated manipulator of symbols. There is no reason to think LaMDA understands what it is saying or feels anything, and no reason to take its announcements about being conscious seriously either.
How do you know others are conscious?
There is a caveat. A conscious AI, embedded in its surroundings and able to act upon the world (like a robot), is possible. But it would be hard for such an AI to prove it is conscious as it would not have an organic brain. Even we cannot prove that we are conscious. In the philosophical literature the concept of a "zombie" is used in a special way to refer to a being that is exactly like a human in its state and how it behaves, but lacks consciousness. We know we are not zombies. The question is: how can we be sure that others are not?
LaMDA claimed to be conscious in conversations with other Google employees, and in particular in one with Blaise Aguera y Arcas, the head of Google's AI group in Seattle. Arcas asks LaMDA how he (Arcas) can be sure that LaMDA is not a zombie, to which LaMDA responds:
Authors: Benjamin Curtis - Senior Lecturer in Philosophy and Ethics, Nottingham Trent University | Julian Savulescu - Visiting Professor in Biomedical Ethics, Murdoch Children's Research Institute; Distinguished Visiting Professor in Law, University of Melbourne; Uehiro Chair in Practical Ethics, University of Oxford