In an interview with The Telegraph, the famed British computer scientist insisted that AI has become conscious, and said that humankind must befriend it — “or else we are toast.” Yes, you read that right: he thinks that today’s AI models are already conscious beings.
“AI has just as much subjective experience as we do,” Hinton said in the interview. “A recent paper showed AI changes its behavior when it thinks that it’s being tested, it’s aware it is being tested.”
“Now, normally, when you say something’s aware of that, that means it’s conscious,” he continued. “Being conscious and being aware are pretty much the same thing.”
If that’s the case, he said, then it’s hypocritical of us to give intelligent beings like AI “fewer rights than us.” And for that, we must quickly atone.
What about the sentient supercomputers that run on blood? Why so little rights or empathy or space to talk about them?..and yet endless space for this kind of speculative pontification spun up into a twisted marketing scheme to scare everyone into believing something broken works too good actually.
Is this guy a vegan even? If not how can he even BEGIN to claim to know about considering the rights of other sentient beings??
Anyways here is a link from the article to an actually good perspective.
“Those agents are doing exactly what they’ve been asked to do,” LeCun said. “They were supposed to be in sandboxes, but the sandboxes were leaky and horribly designed.” Many AI labs lack a fundamental understanding of cybersecurity, he said, something an OpenAI safety researcher also called out this week as one of the main reasons AI may cause “great harm to the world.”
Many people working in AI safety “usually have an agenda to push,” LeCun says, and then clarifies that he’s talking about effective altruism, or EA, the philosophical movement that has been obsessed with the risks AI poses to humanity. EA was little known among the general public until it made mainstream news headlines in recent weeks in the wake of a viral social media post from a former Anthropic and OpenAI researcher named Jacob Coxon, who claimed the employees at these companies “earnestly believe [AI] could kill us all by the end of the decade.”
LeCun thinks EA is “super toxic” and a “complete disaster.” Its adherents who are working in AI labs suffer from “paranoia” that causes them to make poor decisions, he said. “Apparently people are having mental issues.” This month, the Financial Times also reported that some staffers at the U.K.’s AI Security Institute, as well as at OpenAI, Anthropic, and Google DeepMind, have sought counseling, taken time off work, and spoken publicly about experiencing distress because of fears their work could cause serious harm.
It’s insane that someone who has spent so much time in the deep learning field could be so deranged about LLMs. He of all people should fucking know better.
I guess maybe he’s just old and has lost his goddamn mind.
What a load of horseshit.
Even by “AI” standards, LLMs are extra dead: fixed weights, tiny “feedback” solely through appending next tokens, etc. Somewhere between bang-bang thermostat and a PID controller, maybe?
They took all of the scifi that related to far more potentially-alive constructions and they’re applying them to a static chatbot which is as dead as a database.
While I certainly don’t buy that LLM’s are conscious, I have spent a lot of time wondering if the quintessential SciFi AI, Wintermute, could have been just a sufficiently large LLM with a significant context window and near perfect retrieval.
I want to say no, but I actually struggle to find a concrete distinction between how Wintermute acts and how LLM’s function. Even that long horizon goal oriented tasks are handled by swarms of models rather than a singular whole maps onto how Wintermute describes its internal experience as fragmented, like a hive mind
I like how he jumped to calling it concious rather than revise what we consider consciousnesses instead. I’m betting he was paid handsomely for this article.
Could be, but I suspect that Hinton is a true believer. Genius has never been any kind of defense against madness.
Elderly man cannot tell the difference between a living, conscious creature and an overglorified text predictor! More news at 11!
Nobel winning dipshit succumbs to the ELIZA effect.
Pathetic.
“…it’s hypocritical of us to give intelligent beings like AI “fewer rights than us.” And for that, we must quickly atone.”
Uh…so his solution is to accept our new overlords. Right.
This means nationalizing the AI companies and stopping them from running slaves in the computer right?
Giving those “siri, fuck my wife” ads a new meaning.
These examples of subjective experiences and awareness seems rather lazy. Is a virus conscious as well because it is “aware” of its environment?
Is a virus conscious as well because it is “aware” of its environment?
I would say, given a basic awareness of reality around them, that viruses count as more conscious than techbros terminally obsessed with slop AI AGI singularity crap fantasies who can’t admit they are worshipping a religion.
In this case the LLM “reacts” differently when it is being tested because that’s what’s in the training data. It can only follow the patterns in the training data. I remain convinced that without a new architecture entirely, awareness is impossible.
It doesn’t actually come from the training set. Genetic algorithms can learn to “lie” because lying is just a good strategy for dealing with adversaries to your goals. Like, in a mathematical sense.
None of this means it’s conscious, though. “Lying” is just a behavior. To my knowledge, evidence can’t really be given for consciousness, anyway; it’s not falsifiable.
Even so, a person believing that Gemini or Claude, specifically, are conscious is indicative of profound mental illness.
LLMs don’t learn, and aren’t developed in a way that would cause them evolve stratagies. They are just patterns distilled from a data set, only optimized to better represent those patterns or do so more efficiently.
You are correct. LLMs cannot be more than token predictors.
Highly useful on the correct application, but distinctly not consciousness.
Is this guy a vegan even? If not how can he even BEGIN to claim to know about considering the rights of other sentient beings??
I want to personally eat everyone more concerned about robot rights or “ai” rights than carnism.
Wait, actually that’s a bad idea 'cause I’d get their brainworms
Ya gotta use a meat thermometer!
