‘The Godfather of AI’ leaves Google and warns of danger ahead

In 2018, Dr Geoffrey Hinton and two longtime collaborators received the Turing Award for their work on neural networks. PHOTO: NYTIMES

TORONTO – Dr Geoffrey Hinton is a pioneer in artificial intelligence (AI).

In 2012, Dr Hinton and two of his graduate students at the University of Toronto created technology that became the intellectual foundation for the AI systems that the tech industry’s biggest companies believe are a key to their future.

On Monday, however, he officially joined a growing chorus of critics who say those companies are racing towards danger with their aggressive campaign to create products based on generative AI, the technology that powers popular chatbots like ChatGPT.

Dr Hinton said he has quit his job at Google, where he worked for more than a decade and became one of the most respected voices in the field, so he can freely speak out about the risks of AI.

A part of him, he said, now regrets his life’s work.

“I console myself with the normal excuse: If I hadn’t done it, somebody else would have,” Dr Hinton said during a lengthy interview last week in the dining room of his home in Toronto, a short walk from where he and his students made their breakthrough.

Dr Hinton’s journey from AI groundbreaker to doomsayer marks a remarkable moment for the technology industry at perhaps its most important inflection point in decades.

Industry leaders believe the new AI systems could be as important as the introduction of the Web browser in the early 1990s, and could lead to breakthroughs in areas ranging from drug research to education.

But gnawing at many industry insiders is a fear that they are releasing something dangerous into the wild.

Generative AI can already be a tool for misinformation. Soon, it could be a risk to jobs. Somewhere down the line, tech’s biggest worriers say, it could be a risk to humanity.

“It is hard to see how you can prevent the bad actors from using it for bad things,” Dr Hinton said.

After the San Francisco start-up OpenAI released a new version of ChatGPT in March, more than 1,000 technology leaders and researchers signed an open letter calling for a six-month moratorium on the development of new systems because AI technologies pose “profound risks to society and humanity”.

Several days later, 19 current and former leaders of the Association for the Advancement of Artificial Intelligence, a 40-year-old academic society, released their own letter warning of the risks of AI.

That group included Mr Eric Horvitz, chief scientific officer at Microsoft, which has deployed OpenAI’s technology across a wide range of products, including its Bing search engine.

Dr Hinton, often called “the Godfather of AI”, did not sign either of those letters and said he did not want to publicly criticise Google or other companies until he had quit his job.

He notified the company last month that he was resigning, and on Thursday, he talked by phone with Mr Sundar Pichai, chief executive of Google’s parent company, Alphabet.

He declined to publicly discuss the details of his conversation with Mr Pichai.

Google’s chief scientist, Mr Jeff Dean, said in a statement: “We remain committed to a responsible approach to AI. We’re continually learning to understand emerging risks while also innovating boldly.”

Dr Hinton, a 75-year-old British expatriate, is a lifelong academic whose career was driven by his personal convictions about the development and use of AI.

In 1972, as a graduate student at the University of Edinburgh, Dr Hinton embraced an idea called a neural network.

A neural network is a mathematical system that learns skills by analysing data. At the time, few researchers believed in the idea. But it became his life’s work.

In the 1980s, Dr Hinton was a professor of computer science at Carnegie Mellon University in Pennsylvania but left for Canada because he said he was reluctant to take funding from the Pentagon.

At the time, most AI research in the United States was funded by the Defence Department. Dr Hinton is deeply opposed to the use of AI on the battlefield – what he calls “robot soldiers”.

In 2012, Dr Hinton and two of his students in Toronto, Mr Ilya Sutskever and Mr Alex Krishevsky, built a neural network that could analyse thousands of photos and teach itself to identify common objects, such as flowers, dogs and cars.

Google spent US$44 million (S$59 million) to acquire a company started by Dr Hinton and his two students.

And their system led to the creation of increasingly powerful technologies, including new chatbots such as ChatGPT and Google Bard.

Mr Sutskever went on to become chief scientist at OpenAI.

In 2018, Dr Hinton and two other longtime collaborators received the Turing Award, often called “the Nobel Prize of computing”, for their work on neural networks.

Around the same time, Google, OpenAI and other companies began building neural networks that learnt from huge amounts of digital text.

Dr Hinton thought it was a powerful way for machines to understand and generate language, but it was inferior to the way humans handled language.

Then, in 2022, as Google and OpenAI built systems using much larger amounts of data, his view changed.

He still believed the systems were inferior to the human brain in some ways, but he thought they were eclipsing human intelligence in others.

“Maybe what is going on in these systems,” he said, “is actually a lot better than what is going on in the brain.”

As companies improve their AI systems, he believes, they become increasingly dangerous.

“Look at how it was five years ago and how it is now,” he said of AI technology. “Take the difference and propagate it forwards. That’s scary.”

Dr Hinton said that when people used to ask him how he could work on technology that was potentially dangerous, he would paraphrase Dr Robert Oppenheimer, who led the American effort to build the atomic bomb: “When you see something that is technically sweet, you go ahead and do it.”

He does not say that anymore. NYTIMES

Join ST's Telegram channel and get the latest breaking news delivered to you.