For subscribers

How can we tell good AI from bad?

More lessons from the jagged frontiers of new technology

Sign up now: Get ST's newsletters delivered to your inbox

All technologies are good at somethings, - like mimicking human expressions (above) - and bad at others. The difficulty with AI is it can be hard to tell when it is doing a good job, says the writer.

All technologies are good at some things – like mimicking human expressions (above) – and bad at others. The difficulty with AI is it can be hard to tell when it is doing a good job, says the writer.

PHOTO: AFP

Tim Harford

Google Preferred Source badge

Among the many steps along the road to high-performance artificial intelligence (AI), one of the most important was taken in 2007 by Professor Fei-Fei Li, then an assistant professor in Princeton’s computer science department. Using Amazon’s Mechanical Turk service to amass many millions of small acts of human judgment, Prof Li built a vast database of hand-labelled images.

“We settled on a goal of 1,000 different photographs of every single object category,” she writes in her autobiography The Worlds I See. “One thousand different photographs of violins. One thousand different photographs of German shepherds.”

See more on