The secret humans behind Amazon’s AI stores are everywhere

The 1,000 contractors in India working on the company’s Just Walk Out technology offer a stark reminder that AI is not always what it seems.

Amazon’s Just Walk Out technology partially relied on more than 1,000 people in India watching and labelling videos. PHOTO: REUTERS
New: Gift this subscriber-only story to your friends and family

There is a grey area in artificial intelligence (AI) filled with millions of humans who work in secret – they are often hired to train algorithms but end up operating much of their work instead. These crucial workers took the spotlight this week when The Information reported that Amazon’s Just Walk Out technology, which allowed customers to grab grocery items from a shelf and walk out of the store, was being phased out of its grocery stores. It partially relied on more than 1,000 people in India who were watching and labelling videos to make sure the checkouts were accurate.

Amazon says on its website that Just Walk Out uses “computer vision, sensor fusion, and deep learning” but does not mention contractors. The company told Gizmodo that the workers were annotating videos to help improve them, and that they validated a “small minority” of shopping visits when its AI could not determine a purchase.

Already a subscriber? 

Read the full story and more at $9.90/month

Get exclusive reports and insights with more than 500 subscriber-only articles every month

Unlock these benefits

  • All subscriber-only content on ST app and straitstimes.com

  • Easy access any time via ST app on 1 mobile device

  • E-paper with 2-week archive so you won't miss out on content that matters to you

Join ST's Telegram channel and get the latest breaking news delivered to you.