China firm develops system to recognise faces behind coronavirus masks

A software engineer in Beijing working on a facial recognition program that identifies people when they wear a face mask on March 6, 2020. PHOTO: REUTERS

BEIJING (REUTERS) - A Chinese company says it has developed the country's first facial recognition technology that can identify people when they are wearing a mask, as most are these days because of the coronavirus, and help in the fight against the disease.

China employs some of the world's most sophisticated systems of electronic surveillance, including facial recognition.

But the coronavirus which emerged in Hubei province late last year has resulted in almost everyone wearing a surgical mask outdoors in the hope of warding off the virus - posing a particular problem for surveillance.

Now Hanwang Technology, which also goes by the English name Hanvon, said it has come up technology that can successfully recognise people even when they are wearing masks.

"If connected to a temperature sensor, it can measure body temperature while identifying the person's name, and then the system would process the result, say, if it detects a temperature over 38 deg C," Hanwang vice-president Huang Lei said.

The Beijing-based firm said a team of 20 staff used core technology developed over the past 10 years, a sample database of about six million unmasked faces and a much smaller database of masked faces to develop the technology.

The team began work on the system in January as the coronavirus outbreak gathered pace, and began rolling it out to the market after just a month.

It sells two main types of products that use the technology.

One performs "single-channel" recognition that is best used at, for example, entrances to office buildings.

The other, more powerful, product is a "multi-channel"recognition system that uses "multiple surveillance cameras".

It can identify everyone in a crowd of up to 30 people "within a second", Mr Huang says.

"When wearing a mask, the recognition rate can reach about 95 per cent, which can ensure that most people can be identified," Mr Huang said, adding that the success rate for people without mask is about 99.5 per cent.

Losing facial information

A big customer, not surprisingly, is the Ministry of Public Security, which runs the police.

Using Hanwang's technology, the ministry can cross-reference images with its own database of names and other information and then identify and track people as they move about, Mr Huang said.

"It can detect crime suspects, terrorists or make reports or warnings," he said.

But the system struggles to identify people with both a mask and sunglasses, he said.

"In this situation, all of the key facial information is lost. In such cases, recognition is tough," Mr Huang said.

The company has about 200 clients in Beijing using the technology, including the police, and expect scores more across 20 provinces to start installing it soon, Mr Huang said.

It is not immediately clear how Chinese citizens are reacting to this new technology.

When it comes to other surveillance tools being used in the fight against the coronavirus, there has been some grumbling on social media but most people seem to be accepting extra intrusion, or even embracing it, as a means to deal with the health emergency.

Although domestic customers have been driving Hanwang's business, Mr Huang also said he expected more foreign interest as the virus spreads around the world and more people wear face masks.

"It not only benefits Chinese people, but also, when the technology is applied globally, it can benefit the world," he said.

Join ST's Telegram channel and get the latest breaking news delivered to you.