UN Experts Sound Alarm Over AI-enhanced Racial Profiling
Mohammad Ali (@ChaudhryMAli88) Published November 26, 2020 | 05:03 PM
Countries must do more to combat racial profiling, UN rights experts said Thursday, warning that artificial intelligence programmes like facial recognition and predictive policing risked reinforcing the harmful practice
Geneva, (APP - UrduPoint / Pakistan Point News - 26th Nov, 2020 ) :Countries must do more to combat racial profiling, UN rights experts said Thursday, warning that artificial intelligence programmes like facial recognition and predictive policing risked reinforcing the harmful practice.
Racial profiling is not new but the technologies once seen as tools for bringing more objectivity and fairness to policing appear in many places to be making the problem worse.
"There is a great risk that (AI technologies will) reproduce and reinforce biases and aggravate or lead to discriminatory practices," Jamaican human rights expert Verene Shepherd told AFP.
She is one of the 18 independent experts who make up the UN Committee on the Elimination of Racial Discrimination (CERD), which on Thursday published guidance on how countries worldwide should work to end racial profiling by law enforcement.
The committee, which monitors compliance by 182 signatory countries to the International Convention on the Elimination of All Forms of Racial Discrimination, raised particular concern over the use of AI algorithms for so-called "predictive policing" and "risk assessment".
The systems have been touted to help make better use of limited police budgets, but research suggests it can increase deployments to communities which have already been identified, rightly or wrongly, as high-crime zones.
"Historical arrest data about a neighbourhood may reflect racially biased policing practices," Shepherd warned.
"Such data will deepen the risk of over-policing in the same neighbourhood, which in turn may lead to more arrests, creating a dangerous feedback loop." When artificial intelligence and algorithms use biased historical data, their profiling predictions will reflect that.
"Bad data in, bad results out," Shepherd said.
"We are concerned about what goes into making those assumptions and those predictions." The CERD recommendations also take issue with the growing use of facial recognition and surveillance technologies in policing.
Shepherd said the committee had received a number of complaints about misidentification by such technologies, sometimes with dire consequences, but did not provide specific examples.
The issue came to the forefront with the wrongful arrest in Detroit earlier this year of an African American man, Robert Williams, based on a flawed algorithm which identified him as a robbery suspect.
Various studies show facial recognition systems developed in Western countries are far less accurate in distinguishing darker-skinned faces, perhaps because they rely on databases containing more white, male faces.
"We have had complaints of such misidentification because of where the technologies are coming from, who is making them, and what samples they have in their system," Shepherd said.
"It is a real concern." CERD is calling for countries to regulate private companies that develop, sell or operate algorithmic profiling systems for law enforcement.
Countries have a responsibility to ensure that such systems comply with international human rights law, it said, stressing the importance of transparency in design and application.
The committee insisted the public should be informed when such systems are being used and told how they work, what data sets are being used and what safeguards are in place to prevent rights abuses.
The recommendations meanwhile go beyond the impact of new technologies, urging countries to introduce laws against all forms of racial discrimination by law enforcement.
"Racial profiling precedes these technologies," Shepherd said.
She said 2020 -- a year marked by surging racial tensions in many parts of the world -- was a good time to present the new guidelines.
The committee, she said, "hopes that the intensification and globalisation of Black Lives Matter ... and other campaigns calling for attention to discrimination against certain vulnerable groups will help (underline) the importance of the recommendations."
Recent Stories
PTI to stage nationwide protests against alleged electoral frauds
Senate continues discussion on Presidential address to Joint Sitting of Parliame ..
Masood Khan calls for Pak-US cooperation for regional peace
Interior Minister starts Margalla Trail Patrol for security
Currency Rate In Pakistan - Dollar, Euro, Pound, Riyal Rates On 26 April 2024
Today Gold Rate in Pakistan 26 April 2024
ICC Womens T20 World Cup Qualifier, Match 2: Ireland Women open with Comfortable ..
Robinson, bowlers help New Zealand go 2-1 up against Pakistan
Shahzeb Chachar to hold khuli kachehri on April 26
Heatwave amid Israel's aggression in Gaza brings new misery, disease risk
Tourism must change, mayor says as Venice launches entry fee
Court adjourns Judicial Complex attack case till May 17
More Stories From World
-
Ukraine agriculture minister freed on bail in corruption case
17 minutes ago -
Vietnam National Assembly head resigns amid graft purge
17 minutes ago -
Calls for mosque demolition weigh on India's Muslim voters
27 minutes ago -
Chinese shares close higher Friday
27 minutes ago -
China's EV execs bullish on Western pressure at Beijing car show
37 minutes ago -
EU toughens rules on fashion retailer Shein
37 minutes ago
-
Xi meets U.S. secretary of state in Beijing
47 minutes ago -
Ukrainian minister detained over suspected corruption: prosecutors
48 minutes ago -
Golf: PGA Zurich Classic of New Orleans scores
57 minutes ago -
Pilot seriously injured after vintage plane crash in Western Australia
1 hour ago -
Iron ore futures close higher
1 hour ago -
Tabloid head wanted to 'protect' Trump from salacious stories
1 hour ago