How the use of facial recognition technology caused the wrong Black man to be arrested.
The police were waiting for Robert Williams when he returned home from work in Detroit, Michigan. They arrested him for robbery in front of his wife and terrified daughters aged two and five and took him to a detention centre where he was kept overnight. During his interview an officer showed him two grainy CCTV photos of a suspect alongside a photo of Williams from his driving licence. All the photos showed a large Black man, but that’s where the similarity ended – it wasn’t Williams on CCTV but a completely different man. Williams held up the photos to his face and said “I hope you don’t think all Black people look alike”, the officer replied that “the computer must have got it wrong.”
William’s problems began several months before his arrest when video clips and images of the robbery from the CCTV camera were run through face recognition software used by the Detroit Police Department. The system has access to the photos from everyone’s driving licence and can compare different faces until it finds a potential match and in this case it falsely identified Robert Williams. No system is ever perfect but studies have shown that face recognition technology is often better at correctly matching lighter skinned faces than darker skinned ones.
The way facial recognition works is not actually by comparing pictures but by comparing data. When a picture of a face is added to the system, essentially lots of measurements are taken such as how far apart the eyes are, or what the shape of the nose is. That signature is added to the database. When looking for a match from say a CCTV image, the signature of the new image is first determined. Then algorithms look for the signature in the database “nearest” to the one in the database. This gives a signature for each face made up of all the numbers. How well it works depends on the particular features chosen, amongst many other things. If the features chosen are a poor way to distinguish particular groups of people then there will be lots of bad matches. But how does it decide what is “nearest” anyway given in essence it is just comparing groups of numbers? More algorithms are used based on, for example, machine learning. The system might be trained on lots of faces and told which match and which don’t, allowing it to look for patterns that are good ways to predict matches. If, however, it is trained on mainly light-skinned faces it is likely to be bad at spotting matches for faces of other ethnic backgrounds. It may actually decide that “all black people look alike”.
However face recognition is only part of the story. A potential match is only a pointer towards someone who might be a suspect and it’s certainly not a ‘case closed’ conclusion – there’s still work to be done to check and confirm. But as Williams’ lawyer, Victoria Burton-Harris, pointed out once the computer had suggested Williams as a suspect that “framed and informed everything that officers did subsequently”. The man in the CCTV image wore a red baseball cap. It was for a team that Williams didn’t support (he’s not even a baseball fan) but no-one asked him about it. They also didn’t ask if he was in the area at the time (he wasn’t) or had an alibi (he did). Instead the investigators asked a security guard at the shop where the theft took place to look at some photos of possible suspects and he picked Williams from the line-up of images. Unfortunately the guard hadn’t been on duty on the day of the theft and had only seen the CCTV footage.
Robert Williams spent 30 hours in custody for a crime he didn’t commit after his face was mistakenly selected from a database. He was eventually released and the case dropped but his arrest is still on record along with his ‘mugshot’, fingerprints and a DNA sample. In other words he was wrongly picked from one database and has now been unfairly added to another. The experience for his whole family has been very traumatic and sadly his children’s first encounter with the police has been a distressing rather than a helpful one.
The American Civil Liberties Union (ACLU) has filed a lawsuit against the Detroit Police Department on Williams’ behalf for his wrongful arrest. It is not known how many people have been arrested because of face recognition technology but given how widely it is used it’s likely that others will have been misidentified too. The ACLU and Williams have asked for a public apology, for his police record to be cleared and for his images to be removed from any face recognition database. They have also asked that the Detroit Police Department stop using facial recognition in their investigations. If Robert Williams had lived in New Hampshire he’d never have been arrested as there is a law there which prevents face recognition software from being linked with driving license databases.
In June 2020 Amazon, Microsoft and IBM denied the police any further access to their face recognition technology and IBM has also said that it will no longer work in this area because of concerns about racial profiling (targeting a person based on assumptions about their race instead of their individual actions) and violation of privacy and human rights. Campaigners are asking for a new law that protects people if this technology is used in future. But the ACLU and Robert Williams are asking for people to just stop using it – “I don’t want my daughters’ faces to be part of some government database. I don’t want cops showing up at their door because they were recorded at a protest the government didn’t like.”
Technology is only as good as the data and the algorithms it is based on. However, that isn’t the whole story even if very accurate, it is only as good as the way it is used. If as a society our aim is to protect people from bad things happening, perhaps some technologies should not be used at all.
by Jo Brodie and Paul Curzon
We’ll be adding new articles to our Computing and Society page.
Black and white eye surveillance image by Gordon Johnson from Pixabay
CCTV camera image by StockSnap from Pixabay
References and further reading
- IBM, Microsoft and Amazon not letting police use their facial recognition technology (12 June 2020) Forbes
- Tech companies push for nationwide facial recognition law. Now comes the hard part (13 June 2020) CNN
- How is face recognition surveillance rechnology racist? (16 June 2020) ACLU
- I was wrongfully arrested because of facial recognition. Why are police allowed to use it? (24 June 2020) Washington Post – by Robert Williams
- Wrongfully arrested because face recognition can’t tell Black people apart (24 June 2020) ACLU (ACLU calls on lawmakers to immediately stop law enforcement use of face recognition technology)
- The untold number of people implicated in crimes they didn’t commit because of face recognition (24 June 2020) ACLU
- ‘The computer got it wrong’: how facial recognition led to false arrest of Black man (24 June 2020) NPR
- Complaint: Detroit police facial recognition misidentified black man as watch thief (24 June 2020) Deadline Detroit
- 5 ideas to make Silicon Valley less racist (26 June 2020) OneZero
Pingback: Computing and society – useful vignettes for teaching about online safety and better, inclusive design ^JB | Teaching London Computing: A RESOURCE HUB from CAS LONDON & CS4FN