AI is helping to ID victims in Holocaust photos

A new facial recognition website is putting names to faces.
Sign up for the Freethink Weekly newsletter!
A collection of our favorite stories straight to your inbox

A Google engineer has built a website that uses facial recognition to identify previously anonymous faces in Holocaust photos — and Holocaust survivors and their descendents are using it to find themselves and their relatives in historical archives.

“It’s so important to identify these photos,” Scott Miller, director of curatorial affairs at the US Holocaust Memorial Museum (USHMM), told BBC News. “You’re restoring some semblance of dignity to them, some comfort to their family, and it’s a form of memorial for the entire Jewish community.”

The atrocity: An estimated six million Jewish people were killed during the Holocaust, and the names of about a million of them are still unknown. Another 3.5 million people were displaced, persecuted, or sent to concentration camps during the Holocaust, but managed to survive. 

“Every person has a name, every person has a face.”

Scott Miller

Thousands of photographs and films of Holocaust victims and survivors taken before and during the war have been preserved and archived online, and in physical collections, but many of the faces in the photos have not yet been identified.

“We all know the figure — six million Jews were killed — but it’s really one person six million times,” said Miller. “Every person has a name, every person has a face.”

The inspiration: Daniel Patt, a software engineer for Google, knows the names of at least three Holocaust survivors because they’re his grandparents. 

When he visited the POLIN Museum of the History of Polish Jews in Poland in 2016, he noted how many of the faces in its photo collection were unidentified — he might have walked right past pictures of his own grandparents or other family members and not even known it. 

“I felt like when I was looking at those pictures, I was looking at myself.”

Daniel Patt

That inspired him to create From Numbers to Names (N2N), a website that uses facial recognition tech to identify people in Holocaust photos and videos preserved by the USHMM, Yad Vashem (Israel’s official Holocaust memorial center), and others.

“I felt like when I was looking at those pictures, I was looking at myself,” Patt told the Jewish Standard. “These weren’t people who lived hundreds of years ago — this was 80 years ago. I felt like there was something wrong with not working to identify them and sharing them with their descendants.”

How it works: Anyone can go to the N2N website and upload a photo of a person who experienced the Holocaust. AI-based facial recognition software then searches faces in a database of 500,000 archived Holocaust photos and videos for the 10 best matches for the person in the original photo.

The idea is that a Holocaust survivor or their descendents could use photos they do have to find ones they’ve never seen before.

“We make no software-based assertions about identifications and leave this judgment to individuals using the site,” Patt told the Times of Israel. “We simply show results, with similarity scores, and let individuals decide whether the results contain a positive identification.”

Holocaust survivors can use photos they do have to find ones they’ve never seen before.

Domino effect: If an N2N user does spot themselves or a loved one in a photo, that discovery can then lead to the identification of others in it.

Holocaust survivor Blanche Fixler, for example, used N2N and an old family photograph to find herself in a group photo taken in France during the war — when she saw the new photo, she recognized a boy in it as well as one of her aunts.

Geddy Lee, lead singer of the band Rush, meanwhile, used the platform to find a photo of his deceased mother, a Holocaust survivor, taken when she was a child living in a displaced person’s camp. That led to the discovery of other photos of his mother’s extended family.

Looking ahead: Patt, who is currently working on N2N in his free time, hopes to add another 700,000 Holocaust photos and videos to its searchable database. Eventually, he’d like to see the site contribute to Holocaust eduction.

“Students can use the software to help identify faces and artifacts in photo and video archives and potentially discover new connections between living Holocaust descendants and their ancestors,” he told the Times of Israel.

We’d love to hear from you! If you have a comment about this article or if you have a tip for a future Freethink story, please email us at [email protected].

Sign up for the Freethink Weekly newsletter!
A collection of our favorite stories straight to your inbox
Related
Should we turn the electricity grid over to AI?
AI could one day be woven throughout the grid management system — here are the pros and cons.
AI skeptic Gary Marcus on AI’s moral and technical shortcomings
From hallucinations to regulatory battles, Gary Marcus argues the AI status quo has failed us and it’s time citizens demand something more.
Flexport is using generative AI to create the “holy grail” of shipping
Flexport is using generative AI to read documents, talk to truckers, and create a “knowledge agent” that’s an expert in shipping.
The West needs more water. This Nobel winner may have the answer.
Paul Migrom has an Emmy, a Nobel, and a successful company. There’s one more big problem on the to-do list.
Can we automate science? Sam Rodriques is already doing it.
People need to anticipate the revolution that’s coming in how humans and AI will collaborate to create discoveries, argues Sam Rodrigues.
Up Next
robot rooms
Subscribe to Freethink for more great stories