Princeton geneticists are rewriting the narrative of Neanderthals and other ancient humans

Written by
Liz Fuller-Wright, Office of Communications
July 12, 2024

Ever since the first Neanderthal bones were discovered, people have wondered about these ancient hominins. How are they different from us? How much are they like us? Did our ancestors get along with them? Fight them? Love them? The recent discovery of a group called Denisovans, a Neanderthal-like group who populated Asia and Oceania, added its own set of questions.

Now, an international team of geneticists and AI experts are adding whole new chapters to our shared hominin history. Under the leadership of Joshua Akey, a professor in Princeton’s Lewis-Sigler Institute for Integrative Genomics, the researchers have found a history of genetic intermingling and exchange that suggests a much more intimate connection between these early human groups than previously believed.

“This is the first time that geneticists have identified multiple waves of modern human-Neanderthal admixture,” said Liming Li, a professor in the Department of Medical Genetics and Developmental Biology at Southeast University in Nanjing, China, who performed this work as an associate research scholar in Akey’s lab.

“We now know that for the vast majority of human history, we've had a history of contact between modern humans and Neanderthals,” said Akey. The hominins who are our most direct ancestors split from the Neanderthal family tree about 600,000 years ago, then evolved our modern physical characteristics about 250,000 years ago.

“From then until the Neanderthals disappeared — that is, for about 200,000 years — modern humans have been interacting with Neanderthal populations,” he said.

The results of their work appear in the current issue of the journal Science.

Neanderthals, once stereotyped as slow-moving and dim-witted, are now seen as skilled hunters and tool makers who treated each other’s injuries with sophisticated techniques and were well adapted to thrive in the cold European weather.

(Note: All of these hominin groups are humans, but to avoid saying “Neanderthal humans,” “Denisovan humans,” and “ancient-versions-of-our-own-kind-of-humans,” most archaeologists and anthropologists use the shorthand Neanderthals, Denisovans, and modern humans.)

Mapping the gene flow

Using genomes from 2,000 living humans as well as three Neanderthals and one Denisovan, Akey and his team mapped the gene flow between the hominin groups over the past quarter-million years.

The researchers used a genetic tool they designed a few years ago called IBDmix, which uses machine learning techniques to decode the genome. Previous researchers depended on comparing human genomes against a “reference population” of modern humans believed to have little or no Neanderthal or Denisovan DNA.

Akey’s team has established that even those referenced groups, who live thousands of miles south of the Neanderthal caves, have trace amounts of Neanderthal DNA, probably carried south by voyagers (or their descendants).

With IBDmix, Akey’s team identified a first wave of contact about 200-250,000 years ago, another wave 100-120,000 years ago, and the largest one about 50-60,000 years ago.

That contrasts sharply with previous genetic data. “To date, most genetic data suggests that modern humans evolved in Africa 250,000 years ago, stayed put for the next 200,000 years, and then decided to disperse out of Africa 50,000 years ago and go on to people the rest of the world,” said Akey.

“Our models show that there wasn’t a long period of stasis, but that shortly after modern humans arose, we've been migrating out of Africa and coming back to Africa, too,” he said. “To me, this story is about dispersal, that modern humans have been moving around and encountering Neanderthals and Denisovans much more than we previously recognized.”

That vision of humanity on the move coincides with the archaeological and paleoanthropological research suggesting cultural and tool exchange between the hominin groups.

A DNA insight

Li and Akey’s key insight was to look for modern-human DNA in the genomes of the Neanderthals, instead of the other way around. “The vast majority of genetic work over the last decade has really focused on how mating with Neanderthals impacted modern human phenotypes and our evolutionary history — but these questions are relevant and interesting in the reverse case, too,” said Akey.

They realized that the offspring of those first waves of Neanderthal-modern matings must have stayed with the Neanderthals, therefore leaving no record in living humans. “Because we can now incorporate the Neanderthal component into our genetic studies, we are seeing these earlier dispersals in ways that we weren't able to before,” Akey said.

The final piece of the puzzle was discovering that the Neanderthal population was even smaller than previously believed.

Genetic modeling has traditionally used variation — diversity — as a proxy for population size. The more diverse the genes, the larger the population. But using IBDmix, Akey’s team showed that a significant amount of that apparent diversity came from DNA sequences that had been lifted from modern humans, with their much larger population.

As a result, the effective population of Neanderthals was revised down from about 3,400 breeding individuals down to about 2,400.

How Neanderthals vanished

Put together, the new findings paint a picture of how the Neanderthals vanished from the record, some 30,000 years ago.

“I don’t like to say ‘extinction,’ because I think Neanderthals were largely absorbed,” said Akey. His idea is that Neanderthal populations slowly shrank until the last survivors were folded into modern human communities.

This “assimilation model” was first articulated by Fred Smith, an anthropology professor at Illinois State University, in 1989. “Our results provide strong genetic data consistent with Fred’s hypothesis, and I think that's really interesting,” said Akey.

“Neanderthals were teetering on the edge of extinction, probably for a very long time,” he said. “If you reduce their numbers by 10 or 20%, which our estimates do, that's a substantial reduction to an already at-risk population.

“Modern humans were essentially like waves crashing on a beach, slowly but steadily eroding the beach away. Eventually we just demographically overwhelmed Neanderthals and incorporated them into modern human populations.”

Recurrent gene flow between Neanderthals and modern humans over the past 200,000 years,” by Liming Li, Troy J. Comi, Rob F. Bierma, and Joshua M. Akey, appears in the July 13 issue of the journal Science (DOI: 10.1126/science.adi1768). This research was supported by the National Institutes of Health (grant R01GM110068 to JMA).