Richard Feynman famously said, "The first principle is that you must not fool yourself -- and you are the easiest person to fool."
This insightful statement isn't meant to impugn anyone's honesty or intelligence, but to highlight that everyone -- and I'm sure Feynman was very much including himself in this assessment -- has biases that prevent them from seeing clearly. We've already got a model, an internal framework by which we interpret what we experience, and that inevitably constrains our understanding.
As science historian James Burke points out, in his brilliant analysis of the scientific endeavor The Day the Universe Changed, it's a trap that's impossible to get out of. You have to have some mental model for how you think the world works, or all the sensory input you receive would simply be chaos. "Without a structure, a theory for what's there," Burke says, "you don't see anything."
And once you've settled on a model, it's nearly impossible to compromise with. You're automatically going to take some things as givens and ignore others as irrelevant, dismiss some pieces of evidence out of hand and accept others without question. We're always taking what we experience and comparing it to our own mental frameworks, deciding what is important and what isn't. When my wife finished her most recent art piece -- a stunning image of a raven's face, set against a crimson background -- and I was on social media later that day and saw another piece of art someone had posted with a raven against red -- I shrugged and laughed and said, "Weird coincidence."
But that's only because I had already decided that odd synchronicities don't mean anything. If I had a mental model that considered such chance occurrences as spiritually significant omens, I would have interpreted that very, very differently.
Our mental frameworks are essential, but they can lead us astray as often as they land us on the right answer. Consider, for example, the strange, sad case of Johann Beringer and the "lying stones."
Johann Bartholomeus Adam Beringer was a professor of medicine at the University of Würzburg in the early eighteenth century. His training was in anatomy and physiology, but he had a deep interest in paleontology, and had a large collection of fossils he'd found during hikes in his native Germany. He was also a devout Lutheran and a biblical literalist, so he interpreted all the fossil evidence as consistent with biblical events like the six-day creation, the Noachian flood, and so on.
Unfortunately, he also had a reputation for being arrogant, humorless, and difficult to get along with. This made him several enemies, including two of his coworkers -- Ignace Roderique, a professor of geography and algebra, and Johann Georg von Eckhart, the university librarian. So Roderique and von Eckhart hatched a plan to knock Beringer down a peg or two.
They found out where he was planning on doing his next fossil hunt, and planted some fake fossils along the way.
These "lying stones" are crudely carved from limestone. On some of them, you can still see the chisel marks.
So as astonishing as it may seem, Beringer fell for the ruse hook, line, and sinker. Roderique and von Eckhart, buoyed up by their success, repeated their prank multiple times. Finally Beringer had enough "fossils" that in 1726, he published a scholarly work called Lithographiae Wirceburgensis (The Writing-Stones of Würzburg). But shortly after the book's publication -- it's unclear how -- Beringer realized he'd been taken for a ride.
He sued Roderique and von Eckhart for defamation -- and won. Roderique and von Eckhart were both summarily fired, but it was too late; Beringer was a laughingstock in the scientific community. He tried to recover all of the copies of his book and destroy them, but finally gave up. His reputation was reduced to rubble, and he died twelve years later in total obscurity.
It's easy to laugh at Beringer's credulity, but the only reason you're laughing is because if you found such a "fossil," your mental model would immediately make you doubt its veracity. In his framework -- which included a six-thousand-year-old Earth, a biblical flood, and a God who was perfectly capable of signing his own handiwork -- he didn't even stop to consider it.
The history of science is laden with missteps caused by biased mental models. In 1790, a report of a fireball over France that strewed meteorites over a large region prompted a scientific paper -- that laughingly dismissed the claim as "impossible." Pierre Bertholon, editor of the Journal des Sciences Utiles, wrote, "How sad, is it not, to see a whole municipality attempt to certify the truth of folk tales… the philosophical reader will draw his own conclusions regarding this document, which attests to an apparently false fact, a physically impossible phenomenon." DNA was dismissed as the genetic code for decades, because of the argument that DNA's alphabet only contains four "letters," so the much richer twenty-letter alphabet of proteins (the amino acids) must be the language of the genes. Even in the twentieth century, geologists didn't bother looking for evidence for continental drift until the 1950s, long after there'd been significant clues that the continents had, in fact, moved, largely because they couldn't imagine a mechanism that could be responsible.
Our mental models work on every level -- all the way down to telling us what questions are worth investigating.
So poor Johann Beringer. Not to excuse him for being an arrogant prick, but he didn't deserve to be the target of a mean-spirited practical joke, nor does he deserve our derision now. He was merely operating within his own framework of understanding, same as you and I do.
I wonder what we're missing, simply because we've decided it's irrelevant -- and what we've accepted as axiomatic, and therefore beyond questioning?
Maybe we're not so very far ahead of Beringer ourselves.