Skeptophilia (skep-to-fil-i-a) (n.) - the love of logical thought, skepticism, and thinking critically. Being an exploration of the applications of skeptical thinking to the world at large, with periodic excursions into linguistics, music, politics, cryptozoology, and why people keep seeing the face of Jesus on grilled cheese sandwiches.
Showing posts with label expertise. Show all posts
Showing posts with label expertise. Show all posts

Friday, October 20, 2023

Internet expertise

What is it with people trusting random laypeople over experts?

Okay, yeah, I know experts can be wrong, and credentials are not an unshakable guarantee that the person in question knows what they're talking about.  But still.  Why is it so hard to accept that an actual scientist, who has a Ph.D. in the field and has done real research, in general will know more about the topic than some dude on the internet?

The topic comes up because of a conversation I had with my athletic trainer yesterday.  He is pretty knowledgeable about all things fitness-related -- so while he's not a researcher or a scientist (something he'd tell you up front), he's certainly Better Than The Average Bear.  And he ran into an especially ridiculous example of the aforementioned phenomenon, which he was itching to show me as soon as I got there.

Without further ado, we have: the woman who thinks that the amino acid L-glutamine is so named because it is important for developing your glutes:

And of course, it must be right because she heard it from "the TikTok Fitness Girls, and they don't lie."

The whole thing reminds me of something I heard every damn year from students, which is that the ingredient sodium erythorbate in hotdogs and other processed meat products is made from ground-up earthworms, because "earthworm" and "erythorbate" sound a little bit alike.  (Actually, sodium erythorbate is an antioxidant that is chemically related to vitamin C, and is added to meat products as a preservative and antibacterial agent.)

But to return to the broader point, why is it so hard to accept that people who have studied a subject actually... know a lot about the subject?  Instead, people trust shit like:

And I feel obliged to make my usual disclaimer that I am not making any of the above up.

I wonder how much of this attitude, especially here in the United States, comes from the egalitarian mindset being misapplied -- that "everyone should have the same basic rights" spills over into "everyone's opinion is equally valid."  I recall back when George W. Bush was running for president, there was a significant slice of voters who liked him because he came across as a "regular guy -- someone you could sit down and have a beer with."  He wasn't an "intellectual elite" (heaven knows that much was true enough).  

And I remember reacting to that with sheer bafflement.  Hell, I know I'm not smart enough to be president.  I want someone way more intelligent than I am to be running the country.  Why is "Vote Bush -- He's Just As Dumb As You Are" considered some kind of reasonable campaign slogan?

I think the same thing is going on here -- people hear about the new health miracle from Some Guy Online, and it sounds vaguely plausible, so they give more credence to him than they do to an actual expert (who uses big complicated words and doesn't necessarily give you easy solutions to your health problems).  If you don't have a background in biological science yourself, maybe it sounds like it might work, so you figure you'll give it a try.  After that, wishful thinking and the placebo effect do the rest of the heavy lifting, and pretty soon you're naked in the park sunning your nether orifice.

There's a willful part of this, though.  There comes a point where it crosses the line from simple ignorance into actual stupidity.  To go back to my original example, a thirty-second Google search would tell you that L-glutamine has nothing to do with your glutes.  (In fact, the two words don't come from the same root, even though they sound alike; glutamine comes from the Latin gluten, meaning "sticky," and glutes comes from the Greek γλουτός, meaning buttocks.)  To believe that L-glutamine will develop your glutes because the TikTok Fitness Girls say so, you need to be not only (1) ignorant, but (2) gullible, and (3) uninterested in learning any better.

And that, I find incomprehensible.

I'll end with the famous quote from Isaac Asimov, which seems to sum up the whole bizarre thing about as well as anyone could: "There is a cult of ignorance in the United States, and there has always been.  The strain of anti-intellectualism has been a constant thread winding its way through our political and cultural life, nurtured by the false notion that democracy means that 'my ignorance is just as good as your knowledge.'"

****************************************



Tuesday, February 9, 2021

Fooling the experts

I was bummed to hear about the death of the inimitable Cloris Leachman a week and a half ago at the venerable age of 94.  Probably most famous for her role as Frau Blücher *wild neighing horse noises* in the movie Young Frankenstein, I was first introduced to her unsurpassed sense of comic timing in the classic 1970s sitcom The Mary Tyler Moore Show, where she played the tightly-wound self-styled intellectual Phyllis Lindstrom.

One of my favorite moments in that show occurred when Phyllis was playing a game of Scrabble against Mary's neighbor Rhoda Morgenstern (played with equal panache by Valerie Harper).  Rhoda puts down the word oxmersis, and Phyllis challenges it.

"There's no such thing as 'oxmersis,'" Phyllis says.

Rhoda looks at her, aghast.  "Really, Phyllis?  I can not believe that someone who knows as much about psychology as you do has never heard of oxmersis."

Long pause, during which you can almost see the gears turning in Phyllis's head.  "Oh," she finally says.  "That oxmersis."

I was immediately reminded of that scene when I ran into a paper while doing some background investigation for yesterday's post, which was about psychologist David Dunning's research with Robert Proctor regarding the deliberate cultivation of stupidity.  This paper looked at a different aspect of ignorance -- what happens when you combine the Dunning-Kruger effect (people's tendency to overestimate their own intelligence and abilities) with a bias called Appeal to Authority.

Appeal to Authority, you probably know, is when someone uses credentials, titles, or educational background -- and no other evidence -- to support a claim.  Put simply, it is the idea that if Richard Dawkins said it, it must be true, regardless of whether the claim has anything to do with Dawkins's particular area of expertise, evolutionary biology.  (I pick Dawkins deliberately, because he's fairly notorious for having opinions about everything, and seems to relish being the center of controversy regardless of the topic.)  

Dunning teamed up with Cornell University researchers Stav Atir and Emily Rosenzweig, and came up with what could be described as the love child of Dunning-Kruger and Appeal to Authority.  And what this new phenomenon -- dubbed, predictably, the Atir-Rosenzweig-Dunning Effect -- shows us is that people who are experts in a particular field tend to think their expertise holds true even for disciplines far outside their chosen area of study, and because of that are more likely to fall for plausible-sounding falsehoods -- like Phyllis's getting suckered by Rhoda's "oxmersis" bluff.

[Image is in the Public Domain]

In one experiment, the three researchers asked people to rate their own knowledge in various academic areas, then asked them to rank their level of understanding of various finance-related terms, such as "pre-rated stocks, fixed-rate deduction and annualized credit."  The problem is, those three finance-related terms actually don't exist -- i.e., they were made up by the researchers to sound plausible.

The test subjects who had the highest confidence level in their own fields were most likely to fall for the ruse.  Simon Oxenham, who described the experiments in Big Think, says it's only natural.  "A possible explanation for this finding," Oxenham writes, "is that the participants with a greater vocabulary in a particular domain were more prone to falsely feeling familiar with nonsense terms in that domain because of the fact that they had simply come across more similar-sounding terms in their lives, providing more material for potential confusion."

Interestingly, subsequent experiments showed that the correlation holds true even if you take away the factor of self-ranking.  Presumably, someone who is cocky and arrogant and ranks his/her ability higher than is justified in one area would be likely to do it in others.  But when they tested the subjects' knowledge of terms from their own field -- i.e., actually measured their expertise -- high scores still correlated with overestimating their knowledge in other areas.

And telling the subjects ahead of time that some of the terms might be made up didn't change the results. "[E]ven when participants were warned that some of the statements were false, the 'experts' were just as likely as before to claim to know the nonsense statements, while most of the other participants became more likely in this scenario to admit they’d never heard of them," Oxenham writes.

I have a bit of anecdotal evidence supporting this result from my experience in the classroom.  On multiple-choice tests, I had to concoct plausible-sounding wrong answers as distractors.  Every once in a while, I ran out of good wrong answers, and just made something up.  (On one AP Biology quiz on plant biochemistry, I threw in the term "photoglycolysis," which sounds pretty fancy until you realize that there's no such thing.)   What I found was that it was the average to upper-average students who were the most likely to be taken in.  The top students didn't get fooled because they knew what the correct answer was; the lowest students were equally likely to pick any of the wrong answers, because they didn't understand the material well.  The mid-range students saw something that sounded technical and vaguely familiar -- and figured that if they weren't sure, it must be that they'd missed learning that particular term.

It was also the mid-range students who were most likely to miss questions where the actual answer seemed too simple.  Another botanical question I liked to throw at them was, "What do all non-vascular land plants have in common?"  I always provided three wrong answers with appropriately technical-sounding jargon.

The actual answer is, "They're small."

Interestingly, the reason for the small size of non-vascular land plants (the most familiar example is moss) isn't simple at all.  But the answer itself just looked too easy to merit being the correct choice on an AP Biology quiz.

So Atir, Rosenzweig, and Dunning have given us yet another mental pitfall to watch out for -- our tendency to use our knowledge in one field to overestimate our knowledge in others.  But I really should run along, and make sure that the annualized credit on my pre-rated stocks exceeds the recommended fixed-rate deduction.  I worry a lot about that kind of thing, but I suppose my anxiety really just another case of excessive oxmersis.

*********************************

Science writer Elizabeth Kolbert established her reputation as a cutting-edge observer of the human global impact in her wonderful book The Sixth Extinction (which was a Skeptophilia Book of the Week a while back).  This week's book recommendation is her latest, which looks forward to where humanity might be going.

Under a White Sky: The Nature of the Future is an analysis of what Kolbert calls "our ten-thousand-year-long exercise in defying nature," something that immediately made me think of another book I've recommended -- the amazing The Control of Nature by John McPhee, the message of which was generally "when humans pit themselves against nature, nature always wins."  Kolbert takes a more nuanced view, and considers some of the efforts scientists are making to reverse the damage we've done, from conservation of severely endangered species to dealing with anthropogenic climate change.

It's a book that's always engaging and occasionally alarming, but overall, deeply optimistic about humanity's potential for making good choices.  Whether we turn that potential into reality is largely a function of educating ourselves regarding the precarious position into which we've placed ourselves -- and Kolbert's latest book is an excellent place to start.

[Note: if you purchase this book using the image/link below, part of the proceeds goes to support Skeptophilia!]



Thursday, October 19, 2017

Purging the experts

One of the political trends I understand least is the increasing distrust of scientists by elected officials.

It's not like this disparagement of experts is across the board.  When you're sick, and the doctor runs tests and diagnoses you with a sinus infection, you don't say, "I don't believe you.  My real estate agent told me it sounded like I had an ulcer, so I'm gonna go with that."  When you get on an airplane, you don't say to the pilot, "You damn elite aviation specialists, you're obviously biased because of your training.  I think you should hand over the controls to Farmer Bob, here."  When you have your car repaired, you wouldn't say to the mechanic, "I'm not going to do the repairs you suggest, because you have an obvious monetary interest in the car being broken.  I'll get a second opinion from my son's kindergarten teacher, Mrs. Hinkwhistle, who is a disinterested party."

But that's how scientists are treated by politicians.  And it's gotten worse.  Just yesterday, Scott Pruitt, who is the de facto leader of the Environmental Protection Agency despite his apparent loathing of both the environment and the agency, announced that there was going to be a purge of scientists on EPA advisory boards.


"What’s most important at the agency is to have scientific advisers that are objective, independent-minded, providing transparent recommendations,” Pruitt said when he spoke to a group at the Heritage Foundation, an anti-environmental, pro-corporate lobby group.  "If we have individuals who are on those boards, sometimes receiving money from the agency … that to me causes questions on the independence and the veracity and the transparency of those recommendations that are coming our way."

Well, of course environmental scientists get funding from the EPA, you dolt.  One of the EPA's functions is providing grants for basic research in environmental science.  Saying that environmental scientists can't be on EPA advisory boards is a little like excluding doctors from being on medical advisory boards.

Can't have that, after all.  Those doctors are clearly biased to be in favor of policies that promote better health care services, because then they get money for providing those services.  Better populate the medical advisory boards with people who know nothing whatsoever about medicine.

Of course, I am morally certain that the purging of trained scientists from EPA advisory boards is not simply because of this administration's anti-science bent, although that clearly exists as well.  The fight between corporate stooges like Scott Pruitt and the scientific community stems from the fact that much of what the scientists are saying runs counter to economic expediency.  You know, such things as:
  • Climate change exists and is anthropogenic in origin
  • Dumping mining waste into streams and lakes is a bad idea
  • Corporations need strictures on the impact of what they do on the environment, because they have a poor track record of policing themselves
  • Reducing the allowable amounts of air pollutants improves air quality and eases such conditions as asthma and chronic bronchitis
  • Oil pipelines have a nasty habit of breaking and leading to damaging oil spills
  • It's a stupid idea to store pressurized natural gas in unstable underground salt caverns
All of which we environmental types -- by which I mean, people who would like future generations to have drinkable water, breathable air, and a habitable world -- have had to fight in the past year.  The Trump administration's approach to environmental policy is like the Hydra; you cut off one foul, pollution-emitting head, and it grows two more.

The whole thing is driven by a furious drive toward deregulation, which in turn comes out of unchecked corporate greed.  Jennifer Sass, senior scientist for the National Resources Defense Council, nailed it:  "Pruitt’s purge has a single goal: get rid of scientists who tell us the facts about threats to our environment and health.  There’s a reason he won’t apply the same limits to scientists funded by corporate polluters.  Now the only scientists on Pruitt’s good list will be those with funding from polluters supporting Trump’s agenda to make America toxic again."

Michael Halpern, deputy director of the Center for Science and Democracy, agreed.  Halpern said that if Pruitt succeeds in his purge, he "would be willfully setting himself up to fail at the job of protecting public health and the environment."

The problem is, stories like this get buried in the ongoing shitstorm that has characterized the leadership of the United States in the last ten months.  It's another Hydra, and people simply can't pay attention to all of the horrible news at the same time.  That's what they're counting on -- that with outrages over kneeling athletes and disrespect by the president of military widows and allegations of sexual impropriety, we'll just ignore the fact that while all this other stuff is happening, our leaders are gutting every protection the environment has gained in the last fifty years.

You'd think that with the natural disasters this year -- unprecedented hurricanes and wildfires and floods -- we'd wise up and say, "You know, maybe it's time we started paying attention to the damage we've done."  But unfortunately, we're heading in exactly the opposite direction.  My fear is that by doing this, we're making the eventual backlash from the environment unstoppable.

And it would be a Pyrrhic victory, but I hope Scott Pruitt is around to watch it happen.

Tuesday, February 28, 2017

Ignoring the experts

The new book The Death of Expertise: The Campaign Against Established Knowledge and Why It Matters, by Thomas Nichols, could not have been published at a better time.

We have an administration that is relentlessly committed to creating their own set of "alternative facts" and labeling as fake news anything that contradicts the narrative.  Criticism is met with reprisal, honest journalism with shunning, facts and evidence with accusations of bias.  The message is "don't listen to anyone but us."

Nichols's contention is that we got here by a steady progress over the last few decades toward mistrusting experts.  Why should we rely on the pointy-headed scientists, who are not only out of touch with "real people" but probably are doing their research for some kind of evil purpose?  You know those scientists -- always unleashing plagues and creating superweapons, all the while rubbing their hands together in a maniacal fashion.

I have to mention, however, that this was something that always puzzled me about 1950s horror films.  Those scientists who were part of an evil plot to destroy the Earth -- what the hell was their motivation?  Don't they live here too?

Be that as it may, Nichols makes a trenchant point; our lazy, me-centered, fundamentally distrustful culture has created an atmosphere where anyone who knows more than we do is automatically viewed with suspicion.  We use WebMD to diagnose ourselves, and argue with the doctor when (s)he disagrees.  We rate our folksy "look at the weather we're having, climate change can't be real" anecdotes as somehow having more weight than the hard data of actual trained climate scientists.  We accept easy solutions to complicated problems ("Build a wall") instead of putting in the hard work of understanding the complexity of the real situation.

What does she know, anyhow?  [image courtesy of the Wikimedia Commons]

Nichols was interviewed a couple of days ago in the Providence Journal, and shared some pretty disturbing observations about the predicament our culture is in.  "The United States is now a country obsessed with the worship of its own ignorance," Nichols said.  "Worse, many citizens today are proud of not knowing things.  Americans have reached a point where ignorance, especially of anything related to public policy, is an actual virtue."

Of course, Nichols is not the first person to comment upon this.  Isaac Asimov, in his 1980 essay "The Cult of Ignorance," wrote something that has become rightly famous: "There is a cult of ignorance in the United States, and there always has been.  The strain of anti-intellectualism has been a constant thread winding its way through our political and cultural life, nurtured by the false notion that democracy means that 'my ignorance is just as good as your knowledge.'"

This, Nichols says, is not only pernicious, it's demonstrably false.  "People can accept the idea that they are not seven feet tall and can't play basketball.  [But] They hate the idea that anybody is smarter than they are and should be better compensated than they are.  This is a radical egalitarianism that is completely nuts."

What is weirdest about this is that we unhesitatingly accept the expertise of some people, and unhesitatingly reject the expertise of others.  "You put your life in the hands of an expert community all day long," Nichols says.  "Every time you take an aspirin or an over-the-counter medication, every time you talk to your pharmacist, every time your kids go to school, every time you obey the traffic directions of a police officer or go through a traffic light.  When you get on an airplane, you assume that everybody involved in flying that airplane from the flight attendant to the pilot and the ground crew and the people in the control tower knows what they are doing."

And yet when we are told that the overwhelming majority of climate scientists accept anthropogenic climate change, a substantial percentage of us go, "Meh, what do they know?"

The difficulty is that once you have fallen into the trap of distrusting expertise, it's hard to see how you could free yourself from it.  As the adage goes, you can't logic your way out of a position that you didn't logic your way into.  Add into the mix not only the rampant anti-intellectualism characteristic of our current society, but the fundamental distrust of all media that is being inculcated into our minds by the rhetoric from the Trump administration, and you've created a hermetically sealed wall that no facts, no evidence, no argument can breach.

So Nichols's conclusions are interesting, enlightening, and deeply troubling.  His arguments are aimed toward the very people who will be the most resistant to accepting them.

And with our current leadership deepening divisions, distrust, and suspicion of experts, it's hard to see how any of this will change any time soon.