Skeptophilia (skep-to-fil-i-a) (n.) - the love of logical thought, skepticism, and thinking critically. Being an exploration of the applications of skeptical thinking to the world at large, with periodic excursions into linguistics, music, politics, cryptozoology, and why people keep seeing the face of Jesus on grilled cheese sandwiches.
Showing posts with label Lumosity. Show all posts
Showing posts with label Lumosity. Show all posts

Thursday, October 6, 2016

Gaming the brain

I think all of us can relate to the desire to have our brains work better.

We forget things.  We get distracted.  We let worry keep us from enjoying our days and from sleeping at night.  And that's not even counting the more serious problems that some of us have to deal with -- depression, anxiety disorders, bipolar disorder, schizophrenia, dementia... the list goes on and on.

So it's only to be expected that we're attracted to anything that promises to help us out in the Mental Faculties Department.  This has given rise to companies like Lumosity, which use a variety of brain-stimulating games to activate your neural circuitry -- and, the claim goes, trigger an overall improvement in your mental acuity.

The problem is, they don't work as advertised.  Playing a brain game improves one thing and one thing only -- your ability to play that game.  This was the finding of a study that was published last week in the journal Psychological Science in the Public Interest, and describes work by seven researchers headed by Daniel J. Simons, of the University of Illinois at Urbana-Champaign.  Disturbingly, not only did Simons's team find little in the way of positive results, they found poor experimental design in previous studies that had found such results.  Simons et al. write:
Based on this examination, we find extensive evidence that brain-training interventions improve performance on the trained tasks, less evidence that such interventions improve performance on closely related tasks, and little evidence that training enhances performance on distantly related tasks or that training improves everyday cognitive performance.  We also find that many of the published intervention studies had major shortcomings in design or analysis that preclude definitive conclusions about the efficacy of training, and that none of the cited studies conformed to all of the best practices we identify as essential to drawing clear conclusions about the benefits of brain training for everyday activities.
Simons agrees that it's a discouraging result.  "It’s disappointing that the evidence isn’t stronger," Simons said in an interview in Science Around Michigan.  "It would be really nice if you could play some games and have it radically change your cognitive abilities, but the studies don’t show that on objectively measured real-world outcomes."

[image courtesy of the Wikimedia Commons]

If that weren't bad enough, a couple of weeks ago there was an announcement from a researcher that another brain-improvement strategy -- "power poses" -- also shows little effect.  This one achieved wide acclaim when one of its chief proponents, social psychologist Amy Cuddy, spoke about it on one of the most watched TED talks -- at present, it's been viewed over 36 million times.  The idea is that adopting a body pose of strength and courage affects your hormone levels (especially testosterone and cortisol), which then feeds back and positively affects your mood and anxiety levels; likewise, adopting a submissive or weak pose generates the opposite effects. 

The problem is, attempts in January to replicate Cuddy's experiments failed to generate results, and (most damning of all) one of the co-authors of the original study, Dana Carney, has stated outright that "I do not believe that 'power pose' effects are real."  She said the original study made use of the statistical fudging technique called "p-hacking," which (to oversimplify, but give you the general gist) amounts to running a variety of tests and only reporting on the ones that generated positive results.

All of which is not intended to stop you from playing brain games or doing power poses.  I still think there's something to be said for thinking positively, and if you approach life playfully and optimistically you're much more likely to enjoy it and (therefore) be successful at what you do.  (As my dad used to say, I'd rather be an optimist who is wrong than a pessimist who is right.)

But as far as actual measurable results in cognition, memory, or hormone levels?  Apparently not.  Which is disappointing, but perhaps not surprising.  Our brains are tremendously complex organs, and it's always struck me as a little unlikely that powerful neural firing patterns could be so readily malleable.  As usual, the simplistic approach seems to be appealing... but wrong.

Thursday, January 7, 2016

A win for the good guys

I find it discouraging, sometimes, how often the hucksters win.  We still have homeopathic "remedies" on pharmacy shelves.  Selling supplements of dubious benefit and largely unknown side effects is still a multi-million dollar business.  Throw in all of the purveyors of woo who every year bilk thousands of people out of their hard-earned cash, and it all adds up to a pretty dismal picture.

But still, every once in a while, the good guys come out on top.

This  happened just this week with the announcement that the creators and marketers of the "Lumosity" brain-training games are being ordered to pay $2 million in reparations to customers who fell for their "unfounded claims that Lumosity games can help users perform better at work and in school, and reduce or delay cognitive impairment associated with age and other serious health conditions."

The selling points were attractive, with the aging population becoming increasingly (and justifiably) spooked by the specter of Alzheimer's and other age-related dementias.  I can understand the fear; I watched my aunt, my mother's older sister, outlive both of her siblings, finally dying at the age of 90 after spending the last ten years of her life essentially unresponsive and needing 24-hour care due to the ravages of Alzheimer's.  It's my worst nightmare, really.  The idea of having my body go on long after my mind is gone is absolutely terrifying.

So the claim that you could stave off dementia by playing some computer games was appealing.  So, too, were there other claims -- that you would improve your performance at work, at school, and on the sports field, feel more alert, perform cognitive tasks more quickly and accurately.  A direct quote from their advertisements said that playing their games three or four times a week would help users to reach "their full potential in every aspect of life."  With that kind of claim, it's understandable why people fell for their sales pitch.

[image courtesy of the Wikimedia Commons]

The problem was, it had no basis in fact, and the Federal Trade Commission is requiring Lumos Labs, the company which created and marketed Lumosity, to refund money to their customers because they were participating in "misleading health advertising."

"Lumosity preyed on consumers’ fears about age-related cognitive decline, suggesting their games could stave off memory loss, dementia, and even Alzheimer’s disease," said Jessica Rich, Director of the Federal Trade Commission’s Bureau of Consumer Protection.  "But Lumosity simply did not have the science to back up its ads."

In fact, it wasn't simply a lack of evidence; there is significant evidence against their claims.  A 2014 joint statement from Stanford University and the Max Planck Institute said that "The strong consensus of this group is that the scientific literature does not support claims that the use of software-based 'brain games' alters neural functioning in ways that improve general cognitive performance in everyday life, or prevent cognitive slowing and brain disease."

But flying in the face of scientific evidence wasn't the only problem.  The FTC found that "...the defendants [failed] to disclose that some consumer testimonials featured on the website had been solicited through contests that promised significant prizes, including a free iPad, a lifetime Lumosity subscription, and a round-trip to San Francisco."

So promoting falsehoods for profit + paying people to give you good reviews = a $2 million penalty.  Which is exactly as it should be.

It's high time that the FTC crack down on these spurious claims.  You have to wonder how long it'll take before they can get the supplement-and-remedies cadre to stop hiding behind "This product is not intended to diagnose, treat, or cure any human illness" as a catch-all disclaimer and general Get Out of Jail Free card.

In any case, I find the whole thing heartening.  I do believe in the principle of caveat emptor, but we sure as hell wouldn't have to invoke it quite so often if the powers-that-be would pull back the reins on the false advertisers.