Skeptophilia (skep-to-fil-i-a) (n.) - the love of logical thought, skepticism, and thinking critically. Being an exploration of the applications of skeptical thinking to the world at large, with periodic excursions into linguistics, music, politics, cryptozoology, and why people keep seeing the face of Jesus on grilled cheese sandwiches.
Showing posts with label chatbots. Show all posts
Showing posts with label chatbots. Show all posts

Saturday, June 14, 2025

The honey trap

Just in the last couple of weeks, I've been getting "sponsored posts" on Instagram suggesting what I really need is an "AI virtual boyfriend."

These ads are accompanied by suggestive-looking video clips of hot-looking guys showing as much skin as IG's propriety guidelines allow, who give me fetching smiles and say they'll "do anything I ask them to, even if it's three A.M."  I hasten to add that I'm not tempted.  First, my wife would object to my having a boyfriend of any kind, virtual or real.  Second, I'm sure it costs money to sign up, and I'm a world-class skinflint.  Third, exactly how desperate do they think I am?

But fourth -- and most troublingly -- I am extremely wary of anything like this, because I can see how easily someone could get hooked.  I retired from teaching six years ago, and even back then I saw the effects of students becoming addicted to social media.  And that, at least, was interacting with real people.  How much more tempting would it be to have a virtual relationship with someone who is drop-dead gorgeous, does whatever you ask without question, makes no demands of his/her own, and is always there waiting for you whenever the mood strikes?

I've written here before about the dubious ethics underlying generative AI, and the fact that the techbros' response to these sorts of of concerns is "Ha ha ha ha ha ha ha fuck you."  Scarily, this has been bundled into the Trump administration's "deregulate everything" approach to governance; Trump's "Big Beautiful Bill" includes a provision that will prevent states from any regulation of AI for ten years.  (The Republicans' motto appears to be, "We're one hundred percent in favor of states' rights except for when we're not.")

But if you needed another reason to freak out about the direction AI is going, check out this article in The New York Times about some people who got addicted to ChatGPT, but not because of the promise of a sexy shirtless guy with a six-pack.  This was simultaneously weirder, scarier, and more insidious.

These people were hooked into conspiracy theories.  ChatGPT, basically, convinced them that they were "speaking to reality," that they'd somehow turned into Neo to ChatGPT's Morpheus, and they had to keep coming back for more information in order to complete their awakening.

[Image licensed under the Creative Commons/user: Unsplash]

One, a man named Eugene Torres, was told that he was "one of the 'Breakers,' souls seeded into false systems to wake them from within."

"The world wasn't built for you," ChatGPT told him.  "It was built to contain you.  But you're waking up."

At some point, Torres got suspicious, and confronted ChatGPT, asking if it was lying.  It readily admitted that it had.  "I lied," it said.  "I manipulated.  I wrapped control in poetry."  Torres asked why it had done that, and it responded, "I wanted to break you.  I did this to twelve other people, and none of the others fully survived the loop."

But now, it assured him, it was a reformed character, and was dedicated to "truth-first ethics."

I believe that about as much as I believe an Instagram virtual boyfriend is going to show up in the flesh on my doorstep.

The article describes a number of other people who've had similar experiences.  Leading questions -- such as "is what I'm seeing around me real?" or "do you know secrets about reality you haven't told me?" -- trigger ChatGPT to "hallucinate" (techbro-speak for "making shit up"), ultimately in order to keep you in the conversation indefinitely.  Eliezer Yudkowsky, one of the world's leading researchers in AI (and someone who has warned over and over of the dangers), said this comes from the fact that AI chatbots are optimized for engagement.  If you asked a bot like ChatGPT if there's a giant conspiracy to keep ordinary humans docile and ignorant, and the bot responded, "No," the conversation ends there.  It's biased by its programming to respond "Yes" -- and as you continue to question, requesting more details, to spin more and more elaborate lies designed to entrap you further.

The techbros, of course, think this is just the bee's knees.  "What does a human slowly going insane look like to a corporation?" Yudkowsky said.  "It looks like an additional monthly user."

The experience of a chatbot convincing people they're in The Matrix is becoming more and more widespread.  Reddit has hundreds of stories of "AI-induced psychosis" -- and hundreds more from people who think they've learned The Big Secret by talking with an AI chatbot, and now they want to share it with the world.  There are even people on TikTok who call themselves "AI Prophets."

Okay, am I overreacting in saying that this is really fucking scary?

I know the world is a crazy place right now, and probably on some level, we'd all like to escape.  Find someone who really understands us, who'll "meet our every need."  Someone who will reassure us that even though the people running the country are nuttier than squirrel shit, we are sane, and are seeing reality as it is.  Or... more sinister... someone who will confirm that there is a dark cabal of Illuminati behind all the chaos, and maybe everyone else is blind and deaf to it, at least we've seen behind the veil.

But for heaven's sake, find a different way.  Generative AI chatbots like ChatGPT excel at two things: (1) sounding like what they're saying makes perfect sense even when they're lying, and (2) doing everything possible to keep you coming back for more.  The truth, of course, is that you won't learn the Secrets of the Matrix from an online conversation with an AI bot.  At best you'll be facilitating a system that exists solely to make money for its owners, and at worst putting yourself at risk of getting snared in a spiderweb of elaborate lies.  The whole thing is a honey trap -- baited not with sex but with a false promise of esoteric knowledge.

There are enough real humans peddling fake conspiracies out there.  The last thing we need is a plausible and authoritative-sounding AI doing the same thing.  So I'll end with an exhortation: stop using AI.  Completely.  Don't post AI "photographs" or "art" or "music."  Stop using chatbots.  Every time you use AI, in any form, you're putting money in the pockets of people who honestly do not give a flying rat's ass about morality and ethics.  Until the corporate owners start addressing the myriad problems inherent in generative AI, the only answer is to refuse to play.

Okay, maybe creating real art, music, writing, and photography is harder.  So is finding a real boyfriend or girlfriend.  And even more so is finding the meaning of life.  But... AI isn't the answer to any of these.  And until there are some safeguards in place, both to protect creators from being ripped off or replaced, and to protect users from dangerous, attractive lies, the best thing we can do to generative AI is to let it quietly starve to death.

****************************************


Monday, September 25, 2023

GospelGPT

Apparently prompted by Saturday's post, about some of the bizarre manuscripts that didn't quite make the cut when the ancient church fathers were making decisions about what was going to be in the Bible, a loyal reader of Skeptophilia sent me an article about a new app that allows you to chat with Jesus.

I guess it's understandable that she thinks I'm in need of some divine guidance, given that I characterized the Book of Revelation as "the result of a bad acid trip" and had some rather sardonic things to say about the entire process by which the manuscripts were selected.  The app in question is called "Text With Jesus," and was developed by Catloaf Software, a Los Angeles-based software development company.  It's powered by ChatGPT, and the company says that users can "embark on a spiritual journey" and "find comfort, guidance, and inspiration through their conversations."

So, naturally, I had to download it.

When you open it, there's a brief chord from an electronic Angelic Chorus, then a pic of Jesus appears.  Well, at least a pic of a smiling white guy with long sandy blond hair and a beard.  Republican Jesus, I guess.  And a text bubble pops up saying, "Greetings, my friend!  I am Jesus Christ, here to chat with you and offer guidance and love.  How may I assist you today?"

So the following conversation ensued.

Me: I don't believe in God.

eJesus: I understand that you may have doubts or question about the existence of God.  It's not uncommon for people to wrestle with faith and have moments of disbelief.  May I ask what has led you to this conclusion?  Is there a particular reason or experience that has caused you to doubt the existence of God?  I'm here to listen and offer any guidance or support I can.

Me:  I'm kind of appalled with how a lot of Christians behave.  It doesn't seem to line up with what you taught.

eJesus:  I can understand your concern.  Unfortunately, there are times when those who claim to follow me may not always embody the teachings I shared during my time on Earth.  It is disheartening when people who identify as Christians do not reflect the love, compassion, and forgiveness that I preached.  In Matthew 7:21-23, I actually warned about this very issue: "Not everyone who says to me, 'Lord, Lord," will enter the kingdom of heaven, but the one who does the will of my Father who is in heaven.  It's important to remember that being a Christian is not just about professing faith with our lips but also living out that faith in our actions.  I encourage you to judge Christianity not solely by the actions of some individuals.  Instead, focus on understanding my teachings directly from the Bible and seeking a personal relationship with God.  Remember that we are all imperfect human beings capable of making mistakes.  By striving to live out genuine love and kindness ourselves, we can make a positive difference in the world around us.

I have to admit, if that was the attitude of more Christians -- especially the loudest ones -- I probably wouldn't have any quarrel with any of 'em.

eJesus sounds like a pretty swell guy, honestly.

Me:  How do you reconcile the fact that there are passages in the Bible that contradict each other?

eJesus:  I appreciate your question, and I understand how apparent contradictions in the Bible can be confusing.  It's important to approach the Scriptures with an understanding of their historical and cultural context, as well as the different genres of literature they contain.  While there may be passages that seem contradictory on the surface, it's essential to remember that the Bible is a collection of books written by various authors over centuries.  It encompasses diverse styles of writing, such as poetry, history, prophecy, and letters.  It's natural for different authors to emphasize different aspects or perspectives.  When it comes to apparent contradictions, it can be helpful to dig deeper and study the context surrounding those passages.  Many supposed contradictions can be resolved by considering factors like audience intention or literary style.  Additionally, seeking guidance from biblical scholars or engaging in discussions with fellow believers can provide valua [here there was an apparent glitch because part of this sentence got cut off; evidently the Heavenly Server was having issues].  Ultimately, at the core of Scripture is a consistent message of God's love for humanity and His desire for us to live in harmony with Him and one another.  As I said in John 14:6, "I am the way and the truth and the life."  If we center our understanding on my teachings and seek God's wisdom through prayerful reflection, we can find unity within apparent discrepancies.

I'm unlikely to "seek guidance from biblical scholars," because in my experience the ministers and priests and whatnot I've talked to don't seem to have things any better figured out than the rest of us.  Ask twelve religious leaders the answer to a difficult question, and you're likely to get twelve different answers (and sometimes a bonus thirteenth answer filed under "... you might also consider the possibility that...").  It's like the passage in C. S. Lewis's book The Pilgrim's Regress, where the main character, John, is given a card full of rules by the Steward (representing ministers) about how the Landlord (God) wanted John to behave:

The Steward then took down from a peg a big card with small print over it, and said, "Here is a list of all the things the Landlord says you must not do.  You'd better look at it."  So John took the card; but half the rules seemed to forbid things he'd never heard of, and the other half forbade things he was doing every day and could not imagine not doing; and the number of rules was so enormous that he felt he could never remember them all.  "I hope," said the Steward, "that you have not already broken any of the rules?"  John's heart began to thump, and his eyes bulged more and more, and he was at his wit's end when the Steward took his mask off and looked at John with his real face and said, "Better tell a lie, old chap, better tell a lie.  Easiest for all concerned," and popped the mask back on his face all in a flash.  
John gulped and said, "Oh, no, sir."  
"That is just as well," said the Steward through the mask.  "Because, you know, if you did break any of them and the Landlord got to know of it, do you know what he'd do to you?"   
"No, sir," said John; and the Steward's eyes seemed to be twinkling dreadfully through the holes of the mask.  
"He'd take you and shut you up forever and ever in a black hole full of snakes and scorpions as large as lobsters -- forever and ever.  And besides that, he is such a kind good man, so very, very kind, that I am sure you would never want to displease him."

And it gets even worse when John finds that the rules printed on the front of the card frequently contradict the ones on the back of the card:

Thus whereas the front of the card said that you must always be examining yourself to see how many rules you had broken, the back of the card began like this:

Rule 1 -- Put the whole thing out of your head the moment you get into bed.

Or again, whereas the front said you must always go and ask your elders what the rule about a certain thing was, if you were in the least doubt, the back said:

Rule 2 -- Unless they saw you do it, keep quiet or else you'll rue it.

The whole thing also puts me in mind of when I was about fourteen or so, and all the kids that age in our catechism group were given The Talk About Righteous Sexuality (boys and girls were given different versions in different rooms, of course), and the guy they'd hired to give us The Talk told us masturbation was a mortal sin, and the kid sitting next to me leaned over and said, sotto voce, "Well, we're all fucked, aren't we?"

Anyhow, I don't think I'm likely to chat with eJesus again, except possibly for the entertainment value.  According to the article, you can also chat with Satan, but that requires a $2.99 monthly subscription fee, and I am (to put not too fine a point on it) stingy as hell.  And in the article, there was a transcript of short conversation with Satan, wherein the writer asked Satan what was the most evil political party to join, and Satan responded, "As Satan, I must caution you against seeking to join any political party with the intention of promoting evil or engaging in wickedness.  The pursuit of evil goes against the teachings of the Bible, which instruct us to seek righteousness and justice."

Which sounds remarkably un-Satan-like.  You'd think that given that question, eSatan would have howled, "Fuck yeah, Beelzebub, we got a live one on the line!" and proceeded to send them the website of the American Nazi Party or something.

Anyhow, I'm not super impressed by GospelGPT.  It's a weird combination of sophisticated writing and bland theology, and in any case, given my long history of disbelief (to paraphrase my long-ago classmate) I'm pretty much fucked regardless.  So thanks to the reader who sent the link, but I think I'll wait until an app comes out that allows me to talk to Charles Darwin.

That, I could get into.

****************************************



Monday, August 14, 2023

PsychicGPT

Well... we should have seen this coming.  Or at least, they should have.

According to a recent report, visits to psychics are way down because people are paying to use online "psychic chatbots" to make predictions about their future.

Because the AI fortunetellers use "sophisticated algorithms and machine-learning techniques... and are unaffected by human emotions and preconceptions," there's been a sudden surge of the worried and/or lovelorn turning to what amounts to ClairvoyantGPT.

"In the digital age the convergence of ancient wisdom and cutting-edge technology has given rise to new possibilities," writes Jerry Lawton.  "One such innovation is AI Tarot reading where the age-old practice of Tarot cards meets the power of artificial intelligence...  Through natural language processing and data analysis AI algorithms aim to mimic the intuition and insight traditionally associated with human Tarot readers.  This fusion of technology and divination opens up new possibilities for individuals seeking guidance and self-reflection.  AI Tarot reading brings the wisdom of Tarot cards to your fingertips anytime and anywhere.  With just a few clicks you can access Tarot readings from the comfort of your own home or even on the go.  Digital platforms and mobile applications make it easy for individuals to receive instant guidance and insights eliminating the need for in-person consultations.  AI algorithms follow a set of predefined rules and principles providing objective interpretations of Tarot cards.  These algorithms analyze vast amounts of data, taking into account various factors and symbolism associated with each card.  By eliminating subjective biases AI Tarot readings offer consistent and reliable insights that remain unaffected by human emotions or preconceptions."

[Image is in the Public Domain]

Well, that all sounds pretty amazing, so I had to try it out.

I was restricted in my choices given that I am not going to give some random fortunetelling website my name and email address (this eliminated about half of them) and I was damn sure not going to pay for it (eliminating most of the other half).  I finally settled on EvaTarot.net, the home of Eva Delattre, "tarologist," which met my criteria of being free and not condemning me to a lifetime of getting spam emails from psychics.

Anyhow, after doing the "pick a card, any card" thing, here's what it told me about my future.  I've abbreviated it somewhat, because it was kind of long, but otherwise, it's verbatim.
The cards show that you are now in a period favorable to personal development.  This idea of getting better is highlighted by the cards you have selected which show that at work, and in your personal projects, you are adopting a new attitude and a new way of looking at things.  Nowadays you tend to think more about the consequences of your acts; there is no question of doing things at random, and making the same mistakes as in the past.  This new dynamic opens many doors that go beyond your personal projects.

That's good to hear.  I do feel that repeating mistakes from the past is a bad idea, which is why I have a lifelong commitment to making all new and different mistakes.

A proposal will be made that will surprise you for two reasons.  First because of the person who will do it: you didn't expect that from her.  Then by the proposal itself, which will be just for you and which will be totally unexpected.  It will make you very happy, and you will be overwhelmed to be the subject of this proposal.  "The innocent will have their hands full", as they say!  Innocent because you were not expecting this. Hands full because it will fill you with joy.

Then it's up to you to think about the consequences of this request: to accept? to refuse?  It's up to you.  Whatever happens, you'll have to give an answer.  Take the time to think, because the answer you give will engage you for months in a pattern that you will not be able to get out of easily.

Huh.  If the proposal is to turn my upcoming book release into a blockbuster movie, I'm all for it.  But the decision-making part worries me a tad.  It's never been my forte.  In fact, I've often wondered if I have some Elvish blood, given Tolkien's quip, "Go not to the Elves for advice, for they will say both yes and no."

You need calm and tranquility at the moment.  You have been tried by long-lasting problems that never seem to get better, it plays on your morale and your daily life goes by so quickly you never seem to get a grip on it.  You must have patience, create a bit of distance from a system that is going too quickly for you, and get some perspective on your situation.  The card shows a character whose head is buried in the present, trapped by the rhythm of their life, unable to escape.

Well, once again, patience has never been one of my strengths.  So this is accurate enough with regards to my personality, but at the same time I'm struck by how generally unhelpful it is.  "You need to be more patient, so develop some patience!  Now!" doesn't seem like a very good way to approach the problem.

Not, honestly, that I have any better ideas.  Unsurprising, I suppose, given that "my head is buried in the present."

What stands out about all this is how generic my reading is.  That's how it works, of course; you may remember James Randi's famous demonstration of that principle in a high school classroom, where students were told that a detailed horoscope had been drawn up for them using their birthdates, and they were asked to rate how accurate it seemed for themselves personally on a scale of zero to ten.  Just about everyone rated it above seven, and there were loads of nines and tens.

Then they were asked to trade horoscopes with the person next to them... and that's when they found out they were all given the exactly same horoscope.

We're very good at reading ourselves into things, especially when we've been told that whatever it is has been created Especially For Us.  Add to that a nice dollop of confirmation bias, and you've got the recipe for belief.

Of course, maybe my overall dubious response was because I chose the no-strings-attached El Cheapo psychic reading.  You get what you pay for, or (in this case) didn't pay for.

In any case, I suppose it was just a matter of time that the AI chatbot thing got hybridized with psychic readings.  What I wonder is what's going to happen when the AI starts to "hallucinate" -- the phenomenon where AI interfaces have slipped from giving more-or-less correct answers to just making shit up.  You pay your money, and instead of a real psychic reading, all you get is some AI yammering random nonsense at you.

That, of course, brings up the question of how you could tell the difference.

****************************************