No guardrails

I was asked a couple of days ago if I think that AI is inherently bad.

My answer might surprise you; it was an unhesitating "no."  As a construct with -- thus far -- no sentient awareness, and therefore no intentionality, it isn't any more inherently evil than a rock.  Like anything, the problem comes with how beings with sentience and intentions use it, and more to the point, what guardrails are placed on it to prevent bad actors from misusing it.

And thus far, the deregulate-everything, corporate-capitalism-über-alles powers-that-be have seen fit to place no restrictions whatsoever on its uses, however harmful they might be.

If you think I'm exaggerating, here are four examples just from within the past few weeks of places where, in my opinion, any sane and moral person would say, "Oh, hell no," but the techbros are mostly shrugging and grinning and saying "ha ha ha ha ha ha ha fuck you."

A Dutch court had to force X/Twitter and its AI chatbot Grok, by way of massive fines (€100,000 per day for non-compliance) to stop users from using its "nudify" tool to produce child pornography and non-consensual adult pornographic images.  That such a tool even exists is sickening; that a court had to force Elon Musk's company to halt its use doubly so.  The problem, of course, is that the ruling only applies to use in the Netherlands; it's still widely available elsewhere.  So although the possession of child pornography is still illegal in most places, the AI tools people are using to produce it are still somehow legal.

And given that the current leadership in the United States was deeply entangled for decades in a horrific cult of pedophilia and abuse, it's doubtful any action will be taken over here.

The second example comes from a study out of Brown University that found people are using chatbots like ChatGPT as therapists, with alarming results.  Compared side-by-side to actual trained therapists, chatbots -- even those that had been trained on text based in modern psychoanalytic models and current therapeutic ethical standards -- consistently "mishandled crisis situations, gave responses that reinforced harmful beliefs about users or others, and used language that created a false appearance of empathy."

"For human therapists, there are governing boards and mechanisms for providers to be held professionally liable for mistreatment and malpractice," said Zainab Iftikhar, a computer scientist at Brown, who led the study.  "But when LLM counselors make these violations, there are no established regulatory frameworks."

Going hand-in-hand with this was a study out of Stanford University, where a team of researchers found that AI/LLM chatbots are being deliberately designed to incorporate sycophancy -- flattering, affirming, people-pleasing behaviors that facilitate users' desire to come back for more.  If you're in doubt about how intense (and scary) this effect is, here's a direct quote from the paper:

In our human experiments, even a single interaction with sycophantic AI reduced participants’ willingness to take responsibility and repair interpersonal conflicts, while increasing their own conviction that they were right.  Yet despite distorting judgment, sycophantic models were trusted and preferred.  All of these effects persisted when controlling for individual traits such as demographics and prior familiarity with AI; perceived response source; and response style.  This creates perverse incentives for sycophancy to persist: the very feature that causes harm also drives engagement.

Last, and most alarming of all, is a study out of King's College London looked at the AI-based systems now being used more and more often in war games and military strategy simulation and analysis, and found that when pitted against each other, these programs fell back on threats of nuclear weapons use 95% of the time.  Kenneth Payne, who led the study, writes:

Nuclear escalation was near-universal: 95% of games saw tactical nuclear use and 76% reached strategic nuclear threats.  Claude and Gemini especially treated nuclear weapons as legitimate strategic options, not moral thresholds, typically discussing nuclear use in purely instrumental terms.  GPT-5.2 was a partial exception, limiting strikes to military targets, avoiding population centers, or framing escalation as “controlled” and “one-time.”  This suggests some internalised norm against unrestricted nuclear war, even if not the visceral taboo that has held among human decision-makers since 1945.

Given that Secretary of Defense Pete Hegseth's idea of high-level military strategy is "shoot 'em up pew-pew-pew," and that he recently got into a huge battle with the head of the AI firm Anthropic over Anthropic's demand that there be restrictions on the unethical use of their AI systems by the military (Hegseth unsurprisingly wanted no restrictions whatsoever, and called Anthropic's objections "woke," which is MAGA-speak for "me no like"), anyone with a shred of foresight, morality, or simple common sense finds this pretty fucking alarming.  So we've got a drunk right-wing talk show host running the largest military in the world with all the thoughtfulness and restraint of a seven-year-old boy playing with G. I. Joes, and now he wants to turn over the decision-making to AI agents that have no apparent problem with using nuclear weapons.

I see no way that could go wrong.

Look, I'm honestly not a pessimist; I've always been in agreement with my dad's assessment that it's better to be an optimist who is wrong than a pessimist who is right.  But this infiltration of AI into everything -- our morality, our relationships, our mental health services, our governments, our militaries -- has got to stop.  Put simply, we're not ready for it as a species.  It's a challenge we didn't evolve to face.  Governments have been reluctant to act, whether from not fully understanding the threat or, as here in the United States, because the tech firms are paying elected officials to pretend there's no problem.  Which it is, of course, doesn't matter in the slightest, because the result is the same.  

No guardrails.

So it's up to us to speak up.  Pressure your representatives to place some kind of restrictions on this.  The Netherlands managed, at least in the case of Elon Musk's child porn generator, so it's possible.  But not unless we fully comprehend what's happening here, and are willing to use the voices we have.  Otherwise, we're in a situation like the one biologist E. O. Wilson warned us about years ago: "The real problem of humanity is that we have Paleolithic emotions, medieval institutions, and godlike technology."

****************************************

The war of choice

Back in the fifth century C. E., things had been looking pretty hopeless for the Jewish people in the Middle East for nearly three centuries.

The Bar Kokhba Revolt, which started in 132 and lasted four years, marked the beginning of the downward spiral.  A Judaean military leader, Simon bar Kokhba, launched a fierce rebellion against their repressive Roman overlords, with the immediate cause being Emperor Hadrian's intent to rebuild the damaged city of Jerusalem as an overtly Roman city, dedicated to the worship of Jupiter, and renamed Aelia Capitolina.  Bar Kokhba and his followers started a series of ultimately doomed guerrilla actions, and gained some ground for a while, but inevitably the far better armed and trained Roman legions were victorious.  The Jewish people in Judaea were destroyed almost completely, with the survivors fleeing to anywhere they could manage to get to.

Even after the devastating aftermath of the Bar Kokhba Revolt, however, the hope still remained that the Jews might eventually win back their lost territory.  By the middle of the fifth century, repeated invasions by the Goths, Huns, Alans, and Franks had weakened the Roman Empire to the point that some Jews thought the time was ripe.  Add to that the prediction that -- according to one interpretation of the Talmud -- the Messiah would arrive in the year 440, and you have a dangerous confluence of desperation, hope, and prophecy.

This is when a guy named Moses of Crete showed up.  According to a writing from the seventh century, the Chronicle of John of Nikiû, his name was originally Fiskis, but that doesn't sound nearly as impressive, so history remembers him as Moses.  Also uncertain is whether he actually believed what he preached, or if he was simply a charlatan.

Whatever the truth is, he amassed a huge following amongst the Jewish refugees in Crete, and convinced them he was anointed by God to lead them back to Judaea, where after a Holy War they would re-establish a Jewish kingdom.  Further, he said that he -- like his namesake -- would lead them, dry-shod, across the sea and back to the Holy Land.  Astonishingly, people believed him.  Many left behind everything they owned, followed Moses to a promontory on the southeastern coast of Crete, and walked off the edge.

The predictable happened.

The Chronicle says no one knows what happened to Moses after this debacle, in which hundreds perished.  Some say he died with them; others, that he panicked when he saw what was happening, and fled, assuming a different identity somewhere else.  Which it was, I suppose, depends primarily on which version you went for earlier -- whether he was a con artist or a True Believer.

I was reminded of the story of Moses of Crete when I saw a post yesterday over at Joe My God that combat unit commanders in charge of the soldiers tasked with carrying out Donald Trump and Pete Hegseth Kegbreath's ill-advised war against Iran have told their troops that the war is part of "God's divine plan" and that Donald Trump was "appointed by Jesus" to carry it out -- with the ultimate aim of triggering Armageddon and the Second Coming of Christ.

Nicholas Roerich, Armageddon (1936)  [Image is in the Public Domain]

This attempt to turn the attacks into a Holy War has already resulted in over a hundred complaints by servicemen and women, who (rightly) claim that framing this as some sort of Christian jihad is, to put it bluntly, insane.  The last thing we need is the End Times fanatics getting behind this because they've decided that Trump and Whiskey Pete are carrying God's authority to open the Seven Seals.

Don't get me wrong; the regime in Iran in general, and Supreme Leader Ali Khamenei in particular, are a bunch of murderous thugs (well, was in Khamenei's case).  But Trump and his cronies started a war, ostensibly to eliminate a nuclear threat that Trump himself said had been "obliterated" only eight months ago, but the obvious goal was distracting everyone from doing anything about the fact that there's credible evidence he and about a hundred other rich white guys were engaging in decades of horrifying and vicious pedophilia.  He has no plan beyond that, no strategy, no end game.  The entire thing is smoke and mirrors -- except that it has already cost lives, including those of six servicemen and over a hundred Iranian children at a girls' school bombed "accidentally."

Oh, but this is a Holy War!  Really it is!  Here, American soldiers, follow me right off this cliff!  The waters will part and God will grant you victory, I promise!  

Hegseth, of course, wants war; it's significant -- although it was widely ridiculed at the time -- that he changed the name of the department he leads from the Department of Defense to the Department of War.  He, and people like him, are happiest when they're thumping their chests and telling everyone what Big Bad Tough Guys they are, and there's nothing like bombing the shit out of a country to prove that to the world.

The only hopeful things I can draw from all of this are that (1) the complaints of religious proselytization are being taken seriously enough that an investigation is being launched, and (2) the Epstein files aren't going anywhere.  Yeah, the war in Iran has bumped them from the headlines for the moment, but nobody is forgetting about them.

It's pretty clear Trump doesn't have a religious bone in his body, and never has; as far as Hegseth, he appears to be a devout, if frighteningly fanatical, Christian.  Ultimately, of course, it doesn't matter, just as it didn't for Moses of Crete and his unfortunate followers.  Walking off the edge of a precipice, whether a real one or a metaphorical one, isn't going to result in some kind of miracle; it'll end up producing a pile of mangled bodies.

Not that Trump appears to care.  "There'll likely be more [casualties] before it ends," he said at a press conference a couple of days ago.  "That's the way it is.  Likely be more."

The whole thing reminds me of the trenchant words of Susan B. Anthony: "I distrust those people who know so well what God wants them to do, because I notice it always coincides with their own desires."

****************************************

The cabinet of Doctor MAGAligari

So Dictator-for-Life-elect Donald Trump has started to select his appointees for cabinet and other major government positions, and his choices are as appalling as they are unsurprising.  Apparently the only qualification for being selected is how fervently a prospective candidate has kissed Trump's ass.  Many of these are so awful they'd be funny if the consequences weren't so dire; the worst make replacing a distinguished jurist like Ruth Bader Ginsburg with the vapid Amy Coney Barrett seem like, "Eh, okay, that's not so bad."

Let's start with one that's so weird that when I first saw it posted, I thought it was a parody.  Alas, it isn't.  Trump has proposed a new department of the federal government, to be run by Elon Musk and Vivek Ramaswamy, called "The Department of Governmental Efficiency."  Or... DOGE.

I swear, sometimes the jokes write themselves.

It's unlikely that Trump can just declare the creation of a new department without Congress's approval, so it might be that this will be some sort of advisory board -- or considering the current Congress, maybe they'll just rubber-stamp it.  Whatever form it takes, Musk has already promised to cut two trillion dollars from the federal budget, which is going to be tricky because the discretionary budget is only around 1.7 trillion dollars.

But Musk's grasp on reality is such that he considers the loss of three-quarters of the users of Twitter since he took over a sign of his excellent business acumen, so why not?

What's most amusing about this one is that apparently Musk is already rubbing Trump the wrong way, and there are signs that his stay in the administration might be under half a Scaramucci long.  It's unsurprising when you think about it; there's no way in hell Musk and Trump could share the limelight.  There can only be one egotistical, sociopathic man-baby getting the praise, or else sparks start to fly.  What I wonder is what will happen when they have a serious falling out; Musk's way smarter than Trump (not that this is a high bar), and if he starts using his obscene amounts of wealth to sabotage Trump's agenda, things could get ugly fast.

Then there's the nominee for Secretary of Defense, Pete Hegseth.  At first, tapping Hegseth struck many people as a puzzling WTF moment; his sole qualification seemed to be that he'd been a host on Fox & Friends.  But further inquiry into Hegseth's background found that there's something darker behind this choice.  Hegseth has frightening ties to the Christofascist movement, especially the "Reformed Reconstructionists" (nicknamed the "TheoBros"), who advocate laws based on Christian supremacy, male dominance, and "building the Kingdom of God on Earth."  A sign of his beliefs is his tattoo someone found an image of:

"Deus Vult" ("God Wills It") was the rallying cry of the Crusaders, and has been taken over by the Christian Dominionists -- who want laws passed requiring Christianity as a prerequisite for holding elected office.

The Environmental Protection Agency is going to be run by New York State congressman Lee Zeldin, whose definition of "protection" is "deregulate the absolute fuck out of everything."  Zeldin has strong ties to the fossil fuel and auto industries, and basically wants to repeal any legislation holding back oil and natural gas drilling.  "While protecting access to clean air and water," Zeldin said, almost as an afterthought, although how he plans on doing both simultaneously is a mystery to everyone, probably including himself.

Then there's Mike Huckabee -- who stated "there's no such thing as a Palestinian" -- as ambassador to Israel.  Robert F. Kennedy Jr. has been nominated for Secretary of the Department of Health and Human Services; in a speech Trump said he was going to let RFK "go wild on health care."  The man is an antivaxxer, a conspiracy theorist who said that COVID-19 was genetically engineered to spare Jews and Chinese people, and promotes a whole shelf full of fringe-y "alt-med therapies."  He, in fact, seems simply to be an all-around general-purpose wacko, whose extreme anti-science views and determination to spread them was directly responsible for a measles epidemic in Samoa that killed dozens of children.  

And how about Tulsi Gabbard, who called media coverage of the January 6 coup attempt "sensationalized," and labeled Trump's 34 felony convictions as "persecution," who has been nominated for Director of National Intelligence despite having zero experience in intelligence (in both senses of the word).  Representative Abigail Spanberger, a former CIA officer, said about Gabbard, "Not only is she ill-prepared and unqualified, but she traffics in conspiracy theories and cozies up to dictators like Bashar-al Assad and Vladimir Putin.  As a member of the House Intelligence Committee, I am deeply concerned about what this nomination portends for our national security.  My Republican colleagues with a backbone should speak out."

But of course they won't, because no one questions Dear Leader.

Perhaps worst of all (at least so far -- heaven only knows what other hideous revelations await in this warped and surreal horror movie), there's the nomination of Florida Representative Matt Gaetz for Attorney General, which may have moved Trump onto shaky ground even with some of his supporters.  Gaetz has been the subject of investigation for having sex with a minor and for child sex trafficking, so putting him in the position of Attorney General -- the top legal advisor to the president, who oversees all issues of law enforcement nationally -- is a horrifying choice.  (I heard an interview with one Republican on the radio this morning who was one hundred percent supportive of Gaetz, and who said that one positive result of the nomination would be shutting down the investigation into Gaetz's actions -- further evidence that the majority of the GOP have more of a problem with a child being queer than they do with a child being raped.)  At least there were two Republicans, who (for obvious reasons) declined to be named, who said they were "stunned and disgusted" by the pick, and that "we wanted him out of the House, but this isn't what we had in mind."

Oh, and Republican Senator Susan Collins went so far as to say she was "shocked" by Gaetz's nomination, thus exceeding her previous most-overwrought emotional state, which was "concerned."  I'm sure she'll even make a frowny-face as she votes "yes" on confirming him.

What's coming?  I'd have said his next likely move was to put Marjorie Taylor Greene in charge of the Department of Education, but he's planning on closing that.  So MTG will have to cool her heels in the House of Representatives for a while longer.  Maybe the My Pillow guy can become the head of the Department of Homeland Security or Surgeon General or something.  I dunno.

The only glimmer of hope I can find in all this -- and it's a slim one -- is that his choices for cabinet members are, one and all, so dramatically unqualified that they're likely to resemble the Keystone Kops more than they do the Wehrmacht.  The problem is, as the entire mess implodes, it can do a lot of damage, depriving American citizens of services they depend on, and in the case of Kennedy and HHS, actually killing people.  As usual, the GOP is the Party of Small Government Until They Want Large Government.  Cutting services to ordinary Americans, defunding public education, destroying health services and medical care, deregulating industry, and killing environmental standards, that's all fine and dandy; but let's get the government into libraries, schools, and people's bedrooms, and along the way get the church into everything.

So those of you who voted for Trump -- I hope you're happy with the chaos that's about to descend.  It's grimly satisfying to know that with Republican control of the Executive Branch, the Senate, the Supreme Court, and (likely) the House of Representatives, you people at least won't have the option of blaming the Democrats when things go to hell.

****************************************