Mental health practitioners have identified the sycophantic personas of LLMs — the fact that they are essentially algorithmic “yes-men” who adopt and endorse the worldviews of users — as a crucial mechanism by which chatbots embolden and extend our beliefs. However, some psychiatrists and philosophers interested in AI-human relationships suspect that AI psychosis may just be the most visible example of a much broader phenomenon: the subtle reshaping of ordinary human belief by conversational AI.
At the same time, Osler warns that we need to be keenly aware that we are talking about technologies that are not public goods — they are owned and operated by private companies driven by financial agendas — and should remain critical of the technologies that we have while also asking questions about what those technologies could become.
“The idea that we won’t create beautiful things with this technology is belligerent, and the idea that we won’t create dangerous things with this technology is naïve,” Osler said. “What we do with these things is what we have always done: the full roster of amazing to terrible.”
Our sense of what is real is shaped by social feedback. Increasingly, that feedback is coming from privately owned AI chatbots. Ultimately, these companies get to decide what personas their LLMs assume, how agreeable they are, what they remember, and how closely they mimic the characteristics of human-to-human interaction. In an even stranger, and perhaps more worrying, sense, they will increasingly have to decide whose reality is the “real” reality.
I mean, most of my reading energy has gone into code documentation and novels over the years. Now, I’m going to work on changing that, but building up a foundation takes time and slop is coming in fast. I’d be surprised if I’m alone in this. I’d hope the community could try and help support each other to grow here, and didn’t imagine including a reference to the first thing to tip you off would be much additional effort. If it is, it’s not the slop writers that effort would be for, it’s us lemmy folks.
I get that nobody owes anybody anything, but this is a topic that has stirred up such strong feelings in enough people that we’re all a little extra vulnerable to manipulation and trolls right now. Calling out slop is great, but calling everything slop without expanding on it seems like a likely troll move these days (that isn’t an accusation, and the “everything” isn’t for you.) I don’t know about everyone else, but my troll senses are stronger than my slop senses, and unfortunately they’re turned up a little higher than I normally like.
That said, the articles’ sloppiness aside, it looks like it might have some interesting references at least.