Mental health practitioners have identified the sycophantic personas of LLMs — the fact that they are essentially algorithmic “yes-men” who adopt and endorse the worldviews of users — as a crucial mechanism by which chatbots embolden and extend our beliefs. However, some psychiatrists and philosophers interested in AI-human relationships suspect that AI psychosis may just be the most visible example of a much broader phenomenon: the subtle reshaping of ordinary human belief by conversational AI.

At the same time, Osler warns that we need to be keenly aware that we are talking about technologies that are not public goods — they are owned and operated by private companies driven by financial agendas — and should remain critical of the technologies that we have while also asking questions about what those technologies could become.

“The idea that we won’t create beautiful things with this technology is belligerent, and the idea that we won’t create dangerous things with this technology is naïve,” Osler said. “What we do with these things is what we have always done: the full roster of amazing to terrible.”

Our sense of what is real is shaped by social feedback. Increasingly, that feedback is coming from privately owned AI chatbots. Ultimately, these companies get to decide what personas their LLMs assume, how agreeable they are, what they remember, and how closely they mimic the characteristics of human-to-human interaction. In an even stranger, and perhaps more worrying, sense, they will increasingly have to decide whose reality is the “real” reality.

  • undrwater@lemmy.worldEnglish
    3·
    22 hours ago

    I really loved this sentence:

    Slop is already a denial of service attack on our attention, our infrastructure and the signal-to-noise ratio of the information that we consume.

    Thanks for this!

    As to why you might help people:

    LLM’s write in language styles based on articles and writing that came “before”. I’m somewhat older (61), and I recognize my style from many of the responses I get from LLM’s.

    I’m just now starting to see the patterns that are generated, but I understand those are being corrected. Still, some humans are better at pattern matching than others, so a little help goes a long way.

    Thanks again!