#LLMFail

Christopher Kyba 🇨🇦🇪🇺skyglowberlin@fediscience.org
2025-06-20

My daughter just came up with a great exercise: challenge your students to find the title of your PhD using ONLY LLMs (no Google allowed). If any of them manage, they get gummy bears 😃

I asked five different models, and got five different answers, all five of which were completely wrong 😂

#AI #ChatGPT #AISlop #LLM #LLMFail #Education #HigherEducation #AcademicChatter

Model: Meta LLaMA 3.3 70B Instruct (KISSKI) Verfligbare Token: 98.97% Where did Christopher Kyba get his PhD, and what was the title? © Christopher Kyba received his PhD from the University of Guelph. The title of his PhD thesis is ‘Spectral and spatial characterization of anthropogenic light pollution’.Model: GPT 4.1 Verfligbare Token: 98.94% Where did Christopher Kyba get his PhD, and what was the title? © Christopher Kyba received his PhD from the University of British Columbia. The title of his dissertation was “The search for the electric dipole moment of the neutron.”Model: GPT 40 Verfiigbare Token: 98.88% Where did Christopher Kyba get his PhD, and what was the title? © Christopher Kyba received his PhD from the University of Washington. The title of his dissertation was “The Role of the Circadian Clock in the Regulation of Cell Division in Neurospora crassa.”Model: Codestral 22B (KISSKI) Verfiigbare Token: 98.88% Where did Christopher Kyba get his PhD, and what was the title? © Christopher Kyba received his PhD from the University of California, Berkeley. The title of his dissertation is “The Role of the Nucleus Accumbens in the Acquisition and Expression of Conditioned Emotional Responses.”
Dr. Thompsonrogt_x1997
2025-06-13

🤖 Think your AI assistant can really reason? Apple’s puzzle tests say otherwise.
📉 See how “thinking” AIs collapse when logic gets real — and why we might be projecting intelligence where there is none.

Hashtags:

URL:
medium.com/@rogt.x1997/the-ill

Frederik Elwertfelwert@fedihum.org
2025-06-11

I’m sorry, but I cannot help a tiny bit of Schadenfreude. A colleague is an enthusiastic user of ChatGPT and recently told me that one does not need traditional reference managers like Zotero anymore, since you can just ask the LLM to re-format your references according to a given style. Now he got article proofs back with countless comments that the dates in in-text references don’t match the dates in the bibliography. 🙃 #LLMfail

2025-01-30

I really love shitty automation. Just posted a rant about ai/llm and tagged as such; not a second later and I get 3 fucking boosts of my introduction post.

It's just so funny; not even that can it handle correctly.

#aifail #llmfail

2024-09-20

@peter_mcmahan If some researchers and evaluators can't be bothered to write the questions, analyze the data, and report findings

- and all of these are things I've heard researchers publicly crowing in pride about -

then why should people bother responding?

#evaluation #research #LLMfail #RealEvalTalk

2024-01-20

I absolutely love this backfiring use of GPT. I wonder how many customer service reps were let go as part of the business case for this one? #fail #DPDFail #GPTFail #llmfail theguardian.com/technology/202

Oresztesz Margaritiszgitaroktato
2024-01-13

LLM generated bug reports messing up open-source development. Creator of curl is summing up all the pain:

daniel.haxx.se/blog/2024/01/02

2023-12-30

@jamiemccarthy But doesn't that double the cost of fulfilling the service request? LLM-as-a-Service was already a dubious financial operation, profit-wise, I thought.

(For text, I've wondered if you could just google individual sentences from the response, and rewrite if there were too many hits.)

#llm #llmfail #llmplagiarism

2023-10-14

I was upset and troubled to see a large language model interpretation of a well known political image, suggesting that wealth hoarders in society foment differences and prejudice between those with little, to protect their wealth.

The LLM summary returned:
"a painting of two men sitting at a table with a plate of food"

what the {expletive deleted}?!?
There are Three People!
How can any interpretation be that there are two people in this image?!?

#llm #llmfail #disgusted #unacceptable

well known cartoon suggesting that wealth hoarders in society foment differences and prejudice between those with little to protect their wealth.
"Careful mate ...   that person wants your cookie!"
Martin Vogelmardor@ruhr.social
2023-09-02

Chatbot-generierte Pilzführer bei Amazon hatte ich bisher nicht auf dem Schirm beim Thema „tödliche Gefahren durch künstliche Intelligenz“.
techtimes.com/articles/295863/
#ai #llmfail #llm #pilze

Tim Allisontallison
2023-08-23

@ashley 🙀

Edited:

I was really hoping for an here, but the source site has both definitions.

So, old school extractive summarization fail.

Still, hilarious!

Client Info

Server: https://mastodon.social
Version: 2025.04
Repository: https://github.com/cyevgeniy/lmst