In our #ISE2025 lecture last Wednesday, we learned how in n-gram language models via Markov assumption and maximum likelihood estimation we can predict the probability of the occurrence of a word given a specific context (i.e. n words previous in the sequence of words).
#NLP #languagemodels #lecture @fizise @tabea @enorouzi @sourisnumerique @fiz_karlsruhe @KIT_Karlsruhe
Type-Constrained Code Generation with Language Models
https://arxiv.org/abs/2504.09246
#HackerNews #TypeConstrained #CodeGeneration #LanguageModels #AIinProgramming #CodeQuality
Adam Barney is 'Demystifying LLMs: How They Work and Why It Matters' July 24th at Nebraska.Code().
https://nebraskacode.amegala.com/
#Travefy #LargeLanguageModels #LLM #languagemodels #TechTalk #tokenization #embeddings #attentionmechanisms #finetuning #engineering #softwareengineering #softwareengineer #Nebraska #TechnologyConference #lincolnnebraska #devconference
🧠 🤖 Researchers from the Natural Language Processing Laboratory and NeuroAI Laboratory have discovered key ‘units’ in large AI models that seem to be important for language, mirroring the brain’s language system. When these specific units were turned off, the models got much worse at language tasks.
#LanguageModels #ArtificialIntelligence #AIResearch
Read more: https://go.epfl.ch/LJx-en
How can #LanguageModels optimize tradeoffs between performance and inference costs?
Meta-reasoner's "contextual multi-armed bandits" made the best trades on #math and #logic tasks by iteratively checking opportunities to redirect, correct, and optimize.
Ever wondered what really makes those powerful AI language models tick? 🤔 Andrej Karpathy offers a clear explanation, revealing the secrets behind their training and architecture. Discover how they're evolving and the key security hurdles we need to overcome. A must-read for anyone curious about the behind-the-scene aspects AI! https://www.alanbonnici.com/2025/05/demystifying-llms-with-andrej-karpathy.html #ArtificialIntelligence #NLP #LanguageModels #AISecurity #TechInsights #FutureofAI #TTMO
Building on the 90s, statistical n-gram language models, trained on vast text collections, became the backbone of NLP research. They fueled advancements in nearly all NLP techniques of the era, laying the groundwork for today's AI.
F. Jelinek (1997), Statistical Methods for Speech Recognition, MIT Press, Cambridge, MA
#NLP #LanguageModels #HistoryOfAI #TextProcessing #AI #historyofscience #ISE2025 @fizise @fiz_karlsruhe @tabea @enorouzi @sourisnumerique
Block Diffusion: Interpolating Autoregressive and Diffusion Language Models
#HackerNews #BlockDiffusion #Autoregressive #LanguageModels #DiffusionModels #MachineLearning #AIResearch
The project "Me, Myself, and AI" examines the situational understanding of advanced language models by applying a detailed array of over 13,000 questions. This initiative tests their capacity to identify themselves and comply with directives.
Discover more at https://situational-awareness-dataset.org.
At #NAACL this week and I’m delighted to see the name change to “Nations of the Americas” as well as the special theme for this year of multi- and cross-culturalism in #NLP.
#NLProc #AI #LLMs #LanguageModels #CompLing #ComputationalLinguistics
Today, the 2nd lecture of #ISE2025 took place with an introduction into Natural Language Processing, which will be subject of our lecture for the next 4 weeks.
#AI #nlp #informationextraction #ocr #ner #linguistics #computationallinguistics #morphology #pos #ambiguity #language @fiz_karlsruhe @fizise @tabea @enorouzi @sourisnumerique #AIart #generativeAI #machinetranslation #languagemodels #llm
✨🤖 Ah, behold the latest in #AI buzzword salad: "DeepSeek-R2", where the AI language models promise to lead us into a brave new world of vague "solutions" and existential dread. Because who wouldn't want a computer to understand the futility of human existence better than we do? 🧐💡
https://deepseek.ai/blog/deepseek-r2-ai-model-launch-2025 #Buzzwords #DeepSeekR2 #ExistentialDread #TechTrends #LanguageModels #HackerNews #ngated
🚀Somebody decided that tuning the knobs on large language models wasn't enough, so they invented "Inference-Aware Fine-Tuning for Best-of-N Sampling"—because that's what the world needed, more jargon. 🙄 Meanwhile, our brains are staggering under the weight of acronyms, wondering if the Simons Foundation can fund a cure for their strain.💡
https://arxiv.org/abs/2412.15287 #InferenceAwareFineTuning #BestOfNSampling #LanguageModels #AIJargon #SimonsFoundation #HackerNews #ngated
Can popular, generalist #LLMs answer questions as specialists?
Adopting each step of #diagnosis into a #ChainOfThought prompt made small and large #languageModels' outperform both zero-shot and the fine-tuned OLAPH method on the #MedLFQA benchmark.
Inferring the Phylogeny of Large Language Models
https://arxiv.org/abs/2404.04671
#HackerNews #Inferring #the #Phylogeny #of #Large #Language #Models #AI #Research #LanguageModels #Phylogenetics #MachineLearning #HackerNews
💻 Apple is taking #privacy seriously- also for training their #AI #languageModels.
In this new blog post, the #ML team outlines how they plan to get synthetic training #data without compromising privacy
🚀 Oh, look! Yet another 'groundbreaking' platform trying to democratize AI by letting anyone and everyone play with large language models... as long as they're willing to pretend Python isn't a thing. 🤦♂️ Blessed by the almighty #Mozilla, because nothing screams innovation like clunky open-source projects with dreams of world domination. 🌍✨
https://transformerlab.ai/ #AIinnovation #OpenSource #LanguageModels #TechTrends #HackerNews #ngated
Beyond Quacking: Deep Integration of Language Models and RAG into DuckDB
https://arxiv.org/abs/2504.01157
#HackerNews #BeyondQuacking #LanguageModels #RAG #DuckDB #AIIntegration
LLMs Understand Nullability
https://dmodel.ai/nullability-gentle/
#HackerNews #LLMs #Nullability #AI #LanguageModels #Understanding
