Lmst

AI's Short-Term Memory Problem - Dwarkesh Patel and Chris Williamson

Why AI "Learns" from Your Prompts (And What That Teaches Us About Attention) https://timdasey.substack.com/p/why-ai-learns-from-your-prompts-and (in-context filtering) #AI #prompting #ShortTermMemory

This is why a single example in your prompt can completely change the model's behavior.
When you show the Al one sample of the writing style you want, the attention mechanism picks up on the patterns in that example-sentence length, formality, structure, vocabulary-and uses those patterns to filter how it accesses its training knowledge. As the model generates its response, each new word it produces also feeds back into the attention calculation, helping it maintain consistency with the style you demonstrated.
The technical term is "in-context learning," but it's more accurate to call it "in-context filtering." The model isn't acquiring new information; it's filtering its existing knowledge through the lens of your prompt and its own developing response.

Why AI "Learns" from Your Prompts (And What That Teaches Us About Attention) https://timdasey.substack.com/p/why-ai-learns-from-your-prompts-and (in-context filtering) #AI #prompting #ShortTermMemory

@ReniTheRaven there’s a reason why I put a waterproof notepad in the shower.
#ShowerThoughts and my shot #ShortTermMemory

So what was your reaction when it was Jawaan Taylor getting called for it all game in the opener last year between the Lions and Chiefs? Was the league on the Lions side last year? #ShortTermMemory https://x.com/PetersenWill/s…

I am shocked that this ticky tacky thing Roger Goodell ordered is going the Chiefs way. Shocked!

About #workingmemory #shorttermmemory
https://arstechnica.com/science/2023/12/some-bird-brains-can-remember-things-the-same-way-we-do/

#DailyBloggingChallenge (137/200)

When looking at short term memory, a portion of it is the active working memory.

One way to look at the active working memory is like matrix multiplication.

Let’s say one gets a 5 digit number. It is fairly simple to return that number in the same order as given, which would equate to the identity matrix.

If one had to invert the order of number, then the diagonal of the matrix would be flipped compared to the identity matrix, so equating to a negative determinant.

Now imagine if one had to do more complex calculations like ordering the months of the year alphabetically. Creating a matrix that transposes the months vector is initially not that simple, though once instantiated, it becomes quite simple to repeat.

Depending on how many row alterations are needed, starting from the identity matrix could be a way to quantify the complexity of the task.

#ShortTermMemory #ActiveWorkingMemory #memory #matrix #MatrixMultiplication #maths

Now on ACB Media 8 the PCB Conference and Convention brings you celebrated author and Podcaster Ann Chiapeeta (forgive spelling I am not in a place where I can verify spelling). Ann has written 5 books, is a poet, and has co-produced for Friends in Art. Tonight’s topic is a discussion of audio Prompting. I’m already mesmerized. #PCB, #ACBMedia8, #ShortTermMemory, #AudioPropting

The best way to ingest caffeine and far more healthier than energy drinks or soda 👍

"However, the #MRI scans showed that drinking #coffee increased activity in parts of the brain involved in #ShortTermMemory, #attention and #focus, whereas ingesting #caffeine on its own did not."

Brain scans of #CoffeeDrinkers show its effects go beyond caffeine
https://www.nbcnews.com/health/health-news/brain-scans-coffee-drinkers-caffeine-rcna91680

#memory #shorttermmemory #hearts #heartsurgery #chesttube

$ﬂ\ Jessica Ellis y @baddestmamajama Sometimes | think about how after my heart surgery they had to do a quick procedure to remove the chest tube, and they nonchalantly gave me a MEDICATION THAT STOPS YOU FROM FORMING SHORT TERM MEMORY like that was normal and not a sci-fi idea that could spawn a thousand tales. 12:35 PM - May 17, 2023 [6)$

New #vinyl set, "Identity."
🕴️ 🕴️ 🕴️ 🕴️
https://www.mixcloud.com/emuziek/identity/
-
#ShortTermMemory #ExilSystem
#BakterielleInfektion #YearsOnEarth
#AnalogueElectronix #NegativeResponse #Misteek
#JohnJLafia #TheHorseHesSick
#Fantomas #GunClub #ABlazeColour
#CabaretVoltaire #Zweitbesetzung
#Weltklang #AndreasHolmsCollage
#DCPoebeln #EffetoJoule #ShibuyaStation #NubloRoboten
#Fraktus #SeveredHeads #electronicmusic #darksynth #electro
#minimalwave #coldwave #minimal
#records #NowPlaying #djset #dj
🕴️ 🕴️ 🕴️ 🕴️

Vinyl setlist. Minimal electronic music. Electro underground.

Here we go again: the common #adhd morning #dilemma of ‘Have I taken my meds or not?’

Thanks to my lovely #ShortTermMemory, I have to piece together my morning and see where I deviated from The Sequence of Things, because any deviation can make me forget a step.

(this need for a specific order of actions makes me wonder how far along the spectrum I might be).

#Neurodiverse #Neurodiversity

Looking for alternatives #2

I'd like an alternative for my short-term memory. I came here to ask for suggestions for alternatives to two things and in the process of writing the first post I totally forgot what the second item was.

#ADHD #ShortTermMemory #MyLifeSucks

JOHN HESS MD @DRJOHNHHESS • DEC 27, 2022

Significant short-term memory issues

Interesting and useful twitter thread,
roll-ups not currently working.

3 patients in the last 2 weeks, all with significant short-term memory issues, including forgetting where they are going while driving. No prior dementia. None brought up COVID infection until asked. All three have been infected within the past 4 months when asked. Is anyone else seeing this?

#Covid19 #ShortTermMemory

https://twitter.com/DrJohnHhess/status/1607868082730700800?s=20&t=er2W_PDpNYiGXx-Gp4Yb8Q