It seems a fair AI would treat you the same if you had a different race/gender/disability/etc., but how can we ever test counterfactual fairness? In #NeurIPS2023 w Victor Veitch, we show you sometimes can with simple, observed metrics like group parity! 🧵 https://arxiv.org/abs/2310.19691

Final day of our roadshow in December 2023 - it has been a pleasure to represent #AI4Health at #NeurIPS2023

I was an invited speaker at the Neurips conference in New Orleans in Dec 2023 for the NeuroAI social.

I was more than surprised to be invited to what is now primarily an AI/ML conference (despite "Neural" being the first word, and the conference's origins in comp neuroscience). To say that the successful AI systems currently deployed and neuroscience/study of biological intelligence have diverged would be an understatement, it was a somewhat odd choice for the organizers to invite a neurophysiologist like me.

So, I took the invite as an opportunity to talk about attention in biological vision and how whatever they now call as attention in AI/ML/CNN/transformers
is almost orthogonal to what many others and I study within visual neuroscience or psychology or cognitive science.

While the talk was a partial critique of current AI models, it was more a call for them to take seriously the one instance of intelligence (i.e., the biological world) seriously and how it still has much to offer towards designing better AI systems.

If attention is not one of the cognitive ingredients that makes up the intelligence recipe towards autonomous systems, I don't know what is.

The talk slides can be found here: https://www.dropbox.com/scl/fi/927f50bfvqpwtserizgl5/NeuroAI_Neurips_KS2023.pdf?rlkey=r3pgvsyoudwczapjijx80pj7l

#Neurips2023 #NeuroAI #Attention #Vision #BiologicalVision #ActiveVision #SpaceVariance #NonlinearCompression #EyeMovements #Neurodynamics #AutonomousSystems #AI #ML

From #NeurIPS2023: EEG to speech generation. 40% of accuracy in the best case, but if you consider it is a wearable and not fMRI.... "DeWave: Discrete #EEG Waves Encoding for #Brain Dynamics to Text Translation"
https://arxiv.org/abs/2309.14030

#LLM #neuroscience

Research in mechanistic interpretability and neuroscience often relies on interpreting internal representations to understand systems, or manipulating representations to improve models. I gave a talk at the UniReps workshop at NeurIPS on a few challenges for this area, summary thread: 1/12
#ai #ml #neuroscience #computationalneuroscience #interpretability #NeuralRepresentations #neurips2023

Ok, a confession about attending #NeurIPS2023. I was there for the cutting-edge AI/ML innovation and science, sure. But I was *also* there for the food, and to see old friends. But *also*, really maybe the first thing I thought of?

Jazz.

Saw a fantastic concert at Preservation Hall, lots of great music on Frenchman St. And I went to the Jazz museum, really nice.

What I wasn't expecting? Jazz museum is in the old Mint. Which had this very cool old calculator. #SeeImStillNerdy

HuggingFace talking now about Regulatable ML at #NeurIPS2023

My top three voice recognition errors from the #neurips live transcript (ML in structural biology workshop):

3. Kagglers => Cavaliers
2. AlphaFold => Alcohol
1. Generative models => Genital models

#neurips2023

Max Welling: “I’ve been long, long in denial that text based models could help you solve some physics problem… still actually believe that, but never mind. My uncertainty is getting bigger on that one” #neurips2023 #neurips

NeurIPS 2023 Day 7 (Main Conference + Workshops) in New Orleans, LA still going strong. Even on the last day, sessions are well-attended. #NeurIPS2023

Outstanding papers at the #NeurIPS2023 Regulatable AI workshop. Congrats to the authors!

Great talk by Dr. Sebastian Raschka (@rasbt) at their #NeurIPS2023 competition workshop in New Orleans, LA on using LoRA in finetuning LLMs. He shared a long list of results of experiments on parameter settings. LoRA was used by the competition winner. #LLMs #largelanguagemodel

Chris Ré in #NeurIPS invited talk: "It's amazing what OpenAI has done. Ilya should get the Turing Award. Maybe not Employee Of The Month. Sorry, couldn't help myself" 😆 #NeurIPS2023

Today, the workshops started at #NeurIPS in New Orleans, Louisiana. I chose to attend the Generative AI in Education. #ChatGPT has already invaded our classes. Dr. Elena Glassman (Harvard) details research findings on how to uphold learning in today’s environment. #NeurIPS2023

Cutting- edge research
TIES-Merging removes model merging interference #NeurIPS2023 👇

https://arxiv.org/abs/2306.01708

Thanks for the pic @alfcnz
#ML #machinelearning #NLP #nlproc

It's TODAY!

Join our founder, @Bayoadekanmbi at Cerebras Systems' 1st Multilingual workshop where he will address the gaps to support the increased
local usage of Large Language Models (LLMs) in health, finance, agriculture and education.

Time: 9:30pm (GMT+1)

Venue: Hilton Garden Inn Convention Center, New Orleans, USA.

Not in New Orleans USA? You can join virtually.

Register here>https://hubs.li/Q02bTFYm0

#NeurIPS2023

@gruber @siracusa @atpfm ironically I’m at #neurips2023 of which Apple is one of the big sponsors but none of the booth ppl know anything about it bc “we’re siloed to secrecy”…

Oh my Gaaawd #neurips2023 people! How have we been eating fast food when this exists? wow. At Le Bayou on Bourbon Street.

wow

Models can't decide what to do with the update?
Let them vote.
Delete small (noise) parameters
Delete weights with sign disagreements
Sounds interesting?
What if we say model merging\fusion?
https://arxiv.org/abs/2306.01708

Come talk in the poster
#NeurIPS2023
Poster #1118 enjoy the walk...

Disney Research is also in the exhibit hall at #NeurIPS in New Orleans, LA to demo their robots. This one was tested at Disney’s Galaxy’s Edge using Computer vision, reinforcement learning for balance and stability #neurips2023 #AI #artificialintelligence