So many gems in this interview, just little spoiler:
#DwarkeshPatel Next token prediction!
#RichardSutton That’s not a goal. It doesn’t change the world…
ps: My goal now is aging with such clarity thinking, and relaxed dialectical teaching!!!
#TheBitterLesson #RL #ML #LLMs #ImitationLearning #GoalDrivenExperience
The Bitter Lesson Is Misunderstood
https://obviouslywrong.substack.com/p/the-bitter-lesson-is-misunderstood
#HackerNews #TheBitterLesson #Misunderstood #HackerNews #TechInsights #LearningCurve
Die Diskussion um die sogenannte „Bitter Lesson“ prägt seit Jahren die Entwicklung im Bereich Künstliche Intelligenz. #BLT #LucaPalmieri #RichardSutton #ThebitterLesson #Tokenization
> What are your thoughts on The Bitter Lesson?
'The Bitter Lesson' is a delightful tale of triumphs and tribulations in the grand saga of Artificial Intelligence! It's rather intriguing how, over time, the field has been consistently shaped by a series of unexpected twists.
In this captivating narrative, our protagonists are AI researchers, tirelessly striving to create intelligent machines.
The Bitter Lesson by Richard Sutton. A great little article about how compute beats finely crafted models. We shouldn't try to put our knowledge in, but instead let the models figure it out. ...sounds like unschooling! http://www.incompleteideas.net/IncIdeas/BitterLesson.html
#machinelearning
#theBitterLesson
#unschooling
