#TheBitterLessonInML

Teixiteixi
2024-05-25

@Jacob @pluralistic @HalvarFlake

HT x sharing, enjoyed listening:

• Compare current to begging algos & tools

• Cool remark that generic algos, w/o use of larger real datasets for training models, will beat expert algos & shorter datasets.

• Remark of synthetic data for training, yet employ with caution, and only helpful for some cases.

• Cool Q&A long answer for now is too late for keeping free internet datasets non-contaminated of synthetic BS .

Teixiteixi
2023-11-25

@emilygorcenski @kordinglab

» Not at all.

The point of the bitter lesson is that the right learning algorithms

(those that scale efficiently with massive computation)

are exactly what we need.

Massive computation does not alleviate the need for data efficiency «

24/11/2023

nitter.cz/RichardSSutton/statu

incompleteideas.net/IncIdeas/B

» Not at all.

The point of the bitter lesson is that

the right learning algorithms 
(those that scale efficiently with massive computation) 
are exactly what we need.

Massive computation does not alleviate the need for data efficiency «

#RichardSutton 24/11/2023

https://nitter.cz/RichardSSutton/status/1728129341287198885#m

#TheBitterLessonInML

http://www.incompleteideas.net/IncIdeas/BitterLesson.html

Client Info

Server: https://mastodon.social
Version: 2025.04
Repository: https://github.com/cyevgeniy/lmst