"You shall know a word by the company it keeps." Distributional Semantics as the basis for self supervised learning as in today's large language models. This is what my colleague @MahsaVafaie and I are going to talk about in this #kg2023 lecture excursion.
OpenHPI video: https://open.hpi.de/courses/knowledgegraphs2023/items/4fwf0437tRYK49o8Xd18Eg
youtube video: https://www.youtube.com/watch?v=EYAY8nmhpdg&list=PLNXdQl4kBgzubTOfY5cbtxZCgg9UTe-uF&index=61
slides: https://zenodo.org/records/10185262
@fiz_karlsruhe @fizise @tabea @sashabruns @enorouzi #semantics #distributionalsemantics #llm #llms #cooccurrence #wittgenstein
![Slide from the free OpenHPI MOOC Knowledge Graphs - Foundations and Applications, Week 6: Intelligent Applications with Knowledge Graphs and Deep Learning / Excursion 8: Distributional Semantics and LMs, The slide shows a historical picture of the linguist J. R. Firth as dreamed of by artBot. In a speech bubble he says "You shall know a word by the company it keeps." Below in the slide is the Wittgenstein quote "The meaning of a word is its use in the language". Bibliography: J.R. Firth (1957) A synopsis of linguistic theory, Studies in linguistic analysis, Blackwell, Oxford.
Prompt: “A 1950s photography of J. R. Firth aged 55, with glasses and a white toothbrush mustache, English linguist and leading figure in British linguistics””, created via ArtBot, ProtoGen, 2022, [CC-BY-4.0], https://tinybots.net/artbot](https://files.mastodon.social/cache/media_attachments/files/111/556/497/812/640/123/small/562e1274c0061293.png)