#acceptability

2022-12-21

Happy to share our new paper “Language model acceptability judgements are not always robust to context” arxiv.org/abs/2212.08979! We prepend several kinds of context to minimal linguistic #acceptability test pairs and find #LMs (#OPT, #GPT2) can still achieve strong performance on #BLiMP & #SyntaxGym, except in some interesting cases. 🧵 [1/7]

Joint work with @jon , @kanishka, @amuuueller, @keren fuentes, @roger_p_levy, @Adinawilliams

Language model acceptability judgements are not always robust to context. Koustuv Sinha, Jon Gauthier, Aaron Mueller, Kanishka Misra, Keren Fuentes, Roger Levy, Adina Williams.
2021-07-11

#Acceptability - The quality of being acceptable; acceptableness.

https://mastodon.social/@rzrrzr@social.samsunginter.net
2019-07-18
https://mastodon.social/@rzrrzr@social.samsunginter.net
2019-07-15

Client Info

Server: https://mastodon.social
Version: 2025.04
Repository: https://github.com/cyevgeniy/lmst