I found this issue of the #Interconnects newsletter really interesting. Progress in small, #opensource_llm models, but also insights into the dynamics of the whole #foundation_model ecosystem, and most importantly for me, a load on #llm_benchmarking. I'm still keen to find a way to relate the benchmarks to real world tasks in a way which makes sense for people who are trying to build, or are considering building #llm applications.
https://www.interconnects.ai/p/olmoe-and-building-better-llms?publication_id=48206&post_id=148458085