Hello TREC-ToTers! 👋🏽
Excited to announce the release of TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track guidelines: https://trec-tot.github.io/guidelines. We will release test queries in July and run submission deadline will be in August. #TREC2025 #TRECToT #TREC2025ToT
Please register to participate:
*IMPORTANT ANNOUNCEMENT*
We are extending the #TREC Tip-of-the-Tongue (ToT) Track run submission deadline to October 4th (**10 days from today**).
Registration and submission details can be found in the track guidelines: https://trec-tot.github.io/guidelines
Dear TREC-ToTers, less than two weeks to go! #TREC2024 #TRECToT #TREC2024ToT
👉🏽 Run submission deadline: **September 23rd**
👉🏽 Submission form: https://ir.nist.gov/evalbase/conf/trec-2024/trec2024-tot-main/submit
👉🏽 Guidelines: https://trec-tot.github.io/guidelines
👉🏽 You need to register to participate: https://trec-tot.github.io/guidelines#registration
We have released the test queries for TREC 2024 Tip-of-the-Tongue Track! #TRECToT #TREC2024ToT
🟢 Guidelines: https://trec-tot.github.io/guidelines
🟢 Run submission deadline: September 23rd
Let's gooooooo!
Hello TREC-TOTers!
Gentle reminders for #TREC2024 ToT Track:
🟢 Guidelines + train/dev data already available @ https://trec-tot.github.io/guidelines
🟢 Test queries will be released later this month
🟢 Submission deadline will be in September
Watch this space for more announcements! #TRECToT
🟡 Announcing the release of TREC 2024 Tip-of-the-Tongue (TREC-ToT) Track guidelines: https://trec-tot.github.io/guidelines. This year we have three domains: Movies, Landmarks, and Celebrities. We will release test queries in August and run submission deadline will be in September. #TREC #TREC2024 #TRECToT #TREC2024ToT
Please register to participate: https://trec-tot.github.io/guidelines#registration
#TREC2023ToT is now accepting runs. Please submit your runs soon! #TRECToT #TREC2023
📄 Guidelines: https://trec-tot.github.io/guidelines
🏃🏽♀️ Run submission form: https://ir.nist.gov/trecsubmit/tot.html
⏰ Run submission deadline: Aug 31
#TREC2023ToT is now accepting runs. Please submit your runs soon! #TRECToT #TREC2023
📄 Guidelines: https://trec-tot.github.io/guidelines
🏃🏽♀️ Run submission form: https://ir.nist.gov/trecsubmit/tot.html
⏰ Run submission deadline: Aug 31
We have released the test queries for TREC 2023 Tip-of-the-Tongue Track! #TRECToT #TREC2023ToT
📄 Guidelines: https://trec-tot.github.io/guidelines
⏰ Run submission deadline: Aug 31
Here we gooooooo!
We got GPT4 baseline for #TREC2023ToT Track! 🙌🏽 Test queries will be released on July 24 and run submission deadline is Aug 31.
Get your runs ready, should be an exciting #TRECToT track this year! 😎
Guidelines and more info: https://trec-tot.github.io/guidelines
#TRECToT updates:
📰 News: GPT4 baseline run significantly improves DCG over BM25 and dense retrieval. What approaches will you try at the track this year?
⏰ Reminder: Test queries will be released on July 24. Run submission deadline is Aug 31.
Guidelines: https://trec-tot.github.io/guidelines
⏰Gentle reminder: We'll release the TREC 2023 Tip-of-the-Tongue test queries in just over 2 weeks. We are super excited and looking forward to seeing all the creative approaches participants employ for this year's track. #TREC2023ToT #TRECToT
More info: https://trec-tot.github.io
From @bmitra
#TRECToT update: We have baselines!
We’re releasing 2 baselines using BM25 & dense retrieval that participants can compare against and build on. As these early results show, there's a lot of room to improve on this task!
Check guidelines for more details: https://trec-tot.github.io/guidelines
We've got BASELINES for our #TREC2023ToT Track! Lots of room to improve, should be an exciting track this year! 🙌🏽 #TRECToT
https://mastodon.social/@TREC_ToT@idf.social/110621934997454029
#TRECToT update: We have baselines!
We’re releasing 2 baselines using BM25 & dense retrieval that participants can compare against and build on. As these early results show, there's a lot of room to improve on this task!
Check guidelines for more details: https://trec-tot.github.io/guidelines
Hello!👋🏽
Quick #TRECToT updates:
📰 We added Wikipedia-IMDB mappings to our datasets: https://trec-tot.github.io/guidelines.
📣 Release date for test queries: July 24.
👥 Please join https://groups.google.com/g/trec_tot for latest news. Registered participants make sure you're on trectalk.slack.com.
I'm co-organizing 2 TREC tracks this year: Tip-of-the-Tongue & Deep Learning. Excited that 20+ groups have already registered for each. 🙌🏽#TREC2023
Please Register: https://ir.nist.gov/trecsubmit.open/application.html
* TREC-ToT Track: Test queries to be released in July. Submission deadline: August 31st. #TRECToT #TREC2023ToT
Guidelines: https://trec-tot.github.io
* TREC-DL Track: Test queries to be released in June. Submission deadline: July 31st. #TRECDL #TREC2023DL
Guidelines: https://microsoft.github.io/msmarco/TREC-Deep-Learning
🚨 Announcement 🚨
TREC 2023 Tip-of-the-Tongue (TREC-ToT) Track guidelines are now online: https://trec-tot.github.io. Test queries will be released in July and August 31st is the submission deadline. #TRECToT #TREC2023ToT
To participate, please pre-register: https://ir.nist.gov/trecsubmit.open/application.html.
Super excited about #TREC'23! 🙌🏽 This year is the 5th anniversary 🎂 of the Deep Learning Track. #TRECDL I'm also co-organizing the Tip-of-the-Tongue Track, #TRECToT the cool new track 😎 at TREC w/ complex and ambiguous information needs. Please participate!
https://trec.nist.gov/pubs/call2023.html
Have you ever tried re-finding a movie you watched as a child but can't remember its name? Perhaps you vaguely remember the plot or a few scenes or the context in which you watched it.
We are hosting The Tip-of-the-Tongue (ToT) Track at #TREC, a shared task focusing on known-item identification where the searcher can't recall a reliable identifier ("It’s on the tip of my tongue…").
Follow us for announcements and updates, and don't forget to participate in the track! #TRECToT
