🌍 #CohereForAI introduces #Aya, a groundbreaking #MultilingualAI research initiative

🤝 3,000+ independent researchers from 119 countries collaborating on advancing language accessibility in #AI

📚 Key achievements:
• 513M dataset covering 101 languages
• 204K original human annotations
• Three #opensource models: Aya-101, Aya Expanse 8B & 32B
• Supporting previously underserved languages

🔬 Research highlights:
• State-of-the-art performance in multilingual benchmarks
• Complete dataset and model weights openly available on #HuggingFace
• Focus on natural language understanding, summarization, and translation

⚡️ Project scope:
• 250+ language ambassadors
• 81K Discord messages
• Comprehensive research papers and technical documentation
• Named after "fern" in Twi language, symbolizing endurance

https://cohere.com/research/aya

Exciting news from #CohereForAI: they've just released their open-source #LLM called Aya which they created through large-scale collaborative approach.

According to them, they focused on including many under-represented languages. And they published academic papers that look eg into their data collection approach.

Looking forward to digging into those papers 🤓

https://cohere.com/research/aya

#AI #OpenSource

model paper https://cohere.com/research/papers/aya-model-paper-2024-02-13
dataset paper https://cohere.com/research/papers/aya-dataset-paper-2024-02-13
dataset on hF https://huggingface.co/datasets/CohereForAI/aya_collection
model on HF https://huggingface.co/CohereForAI/aya-101
#AI #MultilingualAI #OpenScience #CohereForAI #MachineLearning