#nanoLLAVA

2024-11-26

Edge-Ready #Vision Language Model Advances Visual #AI Processing 🌟

🧠 #OmniVision (968M params) sets new benchmark as world's smallest #VisionLanguageModel

🔄 Architecture combines #Qwen2 (0.5B) for text & #SigLIP (400M) for vision processing

💡 Key Innovations:
• 9x token reduction (729 → 81) for faster processing
• Enhanced accuracy through #DPO training
• Only 988MB RAM & 948MB storage required
• Outperforms #nanoLLAVA across multiple benchmarks

🎯 Use Cases:
• Image analysis & description
• Visual memory assistance
• Recipe generation from food images
• Technical documentation support

Try it now: huggingface.co/spaces/NexaAIDe
Source: nexa.ai/blogs/omni-vision

Client Info

Server: https://mastodon.social
Version: 2025.04
Repository: https://github.com/cyevgeniy/lmst