#StarCoder2

2024-04-28

After playing around with different open source alternatives to GitHub Copilot, I have my winner: Tabby ๐Ÿ†

1) Easy to install ๐Ÿ”จ
2) Good recommendation for models to use (which support for Fill-in-the-Middle) ๐Ÿค–
3) VSCode Plugin which gives the same feeling as the official GitHub Copilot (V1) plugin.

Notice: I think, currently it does not support Copilot Chat, but I do not need that right now anyways.

tabby.tabbyml.com/

#Tabby #LLM #LocalLLM #StarCoder #StarCoder2 #Copilot #OpenSource

An example code completion. Written by the user was "Function which prints 'Hello World'". Tabby autocompleted the code to

def hello_mastodon(): 
    print("Hello Mastodon")
2024-03-08

StarCoder2 is a family of code generation models (3B, 7B, and 15B), trained on 600+ programming languages from The Stack v2 and some natural language text such as Wikipedia, Arxiv, and GitHub issues. The models use Grouped Query Attention, a context window of 16,384 tokens, with sliding window attention of 4,096 tokens. The 3B & 7B models were trained on 3+ trillion tokens, while the 15B was trained on 4+ trillion tokens. For more details check out the paper.

โ€” StarCoder2 @ Github

StarCoder2 is a family of open LLMs for code and comes in 3 different sizes with 3B, 7B and 15B parameters. The flagship StarCoder2-15B model is trained on over 4 trillion tokens and 600+ programming languages from The Stack v2. All models use Grouped Query Attention, a context window of 16,384 tokens with a sliding window attention of 4,096 tokens, and were trained using the Fill-in-the-Middle objective.

StarCoder2 offers three model sizes: a 3 billion-parameter model trained by ServiceNow, a 7 billion-parameter model trained by Hugging Face, and a 15 billion-parameter model trained by NVIDIA using NVIDIA NeMo on NVIDIA accelerated infrastructure:

โ€” StarCoder2 @ Hugging Face

 

https://www.symphora.com/2024/03/starcoder2-open-source-code-completion-models/

#AI #codeCompletion #Huggingface #LLM #NVIDIA #StarCoder2

Software Heritageswheritage@mstdn.social
2024-03-05

๐ŸŒŸ Discover #SoftwareHeritage's mission: preserving human code knowledge! Learn about our journey, challenges, and groundbreaking milestone: #StarCoder2, the first #AI model for code using our #repository.

Join us in shaping ethical AI!

๐Ÿ‘‰ Read more: softwareheritage.org/2024/02/2

Pioneering the Future of Code Preservation and AI with StarCoder2
2024-02-29

#GitHub #Copilot Enterprise and a new set of #StarCoder2 #LLMs released this week will add to an expanding array of #genAI #codingassistant tools but experts urge caution as enterprises look to adopt them. techtarget.com/searchsoftwareq

Client Info

Server: https://mastodon.social
Version: 2025.04
Repository: https://github.com/cyevgeniy/lmst