Llama Code in CP

Today, Meta released Llama Code, a Large Language Model trained specifically for code. It's trained on Python, C++, Java, PHP, Typescript, C#, Bash. They are releasing 3 models with 7B, 13B and 34B parameters respectively. The smaller two allow for Fill-in-the-Middle.

It's free for research and commercial use, but obviously requires a solid amount of computing power if you want to run it locally.

You can read more about it here: https://about.fb.com/news/2023/08/code-llama-ai-for-coding/

I'd be interested in seeing if this becomes useful in CP. It seems like there's a lot of potential, specifically with code completion with Fill-in-the-middle. Imagine having vscode and hitting something like "F3" and typing something like "SegTree with lazy prop, range set max, and range +=", and getting exactly the segment tree you need in two seconds.

I also think it may be useful because although LLMs are currently horrendous at the problem solving aspect of CP (similarly to how tools like MidJourney suck at hands), if you can highlight an area or chunk of code and be like "hey, this part's bad, try again for just this part", that might help improve weaknesses.

Just a thought.