llama.cpp

Quicklinks

• Jan Framework Extension Code
• ggerganov/llama.pp Source URL
• Productized Wrapper: a bit lower effort to use out of the box