G
ggerganov/llama.cpp
RisingMaintainedLLM inference in C/C++
llminferencecppoptimization
71.2k(+1.5k this week)10.2k forksC++MITUpdated Dec 20
What it is
LLM inference in C/C++
Best for
InfraLLM
Quick Start
# Install
pip install llama.cppLLM inference in C/C++
LLM inference in C/C++
pip install llama.cpp