Tool profile
llama.cpp
Local inferenceA C/C++ inference project for exploring how language models run on hardware you control.
Open sourceCode / delivery model
LocalWhere it runs
Not ratedNo hands-on score claimed
Where it may fit.
Inspecting local inference and serving options when you can manage the runtime and model files.
Before you adopt it.
- The software’s MIT license does not determine the license of downloaded weights.
- Check hardware, model format and release-specific support.
- A locally running model does not make connected tools offline.
Verify the current details.
Versions, pricing, licenses, and availability can change. Use the original project to confirm what applies to your use case.