ggml

GGML & Llama.cpp: The Case for On-Device LLM Inference

Simply put, llama. cpp is a high-performance C/C++ library for running Large Language Models (LLMs) on standard hardware