Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Kernels & AI inference engine for phone chips

Local AI API Platform

Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O

An innovative library for efficient LLM inference via low-bit quantization

Kolosal AI is an OpenSource and Lightweight alternative to LM Studio to run LLMs 100% offline on your device.

Inference Vision Transformer (ViT) in plain C/C++ with ggml

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

LLM in Godot

Booster - open accelerator for LLM models. Better inference and debugging for AI hackers

A game made for a school project, dedicated to my daughter.

Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compatible with most of Ikawrakow's quants except Bitnet.

lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

Local LLMs in your DAW!

Python bindings for llama.cpp

xllamacpp - a Python wrapper of llama.cpp

Run large language models in Godot.

Getting an LLM to work with Godot.

A flutter binding for llama.cpp, which use platform channel.