Skip to content

Open-source tools: local-llm

Open-source Devhok entries in the local-llm category, with repository facts from the GitHub API.

Ollama

A command-line tool and background service for downloading and running open language models locally, with a built-in model library and an OpenAI-compatible local API.

ollama/ollama

If the local-LLM promise is 'no subscription, no data leaving the machine', this is the shortest path from install to first prompt.

  • llm
  • local-inference
  • cli

GitHub

WatchForksStars

License
MIT
Language
Go
Last push
Oct 15, 2026
Latest release
v0.40.4 (Oct 12, 2026)

Stats as of Oct 15, 2026

Open WebUI

A self-hosted web interface for running and chatting with language models through an Ollama-compatible API, with conversation history and multi-user support.

open-webui/open-webui

A private, ChatGPT-shaped interface over models that run on your own machine โ€” useful when the model is local but the workflow is not.

  • llm
  • web-ui
  • self-hosted

GitHub

WatchForksStars

License
NOASSERTION
Language
Python
Last push
Oct 15, 2026
Latest release
v0.12.2 (Oct 14, 2026)

Stats as of Oct 15, 2026

llama.cpp

A C++ inference engine that runs large language models locally from quantized GGUF files, on CPU, Apple Silicon or a consumer GPU.

ggml-org/llama.cpp

The cheapest way to run a serious model is a quantized one on hardware you already own โ€” and this is the engine that makes that possible on a mid-range machine.

  • llm
  • inference
  • gguf

GitHub

WatchForksStars

License
MIT
Language
C++
Last push
Oct 15, 2026
Latest release
v0.7.0 (Oct 15, 2026)

Stats as of Oct 15, 2026