A command-line tool and background service for downloading and running open language models locally, with a built-in model library and an OpenAI-compatible local API.
A self-hosted web interface for running and chatting with language models through an Ollama-compatible API, with conversation history and multi-user support.
The cheapest way to run a serious model is a quantized one on hardware you already own โ and this is the engine that makes that possible on a mid-range machine.