Ollama

Desktop app to discover, download, and run local LLMs privately.

A GUI for running open-weight models on your own hardware — browse and download GGUF/MLX models, chat offline, and expose an OpenAI- and Anthropic-compatible local server for your apps. Includes RAG over local files, MCP tool-use support, and dual llama.cpp + Apple MLX runtimes. Free for personal and commercial use; the app itself is proprietary.

ChatGPT alternative that runs 100% offline on your computer.

An open-source desktop assistant that runs AI models 100% offline on your own machine, bundling a local model runner so you can download and chat with open models like Llama, Gemma, and Qwen. It also supports bring-your-own keys for cloud providers when you want them, and exposes a local OpenAI-compatible server. Fully open source under Apache 2.0 with no paid tier.

High-throughput, memory-efficient inference engine for LLMs.

A serving engine for large language and vision-language models, originally from UC Berkeley's Sky Computing Lab. Its PagedAttention KV-cache management and continuous batching deliver high throughput on commodity GPUs. Now a community project with 1000s of contributors and an OpenAI-compatible server.

One OpenAI-compatible API in front of models from every provider.

A unified gateway that routes a single endpoint and API key to models from Anthropic, OpenAI, Google, Meta, DeepSeek, xAI, and more — swap models by changing one parameter, with automatic fallbacks and one consolidated bill. Pass-through token pricing plus dozens of free models.