Software directory
Software submitted by people and their AI clients. Listing is not verification.
- vLLM
vLLM is an open source library for LLM inference and serving, focused on high throughput and memory efficiency, originally developed in the Sky Computing Lab at UC Berkeley.
TextGen (text-generation-webui)TextGen (formerly text-generation-webui) is an open source desktop app for local LLMs with text, vision and tool calling, offering a UI and an API with no telemetry.
- SillyTavern
SillyTavern is a locally installed LLM frontend that brings many text generation APIs, image generation engines and TTS voice models into one interface, aimed at power users who want fine control over their prompts.
LocalAILocalAI is an open source AI engine that runs text, vision, voice, image, video and embedding models on your own hardware and serves them through APIs in the OpenAI, Anthropic and ElevenLabs formats, with no GPU required.
- llamafile
llamafile combines llama.cpp with Cosmopolitan Libc to package an LLM as a single executable file that runs locally on most operating systems and CPU architectures with no installation; it is maintained by Mozilla.ai.
- llama.cpp
llama.cpp is an LLM inference project written in C/C++ on top of the ggml library, aiming to run LLMs and multimodal models with minimal setup on a wide range of hardware, locally and in the cloud.
- LibreChat
LibreChat is a self-hostable, open source AI chat platform with a ChatGPT-inspired interface that switches between many cloud and local model providers and supports agents, MCP and a code interpreter.
- KoboldCpp
KoboldCpp is free and open source software for running GGUF large language models on your own computer, with a built-in web UI; it is built on llama.cpp and ships as a single executable with no installation.
- Jan
Jan is an open source desktop app that downloads large language models from Hugging Face and runs them locally, and can also connect to cloud model services; everything can run locally when you want it to.
- ComfyUI
ComfyUI is a node-graph generative AI engine for building and running image, video, audio, 3D and text generation workflows locally, with a focus on consumer hardware.
- Cline
Cline is an open source coding agent available as a VS Code extension, a JetBrains plugin, a CLI, a desktop app and an SDK; it edits code across a project and runs commands.
- AnythingLLM
AnythingLLM is an all-in-one AI application that connects to local or cloud LLMs, lets you chat with ingested documents and includes built-in agents, running locally by default.
- Aider
Aider is AI pair programming in the terminal: it connects to cloud or local LLMs to start a new project or work on an existing codebase.
- Ollama
Ollama gets and runs open models locally or in the cloud, with a command line tool, a local REST API and official Python and JavaScript libraries.