Ollama

Ollama is an open-source tool that makes running large language models locally as simple as a single terminal command. With `ollama run llama3`, you have a locally running model with no API key, no usage costs, and no data leaving your machine. It supports 50+ models including Llama 3, Mistral, Gemma, Phi, and Qwen. Developers building private AI applications, researchers working with sensitive data, and tinkerers who want to experiment without cost constraints use Ollama to run powerful models on consumer hardware. It provides an OpenAI-compatible API endpoint, making it trivially easy to swap local models into existing applications. Ollama has become the default tool for local LLM experimentation, with over 80,000 GitHub stars. Its ecosystem of compatible applications (Open WebUI, Continue.dev, Cursor) has made it the foundation of the local AI computing movement.