Ollama

Get up and running with large language models.

macOS

Download

Windows

Download

Linux

curl -fsSL https://ollama.com/install.sh | sh

Manual install instructions

Docker

The official Ollama Docker image ollama/ollama is available on Docker Hub.

Libraries

• ollama-python
• ollama-js

Community

• Discord
• Reddit

Quickstart

To run and chat with Gemma 3:

ollama run gemma3

Models

Model	Parameters	Size	Download
Gemma 3	1B	815MB	ollama run gemma3:1b
Gemma 3	4B	3.3GB	ollama run gemma3
DeepSeek-R1	7B	4.7GB	ollama run deepseek-r1
gpt-oss	20B	14GB	ollama run gpt-oss

See a full list of models on ollama.com

CLI Reference

Download a model

ollama pull gemma3

Remove a model

ollama rm gemma3

Create a model

ollama create is used to create a model from a Modelfile.

ollama create mymodel -f ./Modelfile

Show model information

ollama show gemma3

Copy a model

ollama cp gemma3 my-model

List models on your computer

ollama list

Multiline input

For multiline input, you can wrap text with """:

>>> """Hello,
... world!
... """
I'm a basic program that prints the famous "Hello, world!" message to the console.

Multimodal models

ollama run gemma3 "What's in this image? /Users/jmorgan/Desktop/smile.png"

Pass the prompt as an argument

ollama run gemma3 "Summarize this file: $(cat README.md)"

List which models are currently loaded

ollama ps

Stop a model which is currently running

ollama stop gemma3

Start Ollama

To run Ollama's server, use:

ollama serve

Building

See the development guide

REST API

Ollama has a REST API for running and managing models.

Generate a response

curl http://localhost:11434/api/generate -d '{
  "model": "gemma3",
  "prompt":"Why is the sky blue?"
}'

See the API documentation for more information.

Community Integrations

Web & Desktop

• Open WebUI
• SwiftChat (macOS with ReactNative)
• Enchanted (macOS native)
• Hollama
• Lollms-Webui
• LibreChat
• Bionic GPT
• HTML UI
• Saddle
• TagSpaces (A platform for file-based apps, utilizing Ollama for the generation of tags and descriptions)
• Chatbot UI
• Chatbot UI v2
• Typescript UI
• Minimalistic React UI for Ollama Models
• Ollamac
• big-AGI
• Cheshire Cat assistant framework
• Amica
• chatd
• Ollama-SwiftUI
• Dify.AI
• MindMac
• NextJS Web Interface for Ollama
• Msty
• Chatbox
• WinForm Ollama Copilot
• NextChat with Get Started Doc
• Alpaca WebUI
• OllamaGUI
• OpenAOE
• Odin Runes
• LLM-X (Progressive Web App)
• AnythingLLM (Docker + MacOs/Windows/Linux native app)
• Ollama Basic Chat: Uses HyperDiv Reactive UI
• Ollama-chats RPG
• IntelliBar (AI-powered assistant for macOS)
• Jirapt (Jira Integration to generate issues, tasks, epics)
• ojira (Jira chrome plugin to easily generate descriptions for tasks)
• QA-Pilot (Interactive chat tool that can leverage Ollama models for rapid understanding and navigation of GitHub code repositories)
• ChatOllama (Open Source Chatbot based on Ollama with Knowledge Bases)
• CRAG Ollama Chat (Simple Web Search with Corrective RAG)
• RAGFlow (Open-source Retrieval-Augmented Generation engine based on deep document understanding)
• StreamDeploy (LLM Application Scaffold)
• chat (chat web app for teams)
• Lobe Chat with Integrating Doc
• Ollama RAG Chatbot (Local Chat with multiple PDFs using Ollama and RAG)
• BrainSoup (Flexible native client with RAG & multi-agent automation)
• macai (macOS client for Ollama, ChatGPT, and other compatible API back-ends)
• RWKV-Runner (RWKV offline LLM deployment tool, also usable as a client for ChatGPT and Ollama)
• Ollama Grid Search (app to evaluate and compare models)
• Olpaka (User-friendly Flutter Web App for Ollama)
• Casibase (An open source AI knowledge base and dialogue system combining the latest RAG, SSO, ollama support, and multiple large language models.)
• OllamaSpring (Ollama Client for macOS)
• LLocal.in (Easy to use Electron Desktop Client for Ollama)
• Shinkai Desktop (Two click install Local AI using Ollama + Files + RAG)
• AiLama (A Discord User App that allows you to interact with Ollama anywhere in Discord)
• Ollama with Google Mesop (Mesop Chat Client implementation with Ollama)
• R2R (Open-source RAG engine)
• Ollama-Kis (A simple easy-to-use GUI with sample custom LLM for Drivers Education)
• OpenGPA (Open-source offline-first Enterprise Agentic Application)
• Painting Droid (Painting app with AI integrations)
• Kerlig AI (AI writing assistant for macOS)
• AI Studio
• Sidellama (browser-based LLM client)
• LLMStack (No-code multi-agent framework to build LLM agents and workflows)
• BoltAI for Mac (AI Chat Client for Mac)
• Harbor (Containerized LLM Toolkit with Ollama as default backend)
• PyGPT (AI desktop assistant for Linux, Windows, and Mac)
• Alpaca (An Ollama client application for Linux and macOS made with GTK4 and Adwaita)
• AutoGPT (AutoGPT Ollama integration)
• Go-CREW (Powerful Offline RAG in Golang)
• PartCAD (CAD model generation with OpenSCAD and CadQuery)
• Ollama4j Web UI - Java-based Web UI for Ollama built with Vaadin, Spring Boot, and Ollama4j
• PyOllaMx - macOS application capable of chatting with both Ollama and Apple MLX models.
• Cline - Formerly known as Claude Dev is a VSCode extension for multi-file/whole-repo coding
• Cherry Studio (Desktop client with Ollama support)
• ConfiChat (Lightweight, standalone, multi-platform, and privacy-focused LLM chat interface with optional encryption)
• Archyve (RAG-enabling document library)
• crewAI with Mesop (Mesop Web Interface to run crewAI with Ollama)
• Tkinter-based client (Python tkinter-based Client for Ollama)
• LLMChat (Privacy focused, 100% local, intuitive all-in-one chat interface)
• Local Multimodal AI Chat (Ollama-based LLM Chat with support for multiple features, including PDF RAG, voice chat, image-based interactions, and integration with OpenAI.)
• ARGO (Locally download and run Ollama and Huggingface models with RAG and deep research on Mac/Windows/Linux)
• OrionChat - OrionChat is a web interface for chatting with different AI providers
• G1 (Prototype of using prompting strategies to improve the LLM's reasoning through o1-like reasoning chains.)
• Web management (Web management page)
• Promptery (desktop client for Ollama.)
• Ollama App (Modern and easy-to-use multi-platform client for Ollama)
• chat-ollama (a React Native client for Ollama)
• SpaceLlama (Firefox and Chrome extension to quickly summarize web pages with ollama in a sidebar)
• YouLama (Webapp to quickly summarize any YouTube video, supporting Invidious as well)
• DualMind (Experimental app allowing two models to talk to each other in the terminal or in a web interface)
• ollamarama-matrix (Ollama chatbot for the Matrix chat protocol)
• ollama-chat-app (Flutter-based chat app)
• Perfect Memory AI (Productivity AI assists personalized by what you have seen on your screen, heard, and said in the meetings)
• Hexabot (A conversational AI builder)
• Reddit Rate (Search and Rate Reddit topics with a weighted summation)
• OpenTalkGpt (Chrome Extension to manage open-source models supported by Ollama, create custom models, and chat with models from a user-friendly UI)
• VT (A minimal multimodal AI chat app, with dynamic conversation routing. Supports local models via Ollama)
• Nosia (Easy to install and use RAG platform based on Ollama)
• Witsy (An AI Desktop application available for Mac/Windows/Linux)
• Abbey (A configurable AI interface server with notebooks, document storage, and YouTube support)
• Minima (RAG with on-premises or fully local workflow)
• aidful-ollama-model-delete (User interface for simplified model cleanup)
• Perplexica (An AI-powered search engine & an open-source alternative to Perplexity AI)
• Ollama Chat WebUI for Docker (Support for local docker deployment, lightweight ollama webui)
• AI Toolkit for Visual Studio Code (Microsoft-official VSCode extension to chat, test, evaluate models with Ollama support, and use them in your AI applications.)
• MinimalNextOllamaChat (Minimal Web UI for Chat and Model Control)
• Chipper AI interface for tinkerers (Ollama, Haystack RAG, Python)
• ChibiChat (Kotlin-based Android app to chat with Ollama and Koboldcpp API endpoints)
• LocalLLM (Minimal Web-App to run ollama models on it with a GUI)
• Ollamazing (Web extension to run Ollama models)
• OpenDeepResearcher-via-searxng (A Deep Research equivalent endpoint with Ollama support for running locally)
• AntSK (Out-of-the-box & Adaptable RAG Chatbot)
• MaxKB (Ready-to-use & flexible RAG Chatbot)
• yla (Web interface to freely interact with your customized models)
• LangBot (LLM-based instant messaging bots platform, with Agents, RAG features, supports multiple platforms)
• 1Panel (Web-based Linux Server Management Tool)
• AstrBot (User-friendly LLM-based multi-platform chatbot with a WebUI, supporting RAG, LLM agents, and plugins integration)
• Reins (Easily tweak parameters, customize system prompts per chat, and enhance your AI experiments with reasoning model support.)
• Flufy (A beautiful chat interface for interacting with Ollama's API. Built with React, TypeScript, and Material-UI.)
• Ellama (Friendly native app to chat with an Ollama instance)
• screenpipe Build agents powered by your screen history
• Ollamb (Simple yet rich in features, cross-platform built with Flutter and designed for Ollama. Try the web demo.)
• Writeopia (Text editor with integration with Ollama)
• AppFlowy (AI collaborative workspace with Ollama, cross-platform and self-hostable)
• Lumina (A lightweight, minimal React.js frontend for interacting with Ollama servers)
• Tiny Notepad (A lightweight, notepad-like interface to chat with ollama available on PyPI)
• macLlama (macOS native) (A native macOS GUI application for interacting with Ollama models, featuring a chat interface.)
• GPTranslate (A fast and lightweight, AI powered desktop translation application written with Rust and Tauri. Features real-time translation with OpenAI/Azure/Ollama.)
• ollama launcher (A launcher for Ollama, aiming to provide users with convenient functions such as ollama server launching, management, or configuration.)
• ai-hub (AI Hub supports multiple models via API keys and Chat support via Ollama API.)
• Mayan EDMS (Open source document management system to organize, tag, search, and automate your files with powerful Ollama driven workflows.)
• Serene Pub (Beginner friendly, open source AI Roleplaying App for Windows, Mac OS and Linux. Search, download and use models with Ollama all inside the app.)
• Andes (A Visual Studio Code extension that provides a local UI interface for Ollama models)
• Clueless (Open Source & Local Cluely: A desktop application LLM assistant to help you talk to anything on your screen using locally served Ollama models. Also undetectable to screenshare)

Cloud

• Google Cloud
• Fly.io
• Koyeb

Terminal

• oterm
• Ellama Emacs client
• Emacs client
• neollama UI client for interacting with models from within Neovim
• gen.nvim
• ollama.nvim
• ollero.nvim
• ollama-chat.nvim
• ogpt.nvim
• gptel Emacs client
• Oatmeal
• cmdh
• ooo
• shell-pilot(Interact with models via pure shell scripts on Linux or macOS)
• tenere
• llm-ollama for Datasette's LLM CLI.
• typechat-cli
• ShellOracle
• tlm
• podman-ollama
• gollama
• ParLlama
• Ollama eBook Summary
• Ollama Mixture of Experts (MOE) in 50 lines of code
• vim-intelligence-bridge Simple interaction of "Ollama" with the Vim editor
• x-cmd ollama
• bb7
• SwollamaCLI bundled with the Swollama Swift package. Demo
• aichat All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI tools & agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.
• PowershAI PowerShell module that brings AI to terminal on Windows, including support for Ollama
• DeepShell Your self-hosted AI assistant. Interactive Shell, Files and Folders analysis.
• orbiton Configuration-free text editor and IDE with support for tab completion with Ollama.
• orca-cli Ollama Registry CLI Application - Browse, pull, and download models from Ollama Registry in your terminal.
• GGUF-to-Ollama - Importing GGUF to Ollama made easy (multiplatform)
• AWS-Strands-With-Ollama - AWS Strands Agents with Ollama Examples
• ollama-multirun - A bash shell script to run a single prompt against any or all of your locally installed ollama models, saving the output and performance statistics as easily navigable web pages. (Demo)
• ollama-bash-toolshed - Bash scripts to chat with tool using models. Add new tools to your shed with ease. Runs on Ollama.

Apple Vision Pro

• SwiftChat (Cross-platform AI chat app supporting Apple Vision Pro via "Designed for iPad")
• Enchanted

Database

• pgai - PostgreSQL as a vector database (Create and search embeddings from Ollama models using pgvector)
  • Get started guide
• MindsDB (Connects Ollama models with nearly 200 data platforms and apps)
• chromem-go with example
• Kangaroo (AI-powered SQL client and admin tool for popular databases)

Package managers

• Pacman
• Gentoo
• Homebrew
• Helm Chart
• Guix channel
• Nix package
• Flox

Libraries

• LangChain and LangChain.js with example
• Firebase Genkit
• crewAI
• Yacana (User-friendly multi-agent framework for brainstorming and executing predetermined flows with built-in tool integration)
• Spring AI with reference and example
• LangChainGo with example
• LangChain4j with example
• LangChainRust with example
• LangChain for .NET with example
• LLPhant
• LlamaIndex and LlamaIndexTS
• LiteLLM
• OllamaFarm for Go
• OllamaSharp for .NET
• Ollama for Ruby
• Ollama-rs for Rust
• Ollama-hpp for C++
• Ollama4j for Java
• ModelFusion Typescript Library
• OllamaKit for Swift
• Ollama for Dart
• Ollama for Laravel
• LangChainDart
• Semantic Kernel - Python
• Haystack
• Elixir LangChain
• Ollama for R - rollama
• Ollama for R - ollama-r
• Ollama-ex for Elixir
• Ollama Connector for SAP ABAP
• Testcontainers
• Portkey
• PromptingTools.jl with an example
• LlamaScript
• llm-axe (Python Toolkit for Building LLM Powered Apps)
• Gollm
• Gollama for Golang
• Ollamaclient for Golang
• High-level function abstraction in Go
• Ollama PHP
• Agents-Flex for Java with example
• Parakeet is a GoLang library, made to simplify the development of small generative AI applications with Ollama.
• Haverscript with examples
• Ollama for Swift
• Swollama for Swift with DocC
• GoLamify
• Ollama for Haskell
• multi-llm-ts (A Typescript/JavaScript library allowing access to different LLM in a unified API)
• LlmTornado (C# library providing a unified interface for major FOSS & Commercial inference APIs)
• Ollama for Zig
• Abso (OpenAI-compatible TypeScript SDK for any LLM provider)
• Nichey is a Python package for generating custom wikis for your research topic
• Ollama for D
• OllamaPlusPlus (Very simple C++ library for Ollama)
• any-llm (A single interface to use different llm providers by mozilla.ai)
• any-agent (A single interface to use and evaluate different agent frameworks by mozilla.ai)
• Neuro SAN (Data-driven multi-agent orchestration framework) with example

Mobile

• SwiftChat (Lightning-fast Cross-platform AI chat app with native UI for Android, iOS, and iPad)
• Enchanted
• Maid
• Ollama App (Modern and easy-to-use multi-platform client for Ollama)
• ConfiChat (Lightweight, standalone, multi-platform, and privacy-focused LLM chat interface with optional encryption)
• Ollama Android Chat (No need for Termux, start the Ollama service with one click on an Android device)
• Reins (Easily tweak parameters, customize system prompts per chat, and enhance your AI experiments with reasoning model support.)

Extensions & Plugins

• Raycast extension
• Discollama (Discord bot inside the Ollama discord channel)
• Continue
• Vibe (Transcribe and analyze meetings with Ollama)
• Obsidian Ollama plugin
• Logseq Ollama plugin
• NotesOllama (Apple Notes Ollama plugin)
• Dagger Chatbot
• Discord AI Bot
• Ollama Telegram Bot
• Hass Ollama Conversation
• Rivet plugin
• Obsidian BMO Chatbot plugin
• Cliobot (Telegram bot with Ollama support)
• Copilot for Obsidian plugin
• Obsidian Local GPT plugin
• Open Interpreter
• Llama Coder (Copilot alternative using Ollama)
• Ollama Copilot (Proxy that allows you to use Ollama as a copilot like GitHub Copilot)
• twinny (Copilot and Copilot chat alternative using Ollama)
• Wingman-AI (Copilot code and chat alternative using Ollama and Hugging Face)
• Page Assist (Chrome Extension)
• Plasmoid Ollama Control (KDE Plasma extension that allows you to quickly manage/control Ollama model)
• AI Telegram Bot (Telegram bot using Ollama in backend)
• AI ST Completion (Sublime Text 4 AI assistant plugin with Ollama support)
• Discord-Ollama Chat Bot (Generalized TypeScript Discord Bot w/ Tuning Documentation)
• ChatGPTBox: All in one browser extension with Integrating Tutorial
• Discord AI chat/moderation bot Chat/moderation bot written in python. Uses Ollama to create personalities.
• Headless Ollama (Scripts to automatically install ollama client & models on any OS for apps that depend on ollama server)
• Terraform AWS Ollama & Open WebUI (A Terraform module to deploy on AWS a ready-to-use Ollama service, together with its front-end Open WebUI service.)
• node-red-contrib-ollama
• Local AI Helper (Chrome and Firefox extensions that enable interactions with the active tab and customisable API endpoints. Includes secure storage for user prompts.)
• vnc-lm (Discord bot for messaging with LLMs through Ollama and LiteLLM. Seamlessly move between local and flagship models.)
• LSP-AI (Open-source language server for AI-powered functionality)
• QodeAssist (AI-powered coding assistant plugin for Qt Creator)
• Obsidian Quiz Generator plugin
• AI Summmary Helper plugin
• TextCraft (Copilot in Word alternative using Ollama)
• Alfred Ollama (Alfred Workflow)
• TextLLaMA A Chrome Extension that helps you write emails, correct grammar, and translate into any language
• Simple-Discord-AI
• LLM Telegram Bot (telegram bot, primary for RP. Oobabooga-like buttons, A1111 API integration e.t.c)
• mcp-llm (MCP Server to allow LLMs to call other LLMs)
• SimpleOllamaUnity (Unity Engine extension for communicating with Ollama in a few lines of code. Also works at runtime)
• UnityCodeLama (Unity Edtior tool to analyze scripts via Ollama)
• NativeMind (Private, on-device AI Assistant, no cloud dependencies)
• GMAI - Gradle Managed AI (Gradle plugin for automated Ollama lifecycle management during build phases)
• NOMYO Router (A transparent Ollama proxy with model deployment aware routing which auto-manages multiple Ollama instances in a given network)

Supported backends

• llama.cpp project founded by Georgi Gerganov.

Observability

• Opik is an open-source platform to debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. Opik supports native intergration to Ollama.
• Lunary is the leading open-source LLM observability platform. It provides a variety of enterprise-grade features such as real-time analytics, prompt templates management, PII masking, and comprehensive agent tracing.
• OpenLIT is an OpenTelemetry-native tool for monitoring Ollama Applications & GPUs using traces and metrics.
• HoneyHive is an AI observability and evaluation platform for AI agents. Use HoneyHive to evaluate agent performance, interrogate failures, and monitor quality in production.
• Langfuse is an open source LLM observability platform that enables teams to collaboratively monitor, evaluate and debug AI applications.
• MLflow Tracing is an open source LLM observability tool with a convenient API to log and visualize traces, making it easy to debug and evaluate GenAI applications.