Testing mode.
Abstract network background

Ollama Guide

Run powerful AI models on your own computer, completely free.

Back to AI Tools

Like Having a Super-Intelligent Friend on Your Computer

Ollama is like a playground where AI models can live and play on your own computer. Want to chat with an AI that knows about history? Done. Want to ask an AI to help with math? Easy.

Why Companies Charge for This

Big companies charge $20-100 per month for access to AI models that are available for free with Ollama. They're not magic - they're just using the same open-source models we're showing you.

With Ollama, you can have the same powerful AI on your own computer, with complete privacy, for free forever.

Why Ollama Is Perfect for You

Completely Free

No subscriptions, no hidden fees. Just download and use.

Works Offline

Your conversations never leave your computer. Perfect for privacy.

Works on Any Computer

Windows, Mac, or Linux - Ollama works on all of them.

No Technical Skills Needed

Just copy and paste a few simple commands. We'll show you how.

How Ollama Works

Think of Ollama like a app store for AI. You download it once, then choose which AI models you want to use.

Simple 4-Step Process

1

Download Ollama

Get the installer for your computer from the official website

2

Install Ollama

Run the installer - it's as simple as installing any other app

3

Download an AI Model

Choose what kind of AI you want and download it with one command

4

Talk to Your AI

Ask questions, get help, or have a conversation with your AI

Installation Instructions

These instructions work on Windows, Mac, and Linux computers

Step 1: Download Ollama

Visit ollama.com and click the "Download" button for your operating system.

Step 2: Install Ollama

Run the downloaded installer. On Windows and Mac, just follow the setup wizard. On Linux, open a terminal and run:

curl -fsSL https://ollama.com/install.sh | sh

Step 3: Download an AI Model

Open your command prompt/terminal and type:

ollama run llama3

The first time you run this, Ollama will automatically download the Llama 3 model. This might take a few minutes.

Step 4: Talk to Your AI

After the model downloads, you can start chatting with your AI:

You: What is the capital of France?

Llama 3: The capital of France is Paris.

Type your questions and press Enter. Type "/bye" when you're done talking.

Pulling and Managing AI Models

Learn how to download and manage different AI models

How to Pull Specific Models

Ollama has thousands of models available. Here's how to download the ones we recommend:

Qwen:latest (Alibaba's model)
ollama run qwen:latest
Qwen3-Coder-Plus (Coding specialist)
ollama run qwen3-coder-plus
GPT-OSS:20b (Open-source GPT alternative)
ollama run gpt-oss:20b
Llama 3 (General purpose)
ollama run llama3

Advanced Model Management

Useful commands for managing your models:

ollama list

See all downloaded models

ollama pull mistral

Download a model without running it

ollama rm llama3

Remove a downloaded model

ollama ps

See running models

Running Ollama as a Service

Keep Ollama running in the background and access it via API

Start Ollama Server

Run Ollama in the background so other applications can use it:

ollama serve

This command starts the Ollama API server. Keep this terminal window open or run it as a service.

Access Ollama via API

Once the server is running, you can access models programmatically:

POST http://localhost:11434/api/generate

{

"model": "llama3",

"prompt": "Why is the sky blue?",

"stream": false

}

This is how tools like Open WebUI and coding agents communicate with Ollama.

GPU Acceleration

Make your models run faster by using your computer's graphics card:

  • Ollama automatically uses compatible GPUs (NVIDIA, AMD, Apple Silicon)
  • For NVIDIA GPUs, ensure you have CUDA drivers installed
  • For AMD GPUs, ROCm support is automatically detected
  • Apple Silicon Macs automatically use Metal acceleration

GPU acceleration can make models respond 5-10x faster, especially for larger models like GPT-OSS:20b.

Popular AI Models to Try

Each model is good at different things. Try a few to see which works best for you.

Llama 3

Great for general conversations and answering questions

ollama run llama3

Mistral

Fast and efficient for coding and technical questions

ollama run mistral

Phi-3

Small but powerful model for everyday tasks

ollama run phi3

Codellama

Specialized for helping with programming tasks

ollama run codellama

Qwen:latest

Alibaba's most capable model for general tasks

ollama run qwen:latest

Qwen3-Coder

Specialized for coding tasks with advanced reasoning

ollama run qwen3-coder

GPT-OSS:20b

Open-source alternative to GPT with 20 billion parameters

ollama run gpt-oss:20b

Neural Chat

Intel's conversational AI model

ollama run neural-chat

Going Beyond the Basics

Web Interface

Want a friendly chat interface? Try Open WebUI (we'll show you that next) or use Ollama's web interface:

ollama serve

Then visit http://localhost:11434 in your browser.

Custom Models

Create your own models or fine-tune existing ones:

  • Combine different models
  • Add your own knowledge
  • Make specialized AIs for your needs

Ready to Run AI on Your Computer?

It takes less than 10 minutes to get started. No technical skills required.