A real-time streaming chat application built with Django, HTMX, and Server-Sent Events (SSE) to mimic popular LLMs like ChatGPT, Claude, etc. It integrates with local LLMs via Ollama.

This was demonstrated during a talk at DjangoCon US 2025. You can see the video version here or the text-based version here](https://wsvincent.com/django-for-ai-djangocon/).

• 🚀 Real-time streaming responses using Server-Sent Events (SSE)
• 🤖 Local LLM integration via Ollama (Gemma 3:4B)
• 📝 Markdown support with syntax highlighting
• 💬 Conversation history and context management
• 🎨 Clean, responsive UI with HTMX

Download and install the Ollama desktop app for your platform.

Once installed, pull the Gemma 3:4B model (3.3GB):

ollama pull gemma3:4b

Ensure Ollama is running in the background (it runs on http://localhost:11434 by default).

uv is a fast Python package manager. Install it if you haven't already:

curl -LsSf https://astral.sh/uv/install.sh | sh

Then run the project:

# Install dependencies and run migrations
uv run python manage.py migrate

# Create a superuser to access the admin panel
uv run python manage.py createsuperuser

# Start the development server
uv run python manage.py runserver

1. Open your browser and navigate to http://127.0.0.1:8000/
2. Type a message in the input field
3. Watch as the AI response streams in real-time
4. Previous conversations are saved and accessible from the homepage and the admin at http://127.0.0.1:8000/admin/

DjangoForAI/
├── chat/
│   ├── models.py          # Conversation and Message models
│   ├── views.py           # Main view logic using Django CBVs
│   ├── views_stream.py    # SSE streaming implementation
│   ├── services.py        # Business logic for Ollama API and conversations
│   ├── forms.py           # Django forms for message validation
│   ├── constants.py       # Configuration constants and settings
│   ├── exceptions.py      # Custom exception classes
│   ├── urls.py            # URL routing
│   ├── admin.py           # Django admin configuration
│   └── migrations/        # Database migrations
├── templates/
│   ├── homepage.html      # Landing page with recent chats
│   └── chat.html          # Chat interface
├── static/
│   └── css/
│       └── chat.css       # Styling for chat interface
├── DjangoForAI/
│   ├── settings.py        # Django settings
│   └── urls.py            # Root URL configuration
├── manage.py              # Django management script
└── pyproject.toml         # Python project dependencies for uv