Discord Ollama Integration

Discord Ollama is a Discord bot that lets users interact with locally hosted Ollama language models directly from Discord.

The bot supports model management, streamed responses, conversation history, private threads, and configurable server controls. Because Ollama runs locally, you retain control over the models and data used by the bot.

See the setup guides to get started.

These are guides to the features and capabilities of this app.

• User Slash Commands
• Client Events

• Clone this repo using git clone https://github.com/kevinthedang/discord-ollama.git or just use GitHub Desktop to clone the repo.
• You will need a .env file in the root of the project directory with the bot's token. There is a .env.sample is provided for you as a reference for what environment variables.
  • For example, CLIENT_TOKEN = [Bot Token]
  • The LLM server is configured with LLM_ENDPOINT / LLM_PORT (OLLAMA_IP / OLLAMA_PORT still work as deprecated aliases).
• Please refer to the docs for bot setup.
  • Creating a Discord App
  • Local Machine Setup
  • Docker Setup for Servers and Local Machines
    • Nvidia is recommended for now, but support for other GPUs should be development.
    • Local use is not recommended.

• NodeJS
  • This project runs on lts\jod and above.
  • This project requires the use of npm version 10.9.0 or above.
• Ollama
  • Ollama Docker Image
  • llmman also serves the Ollama API (on port 17434) and can be used in its place, see Local Machine Setup.
• Discord.js Docs
• Setting up Docker (Ubuntu 20.04)
  • Setting up Nvidia Container Toolkit

• Kevin Dang
• Jonathan Smoley

discord-ollama © 2023 by Kevin Dang is licensed under CC BY 4.0