♾️ Helix is a private GenAI stack for building AI agents with declarative pipelines, knowledge (RAG), API bindings, and first-class testing.

LLaMA-2 in native Go

An AI framework for building cool things.

Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)

AIx is a cli tool to interact with Large Language Models (LLM) APIs.

EvalGPT is an code interpreter framework that utilizes large language models to automate the process of code-writing and execution, delivering precise results for user-defined tasks.

Galah: An LLM-powered web honeypot.

Go SDK for Google Generative AI

Local CLI Copilot, powered by Ollama. 💻🦙

llama.go is like llama.cpp in pure Golang!

Zep | Examples, Integrations, & More

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

Rag Go Ollama

Sample code to show how to create an in-memory RAG

A CLI tool written in Go to chat with your pdf data

Go Based Lightweight RAG / LLM Tool with CLI + API

Inference Hub for AI at Scale

🚀 Building Go applications with LLMs through composability

🕵️‍♂️ Library designed for developers eager to explore the potential of Large Language Models (LLMs) and other generative AI through a clean, effective, and Go-idiomatic approach.

Go implementation of @qdrant/fastembed.

Distributed vector search for AI-native applications

Parse medusa news site to aggregate news about war in ukrain. these data later can be used as RAG dataset for LLM models

Chi-based Module for Easy REST APIs (like FastAPI for Go)

The authentication glue you need.