🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

rerank library for easy reranking of results

A BM25 Java implementation using streams, stop words and stemming.

Automated fact-check

SearchAugmentedLLM empowers LLMs with relevant web information. Given a query, it searches Google, processes top results, chunks the content, ranks by relevance, and returns the most pertinent text to provide context to the LLM. Ideal for RAG (Retrieval Augmented Generation) applications.