The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Inference code for Llama models

Epsilla is a high performance Vector Database Management System

Java version of LangChain, while empowering LLM for Big Data.

深度学习经典、新论文逐段精读

LangChain4j is an open-source Java library that simplifies the integration of LLMs into Java applications through a unified API, providing access to popular LLMs and vector databases. It makes impl…

LLM Frontend for Power Users.

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B 站视频 ｜ 评论爬虫、微博帖子 ｜ 评论爬虫、百度贴吧帖子 ｜ 百度贴吧评论回复爬虫 | 知乎问答文章｜评论爬虫

FreeAskInternet is a completely free, PRIVATE and LOCALLY running search aggregator & answer generate using MULTI LLMs, without GPU needed. The user can ask a question and the system will make a mu…

一个用Apple Metal实现的Llama和通义千问大模型本地推理

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

LLM inference in C/C++

Distributed reliable key-value store for the most critical data of a distributed system

Prepare SEC EDGAR data for working examples

Empower Large Language Models (LLM) using Knowledge Graph based Retrieval-Augmented Generation (KG-RAG) for knowledge intensive tasks

Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

Local models support for Microsoft's graphrag using ollama (llama3, mistral, gemma2 phi3)- LLM & Embedding extraction

Example project demonstrating how to implement GraphRAG

⚡️AI Cloud OS: Open-source enterprise-level AI knowledge base and MCP (model-context-protocol)/A2A (agent-to-agent) management platform with admin UI, user management and Single-Sign-On⚡️, supports…

Using GPT to parse PDF

🔥 AgentScale: A Scalable Microservices-based Agent Orchestration Framework

A simple, easy-to-hack GraphRAG implementation

Turn any website into clean data pipelines & structured APIs in minutes!

制作懂人情世故的大语言模型 | 涵盖提示词工程、RAG、Agent、LLM微调教程

🤖✨ChatMLX is a modern, open-source, high-performance chat application for MacOS based on large language models.

Examples using MLX Swift

Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization

Graphic notes on Gilbert Strang's "Linear Algebra for Everyone"