SGLang is a fast serving framework for large language models and vision language models.

Universal LLM Deployment Engine with ML Compilation

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations

Model Context Protocol(MCP) 编程极速入门

大模型基础: 一文了解大模型基础知识

This project uses a variety of advanced voiceprint recognition models such as EcapaTdnn, ResNetSE, ERes2Net, CAM++, etc. It is not excluded that more models will be supported in the future. At the …

LiberSonora，寓意“自由的声音”，是一个 AI 赋能的、强大的、开源有声书工具集，包含智能字幕提取、AI标题生成、多语言翻译等功能，支持 GPU 加速、批量离线处理。LiberSonora, meaning "The Voice of Freedom," is an AI-powered robust open-source audiobook toolkit.

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama mode…

Agentic-RAG explores advanced Retrieval-Augmented Generation systems enhanced with AI LLM agents.

Inference code for Llama models

The official Meta Llama 3 GitHub site

Matryoshka Multimodal Models

A modular graph-based Retrieval-Augmented Generation (RAG) system

百聆 是一个类似GPT-4o的语音对话机器人，通过ASR+LLM+TTS实现，时延低至800ms，低配置也可运行，支持打断

Make websites accessible for AI agents

This is a speech interaction system built on an open-source model, integrating ASR, LLM, and TTS in sequence. The ASR model is SenceVoice, the LLM models are QWen2.5-0.5B/1.5B, and there are three …

A blazing fast inference solution for text embeddings models

Ongoing research training transformer models at scale

MTEB: Massive Text Embedding Benchmark

AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

⚡FlashRAG: A Python Toolkit for Efficient RAG Research

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".

AIFoundation 主要是指AI系统遇到大模型，从底层到上层如何系统级地支持大模型训练和推理，全栈的核心技术。

A streamlined and customizable framework for efficient large model evaluation and performance benchmarking

Make bilingual epub books Using AI translate

Xiaomi Home Integration for Home Assistant

Prompt越狱手册

Agent Framework / shim to use Pydantic with LLMs