Lists (2)
Starred repositories
Linux OS for Azure 1P services and edge appliances
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.
Open-Sora: Democratizing Efficient Video Production for All
Native Kubernetes container management platform supporting multi-tenant and multi-cluster
Add-on agent to generate and expose cluster-level metrics.
Awesome Transformers (self-attention) in Computer Vision
总结梳理自然语言处理工程师(NLP)需要积累的各方面知识，包括面试题，各种基础知识，工程能力等等，提升核心竞争力
LLM Group Chat Framework: chat with multiple LLMs at the same time. 大模型群聊框架：同时与多个大语言模型聊天。
A lightweight framework for building LLM-based agents
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
A Next-Generation Training Engine Built for Ultra-Large MoE Models
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance
A complete and graceful API for Wechat. 微信个人号接口、微信机器人及命令行微信，三十行即可自定义个人号机器人。
Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).
CIKM2023 Best Demo Paper Award. HugNLP is a unified and comprehensive NLP library based on HuggingFace Transformer. Please hugging for NLP now!😊
A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery (EMNLP'24)
LLM training code for Databricks foundation models
Fast and memory-efficient exact attention
An unofficial cuda assembler, for all generations of SASS, hopefully ：）
A curated list of awesome Kubernetes tools and resources.