The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.

Ongoing research training transformer models at scale

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

LLaVA-CoT, a visual language model capable of spontaneous, systematic reasoning

FastVideo is an open-source framework for accelerating large video diffusion model.

This is the official implementation of the paper "Needle In A Multimodal Haystack"

Official implementation of "LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Inference"

A natural language interface for computers

Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"

Reaching LLaMA2 Performance with 0.1M Dollars

LLM training in simple, raw C/CUDA

LLM inference in C/C++

Accessible large language models via k-bit quantization for PyTorch.

本项目旨在分享大模型相关技术原理以及实战经验。

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

本项目用于Multimodal领域新手的学习路线，包括该领域的经典论文，项目及课程。旨在希望学习者在一定的时间内达到对这个领域有较为深刻的认知，能够自己进行的独立研究。

Fast inference engine for Transformer models

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max)…

This project aim to reproduce Sora (Open AI T2V model), but we only have limited resource. We deeply wish the all open source community can contribute to this project.

MiniCPM-2B: An end-side LLM outperforms Llama2-13B.

✨✨Latest Papers and Datasets on Multimodal Large Language Models, and Their Evaluation.