Stars
Collection of extracted System Prompts from popular chatbots like ChatGPT, Claude & Gemini
A lightweight Python utility for asynchronously running an action when a specific condition is met.
🐉 Loong: Synthesize Long CoTs at Scale through Verifiers.
Codebase for Merging Language Models (ICML 2024)
A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.
A modular framework designed for easy experimentation with optimization-based diffusion sampling algorithms.
A series of technical report on Slow Thinking with LLM
Paper Reproduction Google SCoRE(Training Language Models to Self-Correct via Reinforcement Learning)
This my attempt to create Self-Correcting-LLM based on the paper Training Language Models to Self-Correct via Reinforcement Learning by google
The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery 🧑🔬
Writing AI Conference Papers: A Handbook for Beginners
(ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training
[NeurIPS'24] SelfCodeAlign: Self-Alignment for Code Generation
Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | 继续预训练提升 Llama-3 的科学推理和中文能力
The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
✨✨Latest Advances on Multimodal Large Language Models
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.
用于从头预训练+SFT一个小参数量的中文LLaMa2的仓库；24G单卡即可运行得到一个具备简单中文问答能力的chat-llama2.
Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
The simplest, fastest repository for training/finetuning medium-sized GPTs.
A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)
Awesome-LLM: a curated list of Large Language Model