Stars
OpenMOSS presents a collection of our research on LLMs, supported by SII, Fudan and Mosi.
[TMLR 2024] Efficient Large Language Models: A Survey
how to optimize some algorithm in cuda.
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥
The official Pytorch implementation of the paper "Fourier Transformer: Fast Long Range Modeling by Removing Sequence Redundancy with FFT Operator" (ACL 2023 Findings)