Train transformer language models with reinforcement learning.

Use PEFT or Full-parameter to finetune 400+ LLMs or 100+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-V…

SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Visual Instruction Tuning: Large Language-and-Vision Assistant built towards multimodal GPT-4 level capabilities.

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

A Framework of Small-scale Large Multimodal Models

Python bindings for llama.cpp

Limitations of MultiLabel Conditional Generation

a state-of-the-art-level open visual language model | 多模态预训练模型

ImageArg Shared Task 2023, co-located with The 10th ArgMining Workshop at EMNLP 2023.

ImageBind One Embedding Space to Bind Them All

You like pytorch? You like micrograd? You love tinygrad! ❤️

Inference code for LLaMA models

Code and Splits for the paper "A Fair and Comprehensive Comparison of Multimodal Tweet Sentiment Analysis Methods", In Proceedings of the 2021 Workshop on Multi-Modal Pre-Training for Multimedia Un…

Dense image captioning in Torch

Efficient, reusable RNNs and LSTMs for torch

Modules for spatial transformer networks (BHWD layout)

A script to generate an edition of the Guardian for reading on the Amazon Kindle using the Guardian Open Platform

Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, B…