[EMNLP 2023] C-STS: Conditional Semantic Textual Similarity

Mobile-Agent: The Powerful GUI Agent Family

[IJCAI 2024] Generate different roles for GPTs to form a collaborative entity for complex tasks.

[ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

[Personalize@EACL 2024] LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Models.

Code repository for Black Mamba

[ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”

Real-time behaviour synthesis with MuJoCo, using Predictive Control

Mamba-Chat: A chat LLM based on the state-space model architecture 🐍

PyTorch library for cost-effective, fast and easy serving of MoE models.

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"

[ACL 2024] AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning

A coding agent for open models like Kimi K3

Common interface for interacting with AI agents. The protocol is tech stack agnostic - you can use it with any framework for building agents.

Code for ACL (main) paper "JumpCoder: Go Beyond Autoregressive Coder via Online Modification"

The official implementation of the EMNLP 2023 paper LLM-FP4

Code for Continual Dialogue State Tracking via Example-Guided Question Answering work.

Ollama JavaScript library

TypeChat is a library that makes it easy to build natural language interfaces using types.

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

RAG with query expansion