bridges the log crate and indicatif to stop the progress bars and log lines from mixing up

Debug print operator for cudagraph debugging

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorR…

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

Optimized primitives for collective multi-GPU communication

Run Multithreaded Rust along with Dart VM (in isolate) 🌀

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Utils for Unsloth

Public repo for HF blog posts

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention)

🌠 Manage your shell commands.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

A framework for few-shot evaluation of language models.

Train transformer language models with reinforcement learning.

A high-throughput and memory-efficient inference and serving engine for LLMs

Influence Functions with (Eigenvalue-corrected) Kronecker-Factored Approximate Curvature

A data index and query language over Markdown files, for https://obsidian.md/.

Awesome-LLM: a curated list of Large Language Model

The official Python library for the OpenAI API

Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

Data for this-week-in-rust.org

Linux​ based GDDR6/GDDR6X VRAM temperature reader for NVIDIA RTX 3000/4000 series GPUs.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Make Zotero effective for us LaTeX holdouts

Generic cache manager for flutter