CUDA Templates for Linear Algebra Subroutines

Development repository for the Triton language and compiler

Tile primitives for speedy kernels

A high-throughput and memory-efficient inference and serving engine for LLMs

Standalone Flash Attention v2 kernel without libtorch dependency

Ongoing research training transformer models at scale

👮‍♂️The sensitive word tool for java.(敏感词/违禁词/违法词/脏词。基于 DFA 算法实现的高性能 java 敏感词过滤工具框架。请勿发布涉及政治、广告、营销、翻墙、违反国家法律法规等内容。高性能敏感词检测过滤组件，附带繁体简体互换，支持全角半角互换，汉字转拼音，模糊搜索等功能。)

中文常用停用词表（哈工大停用词表、百度停用词表等）

leaked prompts of GPTs

Implementation of Nougat Neural Optical Understanding for Academic Documents

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

A natural language interface for computers

A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

Question and Answer based on Anything.

📚 财富资料库 2023

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilizatio…

Python package for WikiMedia dump processing (Wiktionary, Wikipedia etc). Wikitext parsing, template expansion, Lua module execution. For data extraction, bulk syntax checking, error detection, and…

Stable Diffusion web UI

Optimize GEMM with tensorcore step by step

A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")

8-bit CUDA functions for PyTorch

A framework for few-shot evaluation of autoregressive language models.

Interact with your documents using the power of GPT, 100% privately, no data leaks

Convert PDF to markdown quickly with high accuracy

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.