Advanced CUDA kernel builder for Rust with incremental builds, auto-detection, and external dependency support.

A Next-Gen Kernel programming DSL for Maximizing Productivity

LLM Attentions for Rust

OpenAI API Compatible Chat Client

A small Rust library + binary that serves pre-built OpenAI-API compatible Chat UI

大模型训练相关基础知识及进阶技术; Quick Start Guide to Large Language Model (LLM) Training.

Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

Minimalist vLLM implementation in Rust

ModelScope: bring the notion of Model-as-a-Service to life.

DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

DeepEP: an efficient expert-parallel communication library

Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

Minimal web UI for ChatGPT (revision for candle-vllm demo).

Multitask learning for automated COVID 19 diagnosis and severity assessment using CT scans

Fast, flexible LLM inference

Minimalist ML framework for Rust

An intuitive and streamlined pan-cancer analysis framework for identification of lncRNAs associated with pan-cancer prognosis

An open-source website for marking histopathology images

A deep learning based framework for recognition and fusion of multimodal histopathological images

Depthwise Multiception Convolution for Reducing Network Parameters without Sacrificing Accuracy