Stars
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
A powerful tool for creating fine-tuning datasets for LLM
Community maintained hardware plugin for vLLM on Ascend
High-resolution map (OpenDrive\Apollo) visualization and conversion tools
A toolbox for target-less LiDAR-camera calibration [ROS1/ROS2]
OpenCV-Python 相机标定及矫正，张正友相机标定法
A high-throughput and memory-efficient inference and serving engine for LLMs
深度学习500问，以问答形式对常用的概率知识、线性代数、机器学习、深度学习、计算机视觉等热点问题进行阐述，以帮助自己及有需要的读者。 全书分为18个章节，50余万字。由于水平有限，书中不妥之处恳请广大读者批评指正。 未完待续............ 如有意合作，联系scutjy2015@163.com 版权所有，违权必究 Tan 2018.06
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
A low-latency & high-throughput serving engine for LLMs
An ultra fast tiny model for lane detection, using onnx_parser, TensorRTAPI, torch2trt to accelerate. our model support for int8, dynamic input and profiling. (Nvidia-Alibaba-TensoRT-hackathon2021)
本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
A lightweight library for instance-level visual road marking extraction, parameterization, mapping, etc.
[CVPR 2022] HiVT: Hierarchical Vector Transformer for Multi-Agent Motion Prediction
MPC in vehicle to track reference trajectory
Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**
Pointcept: Perceive the world with sparse points, a codebase for point cloud perception research. Latest works: Concerto (NeurIPS'25), Sonata (CVPR'25 Highlight), PTv3 (CVPR'24 Oral)
REST: Retrieval-Based Speculative Decoding, NAACL 2024
Codes for RoadBEV: road surface reconstruction in Bird's Eye View
Accelerate inference without tears
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.