Skip to content
View avtc's full-sized avatar

Block or report avtc

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don't include any personal information such as legal names or email addresses. Markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Showing results

An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

Python 605 65 Updated Dec 13, 2025

SGLang is a fast serving framework for large language models and vision language models.

Python 21,902 3,833 Updated Dec 22, 2025

LLM model quantization (compression) toolkit with hw acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

Python 940 141 Updated Dec 22, 2025

A high-throughput and memory-efficient inference and serving engine for LLMs

Python 65,949 12,124 Updated Dec 22, 2025

Advanced quantization toolkit for LLMs and VLMs. Support for WOQ, MXFP4, NVFP4, GGUF, Adaptive Schemes and seamless integration with Transformers, vLLM, SGLang, and llm-compressor

Python 775 64 Updated Dec 22, 2025
Python 18 1 Updated May 10, 2025

NVIDIA Linux open GPU with P2P support

C 1,302 131 Updated Jun 6, 2025

Roo Code gives you a whole dev team of AI agents in your code editor.

TypeScript 21,330 2,686 Updated Dec 22, 2025

ChromaDB-powered local indexing support for Cursor, exposed as an MCP server

Python 32 11 Updated Mar 20, 2025

AI Agent that handles engineering tasks end-to-end: integrates with developers’ tools, plans, executes, and iterates until it achieves a successful result.

Rust 3,417 297 Updated Dec 17, 2025

Develop software autonomously.

Python 2,193 218 Updated Dec 8, 2025

Provides name-based registrations to Microsoft.Extensions.DependencyInjection

C# 1 Updated Jun 20, 2017

Fast object cloner for .NET

C# 576 78 Updated Nov 3, 2023

Extremely Fast MessagePack Serializer for C#(.NET, .NET Core, Unity, Xamarin). / msgpack.org[C#]

C# 6,557 754 Updated Oct 23, 2025