A framework for efficient model inference with omni-modality models

Nodes to run Hunyuan Image 3 locally with BF16 and NF4 quantized options in Comfyui

A high-throughput and memory-efficient inference and serving engine for LLMs

Enable true multi gpu capability in Comfy UI using XDiT XFuser and FSDP managed by Ray

A powerful meta-prompting, context engineering and spec-driven development system that enables agents to work for long periods of time autonomously without losing track of the big picture

Production ready LLM model compression/quantization toolkit with hw accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.

An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

SGLang is a fast serving framework for large language models and vision language models.

A fast inference library for running LLMs locally on modern consumer-class GPUs

Roo Code (prev. Roo Cline) gives you a whole dev team of AI agents in your code editor.

ChromaDB-powered local indexing support for Cursor, exposed as an MCP server

WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding

A simple source generator that creates interfaces by implementations.

.Net Source Generator for Automatic Interfaces

Use attributes to control how complex types are logged to Serilog.

SimpleStack.Orm is a layer on top of Dapper project that generate SQL queries based on lambda expressions