Lists (1)
Stars
Reverse engineer anything with agents, from app behavior down to native binaries.
25 MB lightweight cross-platform database client for 100+ databases, including MySQL, PostgreSQL, SQLite, Redis, MongoDB, DuckDB, SQL Server, and Dameng. Built-in AI, MCP Server, CLI, desktop and D…
sparkDash ⚡ — Multi-DGX Spark Monitoring Dashboard
LLM Inference Engine for Metal, CUDA and Vulkan.
Qwen3.8-Flash-Next on two DGX Sparks with TensorFold
Jev-like family of decision models built on top of Qwen3.5/3.8 you can train and run on your own
A self-hosted API and web interface for Laya’s structured decision models, compatible with the TypeSafe Jev API format.
Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per re…
RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.
🎨 Best DeepSeek Harness Design Plugin. The open-source Claude Design alternative. 🖥️ Local-first desktop app. 🖼️ Your coding agent becomes the design engine: prototypes, landing pages, dashboards, …
Skills for Real Engineers. Straight from my .agents directory.
1Panel AI 网关提供从统一接入、智能路由到合规审计的全链条管控，让企业 AI 落地更安全、更高效、更可控。
Qwen3.8-Flash-Next-NVFP4-vLLM-Dual-DGX-Spark
First vLLM deployment of Qwen3.8-Flash-Next (RadixArk NVFP4) on 2× DGX Spark (GB10/SM121) — TP2+EP, MTP speculative decode, CUDA graphs, 262K context. Includes the 3-line PLE FP8 quant-resolver pat…
GLM-5.3-Flash (NVFP4) on 2x NVIDIA DGX Spark - vLLM TP2, 262K context, MTP. World-first deploy recipe: 7 day-0 bugs found and fixed, patched sm121 image, probes and full report.
Qwen3.8-Flash-Next (NVFP4) on DGX Spark in vLLM: one Spark 43.9 tok/s with our disk-backed n-gram table patch, staged gather and reduced-vocab MTP draft; TP2 SPEED 53.7; TP4 CONTEXT 9M KV pool. Lau…
Qwen3.8-27B on SGLang for NVIDIA RTX PRO 6000 (96GB, SM120): DSpark speculative decoding, full 256K context, 8 concurrent requests
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
DeepSeek V4 Flash DSpark 1M NVFP4 KV recipe for 2x DGX Spark
Open recipes, engine patches, and benchmark harnesses for LLM inference on Intel Arc Pro B60/B70 (Battlemage, Xe2). MoE 35B at 160 t/s decode / 7.5K t/s prefill single-stream, 27B at 50~ t/s decode…
Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
High-performance single-GPU inference for selected model checkpoints and GPUs.
Docker images for LLM inference (SGLang + vLLM) on NVIDIA Blackwell GPUs (SM120, CUDA 13.2)
Qwen3.8 27B for DGX Spark / RTX 6000 PRO
DeepSeek Harness: Everything is a Plugin.
RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink