Stars
Atomic secret provisioning for NixOS based on sops
🌈 React for interactive command-line apps
CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge techniques in sparse architecture, speculative sampling and qua…
Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
A tool for parsing, dumping and modifying data in Radeon PowerPlay tables
Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators
Development repository for the Triton language and compiler
A retargetable MLIR-based machine learning compiler and runtime toolkit.
A port of the RWKV v7 language model, implemented with the Burn deep learning framework
RimSort is an open source mod manager for the video game RimWorld. There is support for Linux, Mac, and Windows, built from the ground up to be a reliable, community-managed alternative to RimPy Mo…
Tensor computation with WebGPU acceleration
Efficient RWKV inference engine. RWKV7 7.2B fp16 decoding 10250 tps @ single 5090.
A calm, CLI-native way to semantically grep everything, like code, images, pdfs and more.
You like pytorch? You like micrograd? You love tinygrad! ❤️
A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
A fast inference library for running LLMs locally on modern consumer-class GPUs
ScholArxiv is an open-source, aesthetic, minimal and AI powered app that allows users to search, read, bookmark, share, download and view summaries of academic papers from the arXiv repository.
Run the latest LLMs and VLMs across GPU, NPU, and CPU with PC (Python/C++) & mobile (Android & iOS) support, running quickly with OpenAI gpt-oss, Granite4, Qwen3VL, Gemma 3n and more.
FeOx (Iron-Oxide) is an ultra-fast, embedded and persisted KV store in pure Rust.
A pull parser for LaTeX parsing and mathml rendering.