[ICML 2024] Official PyTorch implementation of "SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-parameterized Batch Normalization"

Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)

Reference implementation of "Self-Attention at Constant Cost per Token via Symmetry-Aware Taylor Approximation" (Heinsen and Kozachkov, 2026)

Reference implementation of "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022) and "An Algorithm for Routing Capsules in All Domains" (Heinsen, 2019), for composing deep neural networks.

LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library.

A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available research literature.

PDE-Transformer is a neural network architecture designed to efficiently process and predict the evolution of physical systems described by partial differential equations.

Stable Looped Models

KV cache compression via block-diagonal rotation. Beats TurboQuant: better PPL (6.91 vs 7.07), 28% faster decode, 5.3x faster prefill, 44x fewer params. Drop-in llama.cpp integration.

将冰冷的离别化为温暖的 Skill，欢迎加入数字生命1.0！Transforming cold farewells into warm skills? It's giving rebirth era. Welcome to Digital Life 1.0. 🫶

Hypercomplex Neural Networks with PyTorch

PrismMl Bonsai vs Qwen3.5 Benchmark

autonomous harness engineering

Agent skill to turn any arxiv paper into a working implementation

Self-hosted Kanban board with browser terminals for AI coding agents. Hook-driven auto-tracking — manage tmux/zellij sessions and git worktrees from one board.

"ClawTeam: Agent Swarm Intelligence" (One Command → Full Automation)

AI agents running research on single-GPU nanochat training automatically

A framework-agnostic, git-native standard for defining AI agents

Manage multiple AI terminal agents like Claude Code, Codex, OpenCode, and Amp.

Use Claude Code, Cursor CLI or Codex on mobile and web with CloudCLI (aka Claude Code UI). CloudCLI is a free open source webui/GUI that helps you manage your Claude Code session and projects remotely

Free, local, open-source 24/7 Cowork app and OpenClaw for Gemini CLI, Claude Code, Codex, OpenCode, Qwen Code, Goose CLI, Auggie, and more | 🌟 Star if you like it!

The open source coding agent.

An understudy watches. Then performs.