A fork of OpenCode for local AI models.

DeepSeek 4 Flash local inference engine for Metal

[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

LLAMA Turboquant implementation with CUDA support

DeepSeek 4 Flash local inference engine for Metal and CUDA with M5 optimizations.

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer.

llama.cpp fork with TurboQuant WHT-rotated KV cache & weight compression + Gemma 4 MTP and Qwen 3.6 NextN speculative decoding (+30-50% throughput).

LLM inference in C/C++

llama.cpp fork with TQ3_1S/4S CUDA kernels — 3.5-bit WHT quantization achieving Q4s quality at 10% smaller size. Based on RaBitQ-inspired Walsh-Hadamard transform. Enables 27B models on 16GB GPUs w…

Provider-agnostic, open-source evaluation infrastructure for language models

AI agents running research on single-GPU nanochat training automatically

AI agents running research on single-GPU nanochat training automatically adopted for MacOS

LLM training on Apple's Neural Engine — native Obj-C, private APIs, zero GPU. Dynamic weight pipeline for training without kernel recompilation.

SGLang is a high-performance serving framework for large language models and multimodal models.

Training neural network potentials

infinite coding agent

Every Code - push frontier AI to it limits. A fork of the Codex CLI with validation, automation, browser integration, multi-agents, theming, and much more. Orchestrate agents from OpenAI, Claude, G…

The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—but scores >74% on SWE-bench verified!

HRM Agent repo

Tora: Torchtune-LoRA for RL

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention & RFT)

REverse-Engineered Reasoning for Open-Ended Generation

A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

The official github repo for "Diffusion Language Models are Super Data Learners".

LLM text generation and fine-tuning with MLX

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling