Everything I know about running LLMs locally

Open-source & free — Battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise line-level comments, built-in fine-tuned ruleset (NPE, thre…

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed notebook tutorial.

Deepsec is a security harness for finding vulnerabilities in your codebase powered by coding agents

Run GLM-5.2 (744B MoE) on a 25GB-RAM consumer machine — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

Code, Build and Evaluate agents - excellent Model and Skills/MCP/ACP/A2A Support

Turn any MCP, OpenAPI, or GraphQL server into a CLI — at runtime, with zero codegen

Enterprise AI Platform with guardrails, MCP registry, gateway & orchestrator

Chunk MCP tools: Tool with required properties; optional Properties and Enums

Chunk Skills: Frontmatter; Index of markdown headers 2 nodes; recompose with PageIndex natural page form

Vault-LD: an open spec for Markdown vaults as linked data. YAML-LD frontmatter + a shared @context = an RDF knowledge graph. Prose for humans and LLMs, triples for machines.

Full Rust port of Python docling

Open-source backend-as-a-service. Postgres, auth, storage, functions, AI gateway, MCP.

Secure, Fast, and Extensible Sandbox runtime for AI agents.

"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files

Parallel S3 and local filesystem execution tool.

Postgres rewritten in Rust, now passing 100% of the Postgres regression tests

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Difference-in-Differences causal inference in Python. Callaway-Sant'Anna, Synthetic DiD, Honest DiD, event studies. sklearn-like API, validated against R.

Up to 3× faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding — Gemma-4, Qwen3, Ornith-1.0, ternary Bonsai-27B.

Kubernetes-native VM orchestration on Cloud Hypervisor

a community oriented 1:1 vLLM port in C++ with additional features

Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 2,200+ medical models, 21 languages, Apple MLX + Python, no cloud, no patient data leaving your netwo…

Paste any GitHub URL → interactive architecture map. See how files connect, find what breaks if you change something. No install, no accounts — runs entirely in your browser.

Node Version Manager - POSIX-compliant bash script to manage multiple active node.js versions

A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.

Omnigent is an open-source AI agent framework and meta-harness: orchestrate Claude Code, Codex, Cursor, Pi, and custom agents — swap harnesses without rewriting, enforce policies and sandboxing, an…

A small command line client for querying SPARQL endpoints.

autonomous red teaming platform; multi-agent offensive-security meta-harness