Pinned Loading

1. GPT2-inference GPT2-inference Public

   GPT inference in pure CUDA and C++

   Cuda 17 3

2. blackboard-core blackboard-core Public

   A Python SDK for building LLM-powered multi-agent systems using the Blackboard Pattern.

   Python 5 1

3. quantization-project quantization-project Public

   A comprehensive, modular platform for rapid experimentation with model quantization strategies. Designed for research on consumer hardware with scalability to larger systems.

   Python 1

4. pathfinder pathfinder Public

   Pathfinder is an AI-powered educational platform designed to create personalized learning experiences. It leverages advanced Large Language Models (LLMs) to act as an intelligent tutor, generating …

   TypeScript 3

5. DistributedInference DistributedInference Public

   distribute inference compute between multiple clients

   Python

6. HyperMuon HyperMuon Public

   A from-scratch PyTorch implementation of Manifold-Constrained Hyper-Connections (DeepSeek) trained with the Muon Optimizer (Moonshot) on TinyShakespeare.

   Jupyter Notebook