Skip to content
View syuoni's full-sized avatar

Organizations

@lightseekorg

Block or report syuoni

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Showing results

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing,…

Rust 736 230 Updated Nov 21, 2026

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

Python 4,369 389 Updated Nov 21, 2026

TokenSpeed is a speed-of-light LLM inference engine.

Python 2,944 424 Updated Nov 21, 2026

iTerm2 is a terminal emulator for Mac OS X that does amazing things.

Swift 18,310 1,562 Updated Nov 21, 2026

☄🌌️ The minimal, blazing-fast, and infinitely customizable prompt for any shell!

Rust 60,831 2,857 Updated Nov 21, 2026

Public repository for Agent Skills

Python 198,362 23,217 Updated Nov 16, 2026

Fast and memory-efficient exact attention

Python 25,330 3,246 Updated Nov 21, 2026

PyTensor allows you to define, optimize, and efficiently evaluate mathematical expressions involving multi-dimensional arrays.

Python 654 259 Updated Nov 20, 2026

PyTorch bindings for CUTLASS grouped GEMM.

Cuda 193 48 Updated Apr 8, 2026

GPQA: A Graduate-Level Google-Proof Q&A Benchmark

Jupyter Notebook 551 60 Updated Sep 30, 2024

Virtual whiteboard for sketching hand-drawn like diagrams

TypeScript 136,066 16,241 Updated Nov 21, 2026

Development repository for the Triton language and compiler

MLIR 20,613 3,434 Updated Nov 21, 2026

Parse Python docstrings in various flavors.

Python 273 60 Updated Nov 7, 2026

A Easy-to-understand TensorOp Matmul Tutorial

C++ 460 55 Updated Mar 5, 2026

Remote vanilla PDB (over TCP sockets).

Python 305 30 Updated Oct 24, 2022

Fast, Flexible and Portable Structured Generation

Python 2,024 279 Updated Nov 18, 2026

Enforce the output format (JSON Schema, Regex etc) of a language model

Python 2,041 100 Updated Apr 4, 2026

A guidance language for controlling large language models.

Jupyter Notebook 21,828 1,215 Updated May 21, 2026

Structured Outputs

Python 16,017 918 Updated Sep 21, 2026

A debugging and profiling tool that can trace and visualize python code execution

Python 7,794 480 Updated Nov 12, 2026

Material for gpu-mode lectures

Jupyter Notebook 7,110 722 Updated Sep 9, 2026

Demonstration of various hardware effects on CUDA GPUs.

C++ 395 31 Updated Nov 22, 2023

Download M3U8 live streams to the local disk

JavaScript 382 150 Updated Nov 10, 2026

Thread-safe asyncio-aware queue for Python

Python 971 55 Updated Nov 15, 2026

Flamegraph generator for cProfile stats

Python 258 16 Updated Mar 23, 2023

Generate stubs for python modules

Python 360 75 Updated Oct 14, 2026

FlashInfer: Kernel Library for LLM Serving

Cuda 6,982 1,792 Updated Nov 21, 2026

Examples in the MLX framework

Python 9,077 1,229 Updated Apr 6, 2026

Universal LLM Deployment Engine with ML Compilation

Python 23,408 2,203 Updated Nov 21, 2026

MLX: An array framework for Apple silicon

C++ 29,231 2,452 Updated Nov 21, 2026
Next