Skip to content
View gty111's full-sized avatar

Highlights

  • Pro

Organizations

@arcsysu @Inferact

Block or report gty111

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Showing results
Python 138 64 Updated Nov 16, 2026

DeepInfer: High-performance, large-scale inference framework for DeepSeek models

Python 26,086 3,207 Updated Nov 3, 2026
Lean 17,542 1,991 Updated Oct 30, 2026

Kimi Code CLI — The Starting Point for Next-Gen Agents

TypeScript 8,233 1,385 Updated Nov 16, 2026

Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

Python 8,977 996 Updated Nov 13, 2026

🚀 Efficient implementations for emerging model architectures

Python 6,056 815 Updated Nov 16, 2026

AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI

TypeScript 122,215 15,756 Updated Nov 15, 2026

The open source coding agent.

TypeScript 227,105 30,762 Updated Nov 16, 2026

An LLM post-training framework with vLLM for RL Scaling

Python 503 111 Updated Nov 11, 2026

A fast serialization and validation library, with builtin support for JSON, MessagePack, YAML, and TOML

Python 4,225 231 Updated Nov 14, 2026

FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

Python 17,234 1,709 Updated Nov 16, 2026

The source code of CacheC

Roff 1 Updated Aug 14, 2026

The source code of Mpache

Roff 1 Updated Aug 13, 2026

A Datacenter Scale Distributed Inference Serving Framework

Rust 8,496 1,862 Updated Nov 16, 2026

DeepSeek Harness: Everything is a Plugin.

TypeScript 281,824 34,868 Updated Nov 13, 2026

TokenSpeed is a speed-of-light LLM inference engine.

Python 2,932 415 Updated Nov 16, 2026

A framework for efficient model inference with omni-modality models

Python 7,780 2,130 Updated Nov 16, 2026

Claude Code is an agentic coding tool that lives in your terminal, understands your codebase, and helps you code faster by executing routine tasks, explaining complex code, and handling git workflo…

TypeScript 155,816 25,013 Updated Nov 15, 2026

Lightweight coding agent that runs in your terminal

Rust 135,445 21,484 Updated Nov 16, 2026

An asynchronous streaming data management module for efficient post-training.

Python 175 58 Updated Nov 13, 2026

A framework for few-shot evaluation of language models.

Python 14,478 3,805 Updated Nov 4, 2026

A high-performance and light-weight router for vLLM large scale deployment

Rust 519 259 Updated Nov 16, 2026

slime is an LLM training framework for RL Scaling.

Python 8,828 1,364 Updated Nov 5, 2026

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing,…

Rust 723 223 Updated Nov 16, 2026

Accurate, large-scale, and extensible simulator for LLM inference Systems

Python 724 143 Updated Aug 24, 2026

Offline optimization of your disaggregated Dynamo graph

Python 467 175 Updated Oct 29, 2026

Claude Opus 4.6 wrote a dependency-free C compiler in Rust, with backends targeting x86 (64- and 32-bit), ARM, and RISC-V, capable of compiling a booting Linux kernel.

Rust 2,837 252 Updated Feb 5, 2026

The AI that really does things. Any OS. Any Platform. The lobster way. 🦞

TypeScript 394,547 82,892 Updated Nov 16, 2026

[Archived] Legacy Python Kimi CLI, no longer maintained. Please use Kimi Code CLI: https://github.com/MoonshotAI/kimi-code

Python 11,406 1,322 Updated Sep 22, 2026

NVIDIA Inference Xfer Library (NIXL)

C++ 1,365 528 Updated Nov 15, 2026
Next