Skip to content
View gty111's full-sized avatar

Highlights

  • Pro

Organizations

@arcsysu @Inferact

Block or report gty111

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Showing results
Python 139 65 Updated Nov 16, 2026

DeepInfer: High-performance, large-scale inference framework for DeepSeek models

Python 26,110 3,211 Updated Nov 3, 2026
Lean 17,555 1,991 Updated Oct 30, 2026

Kimi Code CLI — The Starting Point for Next-Gen Agents

TypeScript 8,240 1,387 Updated Nov 16, 2026

Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

Python 8,980 999 Updated Nov 16, 2026

🚀 Efficient implementations for emerging model architectures

Python 6,059 816 Updated Nov 16, 2026

AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI

TypeScript 122,338 15,783 Updated Nov 16, 2026

The open source coding agent.

TypeScript 227,276 30,796 Updated Nov 16, 2026

An LLM post-training framework with vLLM for RL Scaling

Python 503 112 Updated Nov 11, 2026

A fast serialization and validation library, with builtin support for JSON, MessagePack, YAML, and TOML

Python 4,225 231 Updated Nov 16, 2026

FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

Python 17,247 1,710 Updated Nov 16, 2026

The source code of CacheC

Roff 1 Updated Aug 14, 2026

The source code of Mpache

Roff 1 Updated Aug 13, 2026

A Datacenter Scale Distributed Inference Serving Framework

Rust 8,503 1,867 Updated Nov 16, 2026

DeepSeek Harness: Everything is a Plugin.

TypeScript 282,282 34,956 Updated Nov 13, 2026

TokenSpeed is a speed-of-light LLM inference engine.

Python 2,930 417 Updated Nov 16, 2026

A framework for efficient model inference with omni-modality models

Python 7,794 2,136 Updated Nov 16, 2026

Claude Code is an agentic coding tool that lives in your terminal, understands your codebase, and helps you code faster by executing routine tasks, explaining complex code, and handling git workflo…

TypeScript 155,902 25,021 Updated Nov 16, 2026

Lightweight coding agent that runs in your terminal

Rust 135,524 21,491 Updated Nov 16, 2026

An asynchronous streaming data management module for efficient post-training.

Python 175 58 Updated Nov 13, 2026

A framework for few-shot evaluation of language models.

Python 14,487 3,812 Updated Nov 4, 2026

A high-performance and light-weight router for vLLM large scale deployment

Rust 520 259 Updated Nov 16, 2026

slime is an LLM training framework for RL Scaling.

Python 8,831 1,365 Updated Nov 5, 2026

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing,…

Rust 725 223 Updated Nov 16, 2026

Accurate, large-scale, and extensible simulator for LLM inference Systems

Python 729 143 Updated Aug 24, 2026

Offline optimization of your disaggregated Dynamo graph

Python 468 175 Updated Oct 29, 2026

Claude Opus 4.6 wrote a dependency-free C compiler in Rust, with backends targeting x86 (64- and 32-bit), ARM, and RISC-V, capable of compiling a booting Linux kernel.

Rust 2,839 252 Updated Feb 5, 2026

The AI that really does things. Any OS. Any Platform. The lobster way. 🦞

TypeScript 394,594 82,910 Updated Nov 16, 2026

[Archived] Legacy Python Kimi CLI, no longer maintained. Please use Kimi Code CLI: https://github.com/MoonshotAI/kimi-code

Python 11,407 1,322 Updated Sep 22, 2026

NVIDIA Inference Xfer Library (NIXL)

C++ 1,368 529 Updated Nov 16, 2026
Next