Skip to content
View pzhao1799's full-sized avatar

Block or report pzhao1799

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Showing results

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching…

Go 9,745 1,614 Updated Nov 18, 2026

Slurm on Kubernetes - a cluster management tool

Go 11 6 Updated Jan 15, 2026

cuTile is a programming model for writing parallel kernels for NVIDIA GPUs

Python 2,172 160 Updated Nov 18, 2026

A framework for efficient model inference with omni-modality models

Python 7,834 2,155 Updated Nov 18, 2026

Gateway API Inference Extension

Go 806 329 Updated Nov 9, 2026

State of the art inference performance with modern accelerators on Kubernetes

Python 5,301 938 Updated Nov 18, 2026

A Datacenter Scale Distributed Inference Serving Framework

Rust 8,522 1,880 Updated Nov 18, 2026

An AI Hedge Fund Team

Python 64,748 11,389 Updated Nov 9, 2026

An open-source, privacy-first, self-hosted knowledge workspace where humans and AI agents work together 开源、隐私优先、自托管的知识工作空间,让人与智能体在此协作

TypeScript 47,281 3,123 Updated Nov 18, 2026

Cost-efficient and pluggable Infrastructure components for GenAI inference

Go 5,193 768 Updated Nov 18, 2026

Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation

8,140 306 Updated May 15, 2025

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

Go 1,294 149 Updated Nov 16, 2026

[WIP] Resources for AI engineers. Also contains supporting materials for the book AI Engineering (Chip Huyen, 2025)

Jupyter Notebook 18,341 2,692 Updated Jul 3, 2026

Optimized Agentic and LLM Bulk Processing Over Your Data

Python 1,734 157 Updated Nov 10, 2026

A heap memory profiler for Linux

C++ 4,201 248 Updated Nov 16, 2026

High performance self-hosted photo and video management solution.

TypeScript 119,568 7,649 Updated Nov 18, 2026

A playbook for effectively prompting post-trained LLMs

904 38 Updated Jan 21, 2025

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

Python 79,745 7,442 Updated Nov 18, 2026

One proximity graph for vector search, sparse products & attention across RAM, VRAM & NVMe, over dense vectors, sequences, shapes & geospatial sets in 14 languages 🔍

C++ 4,390 377 Updated Nov 18, 2026

AI Observability & Evaluation

Python 12,347 1,312 Updated Nov 18, 2026

Adding guardrails to large language models.

Python 7,625 746 Updated Nov 18, 2026

DSPy: The framework for programming—not prompting—language models

Python 39,127 3,528 Updated Nov 18, 2026

An enterprise-grade AI retriever designed to streamline AI integration into your applications, ensuring cutting-edge accuracy.

Python 295 41 Updated Jun 26, 2025

LLM inference in C/C++

C++ 135,642 25,739 Updated Nov 18, 2026

Tensor library for machine learning

C++ 16,113 2,081 Updated Nov 16, 2026

[ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs

Python 318 30 Updated Jul 13, 2025

SGLang is a high-performance serving framework for large language models and multimodal models.

Python 39,040 10,599 Updated Nov 18, 2026

A simple RPC framework with protobuf service definitions

Go 7,529 327 Updated Oct 8, 2026

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS

Python 512 60 Updated Feb 12, 2026
Next