Skip to content
View GaoYusong's full-sized avatar
162 followers · 307 following

Achievements

Achievement: Pair ExtraordinaireAchievement: StarstruckAchievement: QuickdrawAchievement: YOLOAchievement: Pull Sharkx2

Achievements

Achievement: Pair ExtraordinaireAchievement: StarstruckAchievement: QuickdrawAchievement: YOLOAchievement: Pull Sharkx2

Block or report GaoYusong

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
GaoYusong/README.md

Yusong Gao

Infrastructure for Large-Scale Data and AI Systems

I build production infrastructure for large-scale data and AI systems.

Today, I focus on large-scale LLM inference at Ant Group, including serving architecture, scheduling, performance, reliability, and observability.

Previously, I built production systems for PolarDB and Alibaba Cloud RDS.

Selected Work

  • Large-Scale AI Inference — serving architecture, scheduling, performance, reliability, and observability.
  • Cloud Database Infrastructure — production systems for PolarDB and Alibaba Cloud RDS.
  • Open Source — work around SGLang and llm.cpp.

Pinned Loading

  1. llm.cpp llm.cpp Public

    A C++ port of karpathy/llm.c features a tiny torch library while maintaining overall simplicity.

    C++ 58 10

  2. apecloud/myduckserver apecloud/myduckserver Public

    Unified MySQL, Postgres & FlightSQL Server, Powered by DuckDB.

    Go 592 46

  3. sglang sglang Public

    Forked from sgl-project/sglang

    SGLang is a fast serving framework for large language models and vision language models.

    Python