Persist and reuse KV Cache to speedup your LLM.

FIT: 企业级AI开发框架，提供多语言函数引擎（FIT）、流式编排引擎（WaterFlow）及Java生态的LangChain替代方案（FEL）。原生/Spring双模运行，支持插件热插拔与智能聚散部署，无缝统一大模型与业务系统。

A C++ header-only HTTP/HTTPS server and client library

A Cloud Native Batch System (Project under CNCF)

c++11基础库

A C++11 RPC framework based on future and protobuf, with utility: timer,ssl,future/promise,log,coroutine,etc