All

113 repositories

sglang
Public
SGLang is a fast serving framework for large language models and vision language models.
Python
•
Apache License 2.0
•6.5k•0•0•1•Updated Jun 11, 2026Jun 11, 2026
Distributed-Visual-ChatGPT
Public
Scalable Visual-ChatGPT deployment on Kubernetes - Distributed multi-model inference graph powered by BentoML
aiapps llm
aiapps llm
Python
•
MIT License
•3.2k•16•0•4•Updated Jun 10, 2026Jun 10, 2026
papercups
Public
Open-source live customer chat
Elixir
•
MIT License
•571•0•0•8•Updated Jun 10, 2026Jun 10, 2026
BentoSentenceTransformers
Public
how to build a sentence embedding application using BentoML
Python
•2•15•0•1•Updated Jun 10, 2026Jun 10, 2026
BentoBLIP
Public
how to build an image captioning application on top of a BLIP model with BentoML
Python
•2•5•0•1•Updated Jun 10, 2026Jun 10, 2026
BentoCLIP
Public
building a CLIP application using BentoML
Python
•2•9•0•1•Updated Jun 10, 2026Jun 10, 2026
BentoXTTS
Public
how to build an text-to-speech application using BentoML
Python
•3•12•1•3•Updated Jun 9, 2026Jun 9, 2026
llm-inference-handbook
Public
Everything you need to know about LLM inference
inference-optimization llm llm-inference
inference-optimization llm llm-inference inference-handbook inference-infrastructure
TypeScript
•
Apache License 2.0
•27•293•3•3•Updated Jun 9, 2026Jun 9, 2026
OpenLLM
Public
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
llama mistral fine-tuning
llama mistral fine-tuning mlops bentoml vicuna llm model-inference llmops llm-serving
Python
•
Apache License 2.0
•815•12k•6•9•Updated Jun 8, 2026Jun 8, 2026
BentoML
Public
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
python machine-learning deep-learning
python machine-learning deep-learning model-serving multimodal mlops ml-engineering ai-inference llm generative-ai
Python
•
Apache License 2.0
•968•8.7k•138•26•Updated Jun 3, 2026Jun 3, 2026
Yatai
Public archive
Model Deployment at Scale on Kubernetes 🦄️
kubernetes machine-learning k8s
kubernetes machine-learning k8s model-deployment model-serving mlops bentoml
TypeScript
•
Other
•76•843•21•13•Updated May 30, 2026May 30, 2026
chatgpt-lite
Public
Fast ChatGPT UI with support for both OpenAI and Azure OpenAI. 快速的ChatGPT UI，支持OpenAI和Azure OpenAI。
TypeScript
•
MIT License
•124•0•0•1•Updated May 12, 2026May 12, 2026
BentoCrewAI
Public
Serving CrewAI Agent as REST API with BentoML, optionally with self-host open-source LLMs
Python
•1•22•0•2•Updated May 8, 2026May 8, 2026
BentoBark
Public
Python
•0•9•0•1•Updated May 8, 2026May 8, 2026
terraform-google-kubernetes-engine
Public
Configures opinionated GKE clusters
HCL
•
Apache License 2.0
•1.3k•0•0•7•Updated May 8, 2026May 8, 2026
csi-driver-image-populator
Public
CSI driver that uses a container image as a volume
Go
•
Apache License 2.0
•22•0•0•3•Updated May 8, 2026May 8, 2026
BentoQueue
Public
Python
•1•1•0•2•Updated May 8, 2026May 8, 2026
yatai-schemas
Public
Go
•2•1•1•1•Updated May 8, 2026May 8, 2026
BentoSGLang
Public
Python
•1•1•0•1•Updated Mar 26, 2026Mar 26, 2026
openllm-models
Public
Python
•17•65•0•1•Updated Mar 26, 2026Mar 26, 2026
helm-charts
Public
0•2•0•0•Updated Mar 24, 2026Mar 24, 2026
yatai-image-builder
Public
🐳 Build OCI images for Bentos in k8s
docker kubernetes docker-image
docker kubernetes docker-image container k8s container-image
Go
•12•19•5•13•Updated Mar 24, 2026Mar 24, 2026
yatai-common
Public
Go
•5•1•0•2•Updated Mar 7, 2026Mar 7, 2026
openai_emulator
Public
Python
•
Apache License 2.0
•0•0•0•0•Updated Mar 5, 2026Mar 5, 2026
.github
Public
✨🍱🦄️
4•1•0•0•Updated Mar 5, 2026Mar 5, 2026
BentoVLLM
Public
Self-host LLMs with vLLM and BentoML
Python
•
Apache License 2.0
•21•169•3•5•Updated Mar 3, 2026Mar 3, 2026
bentocloud-homepage-news
Public
2•2•0•0•Updated Feb 10, 2026Feb 10, 2026
BentoSpacy
Public
Python
•0•0•0•2•Updated Jan 26, 2026Jan 26, 2026
BentoTRTLLM
Public
Python
•1•10•2•2•Updated Jan 22, 2026Jan 22, 2026
mise-nebius
Public
Shell
•
MIT License
•0•0•0•0•Updated Jan 22, 2026Jan 22, 2026

ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

BentoML

All

All

113 repositories

sglang

Distributed-Visual-ChatGPT

papercups

BentoSentenceTransformers

BentoBLIP

BentoCLIP

BentoXTTS

llm-inference-handbook

OpenLLM

BentoML

Yatai

chatgpt-lite

BentoCrewAI

BentoBark

terraform-google-kubernetes-engine

csi-driver-image-populator

BentoQueue

yatai-schemas

BentoSGLang

openllm-models

helm-charts

yatai-image-builder

yatai-common

openai_emulator

.github

BentoVLLM

bentocloud-homepage-news

BentoSpacy

BentoTRTLLM

mise-nebius

All

All

Repositories list

113 repositories