A high-throughput and memory-efficient inference and serving engine for LLMs

Intelligent Mixture-of-Models Router for Efficient LLM Inference

KEDA is a Kubernetes-based Event Driven Autoscaling component. It provides event driven scale for any container running in Kubernetes

A cloud-native vector database, storage for next generation AI applications

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

The official Python client for the Huggingface Hub.

SGLang is a fast serving framework for large language models and vision language models.

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of …

Go SDK for Milvus.

Open-source vector similarity search for Postgres

RocksDB/LevelDB inspired key-value database in Go

Distributed reliable key-value store for the most critical data of a distributed system

An embedded key/value database for Go.

A new project to resume development on the formerly open-source Redis project. We're calling it Valkey, since it's a twist on the key-value datastore.

A library that provides an embeddable, persistent key-value store for fast storage.

Redis documentation source code for markdown and metadata files, conversion scripts, and so forth

Placement driver for TiKV

Redis is an in-memory database that persists on disk. The data model is key-value, but many different kind of values are supported: Strings, Lists, Sets, Sorted Sets, Hashes, Streams, HyperLogLogs,…

Redis library for rust

Sidecar container that watches Kubernetes PersistentVolumeClaim objects and triggers CreateVolume/DeleteVolume against a CSI endpoint

CockroachDB - the open source, cloud-native distributed SQL database.

Distributed transactional key-value database, originally created to complement TiDB

Enhancements tracking repo for Kubernetes

Pika is a nosql compatible with redis, it is developed by Qihoo's DBA and infrastructure team

Pure-Go HBase client

Redis Python Client

Production-Grade Container Scheduling and Management