Stars
An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of…
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
A containerd snapshotter with data deduplication and lazy loading in P2P fashion
Nydus - the Dragonfly image service, providing fast, secure and easy access to container images.
Kubernetes-native AI serving platform for scalable model serving.
JupyterLab computational environment.
A lightweight, multi-tenant, scalable and secure gateway that enables Jupyter Notebooks to share resources across distributed clusters such as Apache Spark, Kubernetes and others.
Dynamically provisioning persistent local storage with Kubernetes
Delivers efficient, stable, and secure data distribution and acceleration powered by P2P technology, with an optional content‑addressable filesystem that accelerates OCI container launch.
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
Spark on Kubernetes infrastructure Docker images repo
Spark on Kubernetes infrastructure Helm charts repo
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
Open source Java implementation for Raft consensus protocol.
Cost-efficient and pluggable Infrastructure components for GenAI inference
cloud-native local storage management system for stateful workload, low-latency with simplicity
Karpenter is a Kubernetes Node Autoscaler built for flexibility, performance, and simplicity.
Open, Multi-Cloud, Multi-Cluster Kubernetes Orchestration
Automated management of large-scale applications on Kubernetes (incubating project under CNCF)
Production-Grade Container Scheduling and Management
Virtual Kubelet is an open source Kubernetes kubelet implementation.
Apache Spark - A unified analytics engine for large-scale data processing