AI features and capabilities for Praxis

AI and cloud-native proxy server and framework

🧰 The Rust SQL Toolkit. An async, pure Rust SQL crate featuring compile-time checked queries without a DSL. Supports PostgreSQL, MySQL, and SQLite.

Stateful API logic for agentic applications using vLLM

Enhancement proposals for Praxis

Composable building blocks to build Llama Apps

AI Gateway documentation, gap analysis, and design docs

Website for Praxis

Python SDK for Llama Stack

A high-throughput and memory-efficient inference and serving engine for LLMs

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

Machine Learning Pipelines for Kubeflow

Repository to host llama-stack custom distributions.

Collection of Architectural Decision Records

TrustyAI's LMEval provider for Llama Stack

Utilities intended for use with Llama models.

Collection of demos for building Llama Stack based apps on OpenShift

Experimental repo for llama-stack deployment