Composable building blocks to build Llama Apps

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of …

Repository to host the ODH Llama Stack distribution image

Python SDK for Llama Stack

Running Docling as an API service

Command-line interface. Use this to chat with the model or train the model (training consumes the taxonomy data)

standalone deepspeed backend

ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)

Agentic components of the Llama Stack APIs

Design documents that span multiple InstructLab components

A high-throughput and memory-efficient inference and serving engine for LLMs

This is the latest version of the internal repository from Pebble Technology providing the software to run on Pebble watches. Proprietary source code has been removed from this repository and it wi…

LLM inference in C/C++

Taxonomy tree that will allow you to create models tuned with your data

Python library for Synthetic Data Generation

Large Language Model Text Generation Inference

Python bindings for llama.cpp

Python library for Evaluation