LLM inference in C/C++

A taxonomy of all official CycloneDX property namespaces and names

CycloneDX is a full-stack Bill of Materials (BOM) standard that provides advanced supply chain capabilities for cyber risk reduction. SBOM, SaaSBOM, HBOM, ML-BOM, OBOM, MBOM, VDR, and VEX

Build, edit, validate, and export CycloneDX BOMs through an intuitive browser-based interface

Utility that provides an API platform for validating, querying and managing BOM data

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

A framework for few-shot evaluation of language models.

NVIDIA’s repository for enabling trustworthy AI.

IBM GGUF-encoded AI models and conversion scripts

Utility that provides an API and CLI to identify licenses and legal terms

A minimalistic C++ Jinja templating engine for LLM chat templates

Granite Snack Cookbook -- easily consumable recipes (python notebooks) that showcase the capabilities of the Granite models

Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI

🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transf…

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.

The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

Taxonomy tree that will allow you to create models tuned with your data

Command-line interface. Use this to chat with the model or train the model (training consumes the taxonomy data)

Design documents that span multiple InstructLab components

Ebitengine - A dead simple 2D game engine for Go