Supercharge Your LLM with the Fastest KV Cache Layer

Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)

tools and scripts to support opea local dev

This repo contains documents of the OPEA project

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

GenAI components at micro-service level; GenAI service composer to create mega-service

Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.

Get up and running with Llama 2, Mistral, Gemma, and other large language models.

the AI-native open-source embedding database

Example models using DeepSpeed

PyTorch tutorials.

Intel Low Precision Optimization Tool, targeting to provide a unified low precision inference interface cross different deep learning frameworks, and support auto-tune with specified accuracy crite…

An implementation of a deep learning recommendation model (DLRM)

End-to-end speech recognition using RNN Transducers in Tensorflow 2.0

Tensors and Dynamic neural networks in Python with strong GPU acceleration

multiplayer space ship using p5 as front end and cowboy as back end

This fork of BVLC/Caffe is dedicated to improving performance of this deep learning framework when running on CPU, in particular Intel® Xeon processors (HSW+) and Intel® Xeon Phi processors