LLM inference in C/C++

A nearly-live implementation of OpenAI's Whisper.

On-device AI across mobile, embedded and edge for PyTorch

Implementation of popular deep learning networks with TensorRT network definition API

The code, training pipeline, and models that power Firefox Translations

Tensor description registry

Code repo for "Implicit Transformer Network for Screen ContentImage Continuous Super-Resolution" (NeurIPS'21)

Fully open reproduction of DeepSeek-R1

Whisper finetuning

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

PEAN: A Diffusion-Based Prior-Enhanced Attention Network for Scene Text Image Super-Resolution (ACMMM 2024)

Reference implementations of MLPerf™ inference benchmarks

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Faster Whisper transcription with CTranslate2

An Open Source text-to-speech system built by inverting Whisper.

Real-time speech recognition using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, Raspberry Pi, x86_64 servers, websocket server/client, C/C++,…

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

YOLOv4 / Scaled-YOLOv4 / YOLO - Neural Networks for Object Detection (Windows and Linux version of Darknet )

Community submission to MLPerf inference v3.1

A unified, non-intrusive and technology-agnostic interface to access and reuse any shared knowledge (research projects, benchmarks, experiments, tools, scripts, models, data), implement portable au…