Official inference framework for 1-bit LLMs

Fabric is an open-source framework for augmenting humans using AI. It provides a modular system for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.

LLM inference in C/C++

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

A Python package for extending the official PyTorch that can easily obtain performance on Intel platform

The Python programming language

Inference Llama 2 in one file of pure C

Never use print for debugging again

A modern and customizable python UI-library based on Tkinter

TensorRT MODNet, YOLOv4, YOLOv3, SSD, MTCNN, and GoogLeNet

Implementation of paper - YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors

Instant neural graphics primitives: lightning fast NeRF and more

Deep Learning tools and applications for NVIDIA AGX platforms.

A Linux kernel driver for ch341 emulating the I2C bus

NVIDIA Linux open GPU kernel module source

CUDA Python: Performance meets Productivity

📊 Simple package for monitoring and control your NVIDIA Jetson [Orin, Xavier, Nano, TX] series

Exclusively Dark (ExDARK) dataset which to the best of our knowledge, is the largest collection of low-light images taken in very low-light environments to twilight (i.e 10 different conditions) to…

A tutorial on training a DarkNet YOLOv4 model for the CrowdHuman dataset

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

Visualizer for neural network, deep learning and machine learning models

This repository contains notebooks that show the usage of TensorFlow Lite for quantizing deep neural networks.

Compiler for Neural Network hardware accelerators

Line-by-line profiling for Python

A collective list of free APIs

NVIDIA's Deep Imagination Team's PyTorch Library

Cross-platform, customizable ML solutions for live and streaming media.

GPU & Accelerator process monitoring for AMD, Apple, Huawei, Intel, NVIDIA and Qualcomm

A Trimap-Free Portrait Matting Solution in Real Time [AAAI 2022]