A tiny demo of interfacing CUDA via nanobind with a pytorch tensor

A high-throughput and memory-efficient inference and serving engine for LLMs

Agents of C.L.I.

A high-throughput and memory-efficient inference and serving engine for LLMs

Fast and memory-efficient exact attention

Fast and memory-efficient exact attention ported to rocm

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Development repository for the Triton language and compiler

A rule-based tunnel in Go.

Llama 2 Everywhere (L2E)

Instruct-tune LLaMA on consumer hardware

Llama 2 inference in one file of pure Go

Inference Llama 2 in one file of pure Rust 🦀

Inference Llama 2 in one file of pure C

Inference Llama 2 in one file of pure C++

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Deploy über-JARs. Restart processes. (port of codahale/assembly-sbt)

An unofficial cuda assembler, for all generations of SASS, hopefully ：）

📚 C/C++ 技术面试基础知识总结，包括语言、程序库、数据结构、算法、系统、网络、链接装载库等知识及面试经验、招聘、内推等信息。This repository is a summary of the basic knowledge of recruiting job seekers and beginners in the direction of C/C++ technology, in…

Public repo for the GANFT video

Code + Playground Colab for the paper "Language Models are Unsupervised Multitask Learners"

博客啦～

YOLOv4 / Scaled-YOLOv4 / YOLO - Neural Networks for Object Detection (Windows and Linux version of Darknet )

Simple Scala interface for Graphviz

StyleGAN Encoder - converts real images to latent space

COCO API - Dataset @ http://cocodataset.org/

Matrix Shadow:Lightweight CPU/GPU Matrix and Tensor Template Library in C++/CUDA for (Deep) Machine Learning

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Bounding Box Regression with Uncertainty for Accurate Object Detection (CVPR'19)