From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.

A library to create and manage configuration files, especially for machine learning projects.

Cyclic Block Coordinate Descent With Variance Reduction for Composite Nonconvex Optimization

A curated list of project tutorials for project-based learning.

Algorithms for Privacy-Preserving Machine Learning in JAX

Official Implementation of "Tree of Thoughts: Deliberate Problem Solving with Large Language Models"

Machine learning, in numpy

Let's train vision transformers (ViT) for cifar 10!

Examples and guides for using the OpenAI API

An extensible benchmark for evaluating large language models on planning

[ECCV 2022] TinyViT: Fast Pretraining Distillation for Small Vision Transformers (https://github.com/microsoft/Cream/tree/main/TinyViT)

Implementation of "Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents"

PDF GPT allows you to chat with the contents of your PDF file by using GPT capabilities. The only open source solution to turn your pdf files in a chatbot!

Codes and Solutions of "Numerical Linear Algebra by Trefethen"

Here is a Google Colab Notebook for fine-tuning Alpaca Lora (within 3 hours with a 40GB A100 GPU)

Code and data for Katsumi et al., in press, "Correspondence of functional connectivity gradients across human isocortex, cerebellum, and hippocampus".

A modified version of MineDojo

Learning to See by Looking at Noise

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning (AISTATS 2022 Oral)