[Nature Machine Intelligence 2025] Emulating Human-like Adaptive Vision for Efficient and Flexible Machine Visual Perception

Code for Jensen et al. 2023

FiLM: Visual Reasoning with a General Conditioning Layer

Awesome In-Context RL: A curated list of In-Context Reinforcement Learning - - —

visualizing attention for LLM users

Visualizing the attention of vision-language models

Accompanying code for "Discovering State-of-the-art Reinforcement Algorithms" Nature publication

Structured Outputs

Materials for "Prompting is not a substitute for probability measurements in large language models" (EMNLP 2023)

Visual accumulator model (VAM)

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Code to reproduce the results from the NSD-synthetic data release paper.

Marcrodata Refinement

Official implementation & data for paper "Strong and Precise Modulation of Human Percepts via Robustified ANNs" (NeurIPS 2023)

Original reference implementation of "3D Gaussian Splatting for Real-Time Radiance Field Rendering"

Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams

Corruption and Perturbation Robustness (ICLR 2019)

Algorithms to investigate (through neural control) the representational relationships between univariate or multivariate in silico fMRI responses of multiple visual areas of the brain.

A library for experimenting with, training and evaluating neural networks, with a focus on adversarial robustness.

Spatial prediction across human visual cortex during naturalistic vision.

Trained encoding models to generate in silico neural responses for arbitrary stimuli.

Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch

Predictive Coding JAX-based library

Theme your iPod nano 7th and 6th generation with custom icons, wallpapers, clock faces, change or hide labels, apply custom font, and more.

Use DNN to study the brain and use brain measurement to evaluate DNN

OpenFace – a state-of-the art tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation.

Face detection, tracking and clustering in videos

Computer Vision library for human-computer interaction. It implements Head Pose and Gaze Direction Estimation Using Convolutional Neural Networks, Skin Detection through Backprojection, Motion Dete…

OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation