neural-engine

Run Stable Diffusion on Mac natively

Everything we actually know about the Apple Neural Engine (ANE)

AI speech toolkit for Apple Silicon — ASR, TTS, speech-to-speech, VAD, and diarization powered by MLX and CoreML

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

Fast, private, local-first voice app for Apple Silicon Macs — dictation, file/media transcription, meeting recording, Transforms, and a public automation CLI. Free and open-source.

Learn about the Neumorphic engineering process of creating large-scale integration (VLSI) systems containing electronic analog circuits to mimic neuro-biological architectures.

Run Stable Diffusion using Core ML on iOS within your Expo & React Native App

Run transformers directly on Apple's Neural Engine in Swift bypass coreml entirely

Local AI runtime for training & running small LLMs directly on Apple Neural Engine (ANE). No CoreML. No Metal. Offline, on-device fine-tuning & inference on M-series silicon.

Core ML Guide

A practical lab for exploring Apple's Core AI framework, model assets, specialization, and on-device inference.

Run transformers (incl. LLMs) on the Apple Neural Engine.

Pythonic binding to the Apple Neural Engine

Tool for visual profiling Core ML models, compatible with both package and compiled versions, including reasons for unsupported operations on the Neural Engine

List of world model games and where to find them!

Horizon chart for CPU/GPU/Neural Engine utilization monitoring. Supports Apple M1-M4, Nvidia GPUs, AMD GPUs

Building AI tools and learning as I go: mobile computer vision, medical ML, business automation. Started with a chicken problem, ended up doing neuroscience research. Still figuring it out.

Apple Neural Engine (ANE) LLM inference engine — reverse-engineered private APIs, Metal GPU shaders, hybrid ANE+GPU+CPU on Apple Silicon. 32 tok/s matching llama.cpp, 3.6 TFLOPS fused ANE mega-kernels.

Bringing StableHLO to Apple Silicon

Transport-neutral, vendor-agnostic virtual accelerator devices. First class cross-platform NPU backend support for Apple, Intel, AMD and Qualcomm devices.