MLX-VLM a package for running Vision LLMs on your Mac using MLX.

The easiest way to get started is to install the mlx-vlm package:

With pip:

pip install mlx-vlm

Inference:

python -m mlx_vlm.generate --model qnguyen3/nanoLLaVA --max-tokens 100 --temp 0.0