Skip to content

Repository files navigation

LL·Mirror

LL·Mirror is a C++ GUI tool to inspect and visualize language-model activations and logits (token ranking) during generation. The app shows per-token per-layer logits, top-N token lists, heatmaps and rank plots, and provides a simple chat pane to interact with the model.

This work is inspired by Jacobian Lens and depends on lens feature of chatllm.cpp.

Highlights:

  • 100% Native: no Python/JS/Web.
  • Interactive visualization: fast and beautiful.

Requirements

  • Windows 10/11 (x64)
Screenshots

ocean

lens

Quick Start

  1. Download a release.
  2. Download any model supported by chatllm.cpp.
  3. Start the main program with Identity lens.

To use Jacobian Lens:

  1. Download a supported quantized model, for example Qwen3-4B.
  2. Download the pre-fitted quantized Jacobian Lens, for example Qwen3-4B.
  3. Start the main program with Linear lens.

Development

  • Open the solution llmirror.sln in Visual Studio and build.

  • Copy all binding DLL of chatllm.cpp to build output directory then run.

Acknowledgements

This project uses these awesome libraries/frameworks:

Contributions

This project accepts contributions (such as bug fixes), not code consignments (such as features I don't care).

About

LL·Mirror is a C++ GUI tool to inspect and visualize language-model activations and logits (token ranking) during generation.

Resources

Stars

4 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages