#
mha
Here are 29 public repositories matching this topic...
A game where muhammad ali fights mike tyson
-
Updated
Jul 19, 2023 - Python
A code deep-dive on one of the key innovations from Deepseek - Multihead Latent Attention (MLA)
-
Updated
Nov 9, 2025 - Python
Deploy MySQL 8.x with high availability and consistency
-
Updated
Apr 25, 2023 - Jinja
Making an app of heroes' details - Deku's Hero Analysis Book
-
Updated
Jan 5, 2022 - Lua
Modern LLM Attention from Scratch — MHA, GQA, MQA, RoPE, and KV-Cache implemented in pure PyTorch.
nlp benchmarking deep-learning pytorch transformer language-model attention-mechanism rope mha palm gqa mqa kv-cache llm
-
Updated
Dec 7, 2025 - Python
basically a transformer attending to game info
-
Updated
Oct 12, 2025 - Python
⚡ Optimize attention mechanisms with FlashMLA, a library of advanced sparse and dense kernels for DeepSeek models, improving performance and efficiency.
windows gpu cuda inference nvidia mha mla multi-head-attention gqa mqa llm flash-attention cuda-core decoding-attention deepseek flashinfer flashmla
-
Updated
Apr 30, 2026 - C++
This mod adds Tsuyu Asui from My Hero Acadamia into minetest
-
Updated
Jan 28, 2023 - Lua
array-api based simple volume renderer
-
Updated
Apr 30, 2026 - Python
Data Analytics project focused on the implementation and improvement of an architecture for time series classification, deployment, and productive implementation.
-
Updated
Nov 19, 2025 - TypeScript
Vagrant+Virtualbox+Ansible - various MySQL environments for testing and exploration.
ansible vagrant replication virtualbox group percona-server mha proxysql percona-xtradb-cluster pxc mysql-environments
-
Updated
Aug 9, 2017 - Perl
Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
gpu cuda inference nvidia mha mla multi-head-attention gqa mqa llm large-language-model flash-attention cuda-core decoding-attention flashinfer flashmla
-
Updated
Jun 11, 2025 - C++
Improve this page
Add a description, image, and links to the mha topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the mha topic, visit your repo's landing page and select "manage topics."