#

cross-domain-mixture-of-experts

Here are 3 public repositories matching this topic...

SmallDoges / small-doge

Doge Family of Small Language Models

python nlp natural-language-processing reinforcement-learning deep-learning pytorch transformer chinese webui attention-mechanism r1 attention-is-all-you-need mechine-learning foundation-models small-language-models dynamic-mask-attention cross-domain-mixture-of-experts deepseek-r1

Updated Jan 6, 2026
Python

LoserCheems / WonderfulMatrices

Wonderful Matrices to Build Small Language Models

python nlp machine-learning natural-language-processing deep-learning pytorch transformer feedforward-neural-network language-model attention-mechanism attention-is-all-you-need mixture-of-experts pytorch-transformers foundation-models small-language-models small-language-model dynamic-mask-attention cross-domain-mixture-of-experts

Updated Feb 15, 2025
Python

neko124 / small-doge

Doge Family of Small Language Model

javascript nlp typescript webpack deep-learning pytorch transformer chinese attention-mechanism mechine-learning foundation-models dynamic-mask-attention cross-domain-mixture-of-experts deepseek-r1

Updated Aug 26, 2025

Add this topic to your repo

To associate your repository with the cross-domain-mixture-of-experts topic, visit your repo's landing page and select "manage topics."