Sumin Park

M.S. student at KAIST

profile2.jpeg

I am a Master’s student in the School of Computing at KAIST, advised by Prof. Noseong Park. My research broadly studies how architectural inductive biases and training dynamics shape internal representations and functional specialization in neural networks. My current interests include:

  • Mechanistic interpretability of LLMs
  • Recurrent neural dynamics for efficient sequence modeling and adaptive reasoning
  • Feedback-driven neural adaptation

Building on my undergraduate background in neuroscience, I am also drawn to brain-inspired inductive biases as universal learning principles that can be shared by both brain and machine.

News

  • Nov 2026 Linz, Austria
    Invited Talk Giving an invited talk, Quotient Space Convergence for Looped Reasoning, at the workshop Learning-Based Methods in Scientific Computing at RICAM (Nov 17).
  • Jul 2026 – Jan 2027 Tübingen, Germany
    Research Internship Joining the Computational Applied Mathematics & AI Lab (CAMAIL) at the Max Planck Institute for Intelligent Systems as a research intern, advised by T. Konstantin Rusch.
  • Jul 2026 Seoul, South Korea
    ICML Conference Attending ICML 2026 (Jul 6–11) to present two works, Q-Delta and STAR.

Selected publications

  1. Under Review 2027
    Looped Reasoning Finishes Earlier Than You Think
    Sumin Park, T. Konstantin Rusch
    Gauge-equivariant quotient recurrent reasoner (QRR) that decouples rotational symmetry motion from reasoning-relevant quotient dynamics, enabling stable and faster convergence
    Looped Reasoning Quotient Dyanmics LLMs
  2. ICML 2026
    Q-Delta: Beyond Key–Value Associative State Evolution
    Sumin Park, Seojin Kim, Noseong Park
    Query-aware delta rule for linear attention that uses mixed key–query prediction errors, enabling richer, jointly corrective state evolution dynamics
    Linear Attention SSMs LLMs
  3. ICML 2026
    STAR: Rethinking MoE Routing as Structure-Aware Subspace Learning
    Sumin Park, Noseong Park
    Input-aware MoE routing based on incremental subspace learning for evolving input representation
    MoE Representation LLMs
  4. AAAI 2026
    How Many Experts Are Enough? Towards Optimal Semantic Specialization for Mixture-of-Experts
    Sumin Park, Noseong Park
    Adaptive MoE expansion mechanism based on gradient-guided semantic drift signals
    Adaptive MoE Expert Expansion
  5. ICML 2024
    PANDA: Expanded Width-Aware Message Passing Beyond Rewiring
    Jeongwhan Choi, Sumin Park, Hyowon Wi, Sung-Bae Cho, Noseong Park
    Expanded width-aware message passing for GNNs to address the over-squashing problem
    GNNs Message-Passing