Pinned Loading

1. BabyJay BabyJay Public

   Backend files of Babyjay. An AI Chat_Bot.

   Python

2. gated-attention-repro gated-attention-repro Public

   Reproduction of the NeurIPS 2025 Best Paper 'Gated Attention for LLMs' — baseline vs gated on TinyShakespeare & enwik8, with results and analysis.

   Python

3. highway-rl highway-rl Public

   Deep RL self-driving agent — PPO on highway-env. ~80km/h, 0% collisions. Live TensorBoard video, behavioral eval, constrained-RL speed limits.

   Python

4. nsa-mini nsa-mini Public

   From-scratch Native Sparse Attention (DeepSeek, arXiv:2502.11089): PyTorch reference + Triton kernels, benchmarked vs FlashAttention-2 and validated on A100. 22x faster window kernel at 64k; qualit…

   Python

5. pavansaipendry.github.io pavansaipendry.github.io Public

   ME!

   TypeScript

6. reasoning-slm reasoning-slm Public

   A math/code reasoning small language model trained end-to-end on my own stack: data pipeline -> pretraining (gated + NSA sparse attention) -> SFT -> GRPO RL -> served on a from-scratch inference en…

   Python