Skip to content
View bethehand's full-sized avatar

Block or report bethehand

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
bethehand/README.md

Qirun Li

I train language models and measure what the training actually changes. Quant trader since 2018 (co-founded NV Capital); full-time on LLM training research since August 2026. From trading I kept three habits: write the prediction down before the run, put a noise floor on every result, change one thing at a time.

Looking for a model-training role at an AI lab (pretraining, post-training/RL or alignment) and for opportunities to train myself as a researcher. Preparing for a PhD in artificial intelligence. LinkedIn · Hugging Face · qli858246@gmail.com

Research

1. LLM from scratch → the aha moment → a coding agent · complete · report (中文)

Fifteen controlled experiments on 4× RTX 4090, from pretraining 95M/201M models through GRPO and the R1 "aha moment" (Countdown pass@1 .02 → .75) to an RL-trained coding agent. RL raised pass@1 at every stage while pass@32 barely moved: it reorders what the model can already do.

2. looped-scaling · complete · report (中文) · paper

A pre-registered scaling study of looped (recurrent-depth) transformers: 242 language models at 10M–160M. On web text a loop buys parameter efficiency that grows with size (better than dense from 40M on) but no compute efficiency at any scale measured, and decoding is 2.4–2.5× slower. On a synthetic task that needs serial steps it buys depth that extends at inference: more loops, longer chains.

3. olmo-rlvr-side-effects · in progress · setup notes and contributions in olmo-hands-on

Which RLVR training data changes what, outside its own domain? I trace each change to the Olmo 3 post-training stage that made it, measured the way Ai2 measures it; next, small open-instruct runs will test which data causes it. So far: Ai2's safety numbers for the Olmo 3 7B Think stages, replicated within 1 point, plus their run-to-run noise (open-instruct #1964); answer length, where DPO adds most of it (#2002). Independent work, not affiliated with Ai2.

4. lora-posttrain · complete · report (中文)

Teaching Ai2's Olmo 3 7B Instruct my own quant research loop (idea → factor formula → backtest → revise), with LoRA on 4× RTX 4090 and pre-registered tests: one adapter carried through four stages, SFT twice and then offline and online RL. On idea families it never saw, SFT widens what the model can do (pass@4: 0% → 90%) and RL sharpens it (pass@1: 44% → 66–71%, while pass@4 holds at about 90%). Picking the best-backtested of four answers that pass the checks adds +0.0041 incremental IC on new ideas over a sealed year of market data. Earlier chapters audit and rerun Prime Intellect's wiki-search RL on Qwen3-4B and Olmo 3 7B.

Pinned Loading

  1. lab1-llm-scratch-to-aha-moment-to-coding-agent lab1-llm-scratch-to-aha-moment-to-coding-agent Public

    15 controlled experiments on 4×4090: pretraining from scratch, SFT, GRPO, the R1 "aha moment", and a coding-agent RL curriculum

    Python

  2. looped-scaling looped-scaling Public

    What a loop buys: parameter efficiency on text, extendable depth on a serial task. A pre-registered scaling study of looped (recurrent-depth) transformers from 10M to 160M, with a synthetic test of…

    Python

  3. marin-hero-forecast marin-hero-forecast Public

    Independent, pre-registered forecast (with 80/95% intervals) of the Marin 535B-A23B hero run's final loss

    Python

  4. olmo-rlvr-side-effects olmo-rlvr-side-effects Public

    Which RLVR training data changes what, outside the training domain? Measured on Ai2's open Olmo checkpoints and my own open-instruct runs.

    Python 1

  5. dolos-alignment-audit dolos-alignment-audit Public

    Alignment audit of the Dolos-1.5B model organism: finding an implanted JSON-sabotage behaviour, tracing it to a circuit in the fine-tuning deltas, and auditing for it without the base model

    Python

  6. lora-posttrain lora-posttrain Public

    Post-training small open models with LoRA (SFT + RL) on 4x RTX 4090, with held-out, pre-registered evaluation

    Python