Skip to content
View xiaofengShi's full-sized avatar
🎯
Focusing
🎯
Focusing

Block or report xiaofengShi

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
xiaofengShi/README.md

Xiaofeng Shi

AI Researcher & Engineer @ BAAI
Beijing, China · xfshi@baai.ac.cn

Industry LLMs Post-training Agents RAG Multimodal

Website Google Scholar OpenReview Hugging Face

I am an AI researcher and engineer at the Beijing Academy of Artificial Intelligence (BAAI), with previous experience at ByteDance and Meituan. My work has evolved from computer vision and OCR to large language models, with a current focus on domain adaptation, post-training, agentic systems, retrieval-augmented generation, and multimodal reasoning.

我目前在北京智源人工智能研究院从事 AI 研究与工程工作,曾就职于字节跳动和美团。我的研究关注如何让大模型真正进入专业领域:从高质量数据、监督微调和强化学习,到 Agent、RAG 与多模态推理,并尽可能将论文对应的代码、模型和数据开放出来。

Research Interests

  • Domain LLMs & post-training: data construction, supervised fine-tuning, reinforcement learning, knowledge adaptation, and capability retention
  • AI agents & retrieval: academic search, scientific survey generation, agentic RAG, and long-horizon knowledge workflows
  • Multimodal reasoning: visual-language models, technical drawing understanding, cross-chart reasoning, and OCR
  • Open data & models: multilingual industry corpora, instruction datasets, domain models, benchmarks, and reproducible evaluation

Selected Research

Year / Venue Work Focus Resources
2026 Wnuan (first author / equal contribution) Staged post-training for QA over proprietary enterprise knowledge, combining task-oriented supervision, SFT with general-data replay, and RL on residual errors Paper
ICML 2026 MechVQA / MechVL (co-first & corresponding author) A benchmark with 3.3K mechanical drawings and 21K QA pairs, plus a domain-specialized multimodal model trained with SFT and self-play RL Paper Code Models and Data
2026 RAFT (co-first & corresponding author) Data refinement and adaptive on-policy distillation for domain fine-tuning while alleviating general-capability forgetting Paper
2026 ChartWalker (corresponding author) A cross-chart RAG benchmark built with hierarchical knowledge graphs, structure-aware multi-hop sampling, and an agentic baseline Paper
2025 SFTKey (first author) A two-stage SFT method that explicitly emphasizes answer-relevant tokens after learning the reasoning and output format Paper
2025 SPAR / SPARBench (first author) A multi-agent scholarly retrieval framework using query decomposition, query evolution, and citation-aware exploration Paper Code Dataset
2025 SciSage / SurveyScope (first author) Multi-agent scientific survey generation with hierarchical reflection and a benchmark for evaluating research surveys Paper Code
AAAI 2025 CareBot A full-process open-source medical language model covering continual pre-training, SFT, preference alignment, and evaluation Paper Models
COLING 2025 MoSLD A parameter-efficient mixture of shared LoRAs for multi-task learning and out-of-domain generalization Paper
2024 CCI3.0-HQ A high-quality 500GB Chinese pre-training corpus produced through a two-stage hybrid filtering pipeline Paper Dataset
2024 Aquila-Med A bilingual medical LLM with open continual pre-training, SFT, preference-alignment data, and training recipes Paper Models

Open Models & Data

  • IndustryCorpus2 Multilingual, multi-industry pre-training corpora with accompanying data-rating and classification models
  • Industry Instruction A 2.7M-sample multilingual, multi-industry instruction collection with domain-adapted models
  • IndustryCorpus Open pre-training corpora spanning finance, medicine, law, education, technology, and other industries
  • XiaofengAlg MechVL, CareBot, industry-specific LLMs, MechVQA, SPARBench, and related research releases

Earlier Open Source

  • CHINESE-OCR An end-to-end natural-scene Chinese text detection and recognition pipeline built with CTPN, CRNN, and CTC
  • Image2Katex Image-to-LaTeX recognition for printed and handwritten mathematical formulas
  • DKT-TensorFlow A Deep Knowledge Tracing implementation for adaptive learning

Connect

Research discussions and open-source collaboration are welcome.

Email Xiaofeng GitHub Issues

Pinned Loading

  1. CHINESE-OCR CHINESE-OCR Public

    [python3.6] 运用tf实现自然场景文字检测,keras/pytorch实现ctpn+crnn+ctc实现不定长场景文字OCR识别

    Python 3k 941

  2. SPAR SPAR Public

    Python 27 8

  3. MechVQA MechVQA Public

    MechVQA: https://icml.cc/virtual/2026/poster/66437 | https://arxiv.org/abs/2605.30794

    Python 18 1