From image to report: automating lung cancer screening interpretation and reporting with vision-language models.

Aokun Chen

Tien-Yu Chang Qinglin Gou Leyi Zhao Tiancheng Zhou Hongyu Chen Dong Yang 0005 Huiwen Ju Kaleb E. Smith Chengkun Sun Jinqian Pan Yu Huang 0018 Xing He 0003 Xuhong Zhang 0001 Daguang Xu Jie Xu 0012 Jiang Bian 0001 Aokun Chen From image to report: automating lung cancer screening interpretation and reporting with vision-language models. 104931 2025 171 J. Biomed. Informatics https://doi.org/10.1016/j.jbi.2025.104931 db/journals/jbi/jbi171.html#ChangGZZCYJSSPHHZXXBC25 streams/journals/jbi

Qianqian Xie Qingyu Chen 0001 Aokun Chen Cheng Peng 0009 Yan Hu Fongci Lin Xueqing Peng Jimin Huang Jeffrey Zhang 0010 Vipina Kuttichi Keloth Xinyu Zhou Lingfei Qian Huan He Dennis L. Shung Lucila Ohno-Machado Yonghui Wu 0001 Hua Xu 0001 Jiang Bian 0001 Medical foundation large language models for comprehensive text analysis and beyond. 2025 8 npj Digit. Medicine 1 https://doi.org/10.1038/s41746-025-01533-1 db/journals/npjdm/npjdm8.html#XieCCPHLPHZKZQHSOWXB25 streams/journals/npjdm

Leona Cilar Budler Hongyu Chen Aokun Chen Maxim Topaz Wilson Tam Jiang Bian 0001 Gregor Stiglic A Brief Review on Benchmarking for Large Language Models Evaluation in Healthcare. 2025 June 15 WIREs Data. Mining. Knowl. Discov. 2 https://doi.org/10.1002/widm.70010 db/journals/widm/widm15.html#BudlerCCTTBS25 streams/journals/widm

Hongyu Chen Lingfei Qian Xing He 0003 Aokun Chen Yu Huang 0018 Qinling Gou Yuxuan Wang Yan Wang 0015 Xuguang Ai Yujia Zhou 0003 Inessa Cohen Qingyu Chen 0001 Hua Xu 0001 Jiang Bian 0001 Clinical Trial Eligibility Criteria Decomposition and Parsing with Large Language Models. 688-692 2025 MedInfo https://doi.org/10.3233/SHTI250928 conf/medinfo/2025 db/conf/medinfo/medinfo2025.html#ChenQ0C0GWWAZCC25 Amin Dada Amanda Butler Contreras Constantin Seibold Osman Alperen Koras Julius Keyl Aokun Chen Cheng Peng 0009 Alexander Brehmer Kaleb E. Smith Jiang Bian 0001 Yonghui Wu 0001 Jens Kleesiek Improving Medical Visual Instruction Tuning with Labeled Datasets. 87-97 2025 MedAGI https://doi.org/10.1007/978-3-032-07845-2_9 conf/miccai/2025medagi db/conf/miccai/medagi2025.html#DadaCSKKCPBSBWK25 streams/conf/miccai

Aokun Chen Yunpeng Zhao Yi Zheng Hui Hu Xia Hu 0001 Jennifer N. Fishe William R. Hogan Elizabeth A. Shenkman Yi Guo 0005 Jiang Bian 0001 Exploring the Relation between Contextual Social Determinants of Health and COVID-19 Occurrence and Hospitalization. 4 2024 11 Informatics https://doi.org/10.3390/informatics11010004 db/journals/informatics/informatics11.html#ChenZZHHFHSGB24

Cheng Peng 0009 Xi Yang 0015 Aokun Chen Zehao Yu 0001 Kaleb E. Smith Anthony B. Costa Mona G. Flores Jiang Bian 0001 Yonghui Wu 0001 Generative large language models are all-purpose text analytics engines: text-to-text learning is all your need. 1892-1903 2024 31 J. Am. Medical Informatics Assoc. 9 https://doi.org/10.1093/jamia/ocae078 db/journals/jamia/jamia31.html#PengYCYSCFBW24 streams/journals/jamia

Cheng Peng 0009 Xi Yang 0015 Kaleb E. Smith Zehao Yu 0001 Aokun Chen Jiang Bian 0001 Yonghui Wu 0001 Model tuning or prompt Tuning? a study of large language models for clinical concept and relation extraction. 104630 2024 153 J. Biomed. Informatics https://doi.org/10.1016/j.jbi.2024.104630 db/journals/jbi/jbi153.html#PengYSYCBW24

Shuang Yang Xi Yang 0015 Tianchen Lyu James L. Huang Aokun Chen Xing He 0003 Dejana Braithwaite Hiren J. Mehta Yonghui Wu 0001 Yi Guo 0005 Jiang Bian 0001 Extracting Pulmonary Nodules and Nodule Characteristics from Radiology Reports of Lung Cancer Screening Patients Using Transformer Models. 463-477 2024 September 8 J. Heal. Informatics Res. 3 https://doi.org/10.1007/s41666-024-00166-5 db/journals/jhir/jhir8.html#YangYLHCHBMWGB24 streams/journals/jhir

Mengxian Lyu Cheng Peng 0009 Daniel Paredes Ziyi Chen Aokun Chen Jiang Bian 0001 Yonghui Wu 0001 UF-HOBI at "Discharge Me!": A Hybrid Solution for Discharge Summary Generation Through Prompt-based Tuning of GatorTronGPT Models. 685-695 2024 BioNLP@ACL https://doi.org/10.18653/v1/2024.bionlp-1.60 https://aclanthology.org/2024.bionlp-1.60 conf/bionlp/2024 db/conf/bionlp/bionlp2024.html#LyuPPCCBW24 streams/conf/bionlp Aokun Chen Daniel Paredes Zehao Yu 0001 Xiwei Lou Roberta Brunson Jamie N. Thomas Kimberly A. Martinez Robert J. Lucero Tanja Magoc Laurence M. Solberg Urszula Alina Snigurska Sarah E. Ser Mattia Prosperi Jiang Bian 0001 Ragnhildur I. Bjarnadottir Yonghui Wu 0001 Identifying Symptoms of Delirium from Clinical Narratives Using Natural Language Processing. 305-311 2024 ICHI https://doi.org/10.1109/ICHI61247.2024.00046 conf/ichi/2024 db/conf/ichi/ichi2024.html#ChenPYLBTMLMSSS24

Qianqian Xie Qingyu Chen 0001 Aokun Chen Cheng Peng 0009 Yan Hu Fongci Lin Xueqing Peng Jimin Huang Jeffrey Zhang 0010 Vipina Kuttichi Keloth Xingyu Zhou Huan He Lucila Ohno-Machado Yonghui Wu 0001 Hua Xu 0001 Jiang Bian 0001 Me LLaMA: Foundation Large Language Models for Medical Applications. 2024 abs/2402.12749 CoRR https://doi.org/10.48550/arXiv.2402.12749 db/journals/corr/corr2402.html#abs-2402-12749

Aokun Chen Qian Li 0034 Yu Huang 0018 Yongqiu Li Yu-Neng Chuang Xia Hu 0001 Serena Guo Yonghui Wu 0001 Yi Guo 0005 Jiang Bian 0001 Feasibility of Identifying Factors Related to Alzheimer's Disease and Related Dementia in Real-World Data. 2024 abs/2402.15515 CoRR https://doi.org/10.48550/arXiv.2402.15515 db/journals/corr/corr2402.html#abs-2402-15515

Mengxian Lyu Cheng Peng 0009 Daniel Paredes Ziyi Chen Aokun Chen Jiang Bian 0001 Yonghui Wu 0001 UF-HOBI at "Discharge Me!": A Hybrid Solution for Discharge Summary Generation Through Prompt-based Tuning of GatorTronGPT Models. 2024 abs/2407.15359 CoRR https://doi.org/10.48550/arXiv.2407.15359 db/journals/corr/corr2407.html#abs-2407-15359 streams/journals/corr

Aokun Chen Zehao Yu 0001 Xi Yang 0015 Yi Guo 0005 Jiang Bian 0001 Yonghui Wu 0001 Contextualized medication information extraction using Transformer-based deep learning architectures. 104370 2023 June 142 J. Biomed. Informatics https://doi.org/10.1016/j.jbi.2023.104370 db/journals/jbi/jbi142.html#ChenYYGBW23

Cheng Peng 0009 Xi Yang 0015 Aokun Chen Kaleb E. Smith Nima M. Pournejatian Anthony B. Costa Cheryl Martin 0002 Mona G. Flores Ying Zhang 0079 Tanja Magoc Gloria P. Lipori Duane A. Mitchell Naykky Singh Ospina Mustafa M. Ahmed William R. Hogan Elizabeth A. Shenkman Yi Guo 0005 Jiang Bian 0001 Yonghui Wu 0001 A study of generative large language model for medical research and healthcare. 2023 6 npj Digit. Medicine https://doi.org/10.1038/s41746-023-00958-w db/journals/npjdm/npjdm6.html#PengYCSPCMFZMLMOAHSGBW23

Amin Dada Aokun Chen Cheng Peng 0009 Kaleb E. Smith Ahmad Idrissi-Yaghir Constantin Seibold Jianning Li 0002 Lars Heiliger Christoph M. Friedrich Daniel Truhn Jan Egger Jiang Bian 0001 Jens Kleesiek Yonghui Wu 0001 On the Impact of Cross-Domain Data on German Language Models. 13801-13813 2023 EMNLP (Findings) https://doi.org/10.18653/v1/2023.findings-emnlp.922 https://aclanthology.org/2023.findings-emnlp.922 conf/emnlp/2023f db/conf/emnlp/emnlp2023f.html#DadaCPSISLHFTEB23 Aokun Chen Qian Li 0034 Elizabeth Shenkman Yonghui Wu 0001 Yi Guo 0005 Jiang Bian 0001 Exploring the Effect of Eligibility Criteria on AD Severity and Severe Adverse Event in Eligible Patients. 756-759 2023 ICHI https://doi.org/10.1109/ICHI57859.2023.00139 conf/ichi/2023 db/conf/ichi/ichi2023.html#ChenLSWGB23

Aokun Chen Zehao Yu 0001 Xi Yang 0015 Yi Guo 0005 Jiang Bian 0001 Yonghui Wu 0001 Contextualized Medication Information Extraction Using Transformer-based Deep Learning Architectures. 2023 abs/2303.08259 CoRR https://doi.org/10.48550/arXiv.2303.08259 db/journals/corr/corr2303.html#abs-2303-08259

Aokun Chen Daniel Paredes Zehao Yu 0001 Xiwei Lou Roberta Brunson Jamie N. Thomas Kimberly A. Martinez Robert J. Lucero Tanja Magoc Laurence M. Solberg Urszula Alina Snigurska Sarah E. Ser Mattia Prosperi Jiang Bian 0001 Ragnhildur I. Bjarnadottir Yonghui Wu 0001 Identifying Symptoms of Delirium from Clinical Narratives Using Natural Language Processing. 2023 abs/2304.00111 CoRR https://doi.org/10.48550/arXiv.2304.00111 db/journals/corr/corr2304.html#abs-2304-00111

Cheng Peng 0009 Xi Yang 0015 Aokun Chen Kaleb E. Smith Nima M. Pournejatian Anthony B. Costa Cheryl Martin 0002 Mona G. Flores Ying Zhang 0079 Tanja Magoc Gloria P. Lipori Duane A. Mitchell Naykky Singh Ospina Mustafa M. Ahmed William R. Hogan Elizabeth Shenkman Yi Guo 0005 Jiang Bian 0001 Yonghui Wu 0001 A Study of Generative Large Language Model for Medical Research and Healthcare. 2023 abs/2305.13523 CoRR https://doi.org/10.48550/arXiv.2305.13523 db/journals/corr/corr2305.html#abs-2305-13523

Cheng Peng 0009 Xi Yang 0015 Kaleb E. Smith Zehao Yu 0001 Aokun Chen Jiang Bian 0001 Yonghui Wu 0001 Model Tuning or Prompt Tuning? A Study of Large Language Models for Clinical Concept and Relation Extraction. 2023 abs/2310.06239 CoRR https://doi.org/10.48550/arXiv.2310.06239 db/journals/corr/corr2310.html#abs-2310-06239

Amin Dada Aokun Chen Cheng Peng 0009 Kaleb E. Smith Ahmad Idrissi-Yaghir Constantin Marc Seibold Jianning Li 0002 Lars Heiliger Xi Yang 0015 Christoph M. Friedrich Daniel Truhn Jan Egger Jiang Bian 0001 Jens Kleesiek Yonghui Wu 0001 On the Impact of Cross-Domain Data on German Language Models. 2023 abs/2310.07321 CoRR https://doi.org/10.48550/arXiv.2310.07321 db/journals/corr/corr2310.html#abs-2310-07321

Cheng Peng 0009 Xi Yang 0015 Aokun Chen Zehao Yu 0001 Kaleb E. Smith Anthony B. Costa Mona G. Flores Jiang Bian 0001 Yonghui Wu 0001 Generative Large Language Models Are All-purpose Text Analytics Engines: Text-to-text Learning Is All Your Need. 2023 abs/2312.06099 CoRR https://doi.org/10.48550/arXiv.2312.06099 db/journals/corr/corr2312.html#abs-2312-06099

Xi Yang 0015 Aokun Chen Nima M. Pournejatian Hoo Chang Shin Kaleb E. Smith Christopher Parisien Colin Compas Cheryl Martin 0002 Anthony B. Costa Mona G. Flores Ying Zhang 0079 Tanja Magoc Christopher A. Harle Gloria P. Lipori Duane A. Mitchell William R. Hogan Elizabeth A. Shenkman Jiang Bian 0001 Yonghui Wu 0001 A large language model for electronic health records. 2022 5 npj Digit. Medicine https://doi.org/10.1038/s41746-022-00742-2 https://www.wikidata.org/entity/Q116459843 db/journals/npjdm/npjdm5.html#0015CPSSPC0CFZM22

Luiz Giovanini Fabrício Ceschin Mirela Silva Aokun Chen Ramchandra Kulkarni Sanjay Banda Madison Lysaght Heng Qiao Nikolaos Sapountzis Ruimin Sun Brandon Matthews Dapeng Oliver Wu André Grégio Daniela Oliveira 0001 Online Binary Models are Promising for Distinguishing Temporally Consistent Computer Usage Profiles. 412-423 2022 4 IEEE Trans. Biom. Behav. Identity Sci. 3 https://doi.org/10.1109/TBIOM.2022.3179206 db/journals/tbbis/tbbis4.html#GiovaniniCSCKBL22

Ruimin Sun Xiaoyong Yuan Pan He Qile Zhu Aokun Chen André Grégio Daniela Oliveira 0001 Xiaolin Li 0001 Learning Fast and Slow: Propedeutica for Real-Time Malware Detection. 2518-2529 2022 33 IEEE Trans. Neural Networks Learn. Syst. 6 https://doi.org/10.1109/TNNLS.2021.3121248 https://www.wikidata.org/entity/Q114931762 db/journals/tnn/tnn33.html#SunYHZCGOL22

Aokun Chen Qian Li 0034 Xing He 0003 Michael Jaffee William R. Hogan Fei Wang 0001 Yi Guo 0005 Jiang Bian 0001 Impacts of Eligibility Criteria on Trial Participants' Age in Alzheimer's Disease Clinical Trials. 2022 AMIA https://knowledge.amia.org/76677-amia-1.4637602/f006-1.4642154/f006-1.4642155/101-1.4642441/1149-1.4642438 conf/amia/2022 db/conf/amia/amia2022.html#ChenLHJHW0022

Luiz Giovanini Fabrício Ceschin Mirela Silva Aokun Chen Ramchandra Kulkarni Sanjay Banda Madison Lysaght Heng Qiao Nikolaos Sapountzis Ruimin Sun Brandon Matthews Dapeng Oliver Wu André Grégio Daniela Oliveira 0001 Computer Users Have Unique Yet Temporally Inconsistent Computer Usage Profiles. 2021 abs/2105.09900 CoRR https://arxiv.org/abs/2105.09900 db/journals/corr/corr2105.html#abs-2105-09900

Meisam Navaki Arefi Geoffrey Alexander Hooman Rokham Aokun Chen Michalis Faloutsos Xuetao Wei Daniela Seabra Oliveira Jedidiah R. Crandall FAROS: Illuminating In-memory Injection Attacks via Provenance-Based Whole-System Dynamic Information Flow Tracking. 231-242 2018 DSN https://doi.org/10.1109/DSN.2018.00034 https://doi.ieeecomputersociety.org/10.1109/DSN.2018.00034 conf/dsn/2018 db/conf/dsn/dsn2018.html#ArefiARCFWOC18

Ruimin Sun Xiaoyong Yuan Pan He Qile Zhu Aokun Chen André Grégio Daniela Oliveira 0001 Xiaolin Li 0001 Learning Fast and Slow: PROPEDEUTICA for Real-time Malware Detection. 2017 abs/1712.01145 CoRR http://arxiv.org/abs/1712.01145 db/journals/corr/corr1712.html#abs-1712-01145

Ruimin Sun Andrew Lee Aokun Chen Donald E. Porter Matt Bishop Daniela Oliveira 0001 Bear: A Framework for Understanding Application Sensitivity to OS (Mis) Behavior. 388-399 2016 ISSRE https://doi.org/10.1109/ISSRE.2016.18 https://doi.ieeecomputersociety.org/10.1109/ISSRE.2016.18 conf/issre/2016 db/conf/issre/issre2016.html#SunLCPBO16 Aokun Chen Pratik Prabhanjan Brahma Dapeng Oliver Wu Natalie C. Ebner Brandon Matthews Jedidiah R. Crandall Xuetao Wei Michalis Faloutsos Daniela Oliveira 0001 Cross-layer personalization as a first-class citizen for situation awareness and computer infrastructure security. 23-35 2016 NSPW https://doi.org/10.1145/3011883.3011888 conf/nspw/2016 db/conf/nspw/nspw2016.html#ChenBWEMCWFO16 Mustafa M. Ahmed Xuguang Ai Geoffrey Alexander Meisam Navaki Arefi Sanjay Banda Jiang Bian 0001 Matt Bishop Ragnhildur I. Bjarnadottir Pratik Prabhanjan Brahma Dejana Braithwaite Alexander Brehmer Roberta Brunson Leona Cilar Budler Fabricio CeschinFabrício Ceschin Tien-Yu Chang Hongyu Chen Qingyu Chen 0001 Ziyi Chen Yu-Neng Chuang Inessa Cohen Colin Compas Amanda Butler Contreras Anthony B. Costa Jedidiah R. Crandall Amin Dada Natalie C. Ebner Jan Egger Michalis Faloutsos Jennifer N. Fishe Mona FloresMona G. Flores Christoph M. Friedrich Luiz Giovanini Qinglin Gou Qinling Gou André Ricardo Abed GrégioAndré Grégio Serena Guo Yi Guo 0005 Christopher A. Harle Huan He Pan He Xing He 0003 Lars Heiliger William R. Hogan Hui Hu Xia Ben HuXia Hu 0001 Yan Hu James L. Huang Jimin Huang Yu Huang 0018 Ahmad Idrissi-Yaghir Michael Jaffee Huiwen Ju Vipina Kuttichi Keloth Julius Keyl Jens Kleesiek Osman Alperen Koras Ramchandra Kulkarni Andrew Lee Jianning Li 0002 Qian Li 0034 Xiaolin Li 0001 Yongqiu Li Fongci Lin Gloria P. Lipori Xiwei Lou Robert James LuceroRobert J. Lucero Madison Lysaght Mengxian Lyu Tianchen Lyu Tanja Magoc Cheryl Martin 0002 Kimberly A. Martinez Brandon Matthews Hiren J. Mehta Duane A. Mitchell Lucila Ohno-Machado Daniela Oliveira 0001Daniela Seabra Oliveira Naykky Singh Ospina Jinqian Pan Daniel Paredes Christopher Parisien Cheng Peng 0009 Xueqing Peng Donald E. Porter Nima M. Pournejatian Mattia Prosperi Lingfei Qian Heng Qiao Hooman Rokham Nikolaos Sapountzis Constantin SeiboldConstantin Marc Seibold Sarah E. Ser Elizabeth ShenkmanElizabeth A. Shenkman Hoo Chang Shin Dennis L. Shung Mirela Silva Kaleb E. Smith Urszula Alina Snigurska Laurence M. Solberg Gregor Stiglic Chengkun Sun Ruimin Sun Wilson Tam Jamie N. Thomas Maxim Topaz Daniel Truhn Fei Wang 0001 Yan Wang 0015 Yuxuan Wang Xuetao Wei Dapeng Oliver Wu Yonghui Wu 0001 Qianqian Xie Daguang Xu Hua Xu 0001 Jie Xu 0012 Dong Yang 0005 Shuang Yang Xi Yang 0015 Zehao Yu 0001 Xiaoyong Yuan Jeffrey Zhang 0010 Xuhong Zhang 0001 Ying Zhang 0079 Leyi Zhao Yunpeng Zhao Yi Zheng Tiancheng Zhou Xingyu Zhou Xinyu Zhou Yujia Zhou 0003 Qile Zhu