CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation.

Weixiang Yan Haitian Liu Yunkun Wang Yunzhe Li 0001 Qian Chen 0003 Wen Wang 0001 Tingyu Lin 0002 Weishan Zhao Li Zhu Hari Sundaram Shuiguang Deng CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation. 5511-5558 2024 ACL (1) https://doi.org/10.18653/v1/2024.acl-long.301 https://aclanthology.org/2024.acl-long.301 https://www.wikidata.org/entity/Q131457932 conf/acl/2024-1 db/conf/acl/acl2024-1.html#YanLWL0W0ZZSD24