{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T13:24:21Z","timestamp":1777555461266,"version":"3.51.4"},"publisher-location":"California","reference-count":0,"publisher":"International Joint Conferences on Artificial Intelligence Organization","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,9]]},"abstract":"<jats:p>Large language models (LLMs) have achieved remarkable successes on various tasks. However, recent studies have found that there are still significant challenges to the logical reasoning abilities of LLMs, which can be categorized into the following two aspects: (1) Logical question answering: LLMs often fail to generate the correct answer within a complex logical problem which requires sophisticated deductive, inductive or abductive reasoning given a collection of premises and constrains. (2) Logical consistency: LLMs are prone to producing responses contradicting themselves across different questions. For example, a state-of-the-art question-answering LLM Macaw, answers Yes to both questions Is a magpie a bird? and Does a bird have wings? but answers No to Does a magpie have wings?. To facilitate this research direction, we comprehensively investigate the most cutting-edge methods and propose a detailed taxonomy. Specifically, to accurately answer complex logic questions, previous methods can be categorized based on reliance on external solvers, prompts, and fine-tuning. To avoid logical contradictions, we discuss concepts and solutions of various logical consistencies, including implication, negation, transitivity, factuality consistencies, and their composites. In addition, we review commonly used benchmark datasets and evaluation metrics, and discuss promising research directions, such as extending to modal logic to account for uncertainty and developing efficient algorithms that simultaneously satisfy multiple logical consistencies.<\/jats:p>","DOI":"10.24963\/ijcai.2025\/1155","type":"proceedings-article","created":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T08:10:40Z","timestamp":1758269440000},"page":"10400-10408","source":"Crossref","is-referenced-by-count":13,"title":["Empowering LLMs with Logical Reasoning: A Comprehensive Survey"],"prefix":"10.24963","author":[{"given":"Fengxiang","family":"Cheng","sequence":"first","affiliation":[{"name":"Institute for Logic, Language and Computation, University of Amsterdam"}]},{"given":"Haoxuan","family":"Li","sequence":"additional","affiliation":[{"name":"Center for Data Science, Peking University"},{"name":"Tsinghua-UvA JRC for Logic, Department of Philosophy, Tsinghua University"},{"name":"Machine Learning Department, MBZUAI"}]},{"given":"Fenrong","family":"Liu","sequence":"additional","affiliation":[{"name":"Tsinghua-UvA JRC for Logic, Department of Philosophy, Tsinghua University"},{"name":"Institute for Logic, Language and Computation, University of Amsterdam"}]},{"given":"Robert","family":"van Rooij","sequence":"additional","affiliation":[{"name":"Institute for Logic, Language and Computation, University of Amsterdam"}]},{"given":"Kun","family":"Zhang","sequence":"additional","affiliation":[{"name":"Machine Learning Department, MBZUAI"},{"name":"Department of Philosophy, CMU"}]},{"given":"Zhouchen","family":"Lin","sequence":"additional","affiliation":[{"name":"State Key Lab of General AI, School of Intelligence Science and Technology, Peking University"},{"name":"Institute for Artificial Intelligence, Peking University"},{"name":"Pazhou Laboratory (Huangpu), Guangzhou"}]}],"member":"10584","event":{"name":"Thirty-Fourth International Joint Conference on Artificial Intelligence {IJCAI-25}","theme":"Artificial Intelligence","location":"Montreal, Canada","acronym":"IJCAI-2025","number":"34","sponsor":["International Joint Conferences on Artificial Intelligence Organization (IJCAI)"],"start":{"date-parts":[[2025,8,16]]},"end":{"date-parts":[[2025,8,22]]}},"container-title":["Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence"],"original-title":[],"deposited":{"date-parts":[[2025,9,23]],"date-time":"2025-09-23T11:36:18Z","timestamp":1758627378000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ijcai.org\/proceedings\/2025\/1155"}},"subtitle":[],"proceedings-subject":"Artificial Intelligence Research Articles","short-title":[],"issued":{"date-parts":[[2025,9]]},"references-count":0,"URL":"https:\/\/doi.org\/10.24963\/ijcai.2025\/1155","relation":{},"subject":[],"published":{"date-parts":[[2025,9]]}}}