Context-Aware Language Understanding in Human-Robot Dialogue with LLMs.

Simon Keizer Svetlana Stoyanchev Youmna Farag Simon Keizer Mohan Li Rama Sanand Doddipatla Context-Aware Language Understanding in Human-Robot Dialogue with LLMs. IWSLT 2026 262-274 conf/iwslt/2026 https://aclanthology.org/2026.iwsds-1.27/ db/conf/iwslt/iwslt2026.html#StoyanchevFKLD26 streams/conf/iwslt

Youmna Farag Svetlana Stoyanchev Mohan Li Simon Keizer Rama Doddipatla Conditional Multi-Stage Failure Recovery for Embodied Agents. 2025 July abs/2507.06016 CoRR https://doi.org/10.48550/arXiv.2507.06016 db/journals/corr/corr2507.html#abs-2507-06016 streams/journals/corr

Alejandro Santorum Varela Svetlana Stoyanchev Simon Keizer Rama Doddipatla Kate M. Knill Entity Resolution in Situated Dialog With Unimodal and Multimodal Transformers. 704-713 2024 32 IEEE ACM Trans. Audio Speech Lang. Process. https://doi.org/10.1109/TASLP.2023.3304468 db/journals/taslp/taslp32.html#VarelaSKDK24

Mohan Li Simon Keizer Rama Doddipatla Prompting Whisper for QA-driven Zero-shot End-to-end Spoken Language Understanding. 2024 INTERSPEECH https://doi.org/10.21437/Interspeech.2024-26 conf/interspeech/2024 db/conf/interspeech/interspeech2024.html#LiKD24 Mohan Li Cong-Thanh Do Simon Keizer Youmna Farag Svetlana Stoyanchev Rama Doddipatla WHISMA: A Speech-LLM to Perform Zero-Shot Spoken Language Understanding. 1115-1122 2024 SLT https://doi.org/10.1109/SLT61566.2024.10832156 conf/slt/2024 db/conf/slt/slt2024.html#LiDKFSD24 streams/conf/slt

Mohan Li Cong-Thanh Do Simon Keizer Youmna Farag Svetlana Stoyanchev Rama Doddipatla WHISMA: A Speech-LLM to Perform Zero-shot Spoken Language Understanding. 2024 abs/2408.16423 CoRR https://doi.org/10.48550/arXiv.2408.16423 db/journals/corr/corr2408.html#abs-2408-16423 streams/journals/corr

Norbert Braunschweiler Rama Sanand Doddipatla Simon Keizer Svetlana Stoyanchev Enabling Semi-Structured Knowledge Access via a Question-Answering Module in Task-oriented Dialogue Systems. 36:1-36:11 2023 CUI https://doi.org/10.1145/3571884.3597138 conf/cui/2023 db/conf/cui/cui2023.html#BraunschweilerD23

Simon Keizer Caroline Dockes Norbert Braunschweiler Svetlana Stoyanchev Rama Doddipatla Adversarial learning of neural user simulators for dialogue policy optimisation. 2023 abs/2306.00858 CoRR https://doi.org/10.48550/arXiv.2306.00858 db/journals/corr/corr2306.html#abs-2306-00858

Norbert Braunschweiler Rama Doddipatla Simon Keizer Svetlana Stoyanchev Evaluating Large Language Models for Document-grounded Response Generation in Information-Seeking Dialogues. 2023 abs/2309.11838 CoRR https://doi.org/10.48550/arXiv.2309.11838 db/journals/corr/corr2309.html#abs-2309-11838

Norbert Braunschweiler Rama Doddipatla Simon Keizer Svetlana Stoyanchev Factors in Emotion Recognition With Deep Learning Models Using Speech and Text on Multiple Corpora. 722-726 2022 29 IEEE Signal Process. Lett. https://doi.org/10.1109/lsp.2022.3151551 db/journals/spl/spl29.html#BraunschweilerDKS22

Svetlana Stoyanchev Suraj Pandey Simon Keizer Norbert Braunschweiler Rama Sanand Doddipatla Combining Structured and Unstructured Knowledge in an Interactive Search Dialogue System. 531-540 2022 SIGDIAL https://doi.org/10.18653/v1/2022.sigdial-1.50 https://aclanthology.org/2022.sigdial-1.50 conf/sigdial/2022 db/conf/sigdial/sigdial2022.html#StoyanchevPKBD22

Norbert Braunschweiler Rama Doddipatla Simon Keizer Svetlana Stoyanchev A study on cross-corpus speech emotion recognition and data augmentation. 2022 abs/2201.03511 CoRR https://arxiv.org/abs/2201.03511 db/journals/corr/corr2201.html#abs-2201-03511

Simon Keizer Norbert Braunschweiler Svetlana Stoyanchev Rama Doddipatla Dialogue Strategy Adaptation to New Action Sets Using Multi-dimensional Modelling. 2022 abs/2204.07082 CoRR https://doi.org/10.48550/arXiv.2204.07082 db/journals/corr/corr2204.html#abs-2204-07082

Norbert Braunschweiler Rama Doddipatla Simon Keizer Svetlana Stoyanchev A Study on Cross-Corpus Speech Emotion Recognition and Data Augmentation. 24-30 2021 ASRU https://doi.org/10.1109/ASRU51503.2021.9687987 conf/asru/2021 db/conf/asru/asru2021.html#BraunschweilerD21 Simon Keizer Norbert Braunschweiler Svetlana Stoyanchev Rama Doddipatla Dialogue Strategy Adaptation to New Action Sets Using Multi-Dimensional Modelling. 977-983 2021 ASRU https://doi.org/10.1109/ASRU51503.2021.9688038 conf/asru/2021 db/conf/asru/asru2021.html#KeizerBSD21 Svetlana Stoyanchev Simon Keizer Rama Doddipatla Action State Update Approach to Dialogue Management. 7398-7402 2021 ICASSP https://doi.org/10.1109/ICASSP39728.2021.9414888 conf/icassp/2021 db/conf/icassp/icassp2021.html#StoyanchevKD21 Harry Bunt Volha Petukhova Emer Gilmartin Catherine Pelachaud Alex Chengyu Fang Simon Keizer Laurent Prévot 0001 The ISO Standard for Dialogue Act Annotation, Second Edition. 549-558 2020 LREC https://aclanthology.org/2020.lrec-1.69/ conf/lrec/2020 db/conf/lrec/lrec2020.html#BuntPGPFKP20

Svetlana Stoyanchev Simon Keizer Rama Doddipatla Action State Update Approach to Dialogue Management. 2020 abs/2011.04637 CoRR https://arxiv.org/abs/2011.04637 db/journals/corr/corr2011.html#abs-2011-04637

Simon Keizer Ondrej Dusek Xingkun Liu Verena Rieser User Evaluation of a Multi-dimensional Statistical Dialogue System. 392-398 2019 SIGdial https://doi.org/10.18653/v1/W19-5945 conf/sigdial/2019 db/conf/sigdial/sigdial2019.html#KeizerDLR19

Simon Keizer Ondrej Dusek Xingkun Liu Verena Rieser User Evaluation of a Multi-dimensional Statistical Dialogue System. 2019 abs/1909.02965 CoRR http://arxiv.org/abs/1909.02965 db/journals/corr/corr1909.html#abs-1909-02965

Simon Keizer Verena Rieser Towards Learning Transferable Conversational Skills using Multi-dimensional Dialogue Modelling. 2018 abs/1804.00146 CoRR http://arxiv.org/abs/1804.00146 db/journals/corr/corr1804.html#abs-1804-00146

Simon Keizer Markus Guhe Heriberto Cuayáhuitl Ioannis Efstathiou Klaus-Peter Engelbrecht Mihai Sorin Dobre Alex Lascarides Oliver Lemon Evaluating Persuasion Strategies and Deep Reinforcement Learning methods for Negotiation Dialogue agents. 480-484 2017 EACL (2) https://doi.org/10.18653/v1/e17-2077 https://aclanthology.org/E17-2077/ conf/eacl/2017-2 db/conf/eacl/eacl2017-2.html#LascaridesLGKCE17 Helen F. Hastie Heriberto Cuayáhuitl Nina Dethlefs Simon Keizer Xingkun Liu Extrinsic Versus Intrinsic Evaluation of Natural Language Generation for Spoken Dialogue Systems and Social Robotics. 303-311 2016 IWSDS https://doi.org/10.1007/978-981-10-2585-3_24 conf/iwsds/2016 db/conf/iwsds/iwsds2016.html#HastieCDKL16 Heriberto Cuayáhuitl Simon Keizer Oliver Lemon Learning Trading Negotiations Using Manually and Automatically Labelled Data. 904-911 2015 ICTAI https://doi.org/10.1109/ICTAI.2015.131 https://doi.ieeecomputersociety.org/10.1109/ICTAI.2015.131 conf/ictai/2015 db/conf/ictai/ictai2015.html#CuayahuitlKL15 Heriberto Cuayáhuitl Simon Keizer Oliver Lemon Learning to Trade in Strategic Board Games. 83-95 2015 CGW/GIGA@IJCAI https://doi.org/10.1007/978-3-319-39402-2_7 conf/ijcai/2015cgw db/conf/ijcai/cgw2015.html#CuayahuitlKL15

Heriberto Cuayáhuitl Simon Keizer Oliver Lemon Strategic Dialogue Management via Deep Reinforcement Learning. 2015 abs/1511.08099 CoRR http://arxiv.org/abs/1511.08099 db/journals/corr/corr1511.html#CuayahuitlKL15

Paul A. Crook Simon Keizer Zhuoran Wang Wenshuo Tang Oliver Lemon Real user evaluation of a POMDP spoken dialogue system using automatic belief compression. 873-887 2014 28 Comput. Speech Lang. 4 https://doi.org/10.1016/j.csl.2013.12.002 db/journals/csl/csl28.html#CrookKWTL14

Verena Rieser Oliver Lemon Simon Keizer Natural Language Generation as Incremental Planning Under Uncertainty: Adaptive Information Presentation for Statistical Dialogue Systems. 979-993 2014 22 IEEE ACM Trans. Audio Speech Lang. Process. 5 https://doi.org/10.1109/TASL.2014.2315271 db/journals/taslp/taslp22.html#RieserLK14

Simon Keizer Mary Ellen Foster Zhuoran Wang Oliver Lemon Machine Learning for Social Multiparty Human-Robot Interaction. 14:1-14:32 2014 4 ACM Trans. Interact. Intell. Syst. 3 https://doi.org/10.1145/2600021 https://www.wikidata.org/entity/Q59196135 db/journals/tiis/tiis4.html#KeizerFWL14

Mary Ellen Foster Simon Keizer Oliver Lemon Towards action selection under uncertainty for a socially aware robot bartender. 158-159 2014 HRI https://doi.org/10.1145/2559636.2559805 https://ieeexplore.ieee.org/document/8542514 https://www.wikidata.org/entity/Q59196141 conf/hri/2014 db/conf/hri/hri2014.html#FosterKL14 Simon Keizer Mary Ellen Foster Andre Gaschler Manuel Giuliani Amy Isard Oliver Lemon Handling uncertain input in multi-user human-robot interaction. 312-317 2014 RO-MAN https://doi.org/10.1109/ROMAN.2014.6926271 https://www.wikidata.org/entity/Q59196139 conf/ro-man/2014 db/conf/ro-man/ro-man2014.html#KeizerFGGIL14 Simon Keizer Pantelis Kastoris Mary Ellen Foster Amol A. Deshmukh Oliver Lemon Evaluating a social multi-user interaction model using a Nao robot. 318-322 2014 RO-MAN https://doi.org/10.1109/ROMAN.2014.6926272 https://www.wikidata.org/entity/Q59196137 conf/ro-man/2014 db/conf/ro-man/ro-man2014.html#KeizerKFDL14 Simon Keizer Mary Ellen Foster Oliver Lemon Andre Gaschler Manuel Giuliani Training and evaluation of an MDP model for social multi-user human-robot interaction. 223-232 2013 SIGDIAL Conference https://aclanthology.org/W13-4036/ conf/sigdial/2013 db/conf/sigdial/sigdial2013.html#KeizerFLGG13 Verena Rieser Simon Keizer Oliver Lemon Xingkun Liu Adaptive Information Presentation for Spoken Dialogue Systems: Evaluation with real users. 102-109 2011 ENLG https://aclanthology.org/W11-2813/ conf/enlg/2011 db/conf/enlg/enlg2011.html#RieserKLL11 Filip Jurcícek Simon Keizer Milica Gasic François Mairesse Blaise Thomson Kai Yu 0004 Steve J. Young Real User Evaluation of Spoken Dialogue Systems Using Amazon Mechanical Turk. 3061-3064 2011 INTERSPEECH conf/interspeech/2011 db/conf/interspeech/interspeech2011.html#JurcicekKGMTYY11 https://doi.org/10.21437/Interspeech.2011-766 Alan W. Black Susanne Burger Alistair Conkie Helen Wright Hastie Simon Keizer Oliver Lemon Nicolas Merigaud Gabriel Parent Gabriel Schubiner Blaise Thomson Jason D. Williams Kai Yu 0004 Steve J. Young Maxine Eskénazi Spoken Dialog Challenge 2010: Comparison of Live and Control Test Results. 2-7 2011 SIGDIAL Conference https://aclanthology.org/W11-2002/ conf/sigdial/2011 db/conf/sigdial/sigdial2011.html#BlackBCHKLMPSTWYYE11 Simon Keizer Harry Bunt Volha Petukhova Multidimensional Dialogue Management. 57-86 2011 Interactive Multi-modal Question-Answering https://doi.org/10.1007/978-3-642-17525-1_4 series/tanlp/BB2011 db/series/tanlp/BB2011.html#KeizerBP11

Steve J. Young Milica Gasic Simon Keizer François Mairesse Jost Schatzmann Blaise Thomson Kai Yu 0004 The Hidden Information State model: A practical framework for POMDP-based spoken dialogue management. 150-174 2010 24 Comput. Speech Lang. 2 https://doi.org/10.1016/j.csl.2009.04.001 db/journals/csl/csl24.html#YoungGKMSTY10

François Mairesse Milica Gasic Filip Jurcícek Simon Keizer Blaise Thomson Kai Yu 0004 Steve J. Young Phrase-Based Statistical Language Generation Using Graphical Models and Active Learning. 1552-1561 2010 ACL https://aclanthology.org/P10-1157/ conf/acl/2010 db/conf/acl/acl2010.html#MairesseGJKTYY10 Filip Jurcícek Blaise Thomson Simon Keizer François Mairesse Milica Gasic Kai Yu 0004 Steve J. Young Natural belief-critic: a reinforcement algorithm for parameter estimation in statistical spoken dialogue systems. 90-93 2010 INTERSPEECH https://doi.org/10.21437/Interspeech.2010-41 conf/interspeech/2010 db/conf/interspeech/interspeech2010.html#JurcicekTKMGYY10 Simon Keizer Milica Gasic Filip Jurcícek François Mairesse Blaise Thomson Kai Yu 0004 Steve J. Young Parameter estimation for agenda-based user simulation. 116-123 2010 SIGDIAL Conference https://aclanthology.org/W10-4323/ conf/sigdial/2010 db/conf/sigdial/sigdial2010.html#KeizerGJMTYY10 Milica Gasic Filip Jurcícek Simon Keizer François Mairesse Blaise Thomson Kai Yu 0004 Steve J. Young Gaussian Processes for Fast Policy Optimisation of POMDP-based Dialogue Managers. 201-204 2010 SIGDIAL Conference https://aclanthology.org/W10-4334/ conf/sigdial/2010 db/conf/sigdial/sigdial2010.html#GasicJKMTYY10 Blaise Thomson Filip Jurcícek Milica Gasic Simon Keizer François Mairesse Kai Yu 0004 Steve J. Young Parameter learning for POMDP spoken dialogue models. 271-276 2010 SLT https://doi.org/10.1109/SLT.2010.5700863 conf/slt/2010 db/conf/slt/slt2010.html#ThomsonJGKMYY10 Blaise Thomson Kai Yu 0004 Simon Keizer Milica Gasic Filip Jurcícek François Mairesse Steve J. Young Bayesian dialogue system for the Let's Go Spoken Dialogue Challenge. 460-465 2010 SLT https://doi.org/10.1109/SLT.2010.5700896 conf/slt/2010 db/conf/slt/slt2010.html#ThomsonYKGJMY10 Milica Gasic Fabrice Lefèvre Filip Jurcícek Simon Keizer François Mairesse Blaise Thomson Kai Yu 0004 Steve J. Young Back-off action selection in summary space-based POMDP dialogue systems. 456-461 2009 ASRU https://doi.org/10.1109/ASRU.2009.5373416 conf/asru/2009 db/conf/asru/asru2009.html#GasicLJKMTYY09 Kai Yu 0004 Tomoki Toda Milica Gasic Simon Keizer François Mairesse Blaise Thomson Steve J. Young Probablistic modelling of F0 in unvoiced regions in HMM based speech synthesis. 3773-3776 2009 ICASSP https://doi.org/10.1109/ICASSP.2009.4960448 https://doi.ieeecomputersociety.org/10.1109/ICASSP.2009.4960448 conf/icassp/2009 db/conf/icassp/icassp2009.html#YuTGKMTY09 François Mairesse Milica Gasic Filip Jurcícek Simon Keizer Blaise Thomson Kai Yu 0004 Steve J. Young Spoken language understanding from unaligned data using discriminative classification models. 4749-4752 2009 ICASSP https://doi.org/10.1109/ICASSP.2009.4960692 https://doi.ieeecomputersociety.org/10.1109/ICASSP.2009.4960692 conf/icassp/2009 db/conf/icassp/icassp2009.html#MairesseGJKTYY09 Filip Jurcícek Milica Gasic Simon Keizer François Mairesse Blaise Thomson Kai Yu 0004 Steve J. Young Transformation-based learning for semantic parsing. 2719-2722 2009 INTERSPEECH https://doi.org/10.21437/Interspeech.2009-695 conf/interspeech/2009 db/conf/interspeech/interspeech2009.html#JurcicekGKMTYY09 Fabrice Lefèvre Milica Gasic Filip Jurcícek Simon Keizer François Mairesse Blaise Thomson Kai Yu 0004 Steve J. Young k-Nearest Neighbor Monte-Carlo Control Algorithm for POMDP-Based Dialogue Systems. 272-275 2009 SIGDIAL Conference https://aclanthology.org/W09-3938/ conf/sigdial/2009 db/conf/sigdial/sigdial2009.html#LefevreGJKMTYY09 Blaise Thomson Milica Gasic Simon Keizer François Mairesse Jost Schatzmann Kai Yu 0004 Steve J. Young User study of the Bayesian update of dialogue state approach to dialogue management. 483-486 2008 INTERSPEECH https://doi.org/10.21437/Interspeech.2008-81 conf/interspeech/2008 db/conf/interspeech/interspeech2008.html#ThomsonGKMSYY08 Blaise Thomson Kai Yu 0004 Milica Gasic Simon Keizer François Mairesse Jost Schatzmann Steve J. Young Evaluating semantic-level confidence scores with multiple hypotheses. 1153-1156 2008 INTERSPEECH https://doi.org/10.21437/Interspeech.2008-350 conf/interspeech/2008 db/conf/interspeech/interspeech2008.html#ThomsonYGKMSY08 Milica Gasic Simon Keizer François Mairesse Jost Schatzmann Blaise Thomson Kai Yu 0004 Steve J. Young Training and Evaluation of the HIS POMDP Dialogue System in Noise. 112-119 2008 SIGDIAL Workshop https://aclanthology.org/W08-0119/ conf/sigdial/2008 db/conf/sigdial/sigdial2008.html#GasicKMSTYY08 Simon Keizer Milica Gasic François Mairesse Blaise Thomson Kai Yu 0004 Steve J. Young Modelling user behaviour in the HIS-POMDP dialogue manager. 121-124 2008 SLT https://doi.org/10.1109/SLT.2008.4777855 conf/slt/2008 db/conf/slt/slt2008.html#KeizerGMTYY08

Simon Keizer Rieks op den Akker Dialogue act recognition under uncertainty using Bayesian networks. 287-316 2007 13 Nat. Lang. Eng. 4 https://doi.org/10.1017/S1351324905004067 db/journals/nle/nle13.html#KeizerA07

Simon Keizer Roser Morante Dialogue Simulation and Context Dynamics for Dialogue Management. 310-317 2007 NODALIDA https://aclanthology.org/W07-2449/ conf/nodalida/2007 db/conf/nodalida/nodalida2007.html#KeizerM07 Simon Keizer Harry Bunt Evaluating Combinations of Dialogue Acts for Generation. 158-165 2007 SIGdial https://doi.org/10.18653/v1/2007.sigdial-1.28 https://aclanthology.org/2007.sigdial-1.28/ conf/sigdial/2007 db/conf/sigdial/sigdial2007.html#KeizerB07 Harry Bunt Roser Morante Simon Keizer An Empirically Based Computational Model of Grounding in Dialogue. 283-290 2007 SIGdial https://doi.org/10.18653/v1/2007.sigdial-1.49 https://aclanthology.org/2007.sigdial-1.49/ conf/sigdial/2007 db/conf/sigdial/sigdial2007.html#BuntMK07 Harry Bunt Simon Keizer Tim Paek Proceedings of the 8th SIGdial Workshop on Discourse and Dialogue, SIGdial 2007, Antwerp, Belgium, September 1-2, 2007 SIGdial Association for Computational Linguistics 2007 9789074029322 https://doi.org/10.18653/v1/2007.sigdial-1.0 https://aclanthology.org/volumes/2007.sigdial-1/ https://aclanthology.org/2007.sigdial-1.0/ db/conf/sigdial/sigdial2007.html Simon Keizer Harry Bunt Multidimensional Dialogue Management. 37-45 2006 SIGDIAL Workshop https://aclanthology.org/W06-1306/ conf/sigdial/2006 db/conf/sigdial/sigdial2006.html#KeizerB06 Rieks op den Akker Harry Bunt Simon Keizer Boris W. van Schooten From question answering to spoken dialogue: towards an information search assistant for interactive multimodal information extraction. 2793-2796 2005 INTERSPEECH https://doi.org/10.21437/Interspeech.2005-823 conf/interspeech/2005 db/conf/interspeech/interspeech2005.html#AkkerBKS05 Simon Keizer Rieks op den Akker Anton Nijholt Dialogue Act Recognition with Bayesian Networks for Dutch Dialogues. 88-94 2002 SIGDIAL Workshop https://aclanthology.org/W02-0213/ https://doi.org/10.3115/1118121.1118134 conf/sigdial/2002 db/conf/sigdial/sigdial2002.html#KeizerAN02 Rieks op den Akker Alan W. Black Norbert Braunschweiler Harry Bunt Susanne Burger Alistair Conkie Paul A. Crook Heriberto Cuayáhuitl Amol A. Deshmukh Nina Dethlefs Cong-Thanh Do Mihai Sorin Dobre Caroline Dockes Rama Sanand DoddipatlaRama Doddipatla Ondrej Dusek Ioannis Efstathiou Klaus-Peter Engelbrecht Maxine Eskénazi Alex Chengyu Fang Youmna Farag Mary Ellen Foster Andre Gaschler Milica Gasic Emer Gilmartin Manuel Giuliani Markus Guhe Helen HastieHelen F. HastieHelen Wright Hastie Amy Isard Filip Jurcícek Pantelis Kastoris Kate M. Knill Alex Lascarides Fabrice Lefèvre Oliver Lemon Mohan Li Xingkun Liu François Mairesse Nicolas Merigaud Roser Morante Anton Nijholt Tim Paek Suraj Pandey Gabriel Parent Catherine Pelachaud Volha Petukhova Laurent Prévot 0001 Verena Rieser Jost Schatzmann Boris W. van Schooten Gabriel Schubiner Svetlana Stoyanchev Wenshuo Tang Blaise Thomson Tomoki Toda Alejandro Santorum Varela Zhuoran Wang Jason D. Williams Steve J. Young Kai Yu 0004