Chatbot testing using AI planning

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Abstract

Chatbots, i.e., systems that can interact with humans in a more appropriate way using natural language, have been of increasing importance. This is due the fact of the availability of computational means for natural language interaction between computers and humans that are becoming closer to the interaction between humans alone. Consequently, there are more and more chatbots available that are intended to support humans organizing tasks or making decisions. In this paper, we focus on how to verify the communication capabilities provided by chatbots. In particular, we introduce an automated approach for generating communication sequences and carrying them out. The approach is based on AI planning where each action can be assumed to be a certain question that is given to the chatbot. The answer of the chatbot should make the action post-condition true, in order to proceed with the plan. In cases of deviations between the actual chatbot behavior and the expected one, re-planning is required. Besides the approach, we discuss its application to the domain of tourism and outline a case study.

Original languageEnglish
Title of host publicationProceedings - 2019 IEEE International Conference on Artificial Intelligence Testing, AITest 2019
PublisherInstitute of Electrical and Electronics Engineers
Pages37-44
Number of pages8
ISBN (Electronic)9781728104928
DOIs
Publication statusPublished - 17 May 2019
Event1st IEEE International Conference on Artificial Intelligence Testing, AITest 2019 - Newark, United States
Duration: 4 Apr 20199 Apr 2019

Conference

Conference1st IEEE International Conference on Artificial Intelligence Testing, AITest 2019
CountryUnited States
CityNewark
Period4/04/199/04/19

    Fingerprint

Keywords

  • Automated testing
  • Chatbot testing
  • Planning

ASJC Scopus subject areas

  • Artificial Intelligence
  • Safety, Risk, Reliability and Quality

Cite this

Bozic, J., Tazl, O. A., & Wotawa, F. (2019). Chatbot testing using AI planning. In Proceedings - 2019 IEEE International Conference on Artificial Intelligence Testing, AITest 2019 (pp. 37-44). [8718222] Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/AITest.2019.00-10