Chatbot evaluation for effectiveness in customer query resolution

South African Journal of Information Management

 
 
Field Value
 
Title Chatbot evaluation for effectiveness in customer query resolution
 
Creator Mashigo, Tryphosa B. Dinath, Wafeequa Khumalo, Sithembiso
 
Subject Business Information Management chatbots; customer service; query resolution; bibliometric analysis; artificial intelligence
Description Background: The adoption of artificial intelligence technologies, specifically chatbots, has grown tremendously in various industries and is expected to transform how businesses communicate with and resolve customer queries. Yet, fewer empirical studies have been conducted on how chatbots can be assessed for their effectiveness in resolving customer queries.Objectives: This study aims to uncover and identify research gaps through bibliometric analysis. Bibliometric analysis allows for the exploration of conversational chatbot evaluation in resolving customer queries.Method: A comprehensive analysis of 27 literature articles published between 2015 and 2024 was conducted using data retrieved from the Web of Science database. The study encompasses various analytical approaches, such as performance analysis and science mapping techniques, and includes keyword co-occurrence analysis and citation network visualisation, to elucidate the distribution of publications, influential authors and institutions, and critical research disciplines.Results: Findings reveal a growing body of research on chatbot evaluation predominantly in well-developed countries, spanning diverse disciplines such as Business and Economics, Computer Science, and Engineering. Examining citation networks suggests interconnectedness in the literature, with specific articles emerging as central nodes of influence.Conclusion: The study’s implications for future research include the importance of interdisciplinary collaboration, a deeper examination of aspects of chatbot design, user experience, and interaction dynamics, and prioritising context-sensitive approaches to effective chatbot deployment and evaluation in emerging countries.Contribution: Overall, this bibliometric analysis offers valuable insights into the current state of research on chatbots and provides a foundation for future endeavours in this rapidly evolving research domain.
 
Publisher AOSIS
 
Contributor
Date 2025-09-17
 
Type info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion — Bibliomentrci analysis
Format text/html application/epub+zip text/xml application/pdf
Identifier 10.4102/sajim.v27i1.1963
 
Source South African Journal of Information Management; Vol 27, No 1 (2025); 11 pages 1560-683X 2078-1865
 
Language eng
 
Relation
The following web links (URLs) may trigger a file download or direct you to an alternative webpage to gain access to a publication file format of the published article:

https://sajim.co.za/index.php/sajim/article/view/1963/3324 https://sajim.co.za/index.php/sajim/article/view/1963/3325 https://sajim.co.za/index.php/sajim/article/view/1963/3326 https://sajim.co.za/index.php/sajim/article/view/1963/3327
 
Coverage — — —
Rights Copyright (c) 2025 Tryphosa B. Mashigo, Wafeequa Dinath, Sithembiso Khumalo https://creativecommons.org/licenses/by/4.0
ADVERTISEMENT