Pendu Kung
Pendu Kung
net/publication/356487897
CITATIONS READS
22 2,629
6 authors, including:
All content following this page was uploaded by Andrejs Romanovs on 09 December 2021.
Abstract—It is said 80% of business owners will use chatbots The term chatbot – chat(-ter) bot was invented by Michael
in the future. Chatbots become more and more popular in terms Loren Mauldin. According to Shawar and Atwell’s simplified
of business, that is why it is necessary for businesses implement definition, chatbots are artificial intelligence-assisted chat
innovative approaches to provide customer service twenty-four applications whose functions range is from answering simple
hours. Such business especially is needed in terms of the questions to participating in complex conversations [10].
challenging Covid-19 times. Artificial Intelligence-powered
chatbots can work as intelligent teaching systems, for providing A chatbot is a software application that helps to carry on
a personalized way of learning for students. Chatbot reviews a conversation using text-based or auditory methods [5].
student's responses and his learning progress. One of the most Programs in Chatbots are developed to mimic human
convenient features of chatbots is the opportunity to send lecture conversations. Chatbots are used for variety of purposes,
materials in the form of messages to students as if it is just a chat including customer service, routing request, and information
with a friend. Apart from personalized chatbot usage in the retrieval. By using Natural language processing, some
studying process, it can be used to streamline business processes, chatbots can be used for word classification.
e.g., such as sales. Nowadays chatbots are able to help customers
to search products they need, place orders to the cart and pay The simplest botts processed basic user messages and
for it, and track delivery processes of orders. Chatbot requests. In a posted conversation with the user, with an
intelligence is being developed every day and every year now, so algorithm, it responds with pre-programmed answers.
very soon chatbots will be able to perform even more difficult Chatbots are most frequently used by dialog systems, such as
tasks to make the life of the user easier. In this paper, authors customer support.
will deliver theoretical materials and historical background of
chatbots, describe classification and techniques of chatbots, then Artificial Intelligence (AI) simulates human intelligence
describe the modern development trends of chatbots using in the form of various devices. Such AI devices are developed
artificial intelligence (AI), and finally discuss the role of chatbots to behave as humans do and imitate their actions. Artificial
in education and e-commerce. Intelligence stands for machines that exhibit natural
Keywords— artificial intelligence (AI), chatbots, covid-19, e- characteristics similar to the human mind, such as problem
commerce, education, trends solving and understanding.
I. INTRODUCTION Natural Language Processing (NLP) is the program
interface that allows computers and humans
A chatbot can be represented as a computer, program, intercommunicate with each other. NLP makes it possible for
algorithm, or artificial intelligence which the main goal is a computer to analyze vast amounts of language data from
communication with a person, or another interlocutor. different sources. NLP technique developers can improve the
Chatbots might be developed to communicate by replying to chatbot knowledge to process various tasks such as text
simple keywords or to interact with a user by supporting analysis, stemming, text summarization, automatic
specific topics. They can be used for a customer service, summarization, topic extraction, text mining, speech
marketing, advertising, entertainment industry, data collection recognition, translation, segmentation, and automatic question
etc. For example, a chatbot can communicate with customers answering.
in online shops and help them to find the product they need. NLP combines two techniques – natural language
In this paper, authors have done research in chatbot history generation (NLG) and natural language understanding (NLU).
to find out how the first chatbots were made, which methods NLP is one of the forms of the Artificial Intelligence that
were used, and how much chatbots have been enhanced in the enables chatbots to process users’ text or audio messages and
last few decades. Also, the authors have referred to the most give a proper answer. NLP has the following layers:
common methods and techniques that are used to create a • Application.
chatbot. In this paper, there is mentioned classification of
chatbots and offered both classification and methods to actual • Data Storage.
chatbot trends in the Covid-19 era.
• NLP Engine.
• NLG – Natural Language Generation is used for text The same method was used with a chatbot called
and sentence planning, mining, and text realization. Jabberwacky designed to mimic a natural human conversation
using a voice-activated system.
NLU is the process of generating meaningful responses in
the form of natural language, and includes: Another milestone in the development of chatbots was
called Dr. Sbaitso chatbot. It was able to synthesize speech –
• Text planning retrieves important data from the in some ways it became even more human-like than its
database. predecessors, even if it could not converse in a more
complicated and complex way. Such problem of chatbot
• Sentence planning selects the required words, produces
communication insufficient complexity still exists today.
relevant phrases using these words and creates
meaningful sentences. Kuki - one more chatbot that needs to be represented
(formerly known as Mitsuku) that claims to be a young girl of
• Text implementation is the flow mapping of the 18 years from England [9]. Kuki is developed using AI Mark-
sentence according to the sentence structure. Up Language and both - Retrieval and Generative-Based
It is much harder to realize Natural Language approaches which allows her to imitate a human conversation,
Understanding process than execute the Natural Language avoiding answering the same question over and over again.
Generation process. The most popular chatbots at the time are chatbots that
Natural Language Toolkit (NLTK) was programmed for are used for e-commerce and e-education solutions. There
the creation and application of symbolic and statistical NLP in have always been difficulties in communication between
Python. It is a pack of libraries that include parsing and customer and seller or student and teacher as sometimes there
classification of text, text processing for tokenization, might be situations where employees' workload is huge and
stemming of words, and reasoning about semantics. answering all these questions can cause a big delay although
most probably the question can be answered quickly, and the
Keras is an API library for neural networks in Python. It information might be found easily. This is where chatbots can
combines well with R, PlaidML, TensorFlow, and the be helpful to reduce communication problems in terms of
Microsoft Cognitive Toolkit. response time. An e-commerce chatbot can assist to find the
Tkinter is an interface for developing graphical user product that a customer is searching for or help to fill a parcel
interface (GUI) applications. returning template. For students, chatbots can answer
questions that are related to due dates or requirements in a
Tensorflow is a software library framework that focuses specific subject. Chatbots are very common nowadays and
mainly on machine learning. It uses data flow graphs and they are going to improve and become more helpful and
differentiates programming across different numbers of tasks necessary in the future.
to build models. It is used to create large-scale development
applications including neural networks. It is mainly used for Currently, there are plenty of well-known chatbots that are
classification, understanding, prediction, and creation. used in daily life. For example, Siri – a virtual assistant of iOS
interface that uses natural language to answer user inquiries
Nowadays there are many chatbots, but how did they start? and perform web service requests. Google Now is another
What was the first chatbot? mobile application for Android and iOS devices that provides
Eliza is one of the most famous and at the same time oldest Google-developed predictive maps with information and daily
chatbots invented by the Artificial Intelligence Laboratory in updates to automatically answer users’ questions. Cortana -
MIT, dating back to 1964. Eliza inspired many developers in the Windows voice platform with information that helps
the field to develop their own chatbots. In the early scenario software and hardware developers. Chatbots for Messenger -
called DOCTOR, the chatbot Eliza has the role of a Rogerian a program that uses Artificial Intelligence (AI) to realize an
psychotherapist, asking open-ended questions, which she also interaction with customers. Facebook launched the platform
answers, drawing attention from herself to the user. to allow developers to produce chatbots that are able
communicate with Facebook users through the Messenger
PARRY is another well-known chatbot developed in chat interface. Messenger chatbots understand users’
1972. This program, which diverts attention from itself, uses questions and formulate responses in a very human way [3].
an opposite strategy than Eliza. It does not behave like a doctor
but like a paranoid schizophrenic patient. It tries to provoke Nowadays, functional chatbots are no longer a rarity. They
controversy and makes the interlocutor give more detailed are being developed more and more advanced. One more
answers [1]. interesting project is Sophia, the chatbot that hides behind the
appearance of a humanoid female robot with highly advanced
Racter is another knowable chatbot (short for raconteur – facial expressions [1].
a storyteller). This Chatbot generates prose in the English
language. Prose can be a short text, not written in the verse, in Interesting research was done by a group of students from
which the authors present fragments of their existential the Philippines - chatbots also can help to deal with emotional
experience. This chatbot uses logical sentences based on its traumas during rehabilitation or as a prevention of an
knowledge and makes conclusions one by one. A good emotional breakdown by simulating empathy [6]. Such
chatbots have two types of perceived input data - typed text
and user’s facial expression transmitted via video. For now,
such chatbots powered by Deep Learning can recognize
neutral, happy, and sad users’ facial expressions with 16.7%,
66.7%, and 56.7% accuracy respectively. The combination of
textual and video data input provides a chatbot with sufficient
information to create a proper answer in a certain
conversation. So, it is even possible that in the future chatbots
will be able to assist psychologists or even psychiatrists during
patient treatment.
Chatbots are classified (Fig. 1) by their interaction, Fig. 1. Classification of chatbot development approaches
information gathering, and usage goal types, e.g., Text-Based
and Voice-Based for interaction mode, Open Domain and There are Rule-Based and Self-Learning (includes
Closed Domain for knowledge domain, Task-Oriented and Generative-Based, Retrieval-Based Approaches) chatbots [7],
Non-Task-Oriented for goals, and Rule-Based, Retrieval- [9]. Any of the two Self-Learning chatbot approaches can
Based, Generative-Based for design approach [7], [9]. Some have different techniques such as:
of them are shortly described further. • Parsing method chooses exact words from the input
Task-Oriented chatbots (e.g., Alexa, Cortana, Siri) goal text, makes them less sophisticated, and uses them for
is to help a user to fulfill his task. Task-Oriented chatbots work output.
in restricted domains and are made to help with a hotel or • Pattern Matching method takes as a pattern user’s
flight booking, create a schedule, or find specific information, input and gives him the most suitable response stored
etc. in the template.
Non-Task-Oriented chatbots can handle an extended • Artificial Intelligence Mark-up Language is made of
conversation with the user, which helps to create a feeling of data objects (AIML elements) that consist of topics and
interaction with a human. These responses of chatbots can be categories. Categories have patterns (matches the user
divided into two approaches – Generative-Based (generates input) and templates (creates an output) which provide
more proper responses during the conversation) and Retrieval- a flexible conversation.
Based (learns to select more informative responses from a
repository of a current conversation). None of them can • Markov Chain Model uses probabilities to know
answer if there is no pattern for that question, because they do what kind of input data will be given to a chatbot next.
not create responses, but only take predefined ones. Mostly used for imitating simple human conversation.
Cannot be used for an extended conversation in a
Domain-Specific chatbots, which include Open-Domain specific area.
(used for a non-specific conversation) and Closed-Domain
(conversation has a specific goal) Approaches, are used in • Artificial Neural Networks Models were made to
specific areas (e.g., education and health care) which helps to develop smarter chatbots and can use both -
raise their efficiency and quality of given answers. Generative-Based and Retrieval-Based approaches.
Such chatbots learn how to interact from conversations
Text-Based and Voice-Based chatbots differ by their with a human. Deep Learning allows imitating a
interaction type with users. Speech-to-text is one of the most human brain's work to process given data and produce
crucial functions in any competitive chatbot and its new patterns.
improvement. The basic idea of speech-to-text consists of
criteria like vocabulary size – the number of words in Even though none of all chatbots passed the Turing Test
vocabulary which are millions from different languages. since the first one (ELIZA) had been invented and chatbots
Another criterion is speaker independence or in other words based on Deep Learning are not an exception, nowadays the
chatbot’s ability to recognize speakers. Co-articulation is an most promising technique for chatbot development is Deep
important part of speech-to-text because a chatbot must have Learning. It is believed that Deep Learning combined with a
the ability to process a continuous stream of words that Retrieval-Based Approach can improve the chatbot
requires segmentation and tokenization of the speaker’s input. intelligence and give results that will show a significant
The chatbot must handle noise to filter out background noises difference compared to previous results.
and must be able to understand input when a person is talking
at different distances from the microphone [4]. III. CONTINUOUS IMPROVEMENT STUDY OF CHATBOT
TECHNOLOGIES USING A HUMAN FACTORS METHODOLOGY