KR102439271B1 - System for managing chatbot based on accuracy rating - Google Patents

Abstract

The present invention provides a communication interface unit for providing a communication interface for interworking with a chatbot service providing system that provides a chatbot service through an interface with a user; chatbot information storage unit; a chatbot usage information storage unit for storing and managing usage information of each of the chatbots; a chatbot accuracy storage unit for storing and managing the accuracy of each of the chatbots; A corresponding chatbot service is provided in response to the chatbot service request through the communication interface unit, the chatbot service is provided using the chatbot information stored in the chatbot information storage unit, and the chatbot use information storage unit is configured based on the chatbot service provision information. a control unit for updating and updating the chatbot accuracy storage unit based on feedback information of users who have used the chatbot service; and a chatbot recommendation unit that provides chatbot information requiring performance improvement to chatbot managers based on the information stored in the chatbot information storage unit, the chatbot usage information storage unit, and the chatbot accuracy storage unit. There is an advantage in that the efficiency of chatbot management can be improved by providing the chatbot managers with a list of chatbots that need performance improvement based on the accuracy evaluation result.

Description

Accuracy rating-based chatbot management system {SYSTEM FOR MANAGING CHATBOT BASED ON ACCURACY RATING}

The present invention relates to a system for a chatbot service, and more particularly, to a chatbot management system based on an accuracy rating.

Recently, as the usage environment of messengers through smartphones has expanded and artificial intelligence has developed, a chat-bot system that connects customers and companies with a messaging service and allows them to communicate based on a set response rule has been in the spotlight. have. In particular, in order to improve the quality of customer support services, there are a lot of companies that want to introduce chatbots to reduce the manpower required to respond to customers and to respond quickly 24 hours a day. AT&T, for example, has a bot answering a call to CS. The chat-bot refers to a chatter robot, and is an abbreviation for a robot that communicates.

These chatbots are used in various places such as the financial sector, call centers, and Internet commerce, and as their effectiveness is recognized, the types of chatbot services are diversifying.

Accordingly, it is necessary to manage chatbot services to increase the usability of chatbots.

Korean Patent Publication No. 10-2019-0066988 (published date: June 14, 2019, title: AIML-based chatbot system and chatbot service provision method)

Accordingly, an object of the present invention is to provide a chatbot management system capable of increasing the efficiency of chatbot management by providing chatbot managers with chatbot information that needs to be improved most urgently.

In addition, the present invention provides a chatbot management system capable of providing meaningful information to chatbot managers by creating a list of chatbots requiring performance improvement based on chatbot users' chatbot usage history and accuracy evaluation results and providing them to chatbot managers want to

In order to achieve the above object, the accuracy rating-based chatbot management system provided by the present invention stores and manages chatbot information for providing the chatbot service, and a chatbot that interworks with a chatbot service providing system that provides the chatbot service through an interface with the user A management system, comprising: a communication interface unit providing a communication interface for interworking with the chatbot service providing system; a chatbot information storage unit for storing and managing chatbot information for providing the chatbot service; a chatbot usage information storage unit for storing and managing usage information of each of the chatbots stored in the chatbot information storage unit; a chatbot accuracy storage unit for storing and managing the accuracy of each of the chatbots stored in the chatbot information storage unit; A corresponding chatbot service is provided in response to a chatbot service request through the communication interface unit, the chatbot service is provided using the chatbot information stored in the chatbot information storage unit, and the chatbot usage information is stored based on the chatbot service provision information. a control unit which updates the unit and updates the chatbot accuracy storage unit based on feedback information of users who have used the chatbot service; and a chatbot recommendation unit that provides chatbot information requiring performance improvement to chatbot managers based on the information stored in the chatbot information storage unit, the chatbot usage information storage unit, and the chatbot accuracy storage unit.

Preferably, the chatbot usage information storage unit may store the usage frequency for each chatbot, and the control unit may update the usage frequency for each chatbot stored in the chatbot usage information storage unit based on the chatbot service provision information.

Preferably, the chatbot accuracy storage unit stores the accuracy for each chatbot, and the controller accumulates the accuracy evaluation results of the chatbot included in the feedback information of the users to calculate an average accuracy for each chatbot, and based on the average value, the chatbot accuracy The accuracy of each chatbot stored in the accuracy storage unit can be updated.

Preferably, the chatbot recommendation unit aligns the chatbots stored in the chatbot information storage unit based on the usage frequency for each chatbot stored in the chatbot usage information storage unit, and then a chatbot including a predetermined number of chatbots selected in the order of the highest usage frequency. generating a recommendation list, detecting the accuracy of each of the chatbots included in the chatbot recommendation list from the chatbot accuracy storage unit, rearranging the chatbot recommendation list based on the accuracy, and based on the rearranged chatbot recommendation list A chatbot requiring performance improvement may be selected in the order of lower accuracy and provided to the chatbot manager.

Preferably, the chatbot recommendation unit sorts the chatbots stored in the chatbot information storage unit based on the accuracy of each chatbot stored in the chatbot accuracy storage unit, and then selects a chatbot recommendation list including a predetermined number of chatbots selected in the order of low accuracy. and, after detecting the usage frequency of each of the chatbots included in the chatbot recommendation list from the chatbot usage information storage unit, rearrange the chatbot recommendation list based on the usage frequency, and based on the rearranged chatbot recommendation list A chatbot requiring performance improvement may be selected in the order of frequency of use and provided to the chatbot manager.

Preferably, the control unit may receive the performance improvement information from the chatbot manager, improve the performance of the corresponding chatbot, and store the performance improvement history information in the chatbot information storage unit.

In addition, in order to achieve the above object, the chatbot management method provided by the present invention stores and manages chatbot information for providing the chatbot service, and manages the chatbot in conjunction with the chatbot service providing system that provides the chatbot service through an interface with the user A method for managing a chatbot using a system, the method comprising: providing a chatbot service by detecting and providing a requested chatbot service from pre-stored chatbot information in response to a chatbot service request of the chatbot service providing system; a chatbot usage information update step of updating usage information for each chatbot based on the chatbot service provision information; a chatbot accuracy updating step of receiving feedback information of users who used the chatbot service from the chatbot service providing system, calculating and storing the accuracy for each chatbot based on the chatbot evaluation information included in the feedback information; and a chatbot recommendation step of detecting chatbot information requiring performance improvement based on the usage information for each chatbot and accuracy of each chatbot, and providing the chatbot manager with the chatbot information requiring performance improvement.

Preferably, the updating of the chatbot usage information may include storing and managing a usage history and usage frequency for each chatbot based on the chatbot service provision information.

Preferably, the step of updating the accuracy for each chatbot comprises: an accuracy evaluation result accumulation step of accumulating the accuracy evaluation result of the chatbot included in the feedback information of the users for each chatbot; an accuracy average value calculation step of calculating an accuracy average value for each chatbot based on the accumulated accuracy evaluation result for each chatbot; and an accuracy storage step of storing the accuracy for each chatbot based on the calculated average value.

Preferably, in the chatbot recommendation step, after sorting the chatbots stored in the chatbot management system based on the usage frequency for each chatbot, a predetermined number of chatbots are selected in the order of the highest usage frequency, and a chatbot recommendation including the selected chatbots Chatbot recommendation list generation step of generating a list; a chatbot recommendation list rearranging step of detecting the accuracy of each of the chatbots included in the chatbot recommendation list and rearranging the chatbot recommendation list based on the accuracy; and selecting chatbots requiring performance improvement in the order of lower accuracy based on the rearranged chatbot recommendation list, and providing the chatbots selected as the chatbots requiring performance improvement to the chatbot manager.

Preferably, in the chatbot recommendation step, after sorting the chatbots stored in the chatbot management system based on the accuracy of each chatbot, a predetermined number of chatbots are selected in the order of lower accuracy, and a chatbot recommendation list including the selected chatbots is displayed. Creating a chatbot recommendation list to create; a chatbot recommendation list rearranging step of detecting the usage frequency of each of the chatbots included in the chatbot recommendation list and rearranging the chatbot recommendation list based on the usage frequency; and selecting chatbots requiring performance improvement in the order of the highest usage frequency based on the rearranged chatbot recommendation list, and providing the chatbots selected as the chatbots requiring performance improvement to the chatbot manager.

The accuracy rating-based chatbot management system of the present invention can provide meaningful information to the chatbot administrators by creating a list of chatbots requiring performance improvement based on the chatbot users' chatbot usage history and accuracy evaluation results, and providing them to the chatbot administrators. there are advantages to In addition, the present invention has an advantage in that it is possible to increase the efficiency of chatbot management by providing chatbot administrators with chatbot information that needs to be improved most urgently.

1 is a schematic block diagram of a chatbot management system according to an embodiment of the present invention.
2 is a diagram for explaining the configuration of a field for a chatbot information management DB according to an embodiment of the present invention.
3 is a diagram for explaining the configuration of a field for a chatbot usage information management DB according to an embodiment of the present invention.
4 is a diagram for explaining a field configuration for a chatbot accuracy management DB according to an embodiment of the present invention.
5 is a schematic processing procedure diagram of a chatbot management method according to an embodiment of the present invention.

Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings, but it will be described in detail so that those of ordinary skill in the art to which the present invention pertains can easily practice the present invention. However, the present invention may be embodied in various different forms and is not limited to the embodiments described herein. On the other hand, in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification. In addition, even if the detailed description is omitted, descriptions of parts that can be easily understood by those skilled in the art are omitted.

Throughout the specification and claims, when a part includes a certain element, it means that other elements may be further included, rather than excluding other elements, unless otherwise stated.

1 is a schematic block diagram of a chatbot management system according to an embodiment of the present invention. Referring to FIG. 1 , the chatbot management system 100 according to an embodiment of the present invention includes a chatbot information management DB 110 , a chatbot usage information management DB 120 , a chatbot accuracy management DB 130 , and a communication interface unit ( It includes an I/F) 140 , a control unit 150 , and a chatbot recommendation unit 160 , and interworks with a chatbot service providing system (not shown). In this case, the chatbot service providing system (not shown) provides the chatbot service through an interface with the user.

The chatbot information management DB 110 stores/manages chatbot information for providing a chatbot service. 2 is a view for explaining the configuration of a field for the chatbot information management DB according to an embodiment of the present invention. Referring to FIG. 2 , the chatbot information management DB 110 is a chatbot_ID(111)/chatbot_name (112) / chatbot_description 113 / URL 114 / registration date 115 / registrant_information 116 may be included. In this case, the URL 114 indicates the location information where the chatbot is stored, and the registration date 115 indicates the date the chatbot is registered.

The chatbot usage information management DB 120 stores/manages usage information of each of the chatbots stored in the chatbot information management DB 110 . In particular, the chatbot usage information management DB 120 stores the usage frequency for each chatbot. 3 is a view for explaining the configuration of a field for the chatbot usage information management DB according to an embodiment of the present invention. Referring to FIG. 3 , the chatbot usage information management DB 120 is a chatbot_ID (121)/recent The date of use 122 / period_accumulated number of uses 123 / total_accumulated number of uses 124 may be included. In this case, the period_accumulated number of use 123 stores the number of times used in a preset specific period. That is, it is possible to store the frequency of use of the corresponding chatbot in the period.

The chatbot accuracy management DB 130 stores/manages the accuracy of each of the chatbots stored in the chatbot information management DB 110 . In this case, the accuracy of each of the chatbots may be determined by the average value of the accuracy evaluations of users using the corresponding chatbot. 4 is a view for explaining the field configuration of the chatbot accuracy management DB according to an embodiment of the present invention. Referring to FIG. 4 , the chatbot accuracy management DB 130 is chatbot_ID 131 / evaluation date and time ( 132)/Evaluation result (133)/Evaluator_ID(134)/… /total rating (135)/accuracy (136) may be included. In this case, a plurality of chatbot_ID 131 , evaluation date and time 132 , evaluation result 133 , and evaluator_ID 134 may be included. For example, it may be included as many as a preset number as a valid number to evaluate the chatbot accuracy. This is to increase the reliability of the evaluation results.

The communication interface unit (I/F) 140 provides a communication interface for interworking with the chatbot service providing system (not shown).

The controller 150 controls the overall operation of the chatbot management system 100 based on a preset control algorithm or a control signal input through the communication I/F 140 . In particular, the controller 150 provides a corresponding chatbot service in response to a chatbot service request through the communication I/F 140 , but provides the chatbot service using the chatbot information stored in the chatbot information management DB 110 . To this end, the controller 150 updates the chatbot usage information management DB 120 based on the chatbot service provision information, and in particular, updates the usage frequency for each chatbot. In addition, the control unit 150 updates the chatbot accuracy management DB 130 based on the feedback information of users who used the chatbot service, but accumulates the accuracy evaluation results of the chatbot included in the users' feedback information, and the average value of accuracy for each chatbot , and the accuracy for each chatbot stored in the chatbot accuracy management DB 130 may be updated based on the average value.

In addition, the control unit 150 may receive performance improvement information from the chatbot manager, improve the performance of the corresponding chatbot, and store the performance improvement history information in the chatbot information management DB 110 .

The chatbot recommendation unit 160 provides chatbot information requiring performance improvement to chatbot managers based on information stored in the chatbot information management DB 110 , the chatbot usage information management DB 120 , and the chatbot accuracy management DB 130 . .

That is, the chatbot recommendation unit 160 selects a chatbot that needs performance improvement based on the frequency of use for each chatbot and the accuracy evaluation result for each chatbot, and provides the result to the chatbot manager, so that the chatbot can be managed smoothly.

For example, the chatbot recommendation unit 160 may select a chatbot with low accuracy from among frequently used chatbots and provide it to the chatbot manager, or select a chatbot with low accuracy among recently used chatbots and provide it to the chatbot manager. have.

To this end, the chatbot recommendation unit 160 sorts the chatbots stored in the chatbot information management DB 110 based on the usage frequency for each chatbot stored in the chatbot usage information management DB 120 , and selects the chatbots in the order of the highest frequency of use. Create a chatbot recommendation list including chatbots, detect the accuracy of each of the chatbots included in the chatbot recommendation list from the chatbot accuracy management DB 130, rearrange the chatbot recommendation list based on the accuracy, and Based on the rearranged chatbot recommendation list, a series of processes may be performed to select a chatbot requiring performance improvement in the order of low accuracy and provide it to the chatbot manager.

Alternatively, the chatbot recommendation unit 160 may first select a predetermined number of chatbots with low accuracy, then select a chatbot with high frequency of use from among the chatbots and provide it to the chatbot manager.

To this end, the chatbot recommendation unit 160 sorts the chatbots stored in the chatbot information management DB 110 based on the accuracy of each chatbot stored in the chatbot accuracy management DB 130, and selects a predetermined number of chatbots selected in the order of low accuracy. generating a chatbot recommendation list including, detecting the usage frequency of each of the chatbots included in the chatbot recommendation list from the chatbot usage information management DB 110, rearranging the chatbot recommendation list based on the usage frequency, and Based on the rearranged chatbot recommendation list, a series of processes may be performed to select a chatbot requiring performance improvement in the order of the highest frequency of use and provide it to the chatbot manager.

In this case, the chatbot recommendation unit 160 may select a chatbot based on a chatbot recently used when generating the chatbot recommendation list. That is, a chatbot recommendation list may be generated by selecting a chatbot having a low accuracy or a high frequency of use among chatbots having a history of being used within a preset period.

5 is a schematic processing procedure diagram of a chatbot management method according to an embodiment of the present invention. 5 illustrates a schematic processing procedure for a chatbot management method using the chatbot management system 100 that interworks with the chatbot service providing system 200 that provides a chatbot service through an interface with the user terminal 300 .

1 and 5 , a chatbot management method according to an embodiment of the present invention is as follows.

First, in step S105 , the user terminal 300 requests a chatbot service from the chatbot service providing system 200 , and in step S110 , the chatbot service providing system 200 transmits the chatbot service request to the chatbot management system 100 . do.

In step S115 , the chatbot management system 100 that stores and manages chatbot information for providing the chatbot service detects the requested chatbot service from the chatbot information stored in advance in response to the chatbot service request of the chatbot service providing system 200 .

In step S120 , the chatbot management system 100 delivers the detected chatbot service to the chatbot service providing system 200 , and in step S125 , the chatbot service providing system 200 provides the chatbot service to the user terminal 300 . to provide.

In step S130 , the chatbot management system 100 updates usage information for each chatbot (eg, usage history and frequency of use for each chatbot) based on the chatbot service provision information. That is, in step S130 , the controller 150 updates the chatbot usage information management DB 120 based on the chatbot service provision information.

In step S135, when the user terminal 300 using the chatbot service inputs feedback information for the chatbot service, that is, when the user terminal 300 using the chatbot service evaluates the accuracy of the chatbot, step S140 In , the chatbot service providing system 200 transmits the accuracy evaluation result to the chatbot management system 100 .

In step S145, the chatbot management system 100 updates the accuracy of each chatbot based on the accuracy evaluation result included in the feedback information. That is, in step S145 , the controller 150 updates the chatbot accuracy management DB 130 based on the accuracy evaluation result. To this end, the controller 150 may further perform the step of calculating the accuracy for each chatbot based on the chatbot evaluation information included in the feedback information. That is, the controller 150 accumulates the accuracy evaluation results of the chatbots included in the feedback information of users for each chatbot, calculates an average accuracy value for each chatbot based on the accumulated accuracy evaluation results for each chatbot, and based on the calculated average value Thus, it is possible to perform a series of processes to update the accuracy of each chatbot.

In step S150, the chatbot management system 100 selects the chatbot information requiring performance improvement based on the usage information for each chatbot and the accuracy for each chatbot. In step S155, the chatbot management system 100 selects the chatbot information requiring performance improvement. Information is provided to the manager terminal 400 .

In this case, in step S150, the chatbot recommendation unit 160 may select a chatbot with low accuracy from among frequently used chatbots and provide it to the chatbot manager, or select a chatbot with low accuracy from among recently used chatbots.

To this end, in step S150, the chatbot recommendation unit 160 sorts the chatbots stored in the chatbot information management DB 110 based on the usage frequency for each chatbot, and then selects a predetermined number of chatbots in the order of the highest usage frequency, and A chatbot recommendation list generation step of generating a chatbot recommendation list including the selected chatbots; a chatbot recommendation list rearranging step of detecting the accuracy of each of the chatbots included in the chatbot recommendation list and rearranging the chatbot recommendation list based on the accuracy; and selecting chatbots requiring performance improvement in the order of lower accuracy based on the rearranged chatbot recommendation list.

Alternatively, in step S150 , the chatbot recommendation unit 160 may first select a predetermined number of chatbots with low accuracy, then select a chatbot with a high frequency of use from among the chatbots and provide it to the chatbot manager.

To this end, in step S150, the chatbot recommendation unit 160 sorts the chatbots stored in the chatbot information management DB 110 based on the accuracy of each chatbot, and then selects a predetermined number of chatbots in the order of lower accuracy, and selects the selected chatbots. A chatbot recommendation list generation step of generating a chatbot recommendation list including chatbots; a chatbot recommendation list rearranging step of detecting the usage frequency of each of the chatbots included in the chatbot recommendation list and rearranging the chatbot recommendation list based on the usage frequency; and a chatbot selection step of selecting chatbots requiring performance improvement in the order of frequency of use based on the rearranged chatbot recommendation list.

Meanwhile, in steps S160 and S165, the chatbot management system 100 improves the performance of the corresponding chatbot based on the performance improvement information input information of the manager terminal 400 that has received the chatbot information requiring performance improvement.

In addition, the chatbot management system 100 may further include a performance improvement history information storage step (not shown) of storing the performance improvement history information.

Although embodiments of the present invention have been described above, the scope of the present invention is not limited thereto, and the present invention is easily changed from the embodiments by those of ordinary skill in the art to which the present invention belongs and recognized as equivalent. including all changes and modifications to the scope of

Claims (12)

A chatbot management system that stores and manages chatbot information for providing a chatbot service and interworks with a chatbot service providing system that provides a chatbot service through an interface with a user,
a communication interface unit providing a communication interface for interworking with the chatbot service providing system;
a chatbot information storage unit for storing and managing chatbot information for providing the chatbot service;
including the latest use date and frequency of use of each of the chatbots stored in the chatbot information storage unit a chatbot usage information storage unit for storing and managing usage information;
a chatbot accuracy storage unit for storing and managing the accuracy of each of the chatbots stored in the chatbot information storage unit;
A corresponding chatbot service is provided in response to a chatbot service request through the communication interface unit, the chatbot service is provided using the chatbot information stored in the chatbot information storage unit, and the chatbot is used based on the information on the provided chatbot service a control unit that updates usage information including the most recent use date and frequency of use for each chatbot stored in the information storage unit, and updates the chatbot accuracy storage unit based on feedback information of users who have used the chatbot service; and
A chatbot recommendation unit for providing information on a chatbot in need of performance improvement to chatbot managers based on the information stored in the chatbot information storage unit, the chatbot usage information storage unit, and the chatbot accuracy storage unit;
The chatbot recommendation section
Select a chatbot that needs performance improvement by considering the frequency of use of each chatbot, the accuracy of each chatbot, and the latest use date of each chatbot together,
Among the top predetermined chatbots with high frequency of use, chatbots requiring performance improvement are selected in the order of low accuracy, or
Among the top predetermined chatbots with low accuracy, the chatbots that need performance improvement are selected in the order of frequency of use, or
At least one chatbot whose accuracy is less than or equal to a preset value or whose frequency of use is greater than or equal to a preset value from among the preset number of chatbots included within the preset time period, information on the selected chatbot is displayed. Accuracy rating-based chatbot management system, characterized in that it is provided to the chatbot manager. delete The method of claim 1, wherein the chatbot accuracy storage unit
Save the accuracy of each chatbot,
the control unit
Accuracy rating-based chatbot, characterized in that by accumulating the accuracy evaluation results of the chatbots included in the feedback information of the users, calculating an average accuracy for each chatbot, and updating the accuracy for each chatbot stored in the chatbot accuracy storage unit based on the average value management system. The method of claim 3, wherein the chatbot recommendation unit
After sorting the chatbots stored in the chatbot information storage unit based on the usage frequency of each chatbot stored in the chatbot usage information storage unit, a chatbot recommendation list including a predetermined number of chatbots selected in the order of frequency of use is generated,
After detecting the accuracy of each of the chatbots included in the chatbot recommendation list from the chatbot accuracy storage unit, rearrange the chatbot recommendation list based on the accuracy;
An accuracy rating-based chatbot management system, characterized in that, based on the rearranged chatbot recommendation list, a chatbot requiring performance improvement is selected in the order of lower accuracy, and information about the selected chatbot is provided to the chatbot manager. The method of claim 3, wherein the chatbot recommendation unit
After sorting the chatbots stored in the chatbot information storage unit based on the accuracy of each chatbot stored in the chatbot accuracy storage unit, a chatbot recommendation list including a predetermined number of chatbots selected in the order of low accuracy is generated;
After detecting the usage frequency of each of the chatbots included in the chatbot recommendation list from the chatbot usage information storage unit, rearrange the chatbot recommendation list based on the usage frequency;
An accuracy rating-based chatbot management system, characterized in that, based on the rearranged chatbot recommendation list, a chatbot requiring performance improvement is selected in the order of the highest frequency of use, and information about the selected chatbot is provided to the chatbot manager. According to claim 1, wherein the control unit
Accuracy rating based chatbot management system, characterized in that by receiving the performance improvement information from the chatbot manager, improving the performance of the corresponding chatbot, and storing the performance improvement history information in the chatbot information storage unit. In a chatbot management method using a chatbot management system that stores and manages chatbot information for providing chatbot service, and interworks with a chatbot service providing system that provides chatbot service through an interface with a user,
a chatbot service providing step in which the chatbot management system detects and provides the requested chatbot service from pre-stored chatbot information in response to the chatbot service request of the chatbot service providing system;
a chatbot usage information updating step of updating, by the chatbot management system, usage information for each chatbot including the most recent use date and usage frequency for each chatbot based on the information on the chatbot service provided in the chatbot service providing step;
a chatbot accuracy updating step in which the chatbot management system receives feedback information of users who used the chatbot service from the chatbot service providing system, calculates and stores the accuracy for each chatbot based on the chatbot evaluation information included in the feedback information; and
A chatbot recommendation step in which the chatbot management system detects information on a chatbot requiring performance improvement based on the usage information for each chatbot and accuracy for each chatbot, and provides information about the chatbot requiring performance improvement to the chatbot manager; ,
The chatbot recommendation step is
The chatbot management system selects a chatbot that needs performance improvement in consideration of the frequency of use of each of the chatbots, the accuracy of each of the chatbots, and the recent use date of each of the chatbots together,
Among the top predetermined chatbots with high frequency of use, chatbots requiring performance improvement are selected in the order of low accuracy, or
Among the top predetermined chatbots with low accuracy, the chatbots requiring performance improvement are selected in the order of the highest frequency of use, or
At least one chatbot whose accuracy is less than or equal to a preset value or whose frequency of use is greater than or equal to a preset value from among the preset number of chatbots included within the preset time, information on the selected chatbot is displayed. An accuracy rating-based chatbot management method, characterized in that it is provided to the chatbot manager. delete The method of claim 7, wherein the chatbot accuracy update step
an accuracy evaluation result accumulation step of accumulating accuracy evaluation results of the chatbot included in the feedback information of the users for each chatbot;
an accuracy average value calculation step of calculating an accuracy average value for each chatbot based on the accumulated accuracy evaluation result for each chatbot; and
and an accuracy storage step of storing the accuracy for each chatbot based on the calculated average value. The method of claim 9, wherein the chatbot recommendation step
A chatbot recommendation list creation step of sorting chatbots stored in the chatbot management system based on the usage frequency for each chatbot, selecting a predetermined number of chatbots in the order of the highest usage frequency, and generating a chatbot recommendation list including the selected chatbots ;
a chatbot recommendation list rearranging step of detecting the accuracy of each of the chatbots included in the chatbot recommendation list and rearranging the chatbot recommendation list based on the accuracy;
a chatbot selection step of selecting chatbots requiring performance improvement in the order of lower accuracy based on the rearranged chatbot recommendation list; and
and providing information on chatbots selected as chatbots requiring performance improvement to the chatbot manager. The method of claim 9, wherein the chatbot recommendation step
A chatbot recommendation list generation step of arranging the chatbots stored in the chatbot management system based on the accuracy of each chatbot, selecting a predetermined number of chatbots in the order of low accuracy, and generating a chatbot recommendation list including the selected chatbots;
a chatbot recommendation list rearranging step of detecting the usage frequency of each of the chatbots included in the chatbot recommendation list and rearranging the chatbot recommendation list based on the usage frequency;
a chatbot selection step of selecting chatbots requiring performance improvement in the order of the highest frequency of use based on the rearranged chatbot recommendation list; and
and providing information on chatbots selected as chatbots requiring performance improvement to the chatbot manager. 8. The method of claim 7,
Accuracy rating-based chatbot, characterized in that the chatbot management system further comprises a performance improvement history information storage step of receiving the performance improvement information from the chatbot manager, improving the performance of the corresponding chatbot, and storing the performance improvement history information. management method.

Images