KR102218468B1 - Answer recommendation system and method based on text content and emotion analysis - Google Patents

Abstract

The present invention relates to a system and method for recommending answers based on text content and sentiment analysis, wherein the system according to an embodiment of the present invention provides inquiries from customer inquiry information collected through at least one or more of a plurality of channels. A preprocessor that extracts data and customer situation data, learns the inquiry type for customer inquiry information based on natural language processing of inquiry content data, and creates a first classification model based on the learned result to The first data analysis unit that selects the confirmation answer, learns the emotion type for the customer's emotional state based on natural language processing on the inquiry content data, and creates a second classification model based on the learned result to create the customer's emotional state. It may include a second data analysis unit that selects a response response according to and a third data analysis unit that analyzes the customer situation data and provides an emotional response based on the customer's inquiry time.

Description

Answer recommendation system and method based on text content and sentiment analysis {ANSWER RECOMMENDATION SYSTEM AND METHOD BASED ON TEXT CONTENT AND EMOTION ANALYSIS}

The present invention relates to a system and method for recommending answers based on text content and sentiment analysis, and more specifically, channels such as e-mail, webpage, and social network service (SNS). It relates to a method and system for automatically recommending appropriate phrases by grasping the type of inquiry, the customer's emotional state, and the customer's situation when writing the response of the person in charge to the content of the inquiry left by the customer through the system.

With the recent development of information and communication technology, efforts to improve the efficiency of work by automating business processing of companies continue, and the development of automatic conversation technology using computers is steadily progressing. A representative example of automatic conversation technology is an interactive messenger such as a chatbot.

Currently, services such as Facebook's messenger and Tencent's WeChat are in progress, and most of the automatic conversation technologies including chatbots focus on accurately grasping the meaning of a question and providing an accurate answer. have. This is desirable in terms of delivering accurate information and providing answers, but considering the aspect of natural conversation or response, there is a problem in that it does not provide adequate services to customers.

In particular, in the customer support area that handles inquiries about services and products provided by companies, it is important to provide accurate answers to inquiries, but maintain customer service satisfaction through emotional communication that understands the speaker's feelings and circumstances. Or it is also important to improve. Therefore, it is not desirable to simply use an automatic conversation technology such as a conventional chatbot in the customer support area.

In addition, as mentioned above, the customer support area must provide answers through emotional connection to understand the customer's emotions and circumstances, so even when using automatic conversation technology such as a conventional chatbot, the customer support person in charge of emotional labor relieves mental and physical stress. The problem of receiving still exists. In addition, since it takes a considerable amount of time for the customer support person to construct an appropriate answer that includes emotional sympathy in the foreword, concluding statement, etc. as well as objective content, there is still a problem of prolonging the period of inquiries processing.

Korean Patent Application Publication No. 10-2011-0017559 (2011.02.22)

The present invention is to solve the above-described problems, through analysis of customer inquiries collected through various online and offline channels, to grasp the customer's emotional state, situation, and environment, and to answer based on the identified contents. An object of the present invention is to provide a system and method for recommending by structuring.

An answer recommendation system based on text content and sentiment analysis according to an embodiment of the present invention is a preprocessor for extracting inquiry content data and customer situation data from customer inquiry information collected through at least one or more of a plurality of channels. , A first data analysis unit that learns the type of inquiry about the customer's inquiry information based on natural language processing of the inquiry content data, and generates a first classification model based on the learned result to select the confirmation answer for the inquiry type. , Second data that learns the emotion type for the customer's emotional state based on natural language processing of the inquiry content data, and generates a second classification model based on the learned result to select the response response according to the customer's emotional state. It may include an analysis unit and a third data analysis unit that analyzes the customer situation data and generates an emotional response based on the location of the customer and the time of inquiry.

The first data analysis unit according to an embodiment of the present invention extracts effective morphemes for each inquiry type from text of inquiry content data using Chi-square statistic, and extracts effective morphemes and Determine the inquiry type for customer inquiry information through the first classification model generation unit and the first classification model that learns the feature vectors each of the words included in the word dictionary for each preset inquiry type. , Based on the determined result, it may include an acknowledgment selection unit that estimates the similarity with candidate answers included in the inquiry type pool and selects the top N (N is a natural number) acknowledgment answers.

The confirmation answer selection unit according to an embodiment of the present invention estimates a reliability value for customer inquiry information through a first classification model, selects an inquiry type pool by comparing the estimated reliability value with a preset reference value, and , The similarity can be estimated by vectorizing candidate answers included in the selected query type pool based on whether or not morphemes are included.

The second data analysis unit according to an embodiment of the present invention extracts an effective morpheme for an emotional state from the text of the inquiry content data using Chi-square statistic, and selects each of the extracted effective morphemes. A second classification model generation unit that generates a feature vector having the dimension of and learns the emotion type by applying a weight to the feature vector based on whether or not emoticon data is included, and the second classification model provides information on customer inquiries. It may include a response-answer selection unit that determines the emotion type and selects random N (N is a natural number) response responses from among candidate responses included in the emotion type pool based on the determined result.

The third data analysis unit according to an embodiment of the present invention analyzes the location of the customer and the time of inquiries based on Internet Protocol (IP) information included in the customer situation data, and Emotional answers can be generated based on information.

An answer recommendation system based on text content and emotion analysis according to an embodiment of the present invention is an interface control unit that provides a user interface for recommending a confirmation answer to an inquiry type, a response answer according to the customer's emotional state, and an emotional answer. It may further include.

The interface control unit according to an embodiment of the present invention divides the response to the customer's inquiry information into a greeting, a header, a text, and a closing statement on the user interface, and the confirmation response for the inquiry type is a header and a response according to the customer's emotional state. Answers can be recommended in the preface and ending, and emotional answers at the ending.

An answer recommendation method based on text content and emotion analysis according to an embodiment of the present invention is in which the preprocessor extracts inquiry content data and customer situation data from customer inquiry information collected through at least one or more of a plurality of channels. Step, The first data analysis unit learns the inquiry type for the customer's inquiry information based on natural language processing of the inquiry content data, and generates a first classification model based on the learned result to select the confirmation answer for the inquiry type. The second data analysis unit learns the emotion type for the customer's emotional state based on natural language processing on the inquiry content data, and creates a second classification model based on the learned result to respond according to the customer's emotional state. The step of selecting an answer and the third data analyzing unit may include analyzing the customer situation data and generating an emotional answer based on the location of the customer and the time of the inquiry.

In the step of selecting the confirmation answer for the inquiry type according to an embodiment of the present invention, the first classification model generator uses Chi-square statistic to determine each inquiry type from the text of the inquiry content data. Extracting the effective morphemes for, the first classification model generating unit learning the extracted effective morphemes and the feature vectors each having words included in the word dictionary for each preset inquiry type as one dimension, and selecting a confirmation answer An additional first classification model is used to determine the type of inquiry about the customer's inquiry information, and based on the determined result, the degree of similarity with the candidate answers included in the inquiry type pool is estimated, and the top N (N is a natural number). ). It may include the step of selecting the confirmation answers.

In the step of selecting the top N (N is a natural number) confirmation answers according to an embodiment of the present invention, the confirmation answer selection unit estimating a reliability value for the customer's inquiry information through the first classification model, confirmation answer Step of selecting an inquiry type pool by comparing the estimated reliability value with a preset reference value by the selection unit, and estimating similarity by vectorizing candidate answers included in the selected inquiry type pool by the confirmation answer selection unit based on whether or not morphemes are included. It may include.

In the step of selecting the response response according to the customer's emotional state according to an embodiment of the present invention, the second classification model generator uses Chi-square statistic to determine the emotional state from the text of the inquiry content data. The step of extracting the effective morpheme for the second classification model generation unit generates a feature vector each having the extracted effective morpheme as one dimension, and applies a weight to the feature vector based on whether or not emoticon data is included to determine the emotion type. The learning step and the response answer selection unit determine the emotion type for the customer's inquiry information through the second classification model, and based on the determined result, any N of the candidate answers included in the emotion type pool ( N is a natural number) may include the step of selecting a corresponding answer.

In the step of generating an emotional response according to an embodiment of the present invention, the third data analysis unit analyzes the location of the customer and the time of inquiries based on Internet Protocol (IP) information included in the customer situation data, and Emotional answers can be generated based on environmental information about the location and time of inquiry.

In the method for recommending answers based on text content and emotion analysis according to an embodiment of the present invention, the interface controller provides a user interface for recommending a confirmation answer for an inquiry type, a response response according to the customer's emotional state, and an emotional answer. It may further include the step of.

In the step of providing a user interface according to an embodiment of the present invention, the interface control unit divides the response to the customer's inquiry information into greeting, header, body, and ending on the user interface, and the confirmation answer for the inquiry type is a header, Responses according to the customer's emotional state can be recommended in the preface and ending, and the emotional answer at the ending.

Meanwhile, according to an embodiment of the present invention, a computer-readable recording medium in which a program for executing the above-described method on a computer is recorded may be provided.

According to an answer recommendation system and method provided as an embodiment of the present invention, it is possible to reduce the time required for a customer support person to write an emotional and emotional greeting and a closing statement for a message received from a customer, and to write an accurate answer. By allowing you to invest time, you can maximize the efficiency of customer support work.

In addition, it automatically recommends emotional and emotional greetings and concluding words during customer support tasks where the satisfaction of dissatisfied customers in solving problems depends on emotional compensation and favorable responses (ex.expressions of greetings, apologies, gratitude, correction, etc.). By giving, it is possible to effectively satisfy the satisfaction of dissatisfied customers while minimizing the pain caused by emotional labor of the customer support person in charge.

1 is a conceptual diagram illustrating a customer support service provided through an answer recommendation system interlockable with a customer support system according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating a network relationship between a system for recommending an answer, a plurality of channels, and terminals in charge according to an embodiment of the present invention.
3 is a block diagram showing each configuration of an answer recommendation system according to an embodiment of the present invention.
4 is a flowchart illustrating an operation process of an answer recommendation system according to an embodiment of the present invention.
5 is a conceptual diagram schematically illustrating an operation process of an answer recommendation system according to an embodiment of the present invention.
6 to 11 illustrate a user interface provided by an answer recommendation system according to an embodiment of the present invention.
12 is a flowchart illustrating a method of recommending an answer according to an embodiment of the present invention.
13 is a flowchart illustrating a process of selecting a confirmation answer for an inquiry type according to an embodiment of the present invention.
14 is a flow chart illustrating a process of selecting the top N confirmation answers according to an embodiment of the present invention.
15 is a flowchart illustrating a process of selecting a response response according to an emotional state of a customer according to an embodiment of the present invention.

The terms used in the present specification will be briefly described, and the present invention will be described in detail.

The terms used in the present invention have been selected from general terms that are currently widely used while considering functions in the present invention, but this may vary depending on the intention or precedent of a technician working in the field, the emergence of new technologies, and the like. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning of the terms will be described in detail in the description of the corresponding invention. Therefore, the terms used in the present invention should be defined based on the meaning of the term and the overall contents of the present invention, not a simple name of the term.

When a part of the specification is said to "include" a certain component, it means that other components may be further included rather than excluding other components unless otherwise stated. In addition, terms such as "... unit" described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software, or a combination of hardware and software. In addition, when a part is said to be "connected" with another part throughout the specification, this includes not only a case in which it is "directly connected", but also a case in which a part is connected "with another configuration in the middle."

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement the present invention. However, the present invention may be implemented in various forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are assigned to similar parts throughout the specification.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a conceptual diagram illustrating a customer support service provided through an answer recommendation system 200 interlockable with a customer support system 100 according to an embodiment of the present invention.

The customer support system 100 is a system for handling inquiries including customer complaints and complaints about products and services provided by companies, and collects and collects inquiries through various online and offline channels. It is a solution that provides and handles inquiries in an integrated form to the customer support person in charge.

For example, as shown in FIG. 1, inquiries input from terminals of multiple customers are collected by the customer support system 100 through at least one of a plurality of channels 10 (ex. email, web page, SNS, etc.) Then, the collected inquiries can be converted into a form of "ticket". Inquiries converted into tickets may be integrated and provided to a customer support person through the person in charge terminal 20 as shown in FIG. 1. When the customer support person in charge generates an answer to the ticket through the person in charge terminal 20, the generated answer may be converted back to fit the original form of the channels to which the inquiry was input and provided to the customer terminal.

The answer recommendation system 200 according to an embodiment of the present invention is for assisting the customer support person in the above-described customer support system 100 to create an answer, and communicates with the customer support system 100 and wired/wireless as shown in FIG. It may be formed as a separate configuration to be interlocked through a network or may be integrated into the customer support system 100 to form one configuration of the customer support system 100.

For example, the response recommendation system 200 receives an inquiry converted into a ticket through interworking with the customer support system 100, analyzes the content of the inquiry and the situation of the customer, and structure the response, An answer may be recommended through a user interface implemented in the person in charge terminal 20. That is, the answer recommendation system 200 may improve the speed and efficiency of processing the person in charge in the customer support system 100.

2 is a block diagram showing a network relationship between an answer recommendation system 200, a plurality of channels 10, and a person in charge terminal according to an embodiment of the present invention, and FIG. 3 is an answer recommendation according to an embodiment of the present invention. It is a block diagram showing each configuration of the system 200.

Referring to FIG. 2, the response recommendation system 200 based on text content and emotion analysis according to an embodiment of the present invention is from customer inquiry information collected through at least one or more of a plurality of channels 10. Pre-processing unit 210 that extracts inquiry content data and customer situation data, learns the type of inquiry about customer inquiry information based on natural language processing for inquiry content data, and creates a first classification model based on the learned results The first data analysis unit that selects the confirmation answer for the inquiry type, learns the emotion type for the customer's emotional state based on natural language processing for the inquiry content data, and creates a second classification model based on the learned result. A second data analysis unit 230 that selects a response response according to the customer's emotional state and a third data analysis unit 240 that analyzes the customer situation data and generates an emotional response based on the customer's location and the time of inquiry. It may include.

The preprocessor 210 according to an embodiment of the present invention directly collects customer inquiry information through at least one or more of the plurality of channels 10, or the plurality of channels 10 from the customer support system 100 described above. ), the collected and converted inquiry information may be delivered through at least one of. For example, as shown in FIG. 2, the preprocessor 210 may directly receive customer inquiry information through channels such as email, web page, and social network service. In addition, the preprocessor 210 may receive the inquiry information converted into a ticket in the customer support system 100 linked with the answer recommendation system 200 through a wired or wireless communication network.

The preprocessor 210 according to an embodiment of the present invention may extract inquiry content data and customer situation data through analysis of inquiry information collected through at least one or more of the plurality of channels 10. Inquiry content data refers to text data containing the summary of inquiries such as customer complaints, complaints, and improvement requests. Customer situation data refers to data on environmental factors of customers that can identify the location and time of inquiries of the customer (i.e. customer terminal) who sent the inquiry information.

For example, via e-mail from the customer terminal, "I would like to ask for improvement on the service content." When the inquiry information including the content is transmitted to the preprocessing unit 210, the preprocessing unit 210 requests from the inquiry information to "Improve the service contents." The text data including the content of the above can be extracted as inquiry content data, and customer situation data can be generated (or extracted) by identifying the location of the customer terminal and the time of inquiry through tracking the inquiry information through e-mail.

Referring to FIG. 3, the first data analysis unit 220 according to an embodiment of the present invention is based on natural language processing for the inquiry content data among the inquiry content data and customer context data extracted by the preprocessor 210. As a result, it may include a first classification model generation unit 221 that performs data analysis and learning for classifying the inquiry type of inquiry information. That is, the first data analysis unit 220 analyzes the text included in the inquiry content data in units of morphemes through the first classification model generation unit 221, and analyzes the text in units of morphemes using machine learning. By analyzing (or learning) the type of inquiry according to the text, a first classification model for determining the type of inquiry information may be generated.

In this case, the first classification model generation unit 221 may use a word dictionary organized by inquiry type in an analysis process through machine learning. The word dictionary organized by inquiry type refers to a database in which natural languages in morpheme units related to each inquiry type are classified and stored, and may be set in advance before the operation of the system 200. The preset word dictionary can be automatically updated during the above-described data analysis and learning process, and is added through the terminal of a system user including an operator (ie, a person in charge of operating and managing the customer support system 100). , It can be continuously updated by modification or change.

For example, the first classification model generation unit 221 extracts text in morpheme units through natural language processing on the inquiry content data, and uses Chi-square statistic from the text of the inquiry content data. Effective morphemes for each inquiry type can be extracted. The first classification model generation unit 221 may learn about the inquiry type by using the extracted effective morphemes and words included in a word dictionary for each of the preset inquiry types. At this time, learning about the inquiry type refers to learning about a feature vector that has the effective morpheme and the words included in the word dictionary for each preset inquiry type as one dimension.

The first classification model generation unit 221 according to an embodiment of the present invention collects feedback data on storage, correction, change, etc. of the result classified through the first classification model and reflects it in the previously generated first classification model. I can. In other words, the first classification model generation unit 221 may continuously update the first classification model by using feedback data on the inquiry type of inquiry information generated through a terminal of the system user or the like.

Referring to FIG. 3, the first data analysis unit 220 according to an embodiment of the present invention performs data analysis to recommend an appropriate answer to a person in charge based on the inquiry type determined by the first classification model. It may include an answer selection unit 222. That is, the first data analysis unit 220 determines the type of inquiry about the customer’s inquiry information through the first classification model through the confirmation answer selection unit 222, and based on the determined result, the inquiry type pool By estimating the degree of similarity with the candidate answers included in, the top N (N is a natural number) confirmation answers can be selected.

Here, the inquiry type pool refers to a database in which candidate answers arranged by inquiry type are stored, and may be set in advance before the operation of the system 200. Candidate answers represent various examples of variations of the confirmation answer expressing the recognition of the inquiry type, and may be continuously updated through addition, modification or change through the terminal of the system user.

For example, the confirmation answer selection unit 222 estimates the inquiry type of inquiry information and the reliability value for the inquiry type through the first classification model, and the estimated reliability value and a preset reference value (ie a user-defined reference value) You can select the inquiry type pool through comparison of. The confirmation answer selection unit 222 may estimate similarity by vectorizing candidate answers included in the selected query type pool based on whether or not morphemes are included, and select the top N confirmation answers based on the estimated similarity.

Referring to FIG. 3, the second data analysis unit 230 according to an embodiment of the present invention is based on natural language processing for the inquiry content data among the inquiry content data and customer context data extracted by the preprocessor 210. As a result, it may include a second classification model generation unit 231 that detects the customer's emotional state and analyzes and learns data for classifying the emotion type. That is, the second data analysis unit 230 analyzes the text included in the inquiry content data in units of morphemes through the second classification model generation unit 231, and analyzes the text in units of morphemes using machine learning. By analyzing (or learning) the emotion type based on the text, a second classification model for determining the type of the customer's emotional state may be generated.

For example, the second classification model generation unit 231 extracts text in morpheme units through natural language processing on the inquiry content data, and uses chi-square statistics to provide effective morphemes for the emotional state from the text of the inquiry content data. Can be extracted. The second classification model generator 231 may learn about the emotion type by using the effective morpheme for the emotional state. At this time, the second classification model generation unit 231 generates a feature vector having the extracted effective morphemes as one dimension, and learns the emotion type by applying a weight to the feature vector based on whether or not emoticon data is included. I can.

Referring to FIG. 3, the second data analysis unit 230 according to an embodiment of the present invention performs data analysis to recommend an appropriate answer to a person in charge based on the emotion type determined by the second classification model. It may include an answer selection unit 232. For example, the response answer selection unit 232 determines the emotion type for the customer's inquiry information through the second classification model, and based on the determined result, the response answer selection unit 232 determines a random number of candidate answers included in the emotion type pool. N (N is a natural number) of responses can be selected.

Here, the emotion type pool refers to a database in which candidate answers arranged for each emotional state categorized in a predetermined step are stored, and may be preset before the operation of the system 200. Candidate answers represent various examples of variations of the response answer expressing sympathy (or understanding) for an emotional state, and may be continuously updated through addition, correction, or change through the terminal of the system user.

Meanwhile, the third data analysis unit 240 according to an embodiment of the present invention analyzes the location of the customer and the time of inquiries based on Internet Protocol (IP) information included in the customer situation data, and And it is possible to generate an emotional answer based on the environmental information on the point of inquiry. Here, the emotional response is a phrase that expresses the sensitivity derived from external factors (ex. weather, season, event, etc.) of the customer's environment, or a stimulus that can be felt by a person based on the stimulus applied from the customer's environment. A text that expresses emotion in natural language.

For example, the third data analysis unit 240 performs machine learning on text data related to environmental factors affecting human emotions such as weather, seasons, and events, and based on the machine learning results, the customer Emotional answers can be generated through natural language generation based on environmental information about the location and time of inquiry. In addition, the third data analysis unit 240 may generate an emotional answer by selecting random N answers from a database in which candidate answers related to environmental factors affecting a person's emotions are previously stored.

2 and 3, an answer recommendation system 200 based on text content and emotion analysis according to an embodiment of the present invention includes a confirmation response to an inquiry type, a response response according to a customer's emotional state, and an emotional response. It may further include an interface controller 250 that provides a user interface for recommending an answer. The interface controller 250 may structure and graphic the above-described answers, and provide a user interface representing structured and graphic answers to the person in charge terminal 20.

For example, when a person in charge writes an answer to a customer inquiries, a confirmation answer to an inquiry type, a response answer according to the customer's emotional state, and an emotional answer may be recommended through a user interface that can be implemented in the person in charge terminal 20. At this time, an answer desired by the person in charge may be selected for each of the confirmation answer to the inquiry type, a response answer according to the customer's emotional state, and an emotional answer through an external input authorized by the person in charge through the user interface.

4 is a flowchart illustrating an operation process of the answer recommendation system 200 according to an embodiment of the present invention. Hereinafter, the above-described data processing process for each data analysis unit of the answer recommendation system 200 will be described in more detail with reference to FIG. 4.

(1) Processing process by the first data analysis unit 220

The generation of the first classification model not shown in FIG. 4 may be performed through the following learning process.

First, the first classification model generation unit 221 of the first data analysis unit 220 analyzes the inquiry content data in units of morphemes using a Twitter morpheme analysis method and a Komoran morpheme analysis method. For example, the first classification model generation unit 221 transforms the morphemes included in the text of the inquiry content data into a circle through Twitter morpheme analysis. In addition, the first classification model generation unit 221 extracts endings that cannot be extracted from the Twitter morpheme analysis and positive and negative designations through analysis of the form of the komoran.

Next, the first classification model generation unit 221 extracts effective morphemes for each inquiry type using chi-square statistics. For example, the first classification model generation unit 221 uses [Table 1] conceptualizing chi-square statistics and [Equation 1] derived accordingly to determine each morpheme included in all data for a specific inquiry type. Estimate the degree of relevance (ex. weight). When the relevance of each morpheme to a specific inquiry type is estimated, the first classification model generator 221 sorts the estimated relevance and extracts the upper L% morpheme as an effective morpheme.

[Table 1]

At this time, in [Table 1], c is a specific inquiry type, ~c is all inquiry types other than c, t is a specific morpheme, ~t is a morpheme other than t, and A, B, C, and D are counting counts for each item ( ie frequency), N means the sum of A, B, C and D. The formula for estimating the degree of relevance derived based on this [Table 1] is as follows.

[Equation 1]

Here, X ² means the degree of relevance of each morpheme to a specific inquiry type.

For example, if the first classification model generator 221 assumes that the specific inquiry type c for which the relevance is to be estimated is "payment" and the specific morpheme t is "money", ~c is "bug" except for "payment". The remaining inquiry types such as ", "user", and ~t mean the remaining morphemes such as "me" and "game" excluding "money".

At this time, the first classification model generation unit 221 may estimate A as 300, B as 4000, C as 1000, and D as 40000 based on the result of counting the number of morphemes present in the data for the inquiry type. have. This means that in the data of the inquiry type corresponding to "payment", the morpheme "money" appeared 300 times (A) and the morpheme other than "money" appeared 4000 times (B). In addition, it means that the morpheme "money" appeared 1000 times (C) and the morpheme other than "money" appeared 40000 times (D) in the inquiry type data other than "payment".

Based on the above-described estimation values, the first classification model generation unit 221 estimates N (ie the total sum of the above-described estimation values) to be 45300, and determines the degree of relation of the morpheme “money” to the inquiry type “payment” [ According to Equation 1], it can be estimated to be about 287.49. The relevance estimated here corresponds to the chi-square value of the morpheme “money” for the inquiry type “payment”.

The first classification model generation unit 221 configures, as learning data for machine learning, a feature vector having words included in the word dictionary and upper morphemes extracted by chi-square statistics as one dimension, respectively. The word dictionary can be constructed as shown in [Table 2] below. However, [Table 2] is only an example to aid understanding, and is not limited thereto, and may be variously modified and set.

[Table 2]

The first classification model generation unit 221 generates a first classification model using a feature vector using a support vector machine, which is one of representative machine learning algorithms. The first classification model refers to a plane that best separates two label data groups in a multidimensional space in which the trained and labeled data are radiated. The type of inquiry is determined according to where the new feature vector is located based on this plane.

When the first classification model is generated through such a learning process, as shown in FIG. 4, the confirmation answer selection unit 222 of the first data analysis unit 220 inputs newly collected inquiry content data into the first classification model. Perform inquiry type analysis. For example, the acknowledgment selection unit 222 extracts the input data in units of morphemes using the two morpheme analysis methods described above, and vectorizes the extracted morphemes. The confirmation answer selection unit 222 estimates an inquiry type determination value (i.e. a reliability value for the inquiry type) by inputting the vector value of the morpheme into the first classification model.

Referring to FIG. 4, the confirmation answer selection unit 222 determines whether there is an inquiry type whose reliability value for the inquiry type estimated through inquiry type analysis is greater than or equal to a user-defined reference value. If there is an inquiry type with a confidence value greater than or equal to the reference value, the inquiry type pool of the inquiry type with the highest confidence value is selected, and the similarity with the candidate answers included in the selected inquiry type pool is calculated, and the top N confirmation answers are selected. Choose. If there is no inquiry type with a reliability value greater than or equal to the reference value, the top N confirmation answers are selected by calculating the similarity with the candidate answers included in the pool of all inquiry types.

In this case, the similarity calculation refers to estimating the proximity of the feature vectors to the morphemes of the inquiry content data and the candidate answers. For example, when morphemes are extracted for each of the inquiry content data and candidate answers through the Twitter and Komoran morpheme analysis method, the confirmation answer selection unit 222 forms one dimension for each of the extracted morphemes, A feature vector is constructed based on whether the morpheme of each of the inquiry content data and the candidate answers is included in the formed dimension. The acknowledgment selection unit 222 calculates a similarity by estimating a feature vector for the inquiry content data and a feature vector for adjacent candidate answers based on a cosine similarity.

(2) Processing by the second data analysis unit 230

The generation of the second classification model not shown in FIG. 4 may be performed through the following learning process. In the process of processing by the second data analysis unit 230, descriptions of the same contents as those of the processing process by the first data analysis unit 220 have been omitted.

First, the second classification model generation unit 231 of the second data analysis unit 230 uses the Twitter morpheme analysis method and the Komoran morpheme analysis method in the same manner as the above-described first classification model generation unit 221. Analyze the data in units of morphemes. Next, the second classification model generation unit 231 extracts effective morphemes for the emotional state using chi-square statistics.

The second classification model generation unit 231 configures feature vectors each having one dimension of upper morphemes extracted by chi-square statistics as learning data for machine learning. In this case, the second classification model generator 231 applies a weight to each feature vector according to whether or not emoticon data is included. Unlike the inquiry type based on the objective meaning of the word, the emotional state can be expressed through an emoticon in which an expression is formed using letters, and thus the second classification model generator 231 utilizes the emoticon data in the learning process.

The emoticon data can be constructed as shown in [Table 3] below on the database. However, [Table 3] is only an example for aiding understanding, and is not limited thereto and may be variously modified and set.

[Table 3]

The second classification model generation unit 231 generates a second classification model using a support vector machine, which is one of representative machine learning algorithms, using the feature vector. The second classification model refers to a plane that best separates two label data groups in a multidimensional space in which the trained and labeled data are radiated. The type of inquiry is determined according to where the new feature vector is located based on this plane.

When a second classification model is generated through such a learning process, as shown in FIG. 4, the response response selection unit 232 of the second data analysis unit 230 inputs the inquiry content data into the second classification model to analyze the emotion type. Perform. For example, the corresponding answer selection unit 232 extracts the input data in units of morphemes using the two morpheme analysis methods described above, and vectorizes the extracted morphemes. The response-answer selection unit 232 multiplies the weighted vector value of the morpheme based on whether the input data contains an emoticon, and inputs the vector value of the morpheme to which the weight is applied to the second classification model to determine the emotion type (ie, inquiry type). The confidence value for) is estimated.

Referring to FIG. 4, the response-answer selection unit 232 selects the emotion type having the highest confidence value among the confidence values for the emotion type estimated through the previous analysis, and selects an emotion type from the emotion type pool for the selected emotion type. Select N responses. At this time, the response answer selection unit 232 classifies the emotion type into three levels: friendly, hostile, and dramatic. The emotion type pool corresponding to friendship includes casual expression, the emotion type pool corresponding to hostility includes neutral expression, and the emotion type pool corresponding to dramatic hostility includes polite expression.

(3) Processing by the third data analysis unit 240

Referring to FIG. 4, the third data analysis unit 240 analyzes a source of customer situation data to analyze a customer's location and an inquiry point. For example, the third data analysis unit 240 analyzes the source of customer situation data to obtain IP information. The third data analysis unit 240 identifies the location of the city indicated by the acquired IP information and the time of inquiries using GeoIP2 or the like.

Next, the third data analysis unit 240 analyzes the customer's environmental information using an open API (Open Application Program Interface) based on the customer's location and the time of inquiry. For example, the third data analysis unit 240 acquires weather information, fine dust information, and the like of a city based on a customer's inquiry time by using an open API related to weather.

Referring to FIG. 4, when analysis of customer environmental information is completed, the third data analysis unit 240 generates an emotional answer through natural language generation using deep learning or randomly from a database in which candidate answers are stored (ie emotional answer pool). The N emotional responses of are selected. For example, if it is analyzed that the weather is sunny based on the customer's location and the time of inquiry, the third data analysis unit 240 generates an emotional response to the sunny weather through natural language generation using deep learning. Alternatively, the third data analysis unit 240 selects random N emotional answers from a database in which candidate answers for sunny weather are stored.

5 is a conceptual diagram schematically illustrating an operation process of the answer recommendation system 200 according to an embodiment of the present invention.

Referring to FIG. 5, the interface controller 250 according to an embodiment of the present invention may classify an answer to a customer's inquiry information into a greeting, a preface, a body, and an ending on a user interface. That is, the interface controller 250 may structure the answer implemented on the person in charge terminal 20 through the user interface into four areas. At this time, the confirmation answer for the inquiry type may be recommended in the foreword, the response response according to the customer's emotional state may be recommended in the foreword and concluding sentence, and the emotional answer in the concluding sentence.

For example, when a customer's inquiry related to a game service is received as shown in FIG. 5, the received inquiry content and the customer's situation information may be analyzed through a classification model. If the inquiry type is analyzed as compensation, the emotion type is hostile, and the weather in the city where the customer is located is rainy, the confirmation answer for the inquiry type (i.e. compensation) can be recommended in the foreword through the user interface. As shown in Fig. 5, among a plurality of confirmation answers, "You have inquired because the cumulative payment event compensation was not normally paid." If the answer is selected by the person in charge, the answer may be displayed in the foreword.

Response responses according to emotion type (i.e. hostility) can be recommended in the foreword and ending through the user interface. In this case, the corresponding answer recommended in the foreword and the corresponding answer recommended in the ending may be distinguished from each other. That is, even if they have the same emotion type, the response answer pool recommended in the foreword and the response answer pool recommended in the concluding statement are formed separately, and the response responses can be selected separately through the selection process through the above-described similarity estimation in each response pool. I can.

The emotional answer based on the weather (i.e. rain) is not substantially related to the content of the inquiry, so it can be recommended in the concluding statement through the user interface. At this time, as shown in FIG. 5, an expression (ex. thank you, etc.) for ending the response may be inserted and recommended in the emotional response.

6 to 11 illustrate a user interface provided by the answer recommendation system 200 according to an embodiment of the present invention. Hereinafter, a process of recommending and selecting an answer implemented through a user interface will be described in more detail with reference to FIGS. 6 to 11.

The basic structure of the output screen implemented in the person in charge terminal 20 through the user interface is shown in FIG. 6. First, the person in charge clicks the "Inquiry Analysis START" button formed in the customer's inquiry message window displayed at the top of the output screen. Data analysis by the answer recommendation system 200 proceeds at the same time as the "inquiry analysis START" button is clicked, and when the analysis is completed, the "inquiry analysis START" button is changed to a "inquiry analysis complete" button.

When the inquiry analysis is completed through the click of the button of the person in charge, recommended answers according to the analyzed result are automatically entered into the answer window as shown in FIG. 6. The first recommended answers are randomly selected and exposed by the answer recommendation system 200 from among a plurality of recommended answers, and may be changed to another answer among the plurality of recommended answers by a person in charge.

In addition, when the inquiry analysis is completed by clicking the button of the person in charge, an information window indicating the emotion type, the inquiry type, and the current weather in the area where the counselor is located is exposed on the right side. Referring to FIG. 7, the emotion type is divided into three stages: friendly (0), dissatisfaction (1), and very angry (2), and the analysis result of the emotion type is displayed as a highlight. The analysis result of the inquiry type is indicated by the type name and reliability value, and the reliability value is indicated by numbers along with a bar-shaped graph.

8 to 11, when a person in charge clicks on the recommended answers displayed in the foreword and ending, a plurality of recommended answers are exposed in a drop-and-down manner. When the person in charge clicks the "refresh" button formed at the top right of the recommendation answer window exposed in a drop-and-down manner, the remaining recommended answers that are not selected are randomly changed. When the person in charge selects a new recommendation answer, the sentence is automatically converted to the selected recommendation answer.

12 is a flowchart illustrating a method of recommending an answer according to an embodiment of the present invention.

Referring to FIG. 12, in the method for recommending answers based on analysis of text content and emotions according to an embodiment of the present invention, the preprocessor 210 collects customers through at least one or more of a plurality of channels 10. Step of extracting the inquiry content data and customer situation data from the inquiry information (S110), the first data analysis unit 220 learns and learns the inquiry type for the inquiry information of the customer based on the natural language processing of the inquiry content data. Based on the result, a first classification model is generated to select a confirmation answer for the inquiry type (S120), and the second data analysis unit 230 determines the emotional state of the customer based on natural language processing on the inquiry content data. The step of learning the emotion type for the user and selecting a response response according to the customer's emotional state by creating a second classification model based on the learned result (S130) and the third data analysis unit 240 analyzing the customer situation data Thus, it may include the step (S140) of generating an emotional answer based on the location of the customer and the time of inquiry.

Referring to FIG. 12, in the method for recommending an answer based on analysis of text content and emotion according to an embodiment of the present invention, the interface controller 250 provides a confirmation response to an inquiry type, a response response according to the customer's emotional state, and an emotional response. It may further include providing a user interface for recommending an answer (S150).

In the step (S150) of providing a user interface according to an embodiment of the present invention, the interface control unit 250 divides the response to the customer's inquiry information into greeting, header, body and ending on the user interface, and The confirmation answer for, the response according to the customer's emotional state can be recommended in the foreword and ending, and the emotional answer in the ending.

13 is a flowchart illustrating a process of selecting a confirmation answer for an inquiry type according to an embodiment of the present invention.

Referring to FIG. 13, in the step of selecting an acknowledgment answer for an inquiry type according to an embodiment of the present invention (S120), the first classification model generation unit 221 uses chi-square statistics to generate inquiry content data. Extracting the effective morphemes for each inquiry type from the text (S210), the effective morphemes extracted by the first classification model generation unit 221 and the words included in the word dictionary for each of the preset inquiry types into one dimension. The step (S220) of performing learning on a feature vector having a feature vector and the confirmation answer selection unit 222 determine the inquiry type for the customer's inquiry information through the first classification model, and based on the determined result, the inquiry type pool ( Pool), by estimating a degree of similarity with candidate answers included in the pool), and selecting the top N (N is a natural number) confirmation answers (S230).

14 is a flow chart illustrating a process of selecting the top N confirmation answers according to an embodiment of the present invention.

Referring to FIG. 14, in the step of selecting the top N (N is a natural number) confirmation answers according to an embodiment of the present invention (S230), the confirmation answer selection unit 222 uses the first classification model. Estimating the reliability value for the inquiry information (S310), the step of selecting the inquiry type pool by comparing the estimated reliability value with a preset reference value by the confirmation answer selection unit 222 (S320) and a confirmation answer selection unit A step (S330) of estimating similarity by vectorizing candidate answers included in the selected query type pool based on whether or not morphemes are included (S330).

15 is a flowchart illustrating a process of selecting a response response according to an emotional state of a customer according to an embodiment of the present invention.

Referring to FIG. 15, in the step of selecting a response response according to a customer's emotional state according to an embodiment of the present invention (S130), the second classification model generation unit 231 uses chi-square statistics to Extracting the effective morphemes for the emotional state from the text of the data (S310), the second classification model generation unit 231 generates feature vectors each having the extracted effective morphemes as one dimension, and whether or not emoticon data is included The step of learning the emotion type by applying a weight to the feature vector based on (S320) and the response-answer selection unit 232 determine the emotion type for the customer's inquiry information through the second classification model, and the determined result It may include the step (S330) of selecting any N (N is a natural number) corresponding answers among candidate answers included in the emotion type pool.

In the step of generating an emotional answer according to an embodiment of the present invention (S140), the third data analysis unit 240 analyzes the location of the customer and the point of inquiries based on the IP information included in the customer situation data, and Emotional answers can be generated based on environmental information about the location of and the point of inquiry.

In connection with the method according to an embodiment of the present invention, the contents of the system 200 described above may be applied. Therefore, in relation to the method, descriptions of the same contents as those of the above-described system 200 have been omitted.

Meanwhile, according to an embodiment of the present invention, a computer-readable recording medium in which a program for executing the above-described method on a computer is recorded may be provided. In other words, the above-described method can be written as a program that can be executed on a computer, and can be implemented in a general-purpose digital computer operating the program using a computer-readable medium. Further, the structure of the data used in the above-described method may be recorded on a computer-readable medium through various means. A recording medium for recording executable computer programs or codes for performing various methods of the present invention should not be understood as including temporary objects such as carrier waves or signals. The computer-readable medium may include a storage medium such as a magnetic storage medium (eg, ROM, floppy disk, hard disk, etc.), and an optical reading medium (eg, CD-ROM, DVD, etc.).

The above description of the present invention is for illustrative purposes only, and those of ordinary skill in the art to which the present invention pertains will be able to understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative and non-limiting in all respects. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. .

10: multiple channels 20: contact terminal
100: customer support system 200: answer recommendation system
210: preprocessor 220: first data analysis unit
221: first classification model generation unit 222: confirmation answer selection unit
230: second data analysis unit 231: second classification model generation unit
232: response answer selection unit 240: third data analysis unit
250: interface control unit

Claims (15)

In the response recommendation system based on text content and sentiment analysis,
A preprocessor for extracting inquiry content data and customer situation data from customer inquiry information collected through at least one of a plurality of channels;
First data for learning the inquiry type for the inquiry information of the customer based on natural language processing of the inquiry content data, and generating a first classification model based on the learned result to select a confirmation answer for the inquiry type Analysis unit;
Learning the emotion type for the customer's emotional state based on natural language processing on the inquiry content data, and generating a second classification model based on the learned result to select a response response according to the customer's emotional state A second data analysis unit; And
A third data analysis unit that analyzes the customer situation data and generates an emotional response based on the location of the customer and the time of inquiry,
The third data analysis unit,
Analyzing the location of the customer and the time of inquiries based on the IP (Internet Protocol: IP) information included in the customer situation data, and generating the emotional response based on the environmental information of the location and the time of the inquiry of the customer Answer recommendation system characterized by.
The method of claim 1,
The first data analysis unit,
Using Chi-square statistic, effective morphemes for each inquiry type are extracted from the text of the inquiry content data, and the extracted valid morphemes and words included in the word dictionary for each preset inquiry type are A first classification model generator for learning feature vectors each having one dimension; And
The first classification model determines the type of inquiry for the customer's inquiry information, and based on the determined result, estimates the degree of similarity with the candidate answers included in the inquiry type pool. Is a natural number) answer recommendation system, characterized in that it comprises a confirmation answer selection unit for selecting the confirmation answers.
The method of claim 2,
The confirmation answer selection unit,
The first classification model estimates a reliability value for the customer's inquiry information, selects an inquiry type pool by comparing the estimated reliability value with a preset reference value, and a candidate included in the selected inquiry type pool An answer recommendation system, characterized in that the answers are vectorized based on whether or not morphemes are included to estimate the similarity.
The method of claim 1,
The second data analysis unit,
Using Chi-square statistic, effective morphemes for emotional states are extracted from the text of the inquiry content data, feature vectors each having the extracted effective morphemes as one dimension are generated, and emoticon data A second classification model generation unit that learns the emotion type by applying a weight to the feature vector based on whether or not is included; And
Based on the second classification model, the emotion type of the customer's inquiry information is determined, and based on the determined result, any N number of candidate answers included in the emotion type pool (N is a natural number) An answer recommendation system comprising a response-answer selection unit for selecting a response response.
delete The method of claim 1,
An answer recommendation system further comprising an interface control unit providing a user interface for recommending a confirmation answer to the inquiry type, a response answer according to a customer's emotional state, and an emotional answer.
The method of claim 6,
The interface control unit,
The response to the customer's inquiry information is divided into greeting, header, body and ending on the user interface,
An answer recommendation system, characterized in that the confirmation answer to the inquiry type is recommended in the foreword, the response answer according to the emotional state of the customer is recommended in the foreword and ending, and the emotional answer in the ending.
In the method of recommending answers based on text content and sentiment analysis,
Extracting, by a preprocessor, inquiry content data and customer situation data from customer inquiry information collected through at least one or more of the plurality of channels;
The first data analysis unit learns the inquiry type for the inquiry information of the customer based on natural language processing on the inquiry content data, and generates a first classification model based on the learned result to provide a confirmation answer for the inquiry type. Screening;
The second data analysis unit learns the emotion type for the customer's emotional state based on natural language processing on the inquiry content data, and generates a second classification model based on the learned result, according to the customer's emotional state. Selecting a corresponding answer; And
A third data analysis unit comprising the step of analyzing the customer situation data to generate an emotional response based on the location of the customer and the time of inquiry,
In the step of generating the emotional answer,
The third data analysis unit analyzes the location and time of inquiries of the customer based on Internet Protocol (IP) information included in the customer situation data, and based on the environmental information on the location and the time of inquiries of the customer, the An answer recommendation method, characterized in that generating an emotional answer.
The method of claim 8,
The step of selecting a confirmation answer for the inquiry type,
Extracting, by a first classification model generation unit, an effective morpheme for each inquiry type from the text of the inquiry content data using chi-square statistic;
Performing, by the first classification model generation unit, learning a feature vector having the extracted effective morphemes and words included in a preset word dictionary for each query type as one dimension; And
The confirmation answer selection unit determines the inquiry type for the inquiry information of the customer through the first classification model, and estimates the similarity with the candidate answers included in the inquiry type pool based on the determined result. Answer recommendation method comprising the step of selecting N (N is a natural number) confirmation answers.
The method of claim 9,
The step of selecting the top N (N is a natural number) confirmation answers,
Estimating a reliability value for the inquiry information of the customer through the first classification model by the confirmation answer selection unit;
Selecting, by the confirmation answer selection unit, an inquiry type pool by comparing the estimated reliability value with a preset reference value; And
And estimating the similarity by vectorizing, by the confirmation answer selection unit, candidate answers included in the selected query type pool based on whether or not a morpheme is included.
The method of claim 8,
The step of selecting a response response according to the customer's emotional state,
Extracting, by a second classification model generation unit, an effective morpheme for an emotional state from the text of the inquiry content data using chi-square statistic;
Generating, by the second classification model generation unit, a feature vector having the extracted effective morphemes as one dimension, and learning the emotion type by applying a weight to the feature vector based on whether or not emoticon data is included; And
The response-answer selection unit determines the emotion type for the customer's inquiry information through the second classification model, and based on the determined result, any N of the candidate answers included in the emotion type pool (N Is a natural number) answer recommendation method comprising the step of selecting a corresponding answer.
delete The method of claim 8,
An answer recommendation method further comprising the step of providing, by the interface controller, a user interface for recommending a confirmation answer to the inquiry type, a response answer according to the customer's emotional state, and an emotional answer.
The method of claim 13,
In the step of providing the user interface,
The interface control unit divides the response to the customer's inquiry information into a greeting, a preface, a body, and an ending on the user interface,
An answer recommendation method, characterized in that the confirmation answer to the inquiry type is recommended in the foreword, the response answer according to the customer's emotional state is recommended in the foreword and ending, and the emotional answer in the ending.
A computer-readable recording medium in which a program for implementing the method of any one of claims 8 to 11, 13 and 14 is recorded.

Images