WO2019232885A1 - Method for testing capabilities of salesman, apparatus, computer device, and storage medium - Google Patents

Method for testing capabilities of salesman, apparatus, computer device, and storage medium Download PDF

Info

Publication number
WO2019232885A1
WO2019232885A1 PCT/CN2018/095025 CN2018095025W WO2019232885A1 WO 2019232885 A1 WO2019232885 A1 WO 2019232885A1 CN 2018095025 W CN2018095025 W CN 2018095025W WO 2019232885 A1 WO2019232885 A1 WO 2019232885A1
Authority
WO
WIPO (PCT)
Prior art keywords
question
salesman
attribute
data
ability
Prior art date
Application number
PCT/CN2018/095025
Other languages
French (fr)
Chinese (zh)
Inventor
金戈
徐亮
肖京
Original Assignee
平安科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 平安科技(深圳)有限公司 filed Critical 平安科技(深圳)有限公司
Publication of WO2019232885A1 publication Critical patent/WO2019232885A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0639Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • G06Q10/06398Performance of employee with respect to a job function
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • G06Q10/105Human resources
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/044Recurrent networks, e.g. Hopfield networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods

Definitions

  • the present application relates to the field of computer technology, and in particular, to a method, an apparatus, a computer device, and a storage medium for testing the ability of a salesman.
  • the ability level of the salesman is determined.
  • This application also provides a device for testing the ability of a salesperson, including:
  • An output module for controlling an output device to output a preset question text
  • An obtaining module configured to obtain an answer text in which a salesperson responds to the question text
  • a obtaining module configured to input the answer text into a preset sentiment analysis model trained based on the LSTM-CNN model and perform calculation to obtain the business sentiment data of the salesman for the question text;
  • a determining module configured to determine the ability level of a salesperson according to the business mood data.
  • the present application further provides a computer device including a memory and a processor, where the memory stores computer-readable instructions, and when the processor executes the computer-readable instructions, implements the steps of any of the foregoing methods.
  • the present application further provides a computer non-volatile readable storage medium having computer-readable instructions stored thereon, which when executed by a processor, implement the steps of the method described in any one of the above.
  • the method, device, computer equipment, and storage medium for testing the ability of a salesperson in this application judge the ability of a salesperson by simulating the chat between the customer and the salesperson, obtaining the questions posed by the customer and the response content of the salesperson, by understanding
  • the salesman's business process is used to judge the salesman's ability.
  • the problems are classified according to the emotion of the problem, and the processing ability of the salesman when facing different problems is correspondingly understood, and the ability of the salesman is more comprehensively judged.
  • FIG. 1 is a schematic flowchart of a method for testing a salesman's ability according to an embodiment of the present application
  • FIG. 2 is a schematic flowchart of step S4 in the method for testing a salesman's ability according to an embodiment of the present application
  • FIG. 4 is a schematic flowchart of step S42 in the above step S4 according to an embodiment of the present application;
  • FIG. 5 is a schematic flowchart of a method for testing a salesman's ability according to an embodiment of the present application
  • FIG. 6 is a schematic flowchart of a method for testing a salesman's ability according to an embodiment of the present application
  • FIG. 7 is a schematic flowchart of a method for testing a salesman's ability according to an embodiment of the present application.
  • FIG. 8 is a schematic block diagram of a structure of an apparatus for testing a salesman's ability according to an embodiment of the present application
  • FIG. 9 is a schematic block diagram of a structure of a determination module of a device for testing a salesman's ability according to an embodiment of the present application.
  • FIG. 10 is a schematic structural block diagram of an acquisition unit of a device for testing a salesman's ability according to an embodiment of the present application.
  • FIG. 11 is a schematic block diagram of a structure of a determining unit of a device for testing a salesman's ability according to an embodiment of the present application;
  • FIG. 12 is a schematic block diagram of a structure of an apparatus for testing a salesman's ability according to an embodiment of the present application.
  • FIG. 13 is a schematic block diagram of a structure of an apparatus for testing a salesman's ability according to an embodiment of the present application.
  • FIG. 14 is a schematic block diagram of a computer device according to an embodiment of the present application.
  • an embodiment of the present application provides a method for testing a salesman's ability, including steps:
  • the main body of the method execution may be a robot, and the output device of the robot includes a display screen and a speaker.
  • the output device displays a preset question text, that is, when the robot starts to test the salesman, the robot displays the question to the salesman through the display screen, or plays the question to the salesman through the speaker.
  • the question text is some questions set by the administrator in advance, or simulated questions asked by customers to understand the company's products, organized into text form, stored in the robot, a memory card is set inside the robot, or stored in the server The robot accesses the server to obtain the question text.
  • these question texts are called for display, either by directly displaying the text on the robot's display, or by converting the question text into an audio file and playing it through a speaker. Different question texts represent different questions.
  • the sentiment analysis model judges emotions based on the words and words of the answer text.
  • the staff first defined a large amount of text with different business sentiment data, and then input a large amount of text and the corresponding business sentiment data into the LSTM-CNN model, so that the LSTM-CNN model was formed.
  • An sentiment analysis model that performs sentiment analysis based on text. After the robot enters the answer text of the salesman into the sentiment analysis model, the business sentiment data corresponding to the answer text of the salesman can be output.
  • step S4 if the business sentiment data is larger, it means that the salesperson's mood is more positive and the corresponding ability level is higher.
  • Business sentiment data is directly proportional to ability levels. Through the preset mapping rules of business sentiment data and business levels, the ability level of the salesman is determined.
  • the above step of determining the ability level of a salesperson based on the business sentiment data includes:
  • the question text is a simulation of a question posed by a customer, and also has a certain emotion, and the emotion of the question is quantified by the question emotion data.
  • each problem is defined as a different type, and each type corresponds to an attribute.
  • the question mood data corresponding to the question text and the attributes corresponding to the question mood data are stored in the memory card in advance by the robot.
  • the robot calls the data in the memory card to obtain question mood data of the question text.
  • Some customers are more prone to emotional excitement and higher requirements.
  • the corresponding speaking emotions will carry some negative emotions.
  • the problem emotional data of the question text is relatively low.
  • the corresponding attributes are negative attributes. Further, the negative attributes include general negative emotions.
  • the question emotional data of this question text is medium, and the corresponding attributes are neutral attributes; some customers are more active and active, The corresponding speaking emotions will have positive and positive emotions.
  • the problem mood data of the question text is relatively high.
  • the corresponding attributes are positive attributes.
  • the positive attributes include general positive attributes and very positive attributes. Determining the level of competence of a salesperson refers to the fact that the same salesperson has different levels of competence when facing different attribute problems.
  • the following table is a question attribute corresponding to question mood data in a specific embodiment:
  • the robot displays at least one question of each question attribute to the salesman, and then receives the reply text of the salesman's reply to all the question property questions. Then calculate the business sentiment data of each reply text, calculate the average value of the business sentiment data of the reply text corresponding to the same question attribute, and then calculate the sum of the average values of the respective question attributes to obtain the corresponding question attributes of the salesman. Ultimate business sentiment data. According to the level corresponding to the final business sentiment data, the salesman is evaluated to the salesman's ability level. Each ability level corresponds to different final business sentiment data. The following table is the result of a robot test on a salesman.
  • the ability level is divided into three levels of low, medium and high.
  • the business mood data corresponding to the low ability level is -0.5 or less (excluding -0.5)
  • the business mood data corresponding to the medium ability level is -0.5 to 0.5
  • the business sentiment data corresponding to the high ability level is above 0.5 (excluding 0.5).
  • the corresponding level of competence of the five problem attributes of the salesman is medium, medium, medium, high, and high.
  • the five numbers are added to obtain 2.2, that is, 2.2 is the final business sentiment data. Then according to 2.2 which specific business level, that is, you can determine which level the salesman belongs to.
  • the final business sentiment data and business level have a set of preset mapping rules.
  • the above is a calculation method for calculating the final business sentiment data, and other calculation methods may also be used to calculate the final business sentiment data.
  • the question text is converted into an encoded unstructured vector Z by an automatic encoder, and a structural variable C is added to the vector Z, and a tag sequence is generated using the LSTM-RNN method.
  • the question text is a question text extracted from a question set of a question frequently asked by a customer, that is, a text sentence in the following figure.
  • the problem text is converted into a vector by the encoder, that is, the text is vectorized.
  • the vectorization process can use the one-hot Representation model.
  • One-hot Representation is to use a very long vector to represent a word, the length of the vector is the size of the dictionary N, each vector has only one dimension is 1, and the remaining dimensions are all 0, the position of 1 indicates the position of the word in the dictionary .
  • This One-hot Representation is stored in a sparse manner, and the vectorization process is very simple.
  • a vector Z is obtained, and then a structural variable C is added on the basis of Z.
  • the purpose of increasing C is to make the structure of the vector Z consistent with the subsequent LSTM model, so that the vector Z can be input to Inside the LSTM-RNN model.
  • the labeled sequence is obtained.
  • discriminator recognizes Mood, get mood data for question text.
  • D represents the training sample space. After training a large number of trained samples through the discriminator, the generation parameters of the discriminator's emotional data for the question text are obtained.
  • the question text is input to the discriminator, and the question mood data of the question text can be obtained through the formula obtained after training.
  • the above-mentioned step of determining the ability level of the salesperson corresponding to the problem attribute according to the problem attribute and the business mood data includes:
  • the question mood data of the multiple questions may be classified according to the question data.
  • the problem sentiment data corresponding to multiple question texts of the same problem attribute and the business sentiment data corresponding to one to one are collected, and the business sentiment data corresponding to multiple same problem attributes is calculated using a normalized formula .
  • the emotional data table of the salesman-robot problem text is obtained as follows:
  • the normalization obtains the following five dimensions of normalized problem sentiment data and business sentiment data:
  • the method includes:
  • the robot sends the problem texts of all the problem attributes to the salesman, and then obtains the capability levels corresponding to all the problem attributes, and each problem attribute corresponds to a capability level. Compare multiple ability levels to get the highest ability level.
  • the highest ability level can be multiple.
  • the target question attribute refers to the question attribute corresponding to the highest ability level.
  • Each question attribute represents a type of customer. The higher the capability level corresponding to the question attribute, the better the salesperson is at communicating with the person corresponding to the question attribute.
  • Different question attributes correspond to question texts presented by customers at different business stages. Therefore, through the salesman's ability level corresponding to different problem attributes, a suitable job position for the salesman can be generated. For example, if the highest ability level of the salesman A is the corresponding negative attribute, the most suitable job information for the salesman A is the position related to handling complaints. The highest ability level of Salesperson B is the corresponding neutral attribute. Therefore, the most suitable position information for Salesperson B is related to the front desk consultation.
  • the steps after determining the ability level of the salesman include:
  • the personal information corresponding to the salesman with the lowest ability level can also be obtained, and the proportion of each characteristic information in the statistics can also be obtained.
  • the applicants with a higher proportion of characteristic information in this program will be eliminated first.
  • the method for testing the salesman's ability of this application is to judge the ability of the salesman by simulating the chat between the customer and the salesman, and obtaining the questions posed by the customer and the response of the salesman.
  • Business process to judge the competence of the salesperson.
  • the problems are classified according to the emotion of the problem, and the processing ability of the salesman when facing different problems is correspondingly understood, and the ability of the salesman is more comprehensively judged.
  • an embodiment of the present application further provides a device for testing a salesman's ability, including:
  • a first obtaining module 2 configured to obtain an answer text in which a salesperson responds to the question text
  • the obtaining module 3 is configured to input the answer text into a preset sentiment analysis model trained based on the LSTM-CNN model and perform calculation to obtain the business sentiment data of the salesman for the question text;
  • a determining module 4 is configured to determine a capability level of a salesperson according to the business mood data.
  • the salesman sees the question text, and responds to the question expressed by the question text through input devices such as the keyboard and touch screen.
  • the robot records the answer text entered by the salesman.
  • the first obtaining module 2 saves the answer text in a memory or a server.
  • the first acquisition module 2 converts the voice information into text through speech recognition, and obtains the answer text returned by the salesperson.
  • the staff When training the sentiment analysis model, the staff first defined a large amount of text with different business sentiment data, and then input a large amount of text and the corresponding business sentiment data into the LSTM-CNN model, so that the LSTM-CNN model was formed.
  • An sentiment analysis model that performs sentiment analysis based on text, and then gets module 3 to input the salesman's answer text into the sentiment analysis model, then the business sentiment data corresponding to the salesman's answer text can be output.
  • the determination module 4 determines the ability level of the salesperson.
  • the above determining module 4 further includes:
  • a determining unit 42 is configured to determine an ability level of the salesman corresponding to the problem attribute according to the problem attribute and the business mood data.
  • the question text is a simulation of a question posed by a customer, and also has a certain emotion, and the emotion of the question is quantified by the question emotion data.
  • each problem is defined as a different type, and each type corresponds to an attribute.
  • the question mood data corresponding to the question text and the attributes corresponding to the question mood data are stored in the memory card in advance by the robot.
  • the obtaining unit 41 calls data in the memory card to obtain question mood data of the question text. Some customers are more prone to emotional excitement and higher requirements, and the corresponding speaking emotions will carry some negative emotions.
  • the question emotional data of the question text is relatively low.
  • the obtaining unit 41 obtains the corresponding attributes as negative attributes.
  • Negative attributes include general negative attributes and very negative attributes; some customers are easy-going and have little emotional fluctuations, and the corresponding speaking emotions will tend to be bland.
  • the question mood data of this question text is medium, and the obtaining unit 41 obtains the corresponding attributes are medium sexual attributes; some customers are more active and active, the corresponding speaking emotions will be more positive and positive, the problem emotional data of this question text is relatively high, the corresponding attribute obtained by the acquisition unit 41 is a positive attribute, further, positive Attributes include general positive attributes and very positive attributes. Determining the level of competence of a salesperson refers to the fact that the same salesperson has different levels of competence when facing different attribute problems.
  • the following table is a question attribute corresponding to question mood data in a specific embodiment:
  • the robot displays at least one question of each question attribute to the salesman, and then receives the reply text of the salesman's reply to all the question property questions. Then calculate the business sentiment data of each reply text, calculate the average value of the business sentiment data of the reply text corresponding to the same question attribute, and then calculate the sum of the average values of the respective question attributes to obtain the corresponding question attributes of the salesman. Ultimate business sentiment data. According to the level corresponding to the final business sentiment data, the salesman is evaluated to the salesman's ability level. Each ability level corresponds to different final business sentiment data. The following table is the result of a robot test on a salesman.
  • the same business mood data may correspond to different ability levels.
  • the average value of the business sentiment data corresponding to the five question attributes can be calculated respectively. For example, if the problem attribute is very negative and the business sentiment data is -0.3, then the business sentiment data corresponding to the problem attribute is -0.3. There are two business sentiment data corresponding to the general negative attribute, which is 0.4 and 0.4, then the business sentiment data corresponding to the problem attribute is 0.4. According to this calculation method, the business sentiment data corresponding to the five question attributes are -0.3, 0.4, 0.4, 0.8, 0.9. These five values are the salesman ability levels corresponding to the problem attributes.
  • the ability level is divided into three levels of low, medium and high.
  • the business mood data corresponding to the low ability level is -0.5 or less (excluding -0.5)
  • the business mood data corresponding to the medium ability level is -0.5 to 0.5
  • the business sentiment data corresponding to the high ability level is above 0.5 (excluding 0.5).
  • the corresponding level of competence of the five problem attributes of the salesman is medium, medium, medium, high, and high.
  • the five numbers are added to obtain 2.2, that is, 2.2 is the final business sentiment data.
  • the determining unit 42 can determine which level the salesman belongs to.
  • the final business sentiment data and business level have a set of preset mapping rules.
  • the above is a calculation method for calculating the final business sentiment data, and other calculation methods may also be used to calculate the final business sentiment data.
  • the obtaining unit 41 includes:
  • a conversion subunit 412 configured to pass the discriminator to the marker sequence Turn into problem mood data.
  • the question text is a question text extracted from a question set of a question frequently asked by a customer, that is, a text sentence in the following figure.
  • the sequence subunit 411 converts the question text into a vector through an encoder, that is, vectorizes the text.
  • the vectorization process can use the one-hot Representation model.
  • One-hot Representation is to use a very long vector to represent a word, the length of the vector is the size of the dictionary N, each vector has only one dimension is 1, and the remaining dimensions are all 0, the position of 1 indicates the position of the word in the dictionary .
  • This One-hot Representation is stored in a sparse manner, and the vectorization process is very simple.
  • the sequence subunit 411 vectorizes the problem text through the encoder to obtain a vector Z, and then adds a structural variable C based on Z.
  • the purpose of increasing C is to make the structure of the vector Z consistent with the subsequent LSTM model and make the vector Z can be input into the LSTM-RNN model.
  • the label sequence is obtained
  • the conversion subunit 412 will Input to discriminator, discriminator recognizes Mood, get mood data for question text.
  • D represents the training sample space. After training a large number of trained samples through the discriminator, the generation parameters of the discriminator's emotional data for the question text are obtained.
  • the question text is input to the discriminator, and the question mood data of the question text can be obtained through the formula obtained after training.
  • the above determining unit 42 includes:
  • An obtaining subunit 421, configured to obtain multiple business sentiment data corresponding to multiple question texts of the same question attribute
  • a calculation subunit 422 configured to use a normalization formula to regularly calculate a plurality of the business sentiment data and a plurality of the problem sentiment data for the same problem attribute;
  • the obtaining subunit 423 is configured to obtain the ability level of the salesman corresponding to the problem attribute according to the calculation result.
  • the question sentiment data of the multiple questions can be classified according to the question data, and the acquisition subunit 421 acquires simultaneously multiple business sentiment data corresponding to multiple question texts of the same question attribute.
  • the acquisition subunit 421 collates the problem sentiment data corresponding to multiple question texts of the same problem attribute and the one-to-one corresponding business sentiment data, and the calculation subunit 422 calculates through the normalization formula, Normalized calculation of business sentiment data corresponding to the same problem attribute.
  • the emotional data table of the salesman-robot problem text is obtained as follows:
  • calculation subunit 422 uses the normalization formula
  • the normalization obtains the following five dimensions of normalized problem sentiment data and business sentiment data:
  • the business sentiment data obtained by the salesman responding to the machine sentiment data corresponding to different question texts is calculated, and the sub-unit 423 determines the ability level of the salesman for different question attributes.
  • the problem sentiment data is classified after the regularization, and the corresponding business sentiment data corresponding to the classified problem sentiment data is regularly calculated.
  • a second obtaining module 5 configured to obtain the highest ability level among the ability levels corresponding to the multiple problem attributes of the salesman
  • a generating module 6 is configured to generate position information corresponding to the target problem attribute as the most suitable position information of the salesman according to the target problem attribute corresponding to the highest capability level.
  • the target problem attribute refers to a problem attribute corresponding to the highest ability level.
  • the question texts of all the question attributes are sent to the salesman, and then the ability levels corresponding to all the question attributes are obtained, and each question attribute corresponds to an ability level.
  • the second acquisition module 5 obtains the highest capability level.
  • the highest ability level can be multiple.
  • Each question attribute represents a type of customer. The higher the capability level corresponding to the question attribute, the better the salesperson is at communicating with the person corresponding to the question attribute.
  • Different question attributes correspond to question texts presented by customers at different business stages. Therefore, through the salesman's ability level corresponding to different problem attributes, the generating module 6 can generate a suitable job position for the salesman.
  • the generating module 6 For example, if the highest ability level of the salesperson A is the corresponding negative attribute of the problem attribute, then the generating module 6 generates the most suitable position information for the salesperson A as the position related to handling the complaint. The highest ability level of the salesperson B is the corresponding attribute attribute of the neutral attribute. Then, the generating module 6 generates the most suitable position information for the salesperson B as the front office related consulting position.
  • An adjustment module 7 is configured to adjust the performance score of the salesperson according to the ability level.
  • performance is the desired result of the organization, and it is the effective output of the organization to achieve its goals at different levels.
  • Performance can represent a person's business ability and salesman's emotional data. The higher the enthusiasm for the work, the higher the corresponding performance score.
  • the adjustment module 7 increases the performance score of the salesperson; when the ability level is lower than a certain level, the adjustment module 7 decreases the performance score of the salesperson.
  • the device for testing the salesperson's ability of the present application judges the salesperson's ability by simulating the chat between the customer and the salesperson, and obtaining the questions posed by the customer and the response from the salesperson.
  • the problems are classified according to the emotion of the problem, and the processing ability of the salesman when facing different problems is correspondingly understood, and the ability of the salesman is more comprehensively judged.
  • an embodiment of the present application further provides a computer device.
  • the computer device may be a server, and its internal structure may be as shown in FIG.
  • the computer device includes a processor, a memory, a network interface, and a database connected through a system bus.
  • the computer design processor is used to provide computing and control capabilities.
  • the memory of the computer device includes a non-volatile storage medium and an internal memory.
  • the non-volatile storage medium stores an operating system, computer-readable instructions, and a database.
  • the memory provides an environment for operating systems and computer-readable instructions in a non-volatile storage medium.
  • the database of the computer equipment is used to store data such as models that test the ability of the salesman.
  • the network interface of the computer device is used to communicate with an external terminal through a network connection.
  • the processes of the embodiments of the methods described above are executed.
  • FIG. 14 is only a block diagram of a part of the structure related to the solution of the application, and does not constitute a limitation on the computer equipment to which the solution of the application is applied.
  • An embodiment of the present application further provides a computer non-volatile readable storage medium having computer readable instructions stored thereon.
  • the processes of the embodiments of the methods described above are executed.
  • the above is only a preferred embodiment of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the description of the application and the drawings, or directly or indirectly used in other related The technical fields are equally included in the patent protection scope of this application.

Landscapes

  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Engineering & Computer Science (AREA)
  • Strategic Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Economics (AREA)
  • Physics & Mathematics (AREA)
  • Development Economics (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Educational Administration (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Game Theory and Decision Science (AREA)
  • Data Mining & Analysis (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

Disclosed in the present application are a method for testing the capabilities of a salesman, an apparatus, a computer device, and a storage medium, the method comprising: inputting answer text of a salesman responding to preset question text into an emotion analysis model for calculation so as to obtain service mood data of the salesman, thereby determining the capability level of the salesman. The present application simulates a conversation between a customer and a salesman, and according to response content of the salesman, more objectively evaluates the capabilities of the salesman.

Description

测试业务员能力的方法、装置、计算机设备和存储介质Method, device, computer equipment and storage medium for testing salesman ability
本申请要求于2018年6月6日提交中国专利局、申请号为2018105750106,发明名称为“测试业务员能力的方法、装置、计算机设备和存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on June 6, 2018, with application number 2018105750106, and the invention name is "Methods, Devices, Computer Equipment, and Storage Media for Testing Salesman Competence", and its entire contents Incorporated by reference in this application.
技术领域Technical field
本申请涉及到计算机技术领域,特别是涉及到一种测试业务员能力的方法、装置、计算机设备和存储介质。The present application relates to the field of computer technology, and in particular, to a method, an apparatus, a computer device, and a storage medium for testing the ability of a salesman.
背景技术Background technique
现在针对业务员的业务能力评估,大部分都是基于业务员与客户交流结束后获取客户的反馈,以及业务员的销售业绩来进行评估,这样都是基于业务员的成果来进行能力评估。At present, most of the business ability evaluations of salespeople are based on the feedback obtained by the salesperson after the customer and the sales performance of the salesperson are evaluated. In this way, the ability evaluation is based on the results of the salesperson.
但是业务员在与客户的交流过程中,通过与客户的交流,表达出来的解决问题的能力、表达出来的对客户的情绪,这些都能反映出业务员的业务能力水平。However, in the process of communication with the customer, the salesperson's ability to solve problems and the emotions expressed to the customer through the communication with the customer can all reflect the businessperson's level of business ability.
目前还没有基本业务员与客户的聊天来评判业务员的能力的方法。There is currently no way for the basic salesperson to chat with the customer to judge the ability of the salesperson.
技术问题technical problem
本申请的主要目的为提供一种通过模拟客户与业务员聊天来测试业务员能力的方法、装置、计算机设备和存储介质。The main purpose of this application is to provide a method, a device, a computer device, and a storage medium for testing the ability of a salesperson by simulating a customer chatting with the salesperson.
技术解决方案Technical solutions
为了实现上述发明目的,本申请提出一种测试业务员能力的方法,包括:In order to achieve the above-mentioned object of the invention, a method for testing a salesman's ability is provided in this application, including:
控制输出装置输出预设的问题文本;Controlling the output device to output a preset question text;
获取业务员对所述问题文本进行回复的答案文本;Obtaining the answer text of the salesperson's reply to the question text;
将所述答案文本输入到预设的基于LSTM-CNN模型训练得到的情感分析模型中进行计算,以得到所述业务员针对所述问题文本的业务情绪数据;Inputting the answer text into a preset sentiment analysis model trained based on the LSTM-CNN model and performing calculation to obtain the business sentiment data of the salesman for the question text;
根据所述业务情绪数据,确定业务员的能力等级。According to the business mood data, the ability level of the salesman is determined.
本申请还提供一种测试业务员能力的装置,包括:This application also provides a device for testing the ability of a salesperson, including:
输出模块,用于控制输出装置输出预设的问题文本;An output module for controlling an output device to output a preset question text;
获取模块,用于获取业务员对所述问题文本进行回复的答案文本;An obtaining module, configured to obtain an answer text in which a salesperson responds to the question text;
得到模块,用于将所述答案文本输入到预设的基于LSTM-CNN模型训练得到的情感分析模型中进行计算,以得到所述业务员针对所述问题文本的业务情绪数据;A obtaining module, configured to input the answer text into a preset sentiment analysis model trained based on the LSTM-CNN model and perform calculation to obtain the business sentiment data of the salesman for the question text;
确定模块,用于根据所述业务情绪数据,确定业务员的能力等级。A determining module, configured to determine the ability level of a salesperson according to the business mood data.
本申请还提供一种计算机设备,包括存储器和处理器,所述存储器存储有计算机可读指令,所述处理器执行所述计算机可读指令时实现上述任一项所述方法的步骤。The present application further provides a computer device including a memory and a processor, where the memory stores computer-readable instructions, and when the processor executes the computer-readable instructions, implements the steps of any of the foregoing methods.
本申请还提供一种计算机非易失性可读存储介质,其上存储有计算机可读指令,所述计算机可读指令被 处理器执行时实现上述任一项所述的方法的步骤。The present application further provides a computer non-volatile readable storage medium having computer-readable instructions stored thereon, which when executed by a processor, implement the steps of the method described in any one of the above.
有益效果Beneficial effect
本申请的测试业务员能力的方法、装置、计算机设备和存储介质,通过模拟客户与业务员的聊天,获取模拟客户提出的问题以及业务员的回复内容,来评判业务员的能力,是通过了解业务员的业务过程来进行评判业务员能力。在评判业务员能力时,将问题根据问题情绪进行分类,对应的了解业务员面对不同问题时的处理能力,更全面的评判业务员能力。The method, device, computer equipment, and storage medium for testing the ability of a salesperson in this application judge the ability of a salesperson by simulating the chat between the customer and the salesperson, obtaining the questions posed by the customer and the response content of the salesperson, by understanding The salesman's business process is used to judge the salesman's ability. When judging the ability of the salesman, the problems are classified according to the emotion of the problem, and the processing ability of the salesman when facing different problems is correspondingly understood, and the ability of the salesman is more comprehensively judged.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为本申请一实施例的测试业务员能力的方法的流程示意图;FIG. 1 is a schematic flowchart of a method for testing a salesman's ability according to an embodiment of the present application; FIG.
图2为本申请一实施例的上述测试业务员能力的方法中步骤S4的具体流程示意图;FIG. 2 is a schematic flowchart of step S4 in the method for testing a salesman's ability according to an embodiment of the present application; FIG.
图3为本申请一实施例的上述测试业务员能力的方法中获取问题文本情绪数据的具体流程示意图;FIG. 3 is a schematic diagram of a specific process for obtaining emotional text data of a question in the method for testing the ability of a salesman according to an embodiment of the present application; FIG.
图4为本申请一实施例的上述步骤S4中的步骤S42的具体流程示意图;FIG. 4 is a schematic flowchart of step S42 in the above step S4 according to an embodiment of the present application;
图5为本申请一实施例的测试业务员能力的方法的流程示意图;5 is a schematic flowchart of a method for testing a salesman's ability according to an embodiment of the present application;
图6为本申请一实施例的测试业务员能力的方法的流程示意图;6 is a schematic flowchart of a method for testing a salesman's ability according to an embodiment of the present application;
图7为本申请一实施例的测试业务员能力的方法的流程示意图;7 is a schematic flowchart of a method for testing a salesman's ability according to an embodiment of the present application;
图8为本申请一实施例的测试业务员能力的装置的结构示意框图;8 is a schematic block diagram of a structure of an apparatus for testing a salesman's ability according to an embodiment of the present application;
图9为本申请一实施例的测试业务员能力的装置的确定模块的结构示意框图;9 is a schematic block diagram of a structure of a determination module of a device for testing a salesman's ability according to an embodiment of the present application;
图10为本申请一实施例的测试业务员能力的装置的获取单元的结构示意图框;FIG. 10 is a schematic structural block diagram of an acquisition unit of a device for testing a salesman's ability according to an embodiment of the present application; FIG.
图11为本申请一实施例的测试业务员能力的装置的确定单元的结构示意框图;11 is a schematic block diagram of a structure of a determining unit of a device for testing a salesman's ability according to an embodiment of the present application;
图12为本申请一实施例的测试业务员能力的装置的结构示意框图;FIG. 12 is a schematic block diagram of a structure of an apparatus for testing a salesman's ability according to an embodiment of the present application; FIG.
图13为本申请一实施例的测试业务员能力的装置的结构示意框图;FIG. 13 is a schematic block diagram of a structure of an apparatus for testing a salesman's ability according to an embodiment of the present application; FIG.
图14为本申请一实施例的计算机设备的结构示意框图。FIG. 14 is a schematic block diagram of a computer device according to an embodiment of the present application.
本发明的最佳实施方式Best Mode of the Invention
参照图1,本申请实施例提供一种测试业务员能力的方法,包括步骤:Referring to FIG. 1, an embodiment of the present application provides a method for testing a salesman's ability, including steps:
S1、控制输出装置输出预设的问题文本;S1. Control the output device to output a preset question text;
S2、获取业务员对所述问题文本进行回复的答案文本;S2. Obtain the answer text of the salesperson's reply to the question text;
S3、将所述答案文本输入到预设的基于LSTM-CNN模型训练得到的情感分析模型中进行计算,以得到所述业务员的针对所述问题文本的业务情绪数据;S3. Input the answer text into a preset sentiment analysis model trained based on the LSTM-CNN model and perform calculations to obtain the salesman's business sentiment data for the question text;
S4、根据所述业务情绪数据,确定业务员的能力等级。S4. Determine the ability level of the salesman according to the business mood data.
如上述S1步骤中,该方法执行的主体可以是一个机器人,机器人的输出装置包括显示屏和扬声器。输出装置显示预设的问题文本,即机器人在开始对业务员测试时,通过显示屏显示出题目给业务员回答,或者通过扬声器播放题目给业务员回答。该问题文本是管理员预先设置的一些问题,或者是模拟客户为 了解公司的产品而提出的问题,整理成文本的形式,存储在机器人内部,机器人内部设置有存储卡,或者是存储在服务器,机器人通过访问服务器来获得该问题文本。在需要对业务员进行测试时,调用出这些问题文本进行显示,可以是直接将文本显示在机器人的显示屏上,也可以是将问题文本转换成音频文件后通过扬声器进行播放。不同的问题文本表示不同的问题。As in step S1 above, the main body of the method execution may be a robot, and the output device of the robot includes a display screen and a speaker. The output device displays a preset question text, that is, when the robot starts to test the salesman, the robot displays the question to the salesman through the display screen, or plays the question to the salesman through the speaker. The question text is some questions set by the administrator in advance, or simulated questions asked by customers to understand the company's products, organized into text form, stored in the robot, a memory card is set inside the robot, or stored in the server The robot accesses the server to obtain the question text. When the salesman needs to test, these question texts are called for display, either by directly displaying the text on the robot's display, or by converting the question text into an audio file and playing it through a speaker. Different question texts represent different questions.
如上述S2步骤中,业务员看到问题文本,通过键盘、触屏等输入装置对问题文本所表达的问题进行回复,机器人记录下业务员输入的答案文本。机器人接收到业务员的确认信息后,将答案文本保存在存储器或服务器。在另一具体实施例中,机器人接收业务员输入的语音信号后,通过语音识别,将语音信息转换成文本,得到业务员回复的答案文本。As in step S2 above, the salesman sees the question text, and responds to the question expressed by the question text through input devices such as a keyboard and a touch screen. The robot records the answer text entered by the salesman. After receiving the confirmation from the salesperson, the robot saves the answer text in the memory or server. In another specific embodiment, after the robot receives the voice signal input by the salesperson, the robot converts the voice information into text through speech recognition to obtain the answer text returned by the salesperson.
如上述S3步骤中,LSTM(Long Short-Term Memory)是长短期记忆网络,是一种时间递归神经网络,适合于处理和预测时间序列中间隔和延迟相对较长的重要事件。LSTM是解决长序依赖问题的有效技术。情感分析模型是一个将LSTM-CNN模型经过大量训练后模型,用于将输入的文本信息经一系列计算后得出一个数据,该数据是业务情绪数据,即表达业务员的态度感情的数据。消极和积极是两个对立面的感情。数据越大,表示越积极;数据越小,表示越消极。情感分析模型是根据答案文本的字、词来判断情绪的。在训练该情感分析模型时,工作人员先将大量的文本定义不同的业务情绪数据,然后将大量的文本以及对应的业务情绪数据分别输入到LSTM-CNN模型中,使得该LSTM-CNN模型形成了一个根据文本来进行情绪分析的情感分析模型,之后机器人将业务员的答案文本输入到该情感分析模型中后,即可以输出该业务员的答案文本对应的业务情绪数据。As in the above S3 step, LSTM (Long Short-Term Memory) is a long-short-term memory network, which is a kind of time-recurrent neural network, which is suitable for processing and predicting important events with relatively long intervals and delays in the time series. LSTM is an effective technique for solving long-order dependence problems. The sentiment analysis model is a model after a large amount of training of the LSTM-CNN model, which is used to obtain a data after a series of calculations on the input text information. The data is business sentiment data, that is, data that expresses the attitudes and feelings of the salesperson. Negative and positive are two opposing feelings. The larger the data, the more positive; the smaller the data, the more negative. The sentiment analysis model judges emotions based on the words and words of the answer text. When training the sentiment analysis model, the staff first defined a large amount of text with different business sentiment data, and then input a large amount of text and the corresponding business sentiment data into the LSTM-CNN model, so that the LSTM-CNN model was formed. An sentiment analysis model that performs sentiment analysis based on text. After the robot enters the answer text of the salesman into the sentiment analysis model, the business sentiment data corresponding to the answer text of the salesman can be output.
如上述S4步骤中,如果业务情绪数据越大,表示业务员的情绪越积极,对应的能力等级越高。业务情绪数据与能力等级成正比。通过预设的业务情绪数据与业务等级的映射规则,确定业务员的能力等级。As in the above step S4, if the business sentiment data is larger, it means that the salesperson's mood is more positive and the corresponding ability level is higher. Business sentiment data is directly proportional to ability levels. Through the preset mapping rules of business sentiment data and business levels, the ability level of the salesman is determined.
参照图2,进一步地,上述根据所述业务情绪数据,确定业务员的能力等级的步骤,包括:Referring to FIG. 2, further, the above step of determining the ability level of a salesperson based on the business sentiment data includes:
S41、获取所述问题文本的问题情绪数据,并根据所述问题情绪数据确定对应的问题属性,其中所述问题属性至少包括消极属性、中性属性和积极属性;S41. Obtain question mood data of the question text, and determine corresponding question attributes according to the question mood data, where the question attributes include at least a negative attribute, a neutral attribute, and a positive attribute;
S42、根据所述问题属性以及所述业务情绪数据,确定所述业务员对应所述问题属性的能力等级。S42. Determine the ability level of the salesperson corresponding to the problem attribute according to the problem attribute and the business mood data.
本实施例中,问题文本是模拟客户提出的问题,也是带有一定的情绪的,问题的情绪通过问题情绪数据进行量化。根据量化的结果,将各问题进行分别定义为不同的类型,每个类型对应的是一个属性。问题文本对应的问题情绪数据,问题情绪数据对应的属性等这些数据均是机器人事先存储在内存卡里的。机器人调用该内存卡内的数据,获取问题文本的问题情绪数据。有的客户比较容易情绪激动,要求比较高,对应的说话的情绪会带有一些消极的情绪,该问题文本的问题情绪数据比较低,对应的属性是消极属性,进一步地,消极属性包括一般消极属性和非常消极属性;有的客户性格随和,情绪波动不大,对应的说话情绪会偏于平淡,该问题文本的问题情绪数据中等,对应的属性是中性属性;有的客户比较积 极活泼,对应的说话情绪会比较带有积极正向的情绪,该问题文本的问题情绪数据比较高,对应的属性是积极属性,进一步地,积极属性包括一般积极属性和非常积极属性。确定业务员的能力等级,是指同一个业务员面对不同的属性问题而所具有不同的能力等级。如下表是一个具体实施例中的问题情绪数据对应的问题属性:In this embodiment, the question text is a simulation of a question posed by a customer, and also has a certain emotion, and the emotion of the question is quantified by the question emotion data. According to the quantified results, each problem is defined as a different type, and each type corresponds to an attribute. The question mood data corresponding to the question text and the attributes corresponding to the question mood data are stored in the memory card in advance by the robot. The robot calls the data in the memory card to obtain question mood data of the question text. Some customers are more prone to emotional excitement and higher requirements. The corresponding speaking emotions will carry some negative emotions. The problem emotional data of the question text is relatively low. The corresponding attributes are negative attributes. Further, the negative attributes include general negative emotions. Attributes and very negative attributes; some customers are easy-going and have little emotional fluctuations, and the corresponding speaking emotions will tend to be flat. The question emotional data of this question text is medium, and the corresponding attributes are neutral attributes; some customers are more active and active, The corresponding speaking emotions will have positive and positive emotions. The problem mood data of the question text is relatively high. The corresponding attributes are positive attributes. Further, the positive attributes include general positive attributes and very positive attributes. Determining the level of competence of a salesperson refers to the fact that the same salesperson has different levels of competence when facing different attribute problems. The following table is a question attribute corresponding to question mood data in a specific embodiment:
Figure PCTCN2018095025-appb-000001
Figure PCTCN2018095025-appb-000001
在测试时,机器人将各个问题属性的问题分别至少展示一个给业务员,然后接收业务员对所有的问题属性的问题回复的回复文本。然后计算出各回复文本的业务情绪数据,计算属于同一问题属性对应的回复文本的业务情绪数据的平均值,然后将各问题属性对应的平均值计算总和,分别得到业务员的各问题属性对应的最终业务情绪数据。再根据最终业务情绪数据对应的等级给业务员进行评定业务员的能力等级。每个能力等级对应不同的最终业务情绪数据。下表是机器人对一个业务员测试的结果。During the test, the robot displays at least one question of each question attribute to the salesman, and then receives the reply text of the salesman's reply to all the question property questions. Then calculate the business sentiment data of each reply text, calculate the average value of the business sentiment data of the reply text corresponding to the same question attribute, and then calculate the sum of the average values of the respective question attributes to obtain the corresponding question attributes of the salesman. Ultimate business sentiment data. According to the level corresponding to the final business sentiment data, the salesman is evaluated to the salesman's ability level. Each ability level corresponds to different final business sentiment data. The following table is the result of a robot test on a salesman.
问题文本Question text 问题情绪数据Problem mood data 问题属性Problem attributes 业务情绪数据Business sentiment data
问题文本1Question text 1 -0.8-0.8 非常消极Very negative -0.3-0.3
问题文本2Question text 2 -0.4-0.4 一般消极Generally negative 0.40.4
问题文本3 Question text 3 0.30.3 中性neutral 0.80.8
问题文本4 Question text 4 0.90.9 非常积极Very positive 0.90.9
问题文本5 Question text 5 0.40.4 一般积极Generally positive 0.80.8
问题文本6 Question text 6 00 中性neutral 00
问题文本7Question text 7 -0.4-0.4 一般消极Generally negative 0.40.4
上述实施例中,根据不同的问题属性,相同的业务情绪数据可能对应不同的能力等级。在一个实施例中,如上表所示,可以分别计算出5个问题属性分别对应的业务情绪数据的平均值。例如,问题属性为非常消极对应的业务情绪数据有一个,是-0.3,则该问题属性对应的业务情绪数据是-0.3。问题属性为一般消极对应的业务情绪数据有两个,是0.4和0.4,则该问题属性对应的业务情绪数据是0.4。依此计算方法,分别得出五个问题属性对应的业务情绪数据,是-0.3、0.4、0.4、0.8、0.9。则这五个数值分别是对应问题属性的业务员能力等级。在一具体实施例中,能力等级分为低、中、高三个等级,低能力等级对应的业务情绪数据是-0.5以下(不包含-0.5),中能力等级对应的业务情绪数据是-0.5到0.5,高能力等级对应的业务情绪数据是0.5以上(不包含0.5)。则该业务员的五个问题属性分别对应的能力等级是中、中、中、高、高。In the above embodiment, according to different problem attributes, the same business mood data may correspond to different ability levels. In one embodiment, as shown in the above table, the average value of the business sentiment data corresponding to the five question attributes can be calculated respectively. For example, if the problem attribute is very negative and the business sentiment data is -0.3, then the business sentiment data corresponding to the problem attribute is -0.3. There are two business sentiment data corresponding to the general negative attribute, which is 0.4 and 0.4, then the business sentiment data corresponding to the problem attribute is 0.4. According to this calculation method, the business sentiment data corresponding to the five question attributes are -0.3, 0.4, 0.4, 0.8, 0.9. These five values are the salesman ability levels corresponding to the problem attributes. In a specific embodiment, the ability level is divided into three levels of low, medium and high. The business mood data corresponding to the low ability level is -0.5 or less (excluding -0.5), and the business mood data corresponding to the medium ability level is -0.5 to 0.5, the business sentiment data corresponding to the high ability level is above 0.5 (excluding 0.5). Then the corresponding level of competence of the five problem attributes of the salesman is medium, medium, medium, high, and high.
在另一具体实施例中,将这五个数相加得到2.2,即2.2为最终业务情绪数据。再根据2.2是属于具体哪个业务等级,即可以判断业务员是属于哪个级别的。最终业务情绪数据与业务等级有一套预设的映射规则。In another specific embodiment, the five numbers are added to obtain 2.2, that is, 2.2 is the final business sentiment data. Then according to 2.2 which specific business level, that is, you can determine which level the salesman belongs to. The final business sentiment data and business level have a set of preset mapping rules.
上述是计算最终业务情绪数据的一个计算方法,也可以通过其他计算方法计算最终业务情绪数据。The above is a calculation method for calculating the final business sentiment data, and other calculation methods may also be used to calculate the final business sentiment data.
参照图3,进一步地,上述获取问题文本的问题情绪数据的步骤,包括:Referring to FIG. 3, further, the step of obtaining question mood data of the question text includes:
S411、通过自动编码器将所述问题文本转化为编码无结构的向量Z,并在所述向量Z的基础上增加结构性变量C,采用LSTM-RNN方法生成标记序列
Figure PCTCN2018095025-appb-000002
S411. The question text is converted into an encoded unstructured vector Z by an automatic encoder, and a structural variable C is added to the vector Z, and a tag sequence is generated using the LSTM-RNN method.
Figure PCTCN2018095025-appb-000002
S412、通过辨别器,将所述标记序列
Figure PCTCN2018095025-appb-000003
转换成问题情绪数据。
S412. Pass the marker sequence through a discriminator.
Figure PCTCN2018095025-appb-000003
Turn into problem mood data.
本实施例中,问题文本是来自客户经常提出的问题的问题集里抽取出来的问题文本,即下图中的文本语句。将问题文本通过编码器转换成向量,即将文本向量化。向量化的过程可以用one-hot Representation模型。One-hot Representation就是用一个很长的向量来表示一个词,向量长度为词典的大小N,每个向量只有一个维度为1,其余维度全部为0,为1的位置表示该词语在词典的位置。这种One-hot Representation采用稀疏方式存储,向量化的过程非常的简洁。将问题文本通过编码器向量化后,得到向量Z,然后在Z的基础上增加结构性变量C,增加C的目的是为了使向量Z的结构与后面的LSTM模型一致,使向量Z可以输入到LSTM-RNN模型里面去。通过LSTM—RNN模型输入后得到标记序列
Figure PCTCN2018095025-appb-000004
然后将
Figure PCTCN2018095025-appb-000005
输入到辨别器,辨别器辨别出
Figure PCTCN2018095025-appb-000006
的情绪,得到问题文本的情绪数据。其中,辨别器的训练过程为采用带有标签的句子样本训练X L={(X L,C L)},获取辨别器的参数θ D
In this embodiment, the question text is a question text extracted from a question set of a question frequently asked by a customer, that is, a text sentence in the following figure. The problem text is converted into a vector by the encoder, that is, the text is vectorized. The vectorization process can use the one-hot Representation model. One-hot Representation is to use a very long vector to represent a word, the length of the vector is the size of the dictionary N, each vector has only one dimension is 1, and the remaining dimensions are all 0, the position of 1 indicates the position of the word in the dictionary . This One-hot Representation is stored in a sparse manner, and the vectorization process is very simple. After the problem text is vectorized by the encoder, a vector Z is obtained, and then a structural variable C is added on the basis of Z. The purpose of increasing C is to make the structure of the vector Z consistent with the subsequent LSTM model, so that the vector Z can be input to Inside the LSTM-RNN model. After entering the LSTM-RNN model, the labeled sequence is obtained
Figure PCTCN2018095025-appb-000004
Then
Figure PCTCN2018095025-appb-000005
Input to discriminator, discriminator recognizes
Figure PCTCN2018095025-appb-000006
Mood, get mood data for question text. Among them, the training process of the discriminator is to train X L = {(X L , C L )} with labeled sentence samples, and obtain the parameter θ D of the discriminator:
Figure PCTCN2018095025-appb-000007
Figure PCTCN2018095025-appb-000007
上述公式中,D代表训练的样本空间。将大量训练的样本通过辨别器训练后,得出辨别器对于问题文本的情绪数据的生成参数。在获取问题文本的问题情绪数据时,将问题文本输入到辨别器,通过训练后得到的公式即可得到该问题文本的问题情绪数据。In the above formula, D represents the training sample space. After training a large number of trained samples through the discriminator, the generation parameters of the discriminator's emotional data for the question text are obtained. When obtaining the question mood data of the question text, the question text is input to the discriminator, and the question mood data of the question text can be obtained through the formula obtained after training.
参照图4,进一步地,上述根据所述问题属性以及所述业务情绪数据,确定所述业务员对应所述问题属性的能力等级的步骤,包括:Referring to FIG. 4, further, the above-mentioned step of determining the ability level of the salesperson corresponding to the problem attribute according to the problem attribute and the business mood data includes:
S421、获取同一问题属性的多个所述问题文本分别对应的多个业务情绪数据;S421. Obtain multiple business emotion data corresponding to multiple question texts of the same question attribute;
S422、利用规整化公式,将针对同一所述问题属性的多个所述业务情绪数据以及多个所述问题情绪数据规整化计算;S422. Use a regularization formula to regularly calculate a plurality of the business mood data and a plurality of the question mood data for the same question attribute;
S423、根据计算结果,得到同一所述问题属性对应的所述业务员的能力等级。S423. Obtain the capability level of the salesman corresponding to the same problem attribute according to the calculation result.
本实施例中,业务员回答多个问题后,多个问题的问题情绪数据可以根据问题数据进行分类。通过聚类的方法,将同一问题属性的多个问题文本对应的问题情绪数据和与之一一对应的业务情绪数据整理到一起,将多个同一问题属性对应的业务情绪数据利用规整化公式计算。例如,通过机器人与业务员之间的交流,得到业务员-机器人问题文本的情绪化数据表如下:In this embodiment, after the salesman answers multiple questions, the question mood data of the multiple questions may be classified according to the question data. Through clustering, the problem sentiment data corresponding to multiple question texts of the same problem attribute and the business sentiment data corresponding to one to one are collected, and the business sentiment data corresponding to multiple same problem attributes is calculated using a normalized formula . For example, through the communication between the robot and the salesman, the emotional data table of the salesman-robot problem text is obtained as follows:
问题情绪数据/MmProblem mood data / Mm -0.8-0.8 -0.4-0.4 0.30.3 0.90.9 0.40.4 00 -0.4-0.4
业务情绪数据/YmBusiness sentiment data / Ym -0.3-0.3 0.40.4 0.80.8 0.90.9 0.80.8 00 0.40.4
然后利用规整化公式,Then use the normalized formula,
Figure PCTCN2018095025-appb-000008
Figure PCTCN2018095025-appb-000008
Figure PCTCN2018095025-appb-000009
Figure PCTCN2018095025-appb-000009
其中i∈j判断方式:
Figure PCTCN2018095025-appb-000010
round函数表四舍五入示,|Ym j|≤1。
Where i∈j judgment mode:
Figure PCTCN2018095025-appb-000010
The round function table is rounded off, | Ym j | ≤1.
规整化得到如下五个维度的规整后的问题情绪数据和业务情绪数据:The normalization obtains the following five dimensions of normalized problem sentiment data and business sentiment data:
问题情绪数据/MmProblem mood data / Mm -1-1 -0.5-0.5 00 0.50.5 11
业务情绪数据/YmBusiness sentiment data / Ym -0.500-0.500 0.2750.275 0.50.5 0.9370.937 0.9440.944
如此,计算得出业务员分别应对不同问题文本对应的机器情绪数据得出的业务情绪数据,分别对不同的问题属性,判断业务员所处的能力等级。通过规整后将问题情绪数据进行了分类,对应的将分类后的问题情绪数据对应的业务情绪数据进行规整计算。In this way, the business sentiment data obtained from the salesman's response to the machine sentiment data corresponding to different question texts is calculated, and the ability level of the salesman is determined for different problem attributes. The problem sentiment data is classified after the regularization, and the corresponding business sentiment data corresponding to the classified problem sentiment data is regularly calculated.
参照图5,进一步地,上述根据所述问题属性以及所述业务情绪数据,确定所述业务员对应所述问题属性的能力等级的步骤之后,包括:Referring to FIG. 5, further, after the step of determining the ability level of the salesperson corresponding to the problem attribute according to the problem attribute and the business mood data, the method includes:
S5、获取所述业务员的多个问题属性分别对应的能力等级中的最高能力等级;S5. Obtain the highest capability level among the capability levels corresponding to the multiple problem attributes of the salesman;
S6、根据所述最高能力等级对应的目标问题属性,生成所述目标问题属性对应的岗位信息作为所述业务员的最合适岗位信息。S6. According to the target problem attribute corresponding to the highest ability level, generating position information corresponding to the target problem attribute as the most suitable position information of the salesman.
如上述步骤S5所述,机器人将所有问题属性的问题文本均发送给业务员,进而得到所有问题属性对应的能力等级,每个问题属性对应有一个能力等级。将多个能力等级进行比较,得到最高能力等级。最高能力等级可以是多个。As described in step S5 above, the robot sends the problem texts of all the problem attributes to the salesman, and then obtains the capability levels corresponding to all the problem attributes, and each problem attribute corresponds to a capability level. Compare multiple ability levels to get the highest ability level. The highest ability level can be multiple.
如上述步骤S6所述,目标问题属性是指与最高能力等级对应的问题属性。每个问题属性代表的是一种类型的客户,问题属性对应的能力等级越高,说明业务员越擅长与该问题属性对应的人交流。不同问题属性与客户在不同的业务阶段表现出来的问题文本分别对应。因此,通过业务员在不同问题属性对应的能力等级之间,可以生成业务员适合的工作岗位。比如,甲业务员的最高能力等级是对应的消极属性的问题属性,则生成甲业务员最合适岗位信息是处理投诉相关的岗位。乙业务员的最高能力等级是对应的中性属性的问题属性,则生成乙业务员最合适岗位信息是前台咨询相关的岗位。As described in step S6 above, the target question attribute refers to the question attribute corresponding to the highest ability level. Each question attribute represents a type of customer. The higher the capability level corresponding to the question attribute, the better the salesperson is at communicating with the person corresponding to the question attribute. Different question attributes correspond to question texts presented by customers at different business stages. Therefore, through the salesman's ability level corresponding to different problem attributes, a suitable job position for the salesman can be generated. For example, if the highest ability level of the salesman A is the corresponding negative attribute, the most suitable job information for the salesman A is the position related to handling complaints. The highest ability level of Salesperson B is the corresponding neutral attribute. Therefore, the most suitable position information for Salesperson B is related to the front desk consultation.
参照图6,进一步地,所述确定业务员的能力等级之后的步骤包括:Referring to FIG. 6, further, the steps after determining the ability level of the salesman include:
S7、根据所述能力等级,调整所述业务员的绩效分数。S7. Adjust the performance score of the salesperson according to the ability level.
如上述步骤S7所述,绩效,从管理学的角度看,是组织期望的结果,是组织为实现其目标而展现在不同层面上的有效输出,绩效能表现一个人的业务能力,业务员的情绪数据越高,说明其工作的积极 性越高,对应的绩效分数也越高的。当能力等级高于一定等级时,提高业务员的绩效分数;当能力等级低于一定等级时,降低业务员的绩效分数。As described in step S7 above, performance, from a management perspective, is the desired result of the organization, and is the effective output of the organization at different levels in order to achieve its goals. Performance can represent a person's business ability. The higher the mood data, the higher the enthusiasm for the work, and the higher the corresponding performance score. When the ability level is higher than a certain level, the performance score of the salesperson is improved; when the ability level is lower than a certain level, the performance score of the salesperson is reduced.
参照图7,进一步地,上述业务员包括多个;上述确定业务员的能力等级之后的步骤包括:Referring to FIG. 7, further, the above-mentioned salesman includes a plurality; the above steps after determining the ability level of the salesman include:
S8、获取多个业务员分别对应的能力等级中能力等级最高的目标业务员的个人信息,所述个人信息中包括多个特征信息;S8. Obtain personal information of a target salesperson with the highest capability level among the respective capability levels corresponding to multiple salespersons, where the personal information includes multiple characteristic information;
S9、统计所述多个业务员对应的个人信息中指定的特征信息的数量。S9. Count the number of characteristic information specified in the personal information corresponding to the multiple salespersons.
如上述步骤S8所述,机器人获取多个能力等级为最高级的业务员的个人信息。个人信息包括多个特征,例如性别特征、年龄特征、血型特征、最高学历特征、籍贯特征等。业务员在进行能力测试前,需要输入个人的账户信息,账户信息就包括了业务员的个人信息,机器人调用业务员的账户信息里的个人信息。在另一具体实施例中,机器人在测试开始前或结束后弹出填写个人信息的对话框,然后接收业务员输入的个人信息;当结束测试后,若该业务员能力等级是高级,则获取该业务员输入的个人信息;若结束测试后,能力等级不是高级,则不获取该业务员输入的个人信息。As described in step S8 above, the robot obtains personal information of a plurality of salesmen with the highest level of capability. Personal information includes multiple characteristics, such as gender characteristics, age characteristics, blood type characteristics, highest academic qualification characteristics, and hometown characteristics. Before the salesman performs the ability test, he needs to enter personal account information. The account information includes the personal information of the salesman, and the robot calls the personal information in the account information of the salesman. In another specific embodiment, the robot pops up a dialog box for filling in personal information before or after the test starts, and then receives the personal information entered by the salesperson; after the test is over, if the salesperson's ability level is advanced, the robot obtains the Personal information entered by the salesperson; if the ability level is not advanced after the test is completed, the personal information entered by the salesperson is not obtained.
如上述步骤S9所述,个人信息中包含有多个特征,每个特征包括一个特征信息。如性别特征中包括男和女这两个特征信息;年龄特征中包括70后、80后、90后、其它这四个特征信息;血型特征包括O、A、B、AB这四个特征信息。统计指定特征信息的数量,从而找出能力等级为最高级的共同特征,方便工作人员在后期招聘人员时,对比例高的人优先招聘。As described in step S9 above, the personal information includes multiple features, and each feature includes one feature information. For example, the gender characteristics include two characteristics information of male and female; the age characteristics include four characteristic information of post-70s, 80s, 90s, and other; the blood type characteristics include four characteristic information of O, A, B, and AB. Count the number of specified feature information, so as to find common features with the highest level of competence, so that when the staff recruits staff in the later stage, it will be preferred to recruit those with a higher proportion.
进一步地,计算出指定特征信息的数量后,除以最高级的业务员的人数,得到各特征信息的比例。在一具体实施例中,共有1万个业务员参与该测试,输出结果是有两千个等级为最高等级的业务员。然后获取这两千个业务员的个人信息,最终输出一个如下表格:Further, after calculating the number of designated feature information, divide by the number of the most senior salesperson to obtain the proportion of each feature information. In a specific embodiment, a total of 10,000 salespeople participate in the test, and the output result is that there are 2,000 salespeople with the highest rank. Then obtain the personal information of these two thousand salespersons, and finally output a form as follows:
Figure PCTCN2018095025-appb-000011
Figure PCTCN2018095025-appb-000011
机器人统计出该比例后,便于工作人员在后期招聘人员时,对比例高的人优先录取。优先录取90后、O型血的男性应聘人员。After the robot calculates this ratio, it is convenient for the staff to give priority to those with a higher ratio when recruiting staff in the later period. Priority will be given to male applicants with post 90 blood type O blood.
进一步地,同样也可以获取能力等级最低级的业务员对应的个人信息,统计中各特征信息的比例。便于工作人员的招聘时,优先淘汰在该方案中特征信息比例较高的应聘人员。Further, the personal information corresponding to the salesman with the lowest ability level can also be obtained, and the proportion of each characteristic information in the statistics can also be obtained. When facilitating the recruitment of staff, the applicants with a higher proportion of characteristic information in this program will be eliminated first.
综上所述,本申请的测试业务员能力的方法,通过模拟客户与业务员的聊天,获取模拟客户提出的问题以及业务员的回复内容,来评判业务员的能力,是通过了解业务员的业务过程来进行评判业务员能力。在评判业务员能力时,将问题根据问题情绪进行分类,对应的了解业务员面对不同问题时的处理能力,更全面的评判业务员能力。In summary, the method for testing the salesman's ability of this application is to judge the ability of the salesman by simulating the chat between the customer and the salesman, and obtaining the questions posed by the customer and the response of the salesman. Business process to judge the competence of the salesperson. When judging the ability of the salesman, the problems are classified according to the emotion of the problem, and the processing ability of the salesman when facing different problems is correspondingly understood, and the ability of the salesman is more comprehensively judged.
参照图8,本申请实施例中还提供一种测试业务员能力的装置,包括:Referring to FIG. 8, an embodiment of the present application further provides a device for testing a salesman's ability, including:
输出模块1,用于控制输出装置输出预设的问题文本;An output module 1 for controlling an output device to output a preset question text;
第一获取模块2,用于获取业务员对所述问题文本进行回复的答案文本;A first obtaining module 2 configured to obtain an answer text in which a salesperson responds to the question text;
得到模块3,用于将所述答案文本输入到预设的基于LSTM-CNN模型训练得到的情感分析模型中进行计算,以得到所述业务员针对所述问题文本的业务情绪数据;The obtaining module 3 is configured to input the answer text into a preset sentiment analysis model trained based on the LSTM-CNN model and perform calculation to obtain the business sentiment data of the salesman for the question text;
确定模块4,用于根据所述业务情绪数据,确定业务员的能力等级。A determining module 4 is configured to determine a capability level of a salesperson according to the business mood data.
本实施例中的执行主体可以是一个机器人。机器人的输出模块1的输出装置包括显示屏和扬声器。输出装置显示预设的问题文本,即机器人在开始对业务员测试时,输出模块1通过显示屏显示出题目给业务员回答,或者输出模块1通过扬声器播放题目给业务员回答。该问题文本是管理员预先设置的一些问题,或者是模拟客户为了解公司的产品而提出的问题,整理成文本的形式,存储在机器人内部,机器人内部设置有存储卡,或者是存储在服务器,机器人通过访问服务器来获得该问题文本。在需要对业务员进行测试时,调用出这些问题文本进行显示,可以是输出模块1直接将文本显示在机器人的显示屏上,也可以是输出模块1将问题文本转换成音频文件后通过扬声器进行播放。不同的问题文本表示不同的问题。The execution subject in this embodiment may be a robot. The output device of the output module 1 of the robot includes a display screen and a speaker. The output device displays a preset question text, that is, when the robot starts to test the salesman, the output module 1 displays the question to the salesman through the display screen, or the output module 1 plays the question to the salesman through the speaker. The question text is some questions set by the administrator in advance, or simulated questions asked by customers to understand the company's products, organized into text form, stored in the robot, a memory card is set inside the robot, or stored on the server, The robot accesses the server to obtain the question text. When the salesman needs to test, call these question texts for display. The output module 1 can directly display the text on the robot's display, or the output module 1 can convert the question text into an audio file and use the speaker to perform the test. Play. Different question texts represent different questions.
业务员看到问题文本,通过键盘、触屏等输入装置对问题文本所表达的问题进行回复,机器人记录下业务员输入的答案文本。第一获取模块2接收到业务员的确认信息后,将答案文本保存在存储器或服务器。在另一具体实施例中,第一获取模块2接收业务员输入的语音信号后,通过语音识别,将语音信息转换成文本,得到业务员回复的答案文本。The salesman sees the question text, and responds to the question expressed by the question text through input devices such as the keyboard and touch screen. The robot records the answer text entered by the salesman. After receiving the confirmation information from the salesperson, the first obtaining module 2 saves the answer text in a memory or a server. In another specific embodiment, after receiving the voice signal input by the salesperson, the first acquisition module 2 converts the voice information into text through speech recognition, and obtains the answer text returned by the salesperson.
LSTM(Long Short-Term Memory)是长短期记忆网络,是一种时间递归神经网络,适合于处理和预测时间序列中间隔和延迟相对较长的重要事件。LSTM是解决长序依赖问题的有效技术。情感分析模型是一个将LSTM-CNN模型经过大量训练后模型,用于将输入的文本信息经一系列计算后得出一个数据,该数据是业务情绪数据,即表达业务员的态度感情的数据。消极和积极是两个对立面的感情。数据越大,表示越积极;数据越小,表示越消极。情感分析模型是根据答案文本的字、词来判断情绪的。在 训练该情感分析模型时,工作人员先将大量的文本定义不同的业务情绪数据,然后将大量的文本以及对应的业务情绪数据分别输入到LSTM-CNN模型中,使得该LSTM-CNN模型形成了一个根据文本来进行情绪分析的情感分析模型,之后得到模块3将业务员的答案文本输入到该情感分析模型中后,即可以输出该业务员的答案文本对应的业务情绪数据。LSTM (Long Short-Term Memory) is a short-term short-term memory network, a time-recurrent neural network, suitable for processing and predicting important events with relatively long intervals and delays in time series. LSTM is an effective technique for solving long-order dependence problems. The sentiment analysis model is a model after a large amount of training of the LSTM-CNN model, which is used to obtain a data after a series of calculations on the input text information. The data is business sentiment data, that is, data that expresses the attitudes and feelings of the salesperson. Negative and positive are two opposing feelings. The larger the data, the more positive; the smaller the data, the more negative. The sentiment analysis model judges emotions based on the words and words of the answer text. When training the sentiment analysis model, the staff first defined a large amount of text with different business sentiment data, and then input a large amount of text and the corresponding business sentiment data into the LSTM-CNN model, so that the LSTM-CNN model was formed. An sentiment analysis model that performs sentiment analysis based on text, and then gets module 3 to input the salesman's answer text into the sentiment analysis model, then the business sentiment data corresponding to the salesman's answer text can be output.
如果业务情绪数据越大,表示业务员的情绪越积极,对应的能力等级越高。业务情绪数据与能力等级成正比。通过预设的业务情绪数据与业务等级的映射规则,确定模块4确定业务员的能力等级。If the business sentiment data is larger, it means that the salesperson's mood is more positive and the corresponding ability level is higher. Business sentiment data is directly proportional to ability levels. Based on the preset mapping rules of business sentiment data and business levels, the determination module 4 determines the ability level of the salesperson.
参照图9,进一步地,上述确定模块4包括:Referring to FIG. 9, the above determining module 4 further includes:
获取单元41,用于获取所述问题文本的问题情绪数据,并根据所述问题情绪数据确定的问题属性,其中所述问题属性至少包括消极属性、中性属性和积极属性;The obtaining unit 41 is configured to obtain question mood data of the question text, and determine question attributes based on the question mood data, where the question attributes include at least a negative attribute, a neutral attribute, and a positive attribute;
确定单元42,用于根据所述问题属性以及所述业务情绪数据,确定所述业务员对应所述问题属性的能力等级。A determining unit 42 is configured to determine an ability level of the salesman corresponding to the problem attribute according to the problem attribute and the business mood data.
本实施例中,问题文本是模拟客户提出的问题,也是带有一定的情绪的,问题的情绪通过问题情绪数据进行量化。根据量化的结果,将各问题进行分别定义为不同的类型,每个类型对应的是一个属性。问题文本对应的问题情绪数据,问题情绪数据对应的属性等这些数据均是机器人事先存储在内存卡里的。获取单元41调用该内存卡内的数据,获取问题文本的问题情绪数据。有的客户比较容易情绪激动,要求比较高,对应的说话的情绪会带有一些消极的情绪,该问题文本的问题情绪数据比较低,获取单元41获取到对应的属性是消极属性,进一步地,消极属性包括一般消极属性和非常消极属性;有的客户性格随和,情绪波动不大,对应的说话情绪会偏于平淡,该问题文本的问题情绪数据中等,获取单元41获取到对应的属性是中性属性;有的客户比较积极活泼,对应的说话情绪会比较带有积极正向的情绪,该问题文本的问题情绪数据比较高,获取单元41获取到对应的属性是积极属性,进一步地,积极属性包括一般积极属性和非常积极属性。确定业务员的能力等级,是指同一个业务员面对不同的属性问题而所具有不同的能力等级。如下表是一个具体实施例中的问题情绪数据对应的问题属性:In this embodiment, the question text is a simulation of a question posed by a customer, and also has a certain emotion, and the emotion of the question is quantified by the question emotion data. According to the quantified results, each problem is defined as a different type, and each type corresponds to an attribute. The question mood data corresponding to the question text and the attributes corresponding to the question mood data are stored in the memory card in advance by the robot. The obtaining unit 41 calls data in the memory card to obtain question mood data of the question text. Some customers are more prone to emotional excitement and higher requirements, and the corresponding speaking emotions will carry some negative emotions. The question emotional data of the question text is relatively low. The obtaining unit 41 obtains the corresponding attributes as negative attributes. Further, Negative attributes include general negative attributes and very negative attributes; some customers are easy-going and have little emotional fluctuations, and the corresponding speaking emotions will tend to be bland. The question mood data of this question text is medium, and the obtaining unit 41 obtains the corresponding attributes are medium Sexual attributes; some customers are more active and active, the corresponding speaking emotions will be more positive and positive, the problem emotional data of this question text is relatively high, the corresponding attribute obtained by the acquisition unit 41 is a positive attribute, further, positive Attributes include general positive attributes and very positive attributes. Determining the level of competence of a salesperson refers to the fact that the same salesperson has different levels of competence when facing different attribute problems. The following table is a question attribute corresponding to question mood data in a specific embodiment:
Figure PCTCN2018095025-appb-000012
Figure PCTCN2018095025-appb-000012
在测试时,机器人将各个问题属性的问题分别至少展示一个给业务员,然后接收业务员对所有的问题属性的问题回复的回复文本。然后计算出各回复文本的业务情绪数据,计算属于同一问题属性对应的回复文本的业务情绪数据的平均值,然后将各问题属性对应的平均值计算总和,分别得到业务员的各问题属性对应的最终业务情绪数据。再根据最终业务情绪数据对应的等级给业务员进行评定业务员的能力等级。每个能力等级对应不同的最终业务情绪数据。下表是机器人对一个业务员测试的结果。During the test, the robot displays at least one question of each question attribute to the salesman, and then receives the reply text of the salesman's reply to all the question property questions. Then calculate the business sentiment data of each reply text, calculate the average value of the business sentiment data of the reply text corresponding to the same question attribute, and then calculate the sum of the average values of the respective question attributes to obtain the corresponding question attributes of the salesman. Ultimate business sentiment data. According to the level corresponding to the final business sentiment data, the salesman is evaluated to the salesman's ability level. Each ability level corresponds to different final business sentiment data. The following table is the result of a robot test on a salesman.
问题文本Question text 问题情绪数据Problem mood data 问题属性Problem attributes 业务情绪数据Business sentiment data
问题文本1Question text 1 -0.8-0.8 非常消极Very negative -0.3-0.3
问题文本2Question text 2 -0.4-0.4 一般消极Generally negative 0.40.4
问题文本3 Question text 3 0.30.3 中性neutral 0.80.8
问题文本4 Question text 4 0.90.9 非常积极Very positive 0.90.9
问题文本5 Question text 5 0.40.4 一般积极Generally positive 0.80.8
问题文本6 Question text 6 00 中性neutral 00
问题文本7Question text 7 -0.4-0.4 一般消极Generally negative 0.40.4
上述实施例中,根据不同的问题属性,相同的业务情绪数据可能对应不同的能力等级。在一个实施例中,如上表所示,可以分别计算出5个问题属性分别对应的业务情绪数据的平均值。例如,问题属性为非常消极对应的业务情绪数据有一个,是-0.3,则该问题属性对应的业务情绪数据是-0.3。问题属性为一般消极对应的业务情绪数据有两个,是0.4和0.4,则该问题属性对应的业务情绪数据是0.4。依此计算方法,分别得出五个问题属性对应的业务情绪数据,是-0.3、0.4、0.4、0.8、0.9。则这五个数值分别是对应问题属性的业务员能力等级。在一具体实施例中,能力等级分为低、中、高三个等级,低能力等级对应的业务情绪数据是-0.5以下(不包含-0.5),中能力等级对应的业务情绪数据是-0.5到0.5,高能力等级对应的业务情绪数据是0.5以上(不包含0.5)。则该业务员的五个问题属性分别对应的能力等级是中、中、中、高、高。In the above embodiment, according to different problem attributes, the same business mood data may correspond to different ability levels. In one embodiment, as shown in the above table, the average value of the business sentiment data corresponding to the five question attributes can be calculated respectively. For example, if the problem attribute is very negative and the business sentiment data is -0.3, then the business sentiment data corresponding to the problem attribute is -0.3. There are two business sentiment data corresponding to the general negative attribute, which is 0.4 and 0.4, then the business sentiment data corresponding to the problem attribute is 0.4. According to this calculation method, the business sentiment data corresponding to the five question attributes are -0.3, 0.4, 0.4, 0.8, 0.9. These five values are the salesman ability levels corresponding to the problem attributes. In a specific embodiment, the ability level is divided into three levels of low, medium and high. The business mood data corresponding to the low ability level is -0.5 or less (excluding -0.5), and the business mood data corresponding to the medium ability level is -0.5 to 0.5, the business sentiment data corresponding to the high ability level is above 0.5 (excluding 0.5). Then the corresponding level of competence of the five problem attributes of the salesman is medium, medium, medium, high, and high.
在另一具体实施例中,将这五个数相加得到2.2,即2.2为最终业务情绪数据。再根据2.2是属于具体哪个业务等级,确定单元42即可以判断业务员是属于哪个级别的。最终业务情绪数据与业务等级有一套预设的映射规则。In another specific embodiment, the five numbers are added to obtain 2.2, that is, 2.2 is the final business sentiment data. Based on which business level 2.2 belongs to, the determining unit 42 can determine which level the salesman belongs to. The final business sentiment data and business level have a set of preset mapping rules.
上述是计算最终业务情绪数据的一个计算方法,也可以通过其他计算方法计算最终业务情绪数据。The above is a calculation method for calculating the final business sentiment data, and other calculation methods may also be used to calculate the final business sentiment data.
参照图10,进一步地,上述获取单元41包括:Referring to FIG. 10, further, the obtaining unit 41 includes:
序列子单元411,用于通过自动编码器将所述问题文本转化为编码无结构的向量Z,并在所述向量Z的基础上增加结构性变量C,采用LSTM-RNN方法生成标记序列
Figure PCTCN2018095025-appb-000013
A sequence subunit 411 for converting the question text into an encoded unstructured vector Z through an autoencoder, and adding a structural variable C on the basis of the vector Z, and generating a tag sequence using the LSTM-RNN method
Figure PCTCN2018095025-appb-000013
转换子单元412,用于通过辨别器,将所述标记序列
Figure PCTCN2018095025-appb-000014
转换成问题情绪数据。
A conversion subunit 412, configured to pass the discriminator to the marker sequence
Figure PCTCN2018095025-appb-000014
Turn into problem mood data.
本实施例中,问题文本是来自客户经常提出的问题的问题集里抽取出来的问题文本,即下图中的文本语句。序列子单元411将问题文本通过编码器转换成向量,即将文本向量化。向量化的过程可以用one-hot Representation模型。One-hot Representation就是用一个很长的向量来表示一个词,向量长度为词典的大小N,每个向量只有一个维度为1,其余维度全部为0,为1的位置表示该词语在词典的位置。这种One-hot Representation采用稀疏方式存储,向量化的过程非常的简洁。序列子单元411将问题文本通过编码器向量化后,得到向量Z,然后在Z的基础上增加结构性变量C,增加C的目的是为了使向量Z的结构与后面的LSTM模型一致,使向量Z可以输入到LSTM-RNN模型里面去。通过LSTM—RNN 模型输入后得到标记序列
Figure PCTCN2018095025-appb-000015
然后转换子单元412将
Figure PCTCN2018095025-appb-000016
输入到辨别器,辨别器辨别出
Figure PCTCN2018095025-appb-000017
的情绪,得到问题文本的情绪数据。其中,辨别器的训练过程为采用带有标签的句子样本训练X L={(X L,C L)},获取辨别器的参数θ D
In this embodiment, the question text is a question text extracted from a question set of a question frequently asked by a customer, that is, a text sentence in the following figure. The sequence subunit 411 converts the question text into a vector through an encoder, that is, vectorizes the text. The vectorization process can use the one-hot Representation model. One-hot Representation is to use a very long vector to represent a word, the length of the vector is the size of the dictionary N, each vector has only one dimension is 1, and the remaining dimensions are all 0, the position of 1 indicates the position of the word in the dictionary . This One-hot Representation is stored in a sparse manner, and the vectorization process is very simple. The sequence subunit 411 vectorizes the problem text through the encoder to obtain a vector Z, and then adds a structural variable C based on Z. The purpose of increasing C is to make the structure of the vector Z consistent with the subsequent LSTM model and make the vector Z can be input into the LSTM-RNN model. After entering the LSTM-RNN model, the label sequence is obtained
Figure PCTCN2018095025-appb-000015
Then the conversion subunit 412 will
Figure PCTCN2018095025-appb-000016
Input to discriminator, discriminator recognizes
Figure PCTCN2018095025-appb-000017
Mood, get mood data for question text. Among them, the training process of the discriminator is to train X L = {(X L , C L )} with labeled sentence samples, and obtain the parameter θ D of the discriminator:
Figure PCTCN2018095025-appb-000018
Figure PCTCN2018095025-appb-000018
上述公式中,D代表训练的样本空间。将大量训练的样本通过辨别器训练后,得出辨别器对于问题文本的情绪数据的生成参数。在获取问题文本的问题情绪数据时,将问题文本输入到辨别器,通过训练后得到的公式即可得到该问题文本的问题情绪数据。In the above formula, D represents the training sample space. After training a large number of trained samples through the discriminator, the generation parameters of the discriminator's emotional data for the question text are obtained. When obtaining the question mood data of the question text, the question text is input to the discriminator, and the question mood data of the question text can be obtained through the formula obtained after training.
参照图11,进一步地,上述确定单元42包括:Referring to FIG. 11, further, the above determining unit 42 includes:
获取子单元421,用于获取同一问题属性的多个所述问题文本分别对应的多个业务情绪数据;An obtaining subunit 421, configured to obtain multiple business sentiment data corresponding to multiple question texts of the same question attribute;
计算子单元422,用于利用规整化公式,将针对同一所述问题属性的多个所述业务情绪数据以及多个所述问题情绪数据规整化计算;A calculation subunit 422, configured to use a normalization formula to regularly calculate a plurality of the business sentiment data and a plurality of the problem sentiment data for the same problem attribute;
得到子单元423,用于同一根据计算结果,得到所述问题属性对应的所述业务员的能力等级。The obtaining subunit 423 is configured to obtain the ability level of the salesman corresponding to the problem attribute according to the calculation result.
本实施例中,业务员回答多个问题后,多个问题的问题情绪数据可以根据问题数据进行分类,获取子单元421将同一问题属性的多个问题文本分别对应的多个业务情绪数据同时获取。通过聚类的方法,获取子单元421将同一问题属性的多个问题文本对应的问题情绪数据和与之一一对应的业务情绪数据整理到一起,计算子单元422通过规整化公式计算,将多个同一问题属性对应的业务情绪数据规整化计算。例如,通过机器人与业务员之间的交流,得到业务员-机器人问题文本的情绪化数据表如下:In this embodiment, after the salesman answers multiple questions, the question sentiment data of the multiple questions can be classified according to the question data, and the acquisition subunit 421 acquires simultaneously multiple business sentiment data corresponding to multiple question texts of the same question attribute. . Through the clustering method, the acquisition subunit 421 collates the problem sentiment data corresponding to multiple question texts of the same problem attribute and the one-to-one corresponding business sentiment data, and the calculation subunit 422 calculates through the normalization formula, Normalized calculation of business sentiment data corresponding to the same problem attribute. For example, through the communication between the robot and the salesman, the emotional data table of the salesman-robot problem text is obtained as follows:
问题情绪数据/MmProblem mood data / Mm -0.8-0.8 -0.4-0.4 0.30.3 0.90.9 0.40.4 00 -0.4-0.4
业务情绪数据/YmBusiness sentiment data / Ym -0.3-0.3 0.40.4 0.80.8 0.90.9 0.80.8 00 0.40.4
然后计算子单元422利用规整化公式,Then the calculation subunit 422 uses the normalization formula,
Figure PCTCN2018095025-appb-000019
Figure PCTCN2018095025-appb-000019
Figure PCTCN2018095025-appb-000020
Figure PCTCN2018095025-appb-000020
其中i∈j判断方式:
Figure PCTCN2018095025-appb-000021
round函数表四舍五入示,|Ym j|≤1。
Where i∈j judgment mode:
Figure PCTCN2018095025-appb-000021
The round function table is rounded off, | Ym j | ≤1.
规整化得到如下五个维度的规整后的问题情绪数据和业务情绪数据:The normalization obtains the following five dimensions of normalized problem sentiment data and business sentiment data:
问题情绪数据/MmProblem mood data / Mm -1-1 -0.5-0.5 00 0.50.5 11
业务情绪数据/YmBusiness sentiment data / Ym -0.500-0.500 0.2750.275 0.50.5 0.9370.937 0.9440.944
如此,计算得出业务员分别应对不同问题文本对应的机器情绪数据得出的业务情绪数据,得到子单元423分别对不同的问题属性,判断业务员所处的能力等级。通过规整后将问题情绪数据进行了分类,对应的将分类后的问题情绪数据对应的业务情绪数据进行规整计算。In this way, the business sentiment data obtained by the salesman responding to the machine sentiment data corresponding to different question texts is calculated, and the sub-unit 423 determines the ability level of the salesman for different question attributes. The problem sentiment data is classified after the regularization, and the corresponding business sentiment data corresponding to the classified problem sentiment data is regularly calculated.
参照图12,进一步地,上述测试业务员能力的装置,还包括:Referring to FIG. 12, further, the above apparatus for testing a salesman's ability further includes:
第二获取模块5,用于获取所述业务员的多个问题属性分别对应的能力等级中的最高能力等级;A second obtaining module 5 configured to obtain the highest ability level among the ability levels corresponding to the multiple problem attributes of the salesman;
生成模块6,用于根据所述最高能力等级对应的目标问题属性,生成所述目标问题属性对应的岗位信息作为所述业务员的最合适岗位信息。A generating module 6 is configured to generate position information corresponding to the target problem attribute as the most suitable position information of the salesman according to the target problem attribute corresponding to the highest capability level.
本实施例中,目标问题属性是指与最高能力等级对应的问题属性。将所有问题属性的问题文本均发送给业务员,进而得到所有问题属性对应的能力等级,每个问题属性对应有一个能力等级。将多个能力等级进行比较,第二获取模块5得到最高能力等级。最高能力等级可以是多个。每个问题属性代表的是一种类型的客户,问题属性对应的能力等级越高,说明业务员越擅长与该问题属性对应的人交流。不同问题属性与客户在不同的业务阶段表现出来的问题文本分别对应。因此,通过业务员在不同问题属性对应的能力等级之间,生成模块6可以生成业务员适合的工作岗位。比如,甲业务员的最高能力等级是对应的消极属性的问题属性,则生成模块6生成甲业务员最合适岗位信息是处理投诉相关的岗位。乙业务员的最高能力等级是对应的中性属性的问题属性,则生成模块6生成乙业务员最合适岗位信息是前台咨询相关的岗位。In this embodiment, the target problem attribute refers to a problem attribute corresponding to the highest ability level. The question texts of all the question attributes are sent to the salesman, and then the ability levels corresponding to all the question attributes are obtained, and each question attribute corresponds to an ability level. After comparing multiple capability levels, the second acquisition module 5 obtains the highest capability level. The highest ability level can be multiple. Each question attribute represents a type of customer. The higher the capability level corresponding to the question attribute, the better the salesperson is at communicating with the person corresponding to the question attribute. Different question attributes correspond to question texts presented by customers at different business stages. Therefore, through the salesman's ability level corresponding to different problem attributes, the generating module 6 can generate a suitable job position for the salesman. For example, if the highest ability level of the salesperson A is the corresponding negative attribute of the problem attribute, then the generating module 6 generates the most suitable position information for the salesperson A as the position related to handling the complaint. The highest ability level of the salesperson B is the corresponding attribute attribute of the neutral attribute. Then, the generating module 6 generates the most suitable position information for the salesperson B as the front office related consulting position.
参照图13,进一步地,上述测试业务员能力的装置,还包括:Referring to FIG. 13, further, the above apparatus for testing the ability of a salesman further includes:
调整模块7,用于根据所述能力等级,调整所述业务员的绩效分数。An adjustment module 7 is configured to adjust the performance score of the salesperson according to the ability level.
本实施例中,绩效,从管理学的角度看,是组织期望的结果,是组织为实现其目标而展现在不同层面上的有效输出,绩效能表现一个人的业务能力,业务员的情绪数据越高,说明其工作的积极性越高,对应的绩效分数也越高的。当能力等级高于一定等级时,调整模块7提高业务员的绩效分数;当能力等级低于一定等级时,调整模块7降低业务员的绩效分数。In this embodiment, from a management perspective, performance is the desired result of the organization, and it is the effective output of the organization to achieve its goals at different levels. Performance can represent a person's business ability and salesman's emotional data. The higher the enthusiasm for the work, the higher the corresponding performance score. When the ability level is higher than a certain level, the adjustment module 7 increases the performance score of the salesperson; when the ability level is lower than a certain level, the adjustment module 7 decreases the performance score of the salesperson.
综上所述,本申请的测试业务员能力的装置,通过模拟客户与业务员的聊天,获取模拟客户提出的问题以及业务员的回复内容,来评判业务员的能力,是通过了解业务员的业务过程来进行评判业务员能力。在评判业务员能力时,将问题根据问题情绪进行分类,对应的了解业务员面对不同问题时的处理能力,更全面的评判业务员能力。In summary, the device for testing the salesperson's ability of the present application judges the salesperson's ability by simulating the chat between the customer and the salesperson, and obtaining the questions posed by the customer and the response from the salesperson. Business process to judge the competence of the salesperson. When judging the ability of the salesman, the problems are classified according to the emotion of the problem, and the processing ability of the salesman when facing different problems is correspondingly understood, and the ability of the salesman is more comprehensively judged.
参照图14,本申请实施例中还提供一种计算机设备,该计算机设备可以是服务器,其内部结构可以如图14所示。该计算机设备包括通过系统总线连接的处理器、存储器、网络接口和数据库。其中,该计算机设计的处理器用于提供计算和控制能力。该计算机设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作系统、计算机可读指令和数据库。该内存器为非易失性存储介质中的操作系统和计算机可读指令的运行提供环境。该计算机设备的数据库用于存储测试业务员能力的模型等数据。该计算机设备的网络接口用于与外部的终端通过网络连接通信。该计算机可读指令在执行时,执行如上述各方法的实施例的流程。本领域技术人员可以理解,图14中示出的结构,仅仅是与本申请方案相关的部分结构的框图,并不构成对本申请方案所应用于其上的计算机设备的限定。Referring to FIG. 14, an embodiment of the present application further provides a computer device. The computer device may be a server, and its internal structure may be as shown in FIG. The computer device includes a processor, a memory, a network interface, and a database connected through a system bus. Among them, the computer design processor is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer-readable instructions, and a database. The memory provides an environment for operating systems and computer-readable instructions in a non-volatile storage medium. The database of the computer equipment is used to store data such as models that test the ability of the salesman. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer-readable instructions are executed, the processes of the embodiments of the methods described above are executed. Those skilled in the art can understand that the structure shown in FIG. 14 is only a block diagram of a part of the structure related to the solution of the application, and does not constitute a limitation on the computer equipment to which the solution of the application is applied.
本申请一实施例还提供一种计算机非易失性可读存储介质,其上存储有计算机可读指令,该计算机可读指令在执行时,执行如上述各方法的实施例的流程。以上所述仅为本申请的优选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。An embodiment of the present application further provides a computer non-volatile readable storage medium having computer readable instructions stored thereon. When the computer readable instructions are executed, the processes of the embodiments of the methods described above are executed. The above is only a preferred embodiment of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the description of the application and the drawings, or directly or indirectly used in other related The technical fields are equally included in the patent protection scope of this application.

Claims (20)

  1. 一种测试业务员能力的方法,其特征在于,包括:A method for testing the ability of a salesman, which is characterized by:
    控制输出装置输出预设的问题文本;Controlling the output device to output a preset question text;
    获取业务员对所述问题文本进行回复的答案文本;Obtaining the answer text of the salesperson's reply to the question text;
    将所述答案文本输入到预设的基于LSTM-CNN模型训练得到的情感分析模型中进行计算,以得到所述业务员针对所述问题文本的业务情绪数据;Inputting the answer text into a preset sentiment analysis model trained based on the LSTM-CNN model and performing calculation to obtain the business sentiment data of the salesman for the question text;
    根据所述业务情绪数据,确定业务员的能力等级。According to the business mood data, the ability level of the salesman is determined.
  2. 如权利要求1所述的测试业务员能力的方法,其特征在于,所述根据所述业务情绪数据,确定业务员的能力等级的步骤,包括:The method for testing the ability of a salesperson according to claim 1, wherein the step of determining the ability level of a salesperson based on the business sentiment data comprises:
    获取所述问题文本的问题情绪数据,并根据所述问题情绪数据确定对应的问题属性,其中所述问题属性至少包括消极属性、中性属性和积极属性;Acquiring question emotional data of the question text, and determining corresponding question attributes according to the question emotional data, wherein the question attributes include at least a negative attribute, a neutral attribute, and a positive attribute;
    根据所述问题属性以及所述业务情绪数据,确定所述业务员对应所述问题属性的能力等级。Determining the ability level of the salesperson corresponding to the problem attribute according to the problem attribute and the business sentiment data.
  3. 如权利要求2所述的测试业务员能力的方法,其特征在于,所述获取问题文本的问题情绪数据的步骤,包括:The method for testing the ability of a salesperson according to claim 2, wherein the step of obtaining question mood data of the question text comprises:
    通过自动编码器将所述问题文本转化为编码无结构的向量Z,并在所述向量Z的基础上增加结构性变量C,采用LSTM-RNN方法生成标记序列
    Figure PCTCN2018095025-appb-100001
    The question text is converted into an encoded unstructured vector Z by an autoencoder, and a structural variable C is added to the vector Z, and a tag sequence is generated using the LSTM-RNN method
    Figure PCTCN2018095025-appb-100001
    通过辨别器,将所述标记序列
    Figure PCTCN2018095025-appb-100002
    转换成问题情绪数据。
    Mark the sequence through a discriminator
    Figure PCTCN2018095025-appb-100002
    Turn into problem mood data.
  4. 如权利要求2所述的测试业务员能力的方法,其特征在于,所述根据所述问题属性以及所述业务情绪数据,确定所述业务员对应所述问题属性的能力等级的步骤,包括:The method for testing the ability of a salesperson according to claim 2, wherein the step of determining the ability level of the salesperson corresponding to the problem attribute according to the problem attribute and the business mood data comprises:
    获取同一问题属性的多个所述问题文本分别对应的多个业务情绪数据;Acquiring multiple business sentiment data corresponding to multiple question texts of the same question attribute;
    利用规整化公式,将针对同一所述问题属性的多个所述业务情绪数据以及多个所述问题情绪数据规整化计算;Using a normalization formula to regularly calculate a plurality of the business sentiment data and a plurality of the problem sentiment data for the same problem attribute;
    根据计算结果,得到同一所述问题属性对应的所述业务员的能力等级。According to the calculation result, the ability level of the salesman corresponding to the same problem attribute is obtained.
  5. 如权利要求2所述的测试业务员能力的方法,其特征在于,所述根据所述问题属性以及所述业务情绪数据,确定所述业务员对应所述问题属性的能力等级的步骤之后,包括:The method for testing the ability of a salesperson according to claim 2, wherein after the step of determining the ability level of the salesperson corresponding to the problem attribute according to the problem attribute and the business sentiment data, comprising: :
    获取所述业务员的多个问题属性分别对应的能力等级中的最高能力等级;Obtaining the highest capability level among the capability levels corresponding to the multiple problem attributes of the salesman;
    根据所述最高能力等级对应的目标问题属性,生成所述目标问题属性对应的岗位信息作为所述业务员的最合适岗位信息。According to the target problem attribute corresponding to the highest ability level, position information corresponding to the target problem attribute is generated as the most suitable position information of the salesman.
  6. 如权利要求1所述的测试业务员能力的方法,其特征在于,所述确定业务员的能力等级之后的步骤包括:The method for testing the ability of a salesman according to claim 1, wherein the step after determining the ability level of the salesman comprises:
    根据所述能力等级,调整所述业务员的绩效分数。Adjust the performance score of the salesperson according to the ability level.
  7. 一种测试业务员能力的装置,其特征在于,包括:A device for testing the ability of a salesman, which is characterized by including:
    输出模块,用于控制输出装置输出预设的问题文本;An output module for controlling an output device to output a preset question text;
    获取模块,用于获取业务员对所述问题文本进行回复的答案文本;An obtaining module, configured to obtain an answer text in which a salesperson responds to the question text;
    得到模块,用于将所述答案文本输入到预设的基于LSTM-CNN模型训练得到的情感分析模型中进行计算,以得到所述业务员针对所述问题文本的业务情绪数据;A obtaining module, configured to input the answer text into a preset sentiment analysis model trained based on the LSTM-CNN model and perform calculation to obtain the business sentiment data of the salesman for the question text;
    确定模块,用于根据所述业务情绪数据,确定业务员的能力等级。A determining module, configured to determine the ability level of a salesperson according to the business mood data.
  8. 如权利要求7所述的测试业务员能力的装置,其特征在于,所述确定模块包括:The apparatus for testing the ability of a salesperson according to claim 7, wherein the determining module comprises:
    获取单元,用于获取所述问题文本的问题情绪数据,并根据所述问题情绪数据确定的问题属性,其中所述问题属性至少包括消极属性、中性属性和积极属性;An obtaining unit, configured to obtain question mood data of the question text, and determine question attributes based on the question mood data, wherein the question attributes include at least a negative attribute, a neutral attribute, and a positive attribute;
    确定单元,用于根据所述问题属性以及所述业务情绪数据,确定所述业务员对应所述问题属性的能力等级。A determining unit, configured to determine an ability level of the salesperson corresponding to the problem attribute according to the problem attribute and the business mood data.
  9. 如权利要求8所述的测试业务员能力的装置,其特征在于,所述获取单元包括:The apparatus for testing the ability of a salesperson according to claim 8, wherein the obtaining unit comprises:
    序列子单元,用于通过自动编码器将所述问题文本转化为编码无结构的向量Z,并在所述向量Z的基础上增加结构性变量C,采用LSTM-RNN方法生成标记序列
    Figure PCTCN2018095025-appb-100003
    A sequence subunit, for converting the question text into an encoded unstructured vector Z through an autoencoder, and adding a structural variable C based on the vector Z, and generating a tag sequence using the LSTM-RNN method
    Figure PCTCN2018095025-appb-100003
    转换子单元,用于通过辨别器,将所述标记序列
    Figure PCTCN2018095025-appb-100004
    转换成问题情绪数据。
    A transformation subunit for passing the marker sequence through a discriminator
    Figure PCTCN2018095025-appb-100004
    Turn into problem mood data.
  10. 如权利要求8所述的测试业务员能力的装置,其特征在于,所述确定单元包括:The apparatus for testing a salesman's ability according to claim 8, wherein the determining unit comprises:
    获取子单元,用于获取同一问题属性的多个所述问题文本分别对应的多个业务情绪数据;An acquisition subunit, configured to acquire multiple business sentiment data corresponding to multiple question texts of the same question attribute;
    计算子单元,用于利用规整化公式,将针对同一所述问题属性的多个所述业务情绪数据以及多个所述问题情绪数据规整化计算;A calculation subunit, configured to use a regularization formula to regularly calculate a plurality of the business sentiment data and a plurality of the question sentiment data for the same question attribute;
    得到子单元,用于同一根据计算结果,得到所述问题属性对应的所述业务员的能力等级。A subunit is obtained, and is used to obtain the capability level of the salesman corresponding to the problem attribute according to the calculation result.
  11. 如权利要求8所述的测试业务员能力的装置,其特征在于,还包括:The device for testing a salesman's ability according to claim 8, further comprising:
    第二获取模块,用于获取所述业务员的多个问题属性分别对应的能力等级中的最高能力等级;A second acquisition module, configured to acquire the highest capability level among the capability levels corresponding to the multiple problem attributes of the salesman;
    生成模块,用于根据所述最高能力等级对应的目标问题属性,生成所述目标问题属性对应的岗位信息作为所述业务员的最合适岗位信息。A generating module is configured to generate position information corresponding to the target problem attribute as the most suitable position information of the salesman according to the target problem attribute corresponding to the highest capability level.
  12. 如权利要求7所述的测试业务员能力的装置,其特征在于,还包括:The device for testing a salesman's ability according to claim 7, further comprising:
    调整模块,用于根据所述能力等级,调整所述业务员的绩效分数。An adjustment module is configured to adjust a performance score of the salesperson according to the ability level.
  13. 一种计算机设备,包括存储器和处理器,所述存储器存储有计算机可读指令,其特征在于,所述处理器执行所述计算机可读指令时实现测试业务员能力的方法,该测试业务员能力的方法,包括:A computer device includes a memory and a processor, the memory stores computer-readable instructions, and is characterized in that the processor implements a method for testing a salesman's ability when the processor executes the computer-readable instructions, and the test Methods, including:
    控制输出装置输出预设的问题文本;Controlling the output device to output a preset question text;
    获取业务员对所述问题文本进行回复的答案文本;Obtaining the answer text of the salesperson's reply to the question text;
    将所述答案文本输入到预设的基于LSTM-CNN模型训练得到的情感分析模型中进行计算,以得到 所述业务员针对所述问题文本的业务情绪数据;Inputting the answer text into a preset sentiment analysis model trained based on the LSTM-CNN model and performing calculation to obtain the business sentiment data of the salesman for the question text;
    根据所述业务情绪数据,确定业务员的能力等级。According to the business mood data, the ability level of the salesman is determined.
  14. 如权利要求13所述的计算机设备,其特征在于,所述根据所述业务情绪数据,确定业务员的能力等级的步骤,包括:The computer device according to claim 13, wherein the step of determining the ability level of a salesperson based on the business sentiment data comprises:
    获取所述问题文本的问题情绪数据,并根据所述问题情绪数据确定对应的问题属性,其中所述问题属性至少包括消极属性、中性属性和积极属性;Acquiring question emotional data of the question text, and determining corresponding question attributes according to the question emotional data, wherein the question attributes include at least a negative attribute, a neutral attribute, and a positive attribute;
    根据所述问题属性以及所述业务情绪数据,确定所述业务员对应所述问题属性的能力等级。Determining the ability level of the salesperson corresponding to the problem attribute according to the problem attribute and the business sentiment data.
  15. 如权利要求14所述的计算机设备,其特征在于,所述获取问题文本的问题情绪数据的步骤,包括:The computer device according to claim 14, wherein the step of obtaining question mood data of the question text comprises:
    通过自动编码器将所述问题文本转化为编码无结构的向量Z,并在所述向量Z的基础上增加结构性变量C,采用LSTM-RNN方法生成标记序列
    Figure PCTCN2018095025-appb-100005
    The question text is converted into an encoded unstructured vector Z by an autoencoder, and a structural variable C is added to the vector Z, and a tag sequence is generated using the LSTM-RNN method
    Figure PCTCN2018095025-appb-100005
    通过辨别器,将所述标记序列
    Figure PCTCN2018095025-appb-100006
    转换成问题情绪数据。
    Mark the sequence through a discriminator
    Figure PCTCN2018095025-appb-100006
    Turn into problem mood data.
  16. 如权利要求14所述的计算机设备,其特征在于,所述根据所述问题属性以及所述业务情绪数据,确定所述业务员对应所述问题属性的能力等级的步骤,包括:The computer device according to claim 14, wherein the step of determining the ability level of the salesperson corresponding to the problem attribute according to the problem attribute and the business mood data comprises:
    获取同一问题属性的多个所述问题文本分别对应的多个业务情绪数据;Acquiring multiple business sentiment data corresponding to multiple question texts of the same question attribute;
    利用规整化公式,将针对同一所述问题属性的多个所述业务情绪数据以及多个所述问题情绪数据规整化计算;Using a normalization formula to regularly calculate a plurality of the business sentiment data and a plurality of the problem sentiment data for the same problem attribute;
    根据计算结果,得到同一所述问题属性对应的所述业务员的能力等级。According to the calculation result, the ability level of the salesman corresponding to the same problem attribute is obtained.
  17. 一种计算机非易失性可读存储介质,其上存储有计算机可读指令,其特征在于,所述计算机可读指令被处理器执行时实现测试业务员能力的方法,该测试业务员能力的方法,包括:A computer non-volatile readable storage medium having computer-readable instructions stored thereon, characterized in that when the computer-readable instructions are executed by a processor, a method for testing the ability of a salesman is tested, Methods, including:
    控制输出装置输出预设的问题文本;Controlling the output device to output a preset question text;
    获取业务员对所述问题文本进行回复的答案文本;Obtaining the answer text of the salesperson's reply to the question text;
    将所述答案文本输入到预设的基于LSTM-CNN模型训练得到的情感分析模型中进行计算,以得到所述业务员针对所述问题文本的业务情绪数据;Inputting the answer text into a preset sentiment analysis model trained based on the LSTM-CNN model and performing calculation to obtain the business sentiment data of the salesman for the question text;
    根据所述业务情绪数据,确定业务员的能力等级。According to the business mood data, the ability level of the salesman is determined.
  18. 如权利要求17所述的计算机非易失性可读存储介质,其特征在于,所述根据所述业务情绪数据,确定业务员的能力等级的步骤,包括:The computer non-volatile readable storage medium according to claim 17, wherein the step of determining the ability level of a salesperson based on the business sentiment data comprises:
    获取所述问题文本的问题情绪数据,并根据所述问题情绪数据确定对应的问题属性,其中所述问题属性至少包括消极属性、中性属性和积极属性;Acquiring question emotional data of the question text, and determining corresponding question attributes according to the question emotional data, wherein the question attributes include at least a negative attribute, a neutral attribute, and a positive attribute;
    根据所述问题属性以及所述业务情绪数据,确定所述业务员对应所述问题属性的能力等级。Determining the ability level of the salesperson corresponding to the problem attribute according to the problem attribute and the business sentiment data.
  19. 如权利要求18所述的计算机非易失性可读存储介质,其特征在于,所述获取问题文本的问题 情绪数据的步骤,包括:The computer non-volatile readable storage medium according to claim 18, wherein the step of obtaining question mood data of the question text comprises:
    通过自动编码器将所述问题文本转化为编码无结构的向量Z,并在所述向量Z的基础上增加结构性变量C,采用LSTM-RNN方法生成标记序列
    Figure PCTCN2018095025-appb-100007
    The question text is converted into an encoded unstructured vector Z by an autoencoder, and a structural variable C is added to the vector Z, and a tag sequence is generated using the LSTM-RNN method
    Figure PCTCN2018095025-appb-100007
    通过辨别器,将所述标记序列
    Figure PCTCN2018095025-appb-100008
    转换成问题情绪数据。
    Mark the sequence through a discriminator
    Figure PCTCN2018095025-appb-100008
    Turn into problem mood data.
  20. 如权利要求18所述的计算机非易失性可读存储介质,其特征在于,所述根据所述问题属性以及所述业务情绪数据,确定所述业务员对应所述问题属性的能力等级的步骤,包括:The non-volatile computer-readable storage medium of claim 18, wherein the step of determining the ability level of the salesperson corresponding to the problem attribute according to the problem attribute and the business mood data ,include:
    获取同一问题属性的多个所述问题文本分别对应的多个业务情绪数据;Acquiring multiple business sentiment data corresponding to multiple question texts of the same question attribute;
    利用规整化公式,将针对同一所述问题属性的多个所述业务情绪数据以及多个所述问题情绪数据规整化计算;Using a normalization formula to regularly calculate a plurality of the business sentiment data and a plurality of the problem sentiment data for the same problem attribute;
    根据计算结果,得到同一所述问题属性对应的所述业务员的能力等级。According to the calculation result, the ability level of the salesman corresponding to the same problem attribute is obtained.
PCT/CN2018/095025 2018-06-06 2018-07-09 Method for testing capabilities of salesman, apparatus, computer device, and storage medium WO2019232885A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810575010.6 2018-06-06
CN201810575010.6A CN108764753A (en) 2018-06-06 2018-06-06 Test method, apparatus, computer equipment and the storage medium of business personnel's ability

Publications (1)

Publication Number Publication Date
WO2019232885A1 true WO2019232885A1 (en) 2019-12-12

Family

ID=63999139

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/095025 WO2019232885A1 (en) 2018-06-06 2018-07-09 Method for testing capabilities of salesman, apparatus, computer device, and storage medium

Country Status (2)

Country Link
CN (1) CN108764753A (en)
WO (1) WO2019232885A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109408627B (en) * 2018-11-15 2021-03-02 众安信息技术服务有限公司 Question-answering method and system fusing convolutional neural network and cyclic neural network
WO2021075950A1 (en) * 2019-10-14 2021-04-22 Malayan Banking Berhad Data processing for performance assessment and management
CN112131369B (en) * 2020-09-29 2024-02-02 中国银行股份有限公司 Service class determining method and device
CN114781833B (en) * 2022-04-06 2024-02-02 平安科技(深圳)有限公司 Capability assessment method, device and equipment based on business personnel and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107122351A (en) * 2017-05-02 2017-09-01 灯塔财经信息有限公司 A kind of attitude trend analysis method and system applied to stock news field
US20170286867A1 (en) * 2016-04-05 2017-10-05 Battelle Memorial Institute Methods to determine likelihood of social media account deletion
CN107885726A (en) * 2017-11-06 2018-04-06 广州杰赛科技股份有限公司 Customer service quality evaluating method and device
CN108009756A (en) * 2017-12-27 2018-05-08 安徽华久信科技有限公司 A kind of big data talent ability assessment system and method

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105808721A (en) * 2016-03-07 2016-07-27 中国科学院声学研究所 Data mining based customer service content analysis method and system
WO2018097907A1 (en) * 2016-10-20 2018-05-31 Google Llc Answer to question neural networks
CN107452385A (en) * 2017-08-16 2017-12-08 北京世纪好未来教育科技有限公司 A kind of voice-based data evaluation method and device
CN107844889A (en) * 2017-09-28 2018-03-27 镇江睿悦读教育科技有限公司 A kind of system of assessment work ability
CN107944014A (en) * 2017-12-11 2018-04-20 河海大学 A kind of Chinese text sentiment analysis method based on deep learning

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170286867A1 (en) * 2016-04-05 2017-10-05 Battelle Memorial Institute Methods to determine likelihood of social media account deletion
CN107122351A (en) * 2017-05-02 2017-09-01 灯塔财经信息有限公司 A kind of attitude trend analysis method and system applied to stock news field
CN107885726A (en) * 2017-11-06 2018-04-06 广州杰赛科技股份有限公司 Customer service quality evaluating method and device
CN108009756A (en) * 2017-12-27 2018-05-08 安徽华久信科技有限公司 A kind of big data talent ability assessment system and method

Also Published As

Publication number Publication date
CN108764753A (en) 2018-11-06

Similar Documents

Publication Publication Date Title
WO2019232885A1 (en) Method for testing capabilities of salesman, apparatus, computer device, and storage medium
WO2020147428A1 (en) Interactive content generation method and apparatus, computer device, and storage medium
WO2020119030A1 (en) Model training method, device and equipment used for answering questions and storage medium
US20210097468A1 (en) Generating sentiment metrics using emoji selections
KR102415103B1 (en) A device that analyzes psychology based on an artificial intelligence model generated using voice data and text data
US9443193B2 (en) Systems and methods for generating automated evaluation models
WO2022170985A1 (en) Exercise selection method and apparatus, and computer device and storage medium
WO2020000779A1 (en) Method and apparatus for obtaining quality evaluation model, and computer device and storage medium
US20200051451A1 (en) Short answer grade prediction
US20130302775A1 (en) Cluster analysis of participant responses for test generation or teaching
CN112163162A (en) Portrait recognition-based selected course recommendation method, storage medium and electronic equipment
CN112685550B (en) Intelligent question-answering method, intelligent question-answering device, intelligent question-answering server and computer readable storage medium
CN111507573A (en) Business staff assessment method, system, device and storage medium
Hantke et al. Introducing the weighted trustability evaluator for crowdsourcing exemplified by speaker likability classification
CN111444729B (en) Information processing method, device, equipment and readable storage medium
De Wit et al. Can openness to ICT and scientific research predict the ICT skills and ICT use of bachelor's students?
JP6570465B2 (en) Program, apparatus, and method capable of estimating participant's contribution by key words
Lhasiw et al. A bidirectional LSTM model for classifying Chatbot messages
JP7493341B2 (en) Compatibility determination program, device and method using the interaction part of the model, and matching program
Pong-inwong et al. Teaching evaluation using data mining on moodle LMS forum
WO2020155118A1 (en) Teaching test item matching method, apparatus and device
Mahanan et al. College agent: The machine learning chatbot for college tasks
Roebuck et al. The effects of home country, gender, and position on listening behaviors
CN111680134A (en) Method for measuring question-answering consulting information by information entropy
Anamalamudi et al. SmarTy: an intelligent voice response system model for Indian local languages

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18921558

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18921558

Country of ref document: EP

Kind code of ref document: A1