CN110619588A - Scene drilling assessment method and device, storage medium and intelligent equipment - Google Patents
Scene drilling assessment method and device, storage medium and intelligent equipment Download PDFInfo
- Publication number
- CN110619588A CN110619588A CN201910752171.2A CN201910752171A CN110619588A CN 110619588 A CN110619588 A CN 110619588A CN 201910752171 A CN201910752171 A CN 201910752171A CN 110619588 A CN110619588 A CN 110619588A
- Authority
- CN
- China
- Prior art keywords
- drilling
- word
- voice information
- voice
- weight
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000005553 drilling Methods 0.000 title claims abstract description 241
- 238000000034 method Methods 0.000 title claims description 22
- 238000013515 script Methods 0.000 claims abstract description 124
- 230000003993 interaction Effects 0.000 claims abstract description 119
- 230000011218 segmentation Effects 0.000 claims abstract description 65
- 238000011156 evaluation Methods 0.000 claims abstract description 40
- 238000012545 processing Methods 0.000 claims abstract description 24
- 239000011159 matrix material Substances 0.000 claims description 26
- 238000012549 training Methods 0.000 claims description 22
- 238000004590 computer program Methods 0.000 claims description 18
- 230000006870 function Effects 0.000 claims description 14
- 238000013507 mapping Methods 0.000 claims description 12
- 238000012163 sequencing technique Methods 0.000 claims description 11
- 238000010276 construction Methods 0.000 claims description 2
- 238000006243 chemical reaction Methods 0.000 claims 1
- 230000000694 effects Effects 0.000 abstract description 7
- 230000002452 interceptive effect Effects 0.000 abstract description 5
- 230000008569 process Effects 0.000 description 9
- 238000004088 simulation Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
- G06Q50/2057—Career enhancement or continuing education service
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
- G09B5/14—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Physics & Mathematics (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- Human Resources & Organizations (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Economics (AREA)
- General Health & Medical Sciences (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- General Business, Economics & Management (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention provides an evaluation method, an evaluation device, a storage medium and intelligent equipment for scene drilling, wherein the evaluation method comprises the following steps: acquiring a drilling scene selected by a student; acquiring first voice information input by the trainee in the drilling scene; determining a drilling interaction script corresponding to the first voice information; acquiring second voice information of the student; playing feedback information corresponding to the second voice information, and acquiring a preset score of the feedback information; converting the second voice information acquired during the execution of the drilling interactive script into a sentence text, and performing word segmentation processing on the sentence text to obtain each participle forming the sentence text; and evaluating the drill of the trainees according to the preset scores of the feedback information corresponding to each participle of the sentence text and the second voice information. The invention can objectively evaluate the drilling of the trainees, and the trainees can know the drilling effect of the trainees, so that the drilling efficiency is improved.
Description
Technical Field
The invention relates to the technical field of intelligent interaction, in particular to a scene drilling evaluation method, a scene drilling evaluation device, a storage medium and intelligent equipment.
Background
In traditional training of business personnel products, a training teacher provides a script for business personnel to exercise, the script comprises product introduction and relevant questions and answers of products, and the business personnel perform simulation exercise according to the script. However, under the condition of limited resources and time, the professional generally performs the drilling with the teacher or other professional according to the script, and the drilling effect is judged by the teacher or the professional performing together, that is, the evaluation of the drilling effect is subjective and lacks objective basis, and the professional cannot improve the conversation according to the objective drilling result, so that the training efficiency is not high enough.
Disclosure of Invention
The embodiment of the invention provides an evaluation method, an evaluation device, a storage medium and intelligent equipment for scene drilling, and aims to solve the problems that in the prior art, the evaluation of the drilling effect is subjective and lacks objective basis, and a salesman cannot improve own conversation according to an objective drilling result, so that the training efficiency is not high enough.
A first aspect of an embodiment of the present invention provides an evaluation method for scene drilling, including:
acquiring a drilling scene selected by a student;
acquiring first voice information input by the trainee in the drilling scene;
determining a drilling interaction script corresponding to the first voice information from a plurality of drilling interaction scripts corresponding to the drilling scene;
acquiring second voice information of the trainee based on the drilling interaction script corresponding to the first voice information;
playing feedback information corresponding to the second voice information according to the drilling interaction script corresponding to the first voice information, and acquiring a preset score of the feedback information;
after the drilling interaction script is executed, converting a plurality of pieces of second voice information acquired during the execution of the drilling interaction script into a sentence text, and performing word segmentation processing on the sentence text to obtain each participle forming the sentence text;
and evaluating the drill of the trainees according to the preset scores of the feedback information corresponding to each participle of the sentence text and the second voice information.
A second aspect of an embodiment of the present invention provides an apparatus for evaluating scene drilling, including:
the training scene acquisition unit is used for acquiring a training scene selected by the trainee;
the first voice information acquisition unit is used for acquiring first voice information input by the trainee in the drilling scene;
a drilling interaction script determining unit, configured to determine a drilling interaction script corresponding to the first voice information from a plurality of drilling interaction scripts corresponding to the drilling scenes;
the second voice information acquisition unit is used for acquiring second voice information of the trainee based on the drilling interaction script corresponding to the first voice information;
the feedback information acquisition unit is used for playing the feedback information corresponding to the second voice information according to the drilling interaction script corresponding to the first voice information and acquiring the preset score of the feedback information;
the word cutting processing unit is used for converting the second voice information acquired during the execution of the drilling interaction script into a sentence text after the drilling interaction script is executed, and performing word cutting processing on the sentence text to obtain each word segmentation forming the sentence text;
and the drilling evaluation unit is used for evaluating the drilling of the trainees according to the preset scores of the feedback information corresponding to each participle of the sentence text and the second voice information.
A third aspect of an embodiment of the present invention provides an intelligent device, including a memory and a processor, where the memory stores a computer program operable on the processor, and the processor executes the computer program to implement the following steps:
acquiring a drilling scene selected by a student;
acquiring first voice information input by the trainee in the drilling scene;
determining a drilling interaction script corresponding to the first voice information from a plurality of drilling interaction scripts corresponding to the drilling scene;
acquiring second voice information of the trainee based on the drilling interaction script corresponding to the first voice information;
playing feedback information corresponding to the second voice information according to the drilling interaction script corresponding to the first voice information, and acquiring a preset score of the feedback information;
after the drilling interaction script is executed, converting a plurality of pieces of second voice information acquired during the execution of the drilling interaction script into a sentence text, and performing word segmentation processing on the sentence text to obtain each participle forming the sentence text;
and evaluating the drill of the trainees according to the preset scores of the feedback information corresponding to each participle of the sentence text and the second voice information.
A fourth aspect of embodiments of the present invention provides a computer-readable storage medium storing a computer program which, when executed by a processor, implements the steps of:
acquiring a drilling scene selected by a student;
acquiring first voice information input by the trainee in the drilling scene;
determining a drilling interaction script corresponding to the first voice information from a plurality of drilling interaction scripts corresponding to the drilling scene;
acquiring second voice information of the trainee based on the drilling interaction script corresponding to the first voice information;
acquiring a drilling interaction script corresponding to the first voice information, playing feedback information corresponding to the second voice information, and acquiring a preset score of the feedback information;
after the drilling interaction script is executed, converting a plurality of pieces of second voice information acquired during the execution of the drilling interaction script into a sentence text, and performing word segmentation processing on the sentence text to obtain each participle forming the sentence text;
and evaluating the drill of the trainees according to the preset scores of the feedback information corresponding to each participle of the sentence text and the second voice information.
In the embodiment of the invention, through acquiring a drilling scene selected by a trainee, acquiring first voice information input by the trainee in the drilling scene, determining a drilling interaction script corresponding to the first voice information from a plurality of drilling interaction scripts corresponding to the drilling scene, then acquiring second voice information of the trainee based on the drilling interaction script corresponding to the first voice information, namely entering a drilling state, playing feedback information corresponding to the second voice information according to the drilling interaction script corresponding to the first voice information to realize drilling interaction with the trainee, so that the effect of drilling simulation is more vivid, acquiring a preset score of the feedback information, and converting a plurality of pieces of second voice information acquired during the execution of the drilling interaction script into sentence texts after the drilling interaction script is executed, the sentence text is cut into words to obtain each participle forming the sentence text, the trainee's drilling is objectively evaluated according to each participle of the sentence text and the preset scores of the feedback information corresponding to the second voice information respectively, the trainee's drilling is evaluated according to the expression words of the trainee's voice in the drilling process and the preset scores of the feedback information corresponding to the expression words in the drilling interaction script, so that the evaluation is based, the evaluation result is more objective and accurate, and meanwhile, the trainee can clearly know how the feedback obtained by the trainee's expression in the drilling process is, and the improvement is further carried out, so that the drilling efficiency is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is a flowchart of an implementation of a method for evaluating a scene drill according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a specific implementation of a training step of a TF _ IDF matrix in the method for evaluating a scene drill according to the embodiment of the present invention;
fig. 3 is a flowchart of a specific implementation of the scene drilling evaluation method S105 according to the embodiment of the present invention;
FIG. 4 is a flowchart of an implementation of a method for evaluating a scene drill B3 according to an embodiment of the present invention;
fig. 5 is a block diagram illustrating an evaluation apparatus for scene drilling according to an embodiment of the present invention;
fig. 6 is a schematic diagram of an intelligent device provided in an embodiment of the present invention.
Detailed Description
In order to make the objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the embodiments described below are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 shows an implementation flow of the evaluation method for scene drilling provided by the embodiment of the present invention, where the method flow includes steps S101 to S107. The specific realization principle of each step is as follows:
s101: and acquiring the drill scene selected by the trainee.
In the embodiment of the invention, a plurality of drilling scenes are provided for the trainees to select, and different drilling scenes can simulate different real conversation environments. The drill scenes include phone scenes, face-to-face scenes, and multi-person scenes. Specifically, in a telephone scene, the intelligent device provides a telephone simulation scene, namely, simulated interaction is carried out with the trainee through voice, and the scene is suitable for the trainee to practice a scene of telephone communication with a client; in a face-to-face scene, the intelligent equipment provides video images and voice of virtual clients to perform simulated interaction with students, and the scene is suitable for the students to practice video communication or face-to-face communication with the clients; in a multi-person scenario, the intelligent device provides video images and voice including a plurality of virtual clients to perform simulated interaction with the trainee, and the scenario is suitable for the trainee to perform and communicate with the plurality of clients simultaneously.
Further, in the embodiment of the present invention, a scene identifier is set to identify a drilling scene, and meanwhile, a mapping relationship between the scene identifier and a script library may be established. The script library is used for storing the drilling interaction script. And determining the drilling interaction script corresponding to the drilling scene selected by the trainee by inquiring a database for storing the corresponding relation between the drilling scene and the drilling interaction script. The drill interaction script comprises interaction contents of the intelligent equipment and the trainees. And the intelligent equipment executes the found drilling interaction script corresponding to the drilling scene.
Optionally, different drilling scenes suitable for different products to be promoted may be different, and in the embodiment of the present invention, a mapping relationship between the products and the drilling scenes is established. The method comprises the steps that a product scene comparison table is preset, the product scene comparison table comprises the corresponding relation between product identification and scene identification, different products correspond to different drilling scenes, a student determines products needing drilling firstly, and the drilling scenes are determined according to the product identification of the products needing drilling determined by the student and the preset product scene comparison table. Further, if there is more than one drilling scene corresponding to the product, after the product identifier of the product to be drilled is determined by the trainee, a drilling scene is randomly selected from the drilling scenes corresponding to the product identifier to interact with the trainee, so that the trainee's strain capacity can be trained.
S102: and acquiring first voice information input by the trainee in the drilling scene.
S103: determining a drilling interaction script corresponding to the first voice information from a plurality of drilling interaction scripts corresponding to the drilling scene;
in the embodiment of the present invention, after the trainee selects a drilling scene, a plurality of drilling interaction scripts are provided, and the trainee performs voice detection to obtain first voice information input by the trainee, specifically, recognizes the first voice information, and obtains voice features of the first voice information, where the voice features include a speech speed and a volume, and determines the drilling interaction script corresponding to the voice feature of the first voice information from the plurality of drilling interaction scripts corresponding to the drilling scene.
Optionally, the first voice information is recognized, the first voice information may include a product identifier of a product to be performed, the product identifier includes at least one of a product name and a product number, and according to the recognized product identifier in the first voice information, by querying a database storing mapping relationships among a product identifier, a scene identifier of a drilling scene, and a scene drilling interaction script, the drilling interaction script corresponding to the product identifier is selected from a script library corresponding to the scene identifier. And further, according to the voice characteristics of the first voice information, searching the drilling interaction script corresponding to the voice characteristics of the first voice information from the drilling interaction script corresponding to the product identification.
S104: and acquiring second voice information of the trainee based on the drilling interaction script corresponding to the first voice information.
Specifically, after the drill interaction script is determined, the intelligent device starts to collect the second voice information of the student in real time. In the embodiment of the present invention, the microphone array may be used to pick up voice in real time in all directions, and receive the first voice message and the second voice message. Optionally, when the drill scene selected by the trainee is a telephone scene, a unidirectional microphone is used for picking up voice in real time, and first voice information or second voice information is received; when the drilling scene selected by the trainee is a face-to-face scene or a multi-person scene, the microphone array is used for picking up voice in all directions in real time and receiving first voice information or second voice information.
Optionally, in the phone scenario and the face-to-face scenario, a trainee is generally performed, before the second voice information input by the trainee when the drilling interaction script is executed is obtained, the identity of the trainee is obtained, after the second voice information input by the trainee when the drilling interaction script is executed is obtained, the obtained second voice information is stored in a second voice information set using the identity of the trainee as a tag, and the second voice information performed by the trainee at this time is stored according to the identity of the trainee. In this embodiment of the present invention, the recognition result of the first voice information further includes an identification of the trainee.
In the embodiment of the present invention, if the drilling scene is a multi-user scene, a plurality of trainees drill simultaneously, the second voice information input by the trainees comes from a plurality of trainees when the drilling interaction script is executed, and in order to distinguish which trainee the second voice information comes from, the second voice information needs to be classified according to the trainees. Specifically, before acquiring the second voice information input by the trainee, acquiring the drill role selected by the trainee, acquiring the second voice information input by the trainee when executing the drill interaction script based on the drill role, and classifying the second voice information of the trainee according to the drill role. Further, in order to improve the accuracy of classifying the second voice information, a label is marked on the acquired second voice information so as to distinguish the trainees corresponding to the second voice information. Specifically, voiceprint recognition is performed on the acquired second voice information, voiceprint features of the second voice information are acquired, and the second voice information is marked according to the voiceprint features. And classifying the second voice information marked with the same voiceprint characteristics into the second voice information of the same student.
S105: and playing feedback information corresponding to the second voice information according to the drilling interaction script corresponding to the first voice information, and acquiring a preset score of the feedback information.
In the embodiment of the present invention, the played feedback information corresponds to the second voice information one to one. Specifically, the drilling interaction script includes a drilling preset standard statement and feedback information corresponding to the preset standard statement, and also includes a preset score of the feedback information, where the preset score of the feedback information is initially preset. Performing semantic recognition on the second voice information, searching a preset standard sentence which is the same as the result of the semantic recognition from the drilling interaction script according to the result of the semantic recognition, playing feedback information corresponding to the preset standard sentence, and acquiring a preset score of the feedback information; and if the preset standard sentence which is the same as the semantic recognition result of the second voice information is found in the drilling interaction script, playing default feedback information (namely, appointed feedback information) and acquiring a preset score of the default feedback information. In the embodiment of the present invention, the feedback information is a response made to the second voice information of the trainee, and the feedback is given to the trainee by playing the feedback information corresponding to the second voice information, so as to cooperate with the drill of the trainee.
S106: and after the drilling interactive script is executed, converting the second voice information acquired during the execution of the drilling interactive script into a sentence text, and performing word segmentation processing on the sentence text to obtain each participle forming the sentence text.
In the embodiment of the present invention, during the execution of the drilling interaction script, the trainee inputs one or more pieces of second voice information, the second voice information of the trainee is obtained in real time, the second voice information obtained from the beginning of the execution of the drilling interaction script to the completion of the execution is converted into the sentence text, and the sentence text is subjected to word segmentation processing to obtain each participle constituting the sentence text. The word segmentation processing means that a sentence text is segmented into a single word, namely, each segmented word, in the step, the sentence text can be segmented according to a general dictionary, so that the segmented words are all normal words, and if the words are not in the dictionary, single words are segmented. When words can be formed in the front and back directions, for example, the words are taken, the words are divided according to the size of the statistical word frequency, if the word frequency of the words is high, the words are taken/written, and if the word frequency of the words is high, the words are taken/written.
Optionally, the text information may be participled using a Chinese word segmentation. Before the text information is subjected to word segmentation processing, in order to save storage space and improve word segmentation efficiency, the text information is preprocessed to remove stop words, wherein the stop words comprise periods, commas, semicolons and the like, namely punctuation marks such as periods, commas, semicolons and the like in the text information are screened out. And storing the removed stop word mark sequence into a stop word temporary storage library. And in order to save storage space and improve word segmentation efficiency, the stop word temporary storage library is periodically cleaned.
Optionally, a word list is constructed, the word list includes each participle of the sentence text, and keywords are extracted from the word list based on a trained TF _ IDF (Term Frequency-Inverse Document Frequency) matrix. The corpus in the drilling interaction script corresponding to the TF _ IDF matrix drilling scenario is trained, specifically, as shown in fig. 2, the TF _ IDF matrix training step is as follows:
a1: and acquiring the linguistic data in the drilling interaction script corresponding to the specified drilling scene. Specifically, the corpus includes product introductions.
A2: and carrying out word segmentation on the corpus according to the text, and removing stop words to obtain a training vocabulary.
A3: and generating a TF _ IDF matrix based on the training vocabulary, wherein the horizontal axis is a text, the vertical axis is a keyword, and the key coefficient of the keyword is determined according to the word frequency of the keyword in the sentence text.
A4: arranging the participles in the training vocabulary from high to low according to the word frequency, and selecting the participles with specified number according to the arrangement result to determine the participles as the keywords.
In the embodiment of the invention, after the drilling interaction script is executed, the second voice messages acquired during the execution of the drilling interaction script are converted into the sentence texts, and the word segmentation processing is performed on the sentence texts, so that each participle forming the sentence texts is accurately acquired, the intelligent device can score the drilling of the trainees according to the participles in the voice messages, and the accuracy of drilling scoring can be improved.
S107: and evaluating the drill of the trainees according to the preset scores of the feedback information corresponding to each participle of the sentence text and the second voice information.
In the embodiment of the invention, the trainees can be objectively evaluated according to the preset scores of the feedback information corresponding to each participle of the sentence text and the second voice information, so that the trainees can exercise more efficiently.
As an embodiment of the present invention, as shown in fig. 3, the step S107 specifically includes:
b1: and sequencing all the participles obtained by word segmentation in sequence according to the sequence of the participles in the sentence text to construct a participle sequence.
B2: and searching the word weight and the sequencing weight of the keywords in the word segmentation sequence according to a preset keyword weight list.
B3: and evaluating the drill of the trainees according to the word weight and the sorting weight of the keywords in the word segmentation sequence and the preset scores of the feedback information corresponding to the second voice information. The word weight is used for identifying the importance degree of the keyword, and the sorting weight is used for identifying the influence degree of the sequence of the keyword in the word segmentation sequence.
Specifically, the number of pieces of the second voice information acquired during execution of the drilling interaction script and the number of pieces of feedback information corresponding to the second voice information are determined, and the drilling score of the trainee is determined according to the following formula (1):
wherein Training _ Score represents the drill Score, ε0Representing a predetermined constant, e.g. 100, AtA word weight matrix is constructed for the t-th second voice message according to the word weights of the keywords in the word segmentation sequence, BtAnd Func is any monotone increasing function for realizing mapping from [0, + ∞) to [0,1) for a ranking weight matrix constructed by the t-th second voice message according to the ranking weights of the keywords in the word segmentation sequence. For example, Func may take any of the following functions: Eland the preset score of the first feedback information is represented, T is more than or equal to 1 and less than or equal to T, T is the total number of the second information, L is more than or equal to 1 and less than or equal to L, and L is the total number of the feedback information obtained after the drilling script is executed.
Optionally, the preset constant ε0The value of (b) can be determined according to the drilling interaction script corresponding to the first voice message. Specifically, the closer the voice feature of the first voice message is to the voice feature of the corresponding voice message in the drilling interaction script, the more the preset constant epsilon0The higher the value of (c).
In the embodiment of the invention, the trainees can be objectively scored according to the word weight and the sorting weight of the keywords in the word segmentation sequence, so that the scoring accuracy can be improved.
Optionally, if the participle obtained by the word segmentation processing includes a stop word, that is, the participle sequence includes the stop word, the specific implementation flow of step B3 includes:
b31: determining the number of the second voice messages acquired during the execution of the drilling interaction script and the number of the feedback messages corresponding to the second voice messages;
b32: acquiring the word frequency of stop words in the word segmentation sequence;
b33: determining the stop word weight of stop words in the word segmentation sequence according to the word frequency of the stop words and a preset stop word weight table;
b34: determining a drill score for the trainee according to the following equation (2):
wherein Training _ Score represents the drill Score, ε0Denotes a predetermined constant, AtWord weight matrix constructed for the t-th second voice message according to the word weights of the keywords in the word segmentation sequence，BtA ranking weight matrix constructed for the t-th second voice message according to the ranking weight of the keywords in the participle sequence, C a stop word weight matrix constructed according to the stop word weight of the stop word in the participle sequence, Func is any monotone increasing function for realizing the mapping from [0, + ∞) ] to [0,1), ElAnd the preset score of the first feedback information is represented, T is more than or equal to 1 and less than or equal to T, T is the total number of the second information, L is more than or equal to 1 and less than or equal to L, and L is the total number of the feedback information.
In the embodiment of the invention, considering the influence of stop words on the drilling, for example, too much pause of the trainee or too many stop words used in the drilling process affects the scoring of the drilling, and proper pause is necessary.
Optionally, as an embodiment of the present invention, as shown in fig. 4, the specific step of B3 includes:
b31': and acquiring a preset standard sentence corresponding to the sentence text in the drilling interaction script.
B32': and calculating the sentence similarity between the sentence text and the preset standard sentence.
B33': and evaluating the drill of the trainees according to the sentence similarity, the word weight and the sorting weight of the keywords in the word segmentation sequence and the preset scores of the feedback information corresponding to the second voice information.
Specifically, the step B33' specifically includes: determining the number of the second voice information acquired during the execution of the drilling interaction script and the number of the feedback information corresponding to the second voice information, and determining the drilling score of the trainee according to the following formula (3):
wherein Training _ Score represents the drill Score, ε0Denotes a predetermined constant, AtA word weight matrix is constructed for the t-th second voice message according to the word weights of the keywords in the word segmentation sequence, BtA sorting weight matrix is constructed for the t-th second voice information according to the sorting weights of the keywords in the word segmentation sequence, n is the number of the voice information converted into the sentence text, n is a positive integer, and s _ degreeiThe sentence similarity, lambda, of the sentence text converted from the ith voice message and the corresponding preset standard sentence is showniRepresenting the similarity parameter of the sentence text into which the ith speech message is converted, Func being a monotonically increasing function of any one of the implementations of the mapping from [0, + ∞) to [0,1), ElAnd the preset score of the first feedback information is represented, T is more than or equal to 1 and less than or equal to T, T is the total number of the second information, L is more than or equal to 1 and less than or equal to L, and L is the total number of the feedback information.
In the embodiment of the present invention, the drilling interaction script includes a preset standard sentence, that is, a preset standard sentence for a student to converse with a client, and evaluates the drilling of the student by calculating the sentence similarity between the sentence text and the preset standard sentence, and according to the sentence similarity, the word weight and the ranking weight of the keyword in the participle sequence, and the preset scoring of the feedback information corresponding to each of the plurality of pieces of second voice information, the similarity between the sentence text in the voice information of the student and the preset standard sentence is considered, and the word weight and the ranking weight of the keyword in the participle sequence of the sentence text are considered, so as to further make the scoring more objective and accurate, improve the scoring accuracy, and effectively improve the drilling efficiency of the student.
In the embodiment of the invention, by acquiring a drilling scene selected by a trainee, acquiring first voice information input by the trainee in the drilling scene, determining a drilling interaction script corresponding to the first voice information from a plurality of drilling interaction scripts corresponding to the drilling scene, then acquiring second voice information of the trainee based on the drilling interaction script corresponding to the first voice information, namely starting drilling, and playing feedback information corresponding to the second voice information according to the drilling interaction script corresponding to the first voice information to realize the drilling interaction of the trainee, so that the drilling simulation effect is more vivid, and a preset score of the feedback information is acquired, after the drilling interaction script is executed, a plurality of pieces of second voice information acquired during the execution of the drilling interaction script are converted into sentence texts, and the sentence texts are subjected to word cutting processing, the method comprises the steps of obtaining each participle forming the sentence text, objectively evaluating the drilling of the trainee according to the preset scores of the feedback information corresponding to each participle of the sentence text and the second voice information, evaluating the drilling of the trainee according to the expression words of the speech of the trainee in the drilling process and the preset scores of the feedback information corresponding to the expression words in the drilling interactive script, enabling the evaluation to be based on the preset scores, enabling the evaluation result to be more objective and accurate, enabling the trainee to clearly know how the feedback obtained by the expression of the trainee in the drilling process is, improving the evaluation result and improving the drilling efficiency.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
Fig. 5 is a block diagram of a configuration of an evaluation apparatus for scene drilling according to an embodiment of the present application, which corresponds to the evaluation method for scene drilling described in the foregoing embodiment.
Referring to fig. 5, the scene drill evaluation device includes: a drilling scene acquisition unit 51, a first voice information acquisition unit 52, a drilling interaction script determination unit 53, a second voice information acquisition unit 54, a feedback information acquisition unit 55, a word segmentation processing unit 56, a drilling evaluation unit 57, wherein:
a drilling scene acquisition unit 51 for acquiring a drilling scene selected by the trainee;
a first voice information acquiring unit 52, configured to acquire first voice information input by the trainee in the drilling scene;
a drilling interaction script determining unit 53, configured to determine a drilling interaction script corresponding to the first voice information from a plurality of drilling interaction scripts corresponding to the drilling scenes;
a second voice information obtaining unit 54, configured to obtain second voice information of the trainee based on the drilling interaction script corresponding to the first voice information;
a feedback information obtaining unit 55, configured to play feedback information corresponding to the second voice information according to the drilling interaction script corresponding to the first voice information, and obtain a preset score of the feedback information;
a word cutting processing unit 56, configured to, after the drilling interaction script is executed, convert the multiple pieces of second voice information acquired during the execution of the drilling interaction script into a sentence text, and perform word cutting processing on the sentence text to obtain each word segment constituting the sentence text;
and a drill evaluation unit 57, configured to evaluate the drill of the trainee according to the preset scores of the feedback information corresponding to each participle of the sentence text and the plurality of pieces of second voice information.
Optionally, the drill evaluation unit 57 includes:
the word segmentation sequence construction module is used for sequentially sequencing all the word segments obtained by word segmentation processing according to the sequence of the word segments in the sentence text to construct a word segmentation sequence;
the weight searching module is used for searching word weights and sequencing weights of the keywords in the word segmentation sequence according to a preset keyword weight list;
and the first drilling scoring module is used for evaluating the drilling of the trainees according to the word weight and the sequencing weight of the keywords in the word segmentation sequence and the preset scores of the feedback information corresponding to the second voice information.
Optionally, the first drill scoring module specifically includes:
the voice information counting module is used for determining the number of the second voice information acquired during the period of executing the drilling interaction script and the number of the feedback information corresponding to the second voice information;
a first scoring submodule for determining a drill score for the trainee according to the formula:
wherein Training _ Score represents the drill Score, ε0Denotes a predetermined constant, AtA word weight matrix is constructed for the t-th second voice message according to the word weights of the keywords in the word segmentation sequence, BtA ranking weight matrix is constructed for the t-th second voice message according to the ranking weights of the keywords in the word segmentation sequence, Func is any monotone increasing function for realizing the mapping from [0, + ∞) to [0,1), ElAnd the preset score of the first feedback information is represented, T is more than or equal to 1 and less than or equal to T, T is the total number of the second information, L is more than or equal to 1 and less than or equal to L, and L is the total number of the feedback information.
Optionally, the participle sequence includes stop words, and the drill evaluation unit 57 includes:
the voice information counting module is used for determining the number of the second voice information acquired during the period of executing the drilling interaction script and the number of the feedback information corresponding to the second voice information;
the word frequency acquisition module is used for acquiring the word frequency of stop words in the word segmentation sequence;
the stop word weight determining module is used for determining the stop word weight of the stop words in the word segmentation sequence according to the word frequency of the stop words and a preset stop word weight table;
a second drill scoring module for determining the drill score of the trainee according to the following formula:
wherein Training _ Score represents the drill Score, ε0Representing preset constants，AtA word weight matrix is constructed for the t-th second voice message according to the word weights of the keywords in the word segmentation sequence, BtA ranking weight matrix constructed for the t-th second voice message according to the ranking weight of the keywords in the participle sequence, C a stop word weight matrix constructed according to the stop word weight of the stop word in the participle sequence, Func is any monotone increasing function for realizing the mapping from [0, + ∞) ] to [0,1), ElAnd the preset score of the first feedback information is represented, T is more than or equal to 1 and less than or equal to T, T is the total number of the second information, L is more than or equal to 1 and less than or equal to L, and L is the total number of the feedback information.
Optionally, the drill evaluation unit 57 includes:
the standard sentence acquisition module is used for acquiring a preset standard sentence corresponding to the sentence text in the drilling interaction script;
the sentence similarity calculation module is used for calculating the sentence similarity between the sentence text and the preset standard sentence;
and the third drilling scoring module is used for evaluating the drilling of the trainees according to the sentence similarity, the word weight and the sequencing weight of the keywords in the word segmentation sequence and the preset scores of the feedback information corresponding to the second voice information.
Optionally, the third drill scoring module specifically includes:
the voice information counting module is used for determining the number of the second voice information acquired during the period of executing the drilling interaction script and the number of the feedback information corresponding to the second voice information;
a second scoring submodule for determining a drill score for the trainee according to the following formula:
wherein Training _ Score represents the drill Score, ε0Denotes a predetermined constant, AtA word weight matrix is constructed for the t-th second voice message according to the word weights of the keywords in the word segmentation sequence,Bta sorting weight matrix is constructed for the t-th second voice information according to the sorting weights of the keywords in the word segmentation sequence, n is the number of the voice information converted into the sentence text, n is a positive integer, and s _ degreeiThe sentence similarity, lambda, of the sentence text converted from the ith voice message and the corresponding preset standard sentence is showniRepresenting the similarity parameter of the sentence text into which the ith speech message is converted, Func being a monotonically increasing function of any one of the implementations of the mapping from [0, + ∞) to [0,1), ElAnd the preset score of the first feedback information is represented, T is more than or equal to 1 and less than or equal to T, T is the total number of the second information, L is more than or equal to 1 and less than or equal to L, and L is the total number of the feedback information.
In the embodiment of the invention, by acquiring a drilling scene selected by a trainee, acquiring first voice information input by the trainee in the drilling scene, determining a drilling interaction script corresponding to the first voice information from a plurality of drilling interaction scripts corresponding to the drilling scene, then acquiring second voice information of the trainee based on the drilling interaction script corresponding to the first voice information, namely starting drilling, and playing feedback information corresponding to the second voice information according to the drilling interaction script corresponding to the first voice information to realize the drilling interaction of the trainee, so that the drilling simulation effect is more vivid, and a preset score of the feedback information is acquired, after the drilling interaction script is executed, a plurality of pieces of second voice information acquired during the execution of the drilling interaction script are converted into sentence texts, and the sentence texts are subjected to word cutting processing, the method comprises the steps of obtaining each participle forming the sentence text, objectively evaluating the drilling of the trainee according to the preset scores of the feedback information corresponding to each participle of the sentence text and the second voice information, evaluating the drilling of the trainee according to the expression words of the speech of the trainee in the drilling process and the preset scores of the feedback information corresponding to the expression words in the drilling interactive script, enabling the evaluation to be based on the preset scores, enabling the evaluation result to be more objective and accurate, enabling the trainee to clearly know how the feedback obtained by the expression of the trainee in the drilling process is, improving the evaluation result and improving the drilling efficiency.
Fig. 6 is a schematic diagram of an intelligent device according to an embodiment of the present invention. As shown in fig. 6, the smart device 6 of this embodiment includes: a processor 60, a memory 61 and a computer program 62, such as an evaluation program for scene drilling, stored in said memory 61 and executable on said processor 60. The processor 60, when executing the computer program 62, implements the steps in the above-described embodiments of the evaluation method for scene drilling, such as the steps 101 to 107 shown in fig. 1. Alternatively, the processor 60, when executing the computer program 62, implements the functions of the modules/units in the above-mentioned device embodiments, such as the functions of the units 51 to 57 shown in fig. 5.
Illustratively, the computer program 62 may be partitioned into one or more modules/units that are stored in the memory 61 and executed by the processor 60 to implement the present invention. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution of the computer program 62 in the smart device 6.
The intelligent device 6 may be a desktop computer, a notebook, a palm computer, a cloud intelligent device, or other computing devices. The smart device may include, but is not limited to, a processor 60, a memory 61. Those skilled in the art will appreciate that fig. 6 is merely an example of a smart device 6 and does not constitute a limitation of the smart device 6 and may include more or fewer components than shown, or some components in combination, or different components, for example the smart device may also include input output devices, network access devices, buses, etc.
The Processor 60 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 61 may be an internal storage unit of the intelligent device 6, such as a hard disk or a memory of the intelligent device 6. The memory 61 may also be an external storage device of the Smart device 6, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, provided on the Smart device 6. Further, the memory 61 may also include both an internal storage unit and an external storage device of the smart device 6. The memory 61 is used for storing the computer programs and other programs and data required by the smart device. The memory 61 may also be used to temporarily store data that has been output or is to be output.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present invention, and are intended to be included within the scope of the present invention.
Claims (10)
1. An evaluation method for scene drilling, comprising:
acquiring a drilling scene selected by a student;
acquiring first voice information input by the trainee in the drilling scene;
determining a drilling interaction script corresponding to the first voice information from a plurality of drilling interaction scripts corresponding to the drilling scene;
acquiring second voice information of the trainee based on the drilling interaction script corresponding to the first voice information;
playing feedback information corresponding to the second voice information according to the drilling interaction script corresponding to the first voice information, and acquiring a preset score of the feedback information;
after the drilling interaction script is executed, converting a plurality of pieces of second voice information acquired during the execution of the drilling interaction script into a sentence text, and performing word segmentation processing on the sentence text to obtain each participle forming the sentence text;
and evaluating the drill of the trainees according to the preset scores of the feedback information corresponding to each participle of the sentence text and the second voice information.
2. The assessment method according to claim 1, wherein the assessment of the trainee's drill based on the preset scores of the feedback information corresponding to each participle of the sentence text and each of the plurality of pieces of second speech information comprises:
sequencing all the participles obtained by word segmentation in sequence according to the sequence of the participles in the sentence text to construct a participle sequence;
searching word weight and sequencing weight of the keywords in the word segmentation sequence according to a preset keyword weight list;
and evaluating the drill of the trainees according to the word weight and the sorting weight of the keywords in the word segmentation sequence and the preset scores of the feedback information corresponding to the second voice information.
3. The evaluation method according to claim 2, wherein the evaluating the drill of the trainee according to the word weight and the ranking weight of the keyword in the word segmentation sequence and the preset scores of the feedback information corresponding to the plurality of pieces of second voice information respectively comprises:
determining the number of the second voice messages acquired during the execution of the drilling interaction script and the number of the feedback messages corresponding to the second voice messages;
determining a drill score for the trainee according to the following formula:
wherein Training _ Score represents the drill Score, ε0Denotes a predetermined constant, AtWord weight matrix constructed for the t-th second voice message according to the word weights of the keywords in the word segmentation sequence，BtA ranking weight matrix is constructed for the t-th second voice message according to the ranking weights of the keywords in the word segmentation sequence, Func is any monotone increasing function for realizing the mapping from [0, + ∞) to [0,1), ElAnd the preset score of the first feedback information is represented, T is more than or equal to 1 and less than or equal to T, T is the total number of the second information, L is more than or equal to 1 and less than or equal to L, and L is the total number of the feedback information.
4. The assessment method according to claim 2, wherein the segmentation sequence includes stop words, and the assessment of the trainee's drill according to the word weight and the ranking weight of the keywords in the segmentation sequence and the preset scores of the feedback information corresponding to the plurality of pieces of second voice information respectively comprises:
determining the number of the second voice messages acquired during the execution of the drilling interaction script and the number of the feedback messages corresponding to the second voice messages;
acquiring the word frequency of stop words in the word segmentation sequence;
determining the stop word weight of stop words in the word segmentation sequence according to the word frequency of the stop words and a preset stop word weight table;
determining a drill score for the trainee according to the following formula:
wherein Training _ Score represents the drill Score, ε0Denotes a predetermined constant, AtA word weight matrix is constructed for the t-th second voice message according to the word weights of the keywords in the word segmentation sequence, BtA ranking weight matrix constructed for the t-th second voice message according to the ranking weight of the keywords in the participle sequence, C a stop word weight matrix constructed according to the stop word weight of the stop word in the participle sequence, Func is any monotone increasing function for realizing the mapping from [0, + ∞) ] to [0,1), ElA preset score for expressing the first feedback information, T is more than or equal to 1 and less than or equal to T, T is the total number of the second information, and l is more than or equal to 1And L is less than or equal to L, and L is the total number of the feedback information.
5. The evaluation method according to claim 2, wherein the evaluating the drill of the trainee according to the word weight and the ranking weight of the keyword in the word segmentation sequence and the preset scores of the feedback information corresponding to the plurality of pieces of second voice information respectively comprises:
acquiring a preset standard sentence corresponding to the sentence text in the drilling interaction script;
calculating sentence similarity between the sentence text and the preset standard sentence;
and evaluating the drill of the trainees according to the sentence similarity, the word weight and the sorting weight of the keywords in the word segmentation sequence and the preset scores of the feedback information corresponding to the second voice information.
6. The evaluation method according to claim 5, wherein the evaluating the drill of the trainee according to the sentence similarity, the word weight and the ranking weight of the keyword in the segmentation sequence, and the preset scores of the feedback information corresponding to the plurality of pieces of second voice information respectively comprises:
determining the number of the second voice messages acquired during the execution of the drilling interaction script and the number of the feedback messages corresponding to the second voice messages;
determining a drill score for the trainee according to the following formula:
wherein Training _ Score represents the drill Score, ε0Denotes a predetermined constant, AtA word weight matrix is constructed for the t-th second voice message according to the word weights of the keywords in the word segmentation sequence, BtA sorting weight matrix is constructed for the t-th second voice information according to the sorting weights of the keywords in the word segmentation sequence, n is a conversion languageNumber of pieces of speech information of sentence text, n is a positive integer, s _ depthiThe sentence similarity, lambda, of the sentence text converted from the ith voice message and the corresponding preset standard sentence is showniRepresenting the similarity parameter of the sentence text into which the ith speech message is converted, Func being a monotonically increasing function of any one of the implementations of the mapping from [0, + ∞) to [0,1), ElAnd the preset score of the first feedback information is represented, T is more than or equal to 1 and less than or equal to T, T is the total number of the second information, L is more than or equal to 1 and less than or equal to L, and L is the total number of the feedback information.
7. An evaluation device for scene drilling, comprising:
the training scene acquisition unit is used for acquiring a training scene selected by the trainee;
the first voice information acquisition unit is used for acquiring first voice information input by the trainee in the drilling scene;
a drilling interaction script determining unit, configured to determine a drilling interaction script corresponding to the first voice information from a plurality of drilling interaction scripts corresponding to the drilling scenes;
the second voice information acquisition unit is used for acquiring second voice information of the trainee based on the drilling interaction script corresponding to the first voice information;
the feedback information acquisition unit is used for playing the feedback information corresponding to the second voice information according to the drilling interaction script corresponding to the first voice information and acquiring the preset score of the feedback information;
the word cutting processing unit is used for converting the second voice information acquired during the execution of the drilling interaction script into a sentence text after the drilling interaction script is executed, and performing word cutting processing on the sentence text to obtain each word segmentation forming the sentence text;
and the drilling evaluation unit is used for evaluating the drilling of the trainees according to the preset scores of the feedback information corresponding to each participle of the sentence text and the second voice information.
8. The apparatus for evaluating a drill of a scene according to claim 7, wherein the drill evaluation unit includes:
the word segmentation sequence construction module is used for sequentially sequencing all the word segments obtained by word segmentation processing according to the sequence of the word segments in the sentence text to construct a word segmentation sequence;
the weight searching module is used for searching word weights and sequencing weights of the keywords in the word segmentation sequence according to a preset keyword weight list;
and the first drilling scoring module is used for evaluating the drilling of the trainees according to the word weight and the sequencing weight of the keywords in the word segmentation sequence and the preset scores of the feedback information corresponding to the second voice information.
9. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the evaluation method of a scene drill according to any one of claims 1 to 6.
10. A smart device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the evaluation method of a scenario drill according to any one of claims 1 to 6 when executing the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910752171.2A CN110619588B (en) | 2019-08-15 | 2019-08-15 | Evaluation method and device for scene exercise, storage medium and intelligent device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910752171.2A CN110619588B (en) | 2019-08-15 | 2019-08-15 | Evaluation method and device for scene exercise, storage medium and intelligent device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110619588A true CN110619588A (en) | 2019-12-27 |
| CN110619588B CN110619588B (en) | 2024-04-26 |
Family
ID=68921794
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910752171.2A Active CN110619588B (en) | 2019-08-15 | 2019-08-15 | Evaluation method and device for scene exercise, storage medium and intelligent device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110619588B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102034475A (en) * | 2010-12-08 | 2011-04-27 | 中国科学院自动化研究所 | Method for interactively scoring open short conversation by using computer |
| US20130158982A1 (en) * | 2011-11-29 | 2013-06-20 | Educational Testing Service | Computer-Implemented Systems and Methods for Content Scoring of Spoken Responses |
| US20140141392A1 (en) * | 2012-11-16 | 2014-05-22 | Educational Testing Service | Systems and Methods for Evaluating Difficulty of Spoken Text |
| CN109448458A (en) * | 2018-11-29 | 2019-03-08 | 郑昕匀 | A kind of Oral English Training device, data processing method and storage medium |
| CN109800663A (en) * | 2018-12-28 | 2019-05-24 | 华中科技大学鄂州工业技术研究院 | Teachers ' teaching appraisal procedure and equipment based on voice and video feature |
-
2019
- 2019-08-15 CN CN201910752171.2A patent/CN110619588B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102034475A (en) * | 2010-12-08 | 2011-04-27 | 中国科学院自动化研究所 | Method for interactively scoring open short conversation by using computer |
| US20130158982A1 (en) * | 2011-11-29 | 2013-06-20 | Educational Testing Service | Computer-Implemented Systems and Methods for Content Scoring of Spoken Responses |
| US20140141392A1 (en) * | 2012-11-16 | 2014-05-22 | Educational Testing Service | Systems and Methods for Evaluating Difficulty of Spoken Text |
| CN109448458A (en) * | 2018-11-29 | 2019-03-08 | 郑昕匀 | A kind of Oral English Training device, data processing method and storage medium |
| CN109800663A (en) * | 2018-12-28 | 2019-05-24 | 华中科技大学鄂州工业技术研究院 | Teachers ' teaching appraisal procedure and equipment based on voice and video feature |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110619588B (en) | 2024-04-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2022095380A1 (en) | Ai-based virtual interaction model generation method and apparatus, computer device and storage medium | |
| CN111046133A (en) | Question-answering method, question-answering equipment, storage medium and device based on atlas knowledge base | |
| US10157619B2 (en) | Method and device for searching according to speech based on artificial intelligence | |
| CN109815491B (en) | Answer scoring method, device, computer equipment and storage medium | |
| CN111368042A (en) | Intelligent question and answer method and device, computer equipment and computer storage medium | |
| CN106126524B (en) | Information pushing method and device | |
| CN110765254A (en) | Multi-document question-answering system model integrating multi-view answer reordering | |
| CN111310463B (en) | Test question difficulty estimation method and device, electronic equipment and storage medium | |
| CN111694940A (en) | User report generation method and terminal equipment | |
| CN112487139A (en) | Text-based automatic question setting method and device and computer equipment | |
| CN112699645B (en) | Corpus labeling method, apparatus and device | |
| CN112995690B (en) | Live content category identification method, device, electronic equipment and readable storage medium | |
| CN109460503A (en) | Answer input method, device, storage medium and electronic equipment | |
| CN111192170B (en) | Question pushing method, device, equipment and computer readable storage medium | |
| CN117520503A (en) | Financial customer service dialogue generation method, device, equipment and medium based on LLM model | |
| CN114186983A (en) | Video interview multidimensional scoring method, system, computer equipment and storage medium | |
| CN113342948A (en) | Intelligent question and answer method and device | |
| CN112700203B (en) | Intelligent marking method and device | |
| CN113627722B (en) | Simple answer scoring method based on keyword segmentation, terminal and readable storage medium | |
| CN110619588B (en) | Evaluation method and device for scene exercise, storage medium and intelligent device | |
| CN114186048A (en) | Question-answer replying method and device based on artificial intelligence, computer equipment and medium | |
| CN114822557A (en) | Method, device, equipment and storage medium for distinguishing different sounds in classroom | |
| CN110263346B (en) | Semantic analysis method based on small sample learning, electronic equipment and storage medium | |
| CN113591004A (en) | Game tag generation method and device, storage medium and electronic equipment | |
| CN111782762A (en) | Method and device for determining similar questions in question answering application and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |