CN109716382A - Use the method and system of mood check and evaluation and monitoring compliance - Google Patents

Abstract

It is a kind of for managing, assessing and monitoring an inside the plan subject of action to the system of the compliance of task performance demand, it include: optical sensor, for assessing and monitoring facial expression, eye movement, blinkpunkt and the head pose of subject that link captures subject in compliance；Domain knowledge data library (500), including conceptual data entity (501) and task data entity (502), each conceptual data entity includes knowledge and skills content item (503), and each task data entity includes lecture content material item (504)；Subject's module, the affective state and cognitive state of the sensing data assessment subject for using optical sensor to acquire；Training aids module, for after completing task data entity every time, according to subject to the task data entity for understanding that probability and subject reach the probability of target compliance degree, selecting to subject's delivering and presentation of the knowledge and skills content item of related notion data entity.

Description

Use the method and system of mood check and evaluation and monitoring compliance

Copyright statement

A part of the disclosure of this patent document includes material protected by copyright.Copyright owner does not oppose that anyone is right Patent document or patent disclosure content makes a fax copy, because it appears in the patent document or record of U.S.Patent & Trademark Office In, but copyright owner retains all copyrights in other respects.

The cross reference of associated documents

This application claims following priority: U.S. Patent application No.62/520,542 that on June 15th, 2017 submits, 2017 years 7 The U.S. Patent application No.62/ that the U.S. Patent application No.15/647,272 that submits for 12nd of the moon, on December 5th, 2017 submit 594,557, on January 27th, 2018 submits U.S. Patent application No.62/622,888, on 2 7th, 2018 U.S. submitted are special Benefit applies for the U.S. Patent application No.62/646,365 submitted on March 21st, No.62/627,734 and 2018；These patents The full content of application is herein incorporated by reference.

Technical field

The present invention relates generally to for provided in terms of education programs and training and the method for transmitting compliance management with System, the education programs and training are including study, medical and health improve in company's training, academic guidance, classroom and outside classroom Plan, training, body-building and life style plan, punish religion service and rehabilitation programme and governments and laws and supervision law enforcement and Personal behavioral standard.Particularly, the present invention relates to for managing, assessing and monitoring action task performance demand in the works The method and system of compliance.

Background technique

Compliance means that the subject for participating in an action plan meets certain task performances rule of this action requirements of plan Model.Traditional compliance assessment and monitoring method lay particular emphasis on and provide disposable test for the subject of an action plan, this is primary Property test have and clearly defined pass through standard.These most of conventional methods only focus on passed through as efficiently as possible/ Not by instruction, and fails to predict the subject and whether make progress in entire compliance, or fail to instruct this tested Person is towards compliance effort.In addition, to often rely on labor management disposable for these traditional compliances assessments and monitoring method The test several times of test or (being at most) sporadicly.This is difficult to lasting compliance and provides guarantee.

To solve the above-mentioned problems, it is expected that a kind of intelligent compliance assessment and monitoring system, simulate the feelings of subject Sense and cognitive state help compliance ombudsman to provide personalized compliance explanation and questionnaire, to instruct subject It defers to completely, continues to monitor task performance and the behavior of subject, and reduce open relevant to compliance plan to the maximum extent Pin activity.

Summary of the invention

Gesture, mood and the movement of the subject sensed, sound and speech recognition, row are used the present invention provides a kind of It manages, assess and supervise for one or more of pattern-recognition and the quantitative measurment of Questionnaire results and task performance The inside the plan subject of an action is surveyed to the method and system of the compliance of task performance demand.Various implementations according to the present invention Mode, the subject in action plan will be according to the certain tasks of performance regulation enforcement.According to an embodiment, this method and system By periodically carrying out one or more parts of questionnaires and analyzing subject to the answer of questionnaire and by continuous under performance specification requirements The performance of one or more tasks of subject is monitored, to assess and monitor the compliance of subject.

According to an aspect of the present invention, this method and system estimate the emotion of subject by image and/or video State and cognitive state, wherein the image and/or video are to execute task mistake during subject answers a questionnaire or in subject Obtained during the time window of the sampling of journey, to the image and/or video, analyze the facial expression of subject, eye movement, blinkpunkt and Head pose and physiology are surveyed, such as person's handwriting, tone, the sound of the tactile pressure, subject being applied on touch sensor are clear Clear degree.Image or video capture can by desktop computer that subject uses when answering a questionnaire, laptop computer, It sets in tablet computer and/or smart phone or peripheral camera, and/or is put in the environment that subject executes the task of action plan Other optical sensing devices for setting and installing are completed.Then captured image and/or view are analyzed using machine vision technique Frequently.For example, the signals such as eye movement, blinkpunkt out of focus and inclined head pose for stagnating indicate the theme presented to questionnaire Lack interest with task procedure declaration and pay close attention to and/or lack relevant knowledge, answer a questionnaire dishonest or task at hand is lacked Associative skills/knowledge；And the theme and task process that present in questionnaire are said in the signal expression of the strong tactile pressure detected Bright or task at hand theme experiences anxiety, lacks confidence, and/or feel to defeat；Any one might mean that low degree The tendency of compliance or non-adherence.

According to an embodiment, determining subject to the questionnaire and task process for requiring executing for task in action plan In terms of the understanding of the material presented in explanation and degree of participation, the performance data selected and row from subject can also be acquired For data.The performance data and behavioral data of these selections include but is not limited to: the correctness of question answering in questionnaire, at The number of function and unsuccessful trial, the answer of subject are near the mark the degree of answer, between given answer choice back and forth The number of switching, to the reaction speed of certain types, theme subject matter.For example, subject is when answering test problem given Frequent switching and reaction speed are slow between option, all show its suspection and hesitation to problem answers.

It is right in the works in an action that the assessment of affective state and cognitive state and performance data are mainly used for measurement subject The performance specification of task defers to degree.Although single assessment can be used substantially to evaluate subject in its task performance It whole compliance and predicts the subject finally attainable compliance degree, but multiple assessments can be used and commented to provide The development tendency of valence history and subject.In addition, in the assessment selection method of compliance, monitoring and instruction transmitting and management Aspect uses affective state and the cognitive state of assessed subject to model compliance project.

According to another aspect of the present invention, this method and system are provided defers to for delivering and managing interactive and adaptability The mechanism of property questionnaire and task procedure declaration.The mechanism logically constructs compliance questionnaire and task mistake in a compliance project Journey illustrates that material is domain knowledge, and its data is stored in domain knowledge base.Domain knowledge base includes one or more concepts pair As with one or more task objects.Each conceptual object includes one or more knowledge and skills items.Knowledge and skills item presses task Performance specification complexity/difficulty/Stringency rank sequence, and two or more knowledge and skills items can link to be formed Training outline.In the case where the present invention is applied to specific industry or enterprise, the training outline that the present invention defines can be equivalent to Operation manual/standard, and there are one-to-one between the task performance specification in knowledge and skills item and operation manual/standard Relationship.Each conceptual object can couple to form the logic data tree structure for being used for task choosing process.

Each task object has a variety of different task procedure declaration materials.Each task object and training outline One or more conceptual objects are associated.According to an embodiment, task object can classify are as follows: basic task, interactive task Or the task with basis cognition or expert model.Each basic task includes one or more for assessing whether subject has read Read operation note, task procedure declaration, illustration, test problem and the answer of all material.It is each that there is basis cognition or expert The interactive task of model includes one or more task processes, and each task process includes one or more for instructing subject's root One or more steps of task process are completed according to performance specification.Each step both provide answer, common wrong understanding and Prompt.These steps design in order, to follow the delivery process of task process.In this way, during based on performed task Some point, can customize and build (such as guidance and/or prompt are provided) each task.

According to another aspect of the present invention, for delivering and managing interactive and adaptive compliance questionnaire and task mistake The mechanism that journey illustrates logically is established on two kinds of operation models of domain knowledge: subject's model and training pattern.Tested Under person's model, system executes every in one or more task objects associated with the training outline in the domain knowledge of subject One.During executing task object, system judges the performance of subject, and obtains performance of the subject in each task and refer to Mark, such as: the number and complete to appoint that the success for completing to illustrate step and unsuccessful number, request prompt are attempted in task Business the time it takes.Information (such as its specification complexity/difficulty/stringent of performance indicators and task object obtained Property degree) it is fed in the logistic regression mathematical model of each conceptual object associated with task object.This also referred to as by The knowledge of examination person is tracked, and is calculated subject and is realized target compliance journey in task performance specification associated with conceptual object The probability of degree.The advantages of subject's model includes that the execution of task object is adapted to the capacity variation of subject.For non-limit Property example processed, under subject's model, system can judge the achievable compliance degree of subject, and estimation next task can How many performance are improved with expected, and provide subject in the prediction of the compliance degree at some following time point.Then by these Data are used for training pattern, and are able to use hypothesis testing to be further improved system, evaluate the quality of compliance ombudsman, And the quality of assessment compliance questionnaire and task procedure declaration material.

Under training pattern, system receives the number for executing task object under subject's model and domain knowledge and acquiring According to and providing feedback to subject and compliance ombudsman to make decision to instruction transmission policy.In training mode, System is mainly responsible for the following operation of execution:

1.) entrance of first task is defined.Firstly, all indexs of knowledge and skills item are both configured to default value, these are silent Recognizing value is data in the application form filled in by subject or compliance ombudsman or compliance ombudsman to subject Preliminary assessment and infer and obtain.Selection will execute the sequence of task.Next task is selected, the training aids module of system will The logic data tree structure for searching for conceptual object, finds the conceptual knowledge and technical ability of minimum skill level, then uses problem square Battle array searches the corresponding task object of the learning characteristic of matching subject.After selection, the compliance needed is extracted from domain knowledge and is asked Volume and task procedure declaration material, and the communication module of system is sent it to hand in the communication module user interface of system It pays and shows.

2.) feedback is provided.When subject is handling the task object just executed, the training aids module monitors of system exist The time spent on each task step.If it exceeds time restriction, then provide feedback, the current affective state as subject Performance.For example, it can be the encouragement information selected from universal list, the information with empathy or the letter for having challenge It ceases or it is the dedicated prompt from domain knowledge.

3.) Teaching agent of drive system.The training aids module of system is by the current affective state of subject and imparts knowledge to students generation Existing state is matched in reason.Information short message is also sent to system other than providing affective state information Communication module, so that Teaching agent in the user interface is presented.

4.) determine when a concept is grasped.As previously mentioned, under subject's model, each concept of system estimation Middle subject realizes the probability of target compliance degree in task associated with task performance gauge material.Based on predetermined threshold It is worth (such as 95%), compliance ombudsman can decide when that a concept is grasped.

According to another aspect of the present invention, for managing, assessing and monitoring an action plan for using machine learning techniques Interior subject is to the method and system of the compliance of task performance demand, and technology, which is based on interconnecting, executes model, comprising: field Model, assessment models, learner model, deep learning person's model, one or more excitation model, transition model and teaching modes. Interconnection executes certain desired movements, behavior and/or the result that model is intended for driving, induce or motivating subject.As Non-limiting example, these desired movements and/or result can be, but be not limited to, and grasp certain task programs, take spy Fixed ideal behavior realizes that specific vocational objective, completion particular job task, progress particular purchased and progress particular business are living It is dynamic.Therefore, these execution patterns that are mutually related are also applied for company's training and retailing and trading.

Detailed description of the invention

Embodiments of the present invention are described in more detail hereinafter with reference to attached drawing, in which:

Fig. 1 shows taking action inside the plan subject couple for managing, assessing and monitor one according to an embodiment of the present invention The schematic diagram of the system of the compliance of task performance demand；

Fig. 2 shows the logical data process figures of system；

Fig. 3 shows taking action inside the plan subject couple for managing, assessing and monitor one according to an embodiment of the present invention The activity diagram of the method for the compliance of task performance demand；

It is machine learning work that Fig. 4, which shows the iteration that system is used when calculating subject and realizing the probability of target compliance degree, Make the flow chart flowed；

Fig. 5 shows logic data structure used in system according to an embodiment of the present invention；

The interconnection that Fig. 6 A shows one aspect according to the present invention executes the logic diagram of model；

Fig. 6 B shows the detailed map that interconnection executes the logic means of model.

Specific embodiment

In the following description, for managing, assessing and monitoring the inside the plan subject of an action to task performance demand The system and method for compliance are listed in preferable example.It will be evident for a person skilled in the art that not departing from It in the case where scope and spirit of the present invention, can modify, including add and/or replace.Although can be omitted specific thin Section is in order to avoid the present invention is hard to understand, but disclosure herein is to make those skilled in the art in the feelings without undue experimentation Teaching herein can be practiced under condition.

According to various embodiments of the present invention, for managing, assessing and monitoring an inside the plan subject of action to appointing The method and system of the compliance for performance demand of being engaged in uses a combined sensing, and a combination thereof includes the appearance of the subject sensed Gesture, mood and movement and the quantitative measurment of Questionnaire results and task performance.

According to an aspect of the present invention, this method and system estimate the emotion of subject by image and/or video State and cognitive state, wherein the image and/or video are to execute task mistake during subject answers a questionnaire or in subject Obtained during the time window of the sampling of journey, to the image and/or video, analyze the facial expression of subject, eye movement, blinkpunkt and Head pose and touch feedback, such as person's handwriting, tone, the sound of the tactile pressure, subject that are applied on touch sensor Clarity.By using the built-in camera in the desktop computer of subject, laptop, tablet computer and/or mobile phone Or peripheral hardware camera, and/or be positioned and mounted at action plan subject execute task environment in other optical sensors, The capture of image or video may be implemented.Then, the image and/or video captured is analyzed using machine vision technique.For example, Eye movement stagnation, blinkpunkt is out of focus, head is crooked etc., and signals indicate to lack interest and attention, and/or in questionnaire Subject matter shortage relevant knowledge, the answer questionnaire of presentation are untrue or lack associative skills/knowledge to task at hand；And The signal of tactile pressure detected then indicates to feel the subject matter in the subject matter or task at hand presented in questionnaire by force Anxiety lacks confidence, and/or dejected；Any one might mean that the compliance of low degree or the tendency of non-adherence.

According to an embodiment, the achievement of subject selected can also be acquired in the assessment of affective state and cognitive state Imitate data and behavioral data.These performance datas selected and behavioral data include but is not limited to: attempting completion task process Step success and unsuccessful number complete the speed of task process, and the correctness of question answering in questionnaire is attempted to answer Problem success and unsuccessful number, the answer of subject are near the mark the degree of answer, come between given answer choice Switching times are returned, and to certain types, theme subject matter, and/or task performance specification complexity/difficulty/Stringency survey The reaction speed why inscribed, the implementation step of solution, person's handwriting, intonation and the sound articulation of subject.For example, tested Frequent switching and reaction speed are slow between given option when answering test problem by person, all show it to problem answers Suspection and hesitation.Capture the intermediate implementation step that subject is completion task process steps, by itself and standard solution into Row matching, this can see clearly out understanding of the subject to task procedure declaration and task performance gauge material in turn.

According to various embodiments, task performance is needed for managing, assessing and monitoring an action inside the plan subject The system for the compliance asked includes sensor processing module, and the sensor processing module is by computer that is general and specially designing The combination of the software and firmware that execute in processor is realized.The various sensors that sensor processing module management system uses.It passes Sensor processing module and various electronic sensor equipment carry out electrical and/or data communication, these electronic sensor equipment include but not It is limited to optics and touches indicating equipment sensor, input equipment, image capture device and camera, wherein input equipment includes But it is not limited to keyboard, mouse, pointing device, stylus and electronic pen.

During system operation, input sensing data is continuously acquired with a variety of different sample rates, and calculate and sampled Input sensing data average value.In order to handle the different sample rates of different sensors, select a reference sample rate (such as 5Hz).To the input sensing data compared with low sampling rate, keeps carrying out interpolation using zeroth order, then be adopted with reference sample rate Sample.To the input sensing data compared with high sampling rate, double sampling is carried out with reference sample rate.It, will most after sample rate alignment Several seconds records save in memory afterwards, calculate average value later.In fact, this generates the movement of input sensing data is flat Mean value, and can be used as low-pass filter to remove noise.

Eye movement, blinkpunkt and head pose detection

In one embodiment, using be built in calculate equipment low-cost optical sensor (such as subject face plate electricity The camera of brain).With the sample rate of minimum 5Hz, image is obtained from sensor.Then, pass through face/eye known in the art Eyeball tracking and the every frame image of analysis system processes.Three-dimensional (3D) head orientation is measured with Eulerian angles (pitching, deflection and rolling).For Measurement blinkpunkt, it is assumed that the center of the pupil from the origin of optical sensor to user is 3D vector, secondly, determining from eyeball Center to pupil 3D vector.Then blinkpunkt is calculated using the two vectors.Calibration steps help compensate for offset (by At screen rear, camera position is related with screen for examination person position).Using the data, it can derive and watch attentively in computer screen Plane coordinates on curtain.

Facial expression and mood determine

In another embodiment, captured image as described above and/or video are handled to identify the key point of face, such as Eyes, nose, the corners of the mouth.Then the region between these key points is analyzed, and is classified into facial expression, facial expression For for example: pay close attention to, frown, eyebrow lifts, cheek lifts, chin lifts, squeeze out dimple (labial angle tighten and inwardly draw), eye closing, Eyes are opened wide, inside eyebrow lifts, chin is sagging, eyelid tightening, skim under the corners of the mouth, press lip, being in a pout (mouth to be pushed forward), lip It elongates, lip is sucked, mouth magnifies, nose wrinkles, smiles, laugh foolishly, upper lip lifts.Then these expressions are reflected using look-up table Be mapped to following mood: indignation despises, detests, participating in (expressiveness), is frightened, happy, sad, surprised and potency (including individual Front and negative experience).Every kind of mood is all encoded as percentage and exports simultaneously.

Physiological measurements

In another embodiment, system includes wearable device, to measure physiological parameter not limited to the following: heart rate, Electrodermal activity (EDA), skin temperature.Equipment wireless connection client computing device (such as tablet computer or meter on knee Calculation machine).Heart rate is obtained by observation blood volume pulse.EDA measures skin electric conductivity, and the latter wakes up as stomodaeal nervous system Index.Based on this, can derive and pressure, participation and excited relevant feature.Another method is using visual analysis Technology directly measures heart rate based on the image captured.When blood volume changes because of heart rate, the light absorption of face's vein goes out Existing minor change, this method are realized based on the minor change.

Graphology analysis

In another embodiment, test answers can be write on dedicated Notepaper by digital pen, and can receive all Such as the instruction of " completion of task process steps " etc.Then, pass through intelligent optical character recognition engine in the computer of operation Written answer is digitized, system can assess content written by subject, and provide when needed any necessary Feedback is to instruct subject.Studies have shown that subject's processing and reconfiguration information can be promoted using common written, so as to improve abiding by From property result.Alternatively, OCR can be used in embodiment after the completion of task.It the use of copier scan paper is digital photo, The picture after digitlization OCR software is sent into again to handle.

The identification and analysis of voice and sound

In another embodiment, system includes one or more voice recorders, for assessing and monitoring link in compliance Record the voice of subject.Then, identify that engine carries out the voice of subject by intelligent sound in the computer of operation Digitlization, system can assess content described in subject, and provide any necessary feedback when needed to instruct subject. Further to analyze compliance, give the answer by word of mouth for spoken command relevant to task process and/or to questionnaire test problem, Identify the substantive content of subject's speech.The voice and sound articulation for identifying subject, as assessment affective state With the input of cognitive state.

Teaching agent-subject's interaction

As non-limiting example, Teaching agent can be non-human cartoon role, have by one or more general meters The mankind for combining to realize of the software and/or firmware that are run in calculation machine processor and/or the computer processor of special configuration Feature.By being selected from one group of animation (such as animated GIF), or by being presented to subject's in user interface Still image uses script geometric transformation, and Teaching agent can show basic mood.Another method is using based on SVG Animation.Animation can be annotated with text message (for example, beside animation in a manner of balloon display text message).Text This message is generated by the training aids module of system, and can receive text message from the module.System receives subject to teaching generation The reaction of reason, to assess the affective state of subject.

It is right in the works in an action that the assessment of affective state and cognitive state and performance data are mainly used for measurement subject The performance specification of task defers to degree.Although single assessment can be used substantially to evaluate subject in its task performance It whole compliance and predicts the subject finally attainable compliance degree, but multiple assessments can be used and commented to provide The development tendency of valence history and subject.In addition, in the assessment of selection compliance, monitoring and instruction transmitting and management method Aspect, use affective state and the cognitive state of assessed subject to model compliance project.

Domain knowledge

Referring to Fig. 5.According to an aspect of the present invention, this method and the system property of will comply with questionnaire and task procedure declaration material, And the pass through mechanism in compliance project is logically configured to domain knowledge 500.Domain knowledge 500 includes one or more concepts Object 501 and one or more task objects 502.Each conceptual object 501 includes one or more knowledge and skills items 503.Knowledge It sorts with technical ability item 503 by task performance specification complexity/difficulty/stringency rank, and two or more concepts pair It can be grouped to form trained outline as 501.In the case where the present invention is applied to specific industry or enterprise, what the present invention defined Training outline can be equivalent to operation manual/standard, and the task performance in knowledge and skills item and operation manual/standard is advised There are one-to-one relationships between model.Each conceptual object can couple to form logic data tree structure (knowledge tree), so that more Node close to the root of logic tree is indicated with the concept in a theme being basic and/or basic knowledge and skills item Object, higher node indicates to have more advanced knowledge and skills item and some common in the different branches of logic tree The conceptual object of the branch of basic and/or basic knowledge and skills item.

Each task object 502 has a variety of different compliance questionnaires and task procedure declaration content material 504, and It is associated with one or more conceptual objects 501 in training outline.Record the incidence relation in problem matrix 505, and can be with Incidence relation is searched wherein.According to an embodiment, task object 502 can be classified as: basic task, interactive task Or the task with basis cognition or expert model.Each basic task includes one or more operation notes, task procedure declaration Whether (such as video clipping and other multimedia content) has read the test problem of all material and has answered for assessing subject Case.It is each that there is the interactive task of basis cognition or expert model to include one or more Resolving probiems practices, each practice Including for instructing subject to derive one or more steps of solution to the problem.Each step both provide answer, often The wrong understanding seen and prompt.These steps design in order, to follow the delivery process of task process.In this way, based on institute Some point during the task of execution can customize and build (such as providing guidance and/or prompt) each task.

According to various embodiments, task object collect one group with the relevant compliance questionnaire of realization compliance degree and Task procedure declaration material (for example, operation note and illustration).In addition to above-mentioned classification, task be can also be with one of Types Below:

1.) reading task: new theme but operation note or illustration without scoring are introduced, is needed before carrying out practice task It completes；

2.) practice task: a problem of basket for a theme is practiced in a new theme, until reach threshold value (for example, Continuous five successful experiments not prompted, or reach 60% or the higher degree of understanding)；

3.) it is proficient in challenge task: the select permeability from multiple themes, to allow subject to reach the degree being proficient on a theme (reach 95% or the higher degree of understanding), and selected problem may include pausing to reinforce the memory (example to knowledge Such as, the chance reviewed to subject)；Or

4.) system job: a basket, problem set and/or the practice solved the problems, such as challenged and designed for companion (may not Can be to scoring), to promote more participations of multiple subjects in focus group.

According to an embodiment, the conceptual object and task object of domain knowledge and its composition, wrap in each conceptual object The knowledge and skills item that contains and training outline, operation note, illustration and test problem in each task object and answer are The data entity being stored in the addressable relational database of system (domain knowledge base).One or more domain knowledge bases can belong to In third party system, it is used to manage, assess and monitor the inside the plan subject of an action to task achievement by the third party system The compliance of effect demand.

According to another aspect of the present invention, for delivering and managing interactive and adaptive compliance questionnaire and task mistake The mechanism that journey illustrates logically is established on two kinds of operation models of domain knowledge: subject's model and training pattern.

Subject's model

Under subject's model, system executes one or more tasks associated with the training outline in the domain knowledge of subject Each of object.During executing task object, system judges the performance of subject, and obtains subject in each task In performance indicators, such as: attempt to answer a question in task successfully and unsuccessful number, request the number and complete prompted At task the time it takes.Performance indicators and task object obtained information (such as its specification complexity/difficulty/ Stringency degree) it is fed in the logistic regression mathematical model of each conceptual object associated with task object.This is also referred to as It is tracked for the knowledge of subject, calculates subject and realize target compliance degree in task associated with conceptual object Probability.In one embodiment, realize that the calculating of the probability of target compliance degree has used subject to problem in questionnaire The time-based moving average of answer score, and the number of trial, successful experiment in the early time, failure are attempted in calculating Number, success rate (successful experiment number is than upper total number of attempt), the time spent and task performance specification complexity/hardly possible Lesser weighting is given in terms of degree/stringency rank.In another embodiment, the meter of the probability of target compliance degree is realized Used user complete task process steps time-based moving average, and calculate in in the early time trial, at Function attempt number, failure attempt number, success rate (successful experiment number is than upper total number of attempt), spend time and Lesser weighting is given in terms of task performance specification complexity/difficulty/stringency rank.

In one embodiment, system calculates subject using iteration machine learning workflow in one and conceptual object The associated task of task performance specification in realize target compliance degree probability, Model fitting is collected Data (performance indicators and mission bit stream of subject) comprising but be not limited to: answer score of the subject to problem in questionnaire Time-based moving average, wherein number that the number of trial, successful experiment in the early time, failure are attempted, success rate (successful experiment number is than upper total number of attempt), time, theme difficulty and problem difficulty for spending etc. are given lesser Weighting.Fig. 4 shows the flow chart of aforementioned iteration machine learning workflow.In the illustrative embodiments, data are acquired (401), it verifies and clears up data (402)；Then, using the data for having verified that and clearing up, to attempt fit mathematics model (403)；Mathematical model (404) iteratively are trained in a circulation, until the data fit mathematics model for having verified that and clearing up；So Afterwards, using mathematical model (405) to obtain subject in a task associated with the task performance specification in conceptual object Realize the probability of target compliance degree；The mathematical model of fitting is also recycled back to and is used in verifying and cleaning number collected According to the step of.

System is pushing compliance questionnaire and the selection of task process specification material item, task object is pushed to select and push away Dynamic compliance questionnaire and task process specification material item ranking etc. are tracked using the knowledge of subject.Subject's model it is excellent Point includes that the execution of task object is adapted to the capacity variation of subject.For non-limiting example, under subject's model, System can judge the achievable compliance degree of subject, and estimation next task is expected how many performance improved, and mentions For subject the compliance degree at some following time point prediction.Then these data are used for training pattern, and can Using hypothesis testing to be further improved system, the quality of compliance ombudsman is evaluated, and assesses compliance questionnaire and appoints The quality of business procedure declaration material.

Training pattern

Under training pattern, the training aids module of system, which receives, executes task object data collected and neck under subject's model Domain knowledge for making decision to compliance questionnaire and task procedure declaration transmission policy, and provides feedback to subject and abides by From property ombudsman.For managing, assessing and monitoring an inside the plan subject of action to the compliance of task performance demand System includes the training realized by the combination of the software and firmware that execute in computer processor that is general and specially designing Device module.In one embodiment, training aids module can belong to one or more server computers.Training aids module is mainly responsible for Machine instruction is executed, which corresponds to movable execution under training pattern.Under training pattern, training aids module is executed It operates below:

1.) entrance of task execution is defined.Firstly, conceptual knowledge and all indexs of technical ability item are both configured to default value, this A little default values be data in the application form filled in by subject or compliance ombudsman or compliance ombudsman to by The preliminary assessment of examination person and infer and obtain.Select the follow-up work to be executed.To select next task, the training aids mould of system Block will search for the logic data tree structure of conceptual object (knowledge tree), find minimum skill level (closest to the root of knowledge tree) Conceptual knowledge and technical ability, then search corresponding task object using matching matrix to be selected.It, will be from field after selection Task object data are extracted in knowledge base, and are sent it to the communication module of system and delivered with showing.

2.) feedback is provided.When subject is handling the task object just executed, the training aids module monitors of system exist The time spent on task step.If it exceeds time restriction, then provide feedback, the table of the current affective state as subject It is existing.For example, it can be the encouraging information selected from universal list, the information with empathy or challenging Information or it be the dedicated prompt from domain knowledge.

3.) Teaching agent of drive system.The training aids module of system is by the current affective state of subject and imparts knowledge to students generation Existing state is matched in reason.Text information is also sent to system other than providing affective state information Communication module, to be presented together with the movement of Teaching agent in the user interface for being shown to subject.

4.) determine when grasped a concept.As previously mentioned, system estimation is in each concept under subject's model Middle subject realizes the probability of target compliance degree in task associated with task performance gauge material.Based on predetermined threshold It is worth (such as 95%), ombudsman can decide when to have grasped a concept.

According to various embodiments, task performance is needed for managing, assessing and monitoring an action inside the plan subject The system for the compliance asked further includes the group of the software and firmware by executing in computer processor that is general and specially designing The communication module closed and realized.In one embodiment, a part of communication module belongs to one or more server computers simultaneously It executes wherein, and the other parts of communication module belong to one or more client computers and execute wherein, client meter Calculation machine includes but is not limited to desktop computer, laptop computer, tablet computer, smart phone and other mobile computing devices, Wherein, some is that subject is dedicated, and other are used by ombudsman.

Communication module includes one or more user interfaces, be designed to by the related data of domain knowledge and system by The material for running and generating under examination person's model and training pattern is presented to subject and ombudsman.User interface is also devised to Convenient for capturing user's input (text, gesture, image and video input) and (religion for prompting and simulating including text of display feedback Learn agency movement) in user interaction.Another important feature of communication module is to provide the screen (calculating that subject uses The screen of equipment) plane coordinates and the visual cues of current task object or focus that are carrying out size.For unrestricted Property example, when showing the operation note of task object on screen, communication module provide operation note display area plane sit It is marked with and size, and the data that the information is used to acquire with gaze tracking sensor are matched, whether to determine object Actual participation task (checks operation note).

Fig. 2 shows according to various embodiments of the present invention for manage, assess and monitor one take action it is inside the plan Logical data flow graph of the subject to the system of the compliance of task performance demand.The logical data flow graph is shown in subject During model and training pattern, how the primary clustering of system cooperates in the execution of feedback cycle.In showing for reference Fig. 2 In example property embodiment, during registration, the subject of an action plan selects a series of suitable tasks.This sequence of tasks A training outline object is corresponded directly to, which is one group of associated conceptual object in domain knowledge 202, and And constitute the target compliance degree 201 of the subject.When the user interface that subject is presented by the communication module of system When login system, under training pattern, the training aids module of system selects from domain knowledge 202 and extracts suitable concept pair As and relevant first task object.Start subject's model, from domain knowledge base extract task object data, system by Task object data (such as operation note) is presented in the user interface of examination person, and subject starts to process the task.Meanwhile The sensing of (204) acquisition affective state is interacted via task problem and answer and the behavioural analysis with user interface of subject Data and cognitive state data, system manage compliance assessment and monitoring process 203, the sensing number of the affective state whereby According to including but not limited to blinkpunkt, mood and physiological data.In the sensing data and cognitive state of the affective state of analysis acquisition After data, compliance state 205 is updated.Compare the compliance state 205 and target compliance degree 201 of update.It will determine Knowledge/skill gap or the fitting of task procedure declaration delivery strategy 206 be again supplied to training pattern, to complete to follow Ring.If sensing data and cognitive state data to the affective state of acquisition analysis shows that reaching some compliance degree Probability is higher than threshold value, then it is assumed that has reached certain compliance degree 207.

Fig. 3 is illustrated in greater detail under subject's model and training pattern, by managing, assessing and monitor based on an action Interior subject is drawn to the activity diagram of the implementation procedure of the system of the compliance of task performance demand.In the exemplary of reference Fig. 3 In embodiment, implementation procedure is as follows:

301. subjects pass through her calculating equipment login system, and the communication module which runs system is presented User interface.

302. subjects select the training outline for being presented to her in the user interface.

303. when receiving user's login, and success identity is transported in server computer with after the selection for receiving training outline The training aids module of capable system selected from domain knowledge base and request it is associated with selected trained outline one or more appoint Business object.If being not yet defined as any task object associated with any conceptual object in selected trained outline, it is System will assess knowledge tree, and find subject and not yet learn and/or be assessed as the root (basis) as close possible to knowledge tree Conceptual knowledge and technical ability.The process is executed by the recommended engine of system, which can be by meter that is general and specially designing The combination of the software and firmware that execute in calculation machine processor is realized.Recommended engine can recommend practice task, and be proficient in and choose War task is in the way of lower rate.The task of system recommendations has default priority；Compliance ombudsman distribution Task has higher priority in task choosing.In one embodiment, which further includes recommended engine, for recommending Next the task performance gauge material (for example, theme) to be learnt in training outline.Use the emotion of subject assessed State and cognitive state data, the performance data of subject, knowledge tree (there are all " edge " themes listed), compliance prison Examine the recommendation information of assistant director, the data (checking the data with crowd subject) of collaborative filtering device and task performance normative content Data (attribute of matching subject attribute and task performance gauge material), recommended engine can recommend system under training pattern that will hold Row next task.For example, by difficult/unfamiliar theme of identification (from the emotion estimated during executing some task Status data) and recommend different/next task of theme for being more familiar with, the negative feeling of subject can be mitigated；And work as When the emotional state of subject is detected as positive, recommend the task of next difficult/unfamiliar theme.In another embodiment In, when the affective state data assessed show that subject's object is not challenged, recommended engine can choose more highly difficult Next task.It so, it is possible the matching of acquisition task Yu highest compliance rank.It in this way can be based on similar performance data And/or the assessment of affective state and cognitive state clusters task.This can also make the subject for completing similar compliance rank Form focus group.

If 304. find requested task object, extracts their data and send it to the meter of subject Equipment is calculated to present in the communication module user interface of system.

305. subjects select task object to start compliance assessment and monitoring link.

The training aids module of 306. systems is from the next item down extracted in selected task object in domain knowledge base, to be in In the communication module user interface of present system.

307. start subject's model, and project is presented in selected task object in the communication module user interface of system (compliance questionnaire problem and/or task procedure declaration).

308. activate the camera for capturing subject's face.

309. during the task process material (309a) in the project that subject participates in selected task object, analysis The blinkpunkt and facial expression (309b) of subject.

310. based in sensing data collected and subject's personal information information (superposition (overlay), including All passing performance datas and the compliance rank data reached) and the affective state and cognitive state of subject are assessed, root According to the affective state and cognitive state of the assessment, can be shown in the communication module user interface of system with instruct and/or text Virtual assistant existing for the mode of this prompt.

311. subjects submit the order of the answer and/or trial attempted to complete task process steps.

The order of 312. pairs of answers attempted and/or trial is scored, and in the communication module user interface of system The scoring is shown to subject.

313. systems store the answer of above-mentioned trial and/or the order of trial and scoring also for further analyzing.

314. calculate subject to selected using the order and scoring of the answer of above-mentioned trial and/or trial The business associated concept of object understands that probability and subject reach the probability of target compliance degree in task.

If 315. selected tasks are completed, the training aids module of system can be based on calculated subject to selected The associated concept of task object understand that probability and subject reach the probability of target compliance degree in task, come The step of selecting and request next task, repeating since step 303.

If 316. selected tasks are not yet completed, the training aids module of system extracts the next item down in selected task, The step of repeating since step 306.

After 317. complete all tasks, system reports the result for generating subject.

According to another aspect of the present invention, for managing, assessing and monitoring the inside the plan subject of an action to task achievement The system of the compliance of effect demand further includes management module, is assisting the action of face-to-face compliance assessment, is monitoring across multiple The process of physical facility and online, remote evaluation and monitoring etc., know from compliance ombudsman, subject and field Know and obtains information.In the exemplary embodiment, management module includes the dispatching algorithm based on constraint, which determines compliance The optimal scheduling scheme of assessment and monitoring link, while abiding by constraint, for example, the certification of compliance ombudsman, subject with abide by From the travel distance first come, first served principle of property ombudsman, based on the realization progress of compliance rank and the compliance of Training strategy The composition of ombudsman group.For example, dispatching algorithm can when compliance ombudsman wants to improve teaching/training of the same generation To select that there is the subject of complementary skill group, makes it possible to help each other and form focus group.

Aspectant compliance assessment and monitoring link may include typical process in person, such as: subject's registration is held Result is directly presented on compliance ombudsman's after completion to assess the cognitive state of subject by the small task of row In user interface panel.Then, which continues to explain that new task performance specification is deferred to here by compliance ombudsman Property ombudsman receive the assistance of systematic teaching agency, the latter provides instructional objective and prompt.After interpretation, subject can be with New task is participated in, wherein system provides as needed possible builds frame.Progress and subject are realized according to compliance rank Affective state, the training aids module of system determines how by several options to continue compliance assessment and monitoring link: example Such as suggest setting up focus group, the subject of each group reaches similar compliance rank when completing previous tasks.Pass through Understand.Collect attendance data with for billing purposes with compliance authentication purpose.

Although the embodiment of aforementioned present invention is mainly used in commercial and industrial activity, investigation and job performance evaluation and sets It sets, but the present invention can adapt to Customer Relation Management (CRM) action plan in the case where no excessive experiment.According to this hair A bright embodiment, for managing, assessing and monitoring an inside the plan subject of action to the compliance of task performance demand Method and system includes the mechanism for delivering and managing interactive and adaptability compliance questionnaire and task procedure declaration.The machine Making and logically constructing compliance questionnaire and task procedure declaration material in a compliance project is FIELD Data, element For conceptual object and task object with knowledge and skills item, and respectively with relevant industries or the related training material of occupation Material.When being applied to investigation, the choosing of investigation problem is pushed to the assessment of subject's affective state and cognitive state using system It selects and presentation mode.This makes it possible to obtain more accurate and quick investigation result from subject in turn.When applied to work When making performance evaluation, assessment of the system to employee subject about the affective state and cognitive state of responsibility can allow employer can To measure the level of skill, professional horizontal capability and interest of employee always, to provide help for work and task distribution.

Referring to Fig. 6 A and 6B.According to another aspect of the present invention, for manage, assess and monitor one action it is inside the plan by Examination person uses machine learning techniques to the method and system of the compliance of task performance demand, executes model, packet based on interconnection It includes: domain model, assessment models, learner model, deep learning person's model, one or more excitation model, transition model and religions Learn model.Interconnection executes certain desired movements, behavior and/or the knot that model is intended for driving, induce or motivating subject Fruit.As non-limiting example, these desired movements and/or result can be study specific subject, realize specific academic mesh Mark realizes specific vocational objective, completes particular job task, carries out particular purchased and carries out particular business activity.These are mutually It even executes model and machine learning feedback cycle is collectively formed, which, which is included under assessment models, is continuously tracked and assesses subject Study schedule, under learner model push learning activities, deep learning person's model and excitation operation model under excitation by Examination person selects and reselects knowledge space project under domain model and transition model and under teaching mode by knowledge Space item and activity are transmitted to next state of knowledge from a state of knowledge.

The embodiment of electronic equipment disclosed herein can be used according to the teaching of this article and configure or program general Or dedicated computing equipment, computer processor or including but not limited to specific integrated circuit (ASIC), field programmable gate array (FPGA) it is realized with the electronic circuits of other programmable logic devices.Based on teaching herein, the skill of software or electronic field Art personnel, which can easily be handled, can run on general or specialized calculating equipment, computer processor or programmable logic device Computer instruction or software code.

The all or part of the embodiment of electronic equipment can execute in one or more general or calculating equipment, wrap The mobile computing for including server computer, personal computer, laptop computer and such as smart phone and tablet computer is set It is standby.

The embodiment of electronic equipment includes that the computer with the computer instruction or software code that are stored therein is deposited Storage media can be used for being programmed computer or microprocessor to execute any process of the invention.Storage medium can be with Including but not limited to floppy disk, CD, Blu-ray disc, DVD, CD-ROM and magneto-optic disk, ROM, RAM, flash memory device or be suitable for storage Instruction, any kind of medium of code and/or data or equipment.

Various embodiments of the invention can also realize in distributed computing environment and/or cloud computing environment, wherein Machine instruction is executed in a distributed way by the one or more processing equipments for passing through interconnection of telecommunication network all or in part, such as As Intranet, wide area network (WAN), Local Area Network, Internet and other forms data transmission media.

Foregoing description of the invention is for the purpose of illustration and description, to be not intended to exhaustion or limit the invention to Disclosed precise forms.To those skilled in the art, many modifications and variations are obvious.

The selection and description of embodiment be in order to best explain the principle and its practical application of the present invention so that Others skilled in the art are it will be appreciated that various embodiments of the invention and specific use expected from being suitable for The various modifications on way.

Claims (20)

1. a kind of be to the compliance of task performance demand for managing, assessing and monitoring an inside the plan subject of action System, comprising:

One or more optical sensors, for assessing and monitoring the sensing number that link captures and generates a subject in compliance According to；

One or more electronic databanks comprising one or more domain knowledge data entities, each domain knowledge data entity packet Include one or more conceptual data entities and one or more task data entities, wherein each conceptual data entity includes one or more A and task performance normative content item, each task data entity includes one or more compliance questionnaires and task process specification material Expect item, each task data entity is associated at least one conceptual data entity, and multiple conceptual data entity groupings are to form Training outline；

The subject's module executed by one or more computer-processing equipments, for using the sensing number acquired from optical sensor According to come the affective state and cognitive state of assessing subject；

The training aids module executed by one or more computer-processing equipments, for assessing in compliance and monitoring link, every After one task data entity is completed, subsequent task data entity is selected, extracts task data entity from electronic databank Compliance questionnaire and task process specification material item, transmitted and be presented to subject；

The recommended engine executed by one or more computer-processing equipments can be used for selecting follow-up work data entity for creating Task data list of entities, wherein the task data entity that can be used for selection is associated with one or more conceptual data entities Task data entity, which forms selected trained outline；

Wherein, from the task data list of entities for can be used for selection select task data entity be based on subject with concept The probability of target compliance degree is completed in the associated task of task performance normative content item of data entity；

Wherein, using affective state and cognitive state to subject assessment input data, come calculate subject complete mesh Mark the probability of compliance degree.

2. the system as claimed in claim 1, which is characterized in that the system further include:

One or more physiological measurement mechanisms capture subject and are applied to tactile sensing for assessing and monitoring link in compliance One or more in the tactile pressure of device, heart rate, electrodermal activity (EDA), skin temperature and touch-responsive, it is additional to generate Sensing data；

Wherein, subject's module be also used for optical sensor acquisition sensing data and physiological measurement mechanism acquisition it is additional Sensing data, assess the affective state and cognitive state of subject.

3. the system as claimed in claim 1, which is characterized in that the system further include:

One or more voice recorders, for assessing and monitoring the sound and lamprophonia that link captures subject in compliance Degree, generates additional sensing data；

Wherein, subject's module be also used for optical sensor acquisition sensing data and voice recorder acquisition it is additional Sensing data, assess the affective state and cognitive state of subject.

4. the system as claimed in claim 1, which is characterized in that the system further include:

One or more person's handwriting acquisition equipments capture the person's handwriting of subject for assessing and monitoring link in compliance, and generate volume Outer sensing data；

Wherein, the module be also used for optical sensor acquisition sensing data and the acquisition of person's handwriting acquisition equipment it is additional Sensing data, to assess the affective state and cognitive state of subject.

5. the system as claimed in claim 1, which is characterized in that the system further include:

One or more Teaching agents, for assessing and monitoring the interaction that link captures subject and Teaching agent in compliance, and Generate additional sensing data；

Wherein, the module is also used for the sensing data of optical sensor acquisition and the additional sensing of Teaching agent acquisition Data, to assess the affective state and cognitive state of subject.

6. the system as claimed in claim 1, which is characterized in that each task performance normative content material item is operation note Record, illustration, test problem, the video with embedded testing problem, in deriving issue-resolution have be intended to provide The training or there is the solution of the problem of one or more heuristic rules or constraint condition that the problem of multiple steps of guidance solves Training, the heuristic rule or constraint condition problem of modelling solve the step of training, and the step and subject's execution have The synchronous transmitting of task process steps about task performance specification.

7. the system as claimed in claim 1, which is characterized in that

Multiple conceptual data entities are linked to form a logic data tree structure；

Wherein, the knowledge and skills content item on the basis that conceptual data entity is possessed in a theme is by close to logic tree The node of the root of data structure indicates, and conceptual data entity has advanced knowledge and skills content item and common base The branch of this knowledge and skills content item is then indicated by node higher in the different branches of logic data tree structure；

Wherein, recommended engine is also used to create the task data list of entities for being suitable for selecting follow-up work data entity, wherein The task data entity for being suitable for selection is related to one or more the conceptual data entities for forming selected trained outline The task data entity of connection, one or more conceptual data entities have not yet being grasped by subject and close to conceptual data The knowledge and skills item of the root of logic data tree structure belonging to entity.

8. the system as claimed in claim 1, which is characterized in that

Use the affective state of assessment subject and the input data of cognitive state and the performance data and behavior number of subject According to calculate the probability that subject completes target compliance degree；

Wherein, the performance data and behavioral data of subject include one or more attempt completion task process steps success with not at The number of function, the speed for completing task process, to the correct degree of question answering in questionnaire, attempt to answer a question successfully and not at The number of function, the answer of subject are near the mark degree, the frequent switching and to spy between given answer choice of answer Determine type, theme subject matter and/or task performance specification complexity/difficulty/Stringency test problem reaction speed, solution Certainly in the implementation step of scheme, the person's handwriting of subject, intonation and sound articulation.

9. the system as claimed in claim 1, which is characterized in that the sensing data include the subject facial expression, One or more of eye movement, blinkpunkt and head pose.

10. the system as claimed in claim 1, which is characterized in that

The probability of target compliance degree and the affective state of the subject assessed are realized based on subject, from suitable for choosing Task data entity is selected in the task data list of entities selected；

When the affective state of the subject assessed is expressed as negative feeling, from the knowledge and skill that are not liked with subject In the associated task data entity of conceptual data entity of energy content item, selection and the knowledge and skills liked with subject The associated another task data entity of another conceptual data entity of content item；

When the affective state of the subject assessed is expressed as active mood, from the knowledge and skills liked with subject In the associated task data entity of the conceptual data entity of content item, selection and the knowledge and skills not liked with subject The associated another task data entity of another conceptual data entity of content item.

11. a kind of for managing, assessing and monitoring the inside the plan subject of an action to the side of the compliance of task performance demand Method, comprising:

Link is assessed and monitored in compliance capture and generate the sensing about a subject using one or more optical sensors Data；

There is provided one or more electronic databanks comprising one or more domain knowledge data entities, each domain knowledge data are real Body includes one or more conceptual data entities and one or more task data entities, wherein each conceptual data entity includes one Or multiple tasks performance normative content item, each task data entity include one or more compliance questionnaires and task procedure declaration Material item, each task data entity is associated at least one conceptual data entity, by multiple conceptual data entities point Group forms trained outline；

The affective state and cognitive state of subject are assessed using the sensing data acquired from optical sensor；

Link is assessed and monitored in compliance select subsequent number of tasks factually after completing each task data entity Body extracts the compliance questionnaire and task process specification material item of task data entity from electronic databank, is transmitted and be in Now give subject；

Creation can be used for selecting the task data list of entities of subsequent task data entity, wherein can be used for the number of tasks of selection Factually body is task data entity associated with one or more conceptual data entities, which forms Selected trained outline；

Wherein, target is completed in task associated with the task performance normative content item of conceptual data entity based on subject The probability of compliance degree selects task data entity from the task data list of entities for can be used for selection；

Wherein, using affective state and cognitive state to subject assessment input data, come calculate subject complete mesh Mark the probability of compliance degree.

12. method as claimed in claim 11, which is characterized in that the method further include:

Link is assessed and monitored in compliance, captures and generates the tactile tension being applied on touch sensor about subject One or more of additional sensing data in power, heart rate, electrodermal activity (EDA), skin temperature and touch-responsive；

Wherein, using the additional sensing data of the optical sensor sensing data used and physiological measurement mechanism acquisition, assessment The affective state and cognitive state of subject.

13. method as claimed in claim 11, which is characterized in that the method further include:

It is captured in compliance assessment and monitoring link using one or more voice recorders and generates the sound about subject The additional sensing data of sound and speech intelligibility；

Wherein, using the additional sensing data of the optical sensor sensing data acquired and voice recorder acquisition, assessment The affective state and cognitive state of subject.

14. method as claimed in claim 11, which is characterized in that the method further include:

It is captured in compliance assessment and monitoring link using one or more person's handwriting acquisition equipments and generates the pen about subject The additional sensing data of mark；

The additional sensing data of sensing data and person's handwriting the acquisition equipment acquisition acquired using optical sensor, it is tested to assess The affective state and cognitive state of person.

15. method as claimed in claim 11, which is characterized in that the method further include:

It is captured in compliance assessment and monitoring link and generates the volume of the interaction about subject Yu one or more Teaching agents Outer sensing data；

Wherein, using optical sensor acquire sensing data and Teaching agent acquisition additional sensing data, come assess by The affective state and cognitive state of examination person.

16. method as claimed in claim 11, which is characterized in that each of described task performance normative content material item It is operation note, illustration, test problem, video with embedded testing problem derives there is purport in issue-resolution Training is solved the problems, such as the problem of multiple steps of guidance are provided or there is one or more heuristic rules or constraint condition Training is solved, the heuristic rule or constraint condition problem of modelling solve the step of training, and the step and subject execute About the synchronous transmitting of the task process steps of task performance specification.

17. method as claimed in claim 11, which is characterized in that

Multiple conceptual data entities are linked to form logic data tree structure;

Wherein, the knowledge and skills content item on the basis that conceptual data entity is possessed in a theme is proximate to logic tree number It is indicated according to the node of the root of structure, and conceptual data entity has advanced knowledge and skills content item and common basis The branch of knowledge and skills content item is then indicated by node higher in the different branches of logic data tree structure；

Wherein, which be one or more conceptual datas with the selected trained outline of formation The associated task data entity of entity, one or more conceptual data entities have not yet being grasped by subject and close The knowledge and skills item of the root of logic data tree structure belonging to conceptual data entity.

18. method as claimed in claim 11, which is characterized in that

Use the affective state of assessment subject and the input data of cognitive state and the performance data and behavior number of subject According to calculate the probability that subject completes target compliance degree；

The performance data and behavioral data of subject include one or more attempt completion task process steps success with it is unsuccessful Number, the speed for completing task process, to the correct degree of question answering in questionnaire, attempt to answer a question successfully with it is unsuccessful The answer of number, subject is near the mark degree, the frequent switching and to certain kinds between given answer choice of answer Type, theme subject matter and/or task performance specification complexity/difficulty/Stringency test problem reaction speed, solution Implementation step, the person's handwriting of subject, in intonation and sound articulation.

19. according to the method for claim 11, which is characterized in that the sensing data includes the facial table of the subject One or more of feelings, eye movement, blinkpunkt and head pose.

20. method as claimed in claim 11, which is characterized in that

The probability of target compliance degree and the affective state of the subject assessed are realized based on subject, from suitable for choosing Task data entity is selected in the task data list of entities selected；

When the affective state of the subject assessed is expressed as negative feeling, from the knowledge and skill that are not liked with subject In the associated task data entity of conceptual data entity of energy content item, selection and the knowledge and skills liked with subject The associated another task data entity of another conceptual data entity of content item；

When the affective state of the subject assessed is expressed as active mood, from the knowledge and skills liked with subject In the associated task data entity of the conceptual data entity of content item, selection and the knowledge and skills not liked with subject The associated another task data entity of another conceptual data entity of content item.