WO2019024247A1 - Data exchange network-based online teaching evaluation system and method - Google Patents

Data exchange network-based online teaching evaluation system and method Download PDF

Info

Publication number
WO2019024247A1
WO2019024247A1 PCT/CN2017/105594 CN2017105594W WO2019024247A1 WO 2019024247 A1 WO2019024247 A1 WO 2019024247A1 CN 2017105594 W CN2017105594 W CN 2017105594W WO 2019024247 A1 WO2019024247 A1 WO 2019024247A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
student
evaluation
teaching
state
Prior art date
Application number
PCT/CN2017/105594
Other languages
French (fr)
Chinese (zh)
Inventor
卢启伟
杨宁
刘胜强
Original Assignee
深圳市鹰硕技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市鹰硕技术有限公司 filed Critical 深圳市鹰硕技术有限公司
Publication of WO2019024247A1 publication Critical patent/WO2019024247A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0639Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/20Education
    • G06Q50/205Education administration or guidance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/70Multimodal biometrics, e.g. combining information from different biometric modalities

Definitions

  • the invention relates to the technical field of network education, in particular to an online teaching evaluation system and method based on a data exchange network.
  • web-based online learning is a widely used form of distance learning.
  • online learners can flexibly adjust and control their learning activities and learning processes.
  • the scale of China's online education market has reached 200 billion yuan per year, and the number of learners has reached 100 million, covering areas such as higher education, primary and secondary education, vocational training and preschool education.
  • the “Formability Evaluation System” with the publication number CN102542849B provides a data recording physiological behaviors such as student's answering behavior, facial expression, and EEG and ECG variability, and comprehensively analyzes the psychological and physiological state of students during the answering process. Improve the accuracy of the assessment.
  • CN104299178A a facial recognition-based network teaching method and system
  • real-time monitoring of whether the students are learning the expression management provided to help the teacher to understand whether the students are seriously studying, the log management provided to monitor whether the students should complete the learning content, to avoid absenteeism during the learning process or Alternative phenomena.
  • the physiological state is relatively rough, and the accuracy of determining the student's true learning state is low; focusing on the evaluation of the test state can only reflect the objective state of the student, but not the student's learning. Conduct targeted guidance to improve learning efficiency; using traditional test methods, compared with the application in the real working environment, there are still big differences.
  • the present invention aims to provide an online teaching evaluation system and method based on a data exchange network.
  • an online teaching evaluation system based on a data exchange network including:
  • the course unit including the teaching unit and the evaluation unit, is used to provide the students with the teaching and evaluation courses;
  • the evaluation unit gives an overall evaluation of the student's course learning and evaluation.
  • the above evaluation system also includes:
  • the psychological analysis unit comprehensively analyzes the psychological state reflected by the physiological signs of the students, and the analysis result is the psychological state achievement, which is used for the evaluation unit to give an overall evaluation of the students' learning situation and evaluation situation;
  • the application environment unit places the student in a work scene close to reality, and guides the student to complete the course or complete the evaluation in the work scene;
  • the adjustment unit including the teaching adjustment unit and the evaluation unit, adjusts the teaching and evaluation content according to the teaching requirements and the psychological state of the student;
  • the prediction unit according to the student state given by the psychoanalysis unit and the overall evaluation given by the evaluation unit, gives the student the level that can be achieved under the best and worst conditions of the psychological state.
  • the course unit can record the test scores of the students during the course of the course and the test scores during the evaluation process.
  • the physiological monitoring unit includes:
  • a facial feature monitoring unit for monitoring facial features of the student, and then performing facial feature-based evaluation on the psychological state of the student;
  • the voice monitoring unit is configured to monitor the volume, speech rate, and pause characteristics of the student voice, and then perform a voice feature-based evaluation on the psychological state of the student;
  • a skin monitoring unit for monitoring a student's pulse and skin moistness, thereby making a skin feature-based evaluation of the student's psychological state
  • the action monitoring unit is configured to monitor the physical movements of the students, and then make an evaluation based on the action characteristics of the mental state of the students.
  • the action monitoring unit includes:
  • the eye monitoring unit is configured to monitor the movement of the student's eye, and then make an evaluation based on the eye feature on the psychological state of the student;
  • the gesture monitoring unit is configured to monitor the speed and acceleration of the student's limb end swing, and then make a gesture-based evaluation of the student's mental state.
  • the psychoanalyst unit includes:
  • a first determining unit configured to determine consistency of a mental state evaluation performed by the facial feature detecting unit and the voice monitoring unit
  • the second determining unit further judges the psychological state evaluation made by the skin monitoring unit and/or the motion monitoring unit when the facial feature monitoring unit and the voice monitoring unit do not agree on the psychological state evaluation.
  • the manual determining unit when the determining unit cannot accurately determine the mental state, the system enters the manual determination mode to generate the psychological state given by the first and second determining units, and on this basis, the mental state is manually given by the teacher and entered. system.
  • the evaluation unit gives an overall evaluation of the student's course learning situation and the evaluation situation.
  • the overall evaluation includes test scores and mental state scores.
  • the test scores are composed of the test scores of the students in the course of the course and the test scores of the test unit modules; the mental state scores are analyzed by the psychoanalytic unit.
  • the information feedback from the physiological monitoring unit is analyzed during the examination.
  • the application environment unit includes:
  • a virtual reality unit that simulates a scene that produces a three-dimensional space required by the teaching environment, and provides a simulation of the visual, auditory, and tactile senses of the student in the environment;
  • Augmented reality unit applying the virtual information required by the teaching environment to the real teaching scene, so that the real teaching scene and the virtual object or information are superimposed in the same picture or space in real time;
  • an online teaching evaluation method based on a data exchange network comprising the following steps:
  • the teaching course unit generates a realistic work scene by applying the environment unit according to the requirements of the student registration course, and provides a teaching course to the student in the scene;
  • S50 Adjust the teaching curriculum according to the teaching requirements and the psychological state of the students, so that the teaching curriculum matches the psychological state of the students, and conduct a classroom test, and record the psychological state achievements in the process;
  • the monitoring of the physiological signs includes:
  • the facial feature monitoring unit is used to monitor the facial features of the student, and then the facial features are evaluated based on the psychological state of the student;
  • the voice monitoring unit Through the voice monitoring unit, the volume, speech rate, and pause characteristics of the student's voice are monitored, and then the voice state-based evaluation is performed on the student's psychological state;
  • the pulse and skin moistness of the student are monitored, and then the skin condition is evaluated based on the psychological state of the student;
  • the action monitoring unit Through the action monitoring unit, the student's body movements are monitored, and then the behavioral characteristics of the students are evaluated based on the action characteristics.
  • the action monitoring includes:
  • the eye monitoring unit Through the eye monitoring unit, the movement of the student's eye is monitored, and then the psychological state of the student is evaluated based on the characteristics of the eye;
  • the gesture monitoring unit Through the gesture monitoring unit, the speed and acceleration of the student's limb end swing are monitored, and then the mental state of the student is evaluated based on the gesture feature.
  • the comprehensive analysis of the mental state includes:
  • the first determining unit determining the consistency of the psychological state evaluation made by the facial feature detecting unit and the voice monitoring unit;
  • the psychological state evaluation by the skin monitoring unit and/or the motion monitoring unit is further Judging the psychological state of the student;
  • the determination unit cannot accurately determine the mental state
  • the manual determination mode is entered, and the psychological state given by the first and second determination units is generated.
  • the mental state is manually given by the teacher and entered into the system.
  • the application environment unit is used to generate a real work scenario, including:
  • the whole process of monitoring and adjusting the learning process is realized, and the students are learned and tested in the real application environment, thereby achieving the teaching purpose and learning and applying.
  • FIG. 1 is a schematic diagram of an online teaching evaluation system based on a data exchange network according to the present invention.
  • FIG. 2 is a schematic diagram of an online teaching evaluation method based on a data exchange network according to the present invention.
  • the present invention provides an online teaching evaluation system and method based on a data exchange network, which aims to obtain a more accurate state of the student's mental state, and uses the mental state to adjust the teaching course and the examination evaluation.
  • teaching in a more realistic environment makes the student's knowledge system more complete and practical.
  • FIG. 1 is a schematic diagram of an online teaching evaluation system based on a data exchange network according to the present invention.
  • the device is suitable for online teaching and evaluation under the data exchange network.
  • the teaching plan is formulated according to the syllabus and provided to the course unit 10, and the course unit 10 includes a teaching course unit 101 and an evaluation course unit 102 for providing teaching to the students.
  • the physiological monitoring unit 20 is configured to monitor physiological signs of the student, and the physical signs obtained by the monitoring reflect the learning state of the student, and the learning state is determined by the psychoanalyst unit 30, thereby obtaining the real-time state of the student.
  • the face monitoring unit 201 is used to monitor the facial features of the student.
  • the facial features reflect the expression and mood of the person, and the mood of the person is directly related to the learning state. People's expressions can be divided into joy, sadness, anger, surprise, fear and disgust. Different expressions, such as human eyes, lips, and eyebrows, will change.
  • the image monitoring of the above features can obtain the real-time status of learners. Status includes attention and fatigue.
  • the face monitoring unit 201 is composed of an image acquiring unit 2011, an image processing unit 2012, and an image state analyzing unit 2013; the image acquiring unit 2011 can collect the face image by a digital camera; the image processing unit 2012 passes the brightness, color space, and color of the image.
  • the information features such as gray scale are extracted to extract the physiological features required for learning state recognition.
  • the eyes are darker than other areas of the face, the gray value is relatively low, and the gray level change rate is faster than other areas.
  • the position of the eye and the direction of the eyeball can be determined;
  • the color of the lips is red, which is a common feature of human beings, and has a significant difference from the color of the skin color. Therefore, the positioning and recognition of the lips can be directly realized by separating the red pixels in the RGB image.
  • the learner's learning state may be determined according to the association between the above features and the learning state.
  • the learner may be determined to be asleep according to the opening and closing of the eyes;
  • the frequency of blinking determines whether the learner has inattention and fatigue. Specifically, a person blinks 10-15 times per minute. When the learner is in a state of fatigue, the frequency of blinking will decrease significantly. When the frequency of blinking is less than 10 times per minute, it usually enters a state of fatigue. When it is severely fatigued, the eye will always be in an eye-closed state, and accordingly, the attention will decrease. For example, after obtaining the characteristics of the lips, it can be further judged. The state of the learner, common lip characteristics are yawning, biting lips, licking lips, pouting, pouting, rising mouth, etc.
  • the owe indicates that the learner may have entered fatigue.
  • the biting of the lips and the licking of the lips usually indicate that the learner is under greater pressure.
  • the pouting indicates that the learner is disdainful or angry.
  • the pouting indicates that the learner is dissatisfied or dissatisfied, and the rising of the mouth indicates the joy.
  • the state of the learner can be further judged.
  • the common eyebrow features are stretched, frowning, eyebrows, eyebrows, etc.
  • the eyebrow stretch indicates that the mood is calm and in a happy state, and the frown indicates that it is in trouble. Or bored, eyebrows indicate the importance of talking about the content of the discussion, and raising the eyebrows shows joy.
  • the voice monitoring unit 202 is used to monitor the student's volume, speech rate, and pause.
  • the voice feature reflects the person's mood from another angle, and the person's mood is directly related to the learning state.
  • the voice monitoring unit 202 includes a voice collecting unit 2021, a voice processing unit 2022, and a voice state analyzing unit 2023.
  • the voice collecting unit 2021 acquires the voice, and extracts parameters such as volume, speech rate, pause, and pitch frequency through the voice processing unit 2022, and then obtains the mental state of the student by analyzing the voice state analyzing unit 2023.
  • the volume is usually the external performance of short-term energy. When the emotion is more exciting, the volume is higher, and the energy curve fluctuates greatly.
  • the gene frequency characteristic curves are different between different emotions, so the gene frequency can be analyzed according to the maximum and minimum values of the gene frequency in different emotions. Performance between.
  • the skin monitoring unit 203 is used to monitor the pulse and skin moistness of the student, and the pulse and skin moistness reflect the person's mood from another angle.
  • the skin monitoring unit 203 includes a skin moisture sensor 2031, a pulse sensor 2032, and a skin state analyzing unit 2033.
  • the skin moisture level data is obtained by the skin moisture sensor 2031
  • the body pulse data is obtained by the pulse sensor 2032
  • the above data is analyzed by the skin state analyzing unit 2033 to obtain the psychological state of the student. For example, when a person is in a nervous mood, the palm of the hand increases significantly, and the pulse increases. When the person's state of mind is calm, the pulse is stable and the palm of the hand is low. Through the changes in the above signs, it is possible to The student’s mood changes now.
  • the gesture monitoring unit 204 is employed to monitor the student's gestures and reflect the student's emotions from another perspective.
  • the gesture monitoring unit 204 includes a gesture sensor 2041 that records the position of the hands and/or fingers, the swing speed, the acceleration, and the like, and also includes a gesture state analysis unit 2042.
  • the data of the two-handed data obtained by the gesture sensor 2041 is analyzed by the gesture state analyzing unit 2042 to obtain the psychological state of the student.
  • the hand keeps playing with some things around you. At this time, it is usually a state of psychological stress or carelessness; for example, frequently touching the forehead with hands, it means very tired, or feeling anxious; for example, the pickpocket usually expresses the inner heart.
  • an eye monitoring unit 205 is further included for monitoring the eye movements of the student, thereby making an evaluation based on the eye features of the mental state of the student.
  • the eye monitoring unit 205 includes an eye sensor 2051 that records an eye motion, and further includes an eye state analyzing unit 2052.
  • the eye related data is obtained by the eye sensor 2051, and the above data is analyzed by the eye state analyzing unit 2052 to obtain the psychological state of the student. For example, the visual direction of the eyeball is monitored. When the eye looks like a left and rotates slowly, it often expresses recollections. The eyeballs frequently look around and sometimes appear to be thinking; for example, the monitoring of the size of the pupil diameter and the degree of diameter change, in all emotions.
  • the obsessive observer In the state, the obsessive observer has the largest pupil diameter and the strongest degree of change; followed by impatience and calmness, the observer of emotional anxiety has the smallest pupil diameter and the weakest degree of change, and the change of pupil reflects the state of emotion and changes.
  • emotional stress or excessive fatigue may manifest as eyelids.
  • the psychological analysis unit 30 is further configured to comprehensively analyze the psychological state reflected by the physiological signs of the student.
  • the mental state is usually reflected by certain postures or performances of the body, but In some cases, the same physical characteristics may correspond to different mental states. For example, the eyelids are an external manifestation of emotional stress or excessive fatigue. Therefore, the psychoanalyst unit 30 is required to provide a single unit given by the above monitoring and monitoring units. The evaluation is integrated to give a more accurate mental state.
  • the psychoanalytic unit 30 includes a first determining unit 301 for determining the consistency of the psychological state evaluation made by the face monitoring unit 201 and the voice monitoring unit 202, when the face monitoring When the unit 201 and the voice monitoring unit 202 each independently give the same emotional judgment, the first state determining unit 301 can directly derive the emotional state at this time.
  • the second determining unit 302 is activated, and the skin monitoring unit 203 and/or the motion monitoring unit composed of the gesture monitoring unit 204 and the eye monitoring unit 205 are activated.
  • the psychological state evaluation further determines the psychological state of the student; and when the above determining unit cannot accurately determine the mental state, the system enters the manual determination mode to generate the psychological state given by the first and second determining units, on the basis of The mental state is manually given by the teacher and entered into the manual decision unit 303.
  • the advantage of using the above psychoanalytic unit is that the accuracy of the judgment is improved while ensuring efficiency.
  • an application environment unit 40 that places the student in a work scene that is close to reality in accordance with the teaching requirements of the course unit 10, in which the student is instructed to complete the course or complete the assessment.
  • the application environment unit 40 includes:
  • a virtual reality unit 401 simulating a scene of a three-dimensional space required to generate a teaching environment, providing a simulation of visual, auditory, and tactile sensations of the student in the environment; or, 2) an augmented reality unit 402, which requires virtual information required by the teaching environment Apply to the real teaching scene, so that the real teaching scene and the virtual object or information are superimposed in the same picture or space in real time; or 3) the combination of the virtual reality unit and the augmented reality unit.
  • the application environment unit 40 adopting the above information technology includes the following advantages: firstly, it can solve the boring and practical problems of the existing teaching; secondly, it can solve the problem of lack of communication between the existing online teaching students and between the students and the teachers. With the above device, students can see teachers or other students in the same scene in the virtual scene, and can complete the team collaboration project. Finally, in the teaching process, the teacher can observe the students' behaviors from the perspective of the students, so as to understand the student learning process. Some of the misunderstandings in the middle.
  • the device is particularly suitable for applications in the field of mechanical design.
  • the drawing sequence of the planar graphic is as follows, drawing a reference line, drawing a known line segment, drawing a middle line segment, drawing a connecting line segment, checking and finishing; and dimensioning
  • the order is as follows, select the reference, mark the positioning size of the known line segment, mark the fixed size of the known line segment, mark the size of the middle line segment, mark the fixed size of the connecting line segment, check and adjust.
  • the drawing order is related to the student habit.
  • the instructor can observe the drawing from the perspective of the student. According to the monitoring of the eye movements by the eye monitoring unit, the order of the students' eyes on the drawings can be understood. In the case that the students have an incorrect way of observation, the students can be adjusted or recorded in time, and the students can be guided in the later stage.
  • the device is especially suitable for quick reading practice of literary works.
  • qualified students should focus on the connecting words with the role of inheritance, and the keywords guided by these connecting words, thereby enabling Quickly get the backbone and context of the work.
  • the instructor can read from the perspective of the student, and according to the monitoring of the movement of the eyeball by the eye monitoring unit, the difference in the time of the different words allocated during the reading process can be found, thereby enabling the student to find the speed reading.
  • the problems that exist in the learning process can lead to more specific and targeted guidance for students.
  • the adjustment unit 50 further includes an adjustment unit 501 and an assessment adjustment unit 502, and adjusts the teaching and evaluation contents according to the teaching requirements and the psychological state of the students, so that the students learn more suitable contents under different psychological states. For example, when the system monitors that students are active in thinking, happy and focused, automatically improve the difficulty of the course, and provide the content or key or core content that is difficult to grasp to the students for learning; when the system monitors the students In the case of high tension or difficulty in learning, it automatically reduces the difficulty of the course, provides simple or easy content to the students, relieves tension and builds confidence; when the system monitors students in a slight fatigue, automatically provides interaction More teaching courses, such as foreign language dialogue content or article retelling; when the system monitors the students in fatigue, the current learning content is closed and organized, and the teaching is suspended, allowing students to rest and relax.
  • the system carrying the unit provides test questions of different difficulty according to the psychological state of the student during the examination process, and tries to enable the student to complete the test under the best condition.
  • the student whose native language is Chinese is expected to obtain a comprehensive improvement of the five abilities of the words, listening, speaking, reading and writing in the English learning.
  • the teacher or the online course provider according to a certain order A fixed course is provided to the student A. After each stage of the course is completed, the next step is entered. Although there is a connection between the courses, the psychological state of the student is not considered.
  • the student A first selects the learning item, which selects the word as the first learning object.
  • the system monitors that student A’s attention is always focused on a few words, and eye and motion monitoring shows that the student is only doing mechanical duplication and memory, at this time, in order to make the student
  • switching to the dictation about the above words in the process, through the external influence, the students adjust the learning style and deepen the impression of the learned words; further, the students have already
  • the reading content is a dialog sentence containing the learned words, the mode switching makes the student's thinking always active, and further enhancing the memory and application of the words by reading aloud; Entering the speech expression link, in the mode, providing Chinese text, students need to think about the correct English expression by thinking.
  • the system monitors that the students are in a state of active thinking and expresses a strong desire. At this time, they are transferred to the article writing mode. Under this mode, students acquire the previous stages of learning. Knowledge, and writing essays in a state where the brain is fully active, thereby completing the course study in the section.
  • an evaluation unit 60 that gives an overall rating based on the status of the student, the student's course learning, and the assessment based on the psychoanalytic unit 30.
  • the evaluation unit 60 gives an overall evaluation of the student's course learning and evaluation.
  • the overall evaluation includes test scores and mental state scores.
  • the test scores are composed of the test scores of the students when they are studying in the teaching unit 101 and the test scores of the examination unit 102 exams; the mental state scores are determined by the psychoanalysis unit 30. The information fed back to the physiological monitoring unit 20 during the teaching and examination process is analyzed and given.
  • the test score is divided into five grades of ABCDE, and A is the highest grade; the mental state score is divided into state 1 (concentration of mind, active thinking), state 2 (concentration of spirit, active thinking), state 3 (the general concentration of the spirit, the active thinking is general), the state 4 (the spirit is less concentrated, the thinking is slower) and the state 5 (the spirit is not concentrated, the thinking is slow).
  • the students got the test score 1: B and the state of mind 1: state 3; and in the evaluation process, they got the test score 2: D and mental state score 2: state 3.
  • the student's overall evaluation is: grade 1: B; grade 2: D; mental state score: state 3. That is to say, in the case of "concentrated in spirit and active in thinking", the student's score is 1:B, grade 2:D.
  • the evaluation is based on the results and psychological state.
  • a prediction unit 70 that, based on the student status given by the psychoanalysis unit 30 and the overall rating given by the evaluation unit 60, gives the student the level that can be achieved in the best and worst case of the mental state.
  • the comprehensive evaluation of the above candidate is: in the case of "general concentration, general thinking", the student's score is 1:B, grade 2:D.
  • the prediction unit 70 is based on the same mental state.
  • the statistics of the test scores under the test can predict that the candidate has a best score of 1 in the psychological state 1 and a best score of 2 B; in the case of mental state 5, the worst score 1 is C, the most The difference score 2 is E. Therefore, the student's score interval of score 1 is A-C under different psychological states; the score interval of grade 2 is B-E. It is thus possible to obtain a more accurate test test of the student in different states. Performance.
  • the advantage of using the above unit is that it minimizes the bias of the students' evaluation due to psychological reasons. On the one hand, it helps the teacher or the society to give an objective evaluation to the students, on the other hand, it helps the students to understand their own situation better. Avoid the psychological impact of the exam on students.
  • an online teaching evaluation method based on a data exchange network is provided.
  • FIG. 2 is a schematic diagram of an online teaching evaluation method based on a data exchange network according to the present invention.
  • the online teaching evaluation method based on the data exchange network of the invention comprises the following steps:
  • the teaching course unit generates a realistic work scene by applying the environment unit according to the requirements of the student registration course, and provides a teaching course to the student in the scene;
  • S50 Adjust the teaching curriculum according to the teaching requirements and the psychological state of the students, so that the teaching curriculum matches the psychological state of the students, and conduct a classroom test, and record the psychological state achievements in the process;
  • S100 giving the student an overall evaluation of the course according to the student's test scores and mental state scores in the S50 step, the test test scores in the S90 step, and the mental state scores, and The level that students can achieve in the worst state of mind and the state of mind.
  • the monitoring of the physiological signs comprises: monitoring the facial features of the students through the facial feature monitoring unit, and then performing facial feature-based evaluation on the mental state of the students; monitoring the volume of the students in the voice through the voice monitoring unit , speech rate, pause characteristics, and then make a speech-based evaluation of the student's psychological state; through the skin monitoring unit, monitor the student's pulse and skin moistness, and then make a skin-based evaluation of the student's psychological state; and, through The action monitoring unit monitors the physical movements of the students and then makes an evaluation based on the action characteristics of the students' mental state.
  • the motion monitoring includes: monitoring, by the eye monitoring unit, an action of the eye of the student, and then performing an evaluation based on the eye feature on the mental state of the student; and, by using a gesture monitoring unit, The speed and acceleration of the student's limb end are monitored, and the mental state of the student is evaluated based on the gesture characteristics.
  • the above various monitoring methods are designed to provide more comprehensive student status data from multiple perspectives to assist in making accurate judgments on the true state.
  • the mental state comprehensive analysis comprises: determining, by using the first determining unit, consistency of the mental state evaluation performed by the facial feature detecting unit and the voice monitoring unit; and using the second determining unit, in the facial feature
  • the monitoring unit and the voice monitoring unit give inconsistencies in the psychological state evaluation
  • the psychological state evaluation made by the skin monitoring unit and/or the motion monitoring unit is further used to further judge the psychological state of the student; when the above determining unit cannot accurately determine the mental state, the manual is entered.
  • the determination mode generates the mental state given by the first and second determination units, and on this basis, the mental state is manually given by the teacher and entered into the system.
  • the state of mind is usually reflected in certain postures or manifestations of the body, but in some cases, the same physical characteristics correspond to different mental states, for example, the eyelids are emotions.
  • the application environment unit is utilized to generate a real work scenario, including:
  • the environmental unit has the following advantages: First, it can solve the boring and practical problems of the existing teaching; secondly, it can solve the problem of the lack of communication between the existing online teaching students and between the students and the teachers. With the above device, the students can be virtualized. Teachers or other students in the same group can be seen in the scene, and the teamwork project can be completed. Finally, in the teaching process, the teacher can observe the students' behaviors from the perspective of the students, so as to understand some misunderstandings in the student learning process.
  • the above system and method can be used in online learning, so that the acquisition of the physiological state in the prior art mentioned in the background art section is relatively rough, and can not provide targeted guidance for the student's learning, and the application in the real working environment. In contrast, there are still technical problems with large differences.
  • the configurations and/or methods herein are exemplary in nature and that such specific embodiments or examples should not be considered as limiting, as many variations are possible.
  • the specific routines or methods described herein may represent one or more of any number of processing strategies. Thus, the various acts illustrated may be performed in the order illustrated, performed in another order, performed in parallel, or in some cases omitted. Again, the order of the above processes can be changed.
  • the whole process of monitoring and adjusting the learning process is realized, and the students are learned and tested in the real application environment, thereby achieving the teaching purpose and learning and applying.

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Human Resources & Organizations (AREA)
  • Educational Administration (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • Theoretical Computer Science (AREA)
  • Economics (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Educational Technology (AREA)
  • Development Economics (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Game Theory and Decision Science (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

The present invention provides a data exchange network-based online teaching evaluation system and method. The system comprises a course unit, a physiological monitoring unit, a psychological analyzing unit, an application environment unit, an adjusting unit, an evaluation unit, and a prediction unit. Also disclosed is a method using the system. By means of the system and the method, physiological state data of a student can be obtained, so that the accuracy of evaluating the physiological state of the student is improved, targeted adjustment based on the physiological state can be performed on the teaching and evaluation of the student, and moreover, the student is enabled to study at a working state more closer to the real.

Description

一种基于数据交换网络的在线教学考评系统及方法Online teaching evaluation system and method based on data exchange network 技术领域Technical field
本发明涉及网络教育技术领域,特别涉及一种基于数据交换网络的在线教学考评系统和方法。The invention relates to the technical field of network education, in particular to an online teaching evaluation system and method based on a data exchange network.
背景技术Background technique
目前,基于网络的在线学习是一种应用较为广泛的远程教学形式,在丰富的数字化资源以及各类学习支持系统的支持和辅助下,在线学习者能够灵活调整和控制自己的学习活动和学习过程,充分发挥学习者的自主性。我国在线教育市场规模已达到年均2000亿元,学习者达到1亿人,覆盖了高等教育、中小学教育、职业培训及学前教育等领域。At present, web-based online learning is a widely used form of distance learning. With rich digital resources and support and support from various learning support systems, online learners can flexibly adjust and control their learning activities and learning processes. Give full play to the autonomy of learners. The scale of China's online education market has reached 200 billion yuan per year, and the number of learners has reached 100 million, covering areas such as higher education, primary and secondary education, vocational training and preschool education.
由于在线教育的重要特征,教与学在空间上的分离,在线教育中受教学生缺乏与教师和学习伙伴面对面的交流,在线学习过程中极易产生孤独感;此外,在线教育中相当比例为成人学生,他们肩负工作、学习和生活的多重压力,如果他们遇到的学习困难不能够进行有效且及时的解决,那么他们将极易产生焦虑感,这些消极情绪如果不能够及时加以控制的话,很容易导致在线学习者对在线学习失去兴趣,最终可能导致其终止学习。Due to the important characteristics of online education, the spatial separation of teaching and learning, the lack of communication between teachers and online learning in online education is likely to cause loneliness in the online learning process. In addition, a considerable proportion of online education is Adult students, who have multiple pressures to work, study and live. If the learning difficulties they encounter cannot be solved effectively and promptly, they will be very prone to anxiety. If these negative emotions cannot be controlled in time, It is easy for online learners to lose interest in online learning, which may eventually lead to their termination of learning.
然而,我国在线教育机构更为重视提供学术性技术服务,而非学术性支持服务,尤其是情感类的支持服务尚处在薄弱环节,我国在线教育机构的一些教师仍保持传统的教学观念,他们更加关注教学过程,认为其职责是更多传授知识、辅导学习,而忽略了其在在线教学课堂中还扮演心理教育者的角色,情绪对学习状态产生较大影响,如何利用情绪改善学习效果以及评估学习效果是目前亟待解决的问题。However, China's online education institutions pay more attention to the provision of academic technical services, rather than academic support services. In particular, emotional support services are still in a weak link. Some teachers in online education institutions in China still maintain traditional teaching concepts. Paying more attention to the teaching process, and arguing that his duty is to impart more knowledge and tutoring learning, while ignoring his role as a psycho-educator in the online teaching classroom. Emotions have a greater impact on the learning state, how to use emotions to improve learning effects and Assessing the learning effect is an urgent problem to be solved.
目前,已有注意到学生情绪与学习效果关联的现有技术。At present, there have been prior art techniques that have been associated with student emotions and learning outcomes.
例如,公开号为CN102542849B的“形成性评测系统”,提供一种记录学生答题行为、面部表情以及脑电与心电变异性等生理信号的数据,全面分析学生在答题过程中的心理和生理状态,提高测评的准确性。For example, the “Formability Evaluation System” with the publication number CN102542849B provides a data recording physiological behaviors such as student's answering behavior, facial expression, and EEG and ECG variability, and comprehensively analyzes the psychological and physiological state of students during the answering process. Improve the accuracy of the assessment.
又如,公开号为CN104299178A的“一种基于面部识别的网络教学方法及系 统”,在网络教学中实时监测学员是否为本人在学习,提供的表情管理帮助教师了解学员是否认真的在学,提供的日志管理监测学生是否应该将学习的内容全部完成,避免学习过程中缺勤或者替代等现象。Another example is the disclosure of CN104299178A "a facial recognition-based network teaching method and system In the network teaching, real-time monitoring of whether the students are learning, the expression management provided to help the teacher to understand whether the students are seriously studying, the log management provided to monitor whether the students should complete the learning content, to avoid absenteeism during the learning process or Alternative phenomena.
再如,期刊文献,《浙江医学教育》2008年9月刊载了文章《考生心理状态与成绩的相关性》一文,文章指出,考生临考时的心理状态与水平发挥有非常显著的相关性,在不同心理状态下考生成绩也存在明显差异,在以往应试教育为主开始向素质教育模式转换的情况下,更应重视学生心理、生理素质的培养和训练。For another example, in the journal literature, "Zhejiang Medical Education" published the article "Correlation between Candidates' Psychological Status and Achievements" in September 2008. The article pointed out that there is a very significant correlation between the psychological state and the level of the candidates' examination. Under different psychological conditions, there are also obvious differences in the scores of candidates. In the case of the previous test-oriented education and the transition to quality education mode, students should pay more attention to the cultivation and training of students' psychological and physical qualities.
但上述学习系统存在下述问题,生理状态的获得较为粗略,确定学生真实学习状态的准确率较低;侧重于对考试状态的评价,仅能反应学生的客观状态情况,而不能对学生的学习进行针对性的指导,提高学习效率;采用传统的考试方式,其与真实工作环境下的应用相比,仍存在较大的差异。However, the above learning system has the following problems: the physiological state is relatively rough, and the accuracy of determining the student's true learning state is low; focusing on the evaluation of the test state can only reflect the objective state of the student, but not the student's learning. Conduct targeted guidance to improve learning efficiency; using traditional test methods, compared with the application in the real working environment, there are still big differences.
发明内容Summary of the invention
有鉴于此,本发明旨在提供一种基于数据交换网络的在线教学考评系统和方法。In view of this, the present invention aims to provide an online teaching evaluation system and method based on a data exchange network.
根据本发明的一个目的,提供一种基于数据交换网络的在线教学考评系统,包括:According to an aspect of the present invention, an online teaching evaluation system based on a data exchange network is provided, including:
课程单元,包括教学课程单元以及考评课程单元,用于向学生提供教学和考评所学习课程;The course unit, including the teaching unit and the evaluation unit, is used to provide the students with the teaching and evaluation courses;
评价单元,对学生课程学习情况和考评情况给出总体评价。The evaluation unit gives an overall evaluation of the student's course learning and evaluation.
上述考评系统,还包括:The above evaluation system also includes:
生理监控单元,监控学生生理体征;Physiological monitoring unit to monitor physical signs of students;
心理分析单元,对学生生理体征所反映出的心理状态进行综合分析,其分析结果为心理状态成绩,用于评价单元对学生对课程学习情况和考评情况给出总体评价;The psychological analysis unit comprehensively analyzes the psychological state reflected by the physiological signs of the students, and the analysis result is the psychological state achievement, which is used for the evaluation unit to give an overall evaluation of the students' learning situation and evaluation situation;
应用环境单元,根据课程单元的教学要求,将学生置于接近现实的工作场景中,在所述工作场景中指导学生完成课程或完成考评; The application environment unit, according to the teaching requirements of the course unit, places the student in a work scene close to reality, and guides the student to complete the course or complete the evaluation in the work scene;
调整单元,包括教学调整单元和考评调整单元,根据教学要求和学生心理状态调整教学和考评内容;The adjustment unit, including the teaching adjustment unit and the evaluation unit, adjusts the teaching and evaluation content according to the teaching requirements and the psychological state of the student;
预测单元,根据心理分析单元给出的学生状态与评价单元给出的总体评价,给出所述学生在心理状态最好与最差情况下所能达到水平。The prediction unit, according to the student state given by the psychoanalysis unit and the overall evaluation given by the evaluation unit, gives the student the level that can be achieved under the best and worst conditions of the psychological state.
进一步的,课程单元能够记录学生在教学课程过程中随堂测试成绩和考评过程中的考试成绩。Further, the course unit can record the test scores of the students during the course of the course and the test scores during the evaluation process.
进一步的,所述生理监控单元,包括:Further, the physiological monitoring unit includes:
面部特征监测单元,用于监控学生面部特征,进而对学生的心理状态作出基于面部特征的评价;a facial feature monitoring unit for monitoring facial features of the student, and then performing facial feature-based evaluation on the psychological state of the student;
语音监控单元,用于监控学生语音中音量、语速、停顿特征,进而对学生的心理状态作出基于语音特征的评价;The voice monitoring unit is configured to monitor the volume, speech rate, and pause characteristics of the student voice, and then perform a voice feature-based evaluation on the psychological state of the student;
皮肤监测单元,用于监控学生的脉搏与皮肤湿润程度,进而对学生的心理状态作出基于皮肤特征的评价;a skin monitoring unit for monitoring a student's pulse and skin moistness, thereby making a skin feature-based evaluation of the student's psychological state;
以及,as well as,
动作监控单元,用于监控学生身体动作,进而对学生的心理状态作出基于动作特征的评价。The action monitoring unit is configured to monitor the physical movements of the students, and then make an evaluation based on the action characteristics of the mental state of the students.
进一步的,所述的动作监控单元,包括:Further, the action monitoring unit includes:
眼部监控单元,用于监控学生眼部的动作,进而对学生的心理状态作出基于眼部特征的评价;The eye monitoring unit is configured to monitor the movement of the student's eye, and then make an evaluation based on the eye feature on the psychological state of the student;
以及,as well as,
手势监控单元,用于监控学生肢体末端挥动的速度和加速度,进而对学生的心理状态作出基于手势特征的评价。The gesture monitoring unit is configured to monitor the speed and acceleration of the student's limb end swing, and then make a gesture-based evaluation of the student's mental state.
进一步的,所述心理分析单元,包括:Further, the psychoanalyst unit includes:
第一判定单元,用于判定面部特征检测单元、语音监测单元所作出心理状态评价的一致性;a first determining unit, configured to determine consistency of a mental state evaluation performed by the facial feature detecting unit and the voice monitoring unit;
第二判定单元,在面部特征监测单元与语音监测单元给出心理状态评价不一致时,用皮肤监测单元和/或动作监控单元所作出的心理状态评价进一步判断 学生的心理状态;The second determining unit further judges the psychological state evaluation made by the skin monitoring unit and/or the motion monitoring unit when the facial feature monitoring unit and the voice monitoring unit do not agree on the psychological state evaluation. The psychological state of the student;
人工判定单元,在上述判定单元无法准确确定心理状态时,系统进入人工判定模式,生成第一、第二判定单元给出的心理状态,在此基础上,由教师人工给出心理状态,并录入系统。The manual determining unit, when the determining unit cannot accurately determine the mental state, the system enters the manual determination mode to generate the psychological state given by the first and second determining units, and on this basis, the mental state is manually given by the teacher and entered. system.
进一步的,所述评价单元,对学生课程学习情况和考评情况给出总体评价。总体评价包括测试成绩与心理状态成绩,具体而言,测试成绩由学生在教学课程单元学习时的随堂测试成绩与考评课程单元考试时的考试成绩组成;心理状态成绩由心理分析单元对教学和考试过程中对生理监控单元反馈的信息进行分析得出。Further, the evaluation unit gives an overall evaluation of the student's course learning situation and the evaluation situation. The overall evaluation includes test scores and mental state scores. Specifically, the test scores are composed of the test scores of the students in the course of the course and the test scores of the test unit modules; the mental state scores are analyzed by the psychoanalytic unit. The information feedback from the physiological monitoring unit is analyzed during the examination.
进一步的,所述应用环境单元,包括:Further, the application environment unit includes:
1)虚拟现实单元,模拟产生教学环境所需三维空间的场景,提供学生在所述环境下关于视觉、听觉、触觉的模拟;或,1) a virtual reality unit that simulates a scene that produces a three-dimensional space required by the teaching environment, and provides a simulation of the visual, auditory, and tactile senses of the student in the environment; or
2)增强现实单元,将教学环境所需虚拟信息应用到真实教学场景,使得真实的教学场景和虚拟的物体或信息实时地叠加到同一个画面或空间同时存在;或,2) Augmented reality unit, applying the virtual information required by the teaching environment to the real teaching scene, so that the real teaching scene and the virtual object or information are superimposed in the same picture or space in real time; or
3)虚拟现实单元与增强现实单元的组合。3) A combination of a virtual reality unit and an augmented reality unit.
根据本发明的另一个目的,提供一种基于数据交换网络的在线教学考评方法,包括如下步骤:According to another object of the present invention, an online teaching evaluation method based on a data exchange network is provided, comprising the following steps:
S10:学生登录及注册课程;S10: Student login and registration course;
S20:教学课程单元根据学生注册课程的需求,通过应用环境单元,生成现实的工作场景,在所述场景中向学生提供教学课程;S20: The teaching course unit generates a realistic work scene by applying the environment unit according to the requirements of the student registration course, and provides a teaching course to the student in the scene;
S30:在教学过程中,对学生生理体征进行监控;S30: monitoring the physiological signs of the students during the teaching process;
S40:对学生生理体征所反映出的心理状态进行综合分析;S40: Comprehensive analysis of the psychological state reflected by the student's physiological signs;
S50:根据教学要求和学生心理状态调整教学课程,使教学课程与学生心理状态相匹配,并进行随堂测试,同时记录此过程中的心理状态成绩;S50: Adjust the teaching curriculum according to the teaching requirements and the psychological state of the students, so that the teaching curriculum matches the psychological state of the students, and conduct a classroom test, and record the psychological state achievements in the process;
S60:在教学课程完成后,进入考评课程环节,根据学生注册课程的要求,通过应用环境单元,生成现实的工作场景,在场景中对学生进行考评;S60: After the completion of the teaching course, enter the evaluation course, according to the requirements of the student registration course, through the application of the environmental unit, generate a realistic work scene, and evaluate the students in the scene;
S70:在考评过程中,对学生生理体征进行监控; S70: During the evaluation process, the physical signs of the students are monitored;
S80:对学生生理体征所反映出的心理状态进行综合分析;S80: Comprehensive analysis of the psychological state reflected by the student's physiological signs;
S90:根据教学要求和学生心理状态调整考评内容,使考评内容与学生心理状态相匹配,并进行考试测试,同时记录此过程中的心理状态成绩;S90: According to the teaching requirements and the psychological state of the students, the content of the assessment is adjusted, the content of the assessment is matched with the psychological state of the student, and the examination test is performed, and the psychological state achievement in the process is recorded;
S100:根据学生在S50步骤中的随堂测试成绩和心理状态成绩、S90步骤中的考试测试成绩和心理状态成绩,对学生给出关于所述课程的总体评价,并给出学生在心理状态最好与心理状态最差情况下所能达到的水平。S100: According to the student's test scores and mental state scores in the S50 step, the test test scores and the mental state scores in the S90 step, the students are given an overall evaluation about the course, and the students are given the most psychological state. Good and psychological level can be achieved in the worst case.
进一步的,所述生理体征监控,包括:Further, the monitoring of the physiological signs includes:
通过面部特征监测单元,监控学生面部特征,进而对学生的心理状态作出基于面部特征的评价;The facial feature monitoring unit is used to monitor the facial features of the student, and then the facial features are evaluated based on the psychological state of the student;
通过语音监控单元,监控学生语音中音量、语速、停顿特征,进而对学生的心理状态作出基于语音特征的评价;Through the voice monitoring unit, the volume, speech rate, and pause characteristics of the student's voice are monitored, and then the voice state-based evaluation is performed on the student's psychological state;
通过皮肤监测单元,监控学生的脉搏与皮肤湿润程度,进而对学生的心理状态作出基于皮肤特征的评价;Through the skin monitoring unit, the pulse and skin moistness of the student are monitored, and then the skin condition is evaluated based on the psychological state of the student;
以及,as well as,
通过动作监控单元,监控学生身体动作,进而对学生的心理状态作出基于动作特征的评价。Through the action monitoring unit, the student's body movements are monitored, and then the behavioral characteristics of the students are evaluated based on the action characteristics.
进一步的,所述的动作监控,包括:Further, the action monitoring includes:
通过眼部监控单元,监控学生眼部的动作,进而对学生的心理状态作出基于眼部特征的评价;Through the eye monitoring unit, the movement of the student's eye is monitored, and then the psychological state of the student is evaluated based on the characteristics of the eye;
以及,as well as,
通过手势监控单元,监控学生肢体末端挥动的速度和加速度,进而对学生的心理状态作出基于手势特征的评价。Through the gesture monitoring unit, the speed and acceleration of the student's limb end swing are monitored, and then the mental state of the student is evaluated based on the gesture feature.
进一步的,所述心理状态综合分析,包括:Further, the comprehensive analysis of the mental state includes:
利用第一判定单元,判定面部特征检测单元、语音监测单元所作出心理状态评价的一致性;Using the first determining unit, determining the consistency of the psychological state evaluation made by the facial feature detecting unit and the voice monitoring unit;
利用第二判定单元,在面部特征监测单元与语音监测单元给出心理状态评价不一致时,用皮肤监测单元和/或动作监控单元所作出的心理状态评价进一步 判断学生的心理状态;Using the second determining unit, when the facial feature monitoring unit and the voice monitoring unit give inconsistencies in the psychological state evaluation, the psychological state evaluation by the skin monitoring unit and/or the motion monitoring unit is further Judging the psychological state of the student;
在上述判定单元无法准确确定心理状态时,进入人工判定模式,生成第一、第二判定单元给出的心理状态,在此基础上,由教师人工给出心理状态,并录入系统。When the determination unit cannot accurately determine the mental state, the manual determination mode is entered, and the psychological state given by the first and second determination units is generated. On this basis, the mental state is manually given by the teacher and entered into the system.
进一步的,利用应用环境单元生成现实工作场景,包括:Further, the application environment unit is used to generate a real work scenario, including:
1)通过虚拟现实单元,模拟产生教学环境所需三维空间的场景,提供学生在所述环境下关于视觉、听觉、触觉的模拟;或,1) simulating a scene in a three-dimensional space required for the teaching environment through a virtual reality unit, providing a simulation of the visual, auditory, and tactile senses of the student in the environment; or
2)通过增强现实单元,将教学环境所需虚拟信息应用到真实教学场景,使得真实的教学场景和虚拟的物体或信息实时地叠加到同一个画面或空间同时存在;或,2) Applying the virtual information required by the teaching environment to the real teaching scene through the augmented reality unit, so that the real teaching scene and the virtual object or information are superimposed in the same picture or space in real time; or
3)通过虚拟现实与增强现实组合生成工作场景。3) Generate a work scene through a combination of virtual reality and augmented reality.
通过本发明所述的系统和方法以实现对学习过程的全程监控和调整,并使得学生在真实应用环境下学习和测试,从而达到教学目的,并学而致用。Through the system and method of the present invention, the whole process of monitoring and adjusting the learning process is realized, and the students are learned and tested in the real application environment, thereby achieving the teaching purpose and learning and applying.
提供本概述是为了以简化的形式介绍将在以下详细描述中进一步描述的选择的概念。本概述并不旨在标识所要求保护主题的关键特征或必要特征,也不旨在用于限制所要求保护主体的范围,此外,所要求保护的主题不限于解决在本发明的任一部分中所提及的任何或所有缺点的实现。The Summary is provided to introduce a selection of concepts in the <Desc/Clms Page number> The Summary is not intended to identify key features or essential features of the claimed subject matter, and is not intended to limit the scope of the claimed subject matter. In addition, the claimed subject matter is not limited to being construed in any part of the invention. Implementation of any or all of the disadvantages mentioned.
附图说明DRAWINGS
图1是根据本发明的基于数据交换网络的在线教学考评系统示意图;和1 is a schematic diagram of an online teaching evaluation system based on a data exchange network according to the present invention; and
图2是根据本发明的基于数据交换网络的在线教学考评方法示意图。2 is a schematic diagram of an online teaching evaluation method based on a data exchange network according to the present invention.
具体实施方式Detailed ways
针对现有技术中存在的问题,本发明提出一种基于数据交换网络的在线教学考评系统和方法,旨在更精确的获得学生的心理状态,并将心理状态用于调节授课课程和考试测评,同时在更加真实的环境中教学,使得学生知识体系更加完备而实用。In view of the problems existing in the prior art, the present invention provides an online teaching evaluation system and method based on a data exchange network, which aims to obtain a more accurate state of the student's mental state, and uses the mental state to adjust the teaching course and the examination evaluation. At the same time, teaching in a more realistic environment makes the student's knowledge system more complete and practical.
为使本发明的技术方案更加清楚、明白,以下参照附图并举实施例,对本发明所述方案做进一步地详细说明。 In order to make the technical solutions of the present invention clearer and clearer, the embodiments of the present invention will be further described in detail below with reference to the accompanying drawings.
图1是根据本发明的基于数据交换网络的在线教学考评系统示意图。1 is a schematic diagram of an online teaching evaluation system based on a data exchange network according to the present invention.
本装置适用于数据交换网络下的在线教学和考评,首先,根据教学大纲制定教学计划,并提供给课程单元10,课程单元10包括教学课程单元101以及考评课程单元102,用于向学生提供教学和考评所学习课程;The device is suitable for online teaching and evaluation under the data exchange network. Firstly, the teaching plan is formulated according to the syllabus and provided to the course unit 10, and the course unit 10 includes a teaching course unit 101 and an evaluation course unit 102 for providing teaching to the students. And the assessment course;
生理监控单元20,用于监控学生生理体征,而所述监控所得的体征反映学生的学习状态,通过心理分析单元30,对学习状态进行判定,从而获得学生的实时状态。The physiological monitoring unit 20 is configured to monitor physiological signs of the student, and the physical signs obtained by the monitoring reflect the learning state of the student, and the learning state is determined by the psychoanalyst unit 30, thereby obtaining the real-time state of the student.
人在学习的时候,当其身体机能处于不同条件、学习不同内容时,身体的姿势和心理状态会随之改变而引起学习者表现出不同的状态,因此,可以通过分析学习者的身体参数和姿势等,确定其处于何种状态。When people are learning, when their physical functions are in different conditions and learning different contents, the posture and mental state of the body will change accordingly, causing the learners to show different states. Therefore, it is possible to analyze the learner's physical parameters and Position, etc., to determine what state it is in.
在一个具体实施例中,采用面部监控单元201对学生的面部特征进行监控,面部特征反映了人的表情和心情,而人的心情与学习状态是直接相关的。人的表情可以分为喜悦、悲伤、愤怒、惊奇、恐惧和厌恶,不同的表情,人的眼睛、嘴唇、眉毛等特征都会发生改变,对上述特征进行图像监测可以获得学习者的实时状态,这些状态包括注意力和疲劳程度。面部监控单元201由图像获取单元2011,图像处理单元2012,图像状态分析单元2013组成;图像获取单元2011可以通过数字摄像头对面部图像进行采集;图像处理单元2012通过对图像的亮度、色彩空间、颜色、灰度等信息特征进行提取,从而提取出学习状态识别所需的生理特征。例如,眼睛比面部其他区域都要暗,灰度值相对较低,同时比其他区域灰度变化率又比较快,通过灰度特征的提取和计算,可确定眼睛的位置和眼球的方向;又如,嘴唇的颜色为红色,这是人类的共同特征,而且与肤色的颜色具有明显差异,因此可以直接利用RGB图像中分离出红色像素实现对嘴唇的定位和识别。在获得了面部特征之后,可以根据上述特征与学习状态之间的关联而确定出学习者的学习状态,例如,在获得眼睛特征后,可根据眼睛的开闭确定学习者是否睡着;可根据眨眼的频次确定学习者是否出现注意力不集中、疲劳的情况,具体而言,一个人平均每分钟眨眼10-15次,当学习者处于疲劳状态的情况下,其眨眼的频率会明显下降,当眨眼频次小于每分钟10次时,通常已经进入疲劳状态,当其严重疲劳时,眼睛会一直处于闭眼状态,相应的,注意力随之下降;又如,获得嘴唇特征后,可进一步判断学习者的状态,常见的嘴唇特征有打哈欠,咬嘴唇,舔嘴唇,撇嘴,噘嘴,嘴角上扬等,打哈 欠表明学习者可能进入了疲劳状态,咬嘴唇和舔嘴唇通常表明学习者面临较大压力,撇嘴表明学习者不屑或愤怒,噘嘴表明学习者心存不满或不同意见,而嘴角上扬表明了喜悦的状态;再如,获得眉毛特征后,可进一步判断学习者的状态,常见的眉毛特征有舒展,皱眉,耸眉,扬眉等,眉毛舒展表明心情坦然、处于愉快的状态中,皱眉表明陷入困境或厌烦,耸眉表明对谈论的内容的重视,扬眉表明欣喜。In a specific embodiment, the face monitoring unit 201 is used to monitor the facial features of the student. The facial features reflect the expression and mood of the person, and the mood of the person is directly related to the learning state. People's expressions can be divided into joy, sadness, anger, surprise, fear and disgust. Different expressions, such as human eyes, lips, and eyebrows, will change. The image monitoring of the above features can obtain the real-time status of learners. Status includes attention and fatigue. The face monitoring unit 201 is composed of an image acquiring unit 2011, an image processing unit 2012, and an image state analyzing unit 2013; the image acquiring unit 2011 can collect the face image by a digital camera; the image processing unit 2012 passes the brightness, color space, and color of the image. The information features such as gray scale are extracted to extract the physiological features required for learning state recognition. For example, the eyes are darker than other areas of the face, the gray value is relatively low, and the gray level change rate is faster than other areas. By extracting and calculating the gray features, the position of the eye and the direction of the eyeball can be determined; For example, the color of the lips is red, which is a common feature of human beings, and has a significant difference from the color of the skin color. Therefore, the positioning and recognition of the lips can be directly realized by separating the red pixels in the RGB image. After the facial features are obtained, the learner's learning state may be determined according to the association between the above features and the learning state. For example, after obtaining the eye features, the learner may be determined to be asleep according to the opening and closing of the eyes; The frequency of blinking determines whether the learner has inattention and fatigue. Specifically, a person blinks 10-15 times per minute. When the learner is in a state of fatigue, the frequency of blinking will decrease significantly. When the frequency of blinking is less than 10 times per minute, it usually enters a state of fatigue. When it is severely fatigued, the eye will always be in an eye-closed state, and accordingly, the attention will decrease. For example, after obtaining the characteristics of the lips, it can be further judged. The state of the learner, common lip characteristics are yawning, biting lips, licking lips, pouting, pouting, rising mouth, etc. The owe indicates that the learner may have entered fatigue. The biting of the lips and the licking of the lips usually indicate that the learner is under greater pressure. The pouting indicates that the learner is disdainful or angry. The pouting indicates that the learner is dissatisfied or dissatisfied, and the rising of the mouth indicates the joy. For example, after obtaining the characteristics of the eyebrows, the state of the learner can be further judged. The common eyebrow features are stretched, frowning, eyebrows, eyebrows, etc. The eyebrow stretch indicates that the mood is calm and in a happy state, and the frown indicates that it is in trouble. Or bored, eyebrows indicate the importance of talking about the content of the discussion, and raising the eyebrows shows joy.
在另一个实施例中,采用语音监控单元202对学生的音量、语速、停顿进行监控,语音特征从另一个角度反映了人的心情,而人的心情与学习状态是直接相关的。语音监控单元202包括语音采集单元2021,语音处理单元2022,语音状态分析单元2023组成。语音采集单元2021获取语音,经由语音处理单元2022提取出音量、语速、停顿、基音频率等参数,再通过语音状态分析单元2023分析后获得学生的心理状态。例如,音量通常为短时能量的外在表现,当人情绪比较激动时,音量较高,此时能量曲线波动较大,而当人情绪低落时,音量能量小,能量曲线较为平稳。根据能量的研究可知,情感与语音的振幅有一定相关性,具体而言,愤怒和高兴具有较高的能量,表现形式即为包络线上语音信号的振幅较大,而中性语音的能量相对较低,振幅幅值不是很明显;又如,语速和停顿体现了说话者思维的连续性,语速的变化经常是情绪变化的体现,学生的语音从平常速度逐渐变为慢速,可能是表示对谈论的观点或谈话方式有所不满,以至于提不起兴趣,而当语速由平常速度逐渐变为快速,可能是对谈话的内容有兴趣,或对谈话内容内心存在恐慌或不安,借着快速讲话而掩饰上述情绪;再如基音频率是情感的又一表征,不同情感之间基因频率特征曲线不同,所以可以根据基因频率最大值、最小值等分析基因频率在不同情感之间的表现。In another embodiment, the voice monitoring unit 202 is used to monitor the student's volume, speech rate, and pause. The voice feature reflects the person's mood from another angle, and the person's mood is directly related to the learning state. The voice monitoring unit 202 includes a voice collecting unit 2021, a voice processing unit 2022, and a voice state analyzing unit 2023. The voice collecting unit 2021 acquires the voice, and extracts parameters such as volume, speech rate, pause, and pitch frequency through the voice processing unit 2022, and then obtains the mental state of the student by analyzing the voice state analyzing unit 2023. For example, the volume is usually the external performance of short-term energy. When the emotion is more exciting, the volume is higher, and the energy curve fluctuates greatly. When the person's mood is low, the volume energy is small and the energy curve is relatively stable. According to the study of energy, there is a certain correlation between emotion and the amplitude of speech. Specifically, anger and happiness have higher energy. The expression is the amplitude of the speech signal on the envelope, and the energy of the neutral speech. Relatively low, the amplitude amplitude is not very obvious; for example, the speed of speech and pauses reflect the continuity of the speaker's thinking. The change of speech rate is often the embodiment of emotional changes, and the student's voice gradually changes from normal speed to slow. It may be that they are dissatisfied with the way they talk or talk, so that they can't afford to be interested, and the speed of speech changes from normal to fast, may be interested in the content of the conversation, or there is panic in the content of the conversation or Uneasy, cover up the above emotions by quick speech; if the basic audio frequency is another representation of emotion, the gene frequency characteristic curves are different between different emotions, so the gene frequency can be analyzed according to the maximum and minimum values of the gene frequency in different emotions. Performance between.
在另一个实施例中,采用皮肤监测单元203对学生的脉搏与皮肤湿润程度进行监控,脉搏与皮肤湿润程度从另一个角度反映了人的情绪。皮肤监测单元203包括皮肤湿度传感器2031、脉搏传感器2032、皮肤状态分析单元2033组成。通过皮肤湿度传感器2031获得皮肤的湿润程度数据,通过脉搏传感器2032获得人体脉搏数据,再将上述数据通过皮肤状态分析单元2033进行分析后获得学生的心理状态。例如,当人心情紧张时,手心湿度显著增加,同时脉搏增快;而当人心态平和时,脉搏平稳,手心湿度较低。通过上述体征的变化,可以体 现学生情绪变化。In another embodiment, the skin monitoring unit 203 is used to monitor the pulse and skin moistness of the student, and the pulse and skin moistness reflect the person's mood from another angle. The skin monitoring unit 203 includes a skin moisture sensor 2031, a pulse sensor 2032, and a skin state analyzing unit 2033. The skin moisture level data is obtained by the skin moisture sensor 2031, the body pulse data is obtained by the pulse sensor 2032, and the above data is analyzed by the skin state analyzing unit 2033 to obtain the psychological state of the student. For example, when a person is in a nervous mood, the palm of the hand increases significantly, and the pulse increases. When the person's state of mind is calm, the pulse is stable and the palm of the hand is low. Through the changes in the above signs, it is possible to The student’s mood changes now.
在另一个实施例中,采用手势监控单元204,对学生的手势进行监控,从另外一个角度反映学生的情绪。手势监控单元204包括手势传感器2041,其记录双手和/或手指的位置,摆动速度、加速度等信息,还包括手势状态分析单元2042。通过手势传感器2041获得的双手数据信息,再将上述数据通过手势状态分析单元2042进行分析后获得学生的心理状态。例如,手不停摆弄身边的某些东西,此时,通常为心理紧张或漫不经心的状态;又如,频繁用手抚摸额头,表示十分疲惫,或者心情焦虑;再如,搓手通常表达内心的期待情绪,急速的搓动手掌,表达内心的跃跃欲试的急切心情,而慢慢地搓手掌,则说明事情遇到有决定性作用的选择时的犹豫不定,或要做的事情阻力太大;另如,通常的背手表示镇定自若,但若双手背后,一只手抓住另一只手的手腕或胳膊,则是由于心里紧张而不自觉采用的姿势,以便控制自己的紧张情绪。In another embodiment, the gesture monitoring unit 204 is employed to monitor the student's gestures and reflect the student's emotions from another perspective. The gesture monitoring unit 204 includes a gesture sensor 2041 that records the position of the hands and/or fingers, the swing speed, the acceleration, and the like, and also includes a gesture state analysis unit 2042. The data of the two-handed data obtained by the gesture sensor 2041 is analyzed by the gesture state analyzing unit 2042 to obtain the psychological state of the student. For example, the hand keeps playing with some things around you. At this time, it is usually a state of psychological stress or carelessness; for example, frequently touching the forehead with hands, it means very tired, or feeling anxious; for example, the pickpocket usually expresses the inner heart. Expecting emotions, quickly swaying the palms, expressing the eagerness of the inner eagerness to try, and slowly licking the palm of your hand, it means that when things encounter a decisive choice, the hesitation is uncertain, or the things to do are too much resistance; The usual back hand indicates calmness, but if one hand holds the wrist or arm of the other hand behind the back of the hand, it is a posture that is unconsciously used because of nervousness in order to control one's nervousness.
在另一个实施例中,还包括眼部监控单元205,用于监控学生眼部动作,进而对学生的心理状态做出基于眼部特征的评价。眼部监控单元205包括眼部传感器2051,其记录眼部动作,还包括眼部状态分析单元2052。通过眼部传感器2051获得眼部相关数据,再将上述数据通过眼部状态分析单元2052进行分析后得出学生的心理状态。例如,对眼球的视觉方向进行监控,眼睛像左看并且转动较慢时,经常表示回忆,眼球频繁左顾右盼有时表现为正在思考;又如,对瞳孔直径大小、直径变化程度的监测,在所有情绪状态中,情绪愉快的被观察者瞳孔直径最大并且变化程度最强;其次为急躁以及平静状态,情绪焦虑的被观察者瞳孔直径最小并且变化程度最弱,瞳孔的变化体现出情绪的状态以及变化;再如,情绪紧张或过度疲劳可能会表现为眼睑痉挛。In another embodiment, an eye monitoring unit 205 is further included for monitoring the eye movements of the student, thereby making an evaluation based on the eye features of the mental state of the student. The eye monitoring unit 205 includes an eye sensor 2051 that records an eye motion, and further includes an eye state analyzing unit 2052. The eye related data is obtained by the eye sensor 2051, and the above data is analyzed by the eye state analyzing unit 2052 to obtain the psychological state of the student. For example, the visual direction of the eyeball is monitored. When the eye looks like a left and rotates slowly, it often expresses recollections. The eyeballs frequently look around and sometimes appear to be thinking; for example, the monitoring of the size of the pupil diameter and the degree of diameter change, in all emotions. In the state, the obsessive observer has the largest pupil diameter and the strongest degree of change; followed by impatience and calmness, the observer of emotional anxiety has the smallest pupil diameter and the weakest degree of change, and the change of pupil reflects the state of emotion and changes. Another example is that emotional stress or excessive fatigue may manifest as eyelids.
还包括心理分析单元30,对学生生理体征所反映出的心理状态进行综合分析,根据上述关于心理状态的外在表征可知,心理状态通常会以身体的某些姿势或表现而反映出来,但在一些情况下,同一个身体特征会对应不同的心理状态,例如,眼睑痉挛是情绪紧张或过度疲劳的外在体现,因此,需要心理分析单元30,将上述各监控、监测单元所给出的单一评价进行综合而得出较为精确的心理状态。The psychological analysis unit 30 is further configured to comprehensively analyze the psychological state reflected by the physiological signs of the student. According to the external representation of the psychological state, the mental state is usually reflected by certain postures or performances of the body, but In some cases, the same physical characteristics may correspond to different mental states. For example, the eyelids are an external manifestation of emotional stress or excessive fatigue. Therefore, the psychoanalyst unit 30 is required to provide a single unit given by the above monitoring and monitoring units. The evaluation is integrated to give a more accurate mental state.
在另一个实施例中,心理分析单元30包括第一判定单元301,用于判定面部监控单元201、语音监控单元202所作出心理状态评价的一致性,当面部监控 单元201与语音监控单元202各自独立的给出相同的情绪判断时,可通过第一判定单元301直接得出此时的情绪状态。而当面部监控单元201与语音监控单元202给出不同的情绪判断时,启用第二判定单元302,用皮肤监测单元203和/或由手势监控单元204和眼部监控单元205组成的动作监控单元所作出的心理状态评价进一步判断学生的心理状态;而在上述判定单元无法准确确定心理状态时,系统进入人工判定模式,生成第一、第二判定单元给出的心理状态,在此基础上,由教师人工给出心理状态,并录入人工判定单元303。采用上述心理分析单元的优点在于,在保证效率的同时,提高判断的准确性。In another embodiment, the psychoanalytic unit 30 includes a first determining unit 301 for determining the consistency of the psychological state evaluation made by the face monitoring unit 201 and the voice monitoring unit 202, when the face monitoring When the unit 201 and the voice monitoring unit 202 each independently give the same emotional judgment, the first state determining unit 301 can directly derive the emotional state at this time. When the face monitoring unit 201 and the voice monitoring unit 202 give different emotion determinations, the second determining unit 302 is activated, and the skin monitoring unit 203 and/or the motion monitoring unit composed of the gesture monitoring unit 204 and the eye monitoring unit 205 are activated. The psychological state evaluation further determines the psychological state of the student; and when the above determining unit cannot accurately determine the mental state, the system enters the manual determination mode to generate the psychological state given by the first and second determining units, on the basis of The mental state is manually given by the teacher and entered into the manual decision unit 303. The advantage of using the above psychoanalytic unit is that the accuracy of the judgment is improved while ensuring efficiency.
还包括应用环境单元40,根据课程单元10的教学要求,将学生置于接近现实的工作场景中,在所述工作场景中指导学生完成课程或完成考评。Also included is an application environment unit 40 that places the student in a work scene that is close to reality in accordance with the teaching requirements of the course unit 10, in which the student is instructed to complete the course or complete the assessment.
在另一个实施例中,应用环境单元40,包括:In another embodiment, the application environment unit 40 includes:
1)虚拟现实单元401,模拟产生教学环境所需三维空间的场景,提供学生在所述环境下关于视觉、听觉、触觉的模拟;或,2)增强现实单元402,将教学环境所需虚拟信息应用到真实教学场景,使得真实的教学场景和虚拟的物体或信息实时地叠加到同一个画面或空间同时存在;或,3)虚拟现实单元与增强现实单元的组合。1) a virtual reality unit 401, simulating a scene of a three-dimensional space required to generate a teaching environment, providing a simulation of visual, auditory, and tactile sensations of the student in the environment; or, 2) an augmented reality unit 402, which requires virtual information required by the teaching environment Apply to the real teaching scene, so that the real teaching scene and the virtual object or information are superimposed in the same picture or space in real time; or 3) the combination of the virtual reality unit and the augmented reality unit.
采用上述信息技术的应用环境单元40,包括如下优点:首先,能够解决现有教学的枯燥和脱离实际问题;其次,能够解决现有在线教学学生之间以及学生与教师之间缺乏沟通的问题,借助上述装置,学生可以在虚拟场景内看到教师或其他同组学生,并可以完成团队协作项目;最后,教师在教学过程中,可以以学生的视角观察学生的动作行为,从而了解学生学习过程中的部分误区。The application environment unit 40 adopting the above information technology includes the following advantages: firstly, it can solve the boring and practical problems of the existing teaching; secondly, it can solve the problem of lack of communication between the existing online teaching students and between the students and the teachers. With the above device, students can see teachers or other students in the same scene in the virtual scene, and can complete the team collaboration project. Finally, in the teaching process, the teacher can observe the students' behaviors from the perspective of the students, so as to understand the student learning process. Some of the misunderstandings in the middle.
所述装置尤其适合于机械设计领域的应用,例如,机械设计过程中,平面图形的绘制顺序如下,画基准线、画已知线段、画中间线段、画连接线段、检查整理;而尺寸标注的顺序如下,选定基准,标注已知线段的定位尺寸,标注已知线段的定形尺寸,标注中间线段的尺寸,标注连接线段的定形尺寸,核对,调整。教学过程中,学生时常因为绘制顺序的错误而导致最终的设计图与标准图纸具有较大差异,而绘制顺序与学生习惯有关,在应用环境单元的情境下,指导教师能够以学生的视角观察图纸,并根据眼部监控单元对眼球动作的监控而了解学生的目光在图纸上的顺序,在学生出现观察方式错误的情形下,能够及时对学生进行调整或记录下来,后期对学生进行指导。 The device is particularly suitable for applications in the field of mechanical design. For example, in the mechanical design process, the drawing sequence of the planar graphic is as follows, drawing a reference line, drawing a known line segment, drawing a middle line segment, drawing a connecting line segment, checking and finishing; and dimensioning The order is as follows, select the reference, mark the positioning size of the known line segment, mark the fixed size of the known line segment, mark the size of the middle line segment, mark the fixed size of the connecting line segment, check and adjust. During the teaching process, students often have a big difference between the final design drawing and the standard drawing because of the wrong drawing order. The drawing order is related to the student habit. In the context of the application environment unit, the instructor can observe the drawing from the perspective of the student. According to the monitoring of the eye movements by the eye monitoring unit, the order of the students' eyes on the drawings can be understood. In the case that the students have an incorrect way of observation, the students can be adjusted or recorded in time, and the students can be guided in the later stage.
所述装置尤其适用于文学作品速读练习,例如,在文学作品速读学习过程中,合格的学生应当将目光集中于具有承接作用的连接词,以及这些连接词所引导的关键词,从而能够迅速获得作品的主干和脉络。在此情形下,指导教师可以以学生的视角进行阅读,并根据眼部监控单元对眼球的动作的监控而了解学生在阅读过程中对不同词汇分配时间的差异,由此能够发现学生在速读学习过程中所存在的问题,从而能够对学生进行更为具体和有针对性的指导。The device is especially suitable for quick reading practice of literary works. For example, in the process of fast reading of literary works, qualified students should focus on the connecting words with the role of inheritance, and the keywords guided by these connecting words, thereby enabling Quickly get the backbone and context of the work. Under this circumstance, the instructor can read from the perspective of the student, and according to the monitoring of the movement of the eyeball by the eye monitoring unit, the difference in the time of the different words allocated during the reading process can be found, thereby enabling the student to find the speed reading. The problems that exist in the learning process can lead to more specific and targeted guidance for students.
还包括调整单元50,其包括教学调整单元501和考评调整单元502,根据教学要求和学生心理状态调整教学和考评内容,使得学生在不同的心理状态下学习更为适合的内容。例如,当系统监测到学生处于思维活跃,心情愉悦且注意力集中的状态下,自动提高课程难度,将平时不易掌握的内容或重点或核心内容提供给学生,供其学习;当系统监测到学生处于高度紧张或难以进行学习的情况下,自动降低课程难度,提供较为简单或轻松的内容给学生,使之缓解紧张情绪,并建立信心;当系统监测学生处于轻微疲劳的情况下,自动提供互动更多的教学课程,例如外语对话内容或文章复述等;当系统监测到学生处于疲劳的情况下,对目前学习内容进行收尾和整理工作,并中止教学,让学生进行休息和放松。又如,搭载所述单元的系统在考试过程中,根据学生的心理状态,提供不同难度的试题,尽量使得学生在最佳状态下完成测试。The adjustment unit 50 further includes an adjustment unit 501 and an assessment adjustment unit 502, and adjusts the teaching and evaluation contents according to the teaching requirements and the psychological state of the students, so that the students learn more suitable contents under different psychological states. For example, when the system monitors that students are active in thinking, happy and focused, automatically improve the difficulty of the course, and provide the content or key or core content that is difficult to grasp to the students for learning; when the system monitors the students In the case of high tension or difficulty in learning, it automatically reduces the difficulty of the course, provides simple or easy content to the students, relieves tension and builds confidence; when the system monitors students in a slight fatigue, automatically provides interaction More teaching courses, such as foreign language dialogue content or article retelling; when the system monitors the students in fatigue, the current learning content is closed and organized, and the teaching is suspended, allowing students to rest and relax. In another example, the system carrying the unit provides test questions of different difficulty according to the psychological state of the student during the examination process, and tries to enable the student to complete the test under the best condition.
在另一个实施例中,母语为汉语的学生甲期望获得英语学习中单词、听、说、读、写五项能力的综合提升,在以往的教学过程中,教师或网络课程提供者根据一定顺序提供固定的课程给学生甲,每一阶段课程完成后进入下一环节,各课程之间虽有联系,但并未考虑学生的心理状态。在应用本发明装置的示例中,学生甲首先自选学习项目,其选择了单词作为首先学习对象。经过约五分钟学习后,系统监测到学生甲的注意力始终集中在某几个单词上,并且眼部和动作监测显示,学生仅仅在进行机械的重复和记忆,此时,为使得学生从涣散的注意力中重新回到学习状态,切换到关于上述单词的听写,在此过程中,通过外部的影响使得学生对学习方式进行调整,并且加深对已学习单词的印象;进一步的,在学生已经掌握上述单词的情况下,切换到朗读模式,朗读内容为包含已学习单词的对话语句,模式的切换使得学生甲思维一直处于活跃状态,并且通过朗读,进一步强化单词的记忆和应用;接下来,进入语音表达环节,在所述模式下,提供中文文本,需要学生通过思考说出相应正确的英文表达。 在上述四个阶段经过约40分钟学习后,系统监测到学生已处于思维活跃,表达欲望强烈的状态,此时,转入文章写作模式,在此模式下,学生甲综合前面各阶段所习得的知识,并在大脑充分活跃的状态下书写短文,由此,完成所述小节的课程学习。In another embodiment, the student whose native language is Chinese is expected to obtain a comprehensive improvement of the five abilities of the words, listening, speaking, reading and writing in the English learning. In the past teaching process, the teacher or the online course provider according to a certain order A fixed course is provided to the student A. After each stage of the course is completed, the next step is entered. Although there is a connection between the courses, the psychological state of the student is not considered. In the example in which the apparatus of the present invention is applied, the student A first selects the learning item, which selects the word as the first learning object. After about five minutes of study, the system monitors that student A’s attention is always focused on a few words, and eye and motion monitoring shows that the student is only doing mechanical duplication and memory, at this time, in order to make the student Returning to the learning state, switching to the dictation about the above words, in the process, through the external influence, the students adjust the learning style and deepen the impression of the learned words; further, the students have already In the case of mastering the above words, switching to the reading mode, the reading content is a dialog sentence containing the learned words, the mode switching makes the student's thinking always active, and further enhancing the memory and application of the words by reading aloud; Entering the speech expression link, in the mode, providing Chinese text, students need to think about the correct English expression by thinking. After about 40 minutes of study in the above four stages, the system monitors that the students are in a state of active thinking and expresses a strong desire. At this time, they are transferred to the article writing mode. Under this mode, students acquire the previous stages of learning. Knowledge, and writing essays in a state where the brain is fully active, thereby completing the course study in the section.
还包括评价单元60,评价单元60根据根据心理分析单元30给出的学生的状态、学生课程学习情况和考评情况给出总体评价。Also included is an evaluation unit 60 that gives an overall rating based on the status of the student, the student's course learning, and the assessment based on the psychoanalytic unit 30.
在一个具体实施例中,评价单元60,对学生课程学习情况和考评情况给出总体评价。总体评价包括测试成绩与心理状态成绩,具体而言,测试成绩由学生在教学课程单元101学习时的随堂测试成绩与考评课程单元102考试时的考试成绩组成;心理状态成绩由心理分析单元30对教学和考试过程中对生理监控单元20反馈的信息进行分析后给出。In a specific embodiment, the evaluation unit 60 gives an overall evaluation of the student's course learning and evaluation. The overall evaluation includes test scores and mental state scores. Specifically, the test scores are composed of the test scores of the students when they are studying in the teaching unit 101 and the test scores of the examination unit 102 exams; the mental state scores are determined by the psychoanalysis unit 30. The information fed back to the physiological monitoring unit 20 during the teaching and examination process is analyzed and given.
在另一个具体实施例中,测试成绩分为ABCDE五个等级,A为最高等级;心理状态成绩分为状态1(精神集中,思维活跃)、状态2(精神较为集中,思维较为活跃)、状态3(精神集中一般,思维活跃一般)、状态4(精神较不集中,思维较迟钝)和状态5(精神不集中,思维迟钝)。学生在教学过程中的得到了随堂测试成绩1:B级和心理状态成绩1:状态3;并且在考评过程中的得到了考试成绩2:D级和心理状态成绩2:状态3。则该学生的总体评价为:成绩1:B;成绩2:D;心理状态成绩:状态3。也就是说,在“精神集中一般,思维活跃一般”的情况下,该学生的成绩为成绩1:B,成绩2:D。区别于以往的评价,该评价的做出是以成绩和心理状态为前提的。In another specific embodiment, the test score is divided into five grades of ABCDE, and A is the highest grade; the mental state score is divided into state 1 (concentration of mind, active thinking), state 2 (concentration of spirit, active thinking), state 3 (the general concentration of the spirit, the active thinking is general), the state 4 (the spirit is less concentrated, the thinking is slower) and the state 5 (the spirit is not concentrated, the thinking is slow). In the course of teaching, the students got the test score 1: B and the state of mind 1: state 3; and in the evaluation process, they got the test score 2: D and mental state score 2: state 3. The student's overall evaluation is: grade 1: B; grade 2: D; mental state score: state 3. That is to say, in the case of "concentrated in spirit and active in thinking", the student's score is 1:B, grade 2:D. Different from the previous evaluation, the evaluation is based on the results and psychological state.
还包括预测单元70,根据心理分析单元30给出的学生状态与评价单元60给出的总体评价,给出所述学生在心理状态最好与最差情况下所能达到水平。Also included is a prediction unit 70 that, based on the student status given by the psychoanalysis unit 30 and the overall rating given by the evaluation unit 60, gives the student the level that can be achieved in the best and worst case of the mental state.
在另一个具体实施例中,上述考生的综合评价为:在“精神集中一般,思维活跃一般”的情况下,该学生的成绩为成绩1:B,成绩2:D。通过对学习程度,以及注意力程度和思维活跃程度相似的考生测试,并进行统计,可知,随着精神状态的变化,成绩随之正相关变化,在此情况下,预测单元70基于同心理状态下的测试成绩的统计数据可预测出该考生在心理状态1的情况下,最佳成绩1为A,最佳成绩2位B;在心理状态5的情况下,最差成绩1为C,最差成绩2为E。由此给出该学生在不同心理状态下,成绩1的分数区间为A-C;成绩2的分数区间为B-E。由此可以获得该生在不同状态下更为准确的考试测试成 绩。In another specific embodiment, the comprehensive evaluation of the above candidate is: in the case of "general concentration, general thinking", the student's score is 1:B, grade 2:D. Through the test of the degree of learning, as well as the degree of attention and the degree of active thinking, and statistics, it can be seen that as the mental state changes, the scores are positively correlated, in which case the prediction unit 70 is based on the same mental state. The statistics of the test scores under the test can predict that the candidate has a best score of 1 in the psychological state 1 and a best score of 2 B; in the case of mental state 5, the worst score 1 is C, the most The difference score 2 is E. Therefore, the student's score interval of score 1 is A-C under different psychological states; the score interval of grade 2 is B-E. It is thus possible to obtain a more accurate test test of the student in different states. Performance.
上述示例仅示范性的说明了评价单元、心理分析单元以及预测单元的联系以及工作原理,对于不同的学科或不同的测试标准、测试方式、分数区间划分、标准定制,均为本领域技术人员在本发明的基础上可根据具体课程进行变化和设置的。The above examples only exemplarily illustrate the relationship and working principle of the evaluation unit, the psychoanalysis unit, and the prediction unit. For different disciplines or different test standards, test methods, fractional interval division, and standard customization, those skilled in the art are The present invention can be changed and set according to a specific course.
采用上述单元的优点在于:尽量降低由于心理原因而对学生评价的偏颇,一方面有助于教师或社会对学生给出客观的评价,另一方面,有助于学生对自身情况更为了解,避免考试为学生带来的心理影响。The advantage of using the above unit is that it minimizes the bias of the students' evaluation due to psychological reasons. On the one hand, it helps the teacher or the society to give an objective evaluation to the students, on the other hand, it helps the students to understand their own situation better. Avoid the psychological impact of the exam on students.
根据本发明的另外一个方面,提供一种基于数据交换网络的在线教学考评方法。According to another aspect of the present invention, an online teaching evaluation method based on a data exchange network is provided.
图2是根据本发明的基于数据交换网络的在线教学考评方法示意图。2 is a schematic diagram of an online teaching evaluation method based on a data exchange network according to the present invention.
本发明的基于数据交换网络的在线教学考评方法,包括如下步骤:The online teaching evaluation method based on the data exchange network of the invention comprises the following steps:
S10:学生登录及注册课程;S10: Student login and registration course;
S20:教学课程单元根据学生注册课程的需求,通过应用环境单元,生成现实的工作场景,在所述场景中向学生提供教学课程;S20: The teaching course unit generates a realistic work scene by applying the environment unit according to the requirements of the student registration course, and provides a teaching course to the student in the scene;
S30:在教学过程中,对学生生理体征进行监控;S30: monitoring the physiological signs of the students during the teaching process;
S40:对学生生理体征所反映出的心理状态进行综合分析;S40: Comprehensive analysis of the psychological state reflected by the student's physiological signs;
S50:根据教学要求和学生心理状态调整教学课程,使教学课程与学生心理状态相匹配,并进行随堂测试,同时记录此过程中的心理状态成绩;S50: Adjust the teaching curriculum according to the teaching requirements and the psychological state of the students, so that the teaching curriculum matches the psychological state of the students, and conduct a classroom test, and record the psychological state achievements in the process;
S60:在教学课程完成后,进入考评课程环节,根据学生注册课程的要求,通过应用环境单元,生成现实的工作场景,在场景中对学生进行考评;S60: After the completion of the teaching course, enter the evaluation course, according to the requirements of the student registration course, through the application of the environmental unit, generate a realistic work scene, and evaluate the students in the scene;
S70:在考评过程中,对学生生理体征进行监控;S70: During the evaluation process, the physical signs of the students are monitored;
S80:对学生生理体征所反映出的心理状态进行综合分析;S80: Comprehensive analysis of the psychological state reflected by the student's physiological signs;
S90:根据教学要求和学生心理状态调整考评内容,使考评内容与学生心理状态相匹配,并进行考试测试,同时记录此过程中的心理状态成绩;S90: According to the teaching requirements and the psychological state of the students, the content of the assessment is adjusted, the content of the assessment is matched with the psychological state of the student, and the examination test is performed, and the psychological state achievement in the process is recorded;
S100:根据学生在S50步骤中的随堂测试成绩和心理状态成绩、S90步骤中的考试测试成绩和心理状态成绩,对学生给出关于所述课程的总体评价,并给 出学生在心理状态最好与心理状态最差情况下所能达到的水平。S100: giving the student an overall evaluation of the course according to the student's test scores and mental state scores in the S50 step, the test test scores in the S90 step, and the mental state scores, and The level that students can achieve in the worst state of mind and the state of mind.
通过上述方法,可以实现对学生学习状态的全面监控,在获得学生学习状态的情况下,根据学习状态对教学内容和考试内容进行调整,从而使得学生能够在各种状态下学习更适宜的课程,由此提高学习效率和知识转化率,此外,能够使得教师以及学生对学习内容和学习效果进行客观的评价,而非采用现今教育中所常见的“一考定终身”进行单方面的评价。Through the above method, comprehensive monitoring of the student's learning state can be realized, and in the case of obtaining the student's learning state, the teaching content and the test content are adjusted according to the learning state, so that the student can learn a more suitable course in various states. This improves learning efficiency and knowledge conversion rate. In addition, it enables teachers and students to objectively evaluate learning content and learning outcomes rather than unilaterally evaluating the “one-test life” common in today's education.
在另一个具体实施例中,所述生理体征监控,包括:通过面部特征监测单元,监控学生面部特征,进而对学生的心理状态作出基于面部特征的评价;通过语音监控单元,监控学生语音中音量、语速、停顿特征,进而对学生的心理状态作出基于语音特征的评价;通过皮肤监测单元,监控学生的脉搏与皮肤湿润程度,进而对学生的心理状态作出基于皮肤特征的评价;以及,通过动作监控单元,监控学生身体动作,进而对学生的心理状态作出基于动作特征的评价。In another specific embodiment, the monitoring of the physiological signs comprises: monitoring the facial features of the students through the facial feature monitoring unit, and then performing facial feature-based evaluation on the mental state of the students; monitoring the volume of the students in the voice through the voice monitoring unit , speech rate, pause characteristics, and then make a speech-based evaluation of the student's psychological state; through the skin monitoring unit, monitor the student's pulse and skin moistness, and then make a skin-based evaluation of the student's psychological state; and, through The action monitoring unit monitors the physical movements of the students and then makes an evaluation based on the action characteristics of the students' mental state.
在另一个具体实施例中,所述的动作监控,包括:通过眼部监控单元,监控学生眼部的动作,进而对学生的心理状态作出基于眼部特征的评价;以及,通过手势监控单元,监控学生肢体末端挥动的速度和加速度,进而对学生的心理状态作出基于手势特征的评价。In another specific embodiment, the motion monitoring includes: monitoring, by the eye monitoring unit, an action of the eye of the student, and then performing an evaluation based on the eye feature on the mental state of the student; and, by using a gesture monitoring unit, The speed and acceleration of the student's limb end are monitored, and the mental state of the student is evaluated based on the gesture characteristics.
上述多种监控手段,旨在从多角度提供更为全面的学生状态数据,以协助对真实状态做出准确判断。The above various monitoring methods are designed to provide more comprehensive student status data from multiple perspectives to assist in making accurate judgments on the true state.
在另一个具体实施例中,所述心理状态综合分析,包括:利用第一判定单元,判定面部特征检测单元、语音监测单元所作出心理状态评价的一致性;利用第二判定单元,在面部特征监测单元与语音监测单元给出心理状态评价不一致时,用皮肤监测单元和/或动作监控单元所作出的心理状态评价进一步判断学生的心理状态;在上述判定单元无法准确确定心理状态时,进入人工判定模式,生成第一、第二判定单元给出的心理状态,在此基础上,由教师人工给出心理状态,并录入系统。In another specific embodiment, the mental state comprehensive analysis comprises: determining, by using the first determining unit, consistency of the mental state evaluation performed by the facial feature detecting unit and the voice monitoring unit; and using the second determining unit, in the facial feature When the monitoring unit and the voice monitoring unit give inconsistencies in the psychological state evaluation, the psychological state evaluation made by the skin monitoring unit and/or the motion monitoring unit is further used to further judge the psychological state of the student; when the above determining unit cannot accurately determine the mental state, the manual is entered. The determination mode generates the mental state given by the first and second determination units, and on this basis, the mental state is manually given by the teacher and entered into the system.
根据上述关于心理状态的外在表征可知,心理状态通常会以身体的某些姿势或表现而反映出来,但在一些情况下,同一个身体特征会对应不同的心理状态,例如,眼睑痉挛是情绪紧张或过度疲劳的外在体现,因此,进行心理分析,将上述各监控、监测单元所给出的单一评价进行综合而得出较为精确的心理状 态。According to the above external representation of the state of mind, the state of mind is usually reflected in certain postures or manifestations of the body, but in some cases, the same physical characteristics correspond to different mental states, for example, the eyelids are emotions. The external manifestation of nervousness or excessive fatigue. Therefore, psychological analysis is carried out to synthesize the single evaluations given by the above monitoring and monitoring units to obtain a more accurate mentality. state.
在另一个具体实施例中,利用应用环境单元生成现实工作场景,包括:In another specific embodiment, the application environment unit is utilized to generate a real work scenario, including:
1)通过虚拟现实单元,模拟产生教学环境所需三维空间的场景,提供学生在所述环境下关于视觉、听觉、触觉的模拟;或,2)通过增强现实单元,将教学环境所需虚拟信息应用到真实教学场景,使得真实的教学场景和虚拟的物体或信息实时地叠加到同一个画面或空间同时存在;或,3)通过虚拟现实与增强现实组合生成工作场景。1) Simulate the scenes of the three-dimensional space required for the teaching environment through the virtual reality unit, and provide the students with visual, auditory and tactile simulations in the environment; or 2) the virtual information required by the teaching environment through the augmented reality unit Apply to the real teaching scene, so that the real teaching scene and the virtual object or information are superimposed in the same picture or space in real time; or 3) generate a working scene through the combination of virtual reality and augmented reality.
环境单元具有如下优点:首先,能够解决现有教学的枯燥和脱离实际问题;其次,能够解决现有在线教学学生之间以及学生与教师之间缺乏沟通的问题,借助上述装置,学生可以在虚拟场景内看到教师或其他同组学生,并可以完成团队协作项目;最后,教师在教学过程中,可以以学生的视角观察学生的动作行为,从而了解学生学习过程中的部分误区。The environmental unit has the following advantages: First, it can solve the boring and practical problems of the existing teaching; secondly, it can solve the problem of the lack of communication between the existing online teaching students and between the students and the teachers. With the above device, the students can be virtualized. Teachers or other students in the same group can be seen in the scene, and the teamwork project can be completed. Finally, in the teaching process, the teacher can observe the students' behaviors from the perspective of the students, so as to understand some misunderstandings in the student learning process.
上述系统和方法可以被用于在线学习中,从而解决背景技术部分所提及的现有技术中生理状态的获得较为粗略,不能对学生的学习进行针对性的指导,与真实工作环境下的应用相比,仍存在较大的差异的技术问题。应该理解,此处所属的配置和/方法在本质上是示例性的,并且这些具体实施例或示例不应被认为是局限性的,因为多个变体是可能的。此处所述的具体例程或方法可以表示任何数量的处理策略中的一个或多个。由此,所示出的各个动作可以按所示次序执行、按其他次序执行、并行地执行、或者在某些情况下被省略。同样,可以改变上述过程的次序。The above system and method can be used in online learning, so that the acquisition of the physiological state in the prior art mentioned in the background art section is relatively rough, and can not provide targeted guidance for the student's learning, and the application in the real working environment. In contrast, there are still technical problems with large differences. It should be understood that the configurations and/or methods herein are exemplary in nature and that such specific embodiments or examples should not be considered as limiting, as many variations are possible. The specific routines or methods described herein may represent one or more of any number of processing strategies. Thus, the various acts illustrated may be performed in the order illustrated, performed in another order, performed in parallel, or in some cases omitted. Again, the order of the above processes can be changed.
以上介绍了本发明的较佳实施方式,旨在使得本发明的精神更加清楚和便于理解,并不是为了限制本发明,凡在本发明的精神和原则之内,所做的修改、替换、改进,均应包含在本发明所附的权利要求概括的保护范围之内。The preferred embodiments of the present invention have been described above, and are intended to provide a further understanding of the embodiments of the present invention. It is intended to be included within the scope of the appended claims.
工业实用性Industrial applicability
通过本发明所述的系统和方法以实现对学习过程的全程监控和调整,并使得学生在真实应用环境下学习和测试,从而达到教学目的,并学而致用。 Through the system and method of the present invention, the whole process of monitoring and adjusting the learning process is realized, and the students are learned and tested in the real application environment, thereby achieving the teaching purpose and learning and applying.

Claims (11)

  1. 一种基于数据交换网络的在线教学考评系统,其特征在于,包括:An online teaching evaluation system based on data exchange network, characterized in that it comprises:
    课程单元,包括教学课程单元以及考评课程单元,用于向学生提供学习课程和考评所学习课程;The course unit, including the teaching unit and the evaluation unit, is used to provide the students with the study course and the evaluation course;
    评价单元,对学生课程学习情况和考评情况给出总体评价。(评价单元仅针对德学习情况和考评情况从以下那个单元中获得?换句话说,评价单元与谁相关联?)The evaluation unit gives an overall evaluation of the student's course learning and evaluation. (Is the evaluation unit only for the German learning situation and assessment situation obtained from the following unit? In other words, who is the evaluation unit associated with?)
  2. 如权利要求1所述的基于数据交换网络的在线教学考评系统,其特征在于,还包括:The online teaching evaluation system based on the data exchange network of claim 1, further comprising:
    生理监控单元,监控学生生理体征;Physiological monitoring unit to monitor physical signs of students;
    心理分析单元,对学生生理体征所反映出的心理状态进行综合分析,其分析结果为心理状态成绩,用于评价单元对学生对课程学习情况和考评情况给出总体评价;The psychological analysis unit comprehensively analyzes the psychological state reflected by the physiological signs of the students, and the analysis result is the psychological state achievement, which is used for the evaluation unit to give an overall evaluation of the students' learning situation and evaluation situation;
    应用环境单元,根据课程单元的教学要求,将学生置于接近现实的工作场景中,在所述工作场景中指导学生完成课程或完成考评;The application environment unit, according to the teaching requirements of the course unit, places the student in a work scene close to reality, and guides the student to complete the course or complete the evaluation in the work scene;
    调整单元,包括教学调整单元和考评调整单元,根据教学要求和学生心理状态调整教学和考评内容;The adjustment unit, including the teaching adjustment unit and the evaluation unit, adjusts the teaching and evaluation content according to the teaching requirements and the psychological state of the student;
    预测单元,根据心理分析单元给出的学生状态与评价单元给出的总体评价,给出所述学生在心理状态最好与最差情况下所能达到水平。The prediction unit, according to the student state given by the psychoanalysis unit and the overall evaluation given by the evaluation unit, gives the student the level that can be achieved under the best and worst conditions of the psychological state.
  3. 如权利要求1-2任一项所述的基于数据交换网络的在线教学考评系统,其特征在于,所述生理监控单元,包括:The online teaching evaluation system based on the data exchange network according to any one of claims 1-2, wherein the physiological monitoring unit comprises:
    面部特征监测单元,用于监控学生面部特征,进而对学生的心理状态作出基于面部特征的评价;a facial feature monitoring unit for monitoring facial features of the student, and then performing facial feature-based evaluation on the psychological state of the student;
    语音监控单元,用于监控学生语音中音量、语速、停顿等特征,进而对学生的心理状态作出基于语音特征的评价;The voice monitoring unit is configured to monitor the characteristics of the volume, the speed of speech, the pause, and the like in the student's voice, and then make a voice feature-based evaluation on the psychological state of the student;
    皮肤监测单元,用于监控学生的脉搏与皮肤湿润程度,进而对学生的心理状态作出基于皮肤特征的评价;a skin monitoring unit for monitoring a student's pulse and skin moistness, thereby making a skin feature-based evaluation of the student's psychological state;
    以及, as well as,
    动作监控单元,用于监控学生身体动作,进而对学生的心理状态作出基于动作特征的评价。The action monitoring unit is configured to monitor the physical movements of the students, and then make an evaluation based on the action characteristics of the mental state of the students.
  4. 如权利要求1-3任一项所述的基于数据交换网络的在线教学考评系统,其特征在于,所述的动作监控单元,包括:The online teaching evaluation system based on the data exchange network according to any one of claims 1 to 3, wherein the action monitoring unit comprises:
    眼部监控单元,用于监控学生眼部的动作,进而对学生的心理状态作出基于眼部特征的评价;The eye monitoring unit is configured to monitor the movement of the student's eye, and then make an evaluation based on the eye feature on the psychological state of the student;
    以及,as well as,
    手势监控单元,用于监控学生肢体末端挥动的速度和加速度,进而对学生的心理状态作出基于手势特征的评价。The gesture monitoring unit is configured to monitor the speed and acceleration of the student's limb end swing, and then make a gesture-based evaluation of the student's mental state.
  5. 如权利要求1-4任一项所述的基于数据交换网络的在线教学考评系统,其特征在于,所述心理分析单元,包括:The online teaching evaluation system based on the data exchange network according to any one of claims 1 to 4, wherein the psychoanalyst unit comprises:
    第一判定单元,用于判定面部特征检测单元、语音监测单元所作出心理状态评价的一致性;a first determining unit, configured to determine consistency of a mental state evaluation performed by the facial feature detecting unit and the voice monitoring unit;
    第二判定单元,在面部特征监测单元与语音监测单元给出心理状态评价不一致时,用皮肤监测单元和/或动作监控单元所作出的心理状态评价进一步判断学生的心理状态;The second determining unit further determines the psychological state of the student by using the psychological state evaluation made by the skin monitoring unit and/or the motion monitoring unit when the facial feature monitoring unit and the voice monitoring unit do not agree on the psychological state evaluation;
    人工判定单元,在上述判定单元无法准确确定心理状态时,系统进入人工判定模式,生成第一、第二判定单元给出的心理状态,在此基础上,由教师人工给出心理状态,并录入系统。The manual determining unit, when the determining unit cannot accurately determine the mental state, the system enters the manual determination mode to generate the psychological state given by the first and second determining units, and on this basis, the mental state is manually given by the teacher and entered. system.
  6. 如权利要求1-5任一项所述的基于数据交换网络的在线教学考评系统,其特征在于,所述应用环境单元,包括:The data exchange network-based online teaching evaluation system according to any one of claims 1 to 5, wherein the application environment unit comprises:
    1)虚拟现实单元,模拟产生教学环境所需三维空间的场景,提供学生在所述环境下关于视觉、听觉、触觉的模拟;1) a virtual reality unit that simulates a scene that produces a three-dimensional space required by the teaching environment, and provides a simulation of the visual, auditory, and tactile sensations of the student in the environment;
    或,or,
    2)增强现实单元,将教学环境所需虚拟信息应用到真实教学场景,使得真实的教学场景和虚拟的物体或信息实时地叠加到同一个画面或空间同时存在;2) Augmented reality unit, applying the virtual information required by the teaching environment to the real teaching scene, so that the real teaching scene and the virtual object or information are superimposed in the same picture or space in real time;
    或,or,
    3)虚拟现实单元与增强现实单元的组合。 3) A combination of a virtual reality unit and an augmented reality unit.
  7. 一种基于数据交换网络的在线教学考评方法,其特征在于,包括如下步骤:An online teaching evaluation method based on data exchange network, characterized in that it comprises the following steps:
    S10:学生登录及注册课程;S10: Student login and registration course;
    S20:教学课程单元根据学生注册课程的需求,通过应用环境单元,生成现实的工作场景,在所述场景中向学生提供教学课程;S20: The teaching course unit generates a realistic work scene by applying the environment unit according to the requirements of the student registration course, and provides a teaching course to the student in the scene;
    S30:在教学过程中,对学生生理体征进行监控;S30: monitoring the physiological signs of the students during the teaching process;
    S40:对学生生理体征所反映出的心理状态进行综合分析;S40: Comprehensive analysis of the psychological state reflected by the student's physiological signs;
    S50:根据教学要求和学生心理状态调整教学课程,使教学课程与学生心理状态相匹配,并进行随堂测试,同时记录此过程中的心理状态成绩;S50: Adjust the teaching curriculum according to the teaching requirements and the psychological state of the students, so that the teaching curriculum matches the psychological state of the students, and conduct a classroom test, and record the psychological state achievements in the process;
    S60:在教学课程完成后,进入考评课程环节,根据学生注册课程的要求,通过应用环境单元,生成现实的工作场景,在场景中对学生进行考评;S60: After the completion of the teaching course, enter the evaluation course, according to the requirements of the student registration course, through the application of the environmental unit, generate a realistic work scene, and evaluate the students in the scene;
    S70:在考评过程中,对学生生理体征进行监控;S70: During the evaluation process, the physical signs of the students are monitored;
    S80:对学生生理体征所反映出的心理状态进行综合分析;S80: Comprehensive analysis of the psychological state reflected by the student's physiological signs;
    S90:根据教学要求和学生心理状态调整考评内容,使考评内容与学生心理状态相匹配,并进行考试测试,同时记录此过程中的心理状态成绩;S90: According to the teaching requirements and the psychological state of the students, the content of the assessment is adjusted, the content of the assessment is matched with the psychological state of the student, and the examination test is performed, and the psychological state achievement in the process is recorded;
    S100:根据学生在S50步骤中的随堂测试成绩和心理状态成绩、S90步骤中的考试测试成绩和心理状态成绩(是否需要明确下哪个步骤获得的学习情况及考评情况?),对学生给出关于所述课程的总体评价,并给出学生在心理状态最好与心理状态最差情况下所能达到的水平。S100: According to the student's test scores and mental state scores in the S50 step, the test test scores in the S90 step, and the mental state scores (does it be necessary to determine which step to obtain the learning situation and assessment situation?), give the students Regarding the overall evaluation of the course, and giving students the level they can achieve in the worst state of mind and the state of mind.
  8. 如权利要求7所述的基于数据交换网络的在线教学考评方法,其特征在于,所述生理体征监控,包括:The online teaching evaluation method based on the data exchange network of claim 7, wherein the monitoring of the physiological signs comprises:
    通过面部特征监测单元,监控学生面部特征,进而对学生的心理状态作出基于面部特征的评价;The facial feature monitoring unit is used to monitor the facial features of the student, and then the facial features are evaluated based on the psychological state of the student;
    通过语音监控单元,监控学生语音中音量、语速、停顿等特征,进而对学生的心理状态作出基于语音特征的评价;Through the voice monitoring unit, the characteristics of volume, speech rate, pause, etc. in the student's voice are monitored, and then the voice state-based evaluation of the student's psychological state is made;
    通过皮肤监测单元,监控学生的脉搏与皮肤湿润程度,进而对学生的心理状态作出基于皮肤特征的评价;Through the skin monitoring unit, the pulse and skin moistness of the student are monitored, and then the skin condition is evaluated based on the psychological state of the student;
    以及, as well as,
    通过动作监控单元,监控学生身体动作,进而对学生的心理状态作出基于动作特征的评价。Through the action monitoring unit, the student's body movements are monitored, and then the behavioral characteristics of the students are evaluated based on the action characteristics.
  9. 如权利要求7-8任一项所述的基于数据交换网络的在线教学考评方法,其特征在于,所述的动作监控,包括:The online teaching evaluation method based on the data exchange network according to any one of claims 7-8, wherein the action monitoring comprises:
    通过眼部监控单元,监控学生眼部的动作,进而对学生的心理状态作出基于眼部特征的评价;Through the eye monitoring unit, the movement of the student's eye is monitored, and then the psychological state of the student is evaluated based on the characteristics of the eye;
    以及,as well as,
    通过手势监控单元,监控学生肢体末端挥动的速度和加速度,进而对学生的心理状态作出基于手势特征的评价。Through the gesture monitoring unit, the speed and acceleration of the student's limb end swing are monitored, and then the mental state of the student is evaluated based on the gesture feature.
  10. 如权利要求7-9任一项所述的基于数据交换网络的在线教学考评方法,其特征在于,所述心理状态综合分析,包括:The online teaching evaluation method based on the data exchange network according to any one of claims 7-9, wherein the comprehensive analysis of the mental state comprises:
    利用第一判定单元,判定面部特征检测单元、语音监测单元所作出心理状态评价的一致性;Using the first determining unit, determining the consistency of the psychological state evaluation made by the facial feature detecting unit and the voice monitoring unit;
    利用第二判定单元,在面部特征监测单元与语音监测单元给出心理状态评价不一致时,用皮肤监测单元和/或动作监控单元所作出的心理状态评价进一步判断学生的心理状态;Using the second determining unit, when the facial feature monitoring unit and the voice monitoring unit give inconsistencies in the psychological state evaluation, the psychological state evaluation performed by the skin monitoring unit and/or the motion monitoring unit further determines the psychological state of the student;
    在上述判定单元无法准确确定心理状态时,进入人工判定模式,生成第一、第二判定单元给出的心理状态,在此基础上,由教师人工给出心理状态,并录入系统。When the determination unit cannot accurately determine the mental state, the manual determination mode is entered, and the psychological state given by the first and second determination units is generated. On this basis, the mental state is manually given by the teacher and entered into the system.
  11. 如权利要求7-10任一所述的基于数据交换网络的在线教学考评方法,其特征在于,通过应用环境单元生成现实工作场景,包括:The online teaching evaluation method based on the data exchange network according to any one of claims 7 to 10, wherein the real-time work scene is generated by the application environment unit, including:
    1)通过虚拟现实单元,模拟产生教学环境所需三维空间的场景,提供学生在所述环境下关于视觉、听觉、触觉的模拟;1) simulating a scene in a three-dimensional space required for the teaching environment through a virtual reality unit, providing a simulation of the visual, auditory, and tactile senses of the student in the environment;
    或,or,
    2)通过增强现实单元,将教学环境所需虚拟信息应用到真实教学场景,使得真实的教学场景和虚拟的物体或信息实时地叠加到同一个画面或空间同时存在;2) Applying the virtual information required by the teaching environment to the real teaching scene through the augmented reality unit, so that the real teaching scene and the virtual object or information are superimposed in the same picture or space in real time;
    或, Or,
    3)通过虚拟现实与增强现实组合生成工作场景。 3) Generate a work scene through a combination of virtual reality and augmented reality.
PCT/CN2017/105594 2017-08-01 2017-10-11 Data exchange network-based online teaching evaluation system and method WO2019024247A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710648255.2 2017-08-01
CN201710648255.2A CN107480872B (en) 2017-08-01 2017-08-01 Online teaching evaluation system and method based on data exchange network

Publications (1)

Publication Number Publication Date
WO2019024247A1 true WO2019024247A1 (en) 2019-02-07

Family

ID=60598431

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/105594 WO2019024247A1 (en) 2017-08-01 2017-10-11 Data exchange network-based online teaching evaluation system and method

Country Status (2)

Country Link
CN (1) CN107480872B (en)
WO (1) WO2019024247A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110033400A (en) * 2019-03-26 2019-07-19 深圳先进技术研究院 A kind of classroom monitoring analysis system
CN111047481A (en) * 2019-09-29 2020-04-21 云知声智能科技股份有限公司 Online learning system with supervision function
CN111709641A (en) * 2020-06-15 2020-09-25 南京倍时佳信息科技有限公司 Enterprise internal technology training remote learning system based on internet technology
CN111861161A (en) * 2020-06-03 2020-10-30 四川大学华西医院 Inquiry training evaluation method and device based on standardized patients
CN112767753A (en) * 2021-01-08 2021-05-07 中国石油大学胜利学院 Supervision type intelligent online teaching system and action method thereof
CN113891355A (en) * 2021-09-28 2022-01-04 成都盛科信息技术有限公司 WSN connectivity maximization supplementary node optimization deployment method based on improved teaching and learning algorithm
CN115619279A (en) * 2022-11-03 2023-01-17 华中师范大学 Classroom real-record digital course resource quality evaluation method and system

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108542403A (en) * 2018-03-09 2018-09-18 新华网股份有限公司 Determine the method and apparatus of children's degree tired out
CN108898084A (en) * 2018-06-20 2018-11-27 四川文理学院 A kind of method and device thereof of robot identification student's state auxiliary classroom instruction
CN108961679A (en) * 2018-06-27 2018-12-07 广州视源电子科技股份有限公司 A kind of attention based reminding method, device and electronic equipment
CN110658911A (en) * 2018-06-29 2020-01-07 深圳市掌网科技股份有限公司 Virtual reality course adjusting system and method, virtual reality helmet and processing device
CN109215762A (en) * 2018-08-09 2019-01-15 上海常仁信息科技有限公司 A kind of user psychology inference system and method
CN109298779B (en) * 2018-08-10 2021-10-12 济南奥维信息科技有限公司济宁分公司 Virtual training system and method based on virtual agent interaction
CN109619838B (en) * 2019-01-29 2022-01-07 曹桂硕 Application method of intelligent desk and intelligent desk system
CN109919143B (en) * 2019-04-24 2023-08-18 重庆交互科技有限公司 Education method based on multisensory interaction experience and learning attention assessment
CN111046220B (en) * 2019-04-29 2024-06-21 广东小天才科技有限公司 Playback method of newspaper-reading voice in dictation process and electronic equipment
CN110164213A (en) * 2019-06-06 2019-08-23 南京睦泽信息科技有限公司 A kind of multiple terminals distance education and training system based on AI video analysis
CN112306832A (en) * 2020-10-27 2021-02-02 北京字节跳动网络技术有限公司 User state response method and device, electronic equipment and storage medium
CN112394813B (en) * 2020-11-05 2021-06-08 广州市南方人力资源评价中心有限公司 VR examination method and device based on intelligent bracelet equipment and brain wave acquisition equipment
CN113516087A (en) * 2021-07-21 2021-10-19 湖北海天时代科技发展有限公司 Learning situation analysis system, method and terminal based on network video course
CN117708571B (en) * 2024-02-06 2024-04-26 江西工业贸易职业技术学院(江西省粮食干部学校、江西省粮食职工中等专业学校) Teaching management method and system based on virtual reality

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020146674A1 (en) * 2001-04-10 2002-10-10 Professional Training And Consulting, Inc. Online education system and method
CN101017615A (en) * 2007-03-01 2007-08-15 南京财经大学 A public platform for electronic commerce teaching
CN101055674A (en) * 2006-08-31 2007-10-17 上海交通大学 Remote stream media online teaching method for supporting the VoD and direct broadcast function
CN102542849A (en) * 2012-01-20 2012-07-04 东南大学 Formative evaluation system
CN106504598A (en) * 2016-11-18 2017-03-15 中冶华天工程技术有限公司 Classroom instruction device, Teaching System and teaching method

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9978288B2 (en) * 2009-02-13 2018-05-22 University Of Florida Research Foundation, Inc. Communication and skills training using interactive virtual humans
CN104575142B (en) * 2015-01-29 2018-01-02 上海开放大学 Seamless across the Media open teaching experiment room of experience type digitlization multi-screen
CN106023693B (en) * 2016-05-25 2018-09-04 北京九天翱翔科技有限公司 A kind of educational system and method based on virtual reality technology and mode identification technology
CN106878677B (en) * 2017-01-23 2020-01-07 西安电子科技大学 Student classroom mastery degree evaluation system and method based on multiple sensors

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020146674A1 (en) * 2001-04-10 2002-10-10 Professional Training And Consulting, Inc. Online education system and method
CN101055674A (en) * 2006-08-31 2007-10-17 上海交通大学 Remote stream media online teaching method for supporting the VoD and direct broadcast function
CN101017615A (en) * 2007-03-01 2007-08-15 南京财经大学 A public platform for electronic commerce teaching
CN102542849A (en) * 2012-01-20 2012-07-04 东南大学 Formative evaluation system
CN106504598A (en) * 2016-11-18 2017-03-15 中冶华天工程技术有限公司 Classroom instruction device, Teaching System and teaching method

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110033400A (en) * 2019-03-26 2019-07-19 深圳先进技术研究院 A kind of classroom monitoring analysis system
CN111047481A (en) * 2019-09-29 2020-04-21 云知声智能科技股份有限公司 Online learning system with supervision function
CN111861161A (en) * 2020-06-03 2020-10-30 四川大学华西医院 Inquiry training evaluation method and device based on standardized patients
CN111861161B (en) * 2020-06-03 2023-08-22 四川大学华西医院 Question training evaluation method and device based on standardized patient
CN111709641A (en) * 2020-06-15 2020-09-25 南京倍时佳信息科技有限公司 Enterprise internal technology training remote learning system based on internet technology
CN112767753A (en) * 2021-01-08 2021-05-07 中国石油大学胜利学院 Supervision type intelligent online teaching system and action method thereof
CN112767753B (en) * 2021-01-08 2022-07-22 中国石油大学胜利学院 Supervision type intelligent online teaching system and action method thereof
CN113891355A (en) * 2021-09-28 2022-01-04 成都盛科信息技术有限公司 WSN connectivity maximization supplementary node optimization deployment method based on improved teaching and learning algorithm
CN113891355B (en) * 2021-09-28 2024-05-17 成都盛科信息技术有限公司 WSN connectivity maximization supplemental node optimal deployment method based on improved teaching and learning algorithm
CN115619279A (en) * 2022-11-03 2023-01-17 华中师范大学 Classroom real-record digital course resource quality evaluation method and system

Also Published As

Publication number Publication date
CN107480872A (en) 2017-12-15
CN107480872B (en) 2020-10-30

Similar Documents

Publication Publication Date Title
WO2019024247A1 (en) Data exchange network-based online teaching evaluation system and method
US10089895B2 (en) Situated simulation for training, education, and therapy
CN110349667B (en) Autism assessment system combining questionnaire and multi-modal model behavior data analysis
Engwall Analysis of and feedback on phonetic features in pronunciation training with a virtual teacher
US20140272908A1 (en) Dynamic learning system and method
KR20080081635A (en) Language learning device and control method thereof
CN112908355B (en) System and method for quantitatively evaluating teaching skills of teacher and teacher
KR100900081B1 (en) Language learning control method
CN115713875A (en) Virtual reality simulation teaching method based on psychological analysis
Tsunemoto et al. Visual cues and rater perceptions of second language comprehensibility, accentedness, and fluency
Banda et al. Multimodal affect recognition in intelligent tutoring systems
Massaro et al. Pronunciation training: the role of eye and ear.
CN113748449B (en) Evaluation and training system
CN117666790A (en) Immersive talent expression training system based on brain-computer interface technology
Barmaki Multimodal assessment of teaching behavior in immersive rehearsal environment-teachlive
Antunes et al. Certainty and uncertainty in Brazilian Portuguese: methodology of spontaneous corpus collection and data analysis
Szyszka Pronunciation learning strategies
Fabrigas et al. Kinesics as a science teaching strategy for indigenous learners
TWI731577B (en) Learning state improvement management system
Pangket Oral communication proficiency in English of the grade 5 pupils
Worsley Multimodal analysis
WO2024062935A1 (en) Information processing device, system, information processing method, and program
Nuraini Arviandi Student’s Perceptions on Utilizing Video Recording towards the Student’s Speaking Anxiety
Smolina Teaching interpersonal communication in distance learning. Contemporary Issues in Philology
ÖZDEMİR CHAPTER SEVENTEEN LISTENING SKILLS

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17920609

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17920609

Country of ref document: EP

Kind code of ref document: A1