WO2022024742A1 - プログラム、方法及び情報処理装置 - Google Patents

プログラム、方法及び情報処理装置 Download PDF

Info

Publication number
WO2022024742A1
WO2022024742A1 PCT/JP2021/026210 JP2021026210W WO2022024742A1 WO 2022024742 A1 WO2022024742 A1 WO 2022024742A1 JP 2021026210 W JP2021026210 W JP 2021026210W WO 2022024742 A1 WO2022024742 A1 WO 2022024742A1
Authority
WO
WIPO (PCT)
Prior art keywords
student
information
teacher
learning state
students
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/026210
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
俊二 菅谷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Optim Corp
Original Assignee
Optim Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Optim Corp filed Critical Optim Corp
Publication of WO2022024742A1 publication Critical patent/WO2022024742A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances

Definitions

  • This disclosure relates to programs, methods and information processing devices.
  • Patent Document 1 describes a technique for evaluating a participant's concentration on a story that progresses while changing the content, such as a lecture.
  • a video of a group consisting of a plurality of participants to talk to is acquired, and the degree of concentration of the participants is grasped as a whole based on the video.
  • Patent Document 1 does not consider supporting online lessons.
  • the purpose of this disclosure is to provide technology that can support online lessons while grasping the learning status of students taking online lessons in real time.
  • a program for causing a computer including a processor and a memory to execute has a first step of acquiring first information about the behavior of a student taking an online lesson from the processor, and a first step of evaluating the learning state of the student with respect to the online lesson based on the first information.
  • the two steps and the third step of presenting the teacher with the second information to assist the progress of the online lesson based on the learning state of the student are executed.
  • System 1 is a system for conducting online lessons between students and teachers.
  • FIG. 1 is a diagram showing the overall configuration of the system 1 of the first embodiment.
  • the system 1 includes a terminal device 10A operated by a student, a terminal device 10B operated by a teacher, and a server 20.
  • the terminal device 10A, the terminal device 10B, and the server 20 are connected to each other so as to be able to communicate with each other via the network 80 by using a wired or wireless communication standard.
  • the terminal device 10A and the terminal device 10B are realized by a mobile terminal such as a smartphone or a tablet compatible with a mobile communication system.
  • the terminal device 10A and the terminal device 10B may be, for example, a stationary PC (Personal Computer) or a laptop PC.
  • the terminal device 10A and the terminal device 10B include a communication IF (interface) 12, an input device 13, an output device 14, a memory 15, a storage unit 16, and a processor 19. To prepare for.
  • IF interface
  • the terminal device 10A and the terminal device 10B include a communication IF (interface) 12, an input device 13, an output device 14, a memory 15, a storage unit 16, and a processor 19.
  • the communication IF 12 is an interface for inputting / outputting signals because the terminal device 10A and the terminal device 10B communicate with an external device.
  • the input device 13 is an input device (for example, a touch panel, a touch pad, a pointing device such as a mouse, a keyboard, etc.) for receiving an input operation from a user (student or teacher).
  • the output device 14 is an output device (display, speaker, etc.) for presenting information to the user.
  • the memory 15 is for temporarily storing a program, data processed by the program, or the like, and is, for example, a volatile memory such as a DRAM (Dynamic Random Access Memory).
  • the storage unit 16 is a storage device for storing data, for example, a flash memory or an HDD (Hard Disc Drive).
  • the processor 19 is hardware for executing an instruction set described in a program, and is composed of an arithmetic unit, registers, peripheral circuits, and the like.
  • the server 20 is a device that manages student information, teacher information, and the like.
  • the server 20 is a computer connected to the network 80.
  • the server 20 includes a communication IF 22, an input / output IF 23, a memory 25, a storage 26, and a processor 29.
  • the communication IF 22 is an interface for inputting / outputting signals because the server 20 communicates with an external device.
  • the input / output IF 23 functions as an interface with an input device for receiving an input operation from the user and an output device for presenting information to the user.
  • the memory 25 is for temporarily storing a program, data processed by the program, or the like, and is, for example, a volatile memory such as a DRAM (Dynamic Random Access Memory).
  • the storage 26 is a storage device for storing data, for example, a flash memory or an HDD (Hard Disc Drive).
  • the processor 29 is hardware for executing an instruction set described in a program, and is composed of an arithmetic unit, registers, peripheral circuits, and the like.
  • FIG. 2 is a block diagram of a terminal device 10A operated by a student, which constitutes the system 1 of the first embodiment.
  • the terminal device 10A operates with a plurality of antennas (antenna 111, antenna 112) and a wireless communication unit (first wireless communication unit 121, second wireless communication unit 122) corresponding to each antenna.
  • Reception unit 130 including touch sensitive device 131 and display 132
  • voice processing unit 140 voice processing unit 140
  • microphone 141 microphone 141
  • speaker 142 position information sensor 150
  • camera 160 storage unit 170A
  • control unit 180A control unit
  • the terminal device 10A also has functions and configurations (for example, a battery for holding electric power, a power supply circuit for controlling the supply of electric power from the battery to each circuit, and the like) which are not particularly shown in FIG. As shown in FIG. 2, each block included in the terminal device 10A is electrically connected by a bus or the like.
  • the antenna 111 radiates a signal emitted by the terminal device 10A as a radio wave. Further, the antenna 111 receives radio waves from the space and gives a received signal to the first wireless communication unit 121.
  • the antenna 112 radiates a signal emitted by the terminal device 10A as a radio wave. Further, the antenna 112 receives radio waves from the space and gives a received signal to the second radio communication unit 122.
  • the first wireless communication unit 121 performs modulation / demodulation processing for transmitting / receiving signals via the antenna 111.
  • the second wireless communication unit 122 performs modulation / demodulation processing for transmitting / receiving signals via the antenna 112.
  • the first wireless communication unit 121 and the second wireless communication unit 122 are communication modules including a tuner, an RSSI (Received Signal Strength Indicator) calculation circuit, a CRC (Cyclic Redundancy Check) calculation circuit, a high frequency circuit, and the like.
  • the first wireless communication unit 121 and the second wireless communication unit 122 perform modulation / demodulation and frequency conversion of the wireless signal transmitted / received by the terminal device 10A, and supply the received signal to the control unit 180A.
  • the operation reception unit 130 has a mechanism for receiving an input operation of the operator.
  • the operation receiving unit 130 is configured as a touch screen and includes a touch sensitive device 131 and a display 132. Further, the operation reception unit 130 may include a mouse, a keyboard, and the like.
  • the touch-sensitive device 131 accepts an input operation of the operator of the terminal device 10A.
  • the touch-sensitive device 131 detects the contact position of the operator with respect to the touch panel, for example, by using a capacitive touch panel.
  • the touch-sensitive device 131 outputs a signal indicating the contact position of the operator detected by the touch panel to the control unit 180A as an input operation.
  • the display 132 displays data such as images, moving images, and texts according to the control of the control unit 180A.
  • the display 132 is realized by, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display.
  • the voice processing unit 140 performs modulation / demodulation of the voice signal.
  • the voice processing unit 140 modulates the signal given from the microphone 141 and gives the modulated signal to the control unit 180A. Further, the voice processing unit 140 gives a voice signal to the speaker 142.
  • the voice processing unit 140 is realized by, for example, a processor for voice processing.
  • the microphone 141 receives the voice input and gives the voice signal corresponding to the voice input to the voice processing unit 140.
  • the speaker 142 converts the voice signal given from the voice processing unit 140 into voice and outputs the voice to the outside of the terminal device 10A.
  • the position information sensor 150 is a sensor that detects the position of the terminal device 10A, and is, for example, a GPS (Global Positioning System) module.
  • the GPS module is a receiving device used in a satellite positioning system.
  • the satellite positioning system receives signals from at least three or four satellites and detects the current position of the terminal device 10A on which the GPS module is mounted based on the received signals.
  • the camera 160 is a device for receiving light by a light receiving element and outputting it as a captured image.
  • the camera 160 is, for example, a depth camera that can detect the distance from the camera 160 to the shooting target.
  • the storage unit 170A is composed of, for example, a flash memory or the like, and stores data and programs used by the terminal device 10A. In a certain aspect, the storage unit 170A stores the student information 171.
  • Student information 171 is information about students taking online lessons using the terminal device 10A.
  • the student information 171 includes, for example, the student identification information (student ID), the student name, the identification information of the terminal device 10A (terminal ID), the identification information of the online class that the student is taking (class ID), and the student. Includes a history of operating the terminal device 10A, a student image taken by the terminal device 10A, and the like.
  • the control unit 180A controls the operation of the terminal device 10A by reading the program stored in the storage unit 170A and executing the instruction included in the program.
  • the control unit 180A is, for example, an application installed in the terminal device 10A in advance. By operating according to the program, the control unit 180A exhibits functions as an input operation reception unit 181, a transmission / reception unit 182, and a sensing unit 183.
  • the input operation receiving unit 181 performs a process of receiving an operator's input operation for an input device such as a touch sensitive device 131.
  • the input operation reception unit 181 is based on the information of the coordinates when the operator touches the touch-sensitive device 131 with a finger or the like, and the operator's operation is a flick operation, a tap operation, or a drag ( Swipe) Determine the type of operation, such as whether it is an operation.
  • the transmission / reception unit 182 performs processing for the terminal device 10A to transmit / receive data to / from an external device such as a server 20 according to a communication protocol.
  • the sensing unit 183 performs a process of sensing the first information regarding the behavior of the students taking the online class.
  • the first information includes, for example, information on the operation history of the student operating the terminal device 10A, information based on the student's video data taken by the camera, information on the student's response operation to the exercise included in the online class, and the like. Can be mentioned.
  • the first information sensed by the sensing unit 183 is transmitted to the server 20 via the transmission / reception unit 182.
  • the log of operating the hardware includes, for example, information indicating which key was input by the keyboard, the number of times the key was input, and the like.
  • information on the position detected by a pointing device such as a mouse, touch pad, or touch panel, and information on the operation content of the student determined based on the information on the position (for example, dragging or swiping). , Flick, long tap, etc.) etc. are included.
  • information indicating which location information was clicked by a pointing device such as a mouse, trackball, or touch-sensitive device, the number of clicks, voice information input by a microphone, and remarks.
  • the number of times, information about the flick operation of the touch panel, the number of times of the flick operation, etc. can be adopted.
  • the log of operating the application includes the log of the operation input by the student when using the application for taking online lessons.
  • the sensing unit 183 takes notes by inputting characters, an operation in which the student started the course, an operation in which the course was completed, an operation of pressing the "raise hand” button, a history of chatting with other students, and an operation. Record history etc.
  • the log of operating the application contains information on the answer operation in which the student answers the exercise included in the online lesson using the application.
  • the information regarding the answer operation specifically includes the time required to answer each exercise, the input contents, the number of characters input, the number of times the answer has been corrected, and the like.
  • information on the activation of the application In the log of operating the OS, information on the activation of the application, information on changing the settings of the OS, information on putting the information processing device 10 to sleep, information on waking up from the sleep state, and information on the usage status of hardware resources. (For example, CPU usage rate, memory usage rate, network usage status, etc.) and the like are included.
  • the information based on the student's video data taken by the camera is, for example, the information about the operation that the student started the camera, the facial image data showing the orientation and facial expression of the student's face, and the facial composition extracted by image analysis.
  • FIG. 3 is a block diagram of a terminal device 10B operated by a teacher, which constitutes the system 1 of the first embodiment. Since the terminal device 10B is configured in the same manner as the terminal device 10A shown in FIG. 2, except for the storage unit 170B and the control unit 180B, the description thereof will be omitted. Hereinafter, the storage unit 170B and the control unit 180B will be described.
  • the storage unit 170B is composed of, for example, a flash memory or the like, and stores data and programs used by the terminal device 10B. In a certain aspect, the storage unit 170B stores the teacher information 172.
  • Teacher information 172 is information about a teacher in charge of an online lesson using the terminal device 10B.
  • the teacher information 172 includes, for example, teacher identification information (teacher ID), teacher name, teacher experience value, terminal device 10B identification information (terminal ID), online class identification information (class ID), and teacher is a terminal. Includes a history of operating the device 10B.
  • the teacher's experience value represents the teacher's evaluation given based on the teacher's experience.
  • the experience value is set based on, for example, the history of the lessons taught by the teacher, the license held, the qualification, and the like. It should be noted that, instead of the experience value, the history of the lessons taught by the teacher, the licenses possessed, the qualifications, and the like may be stored.
  • the control unit 180B controls the operation of the terminal device 10B by reading the program stored in the storage unit 170B and executing the instruction included in the program.
  • the control unit 180B is, for example, an application installed in the terminal device 10A in advance. Since the control unit 180B is configured in the same manner as the control unit 180A shown in FIG. 2, except for the display control unit 184, the description thereof will be omitted. Hereinafter, the display control unit 184 will be described.
  • the display control unit 184 performs a process of controlling the display of the terminal device 10B so as to present the teacher with the second information that assists the progress of the online lesson.
  • the display control unit 184 receives an instruction to display the second information from the server 20 via the transmission / reception unit 182, and displays the second information on the terminal device 10B.
  • the details of the second information will be described later, but for example, information about each student, instruction information to appoint a predetermined student, instruction information to explain in detail what the teacher explained, and a break. Instruction information to the effect that should be entered is mentioned.
  • FIG. 4 is a diagram showing a functional configuration of the server 20 constituting the system 1 of the first embodiment.
  • the server 20 functions as a communication unit 201, a storage unit 202, and a control unit 203.
  • the communication unit 201 performs processing for the server 20 to communicate with an external device.
  • the storage unit 202 stores data and programs used by the server 20.
  • the storage unit 202 stores the student information database 281 and the teacher information database 282.
  • the student information database 281 is a database for holding information about students taking online lessons. Details will be described later.
  • the teacher information database 282 is a database for holding information about teachers in charge of online lessons. Details will be described later.
  • the control unit 203 exerts the functions shown as various modules by the processor of the server 20 performing processing according to the program.
  • the reception control module 2031 controls the process in which the server 20 receives a signal from an external device according to a communication protocol.
  • the transmission control module 2032 controls a process in which the server 20 transmits a signal to an external device according to a communication protocol.
  • the first information acquisition module 2033 acquires the first information regarding the behavior of the student taking the online class sensed by the sensing unit 183 of the terminal device 10A from the terminal device 10A operated by the student.
  • the first information includes, for example, information on the operation history of the student operating the terminal device 10A, information based on the student's video data taken by the camera, information on the student's response operation to the exercise included in the online class, and the like. Can be mentioned.
  • the first information acquired by the first information acquisition module 2033 is stored in the student information database 281.
  • the learning state evaluation module 2034 evaluates the learning state of the student for the online lesson based on the first information.
  • the learning state of the student is specifically evaluated by the degree of concentration, understanding, behavioral characteristics, etc. of the student in the online lesson. Concentration indicates whether the student is focused on the online lesson. The degree of comprehension indicates whether or not the content of the lesson is understood. Behavioral characteristics indicate whether or not the behavior is characteristic of that of other students.
  • the learning state evaluation module 2034 evaluates the degree of concentration of students by estimating the degree to which the students are concentrating on the online class based on, for example, the video data of the students taken by the camera or the operation history of the students.
  • the learning state evaluation module 2034 uses face image data or feature point data about the composition of the face to determine whether the student is gazing at the display 132. The learning state evaluation module 2034 evaluates how much the student is concentrating on the online lesson based on the degree of gaze of the display 132. Further, the learning state evaluation module 2034 determines whether or not an application other than the online lesson is operated based on, for example, the operation history of the student. The learning state evaluation module 2034 evaluates how much the student is focused on the online lesson based on the degree of operation of other applications.
  • the learning state evaluation module 2034 evaluates the concentration of students at each time with a numerical value of 0 to 100, for example, based on the first information.
  • the learning state evaluation module 2034 evaluates the degree of understanding of the student by estimating the degree of understanding based on, for example, the answer operation of the student or the video data of the student.
  • the learning state evaluation module 2034 specifies, for example, the time required to answer each exercise and the correct answer rate based on the student's answer operation to the student's exercise.
  • the learning state evaluation module 2034 evaluates how well the student understands the lesson content based on the specified time and correct answer rate.
  • the learning state evaluation module 2034 analyzes the facial expression or movement of the student based on, for example, the video data of the student.
  • the learning state evaluation module 2034 makes, for example, a facial expression (for example, smiling) indicating that the student understands the lesson content, or an action (for example, shaking the head up and down). Evaluate whether the student understands the content of the lesson based on what they are doing.
  • the learning state evaluation module 2034 evaluates the comprehension level of the student at each time with a numerical value from 0 to 100, for example, based on the first information.
  • the learning state evaluation module 2034 evaluates a student's behavioral characteristics by determining whether or not the student is taking a characteristic behavior in comparison with other students, based on, for example, the student's video data or the student's operation history. do.
  • the learning state evaluation module 2034 is used, for example, when there is a student who operates the operation reception unit 130 much more frequently than other students based on the operation history of the student (for example, the mouse is frequently used). (For example, by clicking on), it is judged that the behavior of the student is characteristic compared to the behavior of other students. Further, for example, in the learning state evaluation module 2034, there is a student who does not operate the operation reception unit 130 at all while other students frequently operate the operation reception unit 130 based on the operation history of the student. If so, it is determined that the behavior of the student is characteristic compared to the behavior of other students.
  • the learning state evaluation module 2034 when there is a student who is walking while another student is seated based on the student's video data, the behavior of the student is the behavior of the other student. Judged to be characteristic compared to. Further, for example, in the learning state evaluation module 2034, when there is a student who is not writing at all while another student is writing based on the video data of the student, the behavior of the student is taken. Judge that it is characteristic compared to the behavior of other students.
  • the learning state evaluation module 2034 is characterized in the behavior of the student as compared with the behavior of other students when the time required for the answer is short and the correct answer rate is low based on the response history of the student to the exercise. Judge that.
  • the learning state evaluation module 2034 evaluates the behavioral characteristics of the student at each time as "normal” or "abnormal” based on, for example, the first information. Further, the learning state evaluation module 2034 may evaluate the behavioral characteristics of the student at each time with a numerical value of 0 to 100 as the degree of synchronization, for example, based on the first information. A high degree of synchronization indicates that the student is behaving in the same way as other students, and a low degree of synchronization indicates that the student is behaving differently from other students.
  • the learning state evaluation module 2034 evaluates the learning state by inputting the operation history, the video data, or the answer history into the evaluation model learned in advance. For example, if there is an operation log of another application while the online lesson is being conducted, it is considered that the students are not concentrated. Also, when the user is not looking at the screen, it is considered that he / she is not concentrated. Therefore, the degree of concentration can be, for example, the ratio of the line of sight toward the terminal device 10A within a predetermined time. In the present embodiment, since the camera 160 periodically captures the eyes of the user, the degree of concentration can be specified by analyzing the video data of the student. As the evaluation model, such an image analysis model may be adopted. In order to specify such an image feature amount, for example, CNN (Convolution Neural Network) can be adopted as an evaluation model.
  • CNN Convolution Neural Network
  • the evaluation model may be a trained model in which the machine learning model is trained based on the past operation history, video data, or response history.
  • the evaluation model is input with an operation history, video data, or answer history about the student, and outputs a degree of concentration or a degree of understanding.
  • the learning state evaluation module 2034 may be compared with the learning state of other students taking the same online lesson.
  • the learning state evaluation module 2034 compares the evaluation values of the degree of concentration among the students. Further, for example, the learning state evaluation module 2034 compares the evaluation values of comprehension among the students.
  • the learning state evaluation module 2034 may calculate the average value or the median value of the learning states of all the students taking the same online lesson and evaluate the overall learning state. Further, the learning state evaluation module 2034 may evaluate the learning state of each student by the deviation in the whole student.
  • the second information presentation module 2035 presents the second information to the teacher to assist the progress of the online lesson based on the learning state of the student.
  • the second information presentation module 2035 assists the progress of the online lesson by specifically presenting the second information to the teacher as follows.
  • the second information presentation module 2035 presents information about a predetermined student to the teacher in a manner distinguishable from other students based on the student's learning state.
  • the second information presentation module 2035 presents information about each student to the teacher in ascending order of concentration, or highlights information about students with low concentration, based on the concentration of each student.
  • the low concentration student means, for example, a student whose concentration level is lower than a predetermined value, a few students with a low concentration level, and a student whose concentration level is low and biased in terms of the overall concentration level.
  • the highlighting indicates, for example, enlarging and displaying information about the student, displaying the information about the student with a frame, a predetermined number of students from the lower to the lowest concentration ratio, and the like.
  • the second information presentation module 2035 presents information about each student to the teacher in ascending order of comprehension, or highlights information about students with low comprehension, based on the comprehension of each student.
  • a student with a low level of understanding means, for example, a student whose level of comprehension is lower than a predetermined value, a predetermined number of students from the lower level with a low level of comprehension, and a student whose level of comprehension is low and biased in terms of the overall level of comprehension. ..
  • the second information presentation module 2035 highlights information about a student whose behavior is characteristic as compared with other students, based on the behavioral characteristics of each student.
  • the second information presentation module 2035 may present the second information based on the change along the time series of the learning state of the student.
  • the second information presentation module 2035 highlights students whose concentration has decreased as the lesson progresses. In addition, the second information presentation module 2035 highlights students whose comprehension level has declined as the lesson progresses. The second information presentation module 2035 also highlights students whose behavioral entrainment has declined as the lesson progresses.
  • the second information presentation module 2035 presents instruction information to the teacher that a predetermined student should be nominated as the second information based on the learning state of the students. For example, the second information presentation module 2035 may present a student with a low evaluation of learning status to the teacher as a student to be nominated. Students with a low evaluation of learning status are, for example, students whose evaluation value of learning status is lower than a predetermined value, students of the lower few students whose evaluation value of learning status is low, and students whose evaluation value is low when viewed from the overall evaluation value. Represents a biased student.
  • the second information presentation module 2035 presents a student with a low concentration as a student to be nominated. Further, for example, the second information presentation module 2035 presents a student with a low level of understanding as a student to be nominated. Further, for example, the second information presentation module 2035 presents a student whose behavior is characteristic, for example, a student having a low degree of synchronization of behavior, as a student to be nominated.
  • the second information presentation module 2035 may present information about the student to be nominated to the teacher based on the number of times the student is nominated in the same online class. For example, the second information presentation module 2035 stores the number of times each student has been nominated, and nominates a student with a small number of names or a student who has not been nominated among a plurality of students with a low evaluation of learning status. Present as a student to be.
  • the second information presentation module 2035 may present the second information based on the change along the time series of the learning state of the student.
  • the second information presentation module 2035 presents a student whose concentration level has decreased as the lesson progresses as a student to be nominated.
  • the second information presentation module 2035 presents a student whose comprehension level has decreased as the lesson progresses as a student to be nominated.
  • the second information presentation module 2035 presents a student whose behavioral conformity has decreased as the lesson progresses as a student to be nominated.
  • the second information presentation module 2035 uses the instruction information that the teacher should explain in detail based on the learning state of the student as the second information. Present to.
  • the second information presentation module 2035 may present instructional information that the content explained by the teacher should be explained in detail based on the number of students having a low evaluation of the learning state.
  • the second information presentation module 2035 presents instruction information to the teacher that the explanation should be repeated when the number of students whose concentration ratio is lower than the predetermined value exceeds the preset number. ..
  • the second information presentation module 2035 presents instruction information to the teacher that the explanation should be repeated when the number of students whose comprehension level is lower than the predetermined value exceeds the preset number. If the number of people exceeds the preset ratio instead of the preset number, the teacher may be presented with instruction information to repeat the explanation.
  • the second information presentation module 2035 may calculate the average value or the median value of the learning states of all the students and present the second information based on the average value or the median value.
  • the second information presentation module 2035 presents instruction information to the teacher that the explanation should be repeated when the average value (or median value) of the concentration of the entire student becomes 60 points or less. .. Further, for example, the second information presentation module 2035 presents instruction information to the teacher that the explanation should be repeated when the average value (or the median value) of the comprehension level of all the students becomes 60 points or less.
  • the second information presentation module 2035 may present the second information based on the change along the time series of the learning state of the student.
  • the second information presentation module 2035 presents instruction information to the teacher that the explanation should be repeated when the concentration level of the entire student decreases as the lesson progresses.
  • the second information presentation module 2035 presents instruction information to the teacher that the explanation should be repeated when the comprehension level of the entire student deteriorates as the lesson progresses.
  • the second information presentation module 2035 presents instruction information to the effect that a break should be taken to the teacher as the second information based on the learning state of the student. For example, it presents instructional information that a break should be taken based on the number of students with a low evaluation of learning status.
  • the second information presentation module 2035 presents instruction information to the teacher that a break should be taken when the number of students whose concentration ratio is lower than a predetermined value exceeds a preset number. ..
  • the second information presentation module 2035 presents to the teacher instruction information that a break should be taken when the number of students whose comprehension level is lower than the predetermined value exceeds the preset number of students. If the number of people exceeds the preset ratio instead of the preset number, the teacher may be presented with instruction information to take a break.
  • the second information presentation module 2035 may calculate the average value or the median value of the learning states of all the students and present the second information based on the average value or the median value.
  • the second information presentation module 2035 presents instruction information to the teacher that a break should be taken when the average value (or median value) of the concentration of all the students is 60 points or less. .. Further, for example, the second information presentation module 2035 presents instruction information to the teacher that a break should be taken when the average value (or median value) of the comprehension level of all the students is 60 points or less.
  • the second information presentation module 2035 may present the second information based on the change along the time series of the learning state of the student.
  • the second information presentation module 2035 presents instruction information to the teacher that a break should be taken when the concentration level of the entire student decreases as the lesson progresses.
  • the second information presentation module 2035 presents instruction information to the teacher that a break should be taken when the comprehension level of the entire student deteriorates as the lesson progresses.
  • the second information presentation module 2035 may output the second information by inputting the learning state of the student into the pre-learned model.
  • the trained model is, for example, trained by a machine learning model as input data for data related to a learning state and correct output data for a correspondence taken by a skilled teacher in the learning state.
  • the machine learning model for example, CNN (Convolutional Neural Network) is used.
  • FIG. 5 is a diagram showing a data structure of the student information database 281 stored in the server 20.
  • each of the records in the student information database 281 has an item “student ID”, an item “name”, an item “terminal ID”, an item “class ID”, an item “operation history”, and an item “video data”. , Includes the item “learning state”.
  • the item "Student ID” is information that identifies each student.
  • the item "name” is information indicating the name of each student.
  • terminal ID is information that identifies the terminal device 10A operated by each student.
  • class ID is information that identifies the online class that each student is taking. Students with the same class ID are considered to be students taking the same online class.
  • the item "operation history” is information indicating the operation history in which each student operates the terminal device 10A.
  • the server 20 stores the operation history of the student at each time.
  • the operation history contains information about the student's response operations to the exercises included in the online lesson.
  • the item "video data” is information indicating the student's video taken by the camera of each terminal device 10A.
  • the server 20 stores the video data of the student at each time.
  • the item "learning status" is information indicating the learning status of each student for online lessons.
  • the server 20 numerically evaluates the concentration, comprehension, and behavioral characteristics (behavioral synchronization) of the students at each time, and then calculates and stores the comprehensive evaluation value of the learning state.
  • the behavioral characteristics may be evaluated by parameters such as "normal” or "abnormal” as shown in FIG. 5, instead of a numerical value such as the degree of synchronization.
  • the server 20 calculates the overall evaluation value based on, for example, the acquired concentration level, comprehension level, and behavioral synchronization level. Specifically, for example, the server 20 multiplies each of the acquired concentration level, comprehension level, and behavioral synchronization level by a predetermined weight and adds them to calculate a comprehensive evaluation value. The server 20 does not have to calculate the comprehensive evaluation value of the learning state.
  • FIG. 6 is a diagram showing the data structure of the teacher information database 282 stored in the server 20.
  • each of the records in the teacher information database 282 has an item "teacher ID”, an item “name”, an item “experience value”, an item “terminal ID”, an item “class ID”, and an item “operation history”. "including.
  • the item "teacher ID” is information that identifies each teacher.
  • the item "name” is information indicating the name of each teacher.
  • the item "experience value” is information indicating the experience of each teacher.
  • terminal ID is information for identifying the terminal device 10B operated by each teacher.
  • class ID is information that identifies the online class taught by each teacher.
  • the lesson ID is used as a key for associating information between other databases, and associates a teacher who teaches the same lesson with a student who is taking the lesson.
  • the item "operation history” is information indicating the operation history in which each teacher operates the terminal device 10A at each time.
  • Examples of the operation history of the teacher include an operation in which the teacher taps information about a predetermined student to nominate the student, or an operation in which the "take a break" button is pressed to take a break.
  • FIG. 7 is a flowchart showing an example of the flow of assisting the progress of the online lesson by the system 1.
  • step S711 the sensing unit 183 of the terminal device 10A operated by the student senses the first information regarding the behavior of the student taking the online lesson.
  • the first information as described above, for example, information on the operation history of the student operating the terminal device 10A, information based on the student's video data taken by the camera, or the student's exercise included in the online lesson. Information on answer operations can be mentioned.
  • the terminal device 10A transmits the first information to the server 20.
  • step S721 the first information acquisition module 2033 of the server 20 acquires the first information regarding the behavior of the student taking the online class from the terminal device 10A.
  • step S722 the learning state evaluation module 2034 of the server 20 evaluates the learning state of the student for the online lesson based on the first information. As described above, the learning state evaluation module 2034 evaluates the degree of concentration, the degree of understanding, and the behavioral characteristics of the learning state of the student.
  • the second information presentation module 2035 of the server 20 presents the second information to the teacher to assist the progress of the online lesson based on the learning state of the student.
  • the second information presentation module 2035 includes information about each student, instruction information to appoint a predetermined student, instruction information to explain in detail what the teacher explained, or Present the teacher with instructional information that a break should be taken.
  • step S731 the display control unit 184 of the terminal device 10B operated by the teacher displays the second information assisting the progress of the online lesson on the terminal device 10B.
  • ⁇ 4 screen example> 8 to 11 are diagrams showing screen examples of the terminal device 10B operated by the teacher.
  • FIG. 8 is a diagram showing a phase of presenting the learning state of the student in the terminal device 10B.
  • the lecture screen 132A showing the lecture of the online lesson
  • the progress assist screen 132B for assisting the progress of the online lesson are displayed on the same screen.
  • the progress assistance screen 132B displays the average value of the learning states (concentration, comprehension, behavioral synchronization, or total value) of all the students taking the online lesson in the area 132C.
  • the camera image of each student and the evaluation value of the learning state are displayed, and the information about the student with the lowest learning state is enlarged and displayed based on the learning state of the student.
  • the students displayed in area 132D may be all students taking online lessons or some students selected based on their learning status.
  • the display of the progress assistance screen 132B shown in FIG. 8 is not limited to this.
  • the display of the region 132C shown in FIG. 8 is not limited to the average value, but may be the median value. Further, the area 132C may not be displayed.
  • the enlarged display is not limited to the information about the student with the lowest learning state. Information about students whose learning status assessment is lower than the average learning status may be magnified. In addition, information about students who have performed characteristic behavior may be enlarged and displayed.
  • FIG. 9 is a diagram showing a situation in which a student to be nominated is presented in the terminal device 10B.
  • the lecture screen 132A showing the lecture of the online lesson and the progress assist screen 132B for assisting the progress of the online lesson are displayed on the same screen.
  • the names of the students to be nominated are displayed in the area 132E.
  • the student displayed in area 132E is, for example, the student with the lowest learning status.
  • the camera image of each student and the evaluation value of the learning state are displayed, and the information about the student with the lowest learning state is enlarged and displayed based on the learning state of the student.
  • the teacher can nominate the student by tapping the camera image of the student with the name displayed in the area 132E.
  • the display of the progress assistance screen 132B shown in FIG. 9 is not limited to this.
  • the display of the area 132E shown in FIG. 9 is not limited to the name of the student to be nominated, but an instruction to nominate a predetermined student, for example, "Nominate a student with a low concentration (or understanding)". , Or "Please nominate a student who has a characteristic behavior.”
  • information about several students with a low evaluation of the learning state is enlarged and displayed.
  • the teacher can nominate one of the students with a low evaluation of learning status by tapping one of the enlarged camera images of the students.
  • Information about several students with low evaluations of learning status may be displayed in ascending order of evaluation. In addition, they may be displayed in ascending order of the number of times they have been nominated in the online class.
  • FIG. 10 is a diagram showing a phase in which the terminal device 10B is presented to the effect that it should be explained in detail.
  • the lecture screen 132A showing the lecture of the online lesson
  • the progress assist screen 132B for assisting the progress of the online lesson are displayed on the same screen.
  • the camera image of each student and the evaluation value of the learning state are displayed, and the information about the student with the lowest learning state is enlarged and displayed based on the learning state of the student.
  • the students displayed in area 132D may be all students taking online lessons or some students selected based on their learning status.
  • the display of the progress assistance screen 132B shown in FIG. 10 is not limited to this.
  • the display of the area 132F shown in FIG. 10 is not limited to "Please repeat the explanation.”
  • a unit in which the explanation should be repeated may also be displayed. The displayed unit is set based on, for example, the progress of the online lesson and the time-series change of the student's learning state.
  • the enlarged display is not limited to the information about the student with the lowest learning state. Information about several students with low learning status ratings may be magnified. In addition, information about students who have performed characteristic behavior may be enlarged and displayed.
  • FIG. 11 is a diagram showing a phase in which a break should be taken in the terminal device 10B.
  • the lecture screen 132A showing the lecture of the online lesson
  • the progress assist screen 132B for assisting the progress of the online lesson are displayed on the same screen.
  • instruction information indicating that a break should be taken is displayed in the area 132G.
  • the camera image of each student and the evaluation value of the learning state are displayed, and the information about the student having the lowest learning state is enlarged and displayed based on the learning state of the student.
  • the transmission / reception unit 182 of the terminal device 10B sends an instruction to the server 20 that the break has occurred.
  • the display control unit 184 of the terminal device 10B displays the "end of break” object on the progress assist screen 132B.
  • the first information acquisition module 2033 of the server device 20 receives the instruction to the effect that the break has occurred from the terminal device 10B, the first information acquisition module 2033 stops the acquisition of the first information from the terminal device 10A.
  • the teacher determines that a sufficient break has been taken, he presses the "end of break” object displayed on the progress assistance screen 132B.
  • the transmission / reception unit 182 of the terminal device 10B transmits an instruction to the effect that the break is over to the server 20.
  • the first information acquisition module 2033 of the server device 20 receives the instruction that the break has ended from the terminal device 10B, the first information acquisition module 2033 resumes the acquisition of the first information from the terminal device 10A.
  • the display of the progress assistance screen 132B shown in FIG. 11 is not limited to this.
  • the display of the area 132G shown in FIG. 11 is not limited to the instruction information indicating that a break should be taken, and may be a display calling attention to the current learning state such as "the learning state is deteriorating.”
  • the enlarged display is not limited to the information about the student with the lowest learning state. Information about several students with low learning status ratings may be magnified. In addition, information about students who have performed characteristic behavior may be enlarged and displayed.
  • the "break end" object does not necessarily have to be displayed on the progress assistance screen 132B.
  • the break time is set in advance.
  • the countdown to the end of the break may be started, and the remaining time of the break may be displayed on the progress assist screen 132B.
  • the trained model may be relearned based on the progress of the online lesson by the veteran teacher.
  • the terminal device 10B operated by the teacher senses the operation history of the teacher.
  • the server 20 stores the operation history of the teacher in association with the experience value of the teacher and the learning state of the student at the time corresponding to the operation history. For example, it is assumed that a teacher who has an experience value higher than a preset experience value presses the "take a break" object 132H to take a break when the average value of the concentration of all the students reaches 70 points.
  • the server 20 remembers that a highly experienced teacher took a break when the average concentration of all students reached 70 points.
  • the server 20 relearns the trained model of the second information presentation module 2035 based on the operation history of the veteran teacher. This makes it possible to relearn the trained model based on the behavior of skilled teachers in online lessons.
  • the second information presentation module 2035 stores the teacher's operation history in association with the teacher's experience value and the student's learning state at the time corresponding to the operation history. , The second information may be presented based on the stored information.
  • Appendix 1 A program for causing a computer equipped with a processor and a memory to execute the program, the first step of acquiring the first information regarding the behavior of a student taking an online lesson from the processor. And, based on the first information, the second step of evaluating the learning state of the student with respect to the online lesson, and the second information of assisting the progress of the online lesson based on the learning state of the student are presented to the teacher. The third step and the program to be executed.
  • the online lesson includes an exercise, and in the first step, the information regarding the answer operation in which the student answers the exercise is acquired as the first information, as described in (Appendix 1) or (Appendix 2). Program.

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Tourism & Hospitality (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Electrically Operated Instructional Devices (AREA)
PCT/JP2021/026210 2020-07-29 2021-07-13 プログラム、方法及び情報処理装置 Ceased WO2022024742A1 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-127915 2020-07-29
JP2020127915A JP6898502B1 (ja) 2020-07-29 2020-07-29 プログラム、方法及び情報処理装置

Publications (1)

Publication Number Publication Date
WO2022024742A1 true WO2022024742A1 (ja) 2022-02-03

Family

ID=76650024

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/026210 Ceased WO2022024742A1 (ja) 2020-07-29 2021-07-13 プログラム、方法及び情報処理装置

Country Status (2)

Country Link
JP (3) JP6898502B1 (https=)
WO (1) WO2022024742A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024121994A1 (ja) * 2022-12-07 2024-06-13 日本電信電話株式会社 情報処理装置、情報処理方法及び情報処理プログラム

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7725971B2 (ja) * 2021-09-22 2025-08-20 日本電気株式会社 情報処理装置、情報処理方法、およびプログラム
KR20230089322A (ko) * 2021-12-13 2023-06-20 주식회사우경정보기술 동작 추정과 c3d가 결합된 앙상블 기법이 적용된 아동 비대면 학습 집중도 측정 장치 및 방법
US20230261894A1 (en) * 2022-02-14 2023-08-17 Sony Group Corporation Meeting session control based on attention determination
JP7757918B2 (ja) * 2022-09-21 2025-10-22 トヨタ自動車株式会社 オンライン授業支援用のコンピュータプログラム
JP7584565B1 (ja) 2023-05-19 2024-11-15 株式会社アマダ 工作機械及び工作機械の制御方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004229948A (ja) * 2003-01-31 2004-08-19 Hitachi Ltd 学習時状況判断プログラム及びユーザ状況判断システム
JP2017151554A (ja) * 2016-02-22 2017-08-31 株式会社ベネッセコーポレーション プログラム、情報処理方法、及びサーバ装置
US20200126444A1 (en) * 2017-06-23 2020-04-23 Beijing Yizhen Xuesi Education Technology Co., Ltd. Method and apparatus for monitoring learning and electronic device

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5845740B2 (ja) 2011-09-06 2016-01-20 カシオ計算機株式会社 授業支援装置及びプログラム
JP6672592B2 (ja) 2015-02-19 2020-03-25 富士通株式会社 発表者選択支援プログラム、発表者選択支援方法、および情報処理装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004229948A (ja) * 2003-01-31 2004-08-19 Hitachi Ltd 学習時状況判断プログラム及びユーザ状況判断システム
JP2017151554A (ja) * 2016-02-22 2017-08-31 株式会社ベネッセコーポレーション プログラム、情報処理方法、及びサーバ装置
US20200126444A1 (en) * 2017-06-23 2020-04-23 Beijing Yizhen Xuesi Education Technology Co., Ltd. Method and apparatus for monitoring learning and electronic device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024121994A1 (ja) * 2022-12-07 2024-06-13 日本電信電話株式会社 情報処理装置、情報処理方法及び情報処理プログラム

Also Published As

Publication number Publication date
JP7565874B2 (ja) 2024-10-11
JP6898502B1 (ja) 2021-07-07
JP2022025223A (ja) 2022-02-10
JP2022027477A (ja) 2022-02-10
JP2024177297A (ja) 2024-12-19

Similar Documents

Publication Publication Date Title
JP6898502B1 (ja) プログラム、方法及び情報処理装置
CN108090855B (zh) 一种学习计划推荐方法及移动终端
US10657836B2 (en) Information processing device and information processing method for estimation of acceptance ability
Hossen et al. Attention monitoring of students during online classes using XGBoost classifier
US20250148931A1 (en) Systems and methods for adaptable personalized education
JP2017173418A (ja) 学習支援システム、プログラム、情報処理方法、及び情報処理装置
Zheng et al. SOAP. AI: A collaborative tool for documenting human behavior in videos through multimodal generative AI
US20150301726A1 (en) Systems and Methods for Displaying Free-Form Drawing on a Contact-Sensitive Display
CN116800919A (zh) 一种智慧触屏互动的教学设备
JP6230338B2 (ja) 情報処理装置、学習支援システム、及び学習支援プログラム
CN112286411A (zh) 显示模式的控制方法、装置、存储介质以及电子设备
JP6777999B2 (ja) プログラム、情報処理方法、及びサーバ装置
CN115345762A (zh) 人员培训的方法、装置、存储介质及电子设备
CN115690867A (zh) 课堂专注度检测方法、装置、设备及存储介质
CN111857338A (zh) 一种适合大屏幕上使用移动应用的方法
JP2018027282A (ja) 生体情報に連動するスマートボードシステム及びその方法
JP2021060524A (ja) 学習支援システム、学習支援方法およびプログラム
CN117909587A (zh) 基于ai的学生课后习题个性化推荐方法、系统
JP2016075747A (ja) 学習支援システム、制御方法及びプログラム
US9786195B2 (en) System and method for evaluating reading fluency using underlining
Namnakani et al. GazeBlend: Exploring Paired Gaze-Based Input Techniques for Navigation and Selection Tasks on Mobile Devices
Indradhirmaya et al. Mobile Device Assessment Tool (MoDAT) to capture functional capacity of persons with physical and cognitive disabilities
JP7835698B2 (ja) 学習支援システム
CN118587950B (zh) 一种用于智慧教育的交互式led显示系统
Vijayanand Enhancing Learning Skill Through Biometric Integration

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21851012

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21851012

Country of ref document: EP

Kind code of ref document: A1