KR20190043513A - System For Estimating Lecture Attention Level, Checking Course Attendance, Lecture Evaluation And Lecture Feedback - Google Patents

Abstract

The present invention provides a system for checking online lecture attendance, determining an attention level, evaluating a lecture and performing a lecture feedback, which checks the lecture and calculates the attentional level accordingly to perform lecture evaluation and to provide a feedback thereon, thereby performing the online lecture. To this end, an embodiment of the present invention provides the system for checking the online lecture attendance, determining the attention level, evaluating the lecture and performing the lecture feedback, which comprises: web pages for the online lecture, a trainee terminal on which the lecture web pages are displayed, and a server providing lecture content to the web pages for the online lecture and making communications with the trainee terminal, wherein the trainee terminal includes: an input unit inputting an intention of the trainee; an image capturing unit capturing an image of the trainee; and a sound collection unit collecting sound from and around the trainee, and the server includes: a lecture attendance determination unit determining whether the trainee attends the lecture based on information collected by the input unit, the image capturing unit and the sound collection unit; an attention determination unit determining the attention level of the trainee based on the collected information; a lecture evaluation unit evaluating lecture content of the trainee based on the results from the lecture attendance determination unit and the attention level determination unit; and a lecture feedback providing unit providing lecture feedback information to the trainee terminal.

Description

(Checking Course Attendance, Lecture Evaluation And Lecture Feedback), and the like.

More particularly, the present invention relates to an online lecture or a conference (hereinafter referred to as online lecture) whether a lecturer himself / herself is taking a lecture or not, And a system for judging whether or not to take a course with an online course.

However, in the present invention, the term 'online' is not limited to analyzing the degree of involvement of a learner on another space through the Internet, but also includes a concept of 'online' through an appropriate network in a classroom or a lecture room made up of one space I would say.

E-Learning is a collective term for online learning that includes computer-based learning, web-based learning such as paid learning sites on the Internet, and virtual learning. It communicates learning contents through network and interacts with learners. It is defined as a series of processes to promote.

Unlike traditional face-to-face learning situations, online learning can offer the advantage of being able to learn at any time, anywhere and at any level by customizing it. For effective online learning, it is very important for learners to immerse themselves in learning.

However, most of the online learning sites currently have lectures delivered unilaterally regardless of the learning attitude of the learner.

For example, Korean Patent Laid-Open Publication No. 10-2011-0107454 (published on October 10, 2011) discloses " an online learning system and method for strengthening learning commitment. &Quot; Prior art teaches that a learner It is characterized by providing stimulus elements acoustically or visually so that the learner can concentrate on e-learning more efficiently.

However, the above-mentioned prior art has a side effect that it is inefficient to perform a test or evaluation according to the content of a lecture, and it is a side effect that a lecturer can not obtain a good test result or evaluation due to the pressure.

In addition, in the offline classroom, the teacher monitors students' attitudes, and if the students do not concentrate on the learning, feedback can be made to resume the learning after inducing concentration through the stories or stories of the students. However, There is no means for monitoring the attitude of learning, and the academic achievement is degraded.

Especially, although the on-line lecture or meeting must be taken by the person himself / herself, the other person frequently performs the lecture, but there is no effective device for the lecture.

Korean Patent Laid-Open Publication No. 10-2011-0107454 (published on October 10, 2011) "Online learning system and method for strengthening learning commitment"

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and it is an object of the present invention to provide online lecture contents in which lecturers can participate in online lectures with more efficiency and immersion, The purpose of this study is to provide a feedback system for online lectures, which can provide systematic online lectures.

In order to achieve the above object, the present invention is implemented by the following embodiments.

The online course attendance confirmation, immersion degree determination, course evaluation and course feedback system according to an embodiment of the present invention may include an online course web page, a learner terminal displaying the lecture web page, And a server for performing communication with the learner terminal, the learner terminal comprising: an input unit for inputting a learner's intention; And a sound collecting unit for collecting sounds around the lecturer and the lecturer, and the server is configured to judge whether or not the lecturer of the lecturer is taking a lecture based on the information collected through the input unit, the photographing unit, and the sound collecting unit And an immersion degree determining unit for determining the degree of immersion of the learner based on the collected information, A course evaluation unit for evaluating the content of the learner based on the results of the lecture attendance determining unit and the immersion level determining unit; and a lecture feedback unit for providing lecture feedback information to the user terminal based on a result of the lecture evaluating unit Wherein the lecture attendance unit includes a facial feature point and a facial contour of the lecture attendant obtained when the center of the lecturer's terminal of the learner terminal is viewed from the image of the lecturer collected through the photographing unit and a point on the display unit The characteristic points for the gaze position are calculated by comparing the eyes of the learner, both the nose points of the nose and mouth, and the facial contours of the learner, And judges whether or not the lecturer is attending the lecture based on the calculated value, The position of the point is determined by extracting the face image of the student from the image input on the display unit of the student attending to the position of the face of the student, And the position of the minutiae is calculated by horizontally / vertically projecting the image of the minutiae, and when the learner face rotates when the learner gazes at a point on the display unit, The moving distance of the student's face is tracked using the position change amount of the student's facial feature points or when the student moves while rotating the student's face when the student gazes at a point on the display unit, And the final gazing position is calculated .

The input unit may receive a cipher means for indicating the intention of the learner, and the photographing unit may photograph a face, a pupil or a gesture of the learner, the sound collector may collect voice of the learner, The course attendance determining unit may include a first attendance check unit for providing the attendee's initial information input mode on the web page and receiving attendance information of the attendance person through the input unit, the photographing unit, and the sound collection unit, And a second attendance determination unit for receiving the attendance confirmation information through the input unit, the photographing unit, and the sound collection unit by providing an information input mode. The first and second attendance determination unit may include initial information of the first attendance determination unit and confirmation information of the second attendance determination unit And judges whether or not the student is enrolled according to the degree of coincidence.

In addition, the course attendance determining unit determines a course attendance level according to the number of matches between the initial information and the confirmation information.

The lecture attendant terminal may further include a loudspeaker section. The lecture attendance determining section may determine whether or not the lecture attendance is to be performed based on whether or not a predetermined query content is transmitted through the loudspeaker section and a corresponding answer is input through the sound collecting section. .

It is preferable that the predetermined course content to be transmitted through the speaker unit is sent out at predetermined time intervals.

The attendance determination unit may extract a facial contour of a student who has taken a photograph through the photographing unit, compare facial contours included in the initial information with facial contours included in the confirmation information, .

Further, the immersion degree determination section is characterized by determining the degree of immersion according to the number of coincidences between the facial expression, gaze position or attitude information of the pre-stored student and information collected through the input section, the photographing section, and the sound collecting section .

The degree of immersion may be divided into two or more levels according to the number of matches between the two pieces of information.

In addition, the immersion degree determination unit may determine that one or more predetermined query contents are transmitted through the speaker unit and divide the degree of immersion into two or more levels according to the number of answers corresponding to the query content through the sound collection unit .

The course evaluation unit may evaluate the content of the lecturer by dividing the content of the lecturer into two or more levels on the basis of the degree of participation of the lecturer, which is a result of the lecture-by-lecture determining unit, and the degree of commitment that is a result of the commitment-

The course feedback providing unit divides the feedback information into two or more levels according to the class of the course evaluation unit and provides the feedback information to the course terminal.

The present invention can obtain the following effects by the above-described embodiment, the constitution described below, the combination, and the use relationship.

The present invention enables online participants to participate in on-line lectures with more efficient and engaging contents, and at the same time, it can calculate the attendance check and the degree of engagement, and provides the evaluation and feedback on the attendance so that systematic online attendance .

FIG. 1 is a conceptual diagram illustrating the configuration of an online course attendance confirmation, an immersion degree determination, a course evaluation, and a course feedback system according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating the configuration of a mobile terminal among online course attendance confirmation, immersion degree determination, course evaluation, and course feedback system according to an embodiment of the present invention.
FIG. 3 is a block diagram showing a configuration of a course check unit in the configuration of an online course attendance confirmation, an immersion degree determination, a course evaluation, and a course feedback system according to an embodiment of the present invention.

Best Mode for Carrying Out the Invention Hereinafter, preferred embodiments of the online course registration confirmation, the immersion degree determination, the course evaluation and the tuition feedback system according to the present invention will be described in detail with reference to the accompanying drawings.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. In the specification, " comprising " or " comprising " means that, unless specifically stated otherwise, other elements may be included, Quot ;, " module, " and " module " refer to a unit that processes at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software.

First, an online lecture attendance confirmation, an immersion degree determination, a lecture evaluation and a lecture feedback system according to an embodiment of the present invention will be described in detail below with reference to Figs. 1 to 3. Fig.

FIG. 1 is a conceptual diagram illustrating the configuration of an online lecture attendance confirmation, an immersion degree determination, a lecture evaluation, and a lecture feedback system according to an embodiment of the present invention. FIG. 2 is a diagram illustrating an online lecture according to an embodiment of the present invention FIG. 3 is a block diagram showing the configuration of a mobile terminal among the configurations of the confirmation, the immersion degree determination, the course evaluation and the course feedback system. FIG. 3 is a flowchart illustrating the online course registration confirmation, Fig. 8 is a block diagram showing the configuration of a participation / non-participation determining unit in the configuration of the course taking feedback system. Fig.

First, based on FIG. 1, a detailed description will be made of an online course attendance confirmation, an immersion degree determination, a course evaluation and a tuition feedback system according to an embodiment of the present invention.

1 to 3, an online course entry confirmation, an immersion degree determination, a course evaluation and a course feedback system according to an embodiment of the present invention includes a web page 10, a course terminal 100 and a server 200 ).

The web page 10 displays online contents on the web.

In addition, contents provided through the server 200 are controlled by the server 200, and contents and the like provided through the server 200 are displayed on the entry terminal 100.

In addition, the entry terminal 100 receives contents of the contents of the web page 10 from the server 200 and displays the contents.

As shown in FIG. 2, the entry terminal 100 includes an input unit 110, a photographing unit 130, and a sound collecting unit 150.

The input unit 110 is a part in which the intention or intention of the student attending the online course can be expressed and inputted.

Also, the input unit 110 can receive the cipher means indicating the intention of the student. That is, the on-line course attendance confirmation, immersion degree determination, course evaluation and course feedback system according to an embodiment of the present invention can receive the cipher means including intention of the attendance person through the input unit 110. For example, 110) is a keyboard type of a PC and can input a password for confirming the student's attendance.

In addition, the input unit 110 may be provided in the form of a touch means, in which a cipher means indicating the intention of the student is inputted. That is, the input unit 110 is provided in the form of a touching unit, and can input a unique pattern or the like of only the student attending the lecture, which can be a means for determining whether or not the student is a student.

Further, the photographing unit 130 photographs a student who is taking an online course. For example, the photographing unit 130 may photograph a face, a pupil, or a gesture of a student who is taking an online course. That is, the photographing unit 130 can capture and collect a face shape, a pupil shape, or a gesture of only the learner, which is an element for confirming the lecturer's identity.

In addition, the sound collector 150 collects sounds of the students attending the on-line courses or the sounds around the course terminals 100.

Also, the sound collecting unit 150 may collect the voice of the student taking the online lecture. That is, the sound collection unit 150 included in the course terminal 100 can receive the voice of the on-line lecturer to register the lecturer's voice as a basis for confirming whether the lecturer is the lecturer.

The server 200 also provides the course content to the online attendance web page 10 and communicates with the student attending terminal 100.

The server 200 also includes a participation determining unit 210, an immersion level determining unit 230, a participation evaluation unit 250, and a course feedback providing unit 270.

The attendance determination unit 210 determines whether or not a lecture of a lecturer of an online lecture is taken based on information collected through the input unit 110, the photographing unit 130, and the sound collecting unit 150.

As shown in FIG. 3, the attendance determiner 210 includes a first attendance determiner 213 and a second attendance determiner 217.

The first attendance determination unit 213 may provide the attendee's initial information input mode on the web page 10. [ The first lap state determination unit 213 receives the lecture attendant initial information input through the input unit 110, the photographing unit 130, and the sound collecting unit 150 of the learner terminal 100 .

Also, the second attendance determination unit 217 may provide a student attendance confirmation information input mode on the web page 10. The second attendance determination unit 217 receives the attendance confirmation information inputted through the input unit 110, the photographing unit 130, and the sound collection unit 150 in the student attending information input mode.

Through the above process, the attendance determiner 210 compares the information received by the first attendance check unit 213 and the second attendance check unit 217 with each other.

The attendance determiner 210 determines whether or not the attendance of the attendee is confirmed according to the degree (number) of matching of the two pieces of information as a result of the comparison.

In addition, the attendance determiner 210 determines the attendance / non-attendance rating based on the number of matches between the initial information received by the first attendance check unit 213 and the confirmation information received from the second attendance check unit 217 . In other words, rather than simply determining whether or not the attendance of the online attendance attendees is on-off, an element that can determine whether or not the attendee is present (correspondence between the initial information input through the input unit 110 and confirmation information) ), It is possible to classify the certainty of whether or not attendance is possible, so that it is possible to judge whether or not attendance of the attendee is more effective.

In addition, the entry terminal 100 may further include a speaker unit 170. The speaker unit 170 can transmit sound to be transmitted to the on-line student.

In addition, the attendance / non-attendance determining unit 210 may transmit a predetermined inquiry content through the speaker unit 170. The attendance determiner 210 may determine whether attendance of the attendee is possible by determining whether a response corresponding to a predetermined question sent from the speaker unit 170 is input through the sound collector 150. [ That is, in order to determine whether or not the student is going to take a course, the attendance deciding unit 210 causes the online lecture attendee to send out a predetermined question content for confirming whether or not the attendance is going through the speaker unit 170, It is possible to judge whether the content of the answer matches with the contents of the answers of the learner collected through the sound collecting unit 150 and judge whether or not the online learner is taken according to the correspondence.

In addition, the attendance determiner 210 may control the content of the predetermined query transmitted through the speaker unit 170 to be sent out at predetermined time intervals. That is, instead of simply performing the check-in and check-out of the attendants by only one procedure, the predetermined query contents (the contents of the respective inquiries may be different) are randomly or at regular intervals in the whole process of the online lecture Based on whether or not the student's answer is inputted, it is possible to confirm whether or not the student can take the course more accurately.

In addition, the attendance determiner 210 extracts facial contours of the attendees from the images captured by the photographing unit 130, compares the facial contours included in the initial information with the facial contours included in the confirmation information, It is possible to judge whether or not the attendance of the student is attended.

That is, the attendance determiner 210 determines whether or not the student attended the lecture taking the entire image photographed by the photographing unit 130, and specifically extracts the facial contour of the lecturer, It is possible to judge whether or not the attendance of the student is confirmed.

For example, the attendance determiner 210 can determine whether or not attendance of the attendance person is possible by calculating the position of the attendant on the display unit of the attendance terminal 100.

For this purpose, we use the face position information in the input image, the position information of the face feature point, and the geometric shape change of the feature points. In other words, facial feature points used to identify the student's gaze position are both eyes, nose and mouth end points.

Perform the following procedure to locate the feature points in the image. First, the approximate face region is extracted from the input image. When the face region is determined, the eye, nose and mouth search regions are set using the structural information condition of the face with respect to the positions of the facial feature points.

Since the feature points of the eyes, nose, and mouth are dark compared to the surrounding skin areas, the position of the feature points can be obtained by binarizing the image and projecting it horizontally / vertically. If the student is looking at a point on the display using only the rotation of the face, the gaze position can be obtained by using the change of the facial feature point.

That is, the gaze position can be tracked by using the position of the feature points when the learner looks at the center on the display unit and the amount of change of the positions of the feature points when looking at an arbitrary point on the display unit.

In this case, the moving amount of the face is arithmetically added to the gazing position point calculated by the rotation of the face, so that the final Calculate the gazing position.

As described above, according to the present invention, facial feature points and facial contours obtained when viewing the center of the display unit from the image of a student captured through the photographing unit 130 are compared with facial feature points and facial contours obtained when a point on the display unit is viewed And calculates the gaze position by tracking the face position and motion amount.

Through these calculations, it is possible to check whether the student attends the course.

The immersion level determining unit 230 determines the degree of immersion of the online learner based on the information collected through the input unit 110, the photographing unit 130, and the sound collecting unit 150.

The immersion level determining unit 230 may determine the number of coincidences between the facial expression, gaze position or attitude information of the presenter and the information collected through the input unit 110, the photographing unit 130, and the sound collecting unit 150 The degree of immersion can be determined.

The immersion level determining unit 230 may determine the number of coincidences between the facial expression, gaze position or attitude information of the presenter and the information collected through the input unit 110, the photographing unit 130, and the sound collecting unit 150 The degree of immersion can be divided into two or more levels. That is, the degree of immersion can be classified according to the number of pieces of information matched between the two pieces of information, and the degree of immersion can be determined by dividing the class according to the degree of immersion.

In addition, the immersion level determination unit 230 may cause at least one predetermined query content to be transmitted through the speaker unit 170, and may determine the immersion level according to the number of answers corresponding to the query content through the sound collection unit 150 It is possible to distinguish by grades higher than grade.

That is, the degree of immersion can be classified according to the number of information matched between the content of the query and the content of the answer, and the degree of the immersion can be determined by dividing the class according to the degree of immersion.

The course evaluation unit 250 evaluates the content of the online lecture attendants based on the results of the attendance determination unit 210 and the immersion level determination unit 230. [

The attendance evaluating unit 250 may classify the attendance contents of the attendee into two or more levels based on the degree of attendance that is the result of the attendance determination unit 210 and the degree of involvement that is a result of the engagement degree determination unit 230 It can be divided and evaluated.

Also, the course feedback providing unit 270 provides the course feedback information to the user terminal 100 based on the result of the course evaluation unit 250.

In addition, the course feedback providing unit 270 may divide the feedback information into two or more levels according to the class of the course evaluation unit 250 and provide the feedback information to the course terminal 100.

That is, it is possible to provide the user terminal 100 with feedback information of two or more levels so as to correspond to the evaluation items evaluated according to the grades, thereby determining the extent to which the participant has taken the online course with the immersion and attendance intention, As feedback information and provide it to the learner.

In addition, the online course attendance confirmation, immersion degree determination, course evaluation and course feedback system according to an embodiment of the present invention may be implemented in the following embodiments as well as the above embodiments.

In other words, it can be applied not only in online education, but also offline in classrooms or lecture rooms. More specifically, the present invention relates to a method and apparatus for detecting movement and noise of a student, movement of the entire classroom or the lecture room, acquiring image information photographed through photographing means, which is one of the detection methods, And the efficiency of the lecture is digitized, and the collected information is collected and analyzed. Based on the collected and analyzed information, the policy or improvement measures are established and applied, and the established policy or improvement measures are continuously fed back to the lecturer So that an efficient lecture can be performed.

More specifically, except for the above-described content that is specialized only on the Internet, a variety of sensors provided in the PC or the terminal may be used to detect the behavior of a student in a classroom or a classroom on the off-line, Based on this, it is possible to analyze the concentration of the lecture of the learner, to calculate a plan to improve it based on the analyzed concentration, and to establish a periodical strategy to feed back the estimated improvement direction effectively to the learner will be.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, Should be interpreted as falling within the scope of.

10: Web page
100:
110: Input unit 130:
150: Acoustic collector 170: Speaker
200: Server
210:
213: first course enrollment determination unit 215: second course enrollment determination unit
230: immersion degree discrimination unit
250: Course evaluation unit 270: Course feedback

Claims (1)

An online course enrollment web page, a lecturer terminal displaying the lecture web page, and a server for providing lecture contents on the online lecture web page and communicating with the lecturer terminal, In the evaluation and course feedback system,
The learner terminal includes an loudspeaker unit, an input unit for inputting the intention of the learner, a photographing unit for photographing the lecturer, and an acoustic collector for collecting sounds around the lecturer and the lecturer,
The server comprises:
A judging unit for judging whether or not a lecture of the lecturer is taken based on the information collected through the input unit, the photographing unit, and the sound collecting unit;
An immersion degree judging unit for judging the degree of immersion of the learner based on the collected information;
A course evaluation unit for evaluating contents of the attendance of a student based on the results of the attendance determination unit and the immersion degree determination unit;
And a course feedback providing unit for providing the course feedback information to the learner terminal based on a result of the learner evaluation unit,
The course-
The feedback information may be divided into two or more levels according to the rating of the course evaluation unit, so as to calculate how much the participant has taken the online course with the degree of commitment and the attendance intention and the lack thereof according to the feedback information, Provide,
And a face contour of the learner, which is obtained when the center of the learner terminal is viewed from the image of the learner terminal collected through the photographing unit, and a face contour of the lecturer, Calculating a feature value for eye gaze position by comparing feature points that are both ends of the eyes, nose and mouth, and face contours of the learner, calculating a gaze position by tracking the position and motion amount of the learner's face, Judges whether or not the student attends the lecture through the calculated value,
The position of the minutiae is
Extracting the student's face area from the image input on the display unit of the student attending terminal,
And setting the face of the student's face, the nose of the face and the mouth of the mouth for the position of the face of the student's face,
The image of the minutiae points is binarized and then horizontally / vertically projected to calculate the position of the minutiae points,
When the learner faces a point on the display unit when the learner rotates, the gazing position point tracks the gazing position point using the position change amount of the learner's facial feature points, or the learner traces a point on the display unit When the examinee's face moves while rotating, the final gaze position is calculated while the movement amount of the candidate's face is arithmetically added to the gaze position point,
Wherein the input unit receives a cipher means for indicating an intention of the student attending the lecture,
The photographing unit photographs a gesture of only the face, the pupil, or the student attending the lecturer,
Wherein the sound collector is configured to receive a voice of the student to register the voice of the student who is the student who is the basis for confirming whether or not the student is the student, collect the voice of the student attending the online lecture,
The course-
A first lap state determining unit for providing lecturer initial information input mode on the web page and receiving lecturer initial information through the input unit, the photographing unit, and the sound collecting unit;
And a second attendance determination unit that provides attendance confirmation information input mode on the web page and receives attendance confirmation information through the input unit, the photographing unit, and the sound collection unit,
Judges whether or not the attendance is in accordance with the degree of agreement between the initial information of the first attendance check unit and the confirmation information of the second attendance check unit,
Determines whether or not the attendance level is attained according to the number of matches between the initial information and the confirmation information,
The course-
The facial contour of the learner photographed through the photographing unit is extracted and the facial contour included in the initial information is compared with the facial contour included in the confirmation information to determine whether or not the learner is enrolled according to the matching,
Wherein the immersion degree determination unit comprises:
The gaze position or attitude information of the pre-stored student, and the information collected through the input unit, the photographing unit, and the sound collecting unit,
The degree of immersion is divided into two or more levels according to the number of matches between the two pieces of information,
Wherein the control unit controls the speaker unit to transmit at least one predetermined query content and divides the degree of immersion into two or more levels according to the number of answers corresponding to the content of the query through the sound collector,
Wherein,
The contents of the attendance of the student are divided into two or more levels based on the degree of attendance as a result of the attendance determination unit and the degree of involvement which is a result of the engagement degree discrimination unit,
The course-
It is determined whether the contents of the predetermined query are transmitted through the loudspeaker unit and whether or not the participant is enrolled by checking whether the answer contents pre-stored corresponding to the answer and the answer contents of the lecturer collected through the sound collecting unit match with each other. The contents of the predetermined query are sent randomly or at regular intervals to the entire process, and it is confirmed whether the attendance of the student is correct or not based on whether the student's answer is input,
Wherein the input unit comprises:
It is possible to input a unique pattern of a learner by a keyboard type or a touch type of PC in order to judge whether a learner is a learner or not, an online lecture attendance confirmation, an immersion degree discrimination, a lecture evaluation and a lecture feedback system.

Images