KR102620099B1 - Blended learning system that enables editing and manipulation of class videos in real time, convenient transmission, recording, and platform upload of class videos, and improved interaction between teachers and students - Google Patents

Abstract

Editing and manipulation of class videos is possible in real time, and transmission, recording, and uploading of class videos to the platform are convenient, and it provides a blended learning system with improved interaction between teachers and students.
The blended learning system is a blended class system for conducting classes by interacting with an offline teacher and a plurality of online students, comprising: an electronic whiteboard on which data images are played; A first camera that captures the teacher and creates a teacher image; A second camera that captures multiple students and generates multiple student images; A beam projector that receives and projects a plurality of student images from the second camera in real time; An electric screen that plays a plurality of student images projected from the beam projector; It may be characterized by including a controller that determines the class video to be transmitted to a plurality of students through the teacher's operation.

Description

A blended learning system that allows editing and manipulation of class videos in real time, convenient transmission, recording, and platform upload of class videos, and improved interaction between teachers and students {BLENDED LEARNING SYSTEM THAT ENABLES EDITING AND MANIPULATION OF CLASS VIDEOS IN REAL TIME, CONVENIENT TRANSMISSION, RECORDING, AND PLATFORM UPLOAD OF CLASS VIDEOS, AND IMPROVED INTERACTION BETWEEN TEACHERS AND STUDENTS}

The present invention relates to a blended learning system that allows editing and manipulation of class videos in real time, convenient transmission and recording of class videos and upload to the platform, and improved interaction between teachers and students.

In conventional offline education services, learners had the inconvenience of having to unilaterally follow a uniform curriculum set by a learning provider at a set time and place. Meanwhile, online education services can solve the problems caused by time and location limitations of conventional offline education, but they still have the problem of having to follow a unilateral and consistent curriculum provided by the learning provider.

In addition, conventional offline and/or online education services provide educational content to a large number of learners, resulting in difficulties in individual service and management for each learner. Even when manpower is expanded to solve this problem, costs increase. There is a need to prepare preparations for this.

Meanwhile, mixing online and offline classes is called blended learning or mixed instruction. In other words, blended learning refers to learning that is achieved by combining two or more learning methods. It usually refers to a form of class that combines face-to-face classes (in-person classes) and online classes.

Modern society is becoming digitalized online, and especially due to the outbreak of COVID-19 in 2019, technological development and implementation for non-face-to-face classes are accelerating.

The biggest advantage of blended learning is that learner-led, customized education is possible. If you did not understand a lesson in a face-to-face class, you can make up for it in a remote class. In other words, blended learning can provide individualized and segmented customized learning materials and effective learning methods that fit the level and interests of the learner.

In addition, blended learning has fewer time and space constraints, so it can maximize class efficiency. In particular, building a system that can provide stable education even in the current pandemic situation or a natural disaster that may occur in the future can be a huge advantage.

Meanwhile, in order for blended learning to be successful, technical equipment must be equipped, and webcams, microphones, and Internet must be working for effective interaction between students and teachers. Developed countries have a good Internet deployment, but some countries, such as developing countries, lack such an environment and may not be able to smoothly implement blended learning methods.

In other words, blended learning requires a remote learning platform that allows for smooth classes, and the current class platforms in Korea include online e-learning, WebEx, and ZOOM, as well as Google Meet, Teams, etc. This exists.

However, the existing blended learning system made it difficult for teachers to edit various class videos in real time (material videos played on the electronic whiteboard, student videos online, teacher videos captured by AI cameras, etc.), and it was difficult to record class videos. It was difficult to decide whether or not to upload to the platform, and teachers were unable to immediately and intuitively catch student responses online, making interaction between teachers and students difficult. A solution to this problem is required.
(Prior art)
Prior Art 1: Public Patent Publication No. 10-2022-0114184 (published on August 17, 2022)
Prior Art 2: Public Patent Publication No. 10-2022-0126051 (published on September 15, 2022)
Prior Art 3: Public Patent Publication No. 10-2019-0010080 (published on January 30, 2019)
Prior Art 4: Public Patent Publication No. 10-2022-0018782 (published on February 15, 2022)

The problem that the present invention aims to solve is to provide a blended learning system that allows editing and manipulation of class videos in real time, convenient transmission, recording, and platform upload of class videos, and improved interaction between teachers and students.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned can be clearly understood by those skilled in the art from the description below.

The blended learning system of the present invention to solve the above-described problems is a blended class system for conducting classes by interacting with an offline teacher and a plurality of online students, comprising: an electronic whiteboard on which data images are played; A first camera that captures the teacher and creates a teacher image; A second camera that captures multiple students and generates multiple student images; A beam projector that receives and projects a plurality of student images from the second camera in real time; An electric screen that plays a plurality of student images projected from the beam projector; It may be characterized by including a controller that determines the class video to be transmitted to a plurality of students through the teacher's operation.

The controller includes a remote control and a tablet, and the teacher operates at least one of the remote control and the tablet to determine a class video that is a combination of one or more of a material video, a teacher video, and a plurality of student videos, and the tablet includes It may be characterized by playing a class video decided by the teacher.

The controller may further include a smart pen, and the written content displayed by the teacher on the tablet with the smart pen may be overlapped and synthesized with the data image of the electronic whiteboard.

In addition to the class video, a monitoring video is additionally played on the tablet, and the monitoring video has a difference between the average color of the preceding frame and the middle frame among the plurality of student videos that is less than a first specific value, and the difference between the average color of the middle frame and the succeeding frame is less than the first specific value. 1 It is a student video that satisfies the condition of being more than a certain value, and the leading frame, middle frame, and trailing frame are frames generated sequentially in time series among the plurality of frames of each of the plurality of student images, and the tablet contains the generation time of the trailing frame. As a standard, the monitoring video may be additionally played for a specific time.

The remote control determines whether a periodically repeated certain period of time is the first condition or the second condition and performs haptic operation so that at least one of the vibration period and intensity is different, and the first condition is preceded for a certain period of time in all of the plurality of student images. The condition is that the difference between the average color of the preceding frame session and the following frame session is greater than or equal to the second specific value, and the second condition is that the difference between the average color of the preceding frame session and the following frame session for a certain period of time in all of the plurality of student images is the second specific value. This condition is less than that, and the preceding frame session and the succeeding frame session may be characterized as sessions that include a plurality of frames and are generated in time series sequentially from all of the plurality of student videos.

The blended learning system of the present invention allows the teacher to use a controller such as a remote control or a tablet to view class videos (material video played on the electronic whiteboard, student video online, teacher video captured by an AI camera, etc.) in real time. Since it is possible to decide whether to edit, record, and upload to the platform in real time, user convenience regarding editing operations has been improved, and furthermore, there is an advantage of being able to reflect handwritten content on the electronic whiteboard in real time using a smart pen.

In addition, the blended learning system of the present invention analyzes each frame of a plurality of student videos and provides (provided through a tablet) monitoring images for specific students (such as students who take the action of asking questions) to the teacher in real time. It has the advantage of being able to immediately catch student reactions (improving communication/interaction between teachers and students).

In addition, the blended learning system of the present invention analyzes frame sections of all multiple student videos and provides haptic stimulation for the class atmosphere in real time to the teacher (provided through a remote control), allowing the teacher to understand the overall class atmosphere in real time. There are advantages (improved communication/interaction between teachers and students).

Furthermore, the blended learning system of the present invention applies the next-generation NDI (Network Device Interface) system technology, which has the advantage of fast delivery of information such as educational videos and the ability to use the system equipment not only for blended learning but also as broadcasting equipment for school broadcasting stations. There is.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

Figure 1 is a conceptual diagram showing the blended learning system of the present invention.
Figure 2 is a conceptual diagram showing the controller of the blended learning system of the present invention.
Figure 3 is a conceptual diagram showing the playback of a monitoring image in the blended learning system of the present invention.
Figure 4 is a conceptual diagram showing how a teacher recognizes the class responses of multiple students in real time in the blended learning system of the present invention.

The advantages and features of the present invention and methods for achieving them will become clear by referring to the embodiments described in detail below along with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and may be implemented in various different forms. The present embodiments are merely provided to ensure that the disclosure of the present invention is complete and to provide a general understanding of the technical field to which the present invention pertains. It is provided to fully inform the skilled person of the scope of the present invention, and the present invention is only defined by the scope of the claims.

The terminology used herein is for describing embodiments and is not intended to limit the invention. As used herein, singular forms also include plural forms, unless specifically stated otherwise in the context. As used in the specification, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other elements in addition to the mentioned elements. Like reference numerals refer to like elements throughout the specification, and “and/or” includes each and every combination of one or more of the referenced elements. Although “first”, “second”, etc. are used to describe various components, these components are of course not limited by these terms. These terms are merely used to distinguish one component from another. Therefore, it goes without saying that the first component mentioned below may also be a second component within the technical spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used with meanings commonly understood by those skilled in the art to which the present invention pertains. Additionally, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless clearly specifically defined.

Hereinafter, the blended learning system 1000 of the present invention will be described with reference to the drawings. Figure 1 is a conceptual diagram showing the blended learning system of the present invention, Figure 2 is a conceptual diagram showing the controller of the blended learning system of the present invention, Figure 3 is a conceptual diagram showing the playback of a monitoring image in the blended learning system of the present invention, Figure 4 is a conceptual diagram showing how a teacher recognizes the class responses of multiple students in real time in the blended learning system of the present invention.

The blended learning system 1000 of the present invention may be a system for conducting classes by interacting with an offline teacher and a plurality of online students. For this purpose, the blended learning system 1000 of the present invention includes an electronic whiteboard 100, a first camera 200, a second camera (not shown), a beam projector 300, an electric screen 400, and a controller 500. may include.

The electronic whiteboard 100 is installed in an offline classroom and may be a component that plays a digital screen. “Data video” can be played on the electronic whiteboard 100. In this case, the “data video” is pre-edited material that records the content of the class conducted by the teacher and is preset in a format such as a presentation and uploaded to the electronic whiteboard 100 or transmitted in real time through other communication networks, etc. You can.

The first camera 200 may be a camera that generates a “teacher video” by filming a teacher conducting a class in an offline classroom. As an example, the first camera 200 may be an AI camera that tracks the teacher's motion in real time and changes the angle of view to focus on the teacher's movement, but is not limited to this.

The second camera (not shown) may be a camera that captures images of multiple students online. In other words, students can receive class content online through their own student terminals (not shown, for example, smartphones, tablets, desktop PCs, etc.) at remote locations away from the classroom (home, reading room, etc.), and a second camera is built into the student terminal or provided separately and can capture multiple students in real time to create “multiple student videos.”

The beam projector 300 is installed in an offline classroom and can receive and project multiple student images in real time from a second camera.

The electric screen 400 is installed in an offline classroom and can play multiple student images projected from the beam projector. In this case, the electric screen 400 can be placed opposite the electronic whiteboard 100, and accordingly, the teacher can play multiple games played on the electric screen 400 in real time in a field near the electronic whiteboard 100, which is the main activity area. You can monitor the reactions of multiple students by checking student videos.

The controller 500 may be a component that determines the “class video” to be transmitted to a plurality of students through the teacher's manipulation. In other words, the teacher can use the controller 500 to select and combine “material video,” “teacher video,” and “multiple student videos” to determine the “class video,” and the “class video” can be used to select and combine “material video,” “teacher video,” and “multiple student videos.” It can be played in real time to multiple students through a terminal. In addition, the controller 500 can determine whether to record the “class video” through the teacher’s operation and upload the recorded “class video” to the Edu platform. As an example, the controller 500 converts the user interface code from a video recording, editing, and transmission program such as OBS (Open Broadcaster Software) so that the teacher can easily record, edit, and transmit “class video” using the converted interface. Support may be provided, but it is not limited to this.

In detail, the controller 500 may include a remote control 510, a tablet 520, and a smart pen 530. The remote control (510) is made in a portable size, so it has the advantage of being easy to carry even when the teacher leaves the teacher's desk, and the tablet (520) is provided in a slightly larger size, so that the "class video" is played on the display so the teacher can watch the "class" in real time. You can monitor the “class video”. The teacher may operate at least one of the remote control 510 and the tablet 520 to determine a “class video” that is one or a combination of one or more of “material video,” “teacher video,” and “plural student videos.”

Furthermore, the teacher can use the smart pen 530 to display the written content on the tablet 520 where the “data video” is being played as the “class video,” and the written content displayed by the teacher on the tablet 520 can be electronically displayed. It can be synthesized by overlapping with the “data image” of the blackboard 100.

Accordingly, a “data video” overlapping the content of the teacher’s handwriting can be played on the electronic whiteboard 100 in real time, and a “data video” overlapping the content of the teacher’s handwriting can be played as a “class video” on the student terminal. You can.

Hereinafter, an interaction process that allows a teacher to immediately catch student reactions by analyzing “multiple student videos” in real time in the blended learning system 1000 of the present invention will be described.

To this end, the tablet 520 may additionally play a “monitoring video” in addition to the “class video.” "Monitoring video" is a "monitoring video" that satisfies the condition that among "plurality of student videos" the difference in average color between the preceding frame and the middle frame is less than a first specific value, and the difference in the average color between the middle frame and the following frame is more than the first specific value. It could be a “student video.”

That is, in the blended learning system 1000 of the present invention, a specific action is taken by tracking the "student image" whose average color difference changes rapidly among the "plural student images" through a program preset in the tablet 520. The “student video” can be recognized by the teacher as a “monitoring video” through the tablet 520.

In detail, in the blended learning system (1000) of the present invention, when a student takes a specific action (an action to raise a hand to ask a question, an action to write, an action to nod and doze off), it is as if the scene changes. Taking into account the fact that the difference in the average color of the plurality of frames generated continuously from each of the "multiple student videos" changes rapidly, only the videos of students taking specific actions are selected based on this and a separate "monitoring" is performed on the tablet 520. It is provided as a “video.”

In this case, the leading frame, middle frame, and subsequent frame are frames generated sequentially in time series among the plurality of frames for each of the “plurality of student images,” and the tablet 520 displays the time of generation of the subsequent frame (when the student takes a specific action). “Monitoring video” may be additionally played for a certain period of time based on the time taken.

For example, when colors are expressed in the RGB (Red, Green, Blue) system, the color intensity is expressed as a number from 0 to 255. The closer it is to 255, the higher the concentration of the color in that series, and the closer it is to 0, the lower the concentration of the color in that series is. Accordingly, the difference between the average value of the red, green, and blue intensities in each of the plurality of pixels in the preceding frame, middle frame, and succeeding frame is the first specific value (designed among the density values of red, green, and blue colors in the RGB system). You can select a "student video" that takes a specific action by determining whether it is below or above an arbitrary value set to suit the conditions, but it is not limited to this.

When a “monitoring video” is played on the tablet 520, the teacher can instantly and intuitively recognize and catch the student's actions and communicate with the student taking a specific action through a separate channel. For example, a teacher can separately send a voice to the terminal of a student who takes a specific action through a microphone, and a student who confirms the teacher's voice through the terminal can ask the teacher a question through a microphone built into the terminal or separately provided. The teacher can check the student's questions in real time through a speaker (for example, this may be provided on an electronic whiteboard).

Hereinafter, an interaction process that allows a teacher to capture the overall class atmosphere in real time by analyzing “multiple student videos” in real time in the blended learning system 1000 of the present invention will be described.

To this end, the remote control 520 may determine whether a certain period of time that is periodically repeated is the first condition or the second condition and perform haptic operation so that at least one of the vibration period and intensity is different.

The first condition (a class atmosphere condition with many students' actions) is a condition in which the average color difference between the preceding frame session and the following frame session for a certain period of time in all "multiple student videos" is more than the second specific value, and the second condition ( The class atmosphere condition with less student action) may be a condition in which the difference in average color between the preceding frame session and the following frame session for a certain period of time in all of the plurality of student videos is less than a second specific value.

In other words, the blended learning system 1000 of the present invention judges the “plurality of student images” as a whole, determines the class atmosphere by changing the difference in average color, and allows the teacher to recognize it in real time through the remote control 510. .

In detail, in the blended learning system 1000 of the present invention, when there are many students taking a specific action, the average of the preceding frame session and the succeeding frame session that are continuously generated from all of the “plurality of student images” as if the scene is changing Taking into account the fact that the difference in color changes rapidly, the class atmosphere can be judged based on this.

In this case, the preceding frame session and the following frame session are video concepts that include a plurality of frames generated in time-series sequence, and can be generated in time-series sequence from each of a plurality of student videos.

For example, when colors are expressed in the RGB (Red, Green, Blue) system, the color intensity is expressed as a number from 0 to 255. The closer it is to 255, the higher the concentration of the color in that series, and the closer it is to 0, the lower the concentration of the color in that series is. Accordingly, the difference between the average values of red, green, and blue intensities in each of the plurality of pixels in the preceding frame session (including a plurality of frames) and the succeeding frame session (including a plurality of frames) for a certain period of time is determined by the second specific A class atmosphere in which many students judge whether the value is below or above the value (an arbitrary value set according to the design conditions among the color density values of red, green, and blue in the RGB system) and take a specific action if it is above the second specific value. If it is recognized as less than the second specific value, it can be judged as a class atmosphere with few students taking specific actions.

When haptic stimulation comes as a second condition from the remote control 510, the teacher can immediately and intuitively recognize and capture the overall class atmosphere by recognizing the class atmosphere as having many students taking specific actions, and accordingly, the class atmosphere is You can change the delivery method or give advice or point out to students who have problems.

Above, embodiments of the present invention have been described with reference to the attached drawings, but those skilled in the art will understand that the present invention can be implemented in other specific forms without changing its technical idea or essential features. You will be able to understand it. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive.

Claims (5)

In a blended class system for conducting classes by interacting with an offline teacher and multiple online students,
An electronic whiteboard that plays data videos;
A first camera that captures the teacher and creates a teacher image;
A second camera that captures multiple students and generates multiple student images;
A beam projector that receives and projects a plurality of student images from the second camera in real time;
An electric screen that plays a plurality of student images projected from the beam projector; and
Includes a controller that determines the class video to be transmitted to a plurality of students through the teacher's operation,
The controller includes a remote control and a tablet,
The teacher operates at least one of the remote control and the tablet to determine a class video that is a combination of one or more of a material video, a teacher video, and a plurality of student videos,
The tablet plays the class video decided by the teacher,
The controller further includes a smart pen, and the written content displayed by the teacher on the tablet with the smart pen is overlapped and synthesized with the data image of the electronic whiteboard,
In addition to the class video, the tablet plays additional monitoring videos,
The monitoring video is a student video that satisfies the condition that among a plurality of student videos, the average color difference between the preceding frame and the middle frame is less than a first specific value, and the average color difference between the middle frame and the following frame is more than the first specific value,
The leading frame, middle frame, and trailing frame are frames generated sequentially in time series among the plurality of frames of each of the plurality of student videos. Monitoring images are additionally played on the tablet for a specific time based on the generation time of the trailing frame,
Through the microphone, the teacher sends a video to the student terminal of a student who satisfies the condition that the average color difference between the preceding frame and the middle frame is less than the first specific value and the average color difference between the middle frame and the succeeding frame is more than the first specific value. A voice is transmitted, and the student who receives the voice from the teacher transmits a question through the student terminal, and the student's question is transmitted to the teacher through a speaker provided on the electronic whiteboard,
The remote control determines whether a periodically repeated certain period of time is a first condition or a second condition and performs a haptic operation so that at least one of the vibration period and intensity is different,
The first condition is a condition in which the average color difference between the preceding frame session and the following frame session for a certain period of time in all of the plurality of student images is greater than or equal to a second specific value,
The second condition is a condition in which the average color difference between the preceding frame session and the following frame session for a certain period of time in all of the plurality of student images is less than a second specific value,
A blended learning system characterized in that the leading frame session and the following frame session include a plurality of frames and are sessions created in time series sequentially from all of the plurality of student videos. delete delete delete delete