KR20240085722A - Apparatus and method for supporting teaching and learning based on virtual helper - Google Patents

Abstract

The teaching and learning support method according to an embodiment of the present disclosure is a method in which each step is performed by a processor, including processing a connection procedure for a plurality of user terminals and an instructor terminal, transmitting content to a plurality of user terminals, and virtual Generating an object and transmitting a control signal requesting to display a virtual object on a plurality of user terminals or instructor terminals to a plurality of user terminals or instructor terminals, including information, content, and instructor terminals collected from at least some of the plurality of user terminals. Generating additional content based on at least one of the voice data received from and transmitting a control signal requesting that a virtual object display additional content from a plurality of user terminals or instructor terminals to a plurality of user terminals or instructor terminals. may include.

Description

Method and device for supporting teaching and learning based on virtual assistant {APPARATUS AND METHOD FOR SUPPORTING TEACHING AND LEARNING BASED ON VIRTUAL HELPER}

This disclosure relates to an apparatus and method for supporting teaching and learning, and more specifically, to an apparatus and method for supporting teaching and learning based on a virtual assistant.

Non-face-to-face technology, represented by untact, is gradually developing, and in particular, the market for remote video conferencing and video lectures is also growing.

Current video conferencing and video lecture technologies are mainly limited to simply displaying content.

Accordingly, prior art 1 proposes a configuration that utilizes the learner's learning information as well as the learner's biometric information.

However, current video conferencing and video lecture technologies have the problem of not providing a way to change the one-sided delivery of the instructor (speaker) and the passive appearance of the learner (listener).

Prior Art 1: Korean Patent Publication No. 10-2383457 (announced on April 8, 2022)

One embodiment of the present disclosure provides a teaching and learning support device and method that improves the passive situation of learners or listeners.

Another embodiment of the present disclosure provides a teaching and learning support device and method that can improve lectures and understanding of instructors/speakers and learners/listeners by generating additional content from content.

The teaching and learning support method according to an embodiment of the present disclosure is a method in which each step is performed by a processor, including processing a connection procedure for a plurality of user terminals and an instructor terminal, transmitting content to a plurality of user terminals, and virtual Generating an object and transmitting a control signal requesting to display a virtual object on a plurality of user terminals or instructor terminals to a plurality of user terminals or instructor terminals, including information, content, and instructor terminals collected from at least some of the plurality of user terminals. Generating additional content based on at least one of the voice data received from and transmitting a control signal requesting that a virtual object display additional content from a plurality of user terminals or instructor terminals to a plurality of user terminals or instructor terminals. may include.

A teaching and learning support method according to another embodiment of the present disclosure is a method in which each step is performed by a processor, including processing a connection procedure of a plurality of user terminals and displaying content provided by an instructor on a first display device. , generating additional content based on at least one of information collected from at least some of a plurality of user terminals, content, and voice data of the instructor, and displaying the additional content on the second display device.

A teaching and learning support device according to an embodiment of the present disclosure includes a processor and a memory that is electrically connected to the processor and stores at least one code to be executed by the processor, and the memory is such that when executed through the processor, the processor , Processing the connection procedures of multiple user terminals and instructor terminals, transmitting content to multiple user terminals, creating objects, and sending control signals requesting display of virtual objects on multiple user terminals or instructor terminals to multiple users. transmits to a terminal or instructor terminal, creates additional content based on at least one of information collected from at least some of the plurality of user terminals, content, and voice data received from the instructor terminal, and generates additional content based on at least one of the voice data received from the instructor terminal, and Code that causes the object to transmit a control signal requesting to display additional content to a plurality of user terminals or instructor terminals may be stored.

A teaching and learning support device according to another embodiment of the present disclosure includes a processor and a memory that is electrically connected to the processor and stores at least one code to be executed by the processor, and the memory is such that when executed through the processor, the processor , Processing the connection procedure of a plurality of user terminals, displaying content provided by the instructor on the first display device, based on at least one of information collected from at least some of the plurality of user terminals, content, and voice data of the instructor. Code that creates additional content and causes the additional content to be displayed on the second display device may be stored.

The teaching and learning support device and method according to an embodiment of the present disclosure can provide an interactive, active meeting or learning environment between instructor/speaker and learner/listener.

The teaching and learning support device and method according to the embodiment of the present disclosure can improve the learning efficiency of learners.

1 is a diagram illustrating an example of an interface according to a teaching and learning support method according to an embodiment of the present disclosure.
Figure 2 is a diagram showing an environment for performing a teaching and learning support method or running a teaching and learning support device according to an embodiment of the present disclosure.
Figure 3 is a diagram showing an environment for performing a teaching and learning support method or running a teaching and learning support device according to another embodiment of the present disclosure.
Figure 4 is a block diagram showing the configuration of a teaching and learning support device according to an embodiment of the present disclosure.
Figure 5 is a flowchart for explaining a teaching and learning support method according to an embodiment of the present disclosure.
FIG. 6 is a diagram illustrating a method of generating additional content and a method of determining a transmission time of the additional content according to an embodiment of the present disclosure.
Figure 7 is a diagram for explaining a method of determining the concentration or understanding of a learner or listener according to an embodiment of the present disclosure.

Hereinafter, embodiments disclosed in the present specification will be described in detail with reference to the attached drawings. However, identical or similar components will be assigned the same reference numbers regardless of reference numerals, and duplicate descriptions thereof will be omitted. The suffixes “module” and “part” for components used in the following description are given or used interchangeably only for the ease of preparing the specification, and do not have distinct meanings or roles in themselves. Additionally, in describing the embodiments disclosed in this specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in this specification, the detailed descriptions will be omitted. In addition, the attached drawings are only for easy understanding of the embodiments disclosed in this specification, and the technical idea disclosed in this specification is not limited by the attached drawings, and all changes included in the spirit and technical scope of the present invention are not limited. , should be understood to include equivalents or substitutes.

Terms containing ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

When a component is said to be "connected" or "connected" to another component, it is understood that it may be directly connected to or connected to the other component, but that other components may exist in between. It should be. On the other hand, when it is mentioned that a component is “directly connected” or “directly connected” to another component, it should be understood that there are no other components in between.

An example of an interface according to a method for supporting teaching and learning according to an embodiment of the present disclosure will be described with reference to FIG. 1 .

Figure 1 shows an example of an interface of the user terminal 200 according to a teaching and learning support method.

In this specification, a remote lecture is described as an example, but it is also applicable to remote video conferencing, and the instructor in this specification is a concept that includes the speaker of the remote video conference, and the learner is a concept that includes listeners and users of the remote video conference. am. Therefore, the embodiments of this specification should not be understood as being limited to remote lectures.

The user terminal has an area for displaying the content 101 provided by the instructor, an area for selectively receiving and displaying the instructor's appearance from the instructor terminal 300, and an area for displaying the appearance of the user (learner) from a plurality of user terminals 200. There may be an area where transmission is received and displayed.

The teaching and learning support device 100 may transmit a control signal to the instructor terminal 300 and the user terminal 200 to display a virtual object in a specific area. The virtual object may be a shape rather than a specific shape, or it may be a virtual student. In contrast, the specific area may be a blank area that displays additional content without any virtual objects.

The teaching and learning support device 100 is based on at least one of information collected from at least some of the plurality of user terminals 200, content 101 that changes as the lecture progresses, and voice data received from the instructor terminal 300. A control signal can be transmitted to the user terminal 200 and the instructor terminal 300 to create additional content and display it on a virtual object or in the specific area. At this time, the additional content displayed on the user terminal 200 and the instructor terminal 300 may be different from each other and may be displayed on only one of the content.

Referring to FIG. 2 , an example of an environment for performing a teaching and learning support method or running a teaching and learning support device according to an embodiment of the present disclosure will be described.

In one embodiment, the teaching and learning support device 100 may include a lecture platform 100a and an internal teaching and learning support unit 100b. The lecture platform 100a processes the connection process between the user terminal 200 and the instructor terminal 300, distributes the content uploaded from the instructor terminal 300 to the user terminal 200, and Real-time lecture data (voice, handwriting, etc.) can be distributed to the user terminal 200. The teaching and learning support unit 100b controls the display of virtual objects on the user terminal 200 and the instructor terminal 300, and uploads the information collected from the user terminal 200 and the instructor terminal 300 and the instructor terminal 300. Additional content can be created based on the content and real-time lecture data (voice, handwriting, etc.) of the instructor terminal 300.

In another embodiment, the teaching platform 100a and the teaching and learning support device may be configured as separate devices. In this case, the teaching and learning support device is linked to the teaching platform 100a and provides virtual objects and learning through the teaching platform 100. It may be requested to distribute the generated additional content to the user terminal 200 and the instructor terminal 300. In addition, in order to create additional content, information collected from the user terminal 200 and the instructor terminal 300, content uploaded from the instructor terminal 300, and real-time lecture data (voice, handwriting, etc.) from the instructor terminal 300 are used in the lecture. It can be received from the platform 100a.

Referring to FIG. 3 , an example of an environment for performing a teaching and learning support method or running a teaching and learning support device according to another embodiment of the present disclosure will be described.

The embodiment described with reference to FIG. 2 is a technology to support teaching and learning through remote video conferencing, while the embodiment described with reference to FIG. 3 is a technology to support teaching and learning in the case of offline-based lectures and meetings, such as face-to-face classes. . Below, the description will be made on the assumption that the lecture platform 100a and the internal teaching and learning support unit 100b are configured in one device, but as in FIG. 2, they may be configured as separate devices.

The teaching and learning support device 100 processes the connection procedure of the plurality of user terminals 201 and displays content uploaded by the instructor 301 on the first display device 101. The teaching and learning support device 100 collects the voice data of the instructor 301 or generates additional content based on the content uploaded by the plurality of user terminals 201 and the instructor 301 and then displays the second display device 103. ), additional content can be displayed. Additional content may be displayed as a sound or visualization element such as a virtual student or virtual object displayed on the second display device 103. In the embodiment of FIG. 3, the virtual student may be displayed as a 3D hologram on the second display device 103 or may be displayed on a 2D display device.

In this specification, sign and display are concepts that include all methods of expressing externally as visual and auditory elements, such as sound and LED, in addition to necessarily expressing them as visual elements.

The configuration of the teaching and learning support device 100 according to an embodiment of the present disclosure will be described with reference to FIG. 4 .

The teaching and learning support device 100 performs connection processing between the user terminal 200 and the instructor terminal 300, receives question information from the user terminal 200, receives selection information from the user terminal 200, or performs connection processing between the user terminal 200 and the instructor terminal 300. A communication unit 110 and a processor 130 that receive voice from the terminal 300, image information acquired from the camera of the user terminal 200 and the instructor terminal 300, or eye position information obtained by processing the image information. It may include a memory 120 that stores code or content that instructs the execution of . The teaching and learning support device 100 inputs image information acquired from the cameras of the user terminal 200 and the instructor terminal 300 into a deep learning-based learning model to determine facial expressions or extract keywords from voice information (a learning model ( 150) and a deep learning processor 140 that accelerates deep learning-based processes. The teaching and learning support device 100 may include an interface 150 and a display 170 for user interface, such as administrators.

In one embodiment, the communication unit 110 of the teaching and learning support device 100 may include a wireless communication unit or a wired communication unit as a communication interface.

The wireless communication unit may include at least one of a mobile communication module, a wireless Internet module, a short-range communication module, and a location information module.

The mobile communication module transmits and receives wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network built according to LTE (Long Term Evolution), a communication method for mobile communication.

The wireless Internet module is a module for wireless Internet access and can be built into or external to the teaching and learning support device 100, and supports WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), and Wi-Fi (Wireless Fidelity) Direct. , DLNA (Digital Living Network Alliance), etc. may be used.

The short-range communication module is a module for transmitting and receiving data through short-distance communication, including Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, and NFC (Near Field). Communication), etc. can be used.

The location information module is a module for acquiring the location of the teaching and learning support device 100, and is either a GPS (Global Positioning System) module based on satellite navigation technology, or a location information module based on wireless communication with a wireless communication base station or wireless access point. It may be a module that is acquired. The location information module may include a WiFi module.

In one embodiment, the teaching and learning support device 100 may include an input unit or an output unit for user input.

The input unit includes a user interface (UI: User Interface) including a microphone and a touch interface for receiving information from the user, and the user interface may include a mouse, a keyboard, as well as mechanical and electronic interfaces implemented in the device. As long as the user's command can be input, the method and form are not particularly limited. The electronic interface includes a display capable of touch input.

The display 170 is used to deliver information to the user by displaying the output of the teaching and learning support device 100 to the outside, and includes a display, LED, speaker, etc. for displaying visual output, auditory output, or tactile output. can do.

The teaching and learning support device 100 may include a peripheral device interface 160 for data transmission with various types of connected external devices, a memory card port, and external device I/O (Input/Output). It may include ports, etc.

Deep learning-based learning models include CNN or R-CNN (Region based CNN), C-RNN (Convolutional Recursive Neural Network), Fast R-CNN, Faster R-CNN, and R-FCN (Region based Fully Convolutional Network). ), YOLO (You Only Look Once) or SSD (Single Shot Multibox Detector), RNN (Recursive neural network), and LSTM (Long Short-Term Memory) structures may be included.

The learning model may be implemented in hardware, software, or a combination of hardware and software. If part or all of the learning model is implemented in software, one or more instructions constituting the learning model may be stored in memory.

A teaching and learning support method of the teaching and learning support device 100 according to an embodiment of the present disclosure will be described with reference to FIG. 5 .

As described above, this method is explained on the premise that the lecture platform 100a, which processes the connection procedure of the user terminal 200 and the instructor terminal 300 or distributes content, is configured as a single device, but is configured separately from each other. do not rule out

The teaching and learning support device 100 processes the connection procedure of the user terminal 200 and the instructor terminal 300 (S110). If the teaching and learning support device 100 is a lecture support device, the user terminal 200 may be a learner terminal.

The teaching and learning support device 100 transmits content uploaded by the instructor terminal 300 in advance or in real time to the user terminal 200 for which the connection procedure has been completed (S120).

The teaching and learning support device 100 transmits a control signal to display a virtual object to the user terminal 200 and the instructor terminal 300 (S130). A virtual object is an object displayed on the display as the subject of display when displaying additional content later, and is a virtual character in the form of a person or is not particularly limited in its form.

Afterwards, the teaching and learning support device 100 collects information collected from the user terminal 200 and the instructor terminal 300, content uploaded from the instructor terminal 300, and real-time lecture data (voice, handwriting, etc.) of the instructor terminal 300. ), etc., generate additional content (S140), and transmit a control signal to display the additional content on at least one of the user terminal 200 and the instructor terminal 300 (S150).

Information collected by the user terminal 200 may be feedback information from users (learners) about the content. For example, an interface that allows feedback on the degree of understanding of the current content is displayed on the user terminal 200, and users select input in response to this (for example, a button saying 'I do not understand' or a scale on a 5-point scale) selection of values, etc.). As another example, the feedback information may be questions from users or a consent selection for a specific user's question. For example, the questions collected from the user terminals 200 are feedback information, or the collected questions are displayed on the user terminal 200, and the information collected about whether each user terminal 200 agrees or selects them is feedback information. It could be information.

The following embodiments are explained on the assumption that the feedback information is question information.

Referring to FIG. 6, an embodiment of additional content and an embodiment of a method for determining when to transmit a control signal to display additional content will be described.

In one embodiment, the teaching and learning support device 100 may receive a plurality of question information regarding content from at least a portion of the user terminal 200 and generate additional content based on the plurality of question information. For example, after receiving a plurality of questions from a plurality of user terminals 200, the plurality of questions received are listed and transmitted to the user terminal 200, and the questions are answered according to the selection (preference) of the user terminal 200. After prioritizing a plurality of questions, some of the questions may be selected and created as additional content, and a control signal may be transmitted to display the determined questions on the user terminal 200 and the instructor terminal 300. After checking this additional content, the instructor can provide additional explanations for the questions displayed through virtual objects and then move on to the next content.

In this case, it provides a way for students who spend a lot of time asking common questions from multiple learners or have difficulty actively participating in the lecture to actively participate in the lecture in an indirect way, and has the effect of helping learners understand the lecture. .

In one embodiment, the teaching and learning support device 100 receives voice data from the instructor terminal 300 or the instructor 301, converts the voice data into text data, and converts the text data into a learning model based on deep learning, Alternatively, words may be extracted and additional content may be created in a word cloud format 610 based on the frequencies that appear among the extracted words.

In one embodiment, the teaching and learning support device 100 forms a word cloud based on words (keywords) included in content uploaded from the instructor terminal 300, or simply forms a word cloud based on the instructor's voice data. can do. The teaching and learning support device 100 transmits a control signal to change and display the word cloud content when the salience rank changes according to a preset time interval or the frequency of words included in the word cloud, so that the content changes according to the progress of the content. It has the effect of allowing learners to visually understand important lecture content in a timely manner. Therefore, the learner's learning efficiency can be improved.

For example, when forming a word cloud based on words (keywords) included in content uploaded from the instructor terminal 300, the word cloud can be formed with the contents of the content from the start of content display to the present. Alternatively, a word cloud may be formed based on words (keywords) included in the content within a preset range from the page currently displaying the content on a plurality of user terminals. When the content consists of pages, the preset range can form a word cloud based on content before and/or after a certain page range from the currently displayed page. Therefore, the effect of allowing learners to visually understand important lecture content in a timely manner can be doubled as the content progresses.

In one embodiment, the teaching and learning support device 100 includes at least one of a keyword with a high frequency that emerges from the voice data received from the instructor terminal 300, a keyword with a high frequency that emerges by analyzing the content, and a keyword in a word cloud. By comparing words included in the content currently being displayed on the user terminal 200, some words determined to match the keyword may be displayed differently from other words, which may include words having different morphological sizes or different colors. It may be indicated. For example, additional content can be created to display words with different morphological sizes based on the frequency of words that appear in the voice data, while displaying words included in the content (including similar words) in different colors. Or vice versa, by modifying the content to display words with a certain frequency or higher in the word cloud among the content uploaded from the instructor terminal 300 in different colors or shapes, learners can visually understand important lecture content in a timely manner. can help you do this.

The teaching and learning support device 100 may determine when to transmit a control signal requesting to display the generated additional content rather than transmitting it to at least one of the user terminal 200 and the instructor terminal 300 at the time of creation. (620). In this way, learning efficiency can be improved by not interrupting the flow of the instructor's lecture or presentation or by ensuring that the instructor does not miss cases where learners lack understanding.

In one embodiment, the teaching and learning support device 100 may determine when to transmit a control signal requesting to display additional content based on a plurality of question information received from a plurality of user terminals 200. For example, if the frequency of occurrence of words included in a plurality of question information is calculated and the frequency of occurrence of a specific word exceeds a certain number of times, or if the preference information of the user terminal 200 for a plurality of question information is in the specific question information, If the number exceeds a certain number of times, it is determined that the learners lack understanding of the content, and a control signal requesting display of additional content may be transmitted.

In another embodiment, the teaching and learning support device 100 may determine when to transmit a control signal requesting to display additional content based on the context of the voice data or content received from the instructor terminal 300. . For example, the teaching and learning support device 100 distinguishes between content explaining the lecture and content encouraging questions among the voice data received from the instructor terminal 300, and displays additional content when it determines that the content encourages questions. A control signal requesting to do so may be transmitted. As another example, the teaching and learning support device 100 monitors content changes according to the content display control signal of the instructor terminal 300 for content provided by the instructor, and detects changes at a time when the content has a large change before and after (for example, chapter change) and transmit a control signal requesting that additional content be displayed at that time. In this case, screen images according to the progress of the content are entered into a deep learning-based learning model learned with training data that labels each page of content as whether it is the content of a specific chapter or the start of the next chapter to determine the point in time when there is a large change before and after. can do. Alternatively, it is possible to determine when there is a significant change before and after by comparing the text corresponding to the chapter indication of the content.

Referring to FIG. 7, another embodiment of an embodiment of additional content and a method of determining when to transmit a control signal to display additional content will be described.

In one embodiment, the teaching and learning support device 100 is controlled to display additional content based on the image information acquired from the user terminal 200 and the instructor terminal 300 or the eye movements of the user and the instructor obtained from the image information. You can decide when to transmit the signal.

For example, the teaching and learning support device 100 may determine the first location information 710a and 710b, which is the location of the content currently explained by the instructor, from the instructor's eye movement of the instructor terminal 300. In addition, the teaching and learning support device 100 may determine the second location information 720a and 720b, which is the location of the content that the learners are currently focusing on, from the learner's eye movement of the user terminal 200. The first location information and the second location information may be determined as coordinates or as an area based on eye movement during a certain time interval.

Thereafter, the teaching and learning support device 100 may determine whether the learners understand the instructor's lecture well based on the distance and degree of overlap between the first location information and the second location information. For example, as shown in Figure 7 (a), when the first location information and the second location information are determined as areas, and the degree of overlap between the two areas exceeds a preset standard, it is difficult for the learner to well understand what the instructor explains. It can be judged that On the other hand, as shown in Figure 7 (a), when the first location information and the second location information are determined as areas, and the distance between the center points of the two areas exceeds a preset standard or there is no overlap, the content explained by the instructor is If it is determined that the learner does not understand well, a control signal can be sent to display additional content. In this case, “Learners do not understand” may be displayed while displaying the second location information as additional content, or the question information received from the user terminals 200 may be displayed as additional content.

As another embodiment, the teaching and learning support device 100 may determine the timing of transmitting a control signal to display additional content based on the image information acquired from the user terminal 200 or the user's facial expression obtained from the image information. .

For example, the facial image obtained from the user terminal 200 is input to a deep learning-based learning model to determine the facial expression, and if it is judged to be a negative image such as an expression that many users do not understand or an expression that is difficult, the "Learner" “They do not understand” may be displayed, or question information received from the user terminals 200 may be displayed as additional content.

The present disclosure described above can be implemented as computer-readable code on a program-recorded medium. Computer-readable media includes all types of recording devices that store data that can be read by a computer system. Examples of computer-readable media include HDD (Hard Disk Drive), SSD (Solid State Disk), SDD (Silicon Disk Drive), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is. Additionally, the computer may include a processor for each device.

Meanwhile, the program may be specially designed and configured for the present disclosure, or may be known and usable by those skilled in the art of computer software. Examples of programs may include not only machine language code such as that created by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.

In the specification (particularly in the claims) of the present disclosure, the use of the term “above” and similar referential terms may refer to both the singular and the plural. In addition, when a range is described in the present disclosure, the invention includes the application of individual values within the range (unless there is a statement to the contrary), and each individual value constituting the range is described in the detailed description of the invention. It's the same.

Unless there is an explicit order or description to the contrary regarding the steps constituting the method according to the present disclosure, the steps may be performed in any suitable order. The present disclosure is not necessarily limited by the order of description of the steps above. The use of any examples or illustrative terms (e.g., etc.) in the present disclosure is merely to describe the present disclosure in detail, and unless limited by the claims, the scope of the present disclosure is limited by the examples or illustrative terms. It doesn't work. In addition, those skilled in the art will recognize that various modifications, combinations and changes may be made according to design conditions and factors within the scope of the appended claims or their equivalents.

Therefore, the spirit of the present disclosure should not be limited to the above-described embodiments, and the scope of the patent claims described below as well as all scopes equivalent to or equivalently changed from the claims are within the scope of the spirit of the present disclosure. It will be said to belong to

100: Teaching and learning support device
101: Content
103: second display device
200: user terminal
300: Instructor terminal
610: Word cloud additional content
620: Timing of additional content provision
710: First location information
720: Second location information

Claims (14)

How each step is performed by a processor, comprising:
Processing a connection procedure for a plurality of user terminals and an instructor terminal;
Transmitting content to the plurality of user terminals;
Generating a virtual object and transmitting a control signal requesting the plurality of user terminals or the instructor terminal to display the virtual object to the plurality of user terminals or the instructor terminal;
generating additional content based on at least one of information collected from at least some of the plurality of user terminals, the content, and voice data received from the instructor terminal; and
Comprising the step of transmitting a control signal requesting that the virtual object display the additional content from the plurality of user terminals or the instructor terminal to the plurality of user terminals or the instructor terminal.
How to support teaching and learning.
How each step is performed by a processor, comprising:
Processing a connection procedure for a plurality of user terminals;
displaying content provided by an instructor on a first display device;
generating additional content based on at least one of information collected from at least some of the plurality of user terminals, the content, and the instructor's voice data; and
Including displaying the additional content on a second display device,
How to support teaching and learning.
processor; and
A memory electrically connected to the processor and storing at least one code executed by the processor,
When the memory is executed through the processor, the processor
A control signal that processes connection procedures for a plurality of user terminals and instructor terminals, transmits content to the plurality of user terminals, creates a virtual object, and requests the plurality of user terminals or the instructor terminal to display the virtual object. transmitting to the plurality of user terminals or the instructor terminal, and generating additional content based on at least one of information collected from at least some of the plurality of user terminals, the content, and voice data received from the instructor terminal, Storing a code that causes the virtual object to transmit a control signal requesting the plurality of user terminals or the instructor terminal to display the additional content to the plurality of user terminals or the instructor terminal,
Teaching and learning support devices.
According to clause 3,
The memory allows the processor to:
Receiving a plurality of feedback information about content from at least some of the plurality of user terminals, and further storing code that causes the additional content to be generated based on the plurality of feedback information,
Teaching and learning support devices.
According to clause 4,
The memory allows the processor to:
A control signal requesting to receive a plurality of feedback information about a lecture from at least some of the plurality of user terminals and display the information on the plurality of user terminals is transmitted to the plurality of user terminals, and at least some of the plurality of user terminals Receive preference information for the plurality of feedback information, set a priority of the plurality of feedback information based on the preference information, and convert at least some of the plurality of feedback information to the additional content based on the priority. storing more code that causes it to be generated,
Teaching and learning support devices.
According to clause 3,
The memory allows the processor to:
Further storing a code that causes determining when to transmit a control signal requesting to display the additional content to the plurality of user terminals and the instructor terminal,
Teaching and learning support devices.
According to clause 6,
The memory allows the processor to:
Further storing a code that determines when to transmit the additional content to the plurality of user terminals and the instructor terminal based on the voice data received from the instructor terminal or the context of the content,
Teaching and learning support devices.
According to clause 6,
The memory allows the processor to:
Receive a plurality of question information about a lecture from at least some of the plurality of user terminals, calculate a frequency of occurrence of words included in the plurality of question information, and distribute the additional content to the plurality of users based on the frequency of occurrence. Further storing code that causes the terminal and the instructor terminal to determine when to transmit,
Teaching and learning support devices.
According to clause 6,
The memory allows the processor to:
Determining first location information in the content based on the eye movement of the user of the instructor terminal, and determining second location information in the content based on the eye movement of the user of at least some of the plurality of user terminals, Further storing a code that causes determining a time to transmit the additional content to the plurality of user terminals and the instructor terminal based on the similarity of the first location information and the second location information,
Teaching and learning support devices.
According to clause 6,
The memory allows the processor to:
At least some of the plurality of user terminals receive face images of users of the plurality of user terminals, input facial images of the users of the plurality of user terminals into a deep learning-based learning model to determine facial expressions, and determine facial expressions of the users of the plurality of user terminals. Further storing a code that causes determining a time to transmit the additional content to the plurality of user terminals and the instructor terminal based on the facial expressions of the users of the user terminal,
Teaching and learning support devices.
According to clause 3,
The memory allows the processor to:
Further storing a code that causes a word cloud to be generated as the additional content based on voice data received from the instructor terminal or the content,
The word cloud changes according to the progress of the content,
Teaching and learning support devices.
According to claim 11,
The memory allows the processor to:
Determine in the content at least one of a keyword with a high frequency that appears in the voice data received from the instructor terminal, a keyword with a high frequency that appears by analyzing the content, and a keyword included in the word cloud, and the plurality of user terminals further storing code that causes the content to be transmitted with the keyword highlighted,
Teaching and learning support devices.
According to claim 11,
The memory allows the processor to:
Further storing a code that causes the word cloud to be generated as the additional content from the content within a preset range from the currently displayed page of the content in the plurality of user terminals,
Teaching and learning support devices.
processor; and
A memory electrically connected to the processor and storing at least one code executed by the processor,
When the memory is executed through the processor, the processor
Processes a connection procedure for a plurality of user terminals, displays content provided by an instructor on a first display device, and records information collected from at least some of the plurality of user terminals, the content, and the instructor's voice data. generating additional content based on the content and storing code that causes the additional content to be displayed on a second display device,
Teaching and learning support devices.

Images