KR20230139829A - Apparatus for Online Class Service and Driving Method Thereof - Google Patents

Abstract

The present invention relates to an online class service device and a method of driving the device. The online class service device according to an embodiment of the present invention includes metadata related to the background of the class location provided by the instructor terminal device of the instructor conducting the online class. A storage unit that stores bus data, and when a learner taking an online class enters the class location online, the (pre)stored metaverse data is provided to the learner's terminal device as the background of the class location, and the learner's It may include a control unit that controls an artificial intelligence (AI) character teacher who conducts online classes based on learning results to be implemented on the screen of the learner's terminal device.

Description

Online class service device and driving method of the device {Apparatus for Online Class Service and Driving Method Thereof}

The present invention relates to an online class service device and a method of driving the device, and more specifically, to an online class service device and a method of driving the device in which artificial intelligence (AI) and metaverse teaching methods are used in online abacus classes, etc. will be.

In general, the calculation method of subansem, called abacus, was imported from China and greatly influenced the calculation method of the early Joseon Dynasty. Korea's subansem was an exact copy of China's, but Japan imported it and created the current subansem. This type of abacus was widely used, but declined due to its limitations in not being able to perform complex calculations other than the four basic operations and the spread of inexpensive and accurate electronic calculators. However, it has recently been applied to student education.

In other words, abacus education is not only about the four basic calculations, but it also instills memorization, concentration, and confidence in learning, thereby renewing awareness of abacus. In this respect, consumer demands continue to persist in the market even recently.

Korean Patent Publication No. 10-2004-0104215 (December 10, 2004) Korean Patent Publication No. 10-2004-0062924 (2004.07.09) Korea Patent Publication No. 10-2017-0074083 (2017.06.29)

The purpose of the embodiment of the present invention is to provide an online class service device in which artificial intelligence (AI) and a metaverse class method are implemented, such as in an online abacus class, and a method of driving the device.

The online class service device according to an embodiment of the present invention includes a storage unit that stores metaverse data related to the background of the class location provided by the instructor terminal device of the instructor conducting the online class, and a learner taking the online class. When entering the class location online, the stored metaverse data is provided to the learner's terminal device as the background of the class location, and artificial intelligence (AI) conducts the online class based on the learner's learning results. AI) includes a control unit that controls the character teacher to be implemented on the screen of the learner terminal device.

The storage unit may store a video taken of an offline class location as the metaverse data, or store metaverse data produced by the instructor using a template.

The control unit may determine the learner's learning level based on the learner's learning results and control the artificial intelligence character teacher to present a comment matching the determined learning level.

When a plurality of learners participate in the online class, the control unit displays characters matching each of the plurality of learners on the screen of the learner terminal device, and can display the learners' actions by embodying them in the characters.

When an abacus class is conducted as an online class, the control unit may further display the character teacher's electronic abacus and the learner's electronic abacus on the screen.

In addition, the method of driving the online class service device according to an embodiment of the present invention includes a storage unit storing metaverse data related to the background of the class location provided by the instructor terminal device of the instructor conducting the online class, and a control unit. , When a learner taking the online class enters the class location online, the stored metaverse data is provided to the learner's terminal device as the background of the class location, and based on the learner's learning results, It includes controlling the artificial intelligence (AI) character teacher conducting the online class to be implemented on the screen of the learner terminal device.

In the saving step, a video taken of an offline class location may be stored as the metaverse data, or metaverse data produced by the instructor using a template may be stored.

The controlling step may determine the learner's learning level based on the learner's learning results, and control the artificial intelligence character teacher to present a comment matching the determined learning level.

In the controlling step, when a plurality of learners participate in the online class, characters matching each of the plurality of learners are displayed on the screen of the learner terminal device, and the learner's behavior can be implemented and displayed in the character. there is.

The controlling step may further display the character teacher's electronic abacus and the learner's electronic abacus on the screen when the abacus class is conducted as the online class.

According to an embodiment of the present invention, it will be possible to help improve the learning efficiency of learners by creating an atmosphere in the virtual space that is similar to that of actual offline classes during online classes.

In addition, according to an embodiment of the present invention, when taking an abacus class, for example, online in a virtual space, an artificial intelligence character teacher appears to conduct the class, thereby making it possible to interest young students in online classes.

1 is a diagram showing an online class service system according to an embodiment of the present invention;
Figures 2 to 5 are diagrams for explaining various services provided by the online class service device of Figure 1;
Figure 6 is a block diagram illustrating the detailed structure of the online class service device of Figure 1, and
FIG. 7 is a flowchart showing the driving process of the online class service device of FIG. 1.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

Figure 1 is a diagram showing an online class service system according to an embodiment of the present invention, and Figures 2 to 5 are diagrams for explaining various services provided by the online class service device of Figure 1.

As shown in Figure 1, the online class service system 90 according to an embodiment of the present invention is a system that provides services such as abacus learning and games related to abacus, and includes a learner terminal device 100 and an instructor. It includes part or all of the terminal device 105, communication network 110, online class service device 120, and third-party device 130.

Here, “including part or all” means that the electronic abacus service system 90 is configured by omitting some components, such as the instructor terminal device 105, or the components that make up the online class service device 120. This means that part or all of can be integrated and configured into a network device (e.g., wireless switching device, etc.) constituting the communication network 110, and is explained as being entirely included to facilitate a sufficient understanding of the invention.

The learner terminal device 100 is a user terminal device such as a desktop computer, laptop computer, tablet PC, smartphone, or smart TV that constitutes the screen, and an abacus (or electronic abacus) that operates by being wired or wirelessly connected to the user terminal device. ) may include. Of course, the abacus can be provided with a display unit that implements a screen on its own, or it can also be used by connecting only a monitor through a jack, etc., so the embodiment of the present invention is specifically limited to one form. I won't do it.

For example, a user terminal device such as the above computer connects to the online class service device 120 of FIG. 1 and runs a program, such as an application (hereinafter referred to as an app), for using the online abacus service according to an embodiment of the present invention. can be installed. Of course, it may be already installed and provided at the production factory when the product is shipped. Accordingly, the learner runs the corresponding program on the user terminal device and then operates the abacus machine, so that abacus counting data for counting the abacus machine can be provided to the online class service device 120 of FIG. 1. Of course, abacus data according to the learner's abacus is provided to the online class service device 120 through the user terminal device, but if the abacus is equipped with a communication module and performs a data transmission operation on its own, it is directly connected to the communication network 110. Abacus data can be provided to the online class service device 120 via the online class service device 120. Here, the learner's abacus data may be called first abacus data in the embodiment of the present invention. Additionally, abacus data can be viewed as data that includes information about how the abacus balls were placed, for example, on an electronic abacus.

Through the learner terminal device 100, the learner can be provided with various types of service screens provided by the online class service device 120. For example, a screen when a teacher who teaches one's abacus (e.g., AI character teacher, etc.) participates in the class together and the class is conducted 1:1 (see Figures 2 and 4), another teacher and multiple students That is, various screens may be provided, such as a screen when classes are conducted in groups (see FIGS. 3 and 5), a screen when a student plays abacus-related games alone, and a screen when a student plays a game in a group.

Above all, in the embodiment of the present invention, the teacher implemented on the screen of the learner terminal device 100 is implemented as an artificial intelligence character teacher that operates based on artificial intelligence or by executing an artificial intelligence program. Of course, if there is a request from the actual teacher, the teacher's image can be implemented on the screen, but only the actual teacher's image can be implemented on the screen, and the words and actions can be based on the results of artificial intelligence analysis. Since this can be accomplished in various ways depending on the intention of the program designer, the implementation of the present invention will not be particularly limited to any one form.

In other words, a character teacher appears on the screen and leads the class by providing various comments based on the learners' class results as the artificial intelligence program runs. At this time, the artificial intelligence character teacher is programmed to teach through a comment called 'a' in student A's 'a' state (academic level), and this 'a' comment analyzes the class results of various students using artificial intelligence deep learning, etc. Also, based on the analysis results, student A's status is judged to provide accurate comments. Of course, analysis operations, etc. are performed in the online class service device 120 of FIG. 1, and the character teacher operates under the control of the online class service device 120.

The learner terminal device 100 is configured so that all actions can be viewed at a glance on one screen when the teacher, that is, the artificial intelligence character teacher, participates (see FIG. 5). Of course, this operation is possible by creating the corresponding screen in the online class service device 120 of FIG. 1 and transmitting the video. For example, when 60 unit video frames per second are implemented on the screen, all actions are implemented on one screen according to time changes in all unit video frames. For example, when looking at Figure 5, the first area 500 on the upper side shows the class screen, the second area 510 on the upper side can show the (character) teacher's abacus, and the third area 530 in the middle of the screen. A character teacher may appear. In addition, the students' characters and the abacus can be displayed in the fourth area 530 on the left and right sides of the bottom, respectively. In this way, when using the abacus service, all scenes are integrated and displayed on one screen, thereby improving the learner's learning efficiency in relation to abacus.

Above all, the learner terminal device 100 implements students on the screen in the form of characters when classes are conducted in the form of groups as shown in FIG. 5, but the actual words and actions of students can be implemented in the characters. In other words, a character teacher in the form of artificial intelligence conducts the class, but specific students can also ask questions about the class. In this case, when a microphone, etc. operates in the learner terminal device 100, a voice is received through the microphone, and the character is implemented in the form of conversation through the student's character. In this way, services can be provided in various forms. Of course, it can be seen that the voice (signal) is received from the learner terminal device 100, analyzed, and the online class service device 120 controls the learner terminal devices 100 of a plurality of learners in a batch.

Meanwhile, the instructor terminal device 105 includes a user terminal device or an abacus owned by an instructor, that is, a teacher, who conducts abacus-related classes for students through the online class service device 120. Here, since the configuration of the user terminal device or the abacus is not significantly different from the configuration of the learner terminal device 100, further description will be omitted. In addition, in the embodiment of the present invention, for convenience of explanation, it is explained as an abacus class, but it is not intended to be particularly limited to the class.

The instructor terminal device 105 according to an embodiment of the present invention can be divided into a first type of terminal device such as a desktop computer, laptop computer, tablet PC, or smartphone, and a second type of terminal device such as an electronic abacus. there is. The instructor terminal device 105 creates a metaverse environment in a virtual space for online classes, such as an abacus class, that it conducts. For example, if you are running an offline academy, you provide 3D footage of the offline academy to the online class service device 120 so that the corresponding metaverse environment is implemented in the online class room you open. . Of course, this metaverse environment can become the wallpaper of an online class room, and this metaverse wallpaper can also be created and used in the form of a template. In other words, after presenting a plurality of metaverse screens in the form of a template to the instructor terminal device 105, one metaverse screen selected from the plurality of metaverse screens is used as a background screen. Of course, through the instructor terminal device 105, the instructor can additionally create his or her own online class room on the template, and of course, in the process, build his or her own metaverse environment through additional actions such as furniture placement in the template environment to create an online class room. It can be matched to the classroom.

Above all, in the embodiment of the present invention, an artificial intelligence-based character teacher conducts the class, so there may be no intervention by the actual teacher. However, if the actual teacher wishes to intervene in the class, it is possible to participate in the class by transmitting a control command for class intervention to the online class service device 120, so in the embodiment of the present invention, it can be used in any one form. There will be no particular limitation. In this case, the appearance of the artificial intelligence character teacher is changed to that of an actual teacher, and the teacher's voice and actions are directly reflected in the teacher's appearance during class. Of course, the teacher's electronic abacus on the screen also shows the teacher actually calculating using the electronic abacus. In other words, as seen in Figure 5, the second area 510 is a screen implemented based on the actual teacher's counting data on the electronic abacus, and the third area 520, where the artificial intelligence character teacher appears, is the actual teacher's appearance. can show. Since the instructor terminal device 105 is equipped with a microphone and a camera, it is possible to acquire voice and take pictures through this, so it can be seen that the voice and appearance are implemented in real time in the third area 520.

The communication network 110 includes both wired and wireless communication networks. For example, a wired or wireless Internet network may be used or linked as the communication network 110. Here, the wired network includes Internet networks such as cable networks and public switched telephone networks (PSTN), and the wireless communication network includes CDMA, WCDMA, GSM, EPC (Evolved Packet Core), LTE (Long Term Evolution), and Wibro networks. It means including. Of course, the communication network 110 according to an embodiment of the present invention is not limited to this, and can be used as an access network for a next-generation mobile communication system to be implemented in the future, for example, a cloud computing network in a cloud computing environment, a 5G network, etc. For example, if the communication network 110 is a wired communication network, the access point within the communication network 110 can connect to the telephone company's exchange office, etc., but if it is a wireless communication network, it can connect to the SGSN or GGSN (Gateway GPRS Support Node) operated by the communication company to receive data. Data can be processed by connecting to various repeaters such as BTS (Base Transceiver Station), NodeB, and e-NodeB.

Communication network 110 may include an access point. Access points include small base stations such as femto or pico base stations that are often installed in buildings. Here, femto or pico base stations are classified according to the maximum number of learner terminal devices 100 or instructor terminal devices 105 that can be connected, according to the classification of small base stations. Of course, the access point includes a short-distance communication module for performing short-distance communication such as ZigBee and Wi-Fi with the learner terminal device 100 or the instructor terminal device 105. Access points can use TCP/IP or RTSP (Real-Time Streaming Protocol) for wireless communication. Here, in addition to Wi-Fi, short-range communication can be performed using various standards such as Bluetooth, Zigbee, infrared (IrDA), RF (Radio Frequency) such as UHF (Ultra High Frequency) and VHF (Very High Frequency), and ultra-wideband communication (UWB). You can. Accordingly, the access point can extract the location of the data packet, designate the best communication path for the extracted location, and forward the data packet to the next device, for example, the online class service device 120, along the designated communication path. Access points can share multiple lines in a typical network environment and include, for example, routers, repeaters, and repeaters.

The online class service device 120 provides a service to enable classes based on artificial intelligence and metaverse using an electronic abacus, that is, the learner terminal device 100 or the instructor terminal device 105 of FIG. 1. For example, in a virtual space class, the AI teacher assigns problems, provides the correct answers, plays a game, and stores related data, especially in areas where calculations are frequently incorrect, in the DB (120a), etc., and retrieves them from time to time to help specific students continue to learn. An AI character teacher who allows you to learn appears on the screen. In other words, the AI character teacher can be seen as operating based on AI. This is accomplished through the execution of an artificial intelligence program, and is different from classes using conventional avatars in that the AI character teacher conducts classes through two-way communication.

The online class service device 120 allows students to enter the metaverse environment of a virtual space and feel as if they are learning in an actual offline environment. To this end, before providing the service, the online class service device 120 creates a background screen to provide the metaverse service to students, for example, through 3D photography of the interior space of an academy or learning space. This can be a data construction operation for service provision. Although teachers (AI character teachers or real teachers) and students can meet and learn in a virtual space in real time, students can feel the same as taking classes offline at a real academy, which has the effect of psychologically making them more absorbed in class. You can also get

Classes are conducted using the online class service device 120 as well as the student's electronic abacus, that is, the learner terminal device 100 and the abacus on the screen, which are linked and operate in real time. The service can be performed in real time by storing all data in the DB 120a of FIG. 1 and recalling it each time. Figures 2 to 5 show various services provided by the online class service device of Figure 1.

Looking more closely, the online class service device 120 can make an AI character such as Pororo appear on the screen and become a teacher, as can be seen in FIG. 2. The AI character knows how the student moves the abacus (through an artificial intelligence program, etc.) and stores the data in the DB (120a) of the online class service device (120). In particular, it records the student's frequently incorrect calculations. By focusing on related problems, it works to solve problems without incorrect answers in the future. In other words, the online class service device 120 receives the corresponding data when moving the abacus ball in the learner terminal device 100, recognizes the situation, and controls the AI character teacher based on the recognition result. It is possible to know which abacus bead was moved from the learner terminal device 100. In addition, the online class service device 120 or the artificial intelligence character teacher can know the results of a specific student's counting by analyzing data related to the movement of the abacus beads made in the learner terminal device 100, and based on the results, related You can pose questions.

For this operation, the online class service device 120 can program various types of problems for questions in advance and store them in the DB 120a of FIG. 1, and when the result of the above calculation satisfies the preset conditions, Matching questions can be asked. Of course, since the AI character teacher operates based on artificial intelligence, it can recognize the current situation when the question is asked, extract and transmit a voice that matches it, and display the specified action on the screen.

While Figure 2 shows an example of a basic course screen, Figure 3 shows a group study screen. As in Figure 2, the AI character teacher can know the calculations made in a plurality of learner terminal devices 100 through data provided in real time and analysis results of the data, and each learner terminal device 100 has identification information. And since it is possible to know who the student related to the identification information is through pre-stored data, it may be possible for an AI character teacher to conduct classes on the screen. Of course, it is desirable to implement the background of the screen as a metaverse screen. The online class service device 120 implements an AI character teacher on the screen, but it is also possible to take a photo of the actual teacher's face and use it. In addition, students can select a character and have it displayed on the screen, but since it is also possible to take a picture of their own face and use it, the embodiment of the present invention will not be particularly limited to any one form. In the case of Figure 4, an AI character teacher is shown conducting a class on the screen.

Of course, services such as implementing an avatar on the screen and having the avatar conduct a class have been provided in the past. However, this avatar service differs from the embodiment of the present invention in that classes are conducted in one direction according to a designated program. Additionally, the embodiment of the present invention is different in that a learning space such as an actual academy is used as the background screen through the metaverse. Above all, the online class service device 120 according to an embodiment of the present invention enables classes through two-way communication by an AI character teacher. This is because the character teacher conducts classes based on artificial intelligence by analyzing the data of students using the learner terminal device 100 in real time and learning the analysis results. Since the AI character teacher operates based on artificial intelligence, predictive actions are possible depending on the data analysis results. In fact, artificial intelligence is significantly different from existing rule-based services in that it operates based on learning such as deep learning and is therefore predictable. In rule-based services, if the service policy, that is, the set conditions are not met, no results are output to the outside. However, since the embodiment of the present invention analyzes and operates data through learning based on artificial intelligence and outputs it to the outside through prediction, the AI character teacher can transmit the corresponding voice.

For example, the online class service device 120 according to an embodiment of the present invention may implement a screen as shown in FIG. 5 for online service. On the upper side, a class screen in the first area 500 and a teacher abacus screen in the second area 510 may be implemented. And, the teacher character of the Pororo character may be located in the third area 520 in the middle. Of course, since the teacher character operates based on artificial intelligence, the class can be conducted in the same or similar manner as the teacher actually conducting the class offline. Of course, the results of the calculations implemented on the teacher's abacus screen can be implemented offline as the actual teacher's calculations on the screen, but it is also desirable to implement this using artificial intelligence.

In addition, as can be seen in Figure 5, the online class service device 120 implements the characters of students participating in the class and the learner terminal device 100 around them on a screen and monitors the actual students' abacus results. It is implemented in real time on the screen. Above all, the online class service device 120 according to an embodiment of the present invention implements the background screen as a metaverse environment as seen in FIG. 5. In other words, the internal space of a specific offline academy is filmed and a metaverse environment is realized through the filmed video. This metaverse-based background screen can be produced in the form of a template and configured to provide a metaverse screen selected by, for example, an instructor or administrator providing an online service. Settings are made on the service on the metaverse screen selected in the template.

For example, an instructor who conducts an online class related to abacus in the online class service device 120, that is, a teacher, can connect to the online class service device 120 and create a class room to conduct an online class, and at this time, the teacher can access the online class service device 120. can provide metaverse services through settings by providing footage of offline spaces shot in 3D by oneself, but can also provide services based on this by selecting a metaverse screen of a format specified in the template. Of course, if you select and use the metaverse screen of the designated format provided by the online class service device 120, the interior design can be performed directly in the template environment, so various services can be provided through this. For example, when you want to place furniture or flower pots on one side of the class space, interior design can be done on the Metaverse screen by selecting and placing the desired furniture or flower pots on the service screen. In addition, it is possible to implement different background screens, or metaverse environments, when a learner conducts an online class alone and when multiple learners conduct a class. For example, when a learner studies alone as shown in Figure 2 or Figure 4, the metaverse screen selected from the template is provided, and when multiple students participate in the class, a metaverse screen taken from an actual offline academy is provided. Services can be provided in various forms, such as:

As seen in Figure 5, the background screen can be implemented as a background screen of various types of metaverse screens set according to the same process as above. Of course, these background screens may be updated periodically at the teacher's request. However, classes that take place on the metaverse screen can be conducted by an AI-based character teacher, but students participating in the class actually conduct the class through the learner terminal device 100 that they own.

The third-party device 130 may include an administrator device of an administrator who operates the online class service device 120, or a server or computer device of a production company that produces and provides online programs related to abacus learning. In the case of an administrator, he or she accesses the online class service device 120 using the administrator menu address and registers notices necessary for service operation to be displayed on the service screen of users such as learners or instructors, or to display various analysis results related to (big) data analysis. You can also have an administrator check it. Additionally, in the case of a program production company, for example, an operation such as uploading a program can be performed by accessing the online class service device 120, which operates as a server.

Figure 6 is a block diagram illustrating the detailed structure of the online class service device of Figure 1.

As shown in FIG. 6, the online class service device 120 according to an embodiment of the present invention includes a communication interface unit 600, a control unit 610, an online class processing unit 620, and a portion or storage unit 630. includes everything.

The communication interface unit 600 communicates with the learner terminal device 100, the instructor terminal device 105, and the third-party device 130 via the communication network 110 of FIG. 1, respectively. In the process of performing communication, the communication interface unit 600 can perform various operations such as modulation/demodulation, muxing/demuxing, encoding/decoding, and scaling to convert resolution. This is obvious to those skilled in the art, so no further explanation is required. Omit it.

The communication interface unit 600 performs a data construction operation to enable online classes to be conducted through the metaverse and an artificial intelligence character teacher according to communication with the instructor terminal device 105. For example, the metaverse environment related to the online class location can be set up through the instructor terminal device 105 through 3D captured images provided by an instructor who wants to open a class or provide an online class service. Of course, filming of offline class locations is not done through the instructor terminal device 105, but may be filmed and provided through a professional company, so the settings will not be particularly limited to the instructor terminal device 105.

Additionally, the communication interface unit 600 provides online class services in a metaverse environment according to the request of the learner terminal device 100. In accordance with the service request of the learner terminal device 100, an AI character teacher who provides metaverse services and guides learning appears on the screen. The AI character teacher receives real-time feedback on the learner's learning level or current learning status and provides corresponding guidance. For example, when a learner places an abacus ball on an electronic abacus for learning abacus, the status data is provided so that the current state of the abacus ball placed on the electronic abacus can be known. At this time, based on the results of data analysis corresponding to the state, The goal is to ensure that appropriate guidance is provided through AI character teachers. The communication interface unit 600 may be involved in processing such data.

The control unit 610 is responsible for the overall control operation of the communication interface unit 600, online class processing unit 620, and storage unit 630 of FIG. 6. Typically, the control unit 610 sets a program for providing online classes to learners in the online class processing unit 620, and when there is a request from the learner terminal device 100, the program mounted on the online class processing unit 620 is You can provide learning services by running it. Of course, the learning service implements the background screen in the form of a metaverse and introduces an AI character teacher to guide learning.

In addition, the control unit 610 can temporarily store data received in real time from the learner terminal device 100 through the communication interface unit 600 in the storage unit 630, retrieve it, and provide it to the online class processing unit 620. In addition, data in a designated format that is analyzed and processed by the online class processing unit 620 can be provided and systematically classified and stored in the DB 120a of FIG. 1. For this purpose, the control unit 610 controls the communication interface unit 600.

The online class processing unit 620 performs data building operations and data service operations to provide online class services such as abacus learning. The class environment can be built in a metaverse environment, and learning guidance through an AI character teacher can be provided by building an artificial intelligence program. For example, if learner A is programmed to teach with 'a' in situation 'a', the AI character teacher performs teaching actions according to the programming. However, in order to teach 'a', data analysis of various learners is preceded, and of course, analysis using deep learning of artificial intelligence, etc. can be performed in this process. While artificial intelligence in the data analysis stage is intended to increase the accuracy of analysis, the AI character teacher can be seen as providing guidance according to Learner A's questions or learning results in the process of two-way communication with the learner. These operations can be performed in a dual manner, but it is also possible to operate them in an integrated manner. For example, data analysis is done based on rules, but it is also possible for an AI character teacher to operate based on artificial intelligence.

When a 3D video taken inside an offline academy is provided by an instructor or administrator who wants to provide an online class, the online class processing unit 620 constructs the metaverse environment of the class space. In other words, it is provided as a wallpaper. In this process, the metaverse service is provided when the learner enters the class space. Additionally, an AI character teacher appears in the class space. The AI character teacher can conduct a conversation welcoming the learner and guide learning according to programming. Additionally, if a learner has a question during the learning process, the content of the question is analyzed, an answer matching the question is extracted, and the AI character teacher can answer the question. The online class processing unit 620 can guide the learner's learning like an actual teacher by analyzing and learning data collected during the course of the class.

Since the amount of learning data in the online class processing unit 620 continues to increase, free learning guidance is provided according to the learning results, except in the case of specified answers. For example, if the same conditions are satisfied in the process of providing learning guidance, the online class processing unit 620 can provide a corresponding answer, that is, guidance. However, even if there are no exactly matching conditions, guidance can be performed based on prediction, and in this respect, guidance is provided through an AI character teacher. In this respect, it is distinct from existing rule-based movements and can be seen as distinct from the existing avatar-type teaching method. Of course, when there is problem solving in the avatar's class, it is set based on rules simply for whether the result of the problem solving is correct or incorrect. However, if a new movement is performed other than that, it may be practically impossible to teach the class if there is no prior setting in this regard.

For example, the online class processing unit 620 can conduct classes by an AI character teacher with a plurality of learners participating, as shown in FIG. 5. Many learners can perform various types of queries, and it is realistically impossible to preset all of the learners' expected queries in advance. However, the online class processing unit 620 according to an embodiment of the present invention accumulates data acquired while conducting online classes to form big data and generates analysis results through analysis such as deep learning of artificial intelligence. Through this, when there are various questions from multiple learners, it is possible to find similar conditions and provide answers through prediction. Through this process, classes can be conducted through AI character teachers. For example, when the online class processing unit 620 determines that learner A performs counting using an electronic abacus differently from other learners, it recognizes this situation through artificial intelligence and corrects learner A's counting incorrectly through the AI character teacher. It can be pointed out that it has been done.

The storage unit 630 may temporarily store data processed under the control of the control unit 610. When a captured video for building a metaverse environment is provided from the instructor terminal device 105 of FIG. 1, the storage unit 630 temporarily stores it and then outputs it to the online class processing unit 620 at the request of the control unit 610. can do. In addition, when a metaverse screen in the form of a template is provided from the online class processing unit 620 at the request of the instructor terminal device 105, the storage unit 630 provides information about the metaverse screen when the instructor selects a specific metaverse screen from the template. The data can be temporarily stored and then provided to the online class processing unit 620 so that the metaverse environment can be set accordingly.

In addition to the above, the communication interface unit 600, control unit 610, online class processing unit 620, and storage unit 630 of FIG. 6 can perform various operations, and other details have been sufficiently explained previously. I want to replace it with fields.

The communication interface unit 600, control unit 610, online class processing unit 620, and storage unit 630 of FIG. 6 according to an embodiment of the present invention are composed of hardware modules that are physically separated from each other, but each module has an internal It will be possible to store software to perform the above operations and execute it. However, the software is a set of software modules, and each module can be formed of hardware, so there will be no particular limitation on the configuration of software or hardware. For example, the storage unit 630 may be hardware, such as storage or memory. However, since it is possible to store information through software (repository), the above content will not be specifically limited.

Meanwhile, as another embodiment of the present invention, the control unit 610 may include a CPU and memory, and may be formed as a single chip. The CPU includes a control circuit, an arithmetic unit (ALU), an instruction interpretation unit, and a registry, and the memory may include RAM. The control circuit performs control operations, the operation unit performs operations on binary bit information, and the command interpretation unit includes an interpreter or compiler, which can convert high-level language into machine language and machine language into high-level language. , the registry may be involved in software data storage. According to the above configuration, for example, at the beginning of the operation of the online class service device 120, the data operation processing speed is increased by copying the program stored in the online class processing unit 620, loading it into memory, that is, RAM, and then executing it. It can increase quickly. In the case of deep learning models, they can be loaded into GPU memory rather than RAM and executed by accelerating the execution speed using GPU.

FIG. 7 is a flowchart showing the driving process of the online class service device of FIG. 1.

For convenience of explanation, referring to FIG. 7 together with FIG. 1, the online class service device 120 according to an embodiment of the present invention provides information related to the background of the class location provided by the instructor terminal device 105 of the instructor conducting the online class. Save metaverse data (S700). Here, the metaverse data related to the background of the class location is used to provide the feeling of being at a real academy offline when entering the class location in a virtual space. Therefore, this may be called a background screen in the video.

This metaverse environment can be formed using footage provided by instructors, etc. through 3D filming of actual offline locations, and can be created by selecting one of the various background metaverse screens produced in advance as templates and creating the corresponding metaverse screen. A metaverse environment of a virtual space for a class location can be created in various ways, such as providing a virtual space.

In addition, the online class service device 120 provides (pre)stored metaverse data to the learner terminal device 100 as the background of the class location when a learner taking an online class enters the class location online. And, the artificial intelligence character teacher who conducts online classes based on the learner's learning results is controlled to be implemented on the screen of the learner's terminal device (S710).

And the online class service device 120 can provide learning guidance through an AI character teacher based on the learner's learning results. Here, the AI character teacher's learning guidance can be viewed as a feedback action on the learner's learning results. In this way, the AI character teacher leads learning according to a preset method, but in the process, performs actions such as providing various comments based on the learner's learning results. Of course, such comments may be rule-based comments, but they may also be provided based on analysis results of data from various learners. For example, abacus may have levels. Therefore, when providing comments, the AI character teacher can be seen as guiding learning by operating based on artificial intelligence, such as providing comments based on the data analysis results of learners in the same grade rather than all learners.

In addition to the above, the online class service device 120 of FIG. 1 can perform various operations, and other details have been sufficiently explained previously, so these will be replaced.

Meanwhile, even though all the components constituting the embodiment of the present invention are described as being combined or operating in combination, the present invention is not necessarily limited to this embodiment. That is, as long as it is within the scope of the purpose of the present invention, all of the components may be operated by selectively combining one or more of them. In addition, although all of the components may be implemented as a single independent hardware, a program module in which some or all of the components are selectively combined to perform some or all of the combined functions in one or more pieces of hardware. It may also be implemented as a computer program having. The codes and code segments that make up the computer program can be easily deduced by a person skilled in the art of the present invention. Such computer programs can be stored in non-transitory computer readable media and read and executed by a computer, thereby implementing embodiments of the present invention.

Here, a non-transitory readable recording medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. . Specifically, the above-described programs may be stored and provided on non-transitory readable recording media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, etc.

In the above, preferred embodiments of the present invention have been shown and described, but the present invention is not limited to the specific embodiments described above, and may be used in the technical field to which the invention pertains without departing from the gist of the invention as claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be understood individually from the technical idea or perspective of the present invention.

100: Learner terminal device 105: Instructor terminal device
110: Communication network 120: Online class service device
130: Third party device 600: Communication interface unit
610: Control unit 620: Online class processing unit
630: storage unit

Claims (10)

A storage unit that stores metaverse data related to the background of the class location provided by the instructor terminal device of the instructor conducting the online class; and
When a learner taking the online class enters the class location online, the stored metaverse data is provided to the learner's terminal device as the background of the class location, and the learner's learning results are based on the learner's learning results. A control unit that controls to implement an artificial intelligence (AI) character teacher conducting online classes on the screen of the learner terminal device;
Online class service device, including: According to paragraph 1,
The storage unit is an online class service device that stores captured images of offline class locations as the metaverse data, or stores metaverse data produced by the instructor using a template. According to paragraph 1,
The control unit determines the learner's learning level based on the learner's learning results, and controls the artificial intelligence character teacher to present a comment matching the determined learning level. According to paragraph 1,
The control unit, when a plurality of learners participate in the online class, displays characters matching each of the plurality of learners on the screen of the learner terminal device, and implements the learner's behavior into the character to display the online class service. Device. According to paragraph 4,
The control unit is an online class service device that further displays the character teacher's electronic abacus and the learner's electronic abacus on the screen when an abacus class is conducted as the online class. A storage unit storing metaverse data related to the background of the class location provided by the instructor terminal device of the instructor conducting the online class; and
When a learner taking the online class enters the class place online, the control unit provides the stored metaverse data as a background of the class place to the learner's terminal device, and records the learner's learning results. Based on this, controlling the artificial intelligence (AI) character teacher conducting the online class to be implemented on the screen of the learner terminal device;
A method of operating an online class service device, including: According to clause 6,
The saving step is,
A method of driving an online class service device that stores a video taken of an offline class location as the metaverse data or stores metaverse data produced by the instructor using a template. According to clause 6,
The controlling step is,
A method of driving an online class service device that determines the learner's learning level based on the learner's learning results and controls the artificial intelligence character teacher to present a comment matching the determined learning level. According to clause 6,
The controlling step is,
When a plurality of learners participate in the online class, a character matching each of the plurality of learners is displayed on the screen of the learner terminal device, and the behavior of the learner is implemented in the character and displayed. . According to clause 9,
The controlling step is,
When an abacus class is conducted as the online class, a method of driving an online class service device that further displays the character teacher's electronic abacus and the learner's electronic abacus on the screen.