KR102561352B1 - Method and device for providing virtual lecture space - Google Patents

Abstract

A method of providing a virtual lecture space, comprising: displaying a first avatar that operates in conjunction with a lecturer's account and operates by sensing a lecturer's movement; Displaying an execution screen of a first program executed in a first device used to log in the lecturer account; displaying a second avatar that operates in conjunction with the student's account and operates by sensing the student's movement; displaying an execution screen of a second program executed on a second device used to log in the student account; and displaying a virtual blackboard providing an image obtained based on the lecturer's motion.

Description

Method and device for providing virtual lecture space in which an efficient communication environment is implemented

The present disclosure relates to a method and device for providing a virtual lecture space.

Along with the development of the Internet and communication technology, we have developed a virtual space that can overcome physical limitations while minimizing time and space constraints for environments that require multilateral mutual communication such as various existing lectures, conferences, conferences, experiments, and practices. Needs have been continuously increasing, and various technologies are being actively developed accordingly.

Accordingly, many companies around the world are providing services for communication using multi-party video calls, but such conventional services are currently experiencing psychological anxiety due to the environment in which many people are watching their videos, There are various problems that occur in a video call environment, such as excessive mental fatigue to understand the other party's non-verbal cues and reduced concentration due to technical communication delays.

In addition, while using a conventional service such as a multiperson video call, a function that allows participants to display materials (eg, reference videos or images) related to an ongoing lecture or meeting to utilize the ongoing lecture or meeting, and participants' motions Alternatively, functions for communication for various purposes that can easily grasp the current state of participants by displaying the current state (eg, drowsy state or recording function execution state) determined by sensing a gesture, etc. are not provided through conventional services. There is a problem that it is difficult to communicate smoothly between participants.

Accordingly, a more efficient lecture or conference can be conducted by displaying and providing related materials among participants, and an efficient communication environment in which participants can more easily recognize the current state of each other by displaying images related to the current state of the participants. There is a need for a method and device for providing this implemented virtual space.

An object according to an embodiment of the present disclosure to solve these conventional problems is to display an avatar that operates by sensing the motions of a plurality of participants participating in a virtual lecture space, and to display an image obtained based on the lecturer's motion. It is an object of the present invention to provide a method and device for providing a virtual lecture space that minimizes the mental/physical burden caused by the conventional method of attending through a real user's video image by displaying a virtual blackboard provided.

The objects of the present disclosure are not limited to the objects mentioned above, and other objects not mentioned will be clearly understood from the description below.

As a technical means for achieving the above-described technical problem, according to a first aspect of the present disclosure, in a method for providing a virtual lecture space, a first avatar that operates in conjunction with a lecturer's account and operates by sensing the lecturer's movement displaying; Displaying an execution screen of a first program executed in a first device used to log in the lecturer account; displaying a second avatar that operates in conjunction with the student's account and operates by sensing the student's movement; displaying an execution screen of a second program executed on a second device used to log in the student account; and displaying a virtual blackboard providing an image obtained based on the movement of the lecturer.

The method may further include, when the recording function is executed in the second device, displaying an image indicating that the recording function is being executed in an area adjacent to the second avatar.

In addition, displaying a virtual experiment object generated based on the lecturer's motion; and updating and displaying the shape of the virtual experiment object according to the movement of the lecturer and the movement of the student.

In addition, the first avatar, the execution screen of the first program, the second avatar, the execution screen of the second program, and the virtual blackboard are displayed in 2D or 3D according to the environment of the device in which the virtual lecture space is provided. It can be.

Also, the first program may be executed by sensing the movement of the lecturer, and the second program may be executed by sensing the movement of the student.

In addition, the execution screen of the first program may be displayed in a first item that operates in conjunction with the first avatar, and the execution screen of the second program may be displayed in a second item that operates in association with the second avatar. there is.

The method may further include displaying the first avatar or the second avatar based on a viewpoint determined according to a movement of a user of a third device providing the virtual lecture space.

In addition, the displaying of the second avatar may display repetitive movements of preset body parts of the second avatar based on continuity of data transmitted and received between the second device and the third device in real time.

In addition, in the displaying of the second avatar, an image representing the student's attendance status may be displayed in an area adjacent to the second avatar based on a gaze direction determined according to a result of eyeball monitoring of the student.

According to a second aspect of the present disclosure, in a device for providing a virtual lecture space, a first device operating in conjunction with a lecturer account and a second device operating in conjunction with a student account receive and process lecture provision data processor; And based on the lecture provision data, a first avatar that operates in conjunction with the lecturer's account and operates by sensing the lecturer's movement, and an execution screen of the first program executed on the first device used to log in the lecturer's account. , A second avatar that operates in conjunction with the student account and operates by sensing the student's movement, a second program running on the second device used to log in the student account, and based on the lecturer's movement It is possible to provide a device including; a display for displaying a virtual blackboard providing an acquired image.

In addition, the display may display a virtual experiment object generated based on the lecturer's movement, and update and display the shape of the virtual experiment object according to the lecturer's movement and the student's movement.

In addition, the display displays the first avatar, the execution screen of the first program, the second avatar, the execution screen of the second program, and the virtual blackboard in a 2D or 2D format according to the environment of the device in which the virtual lecture space is provided. It can be displayed in 2D.

Also, the first program may be executed by sensing the movement of the lecturer, and the second program may be executed by sensing the movement of the student.

In addition, the execution screen of the first program may be displayed in a first item that operates in conjunction with the first avatar, and the execution screen of the second program may be displayed in a second item that operates in association with the second avatar. there is.

Also, the display may display the first avatar or the second avatar based on a viewpoint determined according to a movement of a user of the third device providing the virtual lecture space.

Also, the display may display repetitive motions of preset body parts of the second avatar based on continuity of data transmitted and received between the second device and the third device in real time.

Also, the display may display an image representing the student's attendance status in an area adjacent to the second avatar based on a gaze direction determined according to a result of eyeball monitoring of the student.

According to the third aspect of the present disclosure, it is possible to provide a computer-readable recording medium on which a program for executing the method of the first aspect is recorded on a computer.

According to an embodiment of the present disclosure, it is possible to display avatars that operate by sensing motions of participants, thereby minimizing psychological anxiety compared to the conventional video call method.

In addition, an active and efficient virtual lecture opportunity can be provided by displaying a virtual experiment object generated based on the lecturer's movement and updating and displaying the shape of the virtual experiment object according to the movement of the lecturer and the students.

In addition, by displaying an image representing the student's current class status based on the student's eye monitoring result,

The effects of the present disclosure are not limited to the above effects, and should be understood to include all effects that can be inferred from the configuration of the invention described in the detailed description or claims of the present disclosure.

1 is a block diagram schematically illustrating the configuration of a device for providing a virtual lecture space according to an embodiment of the present disclosure.
2 is a flowchart illustrating each step of providing a virtual lecture space through a device for providing a virtual lecture space according to an embodiment of the present disclosure.
3 is a diagram schematically illustrating an example in which a virtual lecture space is provided according to an embodiment of the present disclosure.
4 is a diagram schematically illustrating an example of each avatar displayed according to an embodiment of the present disclosure.
5 is a diagram schematically illustrating an example of displaying each avatar according to a user's movement of a third device according to an embodiment of the present disclosure.
6 is a schematic diagram illustrating an example of displaying a virtual experiment object according to an embodiment of the present disclosure.
7 is a schematic diagram illustrating an example of displaying a virtual experiment object according to an embodiment of the present disclosure.
8 is a diagram schematically illustrating a customized design of a virtual lecture space according to an embodiment of the present disclosure.
9 is a diagram schematically illustrating a customized design of a virtual lecture space according to an embodiment of the present disclosure.

Hereinafter, the present invention will be described with reference to the accompanying drawings. However, the present invention can be implemented in many different forms, and therefore is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only the case where it is "directly connected" but also the case where it is "indirectly connected" with another member interposed therebetween. . In addition, when a part "includes" a certain component, it means that it may further include other components without excluding other components unless otherwise stated.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

In the following specification, all activities performed in a virtual lecture space are limited to 'lecture' to describe embodiments, but are not necessarily limited thereto. For example, all activities performed in the virtual lecture space described in the embodiments may include various activities such as meetings, work, conferences, seminars, experiments, and practice other than lectures.

1 is a block diagram schematically illustrating a configuration of a device 100 for providing a virtual lecture space according to an embodiment of the present disclosure.

Referring to FIG. 1, a device 100 providing a virtual lecture space is a processor that receives and processes lecture provision data from a first device that operates in conjunction with a lecturer account and a second device that operates in conjunction with a student account ( 110) and a first avatar 310 that operates in conjunction with the lecturer's account and operates by sensing the lecturer's movement based on the lecture provision data, and a first that is executed on the first device used to log in the lecturer's account. Execution screen of 1 program, second avatar 320 operating in conjunction with the student's account and operating by sensing the student's movement, execution screen of the second program executed on the second device used to log in the student's account and a display 120 displaying a virtual blackboard providing an image obtained based on the lecturer's motion.

The device 100 providing a virtual lecture space according to an embodiment may implement the virtual lecture space as a customized lecture room design. For example, referring to FIGS. 8 and 9 , by applying digital photos of 6 sides of an arbitrary place including a lecture room or conference room to a virtual lecture space, the corresponding place can be implemented in a virtual lecture space. However, it is not necessarily limited to an image of a real place, and may be implemented as an image that can be expressed in a virtual lecture space. Accordingly, it is possible to create various types of virtual classrooms for an efficient lecture environment.

According to an embodiment, a lecturer account may be granted various rights (eg, creation and modification of a virtual experiment object 610 based on a lecturer's movement) for conducting a lecture in a virtual lecture space, and these rights may be given to the lecturer. may be given differently from It can be used to access with a lecturer's authority to conduct a lecture within a virtual lecture space. In addition, the lecturer's account may be interlocked with the first avatar 310 that operates by sensing the movement of the lecturer conducting the lecture. As such, the lecturer's authority is granted differently from the learner's, so that more smooth and efficient lectures are possible.

The first avatar 310 according to an embodiment may operate in conjunction with a lecturer's account and may operate by sensing a lecturer's movement. For example, the first avatar 310 can be displayed in the form of a 3D modeled avatar through the sensed shape of a lecturer, and includes all avatars expressed in 2D and 3D, such as animal avatars and cartoon avatars, in addition to human shapes so that it can be displayed. In another embodiment, the device 100 providing a virtual lecture space may customize the 3D modeling avatar based on the selection input for the 3D modeled avatar through the shape of the lecturer. In this case, it is possible to customize the avatar according to the lecture or customize the avatar suitable for one's own taste, so that the range of utilization of the virtual lecture can be widened.

In addition, the first avatar 310 operates by sensing the lecturer's movement from the device 100 that provides a virtual lecture space through a common means capable of sensing human movement, such as a VR device, an AR environment, or a motion sensor. can do. Accordingly, it is possible to implement natural movements of a lecturer and students in a virtual lecture space.

The first device according to an embodiment can be used to log in to a lecturer's account, and can also be used for various activities (eg, virtual blackboard display, video playback, image loading, etc.) performed in a virtual lecture space. That is, it may be a PC, a smart device, etc. used to use a virtual lecture space.

The first program according to an embodiment may be executed in the first device, and the device 100 providing a virtual lecture space including the first device may display an execution screen of the first program. The first program may be, for example, any software program used in PCs and smart devices, such as a document creation program including a Word document creation program, a video playback program, and an image loading program.

According to an embodiment, the student account may be a student account for taking a lecture in a virtual lecture space, and various rights granted in the virtual lecture space (eg, part of the virtual experiment object 610 based on the lecturer's movement). transformation) can be given. In addition, the student account may be interlocked with the second avatar 320 that operates by sensing the movement of the student taking the lecture. The authority of the student can be applied to the lecture more cooperatively by being granted differently from the lecturer.

The second avatar 320 according to an embodiment may operate in conjunction with a student account and may operate by sensing a student's movement. For example, the second avatar 320 can be displayed in the form of a 3D modeled avatar through the sensed student's shape, and includes all avatars expressed in 2D and 3D, such as animal avatars and cartoon avatars, in addition to human shapes. so that it can be displayed. In another embodiment, the device 100 providing a virtual lecture space may customize a 3D modeling avatar based on a selection input for a 3D modeled avatar through a student's shape. In this case, it is possible to customize the avatar according to the lecture or customize the avatar suitable for one's own taste, so that the range of utilization of the virtual lecture can be widened.

In addition, the second avatar 320 operates by sensing a student's movement from the device 100 providing a virtual lecture space through a common means capable of sensing a person's movement, such as a VR device, an AR environment, or a motion sensor. can do. Accordingly, it is possible to implement natural movements of a lecturer and students in a virtual lecture space.

The second device according to an embodiment can be used to log in to a student account, and can also be used for various activities (eg, virtual blackboard display, video playback, image loading, etc.) performed in a virtual lecture space. That is, it may be a PC, a smartphone, etc. used to use a virtual lecture space.

In one embodiment, the first device and the second device may be interconnected and communicate through a communication environment (eg, Wi-Fi, Bluetooth, or various local/long-range network environments).

In one embodiment, the first avatar 310 and the second avatar 320 may perform interactions for communication within a virtual lecture space. For example, the interaction may include all interactions required in a lecture environment, such as emotional expressions including greetings, high fives, and head shaking, conversation functions according to the distance between avatars, inquiry requests, and break requests. Accordingly, a lecturer and students can utilize interactions implemented in virtual reality while performing interactions performed in a real lecture environment, so that a more efficient lecture environment can be provided.

The second program according to an embodiment may be executed on the second device, and the device 100 providing a virtual lecture space including the second device may display an execution screen of the second program. The second program may be, for example, any software program used in PCs and smart devices, such as a document creation program including a Word document creation program, a video playback program, and an image loading program.

The device 100 providing a virtual lecture space according to an embodiment may display a virtual blackboard providing images obtained based on a lecturer's movement. This virtual blackboard can display 0, 1, 2, and 3D images such as points, lines, planes, and three-dimensional figures, which are images acquired based on the lecturer's movements in a virtual lecture space, and display the execution screen of the first program. And an image obtained according to the lecturer's touch input to the first device may be displayed. In addition, the virtual blackboard may display an execution screen of a first program executed on a first device and an execution screen of a second program executed on a second device.

According to an embodiment, the device 100 providing a virtual lecture space may provide access status and connection time information of participants including the lecturer and the students to the lecturer's account. In addition, the device 100 providing a virtual lecture space may provide homework, assignment submission, and a related communication system of a student's account to the lecturer's account. Accordingly, lecturers can easily manage virtual lectures through the provided homework, assignment status and notification of submission, and a corresponding communication system (e.g., delivery of detailed assignment details), and access status and access time information of provided participants. Through this, lecturers can more efficiently operate meeting rooms and discussion rooms for team projects, laboratory operations for experiments, and virtual classrooms.

According to an embodiment, the device 100 providing a virtual lecture space may build and provide a special purpose lecture room for science and engineering experiments and practices. Specifically, referring to FIGS. 6 and 7 , the device 100 providing a virtual lecture space may provide a special-purpose lecture room through simulation software for various experiments and practices. Experimental devices and tools necessary for this may be implemented and provided through rendering.

In another embodiment, the device 100 providing a virtual lecture space may provide a virtual space for seminars and conferences. Virtual space for seminars and conferences can utilize all functions provided in virtual classrooms (e.g. virtual space custom design, virtual blackboard, software program linkage, hardware linkage and participant information check, etc.), and can be used for voting, posters, general meetings, seminars , It is possible to implement and provide optimized spaces for actual external venues (e.g., seminars and event halls, poster presentation halls, discussion halls, regional convention centers, venues based on sponsors' logos and promotions, etc.).

In addition, the device 100 providing a virtual lecture space allows only participant accounts registered as members to participate in events such as seminars and conferences through the membership system, payment system, and log-in/out function used for seminars and conferences. In addition, when using the virtual space for real-time access participant information, question and answer and communication functions, and corporate publicity purposes, a virtual company promotion booth and virtual monitor can be provided. In particular, when using a virtual space for corporate publicity purposes, promotional booths, pamphlets, products, etc. of promotional companies can be provided in 3D and video, and depending on the number of 3D products and the size and number of video monitors, the number of booths of participating companies It can be implemented so that size and price can be adjusted.

The foregoing will be described in more detail with reference to the drawings below.

2 is a flowchart illustrating each step of providing a virtual lecture space through the device 100 for providing a virtual lecture space according to an embodiment of the present disclosure.

Referring to FIG. 3 for step S210, the device 100 for providing a virtual lecture space according to an embodiment shows a first avatar 310 that operates in conjunction with a lecturer's account and operates by sensing the lecturer's movement. can be displayed as shown in

According to an embodiment, the device 100 providing a virtual lecture space may display the first avatar 310 by 3D rendering the real appearance of the lecturer as shown in FIG. As shown, it is possible to display an arbitrary avatar that is not the actual appearance of the lecturer. This arbitrary avatar may be an avatar registered in the device 100 that provides a virtual lecture space through a lecturer account or a student account, and may be a basic avatar provided by the device 100 that provides a virtual lecture space. may be

According to an embodiment, the device 100 providing the virtual lecture space in FIG. 4 may display a 2D or 3D outline 410 indicating that the first avatar 310 is a lecturer. The additional outline 410 is formed along the outline of the first avatar 310, and may include a color and shape that are easy for other students to recognize that the first avatar 310 is the lecturer's avatar.

In step S220, the device 100 providing a virtual lecture space according to an embodiment may display an execution screen of a first program executed on a first device used to log in a lecturer account.

This first program may be executed by sensing the movement of the lecturer. Specifically, the device 100 providing a virtual lecture space may acquire the motion of the lecturer sensed through a common means capable of sensing the motion of a person, such as a VR device, an AR environment, or a motion sensor. A first program that includes all software programs used in PCs and smart devices, such as a document creation program, video playback program, and image loading program, including a Word document creation program that is executed on the first device through the lecturer's movements (eg, gestures) may be executed by sensing the movement of the lecturer. Also, the execution screen of the first program may be displayed on the first item 330 including a virtual blackboard. Accordingly, the student can more easily convey the contents of the lecture to the participants.

Also, the execution screen of the first program may be displayed in the first item 330 that operates in conjunction with the first avatar 310 . Specifically, the first item 330 according to an embodiment includes a virtual blackboard as shown in FIG. 3, may include items that can be implemented in a virtual lecture space, such as a virtual monitor, and the movement of the lecturer. It can be created or deleted by sensing. That is, the first item 330 may be a virtual item capable of displaying an execution screen of the first program.

In step S230, the device 100 providing a virtual lecture space according to an embodiment may display a second avatar 320 that operates in conjunction with a student account and senses a student's movement.

According to an embodiment, the device 100 providing a virtual lecture space may display the second avatar 320 by 3D rendering the actual appearance of the student as shown in FIG. 3, but as shown in FIG. As shown, it is possible to display an arbitrary avatar that is not the student's actual appearance. Such an arbitrary avatar may be an avatar registered in the device 100 providing a virtual lecture space through a student's account, or may be a basic avatar basically provided by the device 100 providing a virtual lecture space.

According to an embodiment, the device 100 providing a virtual lecture space may further include a third device providing a virtual lecture space. This third device may be a device used to log in to a student's account.

Also, according to an embodiment, the device 100 providing a virtual lecture space generates a first avatar 310 or a second avatar based on a viewpoint 520 determined according to the movement of the user 510 of the third device. (320) can be displayed.

Specifically, the viewpoint 520 determined according to the movement of the user 510 of the third device may be determined based on the movement (or viewpoint) of the user 510 of the third device in a virtual lecture space. In this regard, referring to FIG. 5 , the view point 520 can be understood as a first-person observer point of view, which is the point of view of the user 510 of the third device, as shown in the drawing, and the point of view of the user 510 of the third device. It may be determined according to the movement (movement of the first-person observer's point of view), and the first avatar 310 or the second avatar 320 may be displayed based on the viewpoint 520 .

The device 100 providing a virtual lecture space according to an embodiment repetitively moves a preset body part 420 of a second avatar based on continuity of data transmitted and received between a second device and a third device in real time. can display.

Specifically, referring to FIG. 4 , the device 100 providing a virtual lecture space determines a preset body part 420 of the second avatar based on whether or not data is continuously transmitted and received from the second device and the third device. Repetitive movements can be displayed. For example, as shown in the drawing, when the second avatar 320 is in the shape of a rabbit, the movements of rabbit ears, which are preset body parts, are repeatedly displayed, and when silence occurs during a lecture, the second avatar 320 repeatedly displays the movement of rabbit ears. Through human movement, it is possible to determine whether a technical problem has occurred. As another example, if the second avatar 320 has a human shape including a student's shape, the movement of the shoulder, which is a predetermined body part, may be repeatedly displayed.

The device 100 for providing a virtual lecture space according to an embodiment includes an image 360 indicating the student's class attendance status in an area adjacent to the second avatar 320 based on the gaze direction determined according to the student's eye monitoring result. can display.

Specifically, the student's eye monitoring result may be obtained from a second device or a camera included in the device 100 providing a virtual lecture space, and the student's gaze direction determined according to the obtained eyeball monitoring result is a preset direction. If it is determined as , it can be understood that the student's current state is relatively low in concentration on the lecture. The device 100 providing a virtual lecture space may determine the student's class attendance status based on the gaze direction determined according to the result of eyeball monitoring of the student, and display an image 360 representing the student's class attendance status as the second avatar 320. ) and can be displayed in an adjacent area.

In more detail, the device 100 for providing a virtual lecture space determines the class attendance status of the second avatar 320 based on a predetermined number of times, which is the number of times that the student's gaze direction determined according to the result of eyeball monitoring of the student is determined to be a predetermined direction. may be determined as a preset state, and an image 360 representing the student's attendance status may be displayed based on the determined class attendance status. Through this, other participants can easily grasp the current student's enrollment status.

For example, if the number of times that the student's gaze direction is determined as the preset direction is equal to or less than the first number of times, the device 100 providing a virtual lecture space may determine the student's attendance status as the first status. In addition, when the number of times the gaze direction is determined to be the preset direction is equal to or greater than the second number and is less than the third number, the student's attendance status may be determined to be the second status, and the number of times the gaze direction is determined to be the preset direction is equal to or greater than the third number. , the student's attendance status may be determined as the third status. Here, the first number may be smaller than the second number, the second number may be smaller than the third number, and the first number may be greater than zero. In addition, the first state may be, for example, a state in which the user is properly focused on the corresponding lecture, and thus may be a 'high level of concentration' state. The second state may be a relatively low level of concentration compared to the 'high level of concentration' state and thus may be a 'moderate level of concentration' state, and the third state may be a level of relatively low level of concentration compared to the level of 'normal level of concentration' state. Therefore, it can indicate a state of 'low concentration'.

That is, as the number of times that the student's gaze direction is determined as the preset direction increases, the student's concentration can be understood as a low state, so the device 100 providing a virtual lecture space determines the student's gaze direction as the preset direction. Based on the number of occurrences, the student's attendance status may be determined as a preset status, and based on the determined student's attendance status, an image 360 representing the student's attendance status may be displayed in an area adjacent to the second avatar 320. can

In another embodiment, the device 100 providing a virtual lecture space is configured to provide a virtual lecture space when the eyeball monitoring result obtained from the lecturer determines that the time during which the eyes are not sensed is equal to or longer than a preset time. ) may determine the student's attendance status as 'absent', and based on this, an image representing the absence status may be displayed in an area adjacent to the second avatar 320 .

In another embodiment, as a result of monitoring the student's eyeballs, when a pattern according to the time in which the eyeballs are sensed is determined as a preset pattern, the device 100 providing a virtual lecture space may determine the student's student's student's student's sleepy state as a drowsy state. . Such a preset pattern may be a pattern in which an eyeball blink pattern appears in a typical drowsy state. The device 100 providing a virtual lecture space may determine the student's attendance status based on the eyeball sensing result, and based on the determined student's attendance status, an image indicating a drowsy state is displayed in an area adjacent to the second avatar 320 . can display.

The device 100 for providing a virtual lecture space according to an embodiment monitors the pupil's eyeballs with a camera of a second device, and generates a preset body part 420 of a second avatar based on a gaze direction determined according to the monitoring. It is possible to determine the speed of repetitive movement (or the speed of movement of parts representing the body).

Specifically, referring to FIG. 4 , the device 100 for providing a virtual lecture space shows a student's eye monitoring result, a second device (or a monitor in the virtual lecture space, a virtual blackboard, a first item 330). )))), that is, when the student's gaze direction is determined in a preset direction, which is a direction with low relevance to the lecture, when the time determined is determined to be a preset time range, based on this, a preset body part of the second avatar ( 420) may determine the speed of the repetitive motion as a preset speed. The preset body part 420 may be a body part that exists in humans (eg, a shoulder, a leg, etc.) or may be a body part that does not exist in humans (eg, a tail). When a body part that does not exist in humans is used as the preset body part 420 as , the device 100 providing a virtual lecture space can more easily and interestingly indicate the degree of concentration of the user.

For example, the device 100 providing a virtual lecture space may perform a predetermined body movement of the second avatar when the time when the student's gaze direction is determined to be in the preset direction is greater than or equal to a first time and less than a second time, which is a preset time range. The speed of the repetitive movement of the part 420 (eg, shoulder, tail, etc.) may be determined as the first speed, and the time when the student's gaze direction is determined to be the preset direction is the preset time range of the second time or longer. If it is less than the time, the speed of the repetitive movement of the second avatar's preset body part 420 may be determined as the third speed, and the time when the student's gaze direction is determined to be the preset direction is the third time, which is the preset time range. In this case, the speed of the repetitive movement of the preset body part 420 of the second avatar may be determined as the third speed. Here, the first time may be less than the second time, the second time may be less than the third time, and the first time may be a value greater than zero. Also, the first speed may be higher than the second speed, and the second speed may be higher than the third speed.

That is, the longer the time when the student's gaze direction is determined in the preset direction, the slower the speed of the repetitive movement of the preset body part 420 of the second avatar representing the degree of concentration of the student's current lecture is determined so that the lecturer can determine the student's concentration in the lecture. The degree can be easily recognized.

In step S240, the device 100 providing a virtual lecture space according to an embodiment may display an execution screen of a second program executed on a second device used to log in a student account.

This second program may be executed by sensing the movement of the student. Specifically, the device 100 that provides a virtual lecture space may acquire the motion of the student sensed through a common means capable of sensing the motion of a person, such as a VR device, an AR environment, or a motion sensor, and obtain the obtained The second program, which is all software programs used in PCs and smart devices, such as word document creation programs, document creation programs, video playback programs, image loading programs, etc. It can be executed by sensing the movement of Also, the execution screen of the second program may be displayed on the second item 340 including the virtual blackboard. Accordingly, the student can display and provide the contents of the presentation on the lecture on the second item 340 to the participants only by moving, so that a virtual lecture capable of efficient and effective communication without unnecessary time delay can be achieved.

Also, the execution screen of the second program may be displayed in the second item 340 that operates in conjunction with the second avatar 320 . Specifically, the second item 340 according to an embodiment includes a virtual blackboard as shown in FIG. 3, may include an item that can be implemented in a virtual lecture space, such as a virtual monitor, and includes movements of students. It can be created or deleted by sensing. That is, the second item 340 may be a virtual item capable of displaying an execution screen of the second program.

When a recording function is executed on the second device, the device 100 providing a virtual lecture space according to an embodiment displays an image 350 indicating that the recording function is being executed in an area adjacent to the second avatar 320. can be displayed.

Specifically, referring to FIG. 3 , an image 350 indicating that a recording function is being executed may be displayed in an area adjacent to the second avatar 320 as shown in the drawing. Accordingly, the lecturer can more easily determine whether the student is currently recording.

In step S250, the device 100 providing a virtual lecture space according to an embodiment may display a virtual blackboard providing an image obtained based on a lecturer's movement.

According to an embodiment, the virtual blackboard may display 0, 1, 2, and 3D images such as points, lines, planes, and three-dimensional figures, which are images obtained based on a lecturer's motion in a virtual lecture space, and An image obtained through a program execution screen and a lecturer's touch input to the first device may be displayed.

According to an embodiment, the first avatar 310, the execution screen of the first program, the second avatar 320, the execution screen of the second program, and the virtual blackboard are 2D or 2D depending on the environment of the device in which the virtual lecture space is provided. It can be displayed in 3D. Accordingly, each element may be displayed appropriately to the environment of the device in which the virtual lecture space is provided.

The device 100 for providing a virtual lecture space according to an embodiment may display a virtual experiment object 610 generated based on a lecturer's movement, and the shape of the virtual experiment object 610 is determined by the lecturer's movement and It can be updated and displayed according to the student's movement.

Specifically, referring to FIGS. 6 and 7 , the device 100 providing a virtual lecture space updates the virtual experiment object 610 generated based on the lecturer's movement according to the lecturer's movement and the student's movement. can be displayed. For example, in FIG. 6, a molecular structure model, which is a virtual experiment object 610, is generated and displayed based on the lecturer's movement, and updated according to various shape transformations, such as partial deformation or separation of the molecular structure model according to the lecturer's movement. An example of being is shown. In addition, in FIG. 7, an example in which a virtual experiment object 610, which is a molecular structure model generated based on the movement of a lecturer, is displayed and updated according to various shape transformations such as rotation and movement according to the movements of the lecturer and the students is shown. For example, the virtual experiment object 610 may be capable of all transformations that can be implemented in virtual reality, such as copying, editing, and simulation, in addition to transformations such as enlargement, reduction, separation, and combination.

In addition, the device 100 providing a virtual lecture space according to an embodiment may determine the updateable range of the virtual experiment object 610 to be different according to the movement of the lecturer and the movement of the student. For example, the updateable range according to the lecturer's movement may be determined as the entire range of the shape of the virtual experiment object 610, but the updateable range according to the student's movement is based on the shape of the virtual experiment object 610. It can be determined by the setting range. Accordingly, it is possible to provide a smooth lecture and practice environment for lecturers using the virtual experiment object 610 .

In addition, the device 100 providing a virtual lecture space according to an embodiment changes the shape of the virtual experiment object 610 according to the movement of the student while updating the shape of the virtual experiment object 610 according to the movement of the lecturer. It is possible to determine whether to allow an update operation. In this case, a lecturer can easily control a situation in which the shape of the virtual experiment object 610 is updated according to a student's motion during a lecture using the virtual experiment object 610 .

3 is a diagram schematically illustrating an example in which a virtual lecture space is provided according to an embodiment of the present disclosure.

As shown in the drawing, the device 100 for providing a virtual lecture space according to an embodiment includes a first avatar 310 that operates in conjunction with a lecturer's account and operates by sensing the lecturer's movement, and a login of the lecturer's account. The execution screen of the first program executed on the first device used for the program, the second avatar 320 that operates in conjunction with the student's account and operates by sensing the student's movement, and is executed on the second device used to log in the student's account. A virtual blackboard providing an execution screen of the second program and an image obtained based on the movement of the lecturer may be displayed.

In addition, the device 100 providing a virtual lecture space may display the execution screen of the first program on the first item 330 that operates in conjunction with the first avatar 310 .

In addition, the device 100 providing a virtual lecture space may display an image 360 representing a student's class attendance status in an area adjacent to the second avatar 320, and operates in conjunction with the second avatar 320. Execution screens of the second program may be displayed in the second item 340 to be displayed.

In embodiments, a lecturer and students may be provided with a virtual lecture space from a first-person perspective, but in the drawings, a third-person observer perspective is used for better understanding.

4 is a diagram schematically illustrating an example of each avatar displayed according to an embodiment of the present disclosure.

The device 100 providing a virtual lecture space according to an embodiment may display an arbitrary avatar rather than a lecturer's actual appearance. This arbitrary avatar may be an avatar registered in the device 100 that provides a virtual lecture space through a lecturer account or a student account, and may be a basic avatar provided by the device 100 that provides a virtual lecture space. may be

The device 100 providing a virtual lecture space according to an embodiment may display a 2-dimensional or 3-dimensional outline 410 indicating that the first avatar 310 is a lecturer. The additional outline 410 is formed along the outline of the first avatar 310, and may include a color and shape that are easy for other students to recognize that the first avatar 310 is the lecturer's avatar.

In addition, the device 100 providing a virtual lecture space may display repetitive movements of the preset body part 420 of the second avatar based on whether data is continuously transmitted and received from the second device and the third device. can As shown in the figure, when the second avatar 320 has a rabbit shape, the movement of rabbit ears, which are preset body parts, is repeatedly displayed to prevent repetitive movements of the second avatar 320 when silence occurs during a lecture. Through this, it is possible to determine whether a technical problem has occurred. As another example, if the second avatar 320 has a human shape including a student's shape, the movement of the shoulder, which is a predetermined body part, may be repeatedly displayed.

5 is a diagram schematically illustrating an example of displaying each avatar according to the movement of the user 510 of the third device according to an embodiment of the present disclosure.

In one embodiment, the viewpoint 520 determined according to the movement of the user 510 of the third device is such that the user 510 (or the second avatar 320) of the third device moves in a virtual lecture space ( Or, it may be determined based on the time point). Referring to the drawing, the view point 520 can be understood as a first-person observer's point of view, which is the point of view of the user 510 of the third device, as shown in the drawing, and the movement of the user 510 of the third device. (movement of the first-person observer's point of view), and the first avatar 310 or the second avatar 320 can be displayed based on the view point 520 .

6 and 7 are schematic diagrams illustrating an example of displaying a virtual experiment object 610 according to an embodiment of the present disclosure.

The device 100 providing a virtual lecture space may update and display the virtual lab object 610 generated based on the lecturer's movement according to the lecturer's movement and the student's movement. For example, in FIG. 6, a molecular structure model, which is a virtual experiment object 610, is generated and displayed based on the lecturer's movement, and updated according to various shape transformations, such as partial deformation or separation of the molecular structure model according to the lecturer's movement. An example of being is shown. In addition, in FIG. 7, an example in which a virtual experiment object 610, which is a molecular structure model generated based on the movement of a lecturer, is displayed and updated according to various shape transformations such as rotation and movement according to the movements of the lecturer and the students is shown. For example, the virtual experiment object 610 may be capable of all transformations that can be implemented in virtual reality, such as copying, editing, and simulation, in addition to transformations such as enlargement, reduction, separation, and combination.

8 and 9 are diagrams schematically illustrating a customized design of a virtual lecture space according to an embodiment of the present disclosure.

The device 100 providing a virtual lecture space according to an embodiment may implement the virtual lecture space as a customized lecture room design. For example, referring to FIGS. 8 and 9 , by applying digital photos of 6 sides of an arbitrary place including a lecture room or conference room to a virtual lecture space, the corresponding place can be implemented in a virtual lecture space. However, it is not necessarily limited to an image of a real place, and may be implemented as an image that can be expressed in a virtual lecture space. Accordingly, it is possible to create various types of virtual classrooms for an efficient lecture environment.

According to an embodiment, the device 100 providing a virtual lecture space may provide backgrounds of patterns and colors to help improve concentration, white noise, and background music to help improve concentration. Accordingly, it is possible to improve the concentration of the participants who participated in the virtual lecture space and thereby facilitate smooth communication.

The above description of the present invention is for illustrative purposes, and those skilled in the art can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, the embodiments described above should be understood as illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and equivalent concepts should be construed as being included in the scope of the present invention. do.

100: Device providing virtual lecture space
110: processor 120: display
310: first avatar 320: second avatar
330: first item 340: second item
350: Image indicating that the recording function is running
360: Image representing the status of taking classes
410: Additional outline 420: Preset body part of the second avatar
510: User of the third device
520: view point
610: virtual experiment object

Claims (18)

In the method of providing a virtual lecture space,
displaying a first avatar that operates in conjunction with a lecturer's account and operates by sensing a lecturer's movement;
displaying an execution screen of a first program executed on a first device used to log in to the lecturer account on the display;
displaying a second avatar that operates in conjunction with the student's account and senses the student's movement on the display;
displaying, on the display, an execution screen of a second program executed on a second device used to log in the student account;
displaying a virtual blackboard providing an image acquired based on the lecturer's motion;
After the display displays the second avatar,
When the pattern according to the eye monitoring result obtained from the student is determined to be a preset pattern, determining that the student is in a drowsy state;
displaying, by the display, an image representing the drowsy state in an area adjacent to the second avatar; and
The display displays the first avatar or the second avatar based on a viewpoint determined according to a movement of a user of a third device providing the virtual lecture space,
The display displays a virtual experiment object generated based on the lecturer's motion,
The display further includes updating and displaying the shape of the virtual experiment object according to the movement of the lecturer and the movement of the student,
The updateable range of the virtual experiment object is determined to be different according to the movement of the lecturer and the movement of the student,
The updateable range according to the movement of the lecturer is determined as the entire range of the shape of the virtual experiment object, and the updateable range according to the movement of the student is determined as a partial range of the shape of the virtual experiment object. method.
According to claim 1,
After displaying the second avatar,
When the recording function is executed in the second device, displaying an image indicating that the recording function is being executed on the display in an area adjacent to the second avatar.
delete According to claim 1,
The first avatar, the execution screen of the first program, the second avatar, the execution screen of the second program, and the virtual blackboard are displayed in 2D or 3D according to the environment of the device in which the virtual lecture space is provided. method.
According to claim 1,
The first program is executed by sensing the movement of the lecturer,
The second program is executed by sensing the movement of the student.
According to claim 1,
An execution screen of the first program is displayed in a first item that operates in conjunction with the first avatar,
The execution screen of the second program is displayed in a second item that operates in conjunction with the second avatar.
delete According to claim 1,
The step of displaying the second avatar by the display
Displaying, by the display, repetitive motions of preset body parts of the second avatar based on continuity of data transmitted and received between the second device and the third device in real time;
The speed of the repetitive movement of the predetermined body part is determined based on the gaze direction determined according to the eyeball monitoring result of the student,
When the time for which the gaze direction is determined as the preset direction is less than a first time, the speed is determined as a first level,
When the time for which the gaze direction is determined to be the preset direction is greater than or equal to the first time and less than a second time, the speed is determined to be a second level,
When the time for which the gaze direction is determined as the preset direction is equal to or longer than the second time, the speed is determined as a third level.
According to claim 1,
The step of displaying the second avatar by the display
Displaying, by the display, an image representing the student's attendance status in an area adjacent to the second avatar based on a gaze direction determined according to a result of the eyeball monitoring of the student;
The image representing the status of the course is
The gaze direction is determined based on the number of times the preset direction is determined,
When the number of times that the gaze direction is determined as the preset direction is less than the first number of times, the image representing the class attendance state is determined as an image representing a high concentration state;
When the number of times that the gaze direction is determined to be the preset direction is greater than or equal to the first number and less than the second number of times, the image representing the class attendance state is determined as an image representing a normal concentration state;
If the number of times that the gaze direction is determined as the preset direction is equal to or greater than the second number of times, the image representing the class attendance state is determined as an image representing a low concentration state.
In a device providing a virtual lecture space,
A processor for receiving and processing lecture provision data from a first device operating in conjunction with a lecturer's account and a second device operating in conjunction with a student's account; and
Based on the lecture provision data, a first avatar that operates in conjunction with the lecturer's account and operates by sensing the lecturer's movement, an execution screen of a first program executed on the first device used to log in to the lecturer's account, A second avatar that operates in conjunction with the student account and operates by sensing the student's movement, and obtained based on the execution screen of the second program executed on the second device used to log in the student account and the lecturer's movement display a virtual blackboard that provides an image of
When the pattern according to the result of eye monitoring obtained from the student is determined to be a preset pattern, the student's attendance status is determined to be a drowsy state, and an image representing the sleepiness status is displayed in an area adjacent to the second avatar, and the display displays an image representing the drowsy state in an area adjacent to the second avatar, and based on a view point determined according to a user's motion of a third device on which the display provides the virtual lecture space, The second avatar is displayed, the display displays a virtual experiment object generated based on the lecturer's movement, and the display updates and displays the shape of the virtual experiment object according to the lecturer's movement and the student's movement. Including; a display that
The updateable range of the virtual experiment object is determined to be different according to the lecturer's movement and the student's movement, and the updateable range according to the lecturer's movement is determined as the entire range of the shape of the virtual experiment object, , The updateable range according to the movement of the student is determined as a partial range for the shape of the virtual experiment object.
delete According to claim 10,
the display
The first avatar, the execution screen of the first program, the second avatar, the execution screen of the second program, and the virtual blackboard are displayed in 2D or 2D according to the environment of the device in which the virtual lecture space is provided, device
According to claim 10,
The first program is executed by sensing the movement of the lecturer,
The second program is executed by sensing the movement of the student.
According to claim 10,
An execution screen of the first program is displayed in a first item that operates in conjunction with the first avatar,
The device, wherein the execution screen of the second program is displayed in a second item that operates in conjunction with the second avatar.
delete According to claim 10,
the display
displaying a repetitive motion of a predetermined body part of the second avatar based on continuity of data transmitted and received between the second device and the third device in real time;
The speed of the repetitive movement of the predetermined body part is determined based on the gaze direction determined according to the eyeball monitoring result of the student,
When the time for which the gaze direction is determined as the preset direction is less than a first time, the speed is determined as a first level,
When the time for which the gaze direction is determined to be the preset direction is greater than or equal to the first time and less than a second time, the speed is determined to be a second level,
When the time for which the gaze direction is determined as the preset direction is equal to or longer than the second time, the speed is determined as a third level.
According to claim 10,
the display
Displaying an image representing the student's attendance status in an area adjacent to the second avatar based on a gaze direction determined according to a result of the student's eyeball monitoring;
The image representing the status of the course is
The gaze direction is determined based on the number of times the preset direction is determined,
When the number of times that the gaze direction is determined as the preset direction is less than the first number of times, the image representing the class attendance state is determined as an image representing a high concentration state;
When the number of times that the gaze direction is determined to be the preset direction is greater than or equal to the first number and less than the second number of times, the image representing the class attendance state is determined as an image representing a normal concentration state;
If the number of times that the gaze direction is determined to be the preset direction is equal to or greater than the second number of times, the image representing the class attendance state is determined as an image representing a low concentration state.
A computer program stored in a recording medium to implement the method of any one of claims 1, 2, 4 to 6, 8 and 9 in a computer.