KR102223107B1 - System and method for VR(Virtual Reality) learning service enabling cooperative work - Google Patents

Abstract

Disclosed is a virtual reality (VR) learning system and method that supports collaboration. The VR learning system according to the present invention includes a VR headset worn by the learner on the head; A VR sensor for detecting a learner's position and movement; And a VR learning server that operates VR learning content arranged to enable a plurality of learners to collaboratively learn in one classroom by interlocking with a VR headset and a VR sensor; wherein the VR learning server includes an area of the classroom and the number of logged-in learners. The personal learning area in the classroom and the separation distance between the individual learning areas are determined by using, and the personal learning area corresponding to each learner is allocated using the location information of each learner detected through the VR sensor, and through the VR sensor. Conflicts between learners are monitored and interactions between learners are controlled by considering the detected position and movement of each learner, each learner's individual learning area, and minimum separation distance.

Description

VR learning system and method that supports collaboration {System and method for VR (Virtual Reality) learning service enabling cooperative work}

The present invention relates to a technology for operating VR (Virtual Reality) learning content, and more specifically, collaboration is provided to efficiently control interactions or collisions between learners when providing VR learning content that allows multiple students to learn together at the same time. It is about supporting VR learning systems and methods.

As experiential classes increase in elementary and junior high schools, many safety accidents are occurring accordingly, and a lot of cost and effort are required to prepare the classroom environment.

In order to solve this problem, VR learning contents have been developed and used to enable experiential learning without preparation of educational materials using virtual reality technology, and to learn various knowledge while traveling around the world even when sitting in a classroom.

However, most of the conventional VR learning contents allow learners to learn by themselves, and even if a plurality of learners use them at the same time, interaction processing between learners is insufficient, so it is difficult to expect a learning effect through collaboration.

The present invention is to solve the problems of the prior art as described above, when providing VR learning content in which a plurality of students in a classroom can learn together at the same time, collaboration is provided to efficiently control interactions or collisions between learners. It is to provide a supporting VR learning system and method.

In order to achieve the above object, a VR learning system according to an embodiment of the present invention includes a VR (Virtual Reality) headset worn by a learner on the head; A VR sensor for detecting the learner's position and movement; And a VR learning server for operating VR learning content provided for cooperative learning by a plurality of learners in one classroom by interworking with the VR headset and the VR sensor, wherein the VR learning server includes an area of the classroom and a login Using the number of one learner, the individual learning area in the classroom and the separation distance between the individual learning areas are determined, and the individual learning area corresponding to each learner is allocated using the location information of each learner detected through the VR sensor. , In consideration of the position and movement of each learner detected through the VR sensor, the individual learning area of each learner, and the minimum distance, it is possible to monitor collisions between learners and control interactions between learners.

The VR learning server determines the minimum separation distance between each individual learning area according to the learner's learning posture, and determines the shape and size of each individual learning area according to the determined minimum separation distance and the type of the VR learning content. I can.

When an interaction between learners is scheduled in the VR learning content, the VR learning server considers the position and movement of each learner detected through the VR sensor, the individual learning area of each learner, and the minimum distance to the learner. It is possible to detect an interaction between the learners and output alarm data representing the interaction through a VR headset or a VR controller of the learners.

The VR learning server, when a collision between learners is predicted in consideration of the position and movement of each learner detected through the VR sensor, the individual learning area of each learner, and the minimum separation distance, is displayed through the VR headsets of the corresponding learners. Graphic data for collision avoidance can be displayed in the losing virtual space.

The VR learning server, if there is a learner predicted to collide with an object in consideration of the position and movement of each learner detected through the VR sensor and the location of objects in the classroom, the virtual displayed through the VR headset of the corresponding learner. Graphic data for collision avoidance can be displayed in the space.

The VR learning server may adjust the individual learning area and the separation distance of each learner in consideration of the number of added learners when there are additional learners logged in.

In the VR learning method according to an embodiment of the present invention, a plurality of learners cooperate in one classroom by interlocking with a VR (Virtual Reality) headset worn by the learner on the head and a VR sensor for detecting the learner's position and movement. Determining, by a VR learning server that operates VR learning content arranged for learning, a personal learning area in the classroom and a separation distance between the individual learning areas by using the area of the classroom and the number of learners; Allocating a personal learning area corresponding to each learner by using the location information of each learner sensed through the VR sensor; When an interaction between learners is scheduled in the VR learning content, the interaction between learners is detected in consideration of the position and movement of each learner detected through the VR sensor, the individual learning area of each learner, and the minimum distance. Displaying alarm data representing the interaction through a VR headset or a VR controller of the learners; And when a collision between learners is predicted in consideration of the position and movement of each learner detected through the VR sensor, each learner's personal learning area, and the minimum distance, it collides with the virtual space shown through the VR headsets of the corresponding learners. Displaying graphic data for prevention; may include.

According to the present invention, it is possible to provide a safe and realistic VR cooperative learning service by efficiently controlling interactions or collisions between learners when providing VR learning contents in which a plurality of students can study together at the same time.

1 is a view for explaining the configuration of a VR learning system according to an embodiment of the present invention.
2 is a flowchart illustrating a VR learning method according to an embodiment of the present invention.
3 is an illustration of a classroom in which a VR learning system supporting collaboration is installed according to an embodiment of the present invention.
4 is a conceptual diagram illustrating a method of dynamically determining an individual learning area in a classroom according to an embodiment of the present invention.
5 is a flowchart illustrating a method of conducting a cooperative learning session according to an embodiment of the present invention.
6 is a conceptual diagram illustrating a method of adjusting an individual learning area when a learner is added according to an embodiment of the present invention.

The terms used in the present specification will be briefly described, and the present invention will be described in detail.

Terms used in the present invention have selected general terms that are currently widely used as possible while taking functions of the present invention into consideration, but this may vary according to the intention or precedent of a technician working in the field, the emergence of new technologies, and the like. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning of the terms will be described in detail in the description of the corresponding invention. Therefore, the terms used in the present invention should be defined based on the meaning of the term and the overall contents of the present invention, not a simple name of the term.

When a part of the specification is said to "include" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary. In addition, terms such as "...means", "...units", and "modules" described in the specification mean a unit that processes at least one function or operation, which is implemented in hardware or software, or is implemented in hardware and software. It can be implemented by a combination of.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are attached to similar parts throughout the specification.

1 is a view for explaining the configuration of a VR (Virtual Reality) learning system according to an embodiment of the present invention.

Referring to FIG. 1, the VR learning system includes a VR learning server 10, one or more VR sensors 11, and a Head Mounted Display (HMD) 12, which is a VR headset device worn by learners on their heads. In addition, a VR controller (not shown) may be further included as one or more VR input devices for receiving inputs from learners.

The HMD 12 is a device worn on the head so that the learner covers his or her eyes. The HMD 12 is a device that detects the user's gaze based on the user's rotation or eye movement based on the origin of the VR content image. Accordingly, a display unit for displaying a corresponding viewing area while driving a VR image may be provided. The sensing unit may include an angular velocity sensor, a gyro sensor, etc. to detect the rotation of the HMD 12, and may include an eye tracking sensor that detects the direction (line of sight) or movement of the eye.

The VR controller is a component that receives a selection signal, a manipulation signal, etc. from a user, and may include various manipulation buttons and a component capable of recognizing a gesture of a user's hand.

The VR sensor 11 is a sensor installed in a classroom to detect the position and movement of a learner, and may include a motion capture unit, a head tracking unit, a position tracking unit, a gaze tracking unit, and the like.

The VR learning server 10 is a computing device that plays and operates VR learning content that can be learned together by multiple learners in one classroom by interworking with the HMD 12 and the VR sensor 11. VR learning to dynamically manage personal learning areas for learning, control collaboration among learners when playing VR learning content, and predict and prevent situations in which learners wearing VR headsets (12) collide with other learners or objects in the classroom. Operate the content.

The VR learning server 10 determines the distance between the individual learning areas and the individual learning areas in the classroom using the area of the classroom and the number of learners, and uses the location information of each learner detected through the VR sensor 11. Thus, a corresponding individual learning area is allocated to each learner. Collaboration and collision between learners, and collision management between learners and objects in the classroom are performed based on the individual learning area and the separation distance determined as described above. Specifically, it is possible to monitor collisions between learners and control interactions between learners in consideration of the position and movement of each learner detected through the VR sensor 11, the individual learning area of each learner, and the minimum distance.

2 is a flowchart illustrating a VR learning method supporting collaboration according to an embodiment of the present invention, FIG. 3 is an illustration of a classroom in which a VR learning system is installed, and FIG. 4 is a personal learning area in the classroom This is a conceptual diagram to explain how to dynamically determine

The VR learning server 10 is equipped with VR software for playing and operating VR contents, and by executing this VR software, the VR sensor 11 and HMD 12 in the classroom are initialized. In addition, when learners wearing the HMD 12 log in and wait, they open a cooperative learning session to start VR learning content. VR learning contents are learning contents in which a plurality of learners can interact together, and may include contents of various contents such as science experiments.

Referring to FIG. 3, a classroom in which a plurality of learners will collaborate learning may be composed of various furniture or educational materials such as desks and chairs, and learners are each sitting on a chair or standing in a virtual space while wearing the HMD 12. Through this, you will experience cooperative learning.

When the cooperative learning session provided by the VR learning content starts, in step S21, the VR learning server 10 acquires the area of the classroom in which learners are gathered to cooperate. The area of the classroom can be expressed in terms of width and height, and can be entered or set in advance by the administrator. In another embodiment, the area of the classroom may be calculated using a horizontal length and a vertical length calculated using a value sensed by the VR sensor 11.

In step S22, the individual learning area in the classroom may be determined using the obtained classroom area and the number of learners as described above. The individual learning area is an area occupied by one learner in a classroom where a plurality of learners teach together, and may be determined as an area less than an area obtained by dividing the total area of the classroom by the number of learners. For example, it may be determined by calculating an area that can be occupied by one learner from an area excluding an area occupied by a teaching tool or the like from the total area of the classroom. That is, the personal learning area used when operating the VR learning content is not determined as a fixed area, but may be dynamically determined according to the classroom space in which the corresponding VR learning content is played and used, and the number of learners who have logged in.

In step S23, a separation distance between individual learning areas is determined (S23). The separation distance can be determined based on the size of the classroom and the number of participating learners.

Referring to FIG. 4, at least one VR sensor 41 is installed in the classroom, and the number of learners logged in within the entire classroom space 40, which can be expressed in terms of the area of the classroom, that is, the horizontal length and the vertical length, is considered. The personal study area 42, which is a space occupied by one person, is determined. In each individual learning area 42, a learner 43 wearing an HMD is positioned to perform cooperative learning with other learner(s). The personal study area 42 may be represented by a horizontal length 44 and a vertical length 45 and will be spaced apart by a predetermined separation distance 46.

The space corresponding to the separation distance is a space that acts as a buffer between the dedicated spaces where each learner moves and conducts learning activities.If each learner's individual learning areas are arranged without separation, it is difficult to prevent collisions between learners. , In the present invention, joint learning is efficiently managed by placing a spaced distance between individual learning areas.

The separation distance will be determined to be smaller than a predetermined or determined minimum separation distance. The minimum separation distance is a threshold value of the separation distance and may be determined based on at least one of a VR learning content author's setting, a VR learning content manager (teacher) setting, a type of VR learning content, and a learner's posture required according to the learning content. .

In an embodiment in which a minimum separation distance between individual learning areas is determined and set according to a learner's learning posture, the minimum separation distance may be set to a predetermined value by dividing a case of standing learning and a case of sitting learning. For example, when learners stand and learn, the minimum separation distance may be set to 80 cm, and when sitting and study, the minimum separation distance may be set to 50 cm.

In step S24, a personal learning area corresponding to each learner is allocated using the location information of each learner sensed through the VR sensor 41. That is, one individual learning area is allocated to the HMD worn by each learner 43, and the location of the HMD also moves as the learner 43 moves, and a personal learning area corresponding thereto around the location of the HMD ( 42) also moves dynamically.

In step S25, each individual learning area may be adjusted to satisfy a predetermined separation distance condition. If the learners 43 wearing the HMD are too close and the separation distance between the individual learning areas centered on the HMD becomes smaller than the preset minimum separation distance, or when the individual learning areas overlap each other, the other learners and other learners are displayed on the display of the HMD. It displays graphic data such as arrows that tell you to move away from it. If a learner sees this sign and moves away from other learners, as a result, the individual learning area will also move in the direction of movement.

The shape and size of each individual learning area 42 may be determined or adjusted according to the minimum separation distance and the type of VR learning content. For example, in the case of science experiment content, the personal learning area 42 may be set to be larger than in the case of math learning content.

The personal learning area 42 may have a rectangular or circular shape, but the shape may be determined according to the contents of the VR learning content. For example, when the learner's joint learning, if there is little movement back and forth and the movement is large on the side, the horizontally long shape will be determined, and if the back and forth movement is large, the back and forth long shape will be determined. To this end, a maximum movement distance back and forth or a maximum movement distance left and right can be set and stored in the VR learning content, and a personal learning area can be dynamically determined by referring to this setting information.

It is recommended that the separation distances between individual learning areas be farther than the space in the classroom allows. First, an appropriate area of the personal study area is determined and placed in the classroom according to the actual location of the HMD, but the separation distance is set as wide as possible in consideration of the area of the classroom. In this case, if the separation distance is less than the minimum separation distance, the personal learning area in which the separation distance can be properly maintained may be determined by going back to the beginning and reducing the size of the personal learning area to recalculate the separation distance.

The learners 43, while wearing the HMD, start collaboration by positioning at the center of each assigned individual learning area, and accordingly, a cooperative learning session will proceed.

5 is a flowchart illustrating a method of conducting a cooperative learning session according to an embodiment of the present invention.

During the cooperative learning session, the collaboration or collision of learners will be managed, and collisions between learners and objects in the classroom will be monitored. That step will be executed. While learning is in progress, the VR learning server 10 interlocks with the VR sensor 11 and the HMD 12 to control learners to collaborate inside, and to interact with learners or objects such as equipment or furniture in the classroom. It's about controlling students so they don't actually collide.

In step S51, collisions between learners are monitored.

When a collision between learners is predicted in consideration of the position and movement of each learner detected through the VR sensor 11, the individual learning area of each learner, and the minimum distance, the HMD 12 or the VR controller of the learner To prevent collisions by displaying alarm data to prevent collisions and notifying learners of possible collisions. The alarm data may include at least one of visually visible graphic data, tactilely felt vibration, and audibly audible sound.

For example, while wearing the HMD 12, when a learner moves out of his/her personal learning area, or when the corresponding learner enters within the minimum distance from the adjacent personal learning area, it is displayed on the HMD display of the corresponding learner. In addition to displaying recognizable graphic data, graphic data may be displayed so that a possibility of collision can be recognized on an HMD display worn by a learner in an adjacent personal learning area.

In step S52, collisions between learners and objects in the classroom are monitored.

If there is a learner who predicts a collision with an object in consideration of the position and movement of each learner detected through the VR sensor 11 and the position of objects in the classroom, collision is prevented through the VR headset 12 or VR controller of the learner. You can display the alarm data for. The alarm data may include at least one of visually visible graphic data, tactilely felt vibration, and audibly audible sound.

When it is determined that an arbitrary learner moves out of his/her personal learning area while wearing the HMD 12 or a hand goes out and approaches the equipment in the classroom within the minimum distance, the learner can recognize it on the HMD display. It prevents collisions by displaying and notifying graphic data.

When an interaction is scheduled within the VR learning content, the VR learning server 10 treats learners moving closer to each other as an exception of collision, and executes step S53 instead of executing step S52. In step S53, interactions for collaboration among learners are managed.

The VR learning server 10 determines the position and movement of each learner detected through the VR sensor 11, the individual learning area, and the minimum separation distance of each learner when an interaction between learners is scheduled within the VR learning content. Considering the interaction between learners is sensed, and when it is determined that there is an interaction, notification data indicating the interaction may be output through the HMD 12 or a VR controller of the corresponding learners. The notification data may include at least one of visually visible graphic data, tactilely felt vibration, and audibly audible sound.

Interaction between learners collaborating in a virtual space is different from direct contact in a real space. Accordingly, for collaboration between learners in a virtual space, the VR learning server 10 needs to be controlled to enable realistic interaction without physically contacting learners in an adjacent personal learning area.

For example, it displays a graphical user interface (GUI) that allows learners to operate while slightly invading each other's personal learning areas. As another example, when a learner enters within the minimum distance of an adjacent individual learning area, or a hand (VR controller held by hand) enters the next learner's personal learning area, both adjacent learners' VR controllers are vibrated, etc. It is possible to inform that there has been an interaction with each other.

For the interaction of VR learning contents, it is judged that there is interaction when the learners' hands or VR controllers approach within a certain distance even if they are not actually in contact, and when wearing the HMD 12, VR contents feel as if they are touching each other. It can be handled as an action such as giving and receiving experimental equipment or holding together.

In step S54, a situation in which the number of learners in the classroom is changed is controlled. If the number of learners collaborating through VR learning content fluctuates, it is necessary to adjust the number and area of individual learning areas accordingly. At this time, the separation distance and the size of the personal learning area are adjusted within the limit of maintaining the minimum separation distance.

If one or more learners log in or log out additionally while learning is in progress or during breaks, the size and separation distance of the personal study area are dynamically determined by reflecting the changed number of learners, and according to the result. Relocate individual learning areas. Since it is desirable to secure the learner's personal learning area as wide as possible, if there are many learners or the classroom is narrow compared to the number of learners, the individual learning area can be secured by narrowing the separation distance. However, when the separation distance between the individual learning areas is closer to within the minimum separation distance, the size of each individual learning area is reduced and the separation distance is adjusted to be greater than the minimum separation distance.

6 is a conceptual diagram illustrating a method of adjusting an individual learning area when a learner is added according to an embodiment of the present invention. When there are additional learners logged in, the individual learning area and the separation distance of each learner are adjusted in consideration of the number of added learners.

Figure 6 (a) is a personal learning area 61 for each learner is arranged in the classroom space when 6 learners log in, and (b) is two personal learning areas when 2 additional learners log in. As an example of adding (63), it shows the result of dynamically re-adjusting the size and position of the personal study area (61) to handle the addition of learners and re-adjusting the separation distance within the limit of maintaining the minimum separation distance. .

If it is possible to secure the separation distance above the minimum separation distance while maintaining the size of the existing personal study area, adjust the separation distance only in the direction of reducing it. If the size of the existing personal study area is maintained, the separation distance is less than the minimum separation distance. In the case of this, as shown in (b), the size of the personal study area is reduced and adjusted.

The method according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements by those skilled in the art using the basic concept of the present invention defined in the following claims are also provided. It belongs to the scope of rights.

The present invention can be applied to the field of VR content operation technology.

10: Virtual Reality (VR) Learning Server
11: Virtual Reality (VR) sensor
12: Head Mounted Display (HMD)

Claims (10)

A VR (Virtual Reality) headset worn by the learner on the head;
A VR sensor for detecting the learner's position and movement; And
Including; a VR learning server for operating VR learning content provided to enable a plurality of learners to collaboratively learn in one classroom by interworking with the VR headset and the VR sensor; and
The VR learning server determines the distance between the personal learning area and the personal learning areas in the classroom using the area of the classroom and the number of learners logged in, and uses the location information of each learner sensed through the VR sensor. Thus, a personal learning area corresponding to each learner is allocated, and collision between learners is monitored by considering the position and movement of each learner detected through the VR sensor, the individual learning area of each learner, and the minimum separation distance. Control the interaction,
The personal learning area in the classroom is a virtual space corresponding to the actual space in which the learner is located,
All the VR headsets worn by the plurality of learners are located in the real space,
The VR learning server, wherein the VR learning system controls an interaction between learners corresponding to the learner's position and movement in the real space through the VR headset.
The method of claim 1,
The VR learning server determines a minimum separation distance between each individual learning area according to the learner's learning posture, and determines the shape and size of each individual learning area according to the determined minimum separation distance and the type of VR learning content. VR learning system, characterized in that to. The method of claim 1,
When an interaction between learners is scheduled in the VR learning content, the VR learning server considers the position and movement of each learner detected through the VR sensor, the individual learning area of each learner, and the minimum distance to the learner. A VR learning system, characterized in that for detecting an interaction between the learners and outputting alarm data representing the interaction through a VR headset or a VR controller of the learners. The method of claim 1,
The VR learning server, when a collision between learners is predicted in consideration of the position and movement of each learner detected through the VR sensor, the individual learning area of each learner, and the minimum separation distance, is displayed through the VR headsets of the corresponding learners. A VR learning system, characterized in that displaying graphic data for collision avoidance in a losing virtual space. The method of claim 1,
The VR learning server, if there is a learner predicted to collide with an object in consideration of the position and movement of each learner detected through the VR sensor and the location of objects in the classroom, the virtual displayed through the VR headset of the corresponding learner. A VR learning system, characterized in that displaying graphic data for preventing collisions in space. The method of claim 1,
The VR learning server, when there are additionally logged in learners, adjusts the individual learning area and the separation distance of each learner in consideration of the number of added learners. A VR learning server that operates VR learning content designed for cooperative learning by multiple learners in one classroom by interlocking with a VR (Virtual Reality) headset worn by the learner on the head and a VR sensor for detecting the learner's position and movement. end,
Determining an individual learning area in the classroom and a separation distance between the individual learning areas using the area of the classroom and the number of learners;
Allocating a personal learning area corresponding to each learner by using the location information of each learner sensed through the VR sensor;
When an interaction between learners is scheduled in the VR learning content, the interaction between learners is detected in consideration of the position and movement of each learner detected through the VR sensor, the individual learning area of each learner, and the minimum distance. Displaying alarm data representing the interaction through a VR headset or a VR controller of the learners; And
When a collision between learners is predicted by considering the position and movement of each learner detected through the VR sensor, each learner's personal learning area, and the minimum distance, collision is prevented in the virtual space displayed through the VR headsets of the corresponding learners. Including; displaying graphic data for
The personal learning area in the classroom is a virtual space corresponding to the actual space in which the learner is located,
All the VR headsets worn by the plurality of learners are located in the real space,
The VR learning method, characterized in that, through the VR headset, an interaction between learners corresponding to the learner's position and movement in the real space is controlled. The method of claim 7,
If there is a learner whose collision is predicted by considering the position and movement of each learner detected through the VR sensor, and the position of objects in the classroom, to prevent collision in the virtual space displayed through the VR headset of the corresponding learner. Displaying graphic data; VR learning method further comprising a. The method of claim 7,
Determining a minimum separation distance between each individual learning area according to the learner's learning posture, and determining the shape and size of each individual learning area according to the determined minimum separation distance and the type of the VR learning content; VR learning method, characterized in that to. The method of claim 7,
When there are additional learners logged in, adjusting the individual learning area and the separation distance of each learner in consideration of the number of added learners.

Images