KR20240040277A - Virtual reality-based education system for self-learning of people with developmental disabilities - Google Patents

Abstract

A virtual reality-based education system for self-learning for developmentally disabled people according to an embodiment of the present invention includes a server that stores and executes learning scenarios and content; and an HMD device mounted on the head of a developmentally disabled person to display a virtual reality image containing the learning scenario and content, wherein the server provides learning scenarios and content according to the adaptability of the developmentally disabled person to the HMD device. can do.

Description

Virtual Reality-BASED EDUCATION SYSTEM FOR SELF-LEARNING OF PEOPLE WITH DEVELOPMENTAL DISABILITIES}

The present invention relates to a virtual reality-based education system for self-learning by people with developmental disabilities. More specifically, it supports self-learning by people with developmental disabilities using learning scenarios including virtual reality images, and provides offline education for people with developmental disabilities at educational institutions. It is about a virtual reality-based education system for self-study of developmentally disabled people that supports general education so that they can receive.

As head mounted displays (hereinafter referred to as “HMD”) devices, which are image display devices that can be worn on the head like glasses and enjoy large images, become popular, virtual reality (hereinafter referred to as “VR”) images are available. Interest in it is also increasing. HMD devices can provide users with VR images that make them feel as if they are interacting with the real surrounding environment.

Using VR video, the viewpoint changes depending on the user's movement, allowing images from various viewpoints to be provided. Attempts to utilize these characteristics and apply them to various fields such as games and education are actively underway.

However, users with low cognitive abilities, such as people with developmental disabilities, cannot expect appropriate responses from watching VR videos, and there is a problem that there is not enough content or scenarios to support learning for people with developmental disabilities using VR videos.

In particular, when using VR video to educate or support learning for people with developmental disabilities, uniform images are provided without considering the personal characteristics, tendencies, intellectual level, and learning preferences of people with developmental disabilities, which greatly affects the individual learning of people with developmental disabilities. There are also limitations in not being able to help.

The present applicant proposed the present invention to solve the above problems.

Korean Patent No. 10-2330218 (registration date 2021.11.18.) Korean Patent Publication No. 10-2021-0123771 (publication date 2021.10.14.) Korea Patent Publication No. 10-2019-0095566 (publication date 2019.08.16.) Korean Patent No. 10-1981701 (registration date 2019.05.17.) Korean Patent No. 10-2082313 (registration date 2020.02.21.)

The present invention was proposed to solve the above problems, and is a virtual reality-based education for self-study of the developmentally disabled that is equipped with various learning scenarios and contents in consideration of the adaptability to HMD devices and intellectual level of the developmentally disabled. Provides a system.

The present invention provides a virtual reality-based education system for self-study of developmentally disabled people that can support social skills training so that they can attend educational institutions and receive offline education as well as subject learning.

A virtual reality-based education system for self-learning of developmentally disabled people according to an embodiment of the present invention to achieve the above-described tasks includes a server that stores and executes learning scenarios and content; and an HMD device mounted on the head of a developmentally disabled person to display a virtual reality image containing the learning scenario and content, wherein the server provides learning scenarios and content according to the adaptability of the developmentally disabled person to the HMD device. can do.

The server provides scenarios and content to help the developmentally disabled person adapt to the HMD device according to his or her adaptability to the HMD device, and if the developmentally disabled person does not feel uncomfortable wearing the HMD device, learning scenarios and content. can be provided.

The server may provide content that can promote the mental or physical stability of a developmentally disabled person while the person with a developmental disability is wearing the HMD device, through the HMD device.

The server includes a menu selection unit that selects a menu for learning by people with developmental disabilities; a level selection unit that selects a learning level according to the learning level of the developmentally disabled person or adaptability to the HMD device; Course selection section that presents learning patterns for people with developmental disabilities; and a subject selection section that presents learning subjects for people with developmental disabilities.

The level selection unit selects the first level when the developmentally disabled person's adaptability to the HMD device is below the standard or when using the HMD device for the first time, and in the case of the first level level, the individual level for the developmentally disabled person is selected. Based on propensity data, we can provide content that developmentally disabled people do not feel uncomfortable about.

The server may control the selection of sub-menus of the course selection unit and the subject selection unit only when the developmentally disabled person passes the first level of the level selection unit.

The course selection department provides a homeschooling course that allows people with developmental disabilities to complete prescribed education at home and a social education course that educates people with interpersonal relationships with members of educational institutions in preparation for cases where people with developmental disabilities receive offline education at educational institutions. can be provided.

The subject selection unit provides any one of Korean language education, English education, and mathematics education, and when Korean education is selected by the subject selection unit, the server determines that the gaze of the developmentally disabled person with respect to the image presented on the HMD device is constant. For objects that stay for more than a period of time, letters are shown and the developmentally disabled person is encouraged to pronounce the corresponding letter. The pronunciation of the developmentally disabled person recognized through the HMD device is corrected, but considering the learning ability of the developmentally disabled person, the object is similar to the object in question and has developmental disabilities. You can correct pronunciation by using words that are familiar to people with disabilities as examples.

When English education is selected by the subject selection unit, the server may provide TESOL-based English education in consideration of the English learning ability or level of the developmentally disabled person.

The server includes a learning history management unit that manages learning history data of people with developmental disabilities; Learning Evaluation Department, which evaluates the learning outcomes of people with developmental disabilities; Behavioral Evaluation Department, which evaluates the behavior of developmentally disabled people during the learning process; And it may include a feedback unit that delivers the evaluation results of the learning evaluation unit and the behavior assessment unit to the guardian of the developmentally disabled person or the child care institution in charge.

The virtual reality-based education system for self-learning of the developmentally disabled according to the present invention first evaluates the adaptability of the developmentally disabled to the HMD device and then provides content according to the level of adaptation, thereby learning virtual reality images based on the HMD device. The effect can be increased.

The virtual reality-based education system for self-study of the developmentally disabled according to the present invention provides not only subject learning but also education to foster social skills of the developmentally disabled, providing the opportunity for the developmentally disabled to receive offline education at educational institutions in the future. can do.

The virtual reality-based education system for self-study for developmentally disabled people according to the present invention not only improves learning effectiveness because it allows people with disabilities to receive feedback from offline educational institutions or teachers about the curriculum and educational results rather than providing education solely to the developmentally disabled. In addition, it can contribute to helping people with developmental disabilities become members of society.

Figure 1 is a diagram showing the configuration of a virtual reality-based education system for self-study for developmentally disabled people according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating another example of a hand motion controller of the system according to FIG. 1.
FIG. 3 is a diagram showing the configuration of a server of the system according to FIG. 1.
FIG. 4 is a diagram showing the configuration of a level selection unit of the server according to FIG. 3.
FIG. 5 is a diagram illustrating the configuration of a process selection unit of the server according to FIG. 3.
FIG. 6 is a diagram showing the configuration of a subject selection unit of the server according to FIG. 3.

The advantages and/or features of the present invention and methods for achieving them will become clear by referring to the embodiments described in detail below in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and will be implemented in various different forms, but the present embodiments only serve to ensure that the disclosure of the present invention is complete and are within the scope of common knowledge in the technical field to which the present invention pertains. It is provided to fully inform those who have the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

In addition, the preferred embodiments of the present invention to be implemented below are provided in each system function configuration in order to efficiently explain the technical components constituting the present invention, or system functions commonly provided in the technical field to which the present invention pertains. The configuration will be omitted whenever possible, and the description will focus on the functional configuration that must be additionally provided for the present invention. If a person has ordinary knowledge in the technical field to which the present invention pertains, he or she will be able to easily understand the functions of conventionally used components among the functional configurations not shown and omitted below, as well as the omitted configurations as described above. The relationships between elements and components added for the present invention will also be clearly understood.

In addition, in the following description, "transmission", "communication", "transmission", "reception" and other similar terms of signals or information refer to the direct transmission of signals or information from one component to another component. In addition, it also includes those transmitted through other components. In particular, “transmitting” or “transmitting” a signal or information as a component indicates the final destination of the signal or information and does not mean the direct destination. This is the same for “receiving” signals or information.

FIG. 1 is a diagram showing the configuration of a virtual reality-based education system for self-learning of developmentally disabled people according to an embodiment of the present invention, FIG. 2 is a diagram showing another example of a hand motion controller of the system according to FIG. 1, FIG. 3 is a diagram showing the configuration of the server of the system according to FIG. 1, FIG. 4 is a diagram showing the configuration of the level selection unit of the server according to FIG. 3, and FIG. 5 is a diagram showing the configuration of the course selection unit of the server according to FIG. 3. Figure 6 is a diagram showing the configuration of the subject selection unit of the server according to Figure 3.

The virtual reality-based education system (10, hereinafter referred to as 'virtual hyeongil-based education system') for self-learning of developmentally disabled people according to an embodiment of the present invention described below uses virtual reality (VR; Virtual Reality) technology. As a system, known virtual reality technology can be used to provide or implement virtual reality images.

Referring to Figure 1, a virtual reality-based education system 10 according to an embodiment of the present invention includes a server 100 that stores and executes learning scenarios and content; and an HMD device 200 mounted on the head of a developmentally disabled person to display a virtual reality image containing the learning scenario and content.

The virtual reality-based education system 10 according to an embodiment of the present invention is not intended for general users, that is, people with normal intellectual level or learning ability, but for people with developmental disabilities. Accordingly, the user of the virtual reality-based education system 10 according to an embodiment of the present invention is a person with a developmental disability.

A person with a developmental disability refers to a person who does not develop normally physically or mentally compared to their peers. The virtual reality-based education system 10 according to an embodiment of the present invention is a system for self-learning of developmentally disabled people whose intellectual level or learning ability lags behind their peers.

The virtual reality-based education system 10 according to an embodiment of the present invention includes, in addition to the server 100 and the HMD device 200, a hand motion controller 300 worn on the hand by a developmentally disabled person, a teacher terminal 400, and a database ( 500).

The teacher terminal 400 may be accessed by a person in charge of managing the self-study of a developmentally disabled person or a guardian of a developmentally disabled person. Additionally, teachers at educational institutions where developmentally disabled people wish to enroll can also access it.

A teacher or guardian can use the terminal 400 to receive various information related to the education of the developmentally disabled person from the server 100 and use it to manage and evaluate the educational performance of the developmentally disabled person. To this end, an application used in the virtual reality-based education system 10 according to an embodiment of the present invention may be installed on the teacher terminal 400.

The database 500 may store various data related to the developmentally disabled person as well as the history of the person with a developmental disability using the virtual reality-based education system 10 according to an embodiment of the present invention. However, data related to personal information of persons with developmental disabilities may be stored in the database 500 only when the person with developmental disabilities or their guardian consents.

The HMD device 200, hand motion controller 300, teacher terminal 400, and database 500 can exchange data with the server 100 through wireless communication.

The virtual reality-based education system 10 according to an embodiment of the present invention allows a developmentally disabled person to learn or experience virtual reality-based content while watching a 3D virtual reality image displayed on the HMD device 200.

The HMD device 200 is a device worn on the head of a developmentally disabled person, and a virtual reality image can be displayed on a display unit provided inside the device. The HMD device 200 may be implemented as a smartphone mounted on a device (not shown) similar to a hair band that can be worn on the head of a developmentally disabled person, as well as the device shown in FIG. 1 .

A developmentally disabled person holds the hand motion controller 300 shown in FIG. 1 with his hand while wearing the HMD device 200 on his head. The HMD device 200 and the hand motion controller 300 may be provided as one set. The hand motion controller 300 is preferably provided in pairs so that a developmentally disabled person can hold one in each hand.

By wearing the hand motion controller 300 on both hands, a developmentally disabled person can think of playing or playing a game rather than learning, and can easily adapt to the virtual reality-based education system 10.

Since the virtual reality image displayed through the HMD device 200 shows a person with a developmental disability holding the hand motion controller 300 in his hand, the person with a developmental disability selects a learning scenario or content using the hand motion controller 300. Or you can continue learning.

In this way, the hand motion controller 300 is a tool that assists developmentally disabled people to actively participate in learning.

Figure 2 shows another example of a hand motion controller used in the virtual suspension-based education system 10 according to an embodiment of the present invention. The hand motion controller 600 according to another embodiment shown in FIG. 2 includes a grip part 610 that a developmentally disabled person can grasp with his or her hand, a movement function lever 620 in the form of a joystick operated with a finger, and a movement function lever 620 that is operated by pressing with a finger. It may include a viewpoint adjustment button 630 that operates and a trigger 640 that is operated by pulling with a finger.

1 and 2, since the objects of the hand motion controllers 300 and 600 are displayed in three dimensions in the virtual reality image displayed on the HMD device 200 worn on the head of the developmentally disabled person, the developmentally disabled person is unable to control the hand movements. You can visually check the hand motion controllers (300,600) moving along.

Referring to FIG. 3, the server 100 of the virtual reality-based education system 10 according to an embodiment of the present invention includes a control unit 110, a menu selection unit 120, a level selection unit 130, and a course selection unit. It may include (140) and a subject selection unit (150). Additionally, in some cases, the server 100 may further include a learning history management unit 160, a learning evaluation unit 170, a behavior evaluation unit 176, and a feedback unit 180.

While the control unit 110, menu selection unit 120, level selection unit 130, course selection unit 140, and subject selection unit 150 are essential components of the server 100, the learning history management unit 160 ), the learning evaluation unit 170, the behavior evaluation unit 176, and the feedback unit 180 can be said to be optional components of the server 100.

The control unit 110 is a component that controls and coordinates the functions of each component of the server 100.

The server 100 of the virtual reality-based education system 10 according to an embodiment of the present invention is provided with a communication unit 191, so that people with developmental disabilities only need the HMD device 200 and the hand motion controller 300 and 600 without a separate terminal. Virtual reality-based training can be implemented.

The communication unit 191 can exchange data related to hands-on training with the HMD device 200 and the hand motion controllers 300 and 600 through wireless communication. The server 100 can transmit graphic images necessary for implementing virtual reality images to the HMD device 200 through the communication unit 191, and the movements of the hand motion controllers 300 and 600 are transmitted to the server 100 through the communication unit 191. can be passed on. In some cases, the HMD device 200 and the hand motion controllers 300 and 600 may exchange data directly through wireless communication.

The communication unit 191 can send and receive data using various known wired or wireless communication methods.

The graphic rendering engine 193 is an engine that generates a virtual reality image displayed on the HMD device 200. If there is a request to modify or update the education scenario and content by the learning history management unit 160, the control unit 110 commands the graphic rendering engine 193 to modify or update the virtual reality image displayed on the HMD device 200. You can.

The hand motion engine 195 uses the movement information of the hand motion controller 300,600 to create the shape of a developmentally disabled person holding the hand motion controller 300,600 or moving the hand motion controller 300,600 or the hand motion controller 300,600. ) can be used to express the state of performing learning in a virtual reality image displayed on the HMD device 200.

The server 100 includes a display unit 199 that presents arrows indicating items or equipment that a developmentally disabled person must check or select with the hand motion controller 300 or 600 within the virtual reality image displayed on the HMD device 200. It can be included. That is, the display unit 199 can display a guidance indicator on a virtual reality image displayed on the HMD device 200 to prevent people with developmental disabilities receiving learning or education from making mistakes. The display unit 199 may or may not display a guidance display depending on the level of the person with a developmental disability, the number of training sessions, and the level of training difficulty.

The control unit 110 can selectively turn on/off the function of the display unit 199 using data from the learning evaluation unit 170 or the feedback unit 180. That is, the control unit 110 can automatically turn on/off the function of the display unit 199 regardless of the selection of the developmentally disabled person.

The server 100 may include a voice guidance unit 197 that outputs a voice guidance explaining educational procedures, learning methods, or content contents to people with developmental disabilities.

The server 100 configured as above can provide learning scenarios and content according to the adaptability of the developmentally disabled person to the HMD device 200.

Unlike normal people, people with developmental disabilities may feel reluctant to wear the HMD device 200, and the HMD device 200 may block their field of vision and may feel anxious due to the virtual reality image displayed on the HMD device 200. . If this happens, learning or education for people with developmental disabilities becomes impossible.

In order for the virtual reality-based education system 100 according to an embodiment of the present invention to be helpful to people with developmental disabilities, the people with developmental disabilities should not have any aversion to wearing the HMD device 200 and the hand motion controllers 300 and 600. The virtual reality-based education system 10 according to an embodiment of the present invention is characterized by first checking the adaptability of the developmentally disabled person to the HMD device 200 and then proceeding with the learning process.

While a developmentally disabled person is wearing the HMD device 200, the menu selection unit 120 may be displayed on the virtual reality image displayed on the HMD device 200. The menu selection unit 120 may be expressed as a 3D character string image or a graphic image in a virtual reality image. A developmentally disabled person can use the hand motion controllers 300 and 600 to select various menus displayed in the menu selection unit 120 and proceed to the next step.

The menu selection unit 120 may basically include a menu for selecting the level selection unit 130, course selection unit 140, and subject selection unit 150.

The guardian or teacher in charge of the developmentally disabled person may transmit the personal data or learning ability data of the developmentally disabled person to the database 500 using the teacher terminal 400.

Personal data of people with developmental disabilities may include age, gender, degree of developmental disability, favorite objects (people, characters, etc.), purpose of self-study, peer relationships (whether friends are present), intention to enroll in offline educational institutions, etc. Learning ability data for people with developmental disabilities may include language proficiency, self-study experience, preferred subjects, and intellectual level.

The server 100 of the virtual reality-based education system 10 according to an embodiment of the present invention analyzes the personal data and learning ability data of the developmentally disabled person transmitted and stored in the database 500 to create a learning scenario or curriculum customized to the developmentally disabled person. can be provided.

On the other hand, if a person with a developmental disability is not accustomed to or has an aversion to wearing the HMD device 200, the person with a developmental disability may select the menu selection unit 120 shown in the virtual reality image displayed on the HMD device 200 using a hand motion controller ( 300,600), it is difficult to choose.

If a developmentally disabled person cannot select the menu selection unit 120 within a certain period of time while wearing the HMD device 200 or the pointing point of the hand motion controller 300 or 600 changes significantly, the control unit 110 may It can be determined that the user is not adapting to the HMD device 200. The control unit 110 may transmit a determination result that the person with a developmental disability has not adapted to the HMD device 200 to the database 500 and force a sub-menu of the level selection unit 130 to be selected. That is, the control unit 110 forcibly selects the first level 132 from the submenu of the level selection unit 130.

When the first level 132 is selected, content that helps the developmentally disabled person become familiar with the HMD device 200 and the hand motion controllers 300 and 600 is displayed on the screen of the HMD device 200. To help people with developmental disabilities feel familiar with the state of wearing the HMD device 200 and to prevent them from experiencing dizziness, content in which people with developmental disabilities can find interest or feel emotional stability, for example, can listen to mother's video and mother's voice. You can promote the psychological stability of people with developmental disabilities by showing them characters or games that are familiar to them.

The control unit 110 of the server 100 analyzes the personal data of the developmentally disabled person stored in the database 500 to find an object with which the developmentally disabled person feels familiar, and controls the display unit 199 to create the object in a virtual reality image. You can.

In this way, the server 100 can provide content that can promote the mental or physical stability of the developmentally disabled person while wearing the HMD device 200 through the HMD device 200.

The level selection unit 130 selects the first level level 132 when the developmentally disabled person's adaptability to the HMD device 200 is below the standard or when using the HMD device 200 for the first time. In the case of level 132, content that developmentally disabled people do not feel uncomfortable can be provided based on personal tendency data about people with developmental disabilities.

The server 100 provides the next level learning scenario or content only when the developmentally disabled person has sufficiently experienced the learning scenario or content provided at the first level of the level selection unit 130 and has become familiar with the HMD device 200. can do.

When a developmentally disabled person is not disturbed by the virtual phenomenon image displayed on the HMD device 200 or performs the presented menu well while wearing the HMD device 200 and the hand motion controller 300,600, or when the hand motion controller 300,600 If it moves well as intended, the control unit 110 may determine that the developmentally disabled person has adapted to the HMD device 200, etc.

The server 100 provides scenarios and content (i.e., content at the first level) that help the developmentally disabled person adapt to the HMD device 200 according to the degree of adaptability to the HMD device 200, and allows the developmentally disabled person to use the HMD device 200. If there is no resistance to wearing the device 200, learning scenarios and content can be provided.

If a person with a developmental disability has adapted to the HMD device 200 and the hand motion controller 300 or 600 to the extent that self-education is possible, the person with a developmental disability can use the content included in the virtual reality image displayed on the HMD device 200. Able to understand and follow instructions.

The server 100 includes a menu selection unit 120 that selects a menu for learning for people with developmental disabilities; A level selection unit 130 that selects a learning level according to the learning level of the developmentally disabled person or adaptability to the HMD device 200; Course selection unit (140) that presents learning patterns for people with developmental disabilities; and a subject selection unit 150 that presents learning subjects for people with developmental disabilities.

First, a person with a developmental disability can select the learning menu he or she wants from among the menus presented in the menu selection unit 120. For example, one menu from the level selection unit 130, course selection unit 140, or subject selection unit 150 can be selected. At this time, the developmentally disabled person can execute the menu by moving the hand motion controller (300, 600) and pointing to the desired menu.

As shown in FIG. 4, the level selection unit 130 is displayed on the virtual reality image displayed on the HMD device 200, and provides a first level level ( 132), it may include submenus of the second level 134, the third level 136, and the fourth level 138.

As described above, if a person with a developmental disability is unable to adapt to the HMD device 200, the server 100 or the control unit 110 may forcibly select the first level 132 regardless of the will of the person with a developmental disability. A developmentally disabled person who has adapted to the HMD device 200 to some extent may select the first level 132 on his or her own.

The level selection unit 130 provides submenus based on the level of the developmentally disabled person's adaptability to the HMD device 200 as well as the level of the educational scenario, content, or curriculum provided by the virtual reality-based education system 10.

When a developmentally disabled person selects one of the second level 134, third level 136, or fourth level 138 in the level selection unit 130, a guide message for the selected level is displayed on the HMD device. It may be presented as a video in 200 or to a person with developmental disabilities through the voice guidance unit 197 of the server 100.

If it is determined that the developmentally disabled person follows the presented guidance text or voice guidance instructions well, the control unit 110 may select a course or subject corresponding to each level.

If it is determined that the developmentally disabled person is unable to follow the presented guidance text or voice guidance instructions, the control unit 110 may forcibly execute the first level 132.

The menu of the course selection unit 140 or the subject selection unit 150 for each level belonging to the level selection unit 130 may be presented to the developmentally disabled person.

However, the server 100 or the control unit 110 selects the course selection unit 140 and the subject selection unit 150 only when the developmentally disabled person passes the first level 132 of the level selection unit 130. You can control to select submenus.

As shown in FIG. 5, the course selection unit 140 can present the courses of homeschooling (142), social education (144), learning play (146), and device education (148) to people with developmental disabilities. That is, a developmentally disabled person can learn the desired course by selecting the four courses of the course selection unit 140 presented in the virtual reality image of the HMD device 200 using the hand motion controller 300 and 600.

The course selection unit 140 provides homeschooling (142) courses that allow people with developmental disabilities to complete prescribed education at home and provide information to members of educational institutions in case people with developmental disabilities receive offline education at educational institutions such as schools. A social skills education (144) course that teaches interpersonal relationships can be provided.

The homeschooling (142) course in the course selection department (140) provides education for developmentally disabled people to complete elementary, middle, and high school courses. The homeschooling (142) course is suitable for people with developmental disabilities whose intellectual abilities are not significantly different from those of normal people. However, rather than providing a full range of education that can replace school, the homeschooling (142) process can be said to be a preparation process for people with developmental disabilities to attend educational institutions such as schools and receive offline education.

The social education (144) course of the course selection unit (140) is an education course on peer relationships necessary in addition to subject learning skills when a developmentally disabled person attends school in person and receives offline education. In other words, it is an educational course that helps students get along well with their friends and adapt well to peer society in virtual reality. Additionally, education can be provided on relationships with teachers at school in addition to friends.

If the social skills education (144) course is selected, the developmentally disabled person can experience the virtual reality of living in a classroom with peers through the virtual reality image of the HMD device 200, and the server 100 allows the developmentally disabled person to interact with peers. We can provide a variety of social education scenarios so that you can gain experience in coping with problems.

The learning play (146) course of the course selection unit (140) can be linked to the social education (144) course to provide learning experiences such as engaging in physical education in virtual reality or playing simple games with peers. .

The device training 148 of the course selection unit 140 is a process of training people with developmental disabilities how to use the HMD device 200 and the hand motion controller 300 and 600. The device training 148 process may provide a learning scenario linked to the first level 132 of the level selection unit 130.

As shown in FIG. 6, the subject selection unit 150 of the server 100 selects learning subjects including Korean language education (152), English education (154), mathematics education (156), and arts and physical education (158). provides.

A developmentally disabled person can experience learning of a subject by selecting a sub-menu of the subject selection unit 150 presented in the virtual reality image of the HMD device 200 worn.

If Korean language education (152) is selected in the subject selection section (150), word learning, sentence learning, etc. can be selected depending on the learning level or intellectual ability of the developmentally disabled person.

When word learning is selected, the server 100 displays letters (words) for objects on which the gaze of a person with a developmental disability stays for a certain period of time or more on the virtual reality image presented on the HMD device 200, and the server 100 displays the corresponding letter ( You can be encouraged to pronounce words). A microphone (not shown) may be provided in the HMD device 200 to listen to the sound of a developmentally disabled person pronouncing letters (words).

When Korean language education 152 is selected, the server 100 selects an object that is the target of word learning from among various objects (e.g., objects, people, etc.) expressed in the virtual reality image displayed on the HMD device 200. Objects can be marked to distinguish them from other objects (for example, by highlighting or blinking the object) and have the object be pronounced by a person with a developmental disability. However, it is desirable to apply this type of education when the developmentally disabled person has adapted to Korean language education (152) to some extent.

If a person with a developmental disability is at level 2, he or she may not be able to recognize a blinking object in a virtual reality image and may feel anxious due to the blinking object. The virtual reality-based education system 10 according to an embodiment of the present invention is characterized by giving learning initiative to the developmentally disabled so that they can receive Korean language education in a psychologically stable state.

Therefore, the virtual reality-based education system 10 according to an embodiment of the present invention allows the developmentally disabled person's gaze to stay for more than a certain period of time (reference time) among the word learning target objects expressed in the virtual reality image of the HMD device 200. By using objects as the object of word learning, people with developmental disabilities can learn words about objects (things) they know.

For example, when the control unit 110 of the server 100 discovers an object in a virtual reality image where the gaze of a person with a developmental disability stays for more than a certain period of time (standard time), it causes the display unit 199 to make the object blink or shine brightly. By creating it, you can encourage developmentally disabled people to learn words for the object. Additionally, if it is correct that the developmentally disabled person pronounced the object in question, the letter corresponding to the object may be displayed on the image and the pronunciation of the object may be played in the voice guidance unit 197.

If the developmentally disabled person fails to pronounce the object correctly, the server 100 changes the virtual reality image to change the mood of the developmentally disabled person, rather than repeatedly inducing pronunciation of the same object, and then provides word training for a different object. It is advisable to try.

In addition, the server 100 corrects the pronunciation of a person with a developmental disability recognized through the microphone of the HMD device 200, and takes into account the learning ability of the person with a developmental disability and uses words related to objects similar to the object to be pronounced and familiar to the person with a developmental disability. You can correct your pronunciation by using examples.

In addition, the server 100 not only pronounces a word for an object on which the gaze of a person with a developmental disability stays for a certain period of time among the virtual reality images displayed on the HMD device 200, but also provides a word corresponding to the object (e.g. , the name of the object) can be used to learn how to create sentences. At this time, the server 100 may analyze the objects or fields in which the developmentally disabled person is interested in the database 500 and conduct learning to use the words of the object in sentences of fields in which the developmentally disabled person may be interested. Additionally, to increase the learning effect, play using sentences containing words for the object can be shown as a virtual reality video and allowed for people with developmental disabilities to experience it.

Meanwhile, when a developmentally disabled person selects English education 154 from the subject selection unit 150, the server 100 may provide learning scenarios, content, or curriculum similar to those of Korean language education 152.

English education (154) requires higher learning ability than Korean language education (152). In general, many people with developmental disabilities are not familiar with Korean, so teaching English to people with developmental disabilities who are not familiar with Korean can be even more difficult.

The virtual reality-based education system 10 according to an embodiment of the present invention can provide various learning scenarios different from Korean language education to increase the effectiveness of English education for developmentally disabled people. For example, in addition to learning English words for objects (objects or people) expressed in virtual reality images, English songs containing the objects can be used for learning, or simple games can be used for learning.

In addition, when English education 154 is selected, the server 100 of the virtual reality-based education system 10 according to an embodiment of the present invention considers the English learning ability or level of the developmentally disabled person and uses TESOL-based education. of English education scenarios or content can be provided.

TESOL (Teaching English to Speakers of Other Languages) provides education on how to teach English to people whose native language is not English. The server 100 can conduct English learning for developmentally disabled people based on a TESOL-based curriculum.

When mathematics education 156 is selected from the subject selection unit 150, the server 100 may provide mathematics education scenarios and content considering the learning level or learning ability of the developmentally disabled person.

When arts and physical education 158 is selected from the subject selection unit 150, the server 100 can provide music education, simple physical education, and simple art education such as drawing to the developmentally disabled. Physical education and art education are conducted by developmentally disabled people using hand motion controllers (300, 600). In addition, the arts and physical education education 158 may provide learning in connection with the learning play 146 of the course selection unit 140.

Meanwhile, referring to FIG. 3, the server 100 of the virtual reality-based education system 10 according to an embodiment of the present invention includes a learning history management unit 160 that manages learning history data of people with developmental disabilities; Learning Evaluation Department (170), which evaluates the learning outcomes of people with developmental disabilities; Behavioral Evaluation Department (176), which evaluates the behavior of developmentally disabled people during the learning process; and a feedback unit 180 that delivers the evaluation results of the learning evaluation unit 170 and the behavior assessment unit 176 to the guardian of the developmentally disabled person or the responsible child care institution.

The learning history management unit 160 stores the history of the learning experience of the developmentally disabled person by selecting the submenus of the menu selection unit 120, level selection unit 130, course selection unit 140, and subject selection unit 150. and analysis. The learning history data of the developmentally disabled person may be stored in the database 500, and the learning history management unit 160 can analyze and manage the learning history of the developmentally disabled person in conjunction with the database 500.

The learning history management unit 160 can analyze the learning history of the developmentally disabled person and inform the guardian of the developmentally disabled person of areas that are lacking or areas where the level needs to be raised or lowered.

The learning history management unit 160 can update the virtual reality images presented in the submenus of the course selection unit 140 and the subject selection unit 150. That is, the content of the virtual reality image displayed on the HMD device 200 can be updated or changed in the submenu of the course selection unit 140 and the subject selection unit 150 to improve the learning progress of the developmentally disabled person.

The learning evaluation unit 170 is a part that evaluates the learning achievements of the developmentally disabled, and the behavior evaluation part 176 is a part that evaluates the social education results of the developmentally disabled.

The evaluation results of the learning evaluation unit 170 and the behavior evaluation unit 176 may be not only stored in the database 500 but also transmitted to the feedback unit 180.

The feedback unit 180 can receive data from the learning history management unit 160, the learning evaluation unit 170, and the behavior evaluation unit 176 and deliver it to the guardian of a person with developmental disabilities or a teacher at an educational institution (school).

The teacher receives the learning-related data (including learning history and evaluation data) of the developmentally disabled person received from the feedback unit 180, determines whether the developmentally disabled person can receive offline education at the educational institution, and reports the results to the feedback unit ( 180). If the educational institution determines that offline education can be received, the contents are transmitted to the feedback unit 180, and if it is determined that offline education cannot be received, the results are not simply transmitted, but the offline education is required due to some aspect. A message informing that offline training can be received can be sent to the feedback unit 180 if the inappropriate part needs to be supplemented.

The feedback unit 180 analyzes the feedback results to derive a learning scenario that is helpful for people with developmental disabilities to receive offline education at educational institutions and transmits it to the database 500, the learning history management unit 160, and the control unit 110. there is.

The virtual reality-based education system 10 according to an embodiment of the present invention recommends a learning process necessary for the developmentally disabled person based on the teacher or guardian's wishes, personal data of the developmentally disabled person, etc. in addition to the selection of the developmentally disabled person, and finally The goal may be to enable people with developmental disabilities to receive offline education at school institutions.

The system or device described above may be implemented with hardware components, software components, and/or a combination of hardware components and software components. For example, devices and components described in embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA), It may be implemented using one or more general-purpose or special-purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. A processing device may execute an operating system (OS) and one or more software applications that run on the operating system. Additionally, a processing device may access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, a single processing device may be described as being used; however, those skilled in the art will understand that a processing device includes multiple processing elements and/or multiple types of processing elements. It can be seen that it may include. For example, a processing device may include multiple processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are possible.

Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or may be processed independently or collectively. You can command the device. Software and/or data may be used on any type of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted by or to provide instructions or data to a processing device. , or may be permanently or temporarily embodied in a transmitted signal wave. Software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

As described above, the embodiments of the present invention have been described with specific details such as specific components and limited examples and drawings, but this is only provided to facilitate a more general understanding of the present invention, and the present invention is limited to the above embodiments. This does not mean that various modifications and variations can be made from this description by those skilled in the art. Accordingly, the spirit of the present invention should not be limited to the described embodiments, and the claims described below as well as all modifications that are equivalent or equivalent to the claims shall fall within the scope of the spirit of the present invention.

10: Virtual reality-based education system for self-learning of developmentally disabled people
100: server 110: control unit
120: Menu selection unit 130: Level selection unit
140: Course selection department 150: Course selection department
160: Learning history management department 170: Learning evaluation department
176: Behavior evaluation department 180: Feedback department
191: Communication Department 193: Graphics rendering engine
195: Hand motion engine 197: Voice guidance unit
199: display unit 200: HMD device
300,600: Hand motion controller 400: Teacher terminal
500: Database

Claims (10)

A server that stores and executes learning scenarios and content; and
A HMD device mounted on the head of a developmentally disabled person and displaying a virtual reality image containing the learning scenario and content;
A virtual reality-based education system for self-study of the developmentally disabled, wherein the server provides learning scenarios and content according to the adaptability of the developmentally disabled to the HMD device.
According to paragraph 1,
The server provides scenarios and content that help the developmentally disabled person adapt to the HMD device according to his or her adaptability to the HMD device,
A virtual reality-based education system for self-study of the developmentally disabled, characterized in that it provides learning scenarios and content when the developmentally disabled person does not feel uncomfortable wearing the HMD device.
According to paragraph 2,
The server is,
A virtual reality-based education system for self-study of the developmentally disabled, characterized in that content that can promote mental or physical stability of the developmentally disabled person while wearing the HMD device is provided through the HMD device.
According to paragraph 1,
The server is,
A menu selection unit that selects a menu for learning for people with developmental disabilities;
a level selection unit that selects a learning level according to the learning level of the developmentally disabled person or adaptability to the HMD device;
Course selection section that presents learning patterns for people with developmental disabilities; and
A virtual reality-based education system for self-study of the developmentally disabled, comprising a subject selection section that presents learning subjects for the developmentally disabled.
According to paragraph 4,
The level selection unit,
If the developmentally disabled person's adaptability to the HMD device is below the standard or if it is the first time to use the HMD device, the first level is selected,
In the case of the first level, a virtual reality-based education system for self-study of the developmentally disabled, characterized in that it provides content that the developmentally disabled do not object to, based on personal preference data for the developmentally disabled.
According to clause 5,
The server is,
A virtual reality-based education system for self-study of the developmentally disabled, characterized in that it controls the sub-menu of the course selection unit and the subject selection unit to be selected only when the developmentally disabled person passes the first level of the level selection unit. .
According to clause 6,
The course selection department,
It is characterized by providing a homeschooling course that allows people with developmental disabilities to complete a certain amount of education at home and a social education course that teaches interpersonal relationships with members of educational institutions in preparation for cases where people with developmental disabilities receive offline education at educational institutions. A virtual reality-based education system for self-learning for developmentally disabled people.
According to clause 6,
The subject selection department provides any one of Korean language education, English education, and mathematics education,
When Korean language education is selected by the subject selection unit, the server,
For the image presented on the HMD device, letters are shown for objects on which the gaze of the person with a developmental disability resides for a certain period of time, and the person with a developmental disability is encouraged to pronounce the letter, and the pronunciation of the person with a developmental disability recognized through the HMD device is corrected. A virtual reality-based education system for self-study of the developmentally disabled, which takes into account the learning ability of the developmentally disabled and corrects pronunciation by using words similar to the object and familiar to the developmentally disabled as examples.
According to clause 8,
When English education is selected by the subject selection unit, the server,
A virtual reality-based education system for self-study of the developmentally disabled, characterized by providing TESOL-based English education in consideration of the English learning ability or level of the developmentally disabled.
According to any one of claims 4 to 9,
The server is,
Learning History Management Department, which manages learning history data of people with developmental disabilities;
Learning Evaluation Department, which evaluates the learning outcomes of people with developmental disabilities;
Behavioral Evaluation Department, which evaluates the behavior of developmentally disabled people during the learning process; and
A virtual reality-based education system for self-study of the developmentally disabled, comprising a feedback unit that delivers the evaluation results of the learning evaluation unit and the behavior evaluation unit to the guardian of the developmentally disabled person or the child care institution in charge.