KR20180034278A - Visual perception training device, method and program for visual perception training using head mounted device - Google Patents

Abstract

The present invention relates to a computing device, a method, and a program to provide a visual perception training based on a head mount display device. According to an embodiment of the present invention, the visual perception training providing method includes: a step (S200) in which a computer provides a first object to a first screen of the head mount display device and provides a second object to a second screen of the head mount display device; a step (S400, user control receiving step) in which the computer receives control from a user for adjusting a positional relation between the first and second objects; a step (S600, screen position changing step) in which the computer changes positions of the first and second screens in accordance with the control; and a step (S800) in which visual perception content is outputted within the patient′s visual field including a damaged vision area around the center of the sight.

Description

TECHNICAL FIELD [0001] The present invention relates to a computing device providing visual perception training, a method of providing visual perception training based on a head mount display device, and a program,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a computing device that provides visual perception training, a method of providing visual perception training based on a head mounted display device, and a program.

In general, stroke is the sole cause of domestic illness as a single disease, and brain damage due to stroke is a major obstacle, with visual disturbances occurring at a high rate of 20-30% of the total patients. These visual field disturbances are usually accepted as permanent defects, and there is no real attempt to treat visual field disorders. Brain damage to the visual cortex following stroke is characteristic of hemianopia on the opposite side of the lesion . For example, a patient with a stroke on the left visual cortex has a right hemispheric visual field disorder, in which the patient does not recognize objects or movements in the right visual field when both eyes are open and facing the front.

However, in some patients with visual field disorders due to a stroke occurring in the visual cortex, some movements or shapes are noticed in the invisible field. In this case, X or O is shown in the invisible field and the patient is not seen While responding, it is probable that the letters are aligned above the chance level and even respond appropriately to visual stimuli. These patients do not visually perceive the stimulus, but the brain is aware of the movement or shape. This phenomenon, discovered by Lawrence Weiskrantz in the 1970s, is called blindsight, which is a phenomenon noticed even when invisible. The existence of the vignetting phenomenon suggests that the visual information entered through the retina can be processed through other than the visual cortex.

Therefore, there is a need for a visual perception training method and apparatus for performing visual perception learning (training) by providing repetitive visual perception stimuli to improve visual perception function.

In the case of conventional visual perception training, the distance and height from the patient's eye position to the monitor are set, the visual perception training screen is displayed on the monitor, and the difficulty level of the visual perception training screen is set in analog manner according to the patient's correct answer rate . Therefore, it is difficult for the patient to continue training in a place other than the hospital, and there is a problem that it is difficult to flexibly change the difficulty adaptively according to the change of the patient's visual perception ability.

The present invention provides a computing device that provides visual perception training, wherein the patient provides visual perception training by initially setting visual perception training conditions suitable for the patient using a head-mounted display device, calculating training levels appropriate for the patient ' And to provide a visual guidance training method and program based on a head mount display device.

The problems to be solved by the present invention are not limited to the above-mentioned problems, and other problems which are not mentioned can be clearly understood by those skilled in the art from the following description.

According to an aspect of the present invention, there is provided a method of providing visual guidance training based on a head mounted display device, the method comprising: providing a first object on a first screen of the head mounted display device; Providing a second object; Receiving a user operation for adjusting a positional relationship between the first object and the second object from a user; Changing a position of the first screen and the second screen according to the operation of the computer; And outputting visual content to a visual range of a patient including a visual impairment area based on a view center direction, wherein the first screen includes a left-eye screen and a right-eye screen of the head-mounted display device And the second screen is not the first screen among the left-eye screen and the right-eye screen of the head-mounted display device.

According to another embodiment of the present invention, the user operation receiving step may be performed by a user to position the first object and the second object on a target point, and at least one of the first object and the second object One is a sports object.

In another embodiment, the computer further includes storing the first screen and the output condition of the second screen for a specific user.

According to another embodiment of the present invention, the visual content output step is to provide any one of a plurality of images at at least one point on a two-dimensional or three-dimensional space for each trial, ≪ / RTI > with the provided image type.

According to another embodiment of the present invention, the step of outputting the display content contents includes the steps of: convergently matching the first screen and the second screen at a central point; And displaying the object corresponding to the visual content on a specific depth in the specified two-dimensional space based on the depth point of the center point.

According to another embodiment of the present invention, the method further includes calculating a percentage of correct answers for each point on the two-dimensional or three-dimensional space to set a visual perception impairment area of the user.

Further, in another embodiment, the computer further includes determining at least one of a task provision frequency, a task difficulty, and an output image size of the task for each point based on the periodically calculated visual field impairment area.

According to another aspect of the present invention, there is provided a method of detecting a head movement of a user or a movement in a pupil direction, thereby searching for a direction of a view center, and providing a task based on a relative position based on the view center direction.

The visual-angle training providing program based on the head-mounted display device according to another embodiment of the present invention, in combination with a computer which is hardware, executes the visual-angle training providing method based on the aforementioned de-mounted display device and is stored in the medium .

A computing device for providing visual field training according to an embodiment of the present invention includes a first object on a first screen of a head mounted display device, a second object on a second screen of the head mounted display device And a controller for receiving a user operation for adjusting a positional relationship between the first object and the second object from a user and changing a position of the first screen and the second screen according to the user operation, Wherein the first screen is one of a left-eye screen and a right-eye screen of the head-mounted display device, and the second screen is one of a head-mounted display It is not the first screen among the left-eye screen and the right-eye screen of the apparatus.

According to the present invention as described above, the following various effects are obtained.

According to an embodiment of the present invention, a user can perform visual perception training using a visual perception training device regardless of a place.

According to an embodiment of the present invention, the user can automatically adjust the first and second screen positions suitable for the user's eye state in the course of performing the initial setting game.

In addition, according to the embodiment of the present invention, unlike the conventional visual perception training method, it is possible to accurately and flexibly adjust the difficulty level of the visual perception training according to the visual impairment state of the patient.

FIG. 1 is a flowchart of a method of providing visual field training based on a head-mounted display device according to an embodiment of the present invention.
FIG. 2 is an exemplary diagram illustrating a change of positions of a first screen and a second screen according to an embodiment of the present invention. Referring to FIG.
Figure 3 is a flow diagram of a method of providing visual field training based on a head mounted display device that provides visual field stimulation on a three dimensional space in accordance with an embodiment of the present invention.
FIG. 4 is a flowchart of a method for providing visual perception training based on a head-mounted display device, which further includes evaluating a user's response according to an embodiment of the present invention.
FIG. 5 is a flowchart illustrating a method of providing visual perception training based on a head-mounted display device, which further includes storing a screen output condition for a specific user according to an exemplary embodiment of the present invention.
FIG. 6 is a flowchart illustrating a method of providing visual field angle training based on a head-mounted display device, which further includes calculating a visual field impairment area according to an embodiment of the present invention.
FIG. 7 is an exemplary diagram of a correct answer rate distribution diagram according to an embodiment of the present invention. FIG.
FIG. 8 is a flowchart illustrating a method of providing visual field training based on a head-mounted display device, which further includes a process of adjusting difficulty level based on a visual field impairment area according to an embodiment of the present invention.
9 is a structural diagram of a computing device that provides visual perception training in accordance with an embodiment of the present invention.
10 is an exemplary view for providing a visual angle training image to a head-mounted display device according to an embodiment of the present invention.
FIG. 11 is an exemplary view comparing the visual field seen by a normal person and a visual perception disorder patient due to brain damage.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense commonly understood by one of ordinary skill in the art to which this invention belongs. Also, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise.

The terminology used herein is for the purpose of illustrating embodiments and is not intended to be limiting of the present invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. The terms " comprises "and / or" comprising "used in the specification do not exclude the presence or addition of one or more other elements in addition to the stated element.

As used herein, the term " computer " includes all of the various devices capable of performing arithmetic processing. For example, the computer may be a smart phone, a tablet PC, a cellular phone, a personal communication service phone (PCS phone), a synchronous / asynchronous A mobile terminal of IMT-2000 (International Mobile Telecommunication-2000), a Palm Personal Computer (PC), a personal digital assistant (PDA), and the like. Further, the computer may correspond to a server computer that receives information from the client. Hereinafter, the computer may be expressed as a terminal or a client.

In this specification, the 'first screen' means a left-eye screen or a right-eye screen of the head-mounted display device.

In this specification, the 'second screen' means that the first screen is not the first screen among the left-eye screen and the right-eye screen of the head-mounted display device.

In the present specification, 'visual perception training image' means an image provided on the screen for visual perception training. The 'visual training training image' includes an output image displayed at a specific position for visual stimulus.

The term " first problem " herein refers to a problem presented on the screen to provide visual perception training to a patient having visual field impairment.

In the present specification, the 'first response' means a response to the first question provided at a specific time point.

The 'second problem' in the present specification means a problem provided for fixing the user's gaze direction to the center of the screen. For example, the 'second problem' may be to display any one of a plurality of objects (for example, k or i) distinguished at the center of the screen at the center of the screen at a specific point in time.

In the present specification, the 'second response' means a response received from the user for the second problem.

In the present specification, the term 'output image' means an image provided at a specific position on the screen by the first problem. For example, the 'output image' may be a horizontal or vertical striped image displayed within a specific quadrant of the screen.

In the present specification, 'screen image' is the screen itself in which one or more output images are arranged according to the first problem. The screen image can be output to a general display device or output to a head-mounted display device. When a head-mounted display device is provided with a screen image, the screen image may be generated as a left-eye image and a right-eye image, respectively.

In the present specification, the 'central visual field' means a central area within a screen provided to a user.

In the present specification, the 'peripheral vision part' means the remaining area except the central vision part in the screen.

In the present specification, a 'task display unit' refers to an area where an output image, which is a task of memory training, is provided in a screen provided to a user. The 'task display unit' may include only the peripheral visual field except for the central visual field, and may include both the central visual field and the peripheral visual field.

In the present specification, the term 'head-mounted display device' refers to a device for providing a visual field training image to the user's eyes. The 'head mounted display device' may be a device used in connection with a computer (for example, a PC or a smart phone) or a device including a computing function.

FIG. 1 is a flowchart of a method of providing visual field training based on a head-mounted display device according to an embodiment of the present invention.

Referring to FIG. 1, a method for providing viewing angle training based on a head-mounted display device according to an embodiment of the present invention includes: providing a first object on a first screen of the head-mounted display device; Providing a second object on a second screen of the device (S200); Receiving a user operation for adjusting a positional relationship between the first object and the second object from a user (S400: user operation receiving step); Changing a position of the first screen and the second screen by the computer according to the user operation (S600; And outputting the visual content to the visual range of the patient including the visual impairment area based on the visual center direction (S800). Hereinafter, a detailed description of each step will be described.

Patients with visually impaired functions due to stroke or other causes are not visible in some areas of the visual field, unlike normal subjects. 11 (a), when the right lower end of the visual range is not visible due to an abnormality in the visual cortex of the left brain, as shown in FIG. 11 (b) Children will not be able to visually confirm. As shown in Fig. 11 (c), when the visual cortex is severely damaged, the patient can not properly recognize the object in a region other than the central portion.

In patients who have had problems with visual perception due to stroke, for example, patients who do not see a certain area within the visual field, they visit the hospital to receive visual perception training to improve visual perception function. Respectively. Specifically, a visual perception training image for visual stimulus was provided on a monitor screen, and training was performed with a head placed at a predetermined distance and height. In other words, it was possible to proceed with training under the precise conditions and proceeded only by visiting the hospital.

Recently, a head mount display device capable of providing a virtual reality image has become popular, and a desired type of image can be provided to a patient. However, the head mount display device can be provided with a convergence of binocular or binocular vision in accordance with the user's eyes. The condition in which the eyes meet in both eyes). There is a need for a method for implementing a screening condition that is appropriate for a patient with visual impairment in a portion of the visual field range.

Generally, when looking at an object in the real space, the convergence of the binocular focal point converges toward the object. However, when the head-mounted display device is used, the left eye image and the right eye image are provided in both eyes, There is a problem that can not be achieved. Conventional virtual reality contents can be viewed normally by processing information in the brain even if convergence matching of both sides is not performed due to use of users whose visual perception ability is normal. However, in patients with visual impairment, it may be difficult to replace the convergence matching process in the brain, and visual stimuli to improve visual perception ability may not be properly provided, resulting in decreased visual perception . Therefore, in order to provide optimal visual perception training for visual perception patients, an initial setup process is required to match the focus (ie, convergence) of both eyes of the patient.

A computer provides a first object on a first screen of the head-mounted display device and a second object on a second screen of the head-mounted display device in step S200. That is, the computer provides the object to the left-eye screen and the right-eye screen of the head-mounted display device, respectively. The first object and the second object may be the same or different.

The computer receives a user operation for adjusting the positional relationship between the first object and the second object from the user (S400: user operation receiving step). That is, the user adjusts the positions of the first object and the second object by inputting a user input for adjusting the position when the first object and the second object do not match with each other.

For example, when the first object and the second object are the same output image, the user can input an operation for adjusting the same output image displayed on the first screen and the second screen to be precisely overlapped. Further, for example, when the first object and the second object are different output images (for example, the first object and the second object are different images that should be matched to the same position) (I.e., a target point) at which the object and the second object should be matched. That is, in the user operation receiving step (S400), the user receives an input operation for matching the positions of the first object and the second object on the target point.

According to another embodiment, at least one of the first object and the second object may be generated as a moving object. In this way, a game can be implemented as a process for performing an initial setting in accordance with a patient's eye condition before a patient performs visual perception training. For example, the first object is an arrow image, the second object is an image of the target, the center of the second object is set as a target point, and the arrow image of the first object is moved toward the target image, Lt; / RTI > If the arrow on the first screen does not match the center of the bull on the second screen, the user enters an input operation for adjusting the arrow image to reach the bull's-eye center.

The computer can receive an operation to move left or right or up and down from a user (i.e., a patient). For example, an operation for moving the first object or the second object from left to right or up and down through the controller for virtual reality from the user can be input. Further, the computer may receive an operation for rotating the first object or the second object from the user via the controller for virtual reality. In addition, the computer may receive an operation of adjusting the size of the first object and the second object provided on a screen of both eyes (i.e., the first screen and the second screen) from the user.

Thereafter, the computer changes the positions of the first screen and the second screen according to the operation (S600; screen position changing step). That is, as shown in FIG. 2, the computer adjusts the positions of the first and second screens based on the input operation so that the first object and the second object meet at the target point. The computer moves the first screen and the second screen by a specific shifting distance.

Thus, the computer can display the first screen and the second screen at a position where the sight line of the patient's eyes meet. That is, the computer can perform the convergence matching between the first screen and the second screen (i.e., the left-eye display screen and the right-eye display screen) according to a user's operation. That is, in general, the head-mounted display device physically adjusts the distance between the left-eye display and the right-eye display to match the positions of the eyes in the binocular direction, but by manipulating the first object and the second object to correspond The position of the first screen and the second screen can be adjusted by software to enable convergence matching.

Thereafter, the computer outputs the visual content in the visual range of the patient including the visual impairment area based on the visual center direction (S800; visual content output step). That is, the computer can provide the visual content (i.e., the visual field training image) in the field of view in a state in which the convergence matching is performed and the binocular images are superimposed on the patient's field of view.

The computer can provide visual stimuli to the field of view in a variety of ways. In one embodiment, the computer can provide visual perceptual stimuli (i.e., output images) throughout the field of view (i.e., the task display area) while changing positions. That is, the computer can provide visual stimuli to both the normal area and the visual impairment area within the field of view. The visual field stimulus provided in the normal region within the visual range stimulates the brain region to the visual impairment region and can restore the visual impairment region. Thus, the computer can provide a visual stimulus for the entire range within the field of view.

Further, in another embodiment, it is possible to intensively provide visual perception stimulation to an area in the visual impairment area. As will be described later, the computer can calculate the visual impairment area based on the results of the patient's training, provide the visual impairment only in the visual impairment area, or display the visual impairment in the visual impairment area at a higher rate than the normal area . In addition, the computer can provide visual perceptual stimuli (i.e., output images) at different rates to each point, depending on the level of visual perception of the user, even within the visual impairment area.

In addition, the computer can provide the visual training training images in various forms. In one embodiment, the computer may provide training (first problem) to allow the patient to select the type of screen image to be presented. That is, the computer provides any one of a plurality of images to at least one point on a two-dimensional or three-dimensional space for each trial.

The first problem is provided by changing at least one of the number, type, arrangement position and size of the output image, and it is possible to increase the number of options by varying the changing conditions. Thus, the computer provides training to select a plurality of screen images that can be generated according to the change condition of the first question.

In one embodiment, the computer may provide training (i. E., The first problem) to select from among a plurality of predetermined output images an image displayed at a particular point on the screen. For example, if the output image includes a horizontal stripe image and a vertical stripe image, the computer may provide a horizontal stripe image or a vertical stripe image for each trial within the task-providing area, can do.

In another embodiment, the first problem may be varied by changing the placement location of the output image included in the screen for each attempt to provide the first problem on the screen. For example, a computer can generate a different screen image by changing the location within the screen where the same output image is displayed. The position of the output image is changed when the task display unit is divided into a plurality of divided regions, the divided region in which the output image of the first problem is displayed is made different, or the point at which the output image is arranged in the same divided region is made different Lt; / RTI > The computer may allow the user to select which screen image (i.e., the layout of one or more output images) is provided to the patient.

In addition, if the output image can be generated at various depths by implementing the task display area in a three-dimensional space, the computer can generate various problem types by changing the depth at which the output image is displayed. For example, the computer can display the output image by dividing it into a near region or a far region from a reference depth (e.g., the depth at which the second problem is presented if the second problem is presented). The computer may allow the user to select which screen image (i.e., the layout of one or more output images) is provided to the patient.

Further, in another embodiment, the computer can change the type of output image (e.g., figure classification and character image classification, etc.) or shape (e.g., horizontal and vertical stripe patterns and vertical stripe patterns) Can be generated. For example, the computer may display different output images (e.g., horizontal stripe pattern and vertical stripe pattern) at the same position of the task display to create another problem.

Further, in another embodiment, the computer can generate a different first problem by varying the size of the output image while displaying the same output image type / shape at the same location.

In another embodiment, as shown in FIG. 3, the display content output step S800 includes: (S810) convergence-matching the first screen and the second screen at a center point; And displaying the object corresponding to the visual content on a specific depth in a specific two-dimensional space based on the depth point of the center point (S820). That is, the computer can provide visual perception stimuli at various depths after convergence matching to a central point in the three-dimensional space.

Specifically, when providing a second problem for fixing the gaze direction of the patient to the center point of the three-dimensional space (for example, a problem of inputting what is displayed on the screen out of a window or a window) Dimensional space that displays the output image included in the first problem based on the three-dimensional space placement position of the first space. In the three-dimensional space, the images provided on the left and right eyes (i.e., the left eye image and the right eye image) form a perspective based on the point where the convergence is formed. Accordingly, the computer performs convergence matching of the left eye image and the right eye image with respect to the second problem while arranging the second problem described below at a specific depth, arranges the output image according to the first problem at a specific depth, Based on the relative positional relationship with the second problem, a screen in which the output image is displayed at various depths can be implemented.

Further, in another embodiment, as in Fig. 4, the computer further includes a step S1000 of comparing the response inputted from the user with the provided image type for each trial. That is, the computer receives a first response, which is a response to the first task, and determines whether the first response is correct. For example, when horizontal stripes and vertical stripes are provided as an output image included in the first problem, the computer determines whether an image to be displayed at a specific position on the screen is input and receives the correct answer. The computer can calculate the correct answer rate by accumulating the correct answer result for a plurality of tests and calculate the correct answer rate per point in the two-dimensional or three-dimensional space, which is the field of view of the patient. The point-by-point rate of correctness can be used to generate a gradient map for determining the visual perception state of the patient as described below.

5, the computer may store the first and second screen output conditions for a specific user (S700). That is, the positional conditions of the first screen and the second screen corresponding to the eye condition of a specific user (i.e., the patient) are calculated and stored. Accordingly, when a plurality of patients perform visual perception training using a head-mounted display device, visual perception training can be performed by selecting setup information for a specific user.

6, a step S1200 of calculating a percent correctance ratio for each point on the two-dimensional or three-dimensional space and setting a visual perception impairment area of the user, as shown in FIG. 6. The computer can obtain per-branch correctness rates by providing visual stimuli (i.e., output images) at various points in the task delivery area. As shown in FIG. 7, the computer generates a gradient map in which the color of each point is expressed differently according to the correct answer rate distribution ratio or the correct answer rate of the task providing area based on the correct answer rate for each point. Thereafter, the computer calculates the visual angle impairment area by connecting points having a specific value based on the distribution of correct answer rate or the gradient map. Through this, the computer can grasp the change in the degree of visual impairment of the patient only by the result of the patient's training, without performing a separate test (for example, fMRI test).

Further, in another embodiment, as shown in FIG. 8, the computer determines at least one of a task provision frequency for each point, a task difficulty, and an output image size of the task based on the periodically calculated visual field impairment area (S1400). That is, the computer can determine the degree of difficulty of the visual perception training image (i.e., the task) by determining the visual perception ability state of the patient. Various methods can be applied to control the degree of difficulty of visual perception training images. For example, a computer can increase the degree of difficulty by reducing the brightness or saturation of the output image provided on the screen, or reducing the size of the output image. In addition, the computer can adjust the difficulty level by adjusting the number of output images appearing in the screen image. As the number of output images increases, the arrangement relationship between the output images becomes more diverse, so that the number of options to be selected by the patient is increased and the degree of difficulty can be increased.

Also, it is necessary to provide a visual stimulus to the visual impairment region based on the direction of the center of the patient's eyes. In order to confirm the visual stimulation through the normal region where the patients can not see the visual stimulus, It is necessary to prevent it.

To this end, in one embodiment, a second problem may be provided at the center of the field of view so that the first question, which is a visual perception stimulus, is provided and the first response is input while the visual direction is fixed at the center. Specifically, the computer provides a second problem displayed in the central field of view within the screen, and receives a second response from the user for the second problem. The second problem is to fix the user's gaze direction at a specific position. Preferably, the second problem is provided simultaneously with the first problem that is provided to one side of the task display unit so that the visual direction is fixed in the center direction at the time of enforcing the first problem. That is, a screen image for simultaneously displaying the first problem and the second problem on the screen is provided so that the user can check the first problem while watching the central viewport where the second problem is displayed.

Further, in another embodiment, the computer senses the user's head motion or pupil direction movement to search the direction of the view center direction, and provides a task based on the relative position based on the view center direction. That is, the computer may measure the direction of the user's gaze and determine and provide the position of the output image according to the first problem on the basis of the gaze direction. For example, since the user is provided with a screen image through the head mount display device, when the user wears the head mount display device and moves his / her head or the direction of the eyeball, the direction in which the same screen image is viewed changes. Accordingly, the computer recognizes the user's head movement or eye movement to obtain the gaze direction, and determines the placement position of the output image based on the gaze direction.

Specifically, the computer measures the movement of the user's head based on the head movement data obtained through the motion sensor included in the head-mounted display device. In addition, the computer measures eye movements based on eye movement data obtained by an eye movement sensor (i.e., eye-tracker) included in the head-mounted display device. Thereafter, the computer calculates the gaze direction (i.e., the center direction of the visual field range) when there is a head movement or an eye movement of the user. The computer then displays the output image centered on the line of sight (i.e., the center of the field of view) to produce the screen image provided for the particular implementation. That is, the output image arrangement position information in the first question is a relative position determined based on the gaze direction (that is, the center direction of the field of view), and the computer displays, based on the output image arrangement position information in the first question, . Through this, the computer can provide memory training smoothly even while the user is performing free head movement and eye movement.

9 is a structural diagram of a computing device that provides visual perception training in accordance with an embodiment of the present invention.

10 is an exemplary view for providing a visual angle training image to a head-mounted display device according to an embodiment of the present invention.

10, a computing device (or visual perception training device) 100 that provides visual perception training according to one embodiment of the present invention includes a display 110, a memory 120, a controller 130, (140). ≪ / RTI > The computing device 100 that provides visual perception training according to an embodiment of the present invention performs the same visual perception training method according to the embodiments of the present invention, so that the description thereof will be omitted.

The visual perception training apparatus 100 may be a portable terminal. The visual percussive training apparatus 100 may be mounted on the head of the user and used in such a manner that the user's eyes face the display 110. [ The visual percussive training apparatus 100 may be a head mounted device such as an HMD (Head Mounted Display), a glass, a goggle, or a display device such as a mobile phone that can be mounted on a head mounted device.

The head mounted display device includes a first screen and a second screen. The first screen and the second screen are a left-eye screen and a right-eye screen of the head-mounted display device.

The memory 120 stores visual perception training programs. The visual perception training program may be a native program previously installed in the visual perception training device 100 or may be a program downloaded and installed from an external server. The memory 120 may be an external memory connected to or inserted into the visual field training device 100. [

When the visual perception training program is executed, the control unit 130 may output a visual perception training image corresponding to the perception visualization training program to the display 110. [

The screen of the display 110 may include a first screen portion corresponding to the left eye of the patient and a second screen portion corresponding to the right eye of the patient. The controller 130 may control the parallax and focus of the visual field training image by adjusting the distance and superimposition between the first image output through the first screen and the second image output through the second screen.

The visual perception training image may include a preliminary image for adjusting the focus of the visual perception training image before realizing the visual perception training in earnest.

The user input unit 140 includes a user input for executing the visual field training program, a user input for adjusting the focus of the visual field training image during the visual field training, a user input for matching the correct answer of the problem included in the visual field training image, Lt; / RTI >

The user may manually adjust the focal distance through the user input unit 140 while watching the dictionary image, or may automatically adjust the focal distance while playing the game through the dictionary image produced in the game format. The user may manually adjust the focus through the user input unit 140 even during the visual perception training.

For example, a method of adjusting the focus through a dictionary image produced in a game format will be described as follows.

The control unit 130 may output the target matching game (for example, a shooting game) to the display 110 as a dictionary image. The user may shoot toward the target through the user input unit 140 and the control unit 130 may automatically adjust the focus to suit the user based on the hit rate of the target.

The visual difficulty of each visual training image may vary depending on the degree of visual impairment of the patient. The control unit 130 determines at least one of the shape, size, position, color, saturation, and contrast of the figure / character included in the visual perception training image based on the correct answer rate inputted through the user input unit 140 during the visual perception training To adjust the level of difficulty to determine the level of visibility training.

According to an embodiment of the present invention, during the visual perception training, the user's answer is received in real time through the user input unit 140, and the degree of training is flexibly adjusted according to the user's condition based on the correct answer rate There is a controllable effect.

An initial setting process for a specific patient to perform visual field training will be described as follows in a computing apparatus providing visual perception training according to an embodiment of the present invention. The computing device 100 providing visual perception training provides a first object on a first screen of the head-mounted display device and a second object on a second screen of the head-mounted display device. Thereafter, the computing device receives an operation for adjusting the positional relationship between the first object and the second object from the user. Thereafter, the computing device changes the positions of the first screen and the second screen in accordance with the operation. The computing device then outputs the visual content to the field of view of the patient including the visual impairment region with respect to the visual field center direction.

As described above, the method for providing visual guidance training based on the head-mounted display device according to an embodiment of the present invention may be implemented as a program (or an application) to be executed in combination with a computer as hardware and stored in a medium.

The above-described program may be stored in a computer-readable medium such as C, C ++, JAVA, machine language, or the like that can be read by the processor (CPU) of the computer through the device interface of the computer, And may include a code encoded in a computer language of the computer. Such code may include a functional code related to a function or the like that defines necessary functions for executing the above methods, and includes a control code related to an execution procedure necessary for the processor of the computer to execute the functions in a predetermined procedure can do. Further, such code may further include memory reference related code as to whether the additional information or media needed to cause the processor of the computer to execute the functions should be referred to at any location (address) of the internal or external memory of the computer have. Also, when the processor of the computer needs to communicate with any other computer or server that is remote to execute the functions, the code may be communicated to any other computer or server remotely using the communication module of the computer A communication-related code for determining whether to communicate, what information or media should be transmitted or received during communication, and the like.

The medium to be stored is not a medium for storing data for a short time such as a register, a cache, a memory, etc., but means a medium that semi-permanently stores data and is capable of being read by a device. Specifically, examples of the medium to be stored include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, but are not limited thereto. That is, the program may be stored in various recording media on various servers to which the computer can access, or on various recording media on the user's computer. In addition, the medium may be distributed to a network-connected computer system so that computer-readable codes may be stored in a distributed manner.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, You will understand. Therefore, it should be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

Claims (10)

A method of performing visual field training using a head mounted display device,
Providing a first object on a first screen of the head mounted display device and providing a second object on a second screen of the head mounted display device;
Receiving a user operation for adjusting a positional relationship between the first object and the second object from a user;
Changing a position of the first screen and the second screen according to a user operation; And
And outputting the visual content in a visual range of the patient including the visual impairment area based on the visual center direction,
Wherein the first screen is one of a left-eye screen and a right-eye screen of the head-mounted display device,
Wherein the second screen is not the first screen among a left-eye screen and a right-eye screen of the head-mounted display device. The method according to claim 1,
Wherein the user operation receiving step comprises:
Characterized in that the position of the first object and the position of the second object are aligned on the target point by the user,
Wherein at least one of the first object and the second object is an object of motion. The method according to claim 1,
Further comprising the step of the computer storing the first screen and the output condition of the second screen for a specific user. The method according to claim 1,
Wherein the display content output step includes:
Wherein each of the plurality of images is provided with at least one point on a two-dimensional or three-dimensional space for each trial,
Comparing the response input from the user with the provided image type for each trial of the computer. 5. The method of claim 4,
Wherein the display content output step includes:
Convergently matching the first screen and the second screen at a central point; And
And displaying the object corresponding to the visual perception content at a specific depth in the specified two-dimensional space based on the depth point of the center point. 5. The method of claim 4,
Further comprising: calculating a percent correctance rate for each point on the two-dimensional or three-dimensional space to set a visual perception impairment area of the user. The method according to claim 6,
Further comprising the step of determining at least one of a frequency of task provision for each point, a degree of difficulty of the task, and an output image size of the task based on the periodically generated visual field impairment area of the computer, Training delivery method. The method according to claim 1,
A head-mounted display device-based visual perception training method, characterized by sensing a direction of a visual center by sensing a user's head motion or a motion in a pupil direction and providing a task based on a relative position based on the visual center direction . 9. A head-mounted display device-based visual-angle training providing program stored in a medium in combination with a computer which is hardware, for executing the method of any one of claims 1 to 8. Providing a first object on a first screen of the head mounted display device,
A second object on a second screen of the head-mounted display device,
Receiving a user operation for adjusting a positional relationship between the first object and the second object from a user,
Changing positions of the first screen and the second screen according to the user operation,
The visual content is output to the visual range of the patient including the visual impairment area based on the visual center direction,
Wherein the first screen is one of a left-eye screen and a right-eye screen of the head-mounted display device,
Wherein the second screen is not the first screen among a left-eye screen and a right-eye screen of the head-mounted display device.

Images