KR20200027187A - SYSTEM AND METHOD FOR EXAMINATING ophthalmic using VR - Google Patents

Abstract

According to an embodiment of the present invention, an eye examination method using virtual reality (VR) comprises the steps of: providing an eye examination setting interface for inputting user setting for an eye examination; selecting a first eye examination according to the eye examination setting interface and performing the first eye examination; controlling a head mounted display to output a virtual reality image for the first eye examination; obtaining inspection data according to the virtual reality image from the head mounted display; and outputting an eye examination progress screen for an examiner for the first eye examination.

Description

Ophthalmic examination method and system using VR {SYSTEM AND METHOD FOR EXAMINATING ophthalmic using VR}

The present invention relates to an ophthalmic examination method and system using VR. More specifically, it relates to a method and system for performing an eye examination by detecting an eye change of a test subject according to a virtual reality image.

Modern people often show symptoms of abnormal vision, such as nearsightedness, farsightedness, and astigmatism, depending on personal, environmental and habits. Human eye disease is a broad concept that includes not only symptoms of vision problems but also pupil problems and eye movement problems.

In general, if an ophthalmic disease is suspected, a doctor or an optometrist conducts an ophthalmological examination, and if it is judged to be an ophthalmic disease, the corresponding treatment is performed. For example, when a vision abnormality occurs, the doctor or an optometrist irradiates light toward the lens, and then proceeds by checking the degree of refractive index through the reflected light and correcting vision through glasses. .

Since each person exhibits various symptoms of ophthalmic diseases, there are various examinations such as visual field examination, strabismus examination, extraocular muscle examination, stereoscopic vision examination, or ring caster examination.

However, the conventional ophthalmic disease test method is commonly performed manually by an examiner (a doctor or an optician) using an expensive optometric equipment to examine the eye condition of the examinee (ophthalmic disease). Therefore, depending on the examiner, the examination result of the examinee is not objective, it takes a long time, and there is a problem in that an excessive examination cost occurs due to the labor cost of the examiner.

In addition, it is true that the ophthalmology equipment for visual examination among ophthalmic diseases is improved from the method using the conventional visual acuity chart, but after the examiner analyzes the examination information of the examinee acquired through the ophthalmic equipment again, the type of ophthalmic disease is determined. Therefore, it is difficult to quickly determine the ophthalmic disease based on the test information of the examinee.

In addition, in the case of examining the ophthalmic disease of the examinee with optometric equipment, there is a problem that the examinee is difficult to move from the fixed position provided on the optometric equipment until the examination is completed. That is, since the position of the examinee's ophthalmic disease test depends on the test equipment, the test environment of the examinee is not good, such as examining the ophthalmic disease in a rigid state.

KR 10-1260757 B1 KR 10-2015-0053371 A

An object of the present invention is to provide an ophthalmic examination method and system using VR capable of accurately and quickly determining ophthalmic diseases by allowing digital examination of various kinds of ophthalmic examinations.

In addition, an object of the present invention is to provide an ophthalmic examination method and system using VR that can accurately and quickly determine ophthalmic diseases by providing various ophthalmic examinations that have been performed manually through a virtual reality-based examination system.

In addition, an object of the present invention is to provide an ophthalmic examination method and system using VR that outputs information related to an ophthalmology examination process in real time to an examiner to check the examination process and to proceed the examination quickly and accurately.

In addition, the object of the present invention, the ophthalmic examination of the subject is performed in a batch process while wearing a head mounted display, it is possible to obtain accurate and objective eye examination results.

An ophthalmic examination method using VR according to an embodiment includes providing an ophthalmic examination setting interface for inputting a user setting for the ophthalmic examination; Selecting a first ophthalmic examination according to the ophthalmic examination setting interface and performing the first ophthalmic examination; Controlling a head mounted display to output a virtual reality image for the first ophthalmic examination; Obtaining inspection data according to the virtual reality image from the head mounted display; And outputting an ophthalmic examination progress screen for an examiner for the first ophthalmic examination.

At this time, the step of providing the ophthalmic examination setting interface may include at least one of setting the focus of the examinee on the head mounted display and setting the first ophthalmic examination among a plurality of ophthalmic examinations. have.

In addition, the step of acquiring test data according to the virtual reality image may be a step of acquiring test data including an ocular reaction of the test subject reacting to the virtual reality image or input of the test subject.

Further, the inspection data may include eyeball position or pupil tracking information of the examinee.

The outputting of the examiner's ophthalmic examination progress screen includes outputting the ophthalmic examination progress information in real time, and the ophthalmic examination progress information includes personal information of the examinee, virtual reality image of the ophthalmologist, and the examination data. , May include at least one information of an analysis value according to the test data and a real-time ophthalmic test result value.

The ophthalmic examination virtual reality image may be a graphic image obtained by converting a 3D virtual reality image output from the head mounted display into 2D.

The outputting of the examiner's ophthalmological examination progress screen further includes providing a control icon capable of controlling the virtual reality image output in real time on the head mounted display, wherein the control icon includes: an eye selection icon, The virtual reality image color change icon, the depth of the virtual reality image (depth) may include at least one of the execution icon and the progress-related execution icon.

The method may further include obtaining ophthalmic examination result information based on the examination data matched to the virtual reality image for the first ophthalmic examination, and outputting the obtained ophthalmic examination result information.

Obtaining ophthalmic examination result information based on the examination data includes transmitting the examination data to an ophthalmic examination service providing server and receiving ophthalmic examination result information based on the examination data from the ophthalmic examination service providing server. It may include steps.

Selecting a first ophthalmic examination according to the ophthalmic examination setting interface and proceeding with the first ophthalmic examination comprises receiving data required to perform the selected first ophthalmic examination from the ophthalmic examination service providing server. It can contain.

In addition, the ophthalmic examination system using VR according to the embodiment, a display device for outputting a graphic image related to the ophthalmic examination for the examiner; An input device that senses the input of the examiner; And an ophthalmic examination console device for controlling a head mounted display to output a virtual reality image for an examinee, wherein the ophthalmic examination console device controls the display device to output an ophthalmic examination setting interface screen, and sets the ophthalmic examination. The input of the examiner to the interface is received from the input device, the ophthalmic examination to proceed according to the input of the examiner is determined, the virtual reality image of the determined ophthalmic examination is transmitted to the head mounted display, and the virtual reality image The inspection data according to is received from the head mounted display, and the received inspection data is output in real time through the display device.

The ophthalmic examination method using the virtual reality according to the embodiment is fixed to the inspector's inspection equipment during manual inspection, and can be freely moved or inspected in a comfortable position.

In addition, in the ophthalmic examination method using virtual reality according to the embodiment, the ophthalmic disease test of the examinee can be implemented in the form of a VR device, thereby examining the ophthalmic disease without additional ophthalmic examination equipment.

In addition, in the ophthalmic examination method using virtual reality according to the embodiment, by allowing the subject's ophthalmic disease to proceed in a normalized automatic examination form, objective examination data can be extracted, and through this, an accurate ophthalmic disease can be determined. It works.

In addition, the ophthalmic examination method using virtual reality according to the embodiment provides an input / output interface for an examiner according to an ophthalmic examination in real time, so that an examiner can perform a more rapid and accurate examination.

In addition, the ophthalmic examination method using the virtual reality according to the embodiment, by performing an ophthalmic examination through the provision server, can improve the data processing speed to accelerate the examination and update the latest ophthalmic examination method. In addition, it is possible to properly calculate profits from service provision.

1 shows the appearance of an ophthalmic examination system using a virtual reality image according to an embodiment of the present invention.
2 is an internal block diagram of an ophthalmic examination console according to an embodiment of the present invention.
3 is an exploded perspective view of an ophthalmic head mounted display of an ophthalmic examination system using a virtual reality image according to an embodiment of the present invention.
4 is an internal block diagram of a processor of an ophthalmic examination console according to an embodiment of the present invention.
5 is a flowchart for explaining an ophthalmological examination process using a virtual reality image according to an embodiment of the present invention.
6 shows a main display screen of an ophthalmic examination according to an embodiment of the present invention.
7A shows a synchronization display screen with a head mount display according to an embodiment of the present invention.
7B shows a head mount display screen when synchronizing with a console according to an embodiment of the present invention.
8 shows an interface for selecting a first ophthalmic examination according to an embodiment of the present invention.
9 shows a head mount display inspection screen during a first ophthalmic examination according to an embodiment of the present invention.
10 illustrates a display screen during a first ophthalmic examination according to an embodiment of the present invention.
11 shows a display screen output to the test results after completion of the first ophthalmic test according to an embodiment of the present invention.

The present invention can be applied to various transformations and can have various embodiments, and specific embodiments will be illustrated in the drawings and described in detail in the detailed description. Effects and features of the present invention and methods for achieving them will be clarified with reference to embodiments described below in detail with reference to the drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various forms. In the following examples, terms such as first and second are not used in a limiting sense, but for the purpose of distinguishing one component from other components. In addition, a singular expression includes a plural expression unless the context clearly indicates otherwise. In addition, the terms including or have means that the features or components described in the specification are present, and does not exclude in advance the possibility that one or more other features or components will be added. In addition, in the drawings, the size of components may be exaggerated or reduced for convenience of description. For example, the size and thickness of each component shown in the drawings are arbitrarily shown for convenience of description, and thus the present invention is not necessarily limited to the illustrated.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, and the same or corresponding components will be denoted by the same reference numerals when describing with reference to the drawings, and redundant description thereof will be omitted. .

1 to 2, an ophthalmic examination system using virtual reality according to an embodiment of the present invention includes a console device for ophthalmic examination, a head mounted display 100, and an ophthalmic examination service providing server 700.

Here, each component of FIGS. 1 and 2 may be connected through a network. The network refers to a connection structure capable of exchanging information between each node, such as an ophthalmic examination console device, a head mounted display 100, and an ophthalmic examination service providing server 700. In one example of such a network, 3GPP (3rd) Generation Partnership Project (LTE) network, Long Term Evolution (LTE) network, World Interoperability for Microwave Access (WIMAX) network, Internet, Local Area Network (LAN), Wireless Local Area Network (LAN), Wide Area Network (WAN) ), PAN (Personal Area Network), Bluetooth (Bluetooth) network, satellite broadcasting network, analog broadcasting network, DMB (Digital Multimedia Broadcasting) network, and the like.

-Ophthalmic examination service providing server (700)

First, the ophthalmic examination service providing server 700 may transmit and receive data required for an ophthalmic examination console device and ophthalmic examination through a network, and provide an interface for an ophthalmic examination process to the examiner through the console apparatus for ophthalmic examination. .

 In addition, the ophthalmic examination service providing server 700 transmits / receives data required for an ophthalmic examination to and from the head mounted display 100 through a network through a console device for ophthalmic examination, or through the head mounted display 100 to the examinee. Ophthalmology examination can be conducted.

In detail, the ophthalmic examination service providing server 700 may provide a program for an examinee required to provide an interface for an examiner to perform an ophthalmological examination to the console apparatus for ophthalmic examination, and continuously update the program for the examinee It may improve test methods or provide new ophthalmic tests.

Similarly, the ophthalmic examination service providing server 700 may provide the head mounted display 100 with an application for an examinee for ophthalmology examination, and continuously update the examiner's program to improve the existing examination method or to perform a new ophthalmic examination. Can provide.

In addition, the ophthalmic examination service providing server 700 may provide data necessary to perform an ophthalmological examination through a program for an examinee and an application for an examinee, and receive examination data that detects the reaction of the examinee according to the ophthalmic examination, and the like. You can.

And the ophthalmic examination service providing server 700 analyzes the received examination data and transmits the analysis results to the console or / and the head mounted display 100 to change the examination progress or provide the user with the examination results. You can.

That is, the ophthalmic examination service providing server 700 directly processes large-capacity deep learning and big data processing required for ophthalmic examination analysis, and then provides the console / head mounted display 100 to the console and head mounted display 100 ), The inspection speed can be improved by minimizing the data processing load that can occur, and it can be used to improve the inspection accuracy and inspection method by turning the continuously accumulated inspection data into big data.

In addition, the ophthalmic examination service providing server 700 counts the number of ophthalmic examination executions by type, the number of analysis of the examination data, or the number of transmission of result data, and stores the result in the database, and charges the user for service provision according to the counting of the stored database. You can.

In summary, the ophthalmic examination service providing server 700 provides real-time data, analysis results, etc. necessary for ophthalmological examination through a network, and can quickly perform the examination while minimizing the data weight of the program / application and the data processing load. In addition, the costs associated with the provision of ophthalmological examination services can be fairly charged depending on the type of examination and analysis processing.

Hereinafter, the process in which the ophthalmology examination service providing server 700 communicates data with the computing device of the console and the ophthalmology examination is performed will be mainly focused on the computing device, but some of the data analysis processed by the computing device is the ophthalmic examination service providing server 700 ).

- head-mounted display (100)

Next, the head mounted display 100 according to the embodiment, after the examinee wears the helmet or glasses, uses the optical unit and the display unit disposed in the head mounted display 100 to quickly and quickly examine the ophthalmic disease of the examinee. It is a device that can be accurately inspected.

In detail, the head mounted display 100 according to the embodiment outputs and outputs a virtual reality image (VR: Virtual Reality) related to the ophthalmic examination from the ophthalmic examination service providing server 700 or / and the console apparatus for ophthalmic examination. The reaction of the subject's eye in response to the virtual reality image and / or the input of the subject may be generated as test data.

In addition, the head mounted display 100 may transmit the generated test data directly or to the console device for ophthalmic examination or the ophthalmic examination service providing server 700, and the transmitted examination data may be used to derive ophthalmic examination results. That is, the ophthalmological examination results can be obtained based on the examination data.

The head mounted display 100 is fixed to the inspector's inspection equipment during manual inspection, and can be freely moved or inspected at a comfortable position. In addition, the head mounted display 100 of the present invention, by implementing an ophthalmic disease test of the examinee in the form of a VR device, it is possible to inspect the ophthalmic disease without additional ophthalmic examination equipment. In addition, the head mounted display 100 of the present invention, by allowing the subject's ophthalmic disease to proceed in a normalized automatic examination form, it is possible to extract the objective test data, and through this it has the effect of determining the correct ophthalmic disease have.

The head mounted display 100 as an example, is implemented as a wearable computer or takes the form of a wearable computer (also referred to as a wearable computing device). In an exemplary embodiment, the wearable computer may take the form of a head-mountable display (HMD) or include an HMD. The head mounted display 100 can be any device that can be worn on the head and put the display in front of one or both eyes of the wearer. The HMD can take various forms, such as helmets or eyeglasses.

Referring to FIG. 4 together with FIG. 3, the head mounted display 100 according to an embodiment includes a main body 200, a display unit 270 sequentially received at the rear of the main body 200, and an optometric unit ( 250), an optical unit 220, an optical holder 210, a housing 160, an optical interference prevention unit 300 and a fixed band 170. However, the components shown in FIGS. 3 and 4 are not essential components for the head mounted display 100, and thus may be omitted according to an ophthalmic examination. Here, the rear surface of the main body 200 is formed with an opening 150 and indicates the direction in which the subject's face is in contact, and the front surface of the main body 200 means the subject's gaze direction.

First, the main body 200 is formed of a solid structure of plastic and / or metal, or hollow of similar material so that wiring and components are interconnected to be routed internally through the head mounted display 100. It may be formed of a hollow structure.

120 illustrated in the drawing is a user input unit. The user input unit may turn on / off the head mounted display 100 or detect an ophthalmic examination related input.

In detail, the user input unit detects a user input that allows communication between the head mounted display 100 and an external system, or an input for changing and selecting a test type when a user (a testee or tester) examines an ophthalmic disease. can do. In addition, in some cases, an LED light in the form of an alarm may be further included so that the inspection is in progress or the inspection is completed.

Separately, the head-mounted display 100 may further include an input unit connected to the head-mounted display 100 by wire / wireless, and the input unit detects an input that derives an examiner's intention as the ophthalmic examination proceeds. It can be a device. The input unit transmits the input value recorded by the examiner's input time and the input value to the head mounted display 100 or the ophthalmic examination console device, and the transmitted input value may be included in the test data.

The fixed band 170 is shown as two fixed band portions, but this is not fixed. The main body 200 may be embodied in the form of a helmet so as to be fixed to the subject's face, or in the form of three or more bands to be fixed while surrounding the subject's head.

Next, the display unit 270 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible It may include at least one of a flexible display and an e-ink display.

The display unit 270 may finally display a graphic image on a 3D display in order to perform an ophthalmic examination. For example, the display unit 270 may display a virtual reality image (VR image) among 3D displays and use it for ophthalmology examination.

In addition, when the panel of the display unit 270 is provided as a single display panel, separated images corresponding to the left and right eyes of the examinee may be implemented. In some cases, at least two display panels may be separated.

Next, the optometric unit 250 may include a plurality of sensors, a plurality of cameras, a control unit of the head mounted display 100, and a circuit module capable of communicating with an external system so as to examine various ophthalmic diseases of the examinee. You can.

The optometric unit 250 may provide an eye tracking function that tracks the eyes of an examinee undergoing an eye test. To this end, in the optometric unit 250, cameras capable of tracking the pupil movement of the examinee may be mounted. The optometric unit 250 tracks the gaze of the subject, which changes according to the VR image, and provides inspection data that is the basis for performing ophthalmic disease tests such as visual field inspection, strabismus examination, extraocular muscle examination, stereoscopic vision examination, or ring caster examination. Can be obtained. In detail, the eyeball image of the examinee photographed by the optometric unit 250 is included in the examination data, and may be transmitted to the ophthalmic examination console device and / or the ophthalmic examination service providing server 700, and the transmitted examination data is the examination result. Can be based on.

In other words, the light irradiation means, imaging means, etc. necessary for inspection such as visual field inspection, strabismus examination, extraocular muscle examination, stereoscopic vision examination, and ring caster examination, which are performed to examine ophthalmic diseases, can be implemented in the form of a sensor module or camera module .

In addition, the optometry unit 250 may further include sensors for irradiating light to the left eye and right eye of the examinee for visual inspection, and receiving the light to obtain refractive index information about the eye of the examinee.

Next, the optical unit 220 may be located between the optometric unit 250 and the housing 160 to provide the most suitable optical unit corresponding to the type of ophthalmology examination of the examinee. For example, when the subject's ophthalmology examination is an eye examination, the optical lens for measuring the refractive index of the lens may be selectively exchanged.

In addition, when the subject's ophthalmology examination is an examination of pupil movement, such as an external eye muscle examination, the optical unit 220 may be an optical lens capable of precisely viewing pupil movement by a camera. The optical unit 220 may be an optical lens having a structure in which a plurality of lenses having polarization characteristics are stacked.

In addition, the optical unit 250 is fixed to the optical holder 210, depending on the type of ophthalmic examination, the required optical unit 250 can be replaced in a detachable manner to the optical holder 210.

Next, the housing 160 is inserted in the direction of the opening of the main body 200, the display unit 270, the optometric unit 250, the optical unit 220 maintains the optical alignment inside the main body 220 While fixing it, it functions to fix it.

In addition, when the examinee wears the head mounted display 100, it provides a space for an ophthalmic examination. Accordingly, the inside of the housing 160 may include a left-eye region and a right-eye region independently separated by the light interference preventing unit 300.

To this end, the inner surface of the housing 160 may be coated with a material having low light reflection and high light absorption for ophthalmic examination.

Next, the optical interference prevention unit 300 may function to separate the head-mounted display 100 from the left-eye region and the right-eye region for ophthalmological examination of the examinee. In general, people have similar positions and forms of both eyes (two eyes), but since each eye functions independently, ophthalmic diseases are similar, but have different symptoms. Therefore, there are examinations in which independent ophthalmologic examinations need to be performed for each left eye and right eye.

However, if the light used in the process of examining the ophthalmic disease for the left eye affects the adjacent right eye or vice versa, accurate and precise ophthalmic disease examination cannot be performed. For example, if the right eye is covered and only the left eye is examined, and vice versa, if the light output from one region interferes with the other region, the inspection result may be adversely affected.

Accordingly, the head mounted display 100 according to the embodiment may include a light interference preventing unit 300 to block light generated in each of the left-eye region and the right-eye region from interfering with each other.

The light interference preventing unit 300 may include a light blocking unit 301 that separates the head mounted display 100 into a left-eye region and a right-eye region, and blocks light traveling from each region to an adjacent region.

In order to further increase the light blocking rate, the light interference preventing unit 300 generates light interference occurring in the area between the light blocking unit 301 and the left eye and the right eye of the examinee when the testee wears the HMD for dark cancer. A first fixing portion 304 and a second fixing portion 305, which may include a contact light blocking portion 302 for preventing, and allow the optical interference unit 300 to be supported / fixed to the forehead region and the nostril region of the testee ) May be further included. Therefore, the light blocking unit 301 has a shape corresponding to the shape from the user's intervertebral region to the human body, not simply a shape supported by the wearer's nose, and when the head mounted display 100 is worn, the left eye region and the right eye By physically separating the regions, it is possible to prevent light from flowing out between the two.

In addition, the light blocking portion 301 and the contact light blocking portion 302 are preferably formed of a material having little light reflection and high light absorption. In addition, since the contact light blocking portion 302 is a portion that comes into contact with the skin of the subject's face, it is preferable to form a material having a high buffering force.

The head mounted display 100 may optically separate the left eye area and the right eye area from the area for examining ophthalmic diseases, thereby preventing inspection errors due to optical interference that may occur during the examination.

In addition, referring to FIG. 4, the head mounted display 100 according to the embodiment when viewed from a functional side includes a battery 110, a communication unit 190, a sensing unit 130, a storage unit 140, and a camera module 150, a user input unit 120, a display unit 270, and a control unit 180. However, the components shown in FIG. 4 are also not essential, and the head mounted display 100 may be implemented with more or fewer components. Hereinafter, the components will be described in turn.

The controller 180 generally controls the overall operation of the head mounted display 100. For example, the communication unit 190 may be controlled to transmit / receive various signals or process input data.

In addition, the image output unit and the audio output unit that may be disposed in the output unit 270 may be controlled and provided to an examinee or an examiner.

According to an embodiment, the head mounted display 100 extracts test data examining the eyes of the examinee, performs comparison and direct calculation based on the ophthalmic disease data stored in the storage 140, and then performs the ophthalmic disease of the examinee You can also judge

In addition, the battery 110 receives external power and internal power under the control of the controller 180 and supplies power required for the operation of each component. The battery 110 may include, for example, a battery, a connection port, a power supply control unit, and a charge monitoring unit.

In addition, the camera module 150 processes image frames such as still images or videos photographed by an image sensor in a video call mode or a shooting mode. The processed image frame may be stored in the storage 140 or transmitted to an external system through the communication unit 190. The camera module 150 may be provided in at least two or more according to the type of the ophthalmic disease test or the test environment of the examinee. For example, in the case of visual inspection of the examinee, a camera may be used for the purpose of monitoring the pupil, and in the case of tracking the eye movement of the examinee, a camera capable of performing imaging along the eye movement trajectory may be used.

In addition, the communication unit 190 enables wired / wireless communication with an external system, an ophthalmic examination console device and / or an ophthalmic examination service providing server 700. Here, the external system may be a concept including another head mounted display 100. The communication unit 190 may include a mobile communication module, a wireless Internet module, a short-range communication module, and a location information module.

In addition, the sensing unit 130 may include a gyro sensor, an acceleration sensor, a proximity sensor, and the like to sense the surrounding environment. In particular, the head mounted display 100 of the present invention may include at least two or more optical sensors that generate and receive light irradiated to the subject's eyes for examination of ophthalmic diseases.

In addition, the storage 140 may store an application for processing and control of the controller 180, or may perform a function for temporarily storing input / output data.

-Console device for eye examination

Returning to the description of the console device for ophthalmic examination again, referring to FIGS. 1 and 2, the console apparatus for ophthalmic examination according to the embodiment includes a console body 21, a display device 500, an input device 400, and Computing device 300 may be included.

First, the console body 21 may be an external body that supports the display device 500, the input device 400, and the computing device 300.

In detail, while the main body of the console body 21 is supported at the bottom of the console body 21, transport units 31 and 32 that allow an inspector to easily move the console body 21 may be disposed.

For example, the transfer units 31 and 32 may include at least one wheel contacting the ground, and may include at least one support connecting the wheel and the main body.

In addition, the main body may include a storage unit 22 capable of receiving the input device 400 and a pedestal supporting the display device 500. The storage unit 22 may be accommodated or discharged into the pedestal, and thus may be configured to improve space usability.

On the storage unit 22, a keyboard 401 or / and a mouse 402 may be disposed as the input device 400, and the input device 400 may be wired / wirelessly interfaced with the computing device 300, The tester can detect the input for the test progress and send it to the computing device 300.

In addition, the console body 21 further includes a first height adjusting unit 12 for adjusting the height of the stand, and a second height adjusting unit 11 for adjusting the arrangement height of the display device 500 on the stand. It can contain.

In detail, the first height adjusting unit 12 is slidingly coupled to the base, so that the position of the base can be raised or lowered by applying force to the base when the lock is released.

Likewise, the second height adjustment unit 11 is slidingly coupled with the display device 500 to increase or decrease the position of the display device 500 by applying force to the display device 500 when the lock is released. .

In addition, the display apparatus 500 may be disposed on a pedestal and output a graphic image for the examiner's ophthalmological examination.

In detail, the display apparatus 500 may output an interface required for an examiner to perform an ophthalmic examination, an ophthalmic examination result, and a related graphic image for controlling a head mounted display.

That is, the display apparatus 500 according to the embodiment may provide an ophthalmic examination graphic user interface for an examiner together with the input apparatus 400.

The display device 500 may output a graphic image required under control to the computing device 300, and for this purpose, the display device 500 may be connected to the computing device 300 by wire / wireless.

In addition, a touch input sensor is further disposed on the display panel of the display apparatus 500 to detect an examiner's touch input, thereby providing an input / output interface, thereby enabling faster and more intuitive inspection.

The display device 500 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display. (flexible display), an electronic ink display (e-ink display) may include at least one.

And the computing device 300 is disposed in the main body 21, and controls the display device 500, the input device 400, the head mounted display 100, and the like, and includes a main processor that performs an ophthalmic examination. You can.

In detail, referring to FIG. 2, the computing device 300 according to an embodiment includes a communication unit 360, an input unit 310, an interface unit 320, a memory 330, an output unit 340, and a power unit 350 ) And a processor 360.

First, the communication unit 360 may communicate with an external system, in particular, an ophthalmic examination service providing server 700 to transmit and receive data necessary for an ophthalmic examination through a network.

For example, the communication unit includes the following communication methods, for example, Global System for Mobile Communication (GSM), Code Division Multi Access (CDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity), etc. It is possible to transmit and receive, or transmit and receive wireless signals through short-range communication such as RFID and NFC.

Next, the input unit 310 may be an input unit 310 that turns on / off the power of the computing device 300, for example, a button.

Also, the interface unit 320 may be a data path for data communication with an external device, for example, the display device 500, the input device 400, and / or the head mounted display 100.

In detail, the interface unit 320 may be wiredly connected to various ports and / or cables to connect external devices and the computing device 300.

In addition, the interface unit 320 is a short-range wireless communication module such as Bluetooth or Wi-Fi, and may communicate data with an external device through short-range wireless communication.

Next, the memory 330 may store any one or more of application programs, data, and instructions necessary for the operation of the ophthalmic examination function according to the embodiment.

The memory 330 may be various storage devices such as ROM, RAM, EPROM, flash drive, hard drive, etc., and is a web storage that performs a storage function of the memory 330 on the Internet. It might be.

Finally, the processor 360 may control the overall operation of each unit described above in order to provide various examiner interfaces necessary for the examiner to proceed to the ophthalmic examination.

These processors 360 include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, It may be implemented using at least one of micro-controllers, microprocessors, and electrical units for performing other functions.

-Ophthalmic examination method using virtual reality

Hereinafter, a process of providing an ophthalmic examination method using virtual reality will be described with reference to FIGS. 5 to 11. In this case, the processor 360 directly controls external devices, analyzes data received from external devices, and provides an ophthalmic examination function. However, as described above, data or examination required for various ophthalmic examinations An embodiment in which the ophthalmic examination service providing server 700 analyzes data or calculates an ophthalmic examination result value through analysis may be possible.

First, when the computing device 300 is activated according to a user input, the computing device 300 may first check the connection between the head mounted display 100 and the display device 500. (S101)

In detail, when the computing device 300 is activated and the ophthalmic examination program is executed, the computing device 300 transmits a connection confirmation signal to the existing / new connected head mounted display 100 and the display device 500 to determine whether or not the connection is made. Can be confirmed.

In an embodiment, the computing device 300 may be wiredly connected to the display device 500 to output a graphic image related to the start of the ophthalmology test program by transmitting a driving signal when the display device 500 is powered on. (S301)

In addition, the computing device 300 may activate the head mounted display 100 by transmitting a driving signal to the head mounted display 100 previously registered through wired / wireless communication. (S201)

In addition, the computing device 300 may receive a feedback signal for the connection confirmation signal and check whether it is connected. (S102)

The computing device 300 confirming the connection may initially provide an ophthalmic test setting interface for setting an ophthalmological test required for the examinee. (S103)

First, the computing device 300 may output a graphic image related to the ophthalmology test setting to the examiner through the display device 500, and receive an examiner's input through the input device 400 or touch according to the graphic image and examine Can proceed. (S302)

In detail, referring to FIG. 6, the main screen of the ophthalmic examination setting interface displays an input 41 of the examinee information, synchronization 42 with the head mounted display 100, and an icon 43 for executing at least one ophthalmic examination. can do. Here, the icon for inputting the examinee information is an icon for executing a setting window for inputting information of the examinee to be examined by the examinee, and inputs personal information such as the name, age, and eye condition of the examinee, and subsequently examines the test data or the result value. It can be provided so that it can be distinguished from other inspection values by matching the information.

In addition, a synchronization execution icon with the head mounted display 100 may execute a task for focusing an examinee wearing the head mounted display 100.

In detail, when the head mounted display 100 is synchronized, a screen informing the examiner that synchronization is being executed may be displayed on the display apparatus 500 as shown in FIG. 7A. During synchronization, it is desirable that the examiner does not control the head mounted display 100, so it is desirable to block the input to prevent the ophthalmological examination from proceeding as shown in FIG. 7A.

In addition, in the head mounted display 100, each of the pointers is displayed in a state in which the left and right eye regions are separated, and a phrase leading to look at the displayed pointer can be displayed as shown in FIG. 7B. Here, it may be preferable that the pointer is green, which has less irritation to the eye and can stimulate the optic nerve.

When the synchronization is completed, the computing device 300 may detect the input of the examiner and perform an ophthalmology examination according to the detected input. (S104)

In detail, the computing device 300 may detect a selection input for the first ophthalmic examination among a plurality of ophthalmic examinations by directly touching the input device 400 or the display device 500.

In an embodiment, the ophthalmic examination provided by the computing device 300 may include at least one ophthalmic examination among a visual field examination, a perspective angle examination, an external eye muscle examination, a stereoscopic vision examination, or a ring caster examination. The above tests are currently being performed by doctors by manually measuring the test subject's eyes through test tools, and these manual tests are inaccurate and take a very long time due to the subjective judgment of the doctor and the feeling of the testee. And has the disadvantage of being uncomfortable.

Returning to the description again, referring to FIG. 8, an inspector may perform a visual inspection function by touching a visual inspection icon among icons representing a visual field inspection, a visual angle test, an external eye test, a stereoscopic vision test, and a ring caster test.

In an embodiment, when the first ophthalmic examination is selected, the computing device 300 may receive data required for the selected ophthalmic examination from the ophthalmic examination service providing server 700. That is, the computing device 300 may receive the latest and improved data on the first ophthalmology test in real time and provide it to the examinee and the examiner, and the ophthalmic examination service providing server 700 counts the number of ophthalmology examinations later. You can justly request the cost of providing the service.

In another embodiment, the computing device 300 may load the data for the first optometrist from the memory 330 to proceed with the optometrist.

To proceed with the ophthalmic examination, the computing device 300 transmits a virtual reality image of the first ophthalmic examination to the head mounted display 100, so that the head mounted display 100 outputs the first ophthalmic examination related virtual reality image. Can be controlled.

The head mounted display 100 receiving the virtual reality image may output a virtual reality image related to the first ophthalmic examination. In this case, since the head mounted display 100 is configured by separating the left-eye region and the right-eye region display unit, different virtual reality images may be output to each of the left-eye region and the right-eye region. In addition, when outputting different virtual reality images or outputting virtual reality images in only one area, it is possible to improve inspection accuracy by blocking light from entering the remaining areas.

For example, referring to FIG. 9, the target image 50 related to the first ophthalmic examination may be output to the left eye area LA on the head mounted display 100, and the display part of the right eye area RA may be deactivated. have.

In addition, the head mounted display 100 may generate test data by measuring an ocular response according to the first ophthalmic examination virtual reality image through the optometric unit. (S203)

In addition, the head mounted display 100, through the input unit or the user input unit 310 connected to the head mounted display 100, recognizes whether the subject is recognized by the target image 50 through user input, and identifies the identified user It can be included in the inspection data in association with the input and input time.

As described above, various virtual reality images for the first ophthalmic examination are sequentially transmitted to the head mounted display 100 through the computing device 300, and the head mounted display 100 receives the virtual reality images sequentially transmitted. While outputting, the test data of the examinee based on this may be acquired and transmitted to the computing device 300.

While the examination is performed on the head mounted display 100, the computing device 300 may control the display apparatus 500 to output an ophthalmic examination progress screen for an examiner. (S303)

In detail, the display apparatus 500 may display an ophthalmology examination progress screen for an examiner through which the examiner can check the progress of the ophthalmology examination through the head mounted display 100 under control on the computing device 300. (S303)

To this end, the computing device 300 displays an ophthalmic examination progress screen for an examiner including an ophthalmic examination image, inspection data, and analysis data analysis values, which are converted into a 2D graphic image in 3D virtual reality image in real time. ).

In detail, referring to FIG. 10, real-time ophthalmic examination progress information may be displayed on the ophthalmic examination progress screen for an examiner, and the ophthalmic examination progress information is output to the subject's personal information 61 and the head mounted display 100 At least one of the test virtual reality image 62, the test data 64 sensed by the head mounted display 100, the analysis value 63 according to the test data 64, the synchronization data, and the real-time ophthalmic test result value 65 The above information may be included.

Such information may be output through real-time analysis of the computing device 300, and the ophthalmic examination service providing server 700 may perform some of these analyzes.

In detail, the examinee's personal information 61 can confirm that the examinee is performing the examination.

In addition, the ophthalmic examination virtual reality image 62 output to the head mounted display 100 may be converted into a 2D graphic image and output, and the examiner may check whether the first ophthalmic examination is correctly performed through the 2D graphic image. have.

In addition, the test data 64 of the test subject for the virtual reality image of the ophthalmic test is output in real time, so that the tester can check the state of the test subject in real time and check whether the test is correctly performed. For example, on the ophthalmic examination progress screen, the position tracking value or / and the eye tracking value, which is the synchronization data of the eyeball, may be calculated and displayed as a numerical value. In addition, according to an embodiment, a real-time ocular imaging image directly photographing the eye reaction of the examinee may be directly displayed on the ophthalmic examination progress screen.

In addition, the analysis value 63 according to the inspection data 64 in real time is a factor that is the basis for calculating the ophthalmic test result value 65. For example, in the field inspection, the field of view detected by the examinee and the non-detection It may be data that separates the field of view. By displaying this, the examiner can intuitively grasp the eye condition of the examinee.

That is, by outputting an analysis value 63 indicating the process of calculating the result 65, in addition to the result 65 of the ophthalmological examination directly analyzed by the computing device 300, the doctor utilizes subjective expertise. More accurate inspection results can be derived.

In addition, the real-time ophthalmic test result value 65 may be an ophthalmic test result value 65 according to the test data 64 measured so far, and through the ophthalmic test result value 65, the examiner proceeds with examination more quickly. You can also determine the status and end the inspection.

On the other hand, referring to FIG. 10, the examiner's ophthalmology examination progress screen may further include a control icon capable of controlling the virtual reality image output in real time to the head mounted display 100.

That is, the computing device 300 transmits the signal to the head mounted display 100 when the examiner inputs a signal to control the image of the head mounted display 100 through the control icon included in the ophthalmic examination progress screen for the examiner. By doing so, the virtual reality image output from the head mounted display 100 may be changed according to a user input. (S107, S204)

In detail, the computing device 300 may display at least one of shape, size, brightness, illuminance, saturation, brightness, depth, or output location of the virtual reality image output to the head mounted display 100 through the user's control icon input. Can be changed.

For example, the control icon may include an eye selection icon 71 capable of determining an area to output a virtual reality image.

In detail, the eye selection icon is an icon for selecting whether the eye to be examined is the left eye or the right eye. When a left eye icon is selected, a virtual reality image is displayed only in the left eye area LA of the head mounted display 100, and, conversely, when the right eye icon is selected. A virtual reality image is output only to the right eye area RA of the head mounted display 100, so that an ophthalmic examination of the left or right eye of the subject can be selectively performed.

At this time, in order to reliably perform the ophthalmic examination only in the left eye or the right eye, it is preferable to completely block the light in the other region other than the region where the ophthalmic examination is performed.

To this end, it has been described above that the head mounted display 100 may include a light blocking unit that completely blocks display light in the left eye region.

In addition, the control icon may include an icon for adjusting the size of the virtual reality image. Since the virtual reality image may not be visible depending on the visual acuity of the examinee, the size of the virtual reality image may be adjusted on the computing device 300 to perform a smooth ophthalmic examination.

In addition, the control icon can change the shape of the virtual reality image. In detail, the virtual reality image includes a background image and a target image for performing an ophthalmology examination, and the shape of the background image and / or the target image may be modified.

For example, the computing device 300 may change the shape, color, or brightness of the background through at least one of the control icons to perform a smooth ophthalmic examination. For example, the computing device 300 may generate a grid in the background or change an environment such as a mountain and the sea that appears to be actually outside to the background, thereby causing interest of the examinee.

In addition, the computing device 300 may change the shape, size, color, or brightness of the target image through the control icon to perform smooth ophthalmic examination.

At this time, the computing device 300 may convert the target image into an animal shape or an object shape, not a basic shape such as a circle, a square, or a triangle through a control icon. For example, the computing device 300 may output the target image by converting the target image into a puppy-like shape that may be interesting to increase the immersion degree of the examinee.

Also, the control icon may include an icon for determining the color of the virtual reality image output from the head mounted display 100. In detail, the control icon may include at least two color change icons capable of changing the color of the virtual reality image. Such a color change icon can improve the inspection environment of a subject having color blindness and color weakness.

In addition, the control icon may include an adjustment bar 73 for adjusting the depth of the virtual reality image. Such an adjustment bar may help to perform various ophthalmological examinations by changing the position of the virtual reality image.

In addition, the control icon may include a reset button to stop or start the ophthalmological examination or to initialize the whole.

The progress-related execution icon 74 may help to quickly stop and restart the test when the test is wrong or there is an abnormality in the testee through the test data 64 and 2D test images output by the tester in real time. .

Finally, the control icon may further include a button for storing the inspection result and printing it as offline output data.

In summary, the computing device 300 according to the embodiment controls the display device 500 to output the ophthalmic inspection progress information, thereby assisting the inspector to check the inspection progress, and at this time, outputs the head mounted display 100 By providing an interface to control the virtual reality image in real time, faster and more accurate inspection can be performed.

Finally, the computing device 300 may generate ophthalmic examination result information based on the examination data 64. (S107)

In detail, the computing device 300 may analyze test data 64 matched to the virtual reality image sequentially output, and output information about the result of the ophthalmology test of the testee.

In an embodiment, the computing device 300 transmits inspection data 64 matched to the virtual reality image to the ophthalmic examination service providing server 700 in real time, and the ophthalmic examination service providing server 700 receiving the examination is examined After analyzing the data 64 to calculate the ophthalmology test result information of the examinee, the result of the ophthalmology test may be obtained by transmitting the calculated result to the computing device 300.

The process of calculating the result of the ophthalmological examination may include the value of tracking the pupil's position in the eyeball image, information on the position of the eyeball, and deep learning of the image of the eye reaction. Since the result value 65 is calculated, the result of the ophthalmic examination may be accurate and accurate.

Finally, the computing device 300 may control the output of the obtained ophthalmic examination result information to the display device 500 to be output.

In detail, referring to FIG. 11, the ophthalmic test result information may include the personal information 81, the test data 82, the test data 82 of the test subject, and the eye state information 83 based on the analysis value. have.

In this way, the ophthalmic examination method using the virtual reality according to the embodiment is fixed to the inspector's inspection equipment during manual inspection, and can be freely moved or inspected in a comfortable position.

In addition, in the ophthalmic examination method using virtual reality according to the embodiment, the ophthalmic disease test of the examinee can be implemented in the form of a VR device, thereby examining the ophthalmic disease without additional ophthalmic examination equipment.

In addition, in the ophthalmic examination method using virtual reality according to the embodiment, by allowing the subject's ophthalmic disease to proceed in a normalized automatic examination form, objective examination data can be extracted, and through this, an accurate ophthalmic disease can be determined. It works.

In addition, the ophthalmic examination method using virtual reality according to the embodiment provides an input / output interface for an examiner according to an ophthalmic examination in real time, so that an examiner can perform a more rapid and accurate examination.

The embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer components and can be recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, or the like alone or in combination. The program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention or may be known and usable by those skilled in the computer software field. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magneto-optical media such as floptical disks. medium), and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory 330, and the like. Examples of the program instructions include not only machine language codes produced by a compiler, but also high-level language codes executable by a computer using an interpreter or the like. The hardware device can be changed to one or more software modules to perform the processing according to the present invention, and vice versa.

The specific implementations described in the present invention are examples, and do not limit the scope of the present invention in any way. For brevity of the specification, descriptions of other electronic aspects of conventional electronic configurations, control systems, software, and systems may be omitted. In addition, the connection or connecting members of the lines between the components shown in the drawings are illustrative examples of functional connections and / or physical or circuit connections, and in the actual device, alternative or additional various functional connections, physical It can be represented as a connection, or circuit connections. In addition, unless specifically mentioned, such as “essential”, “importantly”, etc., it may not be a necessary component for application of the present invention.

In addition, although the detailed description of the present invention has been described with reference to a preferred embodiment of the present invention, those skilled in the art or those skilled in the art having ordinary knowledge in the technical field described in the claims to be described later It will be understood that various modifications and variations can be made in the present invention without departing from the scope of the present invention. Therefore, the technical scope of the present invention should not be limited to the contents described in the detailed description of the specification but should be defined by the claims.

Claims (11)

Providing an eye examination setting interface for inputting user settings for an eye examination;
Selecting a first ophthalmic examination according to the ophthalmic examination setting interface and performing the first ophthalmic examination;
Controlling a head mounted display to output a virtual reality image for the first ophthalmic examination;
Obtaining inspection data according to the virtual reality image from the head mounted display; And
And outputting an ophthalmic examination progress screen for an examiner for the first ophthalmic examination.
Ophthalmic examination method using VR. The method of claim 1,
Providing the ophthalmic examination setting interface,
And setting the first ophthalmic examination among a plurality of ophthalmic examinations.
Ophthalmic examination method using VR. The method of claim 1,
Acquiring inspection data according to the virtual reality image,
In the step of acquiring the test data including the subject's eye response or the input of the test subject in response to the virtual reality image
Ophthalmic examination method using VR. The method of claim 3,
The inspection data,
The eyeball position or pupil tracking information of the examinee
Ophthalmic examination method using VR. The method of claim 1,
The step of outputting the ophthalmic examination progress screen for the examiner is
And outputting progress information of an ophthalmology examination conducted in real time,
The ophthalmic examination progress information,
Personal information of the examinee, the virtual reality image of the ophthalmology test, the inspection data, at least one or more of the analysis data according to the inspection data, and real-time ophthalmic test results
Ophthalmic examination method using VR. The method of claim 5,
The virtual reality image of the ophthalmic examination,
A graphic image obtained by converting a 3D virtual reality image output from the head mounted display into 2D.
Ophthalmic examination method using VR. The method of claim 5,
The step of outputting the ophthalmic examination progress screen for the examiner is
Further comprising the step of providing a control icon for controlling the virtual reality image output in real time on the head mounted display,
In the control icon,
An eyeball selection icon, a color change icon of the virtual reality image, a control icon for adjusting a depth of the virtual reality image, and at least one execution icon of a progress-related execution icon
Ophthalmic examination method using VR. The method of claim 1,
Obtaining ophthalmic examination result information based on the examination data matched to the virtual reality image of the first ophthalmic examination;
And outputting the obtained ophthalmic examination result information.
Ophthalmic examination method using VR. The method of claim 8,
Obtaining the result of the ophthalmological examination based on the test data,
Transmitting the inspection data to an ophthalmic inspection service providing server;
And receiving the result of the ophthalmic examination based on the examination data from the ophthalmic examination service providing server.
Ophthalmic examination method using VR. The method of claim 9,
The first ophthalmic examination is selected according to the ophthalmic examination setting interface and the first ophthalmic examination is performed.
And receiving data required to proceed with the selected first ophthalmic examination from the ophthalmic examination service providing server.
Ophthalmic examination method using VR. A display device for outputting a graphic image related to an ophthalmic examination for an examiner;
An input device that senses the input of the examiner;
And an ophthalmic examination console device for controlling the head mounted display to output the virtual reality image for the examinee,
The ophthalmic examination console device,
Control the display device to output an ophthalmic examination setting interface screen, receive the input of the examiner for the ophthalmic examination setting interface from the input device,
Determine an ophthalmic examination to proceed according to the input of the examiner, and transmit a virtual reality image of the determined ophthalmic examination to the head mounted display,
The inspection data according to the virtual reality image is received from the head mounted display,
Outputting the received inspection data in real time through the display device
Ophthalmic examination system using VR.

Images