JP7391586B2 - ophthalmology system - Google Patents

Description

The present invention relates to an ophthalmologic apparatus, an ophthalmologic system, and a method for controlling an ophthalmologic apparatus that obtain an anterior segment image of an eye to be examined.

The condition of each part of the eye (shape, thickness, blood flow, amount of pigment, etc.) differs by race, and it is known that the probability of disease occurrence in each part of the eye also differs by race (patent (See Patent Documents 1 to 4). For this reason, the anterior segment image of the examinee's eye and ocular characteristics of the examinee's eye (e.g., fundus photographic image and fundus tomogram) obtained at an ophthalmology clinic, etc., are associated with information regarding the examinee's race and stored in a database. By doing so, it is possible to analyze trends in anterior segment images and eye characteristics for each race, and to predict eye diseases for each race.

It is preferable that information regarding the race of the subject be automatically estimated from the viewpoint of work efficiency. Here, since the amount of melanin contained in the iris of the eye differs depending on the race, the color of the iris (color distribution) of the eye also varies depending on the race, and there is a difference between race and iris color. There exists a certain degree of relationship (see Patent Document 5). For this reason, in ophthalmology, the patient's ethnicity can be estimated from the iris color (color distribution) reflected in the anterior segment image of the subject's eye by obtaining the anterior segment image of the subject's eye. It is easy to create, and as a result, the above-mentioned trend analysis and disease prediction become possible.

Patent No. 5559570 Patent No. 4426032 Patent No. 6062793 Publication No. 6-125876 JP 2017-38162 Publication

By the way, if the iris is eclipsed by eyelashes or ambient light is illuminated on the iris when photographing the anterior segment image, the image of the eyelashes or ambient light will be reflected in the iris area corresponding to the iris in the anterior segment image. This results in a dark area, that is, an area where the color of the iris cannot be discerned. In this case, the color (color distribution) of the iris cannot be accurately detected from the iris region of the anterior segment image, resulting in a decrease in the accuracy of estimating the race of the subject.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an ophthalmologic apparatus, an ophthalmologic system, and a control method for an ophthalmologic apparatus that can obtain an anterior segment image suitable for estimating the race of a subject. With the goal.

An ophthalmological apparatus for achieving the object of the present invention includes an anterior eye image acquisition unit that acquires a color anterior eye image of the eye to be examined, and an iris area that defines a region corresponding to the iris of the eye to be examined in the anterior eye image. In the case of and an output section that outputs to an estimation section that estimates race.

According to this ophthalmological apparatus, the estimation unit can estimate the race of the subject based on the area other than the unidentifiable area within the iris area.

An ophthalmological apparatus according to another aspect of the present invention, including a visible light irradiation unit that irradiates visible light to the eye to be examined to shrink the pupil of the eye to be examined, wherein the anterior segment image acquisition unit is configured to use the visible light irradiation unit to reduce the pupil of the eye to be examined. Obtain an image of the anterior segment of the subject's eye irradiated with visible light. Thereby, it is possible to enlarge the iris region in the anterior segment image used for estimating the race of the subject by the estimating section, and thus it is possible to improve the accuracy of the process of estimating the race by the estimating section.

In the ophthalmological apparatus according to another aspect of the present invention, the area detection unit detects an area in the iris area where an image different from the iris is reflected as an unidentifiable area. This allows the estimation unit to estimate the race of the subject based on the area other than the unidentifiable area within the iris area.

In the ophthalmological apparatus according to another aspect of the present invention, the area detection unit detects an area where eyelashes or ambient light are reflected in the iris area as an unidentifiable area. This allows the estimation unit to estimate the race of the subject based on the area other than the unidentifiable area within the iris area.

An ophthalmologic apparatus according to another aspect of the present invention includes an eye characteristic acquisition section that acquires eye characteristics of a subject's eye, and an eye characteristic output section that outputs the eye characteristics acquired by the eye characteristic acquisition section to a server. Thereby, in addition to the anterior segment image for estimating the race of the subject, it is possible to obtain the ocular characteristics of the subject's eye.

The ophthalmological apparatus according to another aspect of the present invention includes an estimating section, and the estimating section estimates the human body of the subject from an identifiable area different from an unidentifiable area in the iris area based on the detection result of the area detecting unit. Estimate the species. Thereby, the race of the subject can be estimated using the ophthalmological apparatus alone.

An ophthalmologic system for achieving the object of the present invention includes the above-described ophthalmologic apparatus, an anterior segment image output unit that is provided in the ophthalmic apparatus and outputs an anterior segment image to a server, and a server. According to this ophthalmologic system, the estimation unit can estimate the race of the subject based on the area other than the unidentifiable area within the iris area.

In the ophthalmological system according to another aspect of the present invention, the estimating unit is provided in the server, and based on the detection result of the area detecting unit, the estimating unit detects the subject from an identifiable area different from an unidentifiable area in the iris area. Estimate the race of. This allows the server to estimate the race of the subject.

In the ophthalmological system according to another aspect of the present invention, the interpolation unit performs interpolation processing on the unidentifiable area using an identifiable area different from the unidentifiable area in the iris area based on the detection result of the area detecting unit. The estimation unit is provided in the ophthalmological apparatus or server, and estimates the race of the subject based on the iris area interpolated by the interpolation unit. Thereby, the estimating section can estimate the race of the subject based on the entire iris region, so that the accuracy of the estimating process of the race by the estimating section can be improved.

In the ophthalmological system according to another aspect of the present invention, the anterior eye segment image acquisition unit acquires anterior eye segment images from a plurality of cameras that photograph the subject's eye from different directions, and the interpolation unit acquires anterior eye segment images from a plurality of cameras that photograph the subject's eye from different directions. Interpolation processing is performed on the unidentifiable area of the anterior eye image taken by a second camera different from the first camera among the plurality of cameras, based on the identifiable area in the anterior eye image taken by the first camera of the plurality of cameras. do. This allows the estimation unit to estimate the race of the subject based on the entire iris region.

In the ophthalmological system according to another aspect of the present invention, the server stores the anterior segment image and the estimation result of the estimation unit in a database in association with each other. This allows the database to be used for various types of eye research for each race.

In the ophthalmologic system according to another aspect of the present invention, the ophthalmologic apparatus includes an eye characteristic acquisition section that acquires the eye characteristics of the eye to be examined, and an eye characteristic output section that outputs the eye characteristics acquired by the eye characteristic acquisition section to the server. A server associates the anterior segment image and eye characteristics with the estimation results of the estimator and stores them in a database. This allows the database to be used for various types of eye research for each race.

In the ophthalmological system according to another aspect of the present invention, the color of the anterior eye image acquired by the anterior eye image acquisition unit is determined by the anterior eye image acquisition unit under illumination of the eye to be examined using a predetermined standard light source. A color correction unit that performs color correction to the color of the acquired anterior segment image is provided in the ophthalmologic apparatus or server. Thereby, the color of the anterior segment image can be corrected as if it were photographed under illumination by the same light source (standard light source).

In the ophthalmological system according to another aspect of the present invention, when the area corresponding to the pupil of the subject's eye in the anterior eye image is defined as the pupil area, the area in the anterior eye image acquired by the anterior eye image acquisition unit is An ophthalmological apparatus or a server is provided with a pupil diameter correction unit that performs image processing on the iris region and the pupil region to correct the pupil diameter of the pupil region to a predetermined size. Thereby, the pupil diameter of the pupil area in the anterior segment image can be corrected to a predetermined size.

A method for controlling an ophthalmological apparatus to achieve the object of the present invention includes an anterior eye image acquisition step of acquiring a color anterior eye image of the eye to be examined, and an area corresponding to the iris of the eye to be examined in the anterior eye image. is the iris region, the detection results of the region detection step for detecting an indiscernible region where the color of the iris cannot be discerned in the iris region and the anterior eye image and region detection step are calculated based on the color of the iris region. and an output step of outputting to an estimator that estimates the examiner's race.

According to the present invention, an anterior segment image suitable for estimating the race of a subject can be obtained.

It is a schematic diagram of an ophthalmology system of a first embodiment. FIG. 1 is a schematic diagram showing an example of the configuration of an ophthalmologic apparatus. It is a functional block diagram of the arithmetic control unit of the ophthalmological apparatus of 1st Embodiment, and the control part of a server. FIG. 6 is an explanatory diagram showing anterior segment images obtained by a stereo camera before and during irradiation of white light onto the subject's eye by the optotype display unit, respectively. FIG. 6 is an explanatory diagram for explaining detection of an NG area within an iris area by an iris area analysis unit. FIG. 6 is an explanatory diagram for explaining detection of an NG area within an iris area by an iris area analysis unit. FIG. 3 is an explanatory diagram for explaining color correction processing by a color correction section. FIG. 6 is an explanatory diagram for explaining correction processing by a pupil diameter correction section. A flowchart illustrating the flow of the eye characteristics acquisition process of the eye to be examined by the ophthalmology system of the first embodiment, particularly the flow of acquiring the anterior segment image for race estimation and storing it in the database according to the method of controlling the ophthalmology apparatus of the present invention. It is. It is a block diagram of an ophthalmology apparatus and a server which constitute an ophthalmology system of a 2nd embodiment. FIG. 6 is an explanatory diagram for explaining a first example of interpolation processing for an NG area by an interpolation unit. FIG. 7 is an explanatory diagram for explaining a second example of interpolation processing for an NG area by an interpolation unit. A flowchart showing the flow of the eye characteristics acquisition process of the eye to be examined by the ophthalmological system of the second embodiment, particularly the flow of acquiring the anterior segment image for race estimation and storing it in the database according to the control method of the ophthalmological apparatus of the present invention. It is. It is a block diagram of the modification of the ophthalmology system of 2nd Embodiment. It is a block diagram of an ophthalmology apparatus and a server which constitute an ophthalmology system of a 3rd embodiment.

[Ophthalmology system of first embodiment]
FIG. 1 is a schematic diagram of an ophthalmologic system 9 according to a first embodiment. As shown in FIG. 1, the ophthalmologic system 9 includes a plurality (or a single device) of ophthalmologic devices 10, a server 11, and a database 12.

The ophthalmological apparatus 10 acquires (measures, photographs, observes, etc.) the eye characteristics of the eye E to be examined (see FIG. 2). The ophthalmologic apparatus 10 of this embodiment is a multifunction device that combines a fundus camera and an optical coherence tomography device that uses optical coherence tomography (OCT) to obtain an OCT image 16, which is a tomographic image.

The ophthalmological apparatus 10 stereoscopically photographs the anterior eye segment Ea (see FIG. 2) of the eye E to be examined to obtain an anterior eye image 14 (also referred to as an observation image of the anterior eye segment), and also acquires the eye characteristic as the eye characteristic of the eye E to be examined. A fundus photographed image 15 and an OCT image 16 of the fundus Ef (see FIG. 2) are acquired. Then, the ophthalmologic apparatus 10 outputs the anterior segment image 14 and the fundus photographed image 15 and OCT image 16, which are the acquisition results of the eye characteristics of the eye E, to the server 11. Further, the ophthalmological apparatus 10 outputs ID information 17 such as a patient ID (identification), which is unique identification information of the subject, to the server 11 together with each of the images 14 to 16.

The server 11 stores each of the images 14 to 16 and the ID information 17 input from the ophthalmological apparatus 10 in the database 12. The server 11 also performs an estimation process to estimate the race of the subject based on the anterior segment image 14 inputted from the ophthalmological apparatus 10, and adds race information 18 indicating the result of the estimation process to each image 14 to 16 and ID information 17 and stored in the database 12. Note that "race" as used herein refers to the division of modern humans based on physical characteristics such as skeleton, skin, and hair. In addition, the term "race" in this specification also includes "ethnicity" which refers to a group of people who have the same (including substantially the same) racial or regional origin.

The database 12 stores images 14 to 16 and race information 18 input from the server 11. Note that the database 12 may be constructed inside the server 11.

[Configuration of ophthalmological device]
FIG. 2 is a schematic diagram showing an example of the configuration of the ophthalmologic apparatus 10. Note that the X direction in the figure is the left-right direction with respect to the subject (the interpupillary direction of the subject's eye E), the Y direction is the vertical direction, and the Z direction approaches the subject (the subject's eye E). This is the front-rear direction (also referred to as the working distance direction) parallel to the front direction and the rear direction moving away from the subject.

As shown in FIG. 2, the ophthalmologic apparatus 10 includes a fundus camera unit 10a, an OCT unit 10b, a stereo camera 20, an arithmetic control unit 22, and the like. Note that the symbol OA in the figure is the optical axis of the objective lens 43.

The fundus camera unit 10a has almost the same optical system as a conventional fundus camera, and acquires (photographs) various observation images of the anterior segment Ea and the fundus Ef of the eye E through the objective lens 43. A photographed fundus image 15 of the fundus Ef is obtained as the eye characteristics of the eye E to be examined. Further, the OCT unit 10b acquires an OCT image 16 of the fundus Ef as an eye characteristic of the eye E through the objective lens 43 and a part of the optical system of the fundus camera unit 10a. Therefore, the fundus camera unit 10a and the OCT unit 10b function as an ocular characteristic acquisition section of the present invention.

The arithmetic control unit 22 is housed within the housing of the ophthalmological apparatus 10, and is an arithmetic processing device such as a personal computer that executes various arithmetic processing and control processing.

<Funus camera unit>
The fundus camera unit 10a includes an illumination optical system 30 and an imaging optical system 50.

The illumination optical system 30 irradiates the fundus Ef with illumination light. The imaging optical system 50 guides the fundus reflected light of the illumination light reflected by the fundus Ef to imaging elements 57 and 60 of, for example, a CMOS (Complementary Metal Oxide Semiconductor) type or a CCD (Charge Coupled Device) type. The imaging optical system 50 also guides the signal light output from the OCT optical system 80 (OCT unit 10b) to the fundus Ef, and guides the signal light that has passed through the fundus Ef to the OCT optical system 80.

The illumination optical system 30 includes an observation light source 31, a reflection mirror 32, a condensing lens 33, a visible cut filter 34, a photographing light source 35, a mirror 36, relay lenses 37 and 38, an aperture 39, a relay lens 40, an aperture mirror 41, and a dichroic lens. It includes a mirror 42, an objective lens 43, and the like.

The imaging optical system 50 includes, in addition to the objective lens 43, dichroic mirror 42, and apertured mirror 41 described above, a focusing lens 51, a mirror 52, a half mirror 53, an optotype display section 54, a dichroic mirror 55, and a light condenser. It includes a lens 56, an image sensor 57, a mirror 58, a condenser lens 59, an image sensor 60, and the like.

The observation light source 31 is, for example, a halogen lamp or an LED (light emitting diode), and emits observation illumination light. The observation illumination light emitted from the observation light source 31 is reflected by the reflection mirror 32, passes through the visible cut filter 34 via the condenser lens 33, and becomes near-infrared light. The observation illumination light that has passed through the visible cut filter 34 is once focused in the vicinity of the photographing light source 35, reflected by a mirror 36, and passes through relay lenses 37, 38, an aperture 39, and a relay lens 40. The observation illumination light is reflected at the periphery of the apertured mirror 41 (area around the aperture), passes through the dichroic mirror 42, and is further refracted by the objective lens 43 to illuminate the fundus Ef.

The fundus reflected light of the observation illumination light is refracted by the objective lens 43, passes through the dichroic mirror 42, a hole formed in the center area of the perforated mirror 41, and the focusing lens 51, and is then reflected by the mirror 52. . Further, this fundus reflected light is transmitted through the half mirror 53 and then reflected by the dichroic mirror 55, so that an image is formed on the light receiving surface of the image sensor 57 by the condenser lens 56. The image sensor 57 images (receives) the fundus reflected light and outputs an image signal to the arithmetic and control unit 22, which will be described later. The arithmetic control unit 22 causes the monitor 23 to display an observation image based on the imaging signal output from the imaging device 57. Note that when the focus of the imaging optical system 50 is adjusted to the anterior segment Ea of the eye E to be examined, an observation image of the anterior segment Ea is displayed on the monitor 23, and the focus of the imaging optical system 50 is adjusted to the fundus Ef. If so, an observed image of the fundus Ef is displayed on the monitor 23.

The photographing light source 35 is, for example, a xenon lamp or an LED light source, and emits photographic illumination light. The photographic illumination light emitted from the photographic light source 35 passes through the same path as the observation illumination light described above and is irradiated onto the fundus Ef. The fundus reflected light of the photography illumination light is guided to the dichroic mirror 55 through the same path as the fundus reflected light of the observation illumination light, and after passing through this dichroic mirror 55, it is reflected by the mirror 58, and is condensed. The lens 59 forms an image on the light receiving surface of the image sensor 60 .

The image sensor 60 images (receives) the fundus reflected light and outputs a fundus photographed image 15 (image data) to the arithmetic and control unit 22, which will be described later. The arithmetic control unit 22 causes the monitor 23 to display the fundus photographed image 15 output from the image sensor 60. Note that the monitor 23 that displays various observation images captured by the image sensor 57 and the monitor 23 that displays the fundus photographed image 15 captured by the image sensor 60 may be the same or may be different from each other. It may be something.

The optotype display unit 54 is used for internal fixation to project fixation light of a fixation target (bright spot image) onto the eye E through the objective lens 43, and is, for example, a dot matrix liquid crystal display (LCD). Displays) and matrix light emitting diodes (LEDs) are used. This visual target display section 54 displays a fixation target. Furthermore, the visual target display section 54 can arbitrarily set the display mode (shape, etc.) and display position of the fixation target.

A part of the fixation light from the fixation target displayed on the optotype display section 54 is reflected by the half mirror 53 and then reflected by the mirror 52, the focusing lens 51, the dichroic mirror 55, and the hole of the perforated mirror 41. The light is projected onto the eye E through the dichroic mirror 42 and the objective lens 43. As a result, a fixation target, an optotype for visual acuity measurement, and the like are presented to the eye E through the objective lens 43.

The optotype display unit 54 also uses the stereo camera 20 to capture an anterior segment image 14 for estimating the race of the subject (hereinafter simply referred to as "for race estimation") stored in the database 12. When executed, it functions as a light source that irradiates the eye E with visible white light. That is, the optotype display section 54 functions as a visible light irradiation section of the present invention. Although details will be described later, as long as the pupil of the eye E can be reduced, the eye E may be irradiated with various types of visible light other than white light from the optotype display section 54.

The fundus camera unit 10a includes a focus optical system 70. The focus optical system 70 generates a split index for focusing on the fundus Ef. In addition to the objective lens 43, dichroic mirror 42, and perforated mirror 41 described above, the focus optical system 70 includes an LED 71, a relay lens 72, a split index plate 73, a two-hole diaphragm 74, a mirror 75, a condensing lens 76, and a reflecting rod 77.

The reflective surface of the reflective rod 77 is set on the optical path of the illumination optical system 30 when the focus optical system 70 performs focus adjustment. The focused light emitted from the LED 71 passes through the relay lens 72 and is separated into two light beams by the split index plate 73, then passes through the two-hole diaphragm 74, the mirror 75, and the condensing lens 76, and is reflected by the reflection bar 77. An image is once formed on the surface, and is reflected toward the relay lens 40 on this reflective surface. Further, the focused light passes through a relay lens 40, an apertured mirror 41, a dichroic mirror 42, and an objective lens 43, and is projected onto the fundus Ef.

The fundus reflected light of the focusing light passes through the objective lens 43, the dichroic mirror 42, and the hole of the apertured mirror 41, and a part of it passes through the dichroic mirror 55, and then passes through the focusing lens 51, the mirror 52, and the half mirror. 53, a dichroic mirror 55, and a condensing lens 56, the image is captured by an image sensor 57. The image sensor 57 images the fundus reflected light of the focus light and outputs an image signal. As a result, the split index is displayed on the monitor 23 together with the observed image. The arithmetic and control unit 22, which will be described later, analyzes the position of the split index and moves the focusing lens 51 and the like to automatically adjust the focus, as in the conventional case. Alternatively, the examiner may manually adjust the focus based on the split index displayed on the monitor 23.

The dichroic mirror 42 branches the optical path of the OCT optical system 80 from the optical path for photographing the fundus. The dichroic mirror 42 reflects light in a wavelength band used for OCT measurement and transmits light for fundus photography. The optical path of this OCT optical system 80 includes, in order from the OCT unit 10b side, a collimator lens unit 81, an optical path length changing section 82, a galvano scanner 83, a focusing lens 84, a mirror 85, and a relay lens 86. is provided.

The optical path length changing unit 82 includes, for example, a corner cube and a mechanism for moving the corner cube. The optical path length changing unit 82 is movable in the direction of the arrow shown in the figure, and changes the optical path length of the OCT optical system 80. This change in the optical path length is used for correcting the optical path length according to the axial length of the eye E to be examined, adjusting the interference state, and the like.

The galvano scanner 83 changes the traveling direction of the signal light passing through the optical path of the OCT optical system 80. Thereby, the fundus Ef can be scanned with the signal light. The galvano scanner 83 includes, for example, a galvano mirror that scans the signal light in the X direction, a galvano mirror that scans the signal light in the Y direction, and a mechanism that independently drives these. Thereby, the signal light can be scanned in any direction on the XY plane.

<OCT unit>
The OCT unit 10b includes an interference optical system used to obtain the OCT image 16. This OCT unit 10b, like a known OCT device, splits a low coherence light into a reference light and a signal light, and causes the signal light that has passed through the fundus Ef to interfere with the reference light that has passed through the reference optical path to generate interference light. and detect the spectral components of this interference light. The detection result (detection signal) by the OCT unit 10b is output to the arithmetic control unit 22. Note that the specific configuration of the OCT unit 10b is a known technology (for example, see Japanese Patent Application Laid-Open No. 2013-248376), so a specific description thereof will be omitted here.

<Stereo camera>
The stereo camera 20 includes a pair of cameras 20a and 20b. The camera 20a and the camera 20b are arranged to sandwich the objective lens 43 from the left and right sides, and photograph the anterior eye segment Ea from different directions, in this embodiment, from the left and right directions simultaneously (including substantially simultaneously). Note that the symbol OB in the figure is the optical axis of the camera 20a and the camera 20b.

The cameras 20a and 20b take color photographs of the anterior eye segment Ea from the left and right directions, respectively, and output a color anterior eye segment image 14, which is an observed image of the anterior eye segment Ea, to the arithmetic and control unit 22. Hereinafter, the anterior eye segment image 14 photographed by the camera 20a will be referred to as the "anterior eye segment image 14a", and the anterior eye segment image 14 photographed by the camera 20b will be referred to as the "anterior eye segment image 14b". These anterior segment images 14a and 14b are used for automatic alignment of the ophthalmological apparatus 10 with respect to the eye E to be examined, and for estimation processing of the race of the examinee executed by the server 11, which will be described later.

[Calculation control unit]
FIG. 3 is a functional block diagram of the arithmetic control unit 22 of the ophthalmologic apparatus 10 and the control section 140 of the server 11 according to the first embodiment. As shown in FIG. 3, the arithmetic control unit 22 centrally controls the operation of each part of the ophthalmologic apparatus 10. The functions of this arithmetic control unit 22 are realized using various processors. Various processors include CPU (Central Processing Unit), GPU (Graphics Processing Unit), ASIC (Application Specific Integrated Circuit), and programmable logic devices [for example, SPLD (Simple Programmable Logic Devices), CPLD (Complex Programmable Logic Device), and FPGA (Field Programmable Gate Arrays)]. Note that the various functions of the arithmetic control unit 22 may be realized by one processor, or may be realized by a plurality of processors of the same type or different types.

Furthermore, in addition to the fundus camera unit 10a, OCT unit 10b, stereo camera 20, and monitor 23 described above, an operation section 24 and a server 11, which will be described later, are connected to the arithmetic and control unit 22. The operation unit 24 receives various input operations by the examiner, such as a measurement start operation, a manual alignment operation, and various setting operations.

The arithmetic control unit 22 executes a control program in a storage section (not shown) to control the optical system control section 100, anterior eye segment image acquisition section 102, iris region analysis section 104, color correction section 106, and pupil diameter correction section 108. , an OCT image forming section 110, an eye characteristic acquisition control section 112, and an image output section 114. Note that what is described as the "~ section" of the arithmetic and control unit 22 may be "~ circuit," "~ device," or "~ equipment" (the same applies to the control section 140 described later). That is, what is described as "unit" may be composed of firmware, software, hardware, or a combination thereof.

The optical system control unit 100 controls the illumination optical system 30, the imaging optical system 50, the focus optical system 70, and the OCT optical system 80. When photographing the fundus photographed image 15, the optical system control section 100 operates the illumination optical system 30, the imaging optical system 50, and the focus optical system 70 under the control of the eye characteristic acquisition control section 112, which will be described later, to control the photographing light source. 35 to illuminate and focus the fundus Ef, and the imaging device 60 to image the fundus reflected light (obtain the fundus photographed image 15). Further, when acquiring the OCT image 16, the optical system control unit 100 operates the OCT optical system 80 under the control of the eye characteristic acquisition control unit 112, which will be described later, to change the optical path length by the optical path length changing unit 82, and Scanning of the signal light by the galvano scanner 83 is performed.

Furthermore, when the stereo camera 20 photographs the anterior segment images 14a and 14b for racial estimation, the optical system control unit 100 operates the optotype display unit 54 to Execute irradiation of white light to E.

FIG. 4 shows anterior segment images 14a and 14b obtained by the stereo camera 20 before (see reference numeral 4A) and during irradiation (see reference numeral 4B) of white light onto the eye E by the optotype display unit 54, respectively. FIG. In addition, in FIG. 4 (the same applies to FIGS. 5, 6, 8, etc., which will be described later), in order to prevent the drawing from becoming complicated, only the anterior eye segment image 14a is shown, and the illustration of the anterior eye segment image 14b is omitted. ing.

As shown by reference numerals 4A and 4B in FIG. 4, the pupil of the eye E to be examined can be reduced by irradiating white light from the optotype display unit 54 to the eye E to be examined. Thereby, in the anterior segment images 14a and 14b, the area of the iris region A1 corresponding to the iris of the eye E to be examined can be expanded, and the area of the pupil region A2 corresponding to the pupil of the eye E to be examined can be reduced. The iris area A1 is used in the process of estimating the race of the subject by the estimation unit 144 of the server 11, which will be described later.

Returning to FIG. 3, the anterior eye segment image acquisition unit 102 controls the cameras 20a and 20b to perform imaging (video shooting, etc.) of the anterior eye segment Ea, and also controls the cameras 20a and 20b to capture the anterior eye segment image 14a. , 14b are repeatedly obtained. Thereby, the anterior eye segment image acquisition unit 102 acquires color anterior eye segment images 14a and 14b for race estimation. The anterior eye images 14a and 14b acquired by the anterior eye image acquisition unit 102 are also used for alignment detection and auto-alignment of the ophthalmological apparatus 10 by an alignment control unit (not shown).

FIG. 5 is an explanatory diagram for explaining detection of an NG area 120 (NG area 120 caused by eyelashes) in the iris area A1 by the iris area analysis unit 104. FIG. 6 is an explanatory diagram for explaining detection of an NG area 120 (NG area 120 caused by ambient light) in the iris area A1 by the iris area analysis unit 104.

As shown in FIGS. 5, 6, and the previously described FIG. 3, the iris area analysis unit 104 corresponds to the area detection unit of the present invention. The iris area analysis unit 104 analyzes the iris color from within the iris area A1 of the anterior eye images 14a, 14b based on the anterior eye images 14a, 14b for race estimation acquired by the anterior eye image acquisition unit 102. An NG area 120, which is an unidentifiable area in which the (color distribution) cannot be identified, is detected, and the NG area 120 is set for the anterior segment images 14a and 14b. Note that the reference numeral 122 in the figure is an OK area that is an identifiable area in which the color (color distribution) of the iris can be identified within the iris area A1.

First, the iris area analysis unit 104 selects an area in the iris area A1 where an image different from the iris is shown, for example, an area where eyelashes are shown (vignetted by the eyelashes) as shown in reference numeral 5A in FIG. Also, an area where disturbance light is reflected as shown by reference numeral 6A in FIG. 6 is detected as an NG area 120.

For example, the iris region analysis unit 104 detects the iris region A1 from the anterior segment images 14a and 14b using a known method (see, for example, Japanese Patent Application Publication No. 2018-45437). Then, the iris region analysis unit 104 forms a pixel set by clustering pixels having similar colors and luminances based on the color and luminance of each pixel in the iris region A1, thereby forming an anterior segment image 14a, The NG area 120 is detected from within the iris area A1 of 14b (see, for example, Japanese Patent Laid-Open No. 2018-206239). In addition, the iris region analysis unit 104 uses a known independent component analysis process, or uses the method disclosed in "The Measurement of Highlights in Color Images," GUDRUN J. KLINKER, STEVEN A. SHAFER, AND TAKEO KANADE. The NG area 120 may be detected from within the iris area A1 by using a reflection removal method. Furthermore, the NG area 120 may be detected using another known image analysis method (reflection removal method).

Next, as shown by reference numeral 5B in FIG. 5 and reference numeral 6B in FIG. An NG area 120 is set for 14b. Setting the NG region 120 means, for example, adding information regarding the position and shape of the NG region 120 to the accompanying information of the anterior eye images 14a, 14b, or masking the NG region 120 in the anterior eye images 14a, 14b. It means to process or remove it. As a result, when the estimation unit 144 of the server 11 described later performs the process of estimating the race of the subject based on the iris area A1 in the anterior segment images 14a and 14b, the NG area 120 is excluded and the OK area 122 is Estimation processing can be performed based only on

FIG. 7 is an explanatory diagram for explaining color correction processing by the color correction unit 106. As the observation light source 31 (halogen lamp or LED) used in the ophthalmologic apparatus 10, there are light sources with various wavelength distributions. Therefore, when storing the anterior eye segment images 14a, 14b acquired (photographed) by various ophthalmological apparatuses 10 in the database 12, the anterior eye segment images 14a, 14b acquired by various ophthalmic apparatuses 10 are It is preferable that the images be stored in the database 12 after color correction as if they were taken under illumination by the same light source.

Therefore, as shown in FIG. 7 and FIG. 3 described above, the color correction unit 106 adjusts the colors of the anterior eye images 14a and 14b acquired by the anterior eye image acquisition unit 102 using a predetermined standard light source. Color correction (color conversion) is performed to the colors of the anterior eye images 14a and 14b photographed by the stereo camera 20 (obtained by the anterior eye image acquisition unit 102) under illumination of the eye E to be examined.

For example, the color correction unit 106 includes standard light source spectrum information 130 that is the spectrum of a known standard light source (halogen bulb light source or D65 light source), and light source spectrum information that is the spectrum of a known observation light source 31 (halogen lamp or LED). 132 is input. Furthermore, a method of calculating RGB values of an image (pixel) from the spectrum of light is also known. Therefore, the color correction unit 106 calculates the anterior segment image 14a, Color correction of the anterior segment images 14a and 14b is performed by converting the RGB values of each pixel of the image 14b. By performing this color correction, it is possible to further improve the accuracy of the process of estimating the race of the subject in the estimation unit 144 of the server 11, which will be described later.

FIG. 8 is an explanatory diagram for explaining correction processing by the pupil diameter correction unit 108. Note that 8A in FIG. 8 is the anterior segment images 14a, 14b before the correction process by the pupil diameter correction unit 108, and 8B in FIG. 8 is the anterior segment images 14a, 14b after the correction process by the pupil diameter correction unit 108. 14b.

Depending on the timing of acquisition of the anterior segment images 14a, 14b by the ophthalmological apparatus 10, the sizes of the iris area A1 and the pupil area A2 in the anterior segment images 14a, 14b (i.e., the pupil diameter of the eye E to be examined) are set as standard. It may vary depending on the size. Further, for example, even in the same subject, the sizes of the iris area A1 and the pupil area A2 may change depending on the acquisition timing of the anterior segment images 14a and 14b. Here, since the anterior segment images 14a and 14b for race estimation are accumulated in the database 12 for various research purposes, if images with different sizes of iris area A1 and pupil area A2 are mixed, statistical processing becomes difficult. Furthermore, when the estimation unit 144 of the server 11 (described later) estimates the race of the subject, if the size of the iris area A1 is significantly different from the standard, the accuracy of the race estimation may decrease. There is.

Therefore, as shown in FIG. 8 and FIG. 3 described above, the pupil diameter correction unit 108 corrects the iris area A1 and pupil area A2 in the anterior eye images 14a and 14b acquired by the anterior eye image acquisition unit 102. Image processing is performed to correct the pupil diameter of the pupil area A2 to a predetermined size.

For example, the pupil diameter correction unit 108 performs known affine transformation processing on the anterior eye images 14a, 14b acquired by the anterior eye image acquisition unit 102, thereby determining the pupil area within the anterior eye image 14a, 14b. The pupil diameter of A2 is corrected to a predetermined size. Furthermore, based on the analysis results of general movement analysis of the pupillary dilator muscle and pupillary sphincter muscle of the eye, the pupil diameter correction unit 108 performs coordinate transformation processing on each pixel of the iris area A1 in the anterior eye images 14a and 14b. By applying this, the pupil diameter of the pupil area A2 may be corrected to a predetermined size.

Furthermore, if the pupil of the eye E to be examined is too dilated, the pupil diameter correction unit 108 sets a part of the pupil area A2 as a missing part, and sets the anterior segment image 14a acquired by the anterior segment image acquisition unit 102. , 14b to expand the iris area A1 inward, thereby correcting the pupil diameter of the pupil area A2 to a predetermined size. Furthermore, when the subject is elderly, miosis occurs, which makes it difficult for the pupils to open. In this case, the pupil diameter correction unit 108 enlarges the pupil diameter of the pupil area A2 to a typical φ3 to 4 mm with respect to the anterior eye images 14a and 14b acquired by the anterior eye image acquisition unit 102. Perform enlargement processing.

Returning to FIG. 3, the order in which the detection and setting of the NG area 120 by the iris area analysis unit 104, the color correction process by the color correction unit 106, and the correction process by the pupil diameter correction unit 108 are executed is not particularly limited. , may be executed in any order. However, when the correction process is performed by the pupil diameter correction unit 108 after the detection and setting of the NG area 120 by the iris area analysis unit 104 described above, the correction of the NG area 120 is executed according to the expansion or reduction of the iris area A1. , or causes the iris region analysis unit 104 to detect and set the NG region 120 again.

The OCT image forming section 110 constitutes the ocular characteristic acquisition section of the present invention together with the OCT unit 10b, and forms an OCT image 16 of the fundus Ef by analyzing the detection signal inputted from the OCT unit 10b. Note that the specific method of forming the OCT image 16 is the same as that of a conventional OCT apparatus, so a description thereof will be omitted here.

The eye characteristics acquisition control unit 112 controls each part of the ophthalmological apparatus 10 to acquire the eye characteristics (fundus photographed image 15 and OCT image 16) of the eye E to be examined. Specifically, the ocular characteristic acquisition control unit 112 controls the illumination optical system 30, the imaging optical system 50, and the focus optical system 70 of the fundus camera unit 10a via the optical system control unit 100 to obtain the fundus photographed image 15. get.

Further, the ocular characteristic acquisition control unit 112 controls the OCT optical system 80 of the fundus camera unit 10a via the optical system control unit 100, and also controls the OCT unit 10b and the OCT image forming unit 110 to generate the OCT image 16. get. Although not shown, the eye characteristic acquisition control unit 112 analyzes the OCT image 16 of the fundus Ef to create layer thickness distribution data of the fundus Ef, and combines this layer thickness distribution data with the normal eye created in advance. It also functions as an analysis unit that creates a comparison map (see Japanese Patent Application Laid-Open No. 2019-58491) by comparing the normal data that is layer thickness distribution data.

Furthermore, the eye characteristics acquisition control unit 112 changes the conditions (operating conditions) for acquiring the eye characteristics of the eye E to be examined by each part of the ophthalmological apparatus 10, according to a determination by a condition determination unit 148 of the server 11, which will be described later. Examples of the acquisition conditions include the amount of photographing light from the photographing light source 35 and the type of normal data described above. The eye characteristic acquisition control unit 112 causes the photography light source 35 to emit light of the photography light amount determined by the condition determining unit 148. Furthermore, the eye characteristic acquisition control unit 112 uses the normative data determined by the condition determination unit 148 when creating the above-mentioned comparison map.

The image output section 114 functions as an output section, an anterior segment image output section, and an eye characteristic output section of the present invention. The image output unit 114 outputs the anterior segment images 14a and 14b for race estimation acquired by the anterior segment image acquisition unit 102, and the NG area 120 (area of the present invention) by the iris area analysis unit 104 described above. The anterior segment images 14a and 14b in which the images (corresponding to the detection results of the detection unit) have been set are output to the server 11 (estimation unit 144). The image output unit 114 also sends the eye characteristic acquisition results (fundus photographed image 15 and OCT image 16) of the eye E acquired under the control of the eye characteristic acquisition control unit 112 to the server 11 (storage control unit 146). Output.

Further, the image output unit 114 outputs the ID information 17 of the subject inputted through the operation unit 24 or the like to the server 11 in association with the anterior eye images 14a, 14b and the eye characteristic acquisition results.

[server]
The server 11 includes a control unit 140. The control unit 140 stores the anterior segment images 14 a and 14 b of the eye E to be examined and the eye characteristic acquisition results in the database 12 , processes the race estimation process of the examinee, and changes the acquisition conditions of the eye characteristics by the ophthalmological apparatus 10 . Executes various controls such as The functions of the control unit 140 are realized using one or more various processors, similar to the arithmetic control unit 22 described above.

The control unit 140 functions as an image acquisition unit 142, an estimation unit 144, a storage control unit 146, and a condition determination unit 148 by executing a control program in a storage unit (not shown).

The image acquisition unit 142 receives the anterior segment images 14a and 14b of the eye E to be examined and the eye characteristic acquisition results (fundus photographed image 15 and OCT image 16) outputted from the image output unit 114 of the ophthalmological apparatus 10, and the image of the examinee. It functions as an interface for acquiring ID information 17. The image acquisition unit 142 outputs the acquired anterior segment images 14a and 14b to the estimation unit 144. The image acquisition unit 142 also outputs the acquired anterior segment images 14 a and 14 b, fundus photographed image 15 , OCT image 16 , and ID information 17 to the storage control unit 146 .

The estimation unit 144 performs a process of estimating the race of the subject based on the anterior segment images 14a and 14b input from the image acquisition unit 142. The estimation unit 144 detects the iris area A1 from the anterior segment images 14a and 14b in the same way as the iris area analysis unit 104 described above, and further detects the iris area A1 based on the NG area 120 set by the iris area analysis unit 104. The OK area 122 within is detected. Then, the estimation unit 144 detects the iris color (color distribution) of the eye E to be examined based on the OK area 122 in the anterior segment images 14a and 14b, and estimates the race of the examinee based on this detection result. Perform processing.

For example, the estimation unit 144 determines the race of the test subject based on the detection result of the iris color (color distribution) in the OK area 122, with reference to a data table or metadata that associates the iris color with the race. presume. Alternatively, the estimation unit 144 performs image analysis processing using artificial intelligence (AI) on the OK region 122, for example, using machine learning or deep learning based on a known machine learning algorithm or deep learning algorithm. The test subject's race is estimated by performing image analysis processing. Note that the method used for the race estimation process by the estimation unit 144 is not particularly limited as long as it is a method of estimating the race from the color of the iris (color distribution).

Then, the estimation unit 144 outputs race information 18, which is the result of estimating the race of the subject, to the storage control unit 146 and the condition determination unit 148. Note that the estimating unit 144 refers to the database 12 based on the ID information 17 associated with the anterior segment images 14a and 14b, and if the race information 18 of the subject is already known, the above-mentioned omit the race estimation process.

The storage control unit 146 stores the anterior segment images 14a and 14b, the fundus photographed image 15, the OCT image 16, and the ID information 17 input from the image acquisition unit 142, and the race information 18 input from the estimation unit 144. are stored in the database 12 in association with each other. Thereby, the racial information 18 of the subject can be stored in the database 12 in association with the anterior segment images 14a and 14b, the photographed fundus image 15, and the OCT image 16 of the subject.

As shown in FIG. 1, the database 12 stores anterior segment images 14a and 14b, fundus photographed images 15, and OCT images input from the server 11 for each subject (that is, for each ID information 17). 16, and racial information 18 are accumulated.

In this way, by associating the anterior segment images 14a, 14b, the fundus photographed image 15, and the OCT image 16 with the subject's racial information 18 and storing them in the database 12, the database 12 can be used to Trend analysis and progress observation of the anterior segment images 14a, 14b and eye characteristics (fundus photographed image 15 and OCT image 16) can be performed. Furthermore, it is possible to analyze the relationship between the anterior segment images 14a and 14b and eye characteristics for each race.

Furthermore, the database 12 can be used for research into predicting eye diseases by race. For example, in Europe and the United States, research on iridology has been conducted for a long time (see, for example, Japanese Patent Application Publication No. 2019-103079). Iridology is an analysis method that obtains an anterior segment image of the subject's eye and diagnoses a person's health information or medical history based on various information appearing in the iris image within the anterior segment image. Since the database 12 stores anterior segment images 14a and 14b and eye characteristics (fundus photographed image 15 and OCT image 16) for each race, the information in the database 12 can be used from the iris to the eye for each race. It can be used in research to diagnose or predict diseases.

Based on the race information 18 input from the estimating unit 144, the condition determining unit 148 determines the conditions for acquiring the eye characteristics of the eye E to be examined by the ophthalmological apparatus 10, that is, the imaging light amount of the imaging light source 35 described above and the normative imaging light source 35 described above. Determine the data. For example, the condition determining unit 148 has acquisition condition information (data table, etc.) indicating the correspondence between a race, the photographing light amount of the photographing light source 35 suitable for the race, and normative data, and By referring to the acquisition condition information based on 18, the photographing light amount of the photographing light source 35 and the normative data suitable for the race are determined.

The condition determination unit 148 then outputs the acquisition conditions for fundus characteristics (the imaging light amount of the imaging light source 35 and the normal data) suitable for the race of the subject to the eye characteristics acquisition control unit 112 of the ophthalmological apparatus 10 . As a result, the eye characteristic acquisition control unit 112 causes the photography light source 35 to emit light of the photography light amount determined by the condition determination unit 148, and generates a comparison map using the normative data determined by the condition determination unit 148. .

[Operation of the ophthalmological system of the first embodiment]
FIG. 9 shows the flow of the eye characteristic acquisition process of the eye E to be examined by the ophthalmological system 9 of the first embodiment having the above configuration, particularly the anterior segment images 14a and 14b for race estimation according to the method of controlling the ophthalmological apparatus of the present invention. 12 is a flowchart showing the flow of acquisition and accumulation in the database 12.

When an operation to start acquiring the eye characteristics of the eye E to be examined is input to the operation unit 24, or when preparations for acquiring the eye characteristics of the eye E to be examined are completed, the ophthalmologic apparatus 10 is activated. First, the optical system control unit 100 operates the optotype display unit 54 to start irradiating the eye E with white light by the optotype display unit 54 (step SA1). As a result, the pupil of the subject's eye E is reduced and the iris is enlarged, so that the anterior segment image 14a, which is used by the estimation unit 144 to estimate the race of the subject, as shown in FIG. The iris area A1 within 14b is enlarged. As a result, the accuracy of the race estimation process by the estimation unit 144 can be improved, that is, anterior segment images 14a and 14b suitable for the race estimation process by the estimation unit 144 are obtained.

When irradiation of the white light onto the eye E to be examined is started, the anterior eye segment image acquisition unit 102 controls the cameras 20a and 20b of the stereo camera 20 to perform color photography of the anterior eye segment Ea, and the camera 20a , 20b (step SA2, corresponding to the anterior eye image acquisition step of the present invention).

When the anterior eye image acquisition unit 102 acquires the color anterior eye images 14a and 14b for race estimation, the iris area analysis unit 104 analyzes the anterior eye images 14a and 14b as shown in FIGS. Detection of the NG area 120 from within the iris area A1 of the partial images 14a and 14b and setting of the NG area 120 for the iris area A1 are executed (step SA3, corresponding to the area detection step of the present invention). This allows the estimating unit 144 to estimate the race of the subject based only on the OK area 122 within the iris area A1, thereby increasing the accuracy of race estimation by the estimating unit 144. Therefore, anterior segment images 14a and 14b suitable for race estimation by the estimation unit 144 are obtained.

Further, as shown in FIG. 7 described above, the color correction section 106 performs color correction on the anterior segment images 14a and 14b, and as shown in FIG. 8 described above, the pupil diameter correction section 108 A correction process for the pupil diameter of the pupil area A2 is performed on the eye images 14a and 14b (step SA4). Through this color correction, regardless of the type of observation light source 31, the colors of the anterior segment images 14a and 14b are corrected as if they were photographed under illumination by the same light source (standard light source). Further, by the correction process of the pupil diameter of the pupil region A2, the pupil diameter of the pupil region A2 in the anterior eye images 14a and 14b can be set to a predetermined size. As a result, the accuracy of race estimation by the estimation unit 144 can be improved, and the analysis or research described above (trend analysis, follow-up observation, disease diagnosis or prediction, etc.) becomes easier to perform.

Although the order of steps SA3 and SA4 is not particularly limited, if the pupil diameter correction process is performed by the pupil diameter correction unit 108 after step SA3, it is preferable to perform the process of step SA3 again.

Next, the image output unit 114 outputs the image of the patient input in advance using the operation unit 24 or the like to the anterior segment images 14a and 14b in which the NG area 120 has been set and which has undergone color correction processing and pupil diameter correction processing. After associating the person's ID information 17, the anterior segment images 14a and 14b are output to the server 11 (step SA5, corresponding to the output step of the present invention).

The image acquisition unit 142 of the server 11 acquires the anterior segment images 14a and 14b (ID information 17) from the image output unit 114, and sends the anterior segment images 14a and 14b to the estimation unit 144 and the storage control unit 146. Output (step SB1).

The estimation unit 144, which receives the anterior eye images 14a and 14b from the image acquisition unit 142, estimates the anterior eye area based on the anterior eye images 14a and 14b and the NG area 120 previously set by the iris area analysis unit 104. An OK area 122 within the iris area A1 of the partial images 14a and 14b is detected. Then, the estimation unit 144 detects the color (color distribution) of the iris of the eye E to be examined based on the OK area 122, estimates the race of the examinee based on this detection result, and stores the racial information 18. It is output to the control section 146 and the condition determining section 148 (step SB2).

Note that, based on the ID information 17 associated with the anterior segment images 14a and 14b, the estimating unit 144 determines whether racial information 18 corresponding to the subject (ID information 17) is stored in the database 12. omits the race estimation process (step SB2).

When the race estimation process is completed, the storage control unit 146 stores the anterior segment images 14a, 14b and ID information 17 input from the image acquisition unit 142, and the race information 18 input from the estimation unit 144. It is stored in the database 12 in association (step SB3).

Furthermore, the condition determining unit 148 determines conditions for acquiring the eye characteristics of the eye E to be examined by the ophthalmological apparatus 10 (the amount of photographing light of the photographing light source 35 and the normative data) based on the race information 18 input from the estimating unit 144. (Step SB4). Then, the condition determination unit 148 outputs the determined acquisition conditions to the eye characteristic acquisition control unit 112 of the ophthalmologic apparatus 10 (step SB5).

When the eye characteristic acquisition control unit 112 receives the input of the eye characteristic acquisition conditions from the condition determination unit 148, it compares the current acquisition conditions with the acquisition conditions input from the condition determination unit 148 (step SA6). Then, if the current acquisition conditions are different from the acquisition conditions input from the condition determination unit 148, the eye characteristic acquisition control unit 112 changes the current acquisition conditions to match the new acquisition conditions (step SA7, SA8). Thereby, it is possible to acquire (measure, etc.) the eye characteristics of the subject's eye E suitable for the race of the subject.

Next, the eye characteristic acquisition control unit 112 controls the fundus camera unit 10a, the OCT unit 10b, and the OCT image forming unit 110 to acquire the eye characteristics (fundus photographed image 15 and OCT image 16) of the eye E to be examined. (Step SA9). Since the acquisition conditions for the eye characteristics are adjusted in accordance with the race of the subject in step SA8 described above, more accurate eye characteristics of the eye E to be examined can be obtained.

When the acquisition of the eye characteristics of the eye E is completed, the image output unit 114 associates the previously described ID information 17 with the fundus photographed image 15 and the OCT image 16, which are the results of acquiring the eye characteristics of the eye E, and then displays these fundus images. The photographed image 15 and the OCT image 16 are output to the server 11 (step SA10).

The image acquisition unit 142 of the server 11 acquires the fundus photographed image 15 and the OCT image 16 (ID information 17) from the image output unit 114, and outputs the fundus photographed image 15 and the OCT image 16 to the storage control unit 146 ( Step SB6).

The storage control unit 146 stores the fundus photographed image 15 and the OCT image 16 in association with the ID information 17 in the database 12 based on the ID information 17 associated with the fundus photographed image 15 and the OCT image 16 (step SB7). . This completes the storage of the anterior segment images 14a, 14b, fundus photographed image 15, OCT image 16, and racial information 18 of the subject (ID information 17) in the database 12.

Hereinafter, each time the eye characteristics of a subject are acquired by the ophthalmological apparatus 10, the anterior segment images 14a, 14b (for each ID information 17), the fundus photographed image 15, the OCT image 16, and racial information 18 are stored in the database 12. Thereby, the database 12 can be used for various types of eye research for each race.

[Effects of the first embodiment]
As described above, in the ophthalmological system 9 of the first embodiment, the color anterior segment images 14a and 14b for race estimation are acquired, and the NG area 120 is extracted from within the iris area A1 of the anterior segment images 14a and 14b. By detecting this, the estimation unit 144 can estimate the race of the subject based on the OK area 122 within the iris area A1. Thereby, the accuracy of race estimation by the estimation unit 144 can be improved. As a result, the ophthalmologic system 9 (ophthalmologic apparatus 10) obtains an anterior segment image 14 suitable for estimating the race of the subject.

[Ophthalmology system of second embodiment]
FIG. 10 is a block diagram of the ophthalmologic apparatus 10 and the server 11 (a functional block diagram of the arithmetic control unit 22 and the control section 140) that constitute the ophthalmologic system 9 of the second embodiment. In the first embodiment, the estimating unit 144 estimates the race of the subject based on the OK area 122 in the iris area A1 of the anterior segment images 14a and 14b, but in the second embodiment, the estimating unit 144 performs a process of estimating the race of the subject based on the entire area (including almost the entire area) of the iris area A1 of the anterior segment images 14a and 14b.

As shown in FIG. 10, the ophthalmologic system 9 of the second embodiment has basically the same configuration as the ophthalmologic system 9 of the first embodiment, except that the arithmetic control unit 22 of the ophthalmologic apparatus 10 functions as an interpolation unit 105. It is. For this reason, the same reference numerals are given to the same elements in function or configuration as those in the first embodiment, and the explanation thereof will be omitted.

The interpolation unit 105 operates when the NG area 120 is included in the iris area A1 of at least one of the anterior segment images 14a and 14b based on the detection result of the NG area 120 by the iris area analysis unit 104. The interpolation unit 105 performs interpolation processing on the NG area 120 using the OK area 122 (that is, a different area from the NG area 120) within the iris area A1 based on the detection result of the NG area 120 by the iris area analysis unit 104.

FIG. 11 is an explanatory diagram for explaining a first example of interpolation processing for the NG area 120 by the interpolation unit 105. As shown by symbols XIA and XIB in FIG. Based on this, interpolation processing is performed on the NG region 120 using, for example, a linear interpolation method.

FIG. 12 is an explanatory diagram for explaining a second example of interpolation processing for the NG area 120 by the interpolation unit 105.

As shown by reference numeral XIIA in FIG. 12, if the NG area 120 is included in the iris area A1 of the anterior eye image 14a taken by the camera 20a, the interpolation unit 105 determines whether the NG area 120 is included in the iris area A1 taken by another camera 20b. A corresponding area corresponding to the NG area 120 is detected from within the iris area A1 of the anterior eye segment image 14b. Then, as shown by reference numeral XIIB in FIG. 12, when the corresponding area is an OK area 122, the interpolation unit 105 determines the NG area in the anterior eye image 14a based on the color and brightness of each pixel in this corresponding area. Interpolation processing for the NG area 120 is performed by estimating the color and brightness of each pixel in the NG area 120. In this case, camera 20a corresponds to the first camera of the present invention, and camera 20b corresponds to the second camera of the present invention.

Conversely, if the NG area 120 is included in the iris area A1 of the anterior eye image 14b taken by the camera 20b, the interpolation unit 105 calculates the iris area of the anterior eye image 14a taken by the camera 20a. A corresponding area is detected from within A1. Then, when the corresponding area is the OK area 122, the interpolation unit 105 calculates the color and brightness of each pixel in the NG area 120 in the anterior segment image 14b based on the color and brightness of each pixel in this corresponding area. By analogy, interpolation processing for the NG area 120 is performed. In this case, camera 20a corresponds to the second camera of the present invention, and camera 20b corresponds to the first camera of the present invention.

Returning to FIG. 10, the color correction process by the color correction unit 106 and the correction process by the pupil diameter correction unit 108 of the second embodiment are performed before or after the above-described NG area 120 detection process and interpolation process. Then, the image output unit 114 of the second embodiment outputs the anterior segment images 14 a and 14 b that have been subjected to interpolation processing and the like to the image acquisition unit 142 of the server 11 .

The estimation unit 144 of the server 11 of the second embodiment detects the iris color (color distribution) of the subject's eye E based on the iris area A1 in the anterior eye images 14a and 14b subjected to interpolation processing by the interpolation unit 105, Based on this detection result, the race of the subject is estimated.

FIG. 13 shows the flow of the eye characteristic acquisition process of the eye E to be examined by the ophthalmological system 9 of the second embodiment having the above configuration, particularly the anterior segment images 14a and 14b for race estimation according to the method of controlling the ophthalmological apparatus of the present invention. 12 is a flowchart showing the flow of acquisition and accumulation in the database 12.

As shown in FIG. 13, in the second embodiment, the eye characteristic acquisition of the first embodiment shown in FIG. The processing is basically the same.

In step SA3, the iris area analysis unit 104 only detects the NG area 120 from within the iris area A1 of the anterior segment images 14a and 14b, and outputs the detection result of the NG area 120 to the interpolation unit 105. Then, in step SA3-1, the interpolation unit 105 performs interpolation processing on the NG area 120 as shown in FIG. 11 or 12 described above based on the detection result of the NG area 120 by the iris area analysis unit 104.

As described above, in the second embodiment, by performing interpolation processing on the NG region 120 by the interpolation unit 105, the color of the iris of the subject's eye E is detected in the entire iris region A1. Species estimation processing can be performed. As a result, the accuracy of estimating the race of the test subject is higher than in the first embodiment, in which the race of the test subject is estimated based on a part of the iris area A1 (region other than the NG area 120). can be increased.

FIG. 14 is a block diagram of a modification of the ophthalmologic system 9 of the second embodiment. In the second embodiment, the arithmetic control unit 22 of the ophthalmologic apparatus 10 functions as the interpolation section 105, but the control section 140 of the server 11 may function as the interpolation section 105 as shown in FIG. Even in this case, the estimating unit 144 can perform the process of estimating the race of the subject based on the entire area of the iris area A1 in the anterior segment images 14a and 14b.

[Ophthalmology system of third embodiment]
FIG. 15 is a block diagram of the ophthalmologic apparatus 10 and the server 11 (a functional block diagram of the arithmetic control unit 22 and the control section 140) that constitute the ophthalmologic system 9 of the third embodiment. Note that the ophthalmologic system 9 of the third embodiment has basically the same configuration as each of the above embodiments, except that some of the functions of the arithmetic control unit 22 and the control section 140 are different from those of the above embodiments. . For this reason, the same reference numerals are given to the same elements in terms of function or configuration as in each of the above embodiments, and the explanation thereof will be omitted.

In each of the above embodiments, the arithmetic control unit 22 of the ophthalmologic apparatus 10 functions as the color correction section 106 and the pupil diameter correction section 108, and the control section 140 of the server 11 functions as the estimation section 144 and the condition determination section 148. , the functions of the arithmetic control unit 22 and the control section 140 may be partially replaced.

For example, as shown in FIG. 15, the arithmetic and control unit 22 may also function as the estimation section 144 and the condition determination section 148. In this case, the anterior eye segment image acquisition unit 102 outputs the anterior eye segment images 14a and 14b to the estimation unit 144, and the iris area analysis unit 104 outputs the detection result of the NG area 120 to the estimation unit 144. Therefore, the anterior eye segment image acquisition section 102 and the iris region analysis section 104 of the third embodiment function as an output section of the present invention. Then, as in each of the above embodiments, the estimation unit 144 performs a process of estimating the race of the subject, and the condition determining unit 148 determines the ocular characteristics of the eye E based on the result of this process of estimating the race. Acquisition conditions are determined, and the eye characteristics of the eye E to be examined are acquired according to the acquisition conditions.

Further, the control unit 140 may function as the color correction unit 106 and the pupil diameter correction unit 108. Thereby, the anterior eye images 14a and 14b acquired by the image acquisition unit 142 are subjected to color correction processing by the color correction unit 106 and pupil diameter correction processing by the pupil diameter correction unit 108. The anterior segment images 14a and 14b, which have been subjected to the color correction process and the pupil diameter correction process, are then stored in the database 12 by the storage control unit 146.

In the ophthalmologic system 9 of the third embodiment, only a part of the functions of the arithmetic control unit 22 and the control section 140 of the first embodiment are replaced, so that the same effects as those of the first embodiment can be obtained.

[others]
In each of the above embodiments, the stereo camera 20 (cameras 20a, 20b) photographs the anterior segment Ea of the eye E to obtain the anterior segment images 14a, 14b. The eye Ea may also be photographed. In this case, for example, the interpolation unit 105 of the second embodiment uses the corresponding area (OK area 122) in the iris area A1 of the anterior eye image 14 captured by one or more second cameras to Interpolation processing is performed on the NG area 120 within the iris area A1 of the anterior eye image 14 photographed by the camera.

In each of the embodiments described above, the anterior eye segment Ea is photographed by the cameras 20a and 20b of the stereo camera 20 to obtain the anterior eye segment images 14a and 14b. Although the estimation unit 144 performs the process of estimating the race of the subject based on the image 14b, the estimation process may be performed based on one of the anterior segment images 14a and 14b. That is, only one camera may be used for the process of estimating the race of the subject. In this case, after the imaging optical system 50 performs an NG area 120 setting or interpolation processing on the anterior eye image 14 acquired through the objective lens 43, the estimation unit The anterior segment image 14 may be stored in the database 12 while performing the process of estimating the race of the subject by 144.

In each of the embodiments described above, when the stereo camera 20 acquires the anterior segment images 14a and 14b for race estimation, the optotype display unit 54 is used to irradiate the eye E with white light. If the pupil can be reduced, a visible light irradiation unit that irradiates various types of visible light to the eye E may be used instead of the optotype display unit 54.

In each of the above embodiments, the ophthalmological apparatus 10 is described as an example of a multifunction device that acquires a photographed fundus image and an OCT image of the fundus Ef of the eye E to be examined. The present invention can be applied to various ophthalmological devices capable of photographing images, such as fundus cameras, OCT devices, slit lamp microscopes, and fluorescence fundus contrast examination devices.

9... Ophthalmic system 10... Ophthalmic device 10a... Fundus camera unit 10b... OCT unit 11... Server 12... Database 14, 14a, 14b... Anterior segment image 15... Fundus photographed image 16... OCT image 17... ID information 18... Race Information 20...stereo cameras 20a, 20b...camera 22...arithmetic control unit 23...monitor 30...illumination optical system 50...imaging optical system 54...target display section 70...focus optical system 80...OCT optical system 100...optical system control section 102...Anterior segment image acquisition unit 104...Iris region analysis unit 105...Interpolation unit 106...Color correction unit 108...Pupillary diameter correction unit 110...OCT image formation unit 112...Eye characteristic acquisition control unit 114...Image output unit 120...NG Area 122...OK area 130...Standard light source spectrum information 132...Light source spectrum information 140...Control unit 142...Image acquisition unit 144...Estimation unit 146...Storage control unit 148...Condition determination unit A1...Iris area A2...Pupillary area E...Eye area Optometry Ea...anterior segment Ef...fundus

Claims (13)

In an ophthalmology system including an ophthalmology device and a server,
The ophthalmological device includes:
an anterior eye segment image acquisition unit that acquires a color anterior eye segment image of the eye to be examined;
an area detection unit that detects an unidentifiable area in which the color of the iris cannot be identified in the iris area, when an area corresponding to the iris of the eye to be examined in the anterior eye image is an iris area;
an output unit that outputs the anterior eye segment image and the detection result of the area detection unit to an estimation unit that estimates the race of the subject based on the color of the iris area;
an anterior eye segment image output unit that outputs the anterior eye segment image to the server;
Equipped with
The ophthalmological apparatus or the server includes an interpolation unit that performs interpolation processing on the unidentifiable area using an identifiable area different from the unidentifiable area in the iris area based on a detection result of the area detecting unit. and
The estimation unit is provided in the ophthalmological apparatus or the server, and estimates the race of the subject based on the iris area subjected to the interpolation process by the interpolation unit,
the anterior eye segment image acquisition unit obtains the anterior eye segment images from a plurality of cameras that photograph the subject's eye from different directions;
The interpolation unit selects a second camera different from the first camera among the plurality of cameras based on the identifiable area in the anterior eye image taken by the first camera among the plurality of cameras. An ophthalmologic system that performs interpolation processing on the indiscernible region of the anterior eye image photographed by. In an ophthalmology system including an ophthalmology device and a server,
The ophthalmological device includes:
an anterior eye segment image acquisition unit that acquires a color anterior eye segment image of the eye to be examined;
an area detection unit that detects an unidentifiable area in which the color of the iris cannot be identified in the iris area, when an area corresponding to the iris of the eye to be examined in the anterior eye image is an iris area;
an output unit that outputs the anterior eye segment image and the detection result of the area detection unit to an estimation unit that estimates the race of the subject based on the color of the iris area;
an anterior eye segment image output unit that outputs the anterior eye segment image to the server;
Equipped with
When the area corresponding to the pupil of the subject's eye in the anterior eye image is defined as the pupil area, the iris area and the pupil area in the anterior eye image acquired by the anterior eye image acquisition unit are imaged. An ophthalmologic system, wherein the ophthalmologic apparatus or the server includes a pupil diameter correction unit that processes the pupil diameter of the pupil region to a predetermined size. The estimation unit is provided in the server, and estimates the race of the subject from an identifiable area different from the unidentifiable area in the iris area based on the detection result of the area detection unit. The ophthalmological system according to claim 2 . The ophthalmological apparatus or the server includes an interpolation unit that performs interpolation processing on the unidentifiable area using an identifiable area different from the unidentifiable area in the iris area based on a detection result of the area detecting unit. and
The ophthalmological system according to claim 2 , wherein the estimating unit is provided in the ophthalmological apparatus or the server, and estimates the race of the subject based on the iris area subjected to the interpolation process by the interpolating unit. . the anterior eye segment image acquisition unit obtains the anterior eye segment images from a plurality of cameras that photograph the subject's eye from different directions;
The interpolation unit selects a second camera different from the first camera among the plurality of cameras based on the identifiable area in the anterior eye image taken by the first camera among the plurality of cameras. The ophthalmologic system according to claim 4 , wherein the indiscernible region of the anterior eye segment image photographed is subjected to interpolation processing. The ophthalmologic system according to any one of claims 1 and 3 to 5 , wherein the server associates the anterior eye segment image with the estimation result of the estimation unit and stores it in a database. The ophthalmological apparatus is provided with an eye characteristic acquisition unit that acquires the eye characteristics of the eye to be examined, and an eye characteristic output unit that outputs the eye characteristics acquired by the eye characteristic acquisition unit to a server,
The ophthalmologic system according to claim 6 , wherein the server associates the anterior segment image, the eye characteristics, and the estimation result of the estimation unit and stores them in a database. The color of the anterior eye segment image acquired by the anterior eye segment image acquisition unit is the color of the anterior eye segment image acquired by the anterior eye segment image acquisition unit under illumination of the eye to be examined by a predetermined standard light source. The ophthalmologic system according to any one of claims 1 to 7 , wherein a color correction unit that performs color correction is provided in the ophthalmologic apparatus or the server. objective lens;
comprising a visible light irradiation unit that irradiates the fundus of the eye to be examined with visible light along the optical axis of the objective lens to shrink the pupil of the eye to be examined;
The ophthalmological system according to any one of claims 1 to 8, wherein the anterior ocular segment image acquisition unit acquires the anterior ocular segment image of the eye to be examined, which is irradiated with the visible light by the visible light irradiation unit. . The ophthalmologic system according to any one of claims 1 to 7 , wherein the area detection unit detects an area in the iris area in which an image different from the iris is reflected as the unidentifiable area. The ophthalmological system according to claim 10 , wherein the area detection unit detects an area where eyelashes or ambient light are reflected in the iris area as the unidentifiable area. an eye characteristics acquisition unit that acquires eye characteristics of the eye to be examined;
an eye characteristics output unit that outputs the eye characteristics acquired by the eye characteristics acquisition unit to the server;
The ophthalmologic system according to any one of claims 1 to 11 , comprising: comprising the estimator,
13. Any one of claims 1 to 12 , wherein the estimation unit estimates the race of the subject from an identifiable area in the iris area that is different from the indiscernible area, based on the detection result of the area detection unit. The ophthalmological system according to item 1.

Images