JP2018198967A - Ophthalmologic device - Google Patents

Abstract

To provide an ophthalmologic device capable of appropriately performing positioning between an eye to be examined and a device optical system.SOLUTION: A driving part of an ophthalmologic device three-dimensionally moves an examination optical system relatively with respect to a face of a subject. An imaging part images the face including an eye to be examined from two or more different positions. An image determination part analyzes a captured image acquired by the imaging part by imaging from the two or more different positions, and determines whether or not an image of an anterior eye part of the eye to be examined is included in a predetermined region of the captured image. When the image of the anterior eye part is determined to be included in the predetermined region by the image determination part, the analysis part analyzes the captured image acquired by the imaging part by the imaging from the two or more positions, and acquires a three-dimensional position of the eye to be examined. A control part performs alignment of the examination optical system to the eye to be examined by controlling the driving part based on the three-dimensional position acquired by the analysis part.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an ophthalmologic apparatus for optically inspecting an eye to be examined.

  The ophthalmologic apparatus includes an ophthalmologic photographing apparatus for obtaining an image of the eye to be examined and an ophthalmologic measuring apparatus for measuring the characteristics of the eye to be examined.

  As an example of an ophthalmologic photographing apparatus, an optical coherence tomography (Optical Coherence Tomography, OCT) is used to obtain a tomographic image, a fundus camera for photographing the fundus, and laser scanning using a confocal optical system. There are a scanning laser ophthalmoscope (SLO) that obtains an image, a slit lamp that obtains an image by cutting out a light section of the cornea using slit light, and the like.

  Examples of ophthalmic measuring devices include an ocular refraction examination device (refractometer, keratometer) that measures the refractive characteristics of the eye to be examined, a tonometer, a specular microscope that obtains corneal properties (corneal thickness, cell distribution, etc.), Hartmann There is a wave front analyzer that obtains aberration information of the eye to be examined using a shack sensor.

  In ophthalmic examinations using these devices, the alignment between the device optical system and the eye to be examined is extremely important from the viewpoint of accuracy and accuracy of the examination. This alignment includes alignment and tracking. The alignment includes an operation for aligning the optical axis of the apparatus optical system with the axis of the eye to be examined (xy alignment) and an operation for adjusting the distance between the eye to be examined and the apparatus optical system (z alignment). In tracking, the movement of the eye to be examined is detected and the position of the apparatus optical system is made to follow the eye to be examined.

JP 2009-112664 A Japanese Patent No. 4136690

  In conventional alignment, alignment in the xy direction (direction perpendicular to the optical axis) and alignment in the z direction (direction along the optical axis) are performed by different methods. That is, in order to perform alignment, it is necessary to detect the positional relationship between the eye to be examined and the apparatus optical system, but the positional relationship in the xy direction and the positional relationship in the z direction are obtained by different methods. As a result, an error occurs between the registrations of the two, and the accuracy of the acquired image and measurement value is lowered, and the reproducibility of the inspection is lowered. Also, complication of the apparatus configuration has been regarded as a problem, for example, it is necessary to mount two different optical systems and arithmetic functions corresponding to the alignment of the two systems.

  The ophthalmologic apparatus uses a chin rest or a forehead for holding the subject's face and fixing the position of the subject's eye. Conventionally, adjustment of the position of the chin rest and the forehead rest has been performed by an examiner's operation. Similarly, adjustment of the height position of the apparatus optical system has been performed by the examiner. These operations reduce the efficiency of imaging and measurement, and may be a burden on the subject and the examiner.

  Moreover, in the conventional ophthalmic apparatus, when the apparatus optical system, the chin rest, etc. are moved, it is determined whether the eye to be examined and the apparatus optical system are close to or in a suitable positional relationship. It was difficult. Actually, in the conventional ophthalmologic apparatus, there is only a method of making a determination by referring to an infrared observation image obtained in such a state once moved to a desired position.

  An object of the present invention is to provide an ophthalmic apparatus capable of suitably performing alignment between an eye to be examined and an apparatus optical system.

  In order to achieve the above object, an ophthalmologic apparatus according to an embodiment includes an inspection optical system, a drive unit, an imaging unit, an image determination unit, an analysis unit, and a control unit. The inspection optical system is used to inspect the eye to be examined. The drive unit relatively moves the inspection optical system in three dimensions with respect to the face of the subject. The imaging unit images the face including the eye to be examined from two or more different positions. The image determination unit analyzes a captured image obtained by the imaging unit by imaging from two or more different positions, and determines whether an image of the anterior eye portion of the eye to be examined is included in a predetermined region in the captured image. judge. When the image determination unit determines that the image of the anterior segment is included in the predetermined area, the analysis unit analyzes a captured image obtained by the imaging unit by shooting from two or more different positions. Obtain the three-dimensional position of the optometry. The control unit controls the driving unit based on the three-dimensional position acquired by the analysis unit, thereby aligning the inspection optical system with respect to the eye to be examined.

  According to the present invention, it is possible to suitably perform alignment between the eye to be examined and the apparatus optical system.

It is a schematic diagram showing an example of composition of an ophthalmology device concerning an embodiment. It is a schematic diagram showing an example of composition of an ophthalmology device concerning an embodiment. It is a schematic block diagram showing an example of composition of an ophthalmology device concerning an embodiment. It is a schematic diagram showing an example of composition of an ophthalmology device concerning an embodiment. It is a schematic diagram showing an example of composition of an ophthalmology device concerning an embodiment. It is the schematic for demonstrating the process which the ophthalmologic apparatus which concerns on embodiment performs. It is the schematic for demonstrating the process which the ophthalmologic apparatus which concerns on embodiment performs. It is a flowchart showing the operation example of the ophthalmologic apparatus which concerns on embodiment. It is a flowchart showing the operation example of the ophthalmologic apparatus which concerns on embodiment. It is a flowchart showing the operation example of the ophthalmologic apparatus which concerns on embodiment. It is a schematic block diagram showing an example of composition of an ophthalmology device concerning an embodiment. It is a flowchart showing the operation example of the ophthalmologic apparatus which concerns on embodiment. It is a flowchart showing the operation example of the ophthalmologic apparatus which concerns on embodiment. It is a flowchart showing the operation example of the ophthalmologic apparatus which concerns on embodiment. It is a schematic block diagram showing an example of the composition of the ophthalmologic apparatus concerning a modification. It is a schematic diagram showing an example of composition of an ophthalmology device concerning an embodiment. It is a flowchart showing the operation example of the ophthalmologic apparatus which concerns on embodiment. It is a flowchart showing the operation example of the ophthalmologic apparatus which concerns on embodiment.

  An example of an embodiment of an ophthalmologic apparatus according to the present invention will be described in detail with reference to the drawings. The ophthalmologic apparatus according to the present invention is used for optical examination of an eye to be examined. As described above, such an ophthalmologic apparatus includes an ophthalmologic photographing apparatus and an ophthalmologic measurement apparatus. Examples of the ophthalmologic photographing apparatus include an optical coherence tomometer, a fundus camera, and a scanning laser ophthalmoscope slit lamp. In addition, examples of the ophthalmologic measurement apparatus include an eye refraction inspection apparatus, a tonometer, a specular microscope, and a wave front analyzer. In the following embodiments, the case where the present invention is applied to an optical coherence tomography will be described in detail, but the present invention can be applied to any other ophthalmologic apparatus.

  In this specification, images acquired by OCT may be collectively referred to as OCT images. In addition, a measurement operation for forming an OCT image may be referred to as OCT measurement. In addition, it is possible to use suitably the description content of the literature described in this specification as the content of the following embodiment.

  In the following embodiments, an optical coherence tomography using a so-called Spectral Domain type OCT equipped with a low coherence light source and a spectroscope will be described. However, types other than the spectral domain, such as swept sources, are described. It is also possible to apply the present invention to an optical coherence tomography using a type or in-face type OCT technique. Note that the swept source OCT scans (wavelength sweeps) the wavelength of the light irradiated to the object to be measured, and the interference light obtained by superimposing the reflected light of each wavelength and the reference light. This is a technique for obtaining a spectral intensity distribution by detection and imaging the form of the object to be measured by applying a Fourier transform thereto. Further, in-face OCT is to irradiate the object to be measured with light having a predetermined beam diameter and analyze the component of the interference light obtained by superimposing the reflected light and the reference light. This is a technique for forming an image of an object to be measured in a cross section perpendicular to the traveling direction of light, and is also called a full-field type.

  In the following embodiments, an apparatus combining an OCT apparatus and a fundus camera will be described. However, the application target of the present invention is not limited to such a multifunction machine, and an ophthalmologic apparatus (for example, a fundus camera alone) as a single machine. It is also possible to apply this invention to

<First Embodiment>
[Constitution]
As shown in FIG. 1, the ophthalmologic apparatus 1 includes a fundus camera unit 2, an OCT unit 100, and an arithmetic control unit 200. The retinal camera unit 2 has almost the same optical system as a conventional retinal camera. The OCT unit 100 is provided with an optical system for acquiring an OCT image of the fundus. The arithmetic control unit 200 includes a computer that executes various arithmetic processes and control processes.

[Fundus camera unit]
The fundus camera unit 2 shown in FIG. 1 is provided with an optical system for obtaining a two-dimensional image (fundus image) representing the surface form of the fundus oculi Ef of the eye E to be examined. The fundus image includes an observation image and a captured image. The observation image is, for example, a monochrome moving image formed at a predetermined frame rate using near infrared light. In addition, when the optical system is focused on the anterior segment Ea of the eye E, the fundus camera unit 2 can obtain an observation image of the anterior segment Ea. The optical system for capturing a moving image of the anterior segment Ea corresponds to an example of a “moving image capturing optical system”. The captured image may be, for example, a color image obtained by flashing visible light, or a monochrome still image using near infrared light or visible light as illumination light. The fundus camera unit 2 may be configured to be able to acquire images other than these, such as a fluorescein fluorescent image, an indocyanine green fluorescent image, a spontaneous fluorescent image, and the like.

  The retinal camera unit 2 is provided with a chin rest and a forehead support for supporting the subject's face. The chin rest and the forehead support correspond to the support portion 440 shown in FIGS. 4A and 4B. In FIG. 4A and FIG. 4B, reference numeral 410 denotes a drive system such as the optical system drive unit 2A and a base in which an arithmetic control circuit is stored. Reference numeral 420 denotes a housing provided on the base 410 and storing an optical system. Reference numeral 430 denotes a lens housing portion that is provided on the front surface of the housing 420 and accommodates the objective lens 22.

  The fundus camera unit 2 is provided with an illumination optical system 10 and a photographing optical system 30. The illumination optical system 10 irradiates the fundus oculi Ef with illumination light. The photographing optical system 30 guides the fundus reflection light of the illumination light to an imaging device (CCD image sensor (sometimes simply referred to as a CCD) 35, 38). The imaging optical system 30 guides the signal light from the OCT unit 100 to the fundus oculi Ef and guides the signal light passing through the fundus oculi Ef to the OCT unit 100.

  The observation light source 11 of the illumination optical system 10 is constituted by a halogen lamp, for example. The light (observation illumination light) output from the observation light source 11 is reflected by the reflection mirror 12 having a curved reflection surface, passes through the condensing lens 13, passes through the visible cut filter 14, and is converted into near infrared light. Become. Further, the observation illumination light is once converged in the vicinity of the photographing light source 15, reflected by the mirror 16, and passes through the relay lenses 17 and 18, the diaphragm 19 and the relay lens 20. Then, the observation illumination light is reflected at the peripheral portion (region around the hole portion) of the aperture mirror 21, passes through the dichroic mirror 46, and is refracted by the objective lens 22 to illuminate the fundus oculi Ef. An LED (Light Emitting Diode) can also be used as the observation light source.

  The fundus reflection light of the observation illumination light is refracted by the objective lens 22, passes through the dichroic mirror 46, passes through the hole formed in the central region of the perforated mirror 21, passes through the dichroic mirror 55, and is a focusing lens. It is reflected by the mirror 32 via 31. Further, the fundus reflection light passes through the half mirror 39A, is reflected by the dichroic mirror 33, and forms an image on the light receiving surface of the CCD image sensor 35 by the condenser lens. The CCD image sensor 35 detects fundus reflected light at a predetermined frame rate, for example. On the display device 3, an image (observation image) based on fundus reflection light detected by the CCD image sensor 35 is displayed. When the photographing optical system is focused on the anterior segment, an observation image of the anterior segment of the eye E is displayed.

  The imaging light source 15 is constituted by, for example, a xenon lamp. The light (imaging illumination light) output from the imaging light source 15 is applied to the fundus oculi Ef through the same path as the observation illumination light. The fundus reflection light of the imaging illumination light is guided to the dichroic mirror 33 through the same path as that of the observation illumination light, passes through the dichroic mirror 33, is reflected by the mirror 36, and is reflected by the condenser lens 37 of the CCD image sensor 38. An image is formed on the light receiving surface. On the display device 3, an image (captured image) based on fundus reflection light detected by the CCD image sensor 38 is displayed. Note that the display device 3 that displays the observation image and the display device 3 that displays the captured image may be the same or different. In addition, when similar imaging is performed by illuminating the eye E with infrared light, an infrared captured image is displayed. It is also possible to use an LED as a photographing light source.

  An LCD (Liquid Crystal Display) 39 displays a fixation target and an eyesight measurement index. The fixation target is an index for fixing the eye E to be examined, and is used at the time of fundus photographing or OCT measurement.

  A part of the light output from the LCD 39 is reflected by the half mirror 39A, reflected by the mirror 32, passes through the focusing lens 31 and the dichroic mirror 55, passes through the hole of the perforated mirror 21, and reaches the dichroic. The light passes through the mirror 46, is refracted by the objective lens 22, and is projected onto the fundus oculi Ef.

  By changing the display position of the fixation target on the screen of the LCD 39, the fixation position of the eye E can be changed. As the fixation position of the eye E, for example, a position for acquiring an image centered on the macular portion of the fundus oculi Ef, or a position for acquiring an image centered on the optic disc as in the case of a conventional fundus camera And a position for acquiring an image centered on the fundus center between the macula and the optic disc. It is also possible to arbitrarily change the display position of the fixation target.

  Further, the fundus camera unit 2 is provided with an alignment optical system 50 and a focus optical system 60 as in a conventional fundus camera. The alignment optical system 50 generates an index (alignment index) for performing alignment (alignment) of the apparatus optical system with respect to the eye E. The configuration for projecting the alignment index onto the eye E corresponds to an example of a “projection optical system”. The focus optical system 60 generates an index (split index) for focusing on the fundus oculi Ef.

  The light (alignment light) output from the LED 51 of the alignment optical system 50 is reflected by the dichroic mirror 55 via the apertures 52 and 53 and the relay lens 54, passes through the hole of the perforated mirror 21, and reaches the dichroic mirror 46. And is projected onto the cornea of the eye E by the objective lens 22.

  The corneal reflection light of the alignment light passes through the objective lens 22, the dichroic mirror 46 and the hole, part of which passes through the dichroic mirror 55, passes through the focusing lens 31, is reflected by the mirror 32, and is half mirror The light passes through 39A, is reflected by the dichroic mirror 33, and is projected onto the light receiving surface of the CCD image sensor 35 by the condenser lens. The light reception image (alignment index) by the CCD image sensor 35 is displayed on the display device 3 together with the observation image. The user performs alignment by performing the same operation as that of a conventional fundus camera. Further, the arithmetic control unit 200 may perform alignment by analyzing the position of the alignment index and moving the optical system (auto-alignment function). In this embodiment, since auto-alignment can be performed using an anterior segment camera 300 described later, it is not essential that auto-alignment using an alignment index is possible. However, the auto-alignment using the alignment index can be performed when the auto-alignment using the anterior segment camera 300 is not successful, or the auto-alignment using the anterior segment camera 300 and the alignment index are used. It is also possible to configure so that auto alignment can be used selectively.

  When performing the focus adjustment, the reflecting surface of the reflecting rod 67 is obliquely provided on the optical path of the illumination optical system 10. The light (focus light) output from the LED 61 of the focus optical system 60 passes through the relay lens 62, is separated into two light beams by the split indicator plate 63, passes through the two-hole aperture 64, and is reflected by the mirror 65, The light is focused on the reflecting surface of the reflecting bar 67 by the condenser lens 66 and reflected. Further, the focus light passes through the relay lens 20, is reflected by the perforated mirror 21, passes through the dichroic mirror 46, is refracted by the objective lens 22, and is projected onto the fundus oculi Ef.

  The fundus reflection light of the focus light is detected by the CCD image sensor 35 through the same path as the cornea reflection light of the alignment light. A light reception image (split index) by the CCD image sensor 35 is displayed on the display device 3 together with the observation image. The arithmetic and control unit 200 analyzes the position of the split index and moves the focusing lens 31 and the focus optical system 60 to perform focusing as in the conventional case (autofocus function). Alternatively, focusing may be performed manually while visually checking the split indicator.

  The dichroic mirror 46 branches the optical path for OCT measurement from the optical path for fundus photography. The dichroic mirror 46 reflects light in a wavelength band used for OCT measurement and transmits light for fundus photographing. In this optical path for OCT measurement, a collimator lens unit 40, an optical path length changing unit 41, a galvano scanner 42, a focusing lens 43, a mirror 44, and a relay lens 45 are provided in this order from the OCT unit 100 side. It has been.

  The optical path length changing unit 41 is movable in the direction of the arrow shown in FIG. 1 and changes the optical path length of the optical path for OCT measurement. This change in the optical path length is used for correcting the optical path length according to the axial length of the eye E or adjusting the interference state. The optical path length changing unit 41 includes, for example, a corner cube and a mechanism for moving the corner cube.

  The galvano scanner 42 changes the traveling direction of light (signal light LS) passing through the optical path for OCT measurement. Thereby, the fundus oculi Ef can be scanned with the signal light LS. The galvano scanner 42 includes, for example, a galvano mirror that scans the signal light LS in the x direction, a galvano mirror that scans in the y direction, and a mechanism that drives these independently. Thereby, the signal light LS can be scanned in an arbitrary direction on the xy plane.

  The fundus camera unit 2 is provided with an anterior eye camera 300. The anterior segment camera 300 images the anterior segment Ea substantially simultaneously from different directions. In this embodiment, two cameras are provided on the subject-side surface of the fundus camera unit 2 (see anterior eye cameras 300A and 300B shown in FIG. 4A). Further, as shown in FIGS. 1 and 4A, the anterior eye cameras 300A and 300B are provided at positions deviated from the optical path of the illumination optical system 10 and the optical path of the imaging optical system 30, respectively. Hereinafter, the two anterior eye cameras 300A and 300B may be collectively represented by reference numeral 300.

  In this embodiment, two anterior eye cameras 300A and 300B are provided, but the number of anterior eye cameras in the present invention is an arbitrary number of 2 or more. However, in consideration of the arithmetic processing described later, a configuration that can photograph the anterior segment substantially simultaneously from two different directions is sufficient. In this embodiment, the anterior segment camera 300 is provided separately from the illumination optical system 10 and the imaging optical system 30, but at least the imaging optical system 30 can be used to perform similar anterior segment imaging. . That is, one of the two or more anterior segment cameras may be carried by a configuration including the imaging optical system 30. Anyway, this embodiment should just be comprised so that imaging | photography of the anterior ocular segment can be carried out substantially simultaneously from two different (or more) directions.

  Note that “substantially simultaneously” indicates that a photographing timing shift that allows negligible eye movement is allowed in photographing with two or more anterior segment cameras. Thereby, an image when the eye E is substantially at the same position (orientation) can be acquired by two or more anterior segment cameras.

  In addition, although shooting with two or more anterior eye cameras may be moving image shooting or still image shooting, in this embodiment, a case where moving image shooting is performed will be described in detail. In the case of moving image shooting, the above-described substantially simultaneous anterior ocular shooting can be realized by controlling the shooting start timing to match or by controlling the frame rate and shooting timing of each frame. On the other hand, in the case of still image shooting, this can be realized by controlling to match the shooting timing.

[OCT unit]
An example of the configuration of the OCT unit 100 will be described with reference to FIG. The OCT unit 100 is provided with an optical system for acquiring an OCT image of the fundus oculi Ef. This optical system has the same configuration as a conventional spectral domain type OCT apparatus. That is, this optical system divides low-coherence light into reference light and signal light, and generates interference light by causing interference between the signal light passing through the fundus oculi Ef and the reference light passing through the reference optical path. It is configured to detect spectral components. This detection result (detection signal) is sent to the arithmetic control unit 200.

  In the case of a swept source type OCT apparatus, a wavelength swept light source is provided instead of a light source that outputs a low coherence light source, and an optical member that spectrally decomposes interference light is not provided. In general, for the configuration of the OCT unit 100, a known technique corresponding to the type of OCT can be arbitrarily applied.

  The light source unit 101 outputs a broadband low-coherence light L0. The low coherence light L0 includes, for example, a near-infrared wavelength band (about 800 nm to 900 nm) and has a temporal coherence length of about several tens of micrometers. Note that near-infrared light having a wavelength band that cannot be visually recognized by the human eye, for example, a center wavelength of about 1040 to 1060 nm, may be used as the low-coherence light L0.

  The light source unit 101 includes a light output device such as a super luminescent diode (SLD), an LED, or an SOA (Semiconductor Optical Amplifier).

  The low-coherence light L0 output from the light source unit 101 is guided to the fiber coupler 103 by the optical fiber 102 and split into the signal light LS and the reference light LR.

  The reference light LR is guided by the optical fiber 104 and reaches the optical attenuator (attenuator) 105. The optical attenuator 105 automatically adjusts the amount of the reference light LR guided to the optical fiber 104 under the control of the arithmetic control unit 200 using a known technique. The reference light LR whose light amount has been adjusted by the optical attenuator 105 is guided by the optical fiber 104 and reaches the polarization adjuster (polarization controller) 106. The polarization adjuster 106 is, for example, a device that adjusts the polarization state of the reference light LR guided in the optical fiber 104 by applying a stress from the outside to the optical fiber 104 in a loop shape. The configuration of the polarization adjuster 106 is not limited to this, and any known technique can be used. The reference light LR whose polarization state is adjusted by the polarization adjuster 106 reaches the fiber coupler 109.

  The signal light LS generated by the fiber coupler 103 is guided by the optical fiber 107 and converted into a parallel light beam by the collimator lens unit 40. Further, the signal light LS reaches the dichroic mirror 46 via the optical path length changing unit 41, the galvano scanner 42, the focusing lens 43, the mirror 44, and the relay lens 45. The signal light LS is reflected by the dichroic mirror 46, is refracted by the objective lens 22, and is applied to the fundus oculi Ef. The signal light LS is scattered (including reflection) at various depth positions of the fundus oculi Ef. The backscattered light of the signal light LS from the fundus oculi Ef travels in the same direction as the forward path in the reverse direction, is guided to the fiber coupler 103, and reaches the fiber coupler 109 via the optical fiber 108.

  The fiber coupler 109 causes the backscattered light of the signal light LS to interfere with the reference light LR that has passed through the optical fiber 104. The interference light LC generated thereby is guided by the optical fiber 110 and emitted from the emission end 111. Further, the interference light LC is converted into a parallel light beam by the collimator lens 112, dispersed (spectral decomposition) by the diffraction grating 113, condensed by the condenser lens 114, and projected onto the light receiving surface of the CCD image sensor 115. Although the diffraction grating 113 shown in FIG. 2 is a transmission type, other types of spectroscopic elements such as a reflection type diffraction grating may be used.

  The CCD image sensor 115 is a line sensor, for example, and detects each spectral component of the split interference light LC and converts it into electric charges. The CCD image sensor 115 accumulates this electric charge, generates a detection signal, and sends it to the arithmetic control unit 200.

  In this embodiment, a Michelson type interferometer is employed, but any type of interferometer such as a Mach-Zehnder type can be appropriately employed. Further, in place of the CCD image sensor, another form of image sensor such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor can be used.

[Calculation control unit]
The configuration of the arithmetic control unit 200 will be described. The arithmetic control unit 200 analyzes the detection signal input from the CCD image sensor 115 and forms an OCT image of the fundus oculi Ef. The arithmetic processing for this is the same as that of a conventional spectral domain type OCT apparatus.

  The arithmetic control unit 200 controls each part of the fundus camera unit 2, the display device 3, and the OCT unit 100. For example, the arithmetic control unit 200 displays an OCT image of the fundus oculi Ef on the display device 3.

  As the control of the fundus camera unit 2, the arithmetic control unit 200 controls the operation of the observation light source 11, the imaging light source 15 and the LEDs 51 and 61, the operation control of the LCD 39, the movement control of the focusing lenses 31 and 43, and the reflector 67. Movement control, movement control of the focus optical system 60, movement control of the optical path length changing unit 41, operation control of the galvano scanner 42, operation control of the anterior eye camera 300, and the like are performed.

  As control of the OCT unit 100, the arithmetic control unit 200 performs operation control of the light source unit 101, operation control of the optical attenuator 105, operation control of the polarization adjuster 106, operation control of the CCD image sensor 115, and the like.

  The arithmetic control unit 200 includes, for example, a microprocessor, a RAM, a ROM, a hard disk drive, a communication interface, etc., as in a conventional computer. A computer program for controlling the ophthalmologic apparatus 1 is stored in a storage device such as a hard disk drive. The arithmetic control unit 200 may include various circuit boards, for example, a circuit board for forming an OCT image. The arithmetic control unit 200 may include an operation device (input device) such as a keyboard and a mouse, and a display device such as an LCD.

  The fundus camera unit 2, the display device 3, the OCT unit 100, and the calculation control unit 200 may be configured integrally (that is, in a single housing) or separated into two or more cases. It may be.

[Control system]
The configuration of the control system of the ophthalmologic apparatus 1 will be described with reference to FIG.

(Control part)
The control system of the ophthalmologic apparatus 1 is configured around the control unit 210. The control unit 210 includes, for example, the aforementioned microprocessor, RAM, ROM, hard disk drive, communication interface, and the like. The control unit 210 includes a main control unit 211, a storage unit 212, and an optical system position acquisition unit 213.

(Main control unit)
The main control unit 211 performs the various operation controls described above. The movement control of the focusing lens 31 is to move the focusing lens 31 in the optical axis direction by controlling a focusing drive unit (not shown). Thereby, the focus position of the photographic optical system 30 is changed. The main control unit 211 can control the optical system driving unit 2A to move the optical system provided in the fundus camera unit 2 three-dimensionally.

  This control is executed in auto alignment and tracking. Here, tracking refers to moving the apparatus optical system in accordance with the eye movement of the eye E. Tracking is performed, for example, at a later stage than alignment (in some cases, focusing is also performed in advance). Tracking is a function that maintains a suitable positional relationship in alignment (and focus) by causing the position of the apparatus optical system to follow the eye movement.

  The optical system drive unit 2A of this embodiment moves an optical system mounted on the fundus camera unit 2, but the optical system and the OCT unit 100 mounted on the fundus camera unit 2 by the optical system drive unit 2A. It may be configured to move the optical system mounted on the. The optical system driving unit 2A is an example of a “first driving unit”.

  Further, since the anterior eye camera 300 of this embodiment is provided in the housing of the fundus camera unit 2, the anterior eye camera 300 can be moved by controlling the optical system driving part 2A. Such an optical system driving unit 2A functions as an example of a “photographing moving unit”. Further, it is possible to provide a photographing moving unit that can independently move two or more anterior eye camera 300. Specifically, the imaging moving unit may include a drive mechanism (an actuator, a power transmission mechanism, etc.) provided for each anterior eye camera 300. The imaging moving unit is configured to move two or more anterior eye cameras 300 by transmitting power generated by a single actuator by a power transmission mechanism provided for each anterior eye camera 300. May be.

  Further, the main control unit 211 performs processing for writing data into the storage unit 212 and processing for reading data from the storage unit 212.

(Memory part)
The storage unit 212 stores various data. Examples of the data stored in the storage unit 212 include OCT image image data, fundus image data, and examined eye information. The eye information includes information about the subject such as patient ID and name, and information about the eye such as left / right eye identification information. The storage unit 212 stores various programs and data for operating the ophthalmologic apparatus 1.

  In particular, the aberration information 212a is stored in the storage unit 212 in advance. In the aberration information 212a, information regarding distortion aberration generated in the captured image due to the influence of the optical system mounted on each anterior eye camera 300 is recorded. Here, the optical system mounted on the anterior segment camera 300 includes an optical element that generates distortion, such as a lens. The aberration information 212a can be said to be a parameter obtained by quantifying the distortion that these optical elements give to the captured image.

  An example of a method for generating the aberration information 212a will be described. Taking the instrumental difference (difference in distortion) of the anterior segment camera 300 into consideration, the following measurement is performed for each anterior segment camera 300. The operator prepares a predetermined reference point. The reference point is an imaging target used for detecting distortion. The operator performs multiple shootings while changing the relative position between the reference point and the anterior eye camera 300. Thereby, a plurality of captured images of the reference point captured from different directions are obtained. The operator generates aberration information 212a of the anterior eye camera 300 by analyzing a plurality of acquired images with a computer. Note that the computer that performs this analysis processing may be the image processing unit 230 or any other computer (an inspection computer before product shipment, a maintenance computer, etc.).

The analysis process for generating the aberration information 212a includes, for example, the following steps:
An extraction step of extracting an image region corresponding to the reference point from each captured image;
A distribution state calculation step of calculating a distribution state (coordinates) of an image area corresponding to a reference point in each captured image;
A distortion aberration calculating step of calculating a parameter representing distortion based on the obtained distribution state;
A correction coefficient calculation step of calculating a coefficient for correcting distortion based on the obtained parameter.

  Parameters relating to distortion aberration given to an image by the optical system include principal point distance, principal point position (vertical direction, horizontal direction), lens distortion (radiation direction, tangential direction), and the like. The aberration information 212a is configured as information (for example, table information) in which the identification information of each anterior segment camera 300 is associated with the correction coefficient corresponding thereto. The aberration information 212a generated in this way is stored in the storage unit 212 by the main control unit 211. Such generation of aberration information 212a and aberration correction based on this generation are referred to as camera calibration.

(Optical system position acquisition unit)
The optical system position acquisition unit 213 acquires the current position of the inspection optical system mounted on the ophthalmologic apparatus 1. The inspection optical system is an optical system used to optically inspect the eye E. The inspection optical system in the ophthalmologic apparatus 1 (a combination machine of a fundus camera and an OCT apparatus) of this embodiment is an optical system for obtaining an image of the eye to be examined.

  The optical system position acquisition unit 213 receives, for example, information indicating the content of movement control of the optical system driving unit 2A by the main control unit 211, and acquires the current position of the inspection optical system moved by the optical system driving unit 2A. To do. A specific example of this process will be described. The main control unit 211 controls the optical system driving unit 2A at a predetermined timing (when the apparatus is activated, when patient information is input, etc.) to move the examination optical system to a predetermined initial position. Thereafter, each time the optical system driving unit 2A is controlled, the main control unit 211 records the control contents. Thereby, a history of control contents is obtained. The optical system position acquisition unit 213 acquires the control content up to the present with reference to this history, and obtains the current position of the inspection optical system based on the control content.

  Further, whenever the main control unit 211 controls the optical system driving unit 2A, the control content is transmitted to the optical system position acquisition unit 213, and each time the optical system position acquisition unit 213 receives the control content, the inspection optical system is transmitted. The current position may be obtained sequentially.

  As another configuration example, a position sensor that detects the position of the inspection optical system may be provided in the optical system position acquisition unit 213.

  When the current position of the inspection optical system is acquired by the optical system position acquisition unit 213 as described above, the main control unit 211 determines the acquired current position and the eye E to be examined obtained by the analysis unit 231 described later. The inspection optical system can be moved to the optical system driving unit 2A based on the three-dimensional position. Specifically, the main control unit 211 recognizes the current position of the inspection optical system based on the acquisition result obtained by the optical system position acquisition unit 213, and recognizes the three-dimensional position of the eye E based on the analysis result obtained by the analysis unit 231. Then, the main control unit 211 changes the position of the inspection optical system from the current position so that the position of the inspection optical system with respect to the three-dimensional position of the eye E has a predetermined positional relationship. This predetermined positional relationship is such that the positions in the x direction and the y direction coincide with each other and the distance in the z direction becomes a predetermined working distance.

(Image forming part)
The image forming unit 220 forms tomographic image data of the fundus oculi Ef based on the detection signal from the CCD image sensor 115. This process includes processes such as noise removal (noise reduction), filter processing, FFT (Fast Fourier Transform), and the like, as in the conventional spectral domain type optical coherence tomography. In the case of another type of OCT apparatus, the image forming unit 220 executes a known process corresponding to the type.

  The image forming unit 220 includes, for example, the circuit board described above. In this specification, “image data” and “image” based thereon may be identified.

(Image processing unit)
The image processing unit 230 performs various types of image processing and analysis processing on the image formed by the image forming unit 220. For example, the image processing unit 230 executes various correction processes such as image brightness correction and dispersion correction. The image processing unit 230 performs various types of image processing and analysis processing on the image (fundus image, anterior eye image, etc.) obtained by the fundus camera unit 2.

  The image processing unit 230 executes known image processing such as interpolation processing for interpolating pixels between tomographic images to form image data of a three-dimensional image of the fundus oculi Ef. Note that the image data of a three-dimensional image means image data in which pixel positions are defined by a three-dimensional coordinate system. As image data of a three-dimensional image, there is image data composed of voxels arranged three-dimensionally. This image data is called volume data or voxel data. When displaying an image based on volume data, the image processing unit 230 performs rendering processing (volume rendering, MIP (Maximum Intensity Projection), etc.) on the volume data, and views the image from a specific gaze direction. Image data of a pseudo three-dimensional image is formed. The pseudo three-dimensional image is displayed on the display unit 240A.

  It is also possible to form stack data of a plurality of tomographic images as image data of a three-dimensional image. The stack data is image data obtained by three-dimensionally arranging a plurality of tomographic images obtained along a plurality of scanning lines based on the positional relationship of the scanning lines. That is, stack data is image data obtained by expressing a plurality of tomographic images originally defined by individual two-dimensional coordinate systems by one three-dimensional coordinate system (that is, by embedding them in one three-dimensional space). is there.

  Further, the image processing unit 230 is provided with an analysis unit 231, an image determination unit 232, and an image composition unit 233.

(Analysis Department)
The analysis unit 231 obtains the three-dimensional position of the eye E by analyzing two or more captured images obtained substantially simultaneously by the two or more anterior segment cameras 300. As an example of a configuration for executing this processing, the analysis unit 231 includes an image correction unit 2311, a feature position specifying unit 2312, and a three-dimensional position calculation unit 2313.

(Image correction unit)
The image correction unit 2311 corrects the distortion of each captured image obtained by the anterior eye camera 300 based on the aberration information 212 a stored in the storage unit 212. This process is executed by, for example, a known image processing technique based on a correction coefficient for correcting distortion. The image correction unit 2311 is an example of a “correction unit”. Note that the aberration information 212a and the image correction unit 2311 do not have to be provided when the distortion aberration given to the captured image by the optical system of the anterior eye camera 300 is sufficiently small.

(Feature position identification part)
The feature position specifying unit 2312 analyzes each captured image (the distortion of which has been corrected by the image correcting unit 2311), thereby analyzing a position (feature position) in the captured image corresponding to a predetermined feature part of the anterior segment Ea. Specified). For example, the center of the pupil of the eye E or the apex of the cornea is used as the predetermined characteristic part. Hereinafter, a specific example of the process of specifying the pupil center will be described.

  First, the feature position specifying unit 2312 specifies an image region (pupil region) corresponding to the pupil of the eye E based on the distribution of pixel values (such as luminance values) of the captured image. In general, since the pupil is drawn with lower brightness than other parts, the pupil area can be specified by searching for the low brightness image area. At this time, the pupil region may be specified in consideration of the shape of the pupil. That is, the pupil region can be specified by searching for a substantially circular and low luminance image region.

  Next, the feature position specifying unit 2312 specifies the center position of the specified pupil region. Since the pupil is substantially circular as described above, the contour of the pupil region can be specified, the center position of this contour (approximate circle or approximate ellipse) can be specified, and this can be used as the pupil center. Further, the center of gravity of the pupil region may be obtained, and the center of gravity position may be used as the center of the pupil.

  Even when the feature position corresponding to another feature part is specified, it is possible to specify the feature position based on the distribution of pixel values of the photographed image in the same manner as described above.

(3D position calculator)
The three-dimensional position calculation unit 2313 determines the characteristic part of the eye E based on the positions of the two or more anterior eye camera 300 and the feature positions in the two or more captured images specified by the feature position specifying unit 2312. A three-dimensional position is calculated. This process will be described with reference to FIGS. 5A and 5B.

  FIG. 5A is a top view showing the positional relationship between the eye E and the anterior eye cameras 300A and 300B. FIG. 5B is a side view showing the positional relationship between the eye E and the anterior eye cameras 300A and 300B. The distance (baseline length) between the two anterior eye cameras 300A and 300B is represented by “B”. The distance (imaging distance) between the baselines of the two anterior eye cameras 300A and 300B and the characteristic part P of the eye E is represented by “H”. A distance (screen distance) between each anterior eye camera 300A and 300B and its screen plane is represented by “f”.

  In such an arrangement state, the resolution of the image captured by the anterior eye cameras 300A and 300B is expressed by the following equation. Here, Δp represents pixel resolution.

Resolution in xy direction (planar resolution): Δxy = H × Δp / f
Resolution in the z direction (depth resolution): Δz = H × H × Δp / (B × f)

  The three-dimensional position calculation unit 2313 is shown in FIGS. 5A and 5B with respect to the positions (known) of the two anterior eye cameras 300A and 300B and the characteristic position corresponding to the characteristic part P in the two captured images. By applying a known trigonometric method that takes into account the arrangement relationship shown, the three-dimensional position of the characteristic part P, that is, the three-dimensional position of the eye E to be examined is calculated.

  The three-dimensional position of the eye E calculated by the three-dimensional position calculation unit 2313 is sent to the control unit 210. Based on the calculation result of the three-dimensional position, the control unit 210 adjusts the optical axis of the inspection optical system to the axis of the eye E, and the distance of the inspection optical system with respect to the eye E is a predetermined operation. The optical system driving unit 2A is controlled so as to be a distance. Here, the working distance is a predetermined value called a working distance, and means a distance between the eye E to be inspected and the inspection optical system at the time of inspection using the inspection optical system.

Further, when the anterior eye camera 300 shoots a moving image of the anterior eye part Ea from different directions in parallel, for example, the following processes (1) and (2) are performed to test the movement of the eye E to be examined. It is possible to perform tracking of the optical system.
(1) The analysis unit 231 sequentially obtains the three-dimensional position of the eye E by sequentially analyzing two or more frames obtained substantially simultaneously in moving image shooting by the two or more anterior segment cameras 300. .
(2) The control unit 210 sequentially controls the optical system driving unit 2A based on the three-dimensional position of the eye E to be sequentially obtained by the analysis unit 231, thereby changing the position of the inspection optical system to the movement of the eye E. To follow.

(Image judgment part)
The image determination unit 232 analyzes the captured image obtained by at least one of the two or more anterior segment cameras 300, so that the image of the anterior segment Ea is included in a predetermined region in the captured image. Determine whether or not.

  This predetermined area is set in advance within the imaging range of the anterior eye camera 300, and is set as an area including the center of the imaging range, for example. Here, the range of the predetermined region can be changed according to the imaging conditions (the position of the anterior eye camera 300, the imaging magnification, etc.) by the anterior eye camera 300. Further, the range of the predetermined area can be determined according to the setting of feature points described later. Further, the predetermined region can be set so as to correspond to the position of the support portion 440 (chin rest, forehead pad, etc., see FIGS. 4A and 4B) supporting the face of the subject or the vicinity thereof. . The image determination unit 232 corresponds to an example of a “determination unit”.

  A specific example of processing executed by the image determination unit 232 will be described. First, the image determination unit 232 specifies an image region corresponding to a predetermined feature point of the anterior eye portion Ea from the captured image. These feature points include the pupil center, pupil contour, iris center, iris contour, and corneal apex. The process for specifying the image area corresponding to the feature point is the same as the process executed by the feature position specifying unit 2312, for example. When the feature point and the feature part are the same, the specification result by the feature position specifying unit 2312 can be used for processing performed by the image determining unit 232.

  Next, the image determination unit 232 determines whether or not the specified feature point is included in a predetermined region in the captured image (frame thereof). This process is performed by comparing the coordinates corresponding to the predetermined area with the coordinates of the feature points.

  The image determination unit 232 sends this determination result to the control unit 210. When it is determined that the image of the anterior segment Ea is not included in the predetermined area, the control unit 210 controls the optical system driving unit 2A (imaging moving unit) to support the anterior segment camera 300 with the support unit 440 ( That is, it is moved in the direction away from the subject's face) and / or the outside of the support portion 440. The direction away from the support portion 440 is the −z direction in the coordinate system shown in FIG. Further, the outward direction of the support portion 440 is a direction in which the anterior eye camera 300 is separated from the optical axis of the inspection optical system. The direction away from the inspection optical system can be defined in the horizontal direction (± x direction) and / or the vertical direction (± y direction). That is, it is possible to define a direction away from the inspection optical system in an arbitrary direction within the xy plane.

  Further, the moving direction and / or moving distance of the anterior eye camera 300 can be set based on, for example, the positional relationship between the anterior eye camera 300 and the support part 440 before the movement. Further, by alternately performing the determination process by the image determination unit 232 and the movement process of the anterior segment camera 300, it is possible to perform control so as to drive the anterior segment camera 300 to a suitable position. . Further, the moving direction and / or moving distance of the anterior eye camera 300 may be determined according to the distance (number of pixels) between the image area corresponding to the feature point and the predetermined area. Further, the moving direction and / or moving distance of the anterior segment camera 300 is determined according to the distance between the image area corresponding to the feature point and a predetermined position (for example, the center position) in the predetermined area. Is also possible.

  Another operation example based on the determination result by the image determination unit 232 will be described. When it is determined that the image of the anterior segment Ea is not included in the predetermined area, the control unit 210 causes the output unit to output predetermined warning information. As this output unit, there are a display unit 240A, an audio output unit (not shown), and the like. When the display unit 240A is used as an output unit, the control unit 210 causes the display unit 240A to display a warning message including predetermined character string information, image information, a pop-up window, and the like. When the audio output unit is used as the output unit, the control unit 210 causes the audio output unit to output predetermined audio information, warning sound, and the like.

  With such warning information, the user recognizes that the image of the anterior segment Ea is not included in the predetermined area. Then, the user moves the anterior eye camera 300 three-dimensionally using the operation unit 240B. Note that the control unit 210 may output information (movement information) indicating the movement direction and / or movement distance of the anterior eye camera 300 together with the warning information. This movement information is generated based on the positional relationship between the image area corresponding to the feature point obtained by the image determination unit 232 and the predetermined area, for example. When the manual movement by the user is completed, the determination process by the image determination unit 232 may be performed again.

(Image composition part)
The image composition unit 233 forms a composite image of two or more captured images obtained substantially simultaneously by the two or more anterior segment cameras 300. Examples of the composite image include a stereoscopic image based on two or more captured images and an image (viewpoint conversion image) obtained by viewpoint conversion. The viewpoint of the viewpoint conversion image is set, for example, on the optical axis of the inspection optical system. These synthesized images are obtained by using a known image synthesis process.

  The image processing unit 230 that functions as described above includes, for example, the aforementioned microprocessor, RAM, ROM, hard disk drive, circuit board, and the like. In a storage device such as a hard disk drive, a computer program for causing the microprocessor to execute the above functions is stored in advance.

(User interface)
The user interface 240 includes a display unit 240A and an operation unit 240B. The display unit 240A includes the display device of the arithmetic control unit 200 and the display device 3 described above. The operation unit 240B includes the operation device of the arithmetic control unit 200 described above. The operation unit 240B may include various buttons and keys provided on the housing of the ophthalmologic apparatus 1 or outside. For example, when the fundus camera unit 2 has a housing similar to that of a conventional fundus camera, the operation unit 240B may include a joystick, an operation panel, or the like provided on the housing. The display unit 240 </ b> A may include various display devices such as a touch panel provided on the housing of the fundus camera unit 2.

  The display unit 240A and the operation unit 240B do not need to be configured as individual devices. For example, a device in which a display function and an operation function are integrated, such as a touch panel, can be used. In that case, the operation unit 240B includes the touch panel and a computer program. The operation content for the operation unit 240B is input to the control unit 210 as an electrical signal. Further, operations and information input may be performed using a graphical user interface (GUI) displayed on the display unit 240A and the operation unit 240B.

[Operation]
The operation of the ophthalmologic apparatus 1 will be described. Examples of the operation of the ophthalmologic apparatus 1 are shown in FIGS. Any two or more of these operation examples can be combined.

[First operation example]
A first operation example will be described with reference to FIG. In the first operation example, the basic flow of auto-alignment by the ophthalmologic apparatus 1 and the specification of the characteristic part of the anterior segment Ea (here, the center of the pupil) are malfunctioning or an image of the anterior segment Ea is taken. A process executed when the image is not included in a predetermined area in the image will be described.

(S1: Patient registration)
First, the user inputs patient information of the subject using the user interface 240. Patient information includes patient ID, patient name, and the like.

(S2: Selection of shooting type)
Next, the user uses the user interface 240 to select and input the type of imaging performed on the subject. Items of this imaging type include an imaging region (optic nerve head, macular, both, etc.), imaging eye (left eye, right eye, both eyes), image capturing pattern (fundus image only, OCT image only, both), OCT scan. There are patterns (line scan, cross scan, radial scan, circle scan, three-dimensional scan, etc.).

(S3: Start auto alignment)
When selection of the photographing type is completed, an instruction to start auto alignment is given. This start instruction may be automatically issued by the control unit 210 in response to the selection of the shooting type shown in step 2, or may be manually performed by the user using the operation unit 240B.

(S4: Start photographing the anterior segment)
When an instruction to start auto-alignment is given, the control unit 210 starts imaging of the anterior segment Ea by the anterior segment cameras 300A and 300B. This shooting is moving image shooting in which the anterior segment Ea is a shooting target. Each anterior eye camera 300A and 300B shoots a moving image at a predetermined frame rate. Here, the imaging timings of the anterior eye cameras 300A and 300B may be synchronized by the control unit 210. Each anterior eye camera 300A and 300B sequentially sends the acquired frames to the control unit 210 in real time. The controller 210 associates the frames obtained by both anterior eye cameras 300A and 300B according to the photographing timing. That is, the control unit 210 associates frames acquired substantially simultaneously by both anterior eye cameras 300A and 300B. This association is executed, for example, based on the above-described synchronization control or based on the input timing of frames from the anterior eye cameras 300A and 300B. The control unit 210 sends a pair of associated frames to the analysis unit 231.

(S5: Specification of pupil center)
The image correction unit 2311 corrects the distortion of each frame sent from the control unit 210 based on the aberration information 212 a stored in the storage unit 212. This correction processing is executed as described above. The pair of frames whose distortion has been corrected is sent to the feature position specifying unit 2312.

  The feature position specifying unit 2312 analyzes each frame sent from the image correcting unit 2311, thereby executing a process for specifying the feature position in the frame corresponding to the pupil center of the anterior segment Ea.

(S6: Has the pupil center been successfully identified?)
If identification of the feature position corresponding to the center of the pupil has failed (S6: NO), the feature position identification unit 2312 sends information indicating that to the control unit 210, and proceeds to step 7. On the other hand, if the feature position has been successfully identified (S6: YES), the process proceeds to step 8.

(S7: Movement of the anterior segment camera)
In the case where the specification of the feature position has failed (S6: NO), the control unit 210 controls the above-described photographing moving unit in response to receiving the information from the feature position specifying unit 2312, and controls the anterior eye camera. 300A and 300B are moved in the direction away from the support portion 440 and / or in the outward direction of the support portion 440.

  When the anterior eye cameras 300A and 300B are moved in the direction away from the support part 440, the distance between the anterior eye cameras 300A and 300B and the subject (eye E) increases, so that the face of the subject It is possible to image a wider range, and the possibility that the eye E to be inspected is arranged in a suitable imageable range by the anterior eye camera 300A and 300B increases. Further, when the anterior eye cameras 300A and 300B are moved in the outward direction of the support part 440, the anterior eye cameras 300A and 300B are moved in the direction of the subject's ear, so that the eye to be examined is in a suitable photographing range. The possibility that E is arranged increases. In addition, by combining these movements in the two directions, the possibility that the eye E to be examined is arranged in a suitable photographing range is further increased.

  In this operation example, it is assumed that moving image shooting of the anterior segment Ea is continued even during and after the movement of the anterior segment cameras 300A and 300B. On the other hand, the moving image shooting may be stopped when the anterior eye cameras 300A and 300B are moved, and the moving image shooting may be resumed automatically or manually after the movement is completed.

  After completion of the movement of the anterior eye cameras 300A and 300B in step 7, moving image shooting by the anterior eye cameras 300A and 300B, specification of the pupil center (step 5), and determination of successful identification (step 6) are executed again. . In addition, when this routine is repeated a predetermined number of times, it can be configured to shift to manual alignment.

(S8: Is the image of the anterior segment located within a predetermined area of the frame?)
When the feature position corresponding to the pupil center is successfully identified (S6: YES), the image determination unit 232 determines whether the image corresponding to the anterior segment Ea is located within a predetermined region of the frame. In this operation example, the determination process is executed using the feature position specified in step 6. Note that when the determination process is performed using other information, the order of steps 5 and 6 and step 8 is arbitrary.

  When it is determined that the image of the anterior segment Ea is not located within the predetermined region of the frame (S8: NO), the process proceeds to step 7 and the above-described processing is executed. On the other hand, if it is determined that the image of the anterior segment Ea is located within a predetermined area of the frame (S8: YES), the process proceeds to step 9.

(S9: Calculation of the three-dimensional position of the eye to be examined)
The three-dimensional position calculation unit 2313 calculates the three-dimensional position of the pupil center of the eye E based on the positions of the anterior eye cameras 300A and 300B and the characteristic positions specified for the pair of frames by the characteristic position specifying unit 2312. calculate. This process is executed as described above.

(S10: Movement of inspection optical system)
Based on the three-dimensional position of the center of the pupil calculated in step 9, the control unit 210 matches the optical axis of the examination optical system with the axis of the eye E, and the examination optical system for the eye E is examined. The optical system driving unit 2A is controlled so that the distance becomes a predetermined working distance.

(S11: Is the position converged?)
When the inspection optical system is moved in step 10, the control unit 210 determines whether the position of the inspection optical system has converged. This determination process is performed using an alignment index, for example. The observation state of the alignment index changes according to the alignment state. Specifically, in a state where the alignment is suitable, the two images of the alignment index are observed at substantially the same position, and the positions of the two images are observed apart as the alignment state deteriorates. The control unit 210 obtains a distance between two images taken by the CCD image sensor 35 and determines whether this distance is equal to or smaller than a predetermined threshold value. If it is determined that the distance is equal to or smaller than the predetermined threshold (S11: YES), it is determined that the position of the inspection optical system has converged, and the process ends. On the other hand, if it is determined that this distance exceeds the predetermined threshold (S11: NO), it is determined that the position of the inspection optical system has not converged, and the process returns to step 9. The processing of step 9 to step 11 is repeated until it is determined “NO” a predetermined number of times in step 11, for example. When the determination of “NO” in step 11 is repeated a predetermined number of times, the control unit 210 outputs, for example, predetermined warning information. Further, in response to the determination of “NO” in step 11 being repeated a predetermined number of times, the control unit shifts to an operation mode in which manual alignment is performed or an operation mode in which auto alignment using an alignment index is performed. It is also possible for 210 to perform control. The position convergence determination process is not limited to this, and any method can be used as long as it can determine whether or not the position of the inspection optical system has converged appropriately.

  This is the end of the description of alignment according to this operation example. It should be noted that the inspection optical system for the eye E can be tracked by repeatedly executing Step 4 (moving image shooting) to Step 11 (position convergence determination). In the description of step 11, when the position of the inspection optical system does not converge (S11: NO), it is described that the process returns to step 9, but it is configured so that the process returns to step 5 (identification of the pupil center). Is possible. That is, frames are sequentially obtained at predetermined time intervals after the imaging of the anterior eye portion is started in step 4, but the processing after step 5 is performed on each frame (or each frame obtained by thinning). It is executed against. When the position convergence determination in step 11 is performed again, the processes in steps 5 to 10 are executed on the newly acquired frame, and the position determination process is executed again in response to the processing.

[Second operation example]
A second operation example will be described with reference to FIG. The second operation example is a warning when the characteristic part of the anterior eye portion Ea (here, the center of the pupil) is not specified or when the image of the anterior eye portion Ea is not included in a predetermined region in the captured image. Information is output.

(S21 to S25: Patient registration to specifying pupil center)
Steps 21 to 25 are executed in the same manner as Steps 1 to 5 in the first operation example.

(S26: Has the pupil center been successfully identified?)
If identification of the feature position corresponding to the center of the pupil has failed (S26: NO), the feature position identification unit 2312 sends information indicating that to the control unit 210, and proceeds to step 27. On the other hand, if the feature position has been successfully identified (S26: YES), the process proceeds to step 29.

(S27: Output of warning information)
When the identification of the feature position has failed (S26: NO), the control unit 210 outputs the warning information described above in response to receiving the information from the feature position specifying unit 2312.

(S28: Anterior eye camera movement operation)
The user who has recognized the warning information moves the anterior eye cameras 300A and 300B using the operation unit 240B. At this time, the control unit 210 can display images captured by the anterior eye cameras 300A and 300B on the display unit 240A. The user can move the anterior eye cameras 300A and 300B while referring to the display image.

  After the movement operation of the anterior eye cameras 300A and 300B in step 28 is completed, moving image shooting by the anterior eye cameras 300A and 300B, identification of the pupil center (step 25), and determination of successful identification (step 26) are executed again. The In addition, when this routine is repeated a predetermined number of times, it can be configured to shift to manual alignment.

(S29: Is the image of the anterior segment located within a predetermined area of the frame?)
If the feature position corresponding to the center of the pupil is successfully identified (S26: YES), the image determination unit 232 positions the image corresponding to the anterior segment Ea within the predetermined region of the frame, as in the first operation example. Judge whether you are doing.

  If it is determined that the image of the anterior segment Ea is not located within the predetermined region of the frame (S29: NO), the process proceeds to step 27, where warning information is output, and the process proceeds to step 28, where The movement operation of the eye cameras 300A and 300B is performed. On the other hand, if it is determined that the image of the anterior segment Ea is located within a predetermined area of the frame (S29: YES), the process proceeds to step 30.

(S30: Calculation of the three-dimensional position of the eye to be examined)
Similar to the first operation example, the three-dimensional position calculation unit 2313 is based on the positions of the anterior eye cameras 300A and 300B and the feature positions specified for the pair of frames by the feature position specification unit 2312. The three-dimensional position of E's pupil center is calculated.

(S31: Movement of inspection optical system)
Based on the three-dimensional position of the center of the pupil calculated in step 30, the control unit 210 matches the optical axis of the inspection optical system with the axis of the eye E, and the inspection optical system for the eye E is inspected. The optical system driving unit 2A is controlled so that the distance becomes a predetermined working distance. This process is executed in the same manner as Step 10 in the first operation example.

(S32: Is the position converged?)
When the inspection optical system is moved in step 31, the control unit 210 performs the position convergence determination process similar to step 11 in the first operation example. If it is determined that the position of the inspection optical system has converged (S32: YES), the process ends. On the other hand, when it is determined that the position of the inspection optical system has not converged (S32: NO), the process returns to step 30. The repetition of processing in steps 30 to 32 and warning are the same as in the first operation example. This is the end of the description of this operation example.

[Third operation example]
A third operation example will be described with reference to FIG. The third operation example is performed manually when the characteristic part of the anterior segment Ea (here, the center of the pupil) is not specified or when the image of the anterior segment Ea is not included in the predetermined region in the captured image. It shifts to the alignment in.

(S41 to S45: Patient registration to specifying pupil center)
Steps 41 to 45 are executed in the same manner as Steps 1 to 5 in the first operation example.

(S46: Has the pupil center been identified successfully?)
If identification of the feature position corresponding to the center of the pupil has failed (S46: NO), the feature position identification unit 2312 sends information indicating that fact to the control unit 210, and proceeds to step 47. On the other hand, if the feature position has been successfully identified (S46: YES), the process proceeds to step 49.

(S47: Projection of alignment index)
In the case where the specification of the feature position has failed (S46: NO), the control unit 210 controls the alignment optical system 50 to correspond to the information received from the feature position specifying unit 2312, and the alignment index is applied to the eye E. Project. In addition, the control unit 210 controls the fundus camera unit 2 and the display unit 240A to display an observation image (moving image) of the anterior segment Ea on which the alignment index is projected.

(S48: Execution of manual alignment)
The user performs manual alignment using the operation unit 240B while referring to the displayed observation image. The process in this case ends here. When the routines of moving image shooting by the anterior eye cameras 300A and 300B, pupil center specification (step 45), and specification success determination (step 46) are repeated a predetermined number of times, the process may be shifted to manual alignment.

(S49: Is the anterior eye image positioned within a predetermined area of the frame?)
When the feature position corresponding to the center of the pupil is successfully identified (S46: YES), the image determination unit 232 positions the image corresponding to the anterior segment Ea within a predetermined region of the frame, as in the first operation example. Judge whether you are doing.

  When it is determined that the image of the anterior segment Ea is not located within the predetermined region of the frame (S49: NO), the process proceeds to step 47, the alignment index is projected onto the eye E, and the process proceeds to step 48. Manual alignment. On the other hand, when it is determined that the image of the anterior segment Ea is located within a predetermined area of the frame (S49: YES), the process proceeds to step 50.

(S50: Calculation of the three-dimensional position of the eye to be examined)
Similar to the first operation example, the three-dimensional position calculation unit 2313 is based on the positions of the anterior eye cameras 300A and 300B and the feature positions specified for the pair of frames by the feature position specification unit 2312. The three-dimensional position of E's pupil center is calculated.

(S51: Movement of inspection optical system)
Based on the three-dimensional position of the center of the pupil calculated in step 50, the controller 210 adjusts the optical axis of the inspection optical system to the axis of the eye E and also sets the inspection optical system for the eye E to be examined. The optical system driving unit 2A is controlled so that the distance becomes a predetermined working distance. This process is executed in the same manner as Step 10 in the first operation example.

  In addition, after the manual alignment of step 48 is performed, the information which shows the characteristic site | part of the anterior eye part Ea specified based on the result of this manual alignment can be displayed. In this process, for example, the feature position specifying unit 2312 specifies an image position in an observation image (frame) corresponding to the feature portion, and the control unit 210 further displays information indicating the specified image position as an observation image. It is executed by displaying it overlaid on.

(S52: Is the position converged?)
When the inspection optical system is moved in step 51, the control unit 210 performs a position convergence determination process similar to step 11 in the first operation example. If it is determined that the position of the inspection optical system has converged (S52: YES), the process ends. On the other hand, if it is determined that the position of the inspection optical system has not converged (S52: NO), the process returns to step 50. The repetition of processing in step 50 to step 52 and the warning are the same as in the first operation example. This is the end of the description of this operation example.

[Fourth operation example]
The fourth operation example can be applied in combination with any operation mode of this embodiment including the first to third operation examples.

  The fourth operation example is executed using the image composition unit 233. That is, the control unit 210 controls the image composition unit 233 to form a composite image of two captured images obtained substantially simultaneously by the two or more anterior eye cameras 300A and 300B. This composite image is, for example, the above-described stereoscopic image or viewpoint conversion image. Note that the timing at which the processing of this operation example is executed may be any timing after two captured images are obtained.

[Action / Effect]
The operation and effect of the ophthalmologic apparatus 1 will be described.

  The ophthalmologic apparatus 1 includes a fundus camera optical system and an OCT optical system (inspection optical system), a support unit 440, an optical system drive unit 2A (drive unit, first drive unit), two anterior eye camera 300A, 300B (photographing unit), analysis unit 231 and control unit 210.

  The inspection optical system is an optical system for inspecting the eye E, and is used to obtain an image of the eye in this embodiment.

  The optical system driving unit 2A moves the inspection optical system three-dimensionally. Accordingly, the inspection optical system and the support portion 440 are moved relatively and three-dimensionally.

  The anterior eye cameras 300 </ b> A and 300 </ b> B capture the anterior eye part Ea of the eye E substantially simultaneously from different directions. In this embodiment, two photographing units are provided, but any number of two or more may be used. However, two are sufficient in consideration of the purpose of use of the image obtained by the photographing unit. Use three or more photographing units with different photographing ranges, and select a suitable one (for example, one in which the anterior segment Ea is suitably depicted) among three or more images obtained substantially simultaneously. Thus, it can be configured to be used for subsequent processing.

  The analysis unit 231 obtains the three-dimensional position of the eye E by analyzing two captured images obtained substantially simultaneously by the two anterior eye cameras 300A and 300B.

  The control unit 210 controls the optical system driving unit 2 </ b> A based on the three-dimensional position of the eye E obtained by the analysis unit 231 to move the inspection optical system and the support unit 440 relative to each other. That is, the control unit 210 of this embodiment adjusts the optical axis of the inspection optical system to the axis of the eye E based on the three-dimensional position of the eye E obtained by the analysis unit 231 and The optical system driving unit 2A is controlled so that the distance of the inspection optical system with respect to the optometry E becomes a predetermined working distance. Here, the axis of the eye E is an arbitrary axis defined in a direction from the cornea side to the retina side of the eye E, and examples thereof include an eye axis and a visual axis. Further, the axis of the eye E may include a deviation in an allowable range (measurement error, instrumental error, etc.). For example, in this embodiment, an image is analyzed to determine the characteristic part (pupil center, corneal apex, etc.) of the anterior segment Ea. However, when viewed from the front, the pupil center and the corneal apex generally do not match. The axis of the eye E may include an error in a range that considers such matters. Note that, after the alignment and tracking according to this embodiment, an examination using the examination optical system (fundus imaging, OCT measurement, etc.) is performed, and therefore, the axis error of the eye E has an adverse effect on the subsequent examination. Is allowed to the extent that is not given.

  The analysis unit 231 may include a feature position specifying unit 2312 and a three-dimensional position calculation unit 2313. The feature position specifying unit 2312 analyzes each of the two photographed images obtained substantially simultaneously by the two anterior eye camera 300A and 300B, so that the photograph corresponding to a predetermined feature part of the anterior eye part Ea is obtained. The feature position in the image is specified. This characteristic part is, for example, the center of the pupil or the apex of the cornea. The three-dimensional position calculation unit 2313 obtains the three-dimensional position of the feature part based on the positions of the two anterior eye cameras 300A and 300B and the feature positions in the two captured images. The three-dimensional position of this characteristic part is used as the three-dimensional position of the eye E to be examined.

  An optical system position acquisition unit 213 that acquires the current position of the inspection optical system can be provided in the control unit 210. In that case, the control unit 210 applies an inspection optical system to the optical system driving unit 2A based on the current position acquired by the optical system position acquisition unit 213 and the three-dimensional position of the eye E obtained by the analysis unit 231. Configured to move.

  According to such an ophthalmologic apparatus 1, the alignment in the xy direction (direction perpendicular to the optical axis) and the alignment in the z direction (direction along the optical axis) are not performed by different methods as in the prior art. It is possible to determine a three-dimensional positional relationship between the eye E and the inspection optical system based on two or more captured images acquired substantially simultaneously. Therefore, the three-dimensional alignment between the eye E and the optical system of the ophthalmologic apparatus 1 can be performed with high accuracy.

  The ophthalmologic apparatus 1 may include a moving image shooting optical system, an alignment optical system 50 (projection optical system), a display unit 240A, and an operation unit 240B. The moving image photographing optical system shares a part of the optical path with the inspection optical system, and takes a moving image of the anterior segment Ea of the eye E to be examined. In this embodiment, a component for acquiring an observation image in the fundus camera optical system is used as a moving image photographing optical system. In addition, this moving image photographing optical system shares a part of the optical path (between the objective lens 22 and the dichroic mirror 46) with the OCT optical system. The alignment optical system 50 projects an index (alignment index) for aligning the inspection optical system with respect to the eye E onto the eye E. The control unit 210 switches the operation mode to the manual alignment mode when the feature position of the anterior segment Ea is not specified by the feature position specifying unit 2312. Specifically, when the characteristic part of the anterior eye part Ea is not specified, the control part 210 performs the following operation: (1) Control the alignment optical system 50 and set the alignment index to the eye E to be examined. (2) causing the moving image photographing optical system to acquire a moving image of the anterior segment Ea on which the alignment index is projected; (3) displaying the moving image of the anterior segment Ea acquired by the moving image capturing optical system. (4) The inspection optical system is moved by controlling the optical system driving unit 2A according to the operation performed by the user using the operation unit 240B while referring to the displayed moving image. By switching the operation mode in this way, it is possible to smoothly shift to manual alignment when auto alignment based on two or more captured images is not successful. Thereby, the examination time can be shortened, and the burden on the patient and the examiner can be reduced.

  After the manual alignment based on the switching of the operation mode is completed, the feature position specifying unit 2312 specifies the image position in the moving image corresponding to the feature part, and the control unit 210 stores information indicating the specified image position. It can be configured to be displayed overlaid on a moving image. According to this structure, the characteristic position specified based on the result of manual alignment can be grasped in real time based on the moving image. In this operation, the feature position specifying unit 2312 specifies the image position for each of the frames sequentially obtained after the manual alignment is completed, and the control unit 210 superimposes information indicating the image position on each frame. Can be displayed. Thereby, a moving image in which the position of the image position in the frame changes according to the movement of the eye E is obtained.

  By applying the following configuration, it is possible to execute tracking similar to the above-described auto alignment. Therefore, two or more imaging units shoot moving images of the anterior segment Ea of the eye E in parallel from different directions. The analysis unit 231 sequentially obtains a three-dimensional position of the eye E by sequentially analyzing two or more frames obtained substantially simultaneously in the moving image shooting. Further, the control unit 210 sequentially controls the optical system driving unit 2A based on the three-dimensional position sequentially obtained by the analysis unit 231, thereby causing the position of the inspection optical system to follow the movement of the eye E. According to such a configuration, it is possible to realize highly accurate tracking.

  Processing for obtaining the three-dimensional position of the eye E to be examined by the analysis unit 231 can be performed as follows. In this configuration, the ophthalmologic apparatus 1 includes a storage unit 212 (second storage unit) that stores aberration information 212a of each imaging unit in advance. The aberration information 212a is information regarding distortion aberration generated in the captured image by the optical system of the imaging unit. The aberration information 212a is generated by analyzing a plurality of photographed images obtained by photographing the reference point with the photographing unit at different positions with respect to the predetermined reference point. The analysis unit 231 includes an image correction unit 2311 that corrects distortion of each captured image based on the aberration information 212a corresponding to the image capturing unit. Then, the analysis unit 231 performs processing for obtaining the three-dimensional position of the eye E based on two or more captured images corrected by the image correction unit 2311. According to such a configuration, distortion due to the optical system of each photographing unit can be taken into consideration, so that alignment and tracking can be performed with higher accuracy.

  When the eye E is not located at a position where the examination can be performed, the imaging unit can be moved to a suitable position. In order to realize this, the ophthalmologic apparatus 1 further includes an imaging movement unit, a support unit 440, and an image determination unit 232 (determination unit). The photographing moving unit moves at least one of the two or more photographing units. The support part 440 supports the subject's face. The image determination unit 232 determines whether or not the image of the anterior segment Ea is included in a predetermined region in the captured image by analyzing a captured image obtained by at least one of the two or more capturing units. . The control unit 210 controls the imaging moving unit to move at least one of the two or more imaging units away from the support unit 440 when it is determined that the image of the anterior segment Ea is not included in the predetermined region. And / or moving away from the optical axis of the inspection optical system. Thereafter, the image determination unit 232 executes the determination process again. According to such a configuration, when the eye E is located at a position where the examination cannot be performed, the determination unit can be performed again by moving the imaging unit in a direction considered suitable for imaging the eye E. it can. Examples of this processing mode include a method of performing a determination process stepwise by moving the photographing unit by a predetermined distance, and a method of performing a determination process in real time while moving at a predetermined speed. Further, when it is determined in the determination process that the image of the anterior segment Ea is included in the predetermined region in the captured image, the control unit 210 leaves the routine for moving the imaging unit, and the latter stage. Control shifts to execution of processing.

  The ophthalmologic apparatus 1 may include an image synthesis unit 233 that forms a composite image of two or more captured images obtained substantially simultaneously by two or more imaging units. In that case, the control unit 210 causes the display unit 240A to display the combined image formed by the image combining unit 233. The composite image is, for example, the above-described stereoscopic image or viewpoint conversion image. According to such a configuration, various observation modes (stereoscopic images, observations from different viewpoints, etc.) of the eye E are realized.

<Second Embodiment>
In the first embodiment described above, the relative movement between the inspection optical system and the support portion 440 is realized by moving the inspection optical system. In this embodiment, a case where the relative movement is realized by applying a configuration in which the support portion 440 can move will be described. Hereinafter, the same reference numerals are used for the same components as those in the first embodiment. The ophthalmologic apparatus of this embodiment is denoted by reference numeral 1000.

[Constitution]
The ophthalmologic apparatus 1000 has a hardware configuration substantially similar to that of the ophthalmologic apparatus 1 of the first embodiment, for example (see FIGS. 1 and 2). A configuration example of the control system of the ophthalmologic apparatus 1000 is shown in FIG. 3 is different from the control system of the first embodiment shown in FIG. 3 in that a moving target position determining unit 2314 is provided in the analyzing unit 231 and a chin rest driving unit 440A and a proximity detecting unit 500 are provided. It is that you are. Although not shown, the user interface 240 is provided with a display unit 240A and an operation unit 240B as in the first embodiment. In addition, although explanations regarding components common to the first embodiment are omitted, the ophthalmologic apparatus 1000 can execute the same processing as that of the first embodiment using these common components. Hereinafter, parts different from the first embodiment will be mainly described.

(Chin rest drive part)
The chin receiving drive unit 440A moves the support unit 440 under the control of the main control unit 211. The chin rest drive section 440A moves the support section 440 at least in the vertical direction. That is, the chin rest drive unit 440A may be configured to move the support unit 440 only in the vertical direction, or to move the support unit 440 in the left-right direction and / or the front-rear direction in addition to the vertical direction. It may be configured. The chin rest drive unit 440A is an example of a “second drive unit”.

  In addition, although the 2nd drive part of this embodiment functions to move several members (a chin rest, a forehead support, etc.) which support a subject's face integrally, each member is moved separately. It may be configured as follows. For example, a drive mechanism for moving the chin rest and a drive mechanism for moving the forehead support may be provided separately.

(Movement target position determination unit)
The movement target position determination unit 2314 moves the movement target position of the support unit 440 based on the two captured images obtained substantially simultaneously by the anterior eye cameras 300A and 300B and the positions of the anterior eye cameras 300A and 300B. To decide. The movement target position means a position where the support unit 440 is moved in the subsequent process. Further, the movement target position indicates a position in the movable direction of the support portion 440 by the chin rest driving portion 440A. For example, when the support portion 440 is movable only in the vertical direction, the movement target position indicates a position in the vertical direction (that is, a height position).

  An example of processing executed by the movement target position determination unit 2314 will be described. As a premise, similarly to the first embodiment, the ophthalmologic apparatus 1000 of this embodiment acquires two images with different viewpoints by performing imaging at substantially the same time using the anterior eye cameras 300A and 300B. . The movement target position determination unit 2314 performs known image processing (for example, pattern matching, threshold processing, etc.) on the two captured images, and corresponds to a predetermined object drawn on both of the two captured images. The image area to be specified is specified. This object is, for example, a part of the subject's face (such as an eye).

  Furthermore, the movement target position determination unit 2314 acquires a three-dimensional position corresponding to the identified image region based on the parallax between the two captured images obtained from the positions of the anterior eye cameras 300A and 300B. This process can be executed, for example, in the same manner as the process for obtaining the three-dimensional position of the eye E described in the first embodiment (see FIGS. 5A and 5B).

  Note that the movement target position determination unit 2314 can determine the movement target position based on an image obtained by photographing the anterior eye part of the eye E, as will be described in an operation example described later. Further, since the position of the inspection optical system and the position of the support unit 440 are relative, the movement target position determination unit 2314 performs the same processing as described above, thereby performing the inspection optical system (fundus camera unit). It is also possible to determine the movement target position of 2).

(Proximity detector)
The proximity detection unit 500 detects the proximity of the subject with respect to the support unit 440. The proximity detection unit 500 is configured to include a proximity sensor, for example. The proximity sensor is also called a proximity switch or the like, and is a device that converts movement information or presence information to be detected into an electrical signal. As a detection method applied to the proximity sensor, there are an infrared method, a capacitance method, an ultrasonic method, and the like. It is also possible to use an illuminance sensor that detects brightness as a proximity sensor.

  An example of a method for detecting the proximity of the subject without using the sensor as described above will be described. First, moving image shooting is started using at least one of the anterior eye cameras 300A and 300B. When the subject approaches the support unit 440, the subject (face) enters the frame. The image processing unit 230 detects that the subject has entered the frame by analyzing each frame of the moving image shooting. Furthermore, the image processing unit 230 obtains a time-series change in the drawing size of the face (predetermined part) of the subject by analyzing sequentially input frames. Then, the image processing unit 230 determines that the subject has approached the support unit 440 when the drawing size becomes a predetermined value or more. The parameter indicating the drawing size is calculated based on, for example, the size of the frame or the size of the drawn object (such as the support unit 440). When this example is applied, at least one of the anterior eye cameras 300 </ b> A and 300 </ b> B and the image processing unit 230 function as the proximity detection unit 500.

[Operation]
The operation of the ophthalmologic apparatus 1000 will be described. An operation example of the ophthalmologic apparatus 1000 is shown in FIGS. Any two or more of these operation examples can be combined. Further, any one or more of these operation examples can be combined with any one or more of the operation examples described in the first embodiment.

[First operation example]
A first operation example will be described with reference to FIG. Note that step 1 (patient registration) and step 2 (selection of imaging type) shown in FIG. 6 of the first embodiment can be performed at any timing before or during the process shown in FIG. .

(S61: Detect proximity of subject)
First, the main control unit 211 starts the operation of the proximity detection unit 500. The proximity detection unit 500 continues the detection operation until at least the proximity of the subject to the support unit 440 is detected (S61: NO).

(S62: Anterior segment photographing / image display is started)
When the proximity detection unit 500 detects the proximity of the subject with respect to the support unit 440 (S61: YES), the main control unit 211 controls the anterior eye cameras 300A and 300B to perform anterior eye imaging of the eye E. Let it begin. Further, the main control unit 211 displays an image obtained by one or both of the anterior segment cameras 300A and 300B in the anterior segment imaging on the 4 display unit 240A in real time. When both images are displayed, the display image may be the above-described composite image (stereoscopic image, viewpoint conversion image, etc.). Moreover, the processing mode of this step is, for example, moving image shooting and moving image display of the anterior segment.

(S63: Is the image of the anterior segment located within a predetermined area of the frame?)
The analysis unit 231 and the image determination unit 232 determine whether the image of the anterior segment is located within a predetermined region of the frame by analyzing the image obtained in step 62. This processing can be performed in the same manner as Step 5 to Step 8 in FIG. 6 of the first embodiment. Further, this process can be sequentially performed on images obtained in time series in the anterior segment imaging started in step 62.

  If it is determined that the image of the anterior segment is located within the predetermined region (S63: YES), the process proceeds to auto alignment (movement of the inspection optical system) in step 66. On the other hand, when it is determined that the image of the anterior segment is not located within the predetermined area (S63: NO), the process proceeds to step 64 and step 65 (movement of the support unit 440).

(S64: The movement target position is determined)
When the image of the anterior segment is not located within the predetermined area (S63: NO), the movement target position determination unit 2314 and the two images captured substantially simultaneously in the anterior segment imaging of step 62 and the anterior segment The movement target position of the support unit 440 is determined based on the positions of the partial cameras 300A and 300B.

(S65: Move the support part)
The main control unit 211 controls the chin rest drive unit 440A so as to move the support unit 440 to the movement target position determined in step 64. When the movement of the support unit 440 is completed, the process returns to the determination process in step 63. That is, step 63 to step 65 are repeated until it is determined in step 63 that “YES (the image of the anterior segment is located within a predetermined region)”.

  In this iterative process, when the number of repetitions reaches a predetermined number, or when the process is continued for a predetermined time, the iterative process can be stopped and a notification process can be performed. For example, the notification process outputs information that prompts manual positioning of the support portion 440.

(S66: Auto alignment is performed while moving the inspection optical system)
When it is determined as “YES” in Step 63, the main control unit 211 performs auto alignment shown in FIG. 6 (particularly, Step 9 to Step 11) of the first embodiment, for example. Accordingly, the relative position between the eye E and the inspection optical system is guided to a positional relationship where the inspection can be performed.

[Second operation example]
A second operation example will be described with reference to FIG. The process according to this operation example is executed in accordance with the change of the subject.

(S71: Input of subject change information)
First, information indicating the change of the subject (subject change information) is input to the main control unit 211. This information input is performed, for example, at the timing when the examination of one subject is completed or when the examination of a new subject is started. As an example of the former, there is a timing at which an operation for ending an examination of one subject is performed, a timing at which a process for saving information acquired by the examination of one subject is performed, and the like. Examples of the latter include the timing at which an operation for starting a test for a new subject is performed, the timing at which patient registration shown in Step 1 of FIG. 6 of the first embodiment is performed, and the like. Information indicating that such an operation or process has been executed is subject change information. The subject change information indicating that a predetermined operation has been performed is input to the main control unit 211 from the operation unit 240B. In addition, since the main control unit 211 itself recognizes that the predetermined process has been executed, it can be considered that the subject change information in this case is input from the main control unit 211 to the main control unit 211 itself. it can.

(S72: The support part is moved to the initial position)
In response to the input of the subject change information, the main control unit 211 controls the chin rest driving unit 440A to move the support unit 440 to a predetermined initial position. This initial position is set in advance. For example, the height position calculated based on the standard value of information (height, sitting height, etc.) obtained by measuring the body can be set as the initial position. When the height of the chair on which the subject sits can be adjusted and the chair height information can be acquired, the initial position can be determined in consideration of the height of the chair. For example, the initial position can be determined based on the height of the chair and the standard value. If the patient has already been registered, the initial position can be determined based on the age, height, sitting height, etc. of the subject. In addition, when a test is performed on a specific age group (adult, dwarf, etc.) or a group of gender subjects as in a health checkup, a plurality of initial groups set in advance according to the age group and gender are used. It can be configured to selectively apply the position.

(S73: Align the inspection optical system and the support portion)
When the support portion 440 is moved to the initial position, alignment for aligning the relative positions of the inspection optical system and the support portion 440 is executed. This alignment process is, for example, any operation example described in the first embodiment or the second embodiment.

[Third operation example]
A third operation example will be described with reference to FIG. In this operation example, the inspection optical system and the support unit 440 are moved to a position applied in a previous inspection performed on the subject.

  As a premise of this operation example, the ophthalmologic apparatus 1000 uses position information indicating the position of the inspection optical system and / or the position of the support portion 440 applied in the inspection as identification information (patient ID or the like) of the subject. It has a function of storing in association. In this process, for example, the patient ID input in the patient registration and the position information in the actual examination are stored in association with each other. As a specific example, an area for recording position information can be provided in the electronic medical record of each patient. The patient ID and position information are stored in a storage device (storage unit 212) mounted on the ophthalmologic apparatus 1000 or a storage device of an external device (electronic medical chart system). In the former case, the storage unit 212 functions as a “first storage unit”. Also in the latter case, the position information generated by the ophthalmologic apparatus 1000 is stored at least temporarily in the storage unit 212 and then sent to the external apparatus in association with the patient ID, and the position information stored in the past is externally stored. Since the process acquired from the apparatus and associated with the patient ID and stored at least temporarily in the storage unit 212 is executed, it can be considered that at least the storage unit 212 is included in the first storage unit.

(S81: Patient registration)
First, patient registration is performed. Patient registration is performed when the user inputs patient information (including subject identification information) using the user interface 240, for example, as in the first embodiment.

(S82: Acquire position information)
The main control unit 211 acquires position information associated with the identification information input in step 81. This process is performed, for example, by searching the storage unit 212 (or the storage device of the external device) using the input identification information as a search query.

  Note that there may be a case where position information associated with the input identification information is not acquired. In that case, it is possible to perform a notification process that the target position information has not been acquired or that the user is prompted to perform a predetermined substitution process instead of the following process. As this alternative process, there is manual alignment or any process described in the first embodiment or the second embodiment.

(S83: The inspection optical system / support unit is moved to the position indicated by the position information)
The main control unit 211 controls the optical system driving unit 2A and / or the jaw holder driving unit 440A so as to move the inspection optical system and / or the support unit 440 to the position indicated by the position information acquired in step 82. . In this process, when the positions of both the inspection optical system and the support portion 440 are included in the position information, both or one of them can be moved. Further, when the position information includes only the position of either the inspection optical system or the support portion 440, one of them can be moved.

(S84: Align the inspection optical system and the support portion)
When the inspection optical system and / or the support unit 440 is moved to the position indicated by the position information, alignment for aligning the relative positions of the inspection optical system and the support unit 440 is executed. This alignment process is, for example, any operation example described in the first embodiment or the second embodiment.

  The reason why the alignment process in step 84 is performed is that the eye E and the inspection optical system cannot generally be arranged in an optimal positional relationship only by the process in step 83. The reason is that the contact position of the face with respect to the support portion 440 is slightly different, and very precise alignment is necessary for the examination of the eye E.

[Modification]
A modification of this embodiment will be described. An example of an ophthalmologic apparatus according to this modification is shown in FIG. The ophthalmologic apparatus 1100 has a contact detection unit 600. Although the proximity detection unit 500 is not illustrated in FIG. 13, the ophthalmologic apparatus 1100 may include the proximity detection unit 500.

  The contact detection unit 600 detects contact of the subject's face with the support unit 440. The contact detection unit 600 is provided, for example, at a position where the face of the subject contacts the support unit 440 (the center position of the chin rest, the center position of the forehead rest, etc.). The contact detection unit 600 has an arbitrary configuration that can detect contact. For example, the contact detection unit 600 includes a micro switch that can determine whether it is in a contact state or a non-contact state by switching between electrical connection / disconnection of contacts.

  When the detection result by the contact detection unit 600 indicates a contact state, that is, when the face is in contact with the support unit 440, the main control unit 211 does not control the chin rest drive unit 440A, and the optical system Only the drive unit 2A is controlled. For example, when a movement request for the support unit 440 is input in the contact state, the main control unit 211 does not execute the movement of the support unit 440 according to the movement request. At this time, notification that the movement of the support portion 440 cannot be accepted can be performed. When a movement request for the inspection optical system is input in the contact state, the main control unit 211 can control the optical system driving unit 2A to move the inspection optical system based on the movement request. Is possible.

  On the other hand, when the detection result by the contact detection unit 600 indicates a non-contact state, that is, when the face is not in contact with the support unit 440, the main control unit 211 includes the optical system driving unit 2A and the chin rest driving unit. It is possible to execute both controls of 440A.

[Action / Effect]
The operation and effect of the ophthalmic apparatus (ophthalmic apparatuses 1000 and 1100) according to this embodiment will be described. In addition, since the effect | action and effect which a structure which is common in 1st Embodiment show | play are the same as that of 1st Embodiment, description for the second time is abbreviate | omitted.

  The ophthalmologic apparatus according to this embodiment includes a chin rest drive unit 440 </ b> A (second drive unit) that moves the support unit 440. The analysis unit 231 analyzes two captured images obtained substantially simultaneously by the anterior eye cameras 300A and 300B. The main control unit 211 (control unit) moves the support unit 440 by controlling the chin rest driving unit 440A based on the analysis result by the analysis unit 231. According to such an ophthalmologic apparatus, the support part 440 (and the inspection optical system) can be relatively moved, so the eye E and the inspection optical of the subject whose face is supported by the support part 440. It is possible to suitably perform alignment with the system.

  The analysis unit 231 determines a movement target position determination unit 2314 that determines a movement target position of the support unit 440 based on the captured images acquired by the anterior eye cameras 300A and 300B and the positions of the anterior eye cameras 300A and 300B. May be included. In that case, the main control unit 211 can control the chin rest drive unit 440A to move the support unit 440 to the determined movement target position. Thereby, the moving operation of the support portion 440 can be automatically performed.

  When the information indicating the change of the subject is input, the main control unit 211 can control the chin rest drive unit 440A to move the support unit 440 to a predetermined initial position. Thereby, since the support part 440 can be moved from a predetermined position, the alignment between the eye E and the optical system for inspection can be quickly performed.

  The ophthalmologic apparatus according to this embodiment may include a proximity detection unit 500 that detects the proximity of the subject to the support unit 440. In that case, when proximity is detected, the main control unit 211 can control the anterior eye cameras 300A and 300B so as to perform imaging at substantially the same time. Thereby, it is possible to automatically perform imaging of the anterior eye segment and processing executed in response thereto at a suitable timing.

  The ophthalmologic apparatus according to this embodiment may include an input unit and a first storage unit. The input unit is for inputting the identification information of the subject, and is configured by the operation unit 240B and the main control unit 211 as described above. The first storage unit stores position information indicating the position of the inspection optical system and / or the position of the support unit 440 applied in the inspection in association with the identification information of the subject, and the storage unit 212. It is comprised including. In the case where such a configuration is applied, when the identification information is input from the input unit, the main control unit 211 acquires position information associated with the identification information from the first storage unit. The optical system drive unit 2A and / or the chin rest drive unit 440A can be controlled to move the inspection optical system and / or the support unit 440 to the position indicated by the position information. Thereby, the positions of the inspection optical system and the support portion 440 applied in the past inspection can be reproduced. Therefore, it is possible to quickly perform alignment between the eye E and the inspection optical system.

  The ophthalmologic apparatus according to this embodiment may include a contact detection unit 600 that detects contact of the subject's face with the support unit 440. In that case, when the contact is detected by the contact detection unit 600, the main control unit 211 is configured such that control can be executed only for the optical system drive unit 2A among the optical system drive unit 2A and the chin rest drive unit 440A. Can be configured. On the other hand, when the contact of the face with the support unit 440 is not detected, the main control unit 211 can be configured so that both the optical system driving unit 2A and the chin rest driving unit 440A can be controlled. is there. According to such a structure, it can prevent that the support part 440 moves in the state which made the face contact the support part 440. FIG.

  The ophthalmologic apparatus according to this embodiment analyzes the captured image obtained by at least one of the anterior segment cameras 300A and 300B, so that the anterior segment image is included in a predetermined region in the captured image (frame). An image determination unit 232 (determination unit) that determines whether the image is present may be included. In this case, when it is determined that the image of the anterior segment is included in the predetermined area, the optical system driving unit 2A is controlled, and it is determined that the image of the anterior segment is not included in the predetermined area. In this case, the main control unit 211 can be configured to control the chin rest drive unit 440A. According to such a configuration, it is possible to properly use drive control based on the captured image. For example, in the former case, the position of the inspection optical system can be finely adjusted, and in the latter case, the position of the support portion 440 can be roughly adjusted.

<Third Embodiment>
The ophthalmologic apparatus according to this embodiment is characterized by the arrangement of the imaging unit. A configuration example of the ophthalmologic apparatus according to this embodiment is shown in FIG.

  Similar to FIG. 4A of the first embodiment, reference numeral 410 denotes a base, reference numeral 420 denotes a housing, reference numeral 430 denotes a lens housing part in which the objective lens 22 is housed, and reference numeral 440 denotes a support part 440. Show.

  In this embodiment, the anterior eye cameras 300 </ b> A and 300 </ b> B are disposed below (−y direction) from the lens center 22 a of the objective lens 22. The lens center 22a corresponds to a position through which the optical axis of the inspection optical system of the ophthalmic apparatus passes. The displacement between the lens center 22a and the anterior eye cameras 300A and 300B in the y direction is arbitrarily set in consideration of the effects described below. Each of the anterior eye cameras 300A and 300B is disposed in a state where its optical axis is inclined upward (toward the eye E during examination). This inclination angle (elevation angle) is also arbitrarily set.

  In addition, “the imaging unit is provided below the optical axis of the inspection optical system” not only means that the entire imaging unit is positioned below the optical axis, but also part of the imaging unit is the same as the optical axis. This includes the case of the height position and the case of being positioned above the optical axis. For example, when the outer shape of the imaging unit is large, a part thereof may be located above the optical axis of the inspection optical system. In any case, if the relative position between the imaging unit and the inspection optical system is set so that the optical axis of the imaging unit intersects the horizontal plane including the optical axis of the inspection optical system from below. Good.

  According to this embodiment, it is possible to reduce the possibility that the subject's eyelashes or eyelashes appear in the captured images acquired by the anterior eye cameras 300A and 300B (imaging unit). Moreover, even if the subject has a deep eye depression (orbit), anterior segment imaging can be suitably performed.

<Fourth Embodiment>
In some cases, the characteristic part (pupil center, corneal apex, etc.) of the anterior segment cannot be detected from the captured image acquired by the imaging unit. For example, this may occur when eyelashes are reflected in a photographed image or when photographing is performed with the eyelashes not fully open. In addition, when the subject's nose is high or the depression of the eye is deep, the characteristic part of the anterior eye part may not be detected even when the photographing field is blocked and a suitable photographed image cannot be obtained. In addition, a suitable photographed image may not be obtained due to the influence of makeup (eye shadow, mascara, etc.). In this embodiment, an example of processing that can be applied when a characteristic part of the anterior segment cannot be detected from a captured image acquired by the imaging unit will be described.

  The ophthalmologic apparatus according to this embodiment has the same configuration as that of the first embodiment, for example (refer to FIG. 3 in particular). An operation example of the orbital device according to this embodiment is shown in FIG. It is assumed that patient registration, selection of imaging type, and auto alignment start operation have already been performed.

(S91: Start photographing the anterior segment)
The control unit 210 controls the anterior eye cameras 300A and 300B to start photographing the anterior eye part Ea. This shooting is moving image shooting in which the anterior segment Ea is a shooting target. The control unit 210 causes the display unit 240A to display a moving image of the images acquired in time series.

(S92: Perform pupil center identification processing)
The image correction unit 2311 corrects the distortion of each frame sent from the control unit 210 based on the aberration information 212 a stored in the storage unit 212. The pair of frames whose distortion has been corrected is sent to the feature position specifying unit 2312.

  The feature position specifying unit 2312 analyzes each frame sent from the image correction unit 2311 to specify the feature position in the frame corresponding to the feature part (centered on the pupil) of the anterior segment Ea. Execute the process.

(S93: Specific success?)
When the feature position corresponding to the center of the pupil has been successfully identified (S93: YES), the feature position identifying unit 2312 sends information indicating that fact to the control unit 210, and proceeds to Step 94. On the other hand, if the specification of the feature position has failed (S93: NO), the feature position specifying unit 2312 sends information indicating that to the control unit 210, and the process proceeds to step 95.

(S94: Auto alignment is executed)
When the feature position is successfully identified in step 93 (S93: YES), the control unit 210 controls each part of the apparatus to execute auto alignment. This auto-alignment operation includes, for example, operations shown in Steps 8 to 11 in FIG. 6 of the first embodiment. This completes the alignment operation in this case.

(S95: A photographed image / designated mark is displayed)
When specifying the feature position fails in step 93 (S93: NO), the control unit 210 causes the display unit 240A to display a photographed image by one or both of the anterior eye cameras 300A and 300B. In addition, the control unit 210 causes the display unit 240A to display a designation mark for assisting a user to designate an image position.

  The designation mark will be described. The designation mark is an image indicating a position in the captured image, and has a predetermined shape (such as a dot shape, a cross shape, or an arrow shape). The designation mark may be always displayed, or may be displayed in response to the user designating the image position in the subsequent step 96.

  The display of the captured image will be described. At the stage of moving to step 95, the moving image display started in step 91 is performed. The display of the captured image in step 95 may continue the moving image display. Further, the moving image display may be switched to another display mode. As an example, one frame used for the moving image display can be displayed. That is, it is possible to switch to still image display. The displayed frame is, for example, a frame displayed at the transition timing to step 95.

  Another example of display mode switching will be described. The control unit 210 can selectively display one of the captured images respectively acquired by the two anterior eye cameras 300A and 300B. This process is executed as follows, for example.

  First, the control unit 210 analyzes the captured images acquired by the anterior eye cameras 300A and 300B, and evaluates the image quality of the captured images. This image quality evaluation process includes, for example, evaluation of the presence and degree of flare, evaluation of reflection of eyelashes, and evaluation of the form (shape and size) of a black eye. This “evaluation of image quality” is to evaluate a predetermined element indicating whether or not the image quality is suitable for observation.

  The image quality evaluation process includes a process content corresponding to the applied element. For example, in the evaluation of flare, a process for determining whether there is an image area having a pixel value (luminance value) equal to or greater than a predetermined threshold, a process for calculating a difference in pixel value with respect to the predetermined threshold, the determination result, and the calculation A process for evaluating the image quality based on the result is executed. In addition, in the evaluation of reflection of eyelashes or the like, processing for specifying an image area corresponding to eyelashes or the like (an object other than the anterior segment Ea) based on the pixel value, A process for specifying the overlapping state with the image region, a process for evaluating the image quality based on the specified overlapping state, and the like are executed. In the evaluation of the form of the black eye, a process for specifying an image area corresponding to the black eye, a process for obtaining the form of the image area, a process for evaluating the image quality based on the obtained form, and the like are executed. .

  The control unit 210 selects one captured image from the captured images acquired by the anterior eye cameras 300A and 300B based on the image quality evaluation result. The selected captured image may be a still image or a moving image. The control unit 210 displays the selected captured image on the display unit 240A.

(S96: Designate a position in the captured image)
The user observes the captured image displayed in step 95 and designates the image position corresponding to the characteristic part (pupil center). This designation operation is performed using the operation unit 240B. As an example of the designation operation, an operation for moving the designation marker to a desired position can be performed using the operation unit 240B. As another example of the designation operation, when the display unit 240A is a touch panel (that is, when the display unit 240A and the operation unit 240B are integrated), the user touches a desired position in the displayed captured image. . When the image position in the captured image is designated, the user performs an operation for confirming the designation result using the operation unit 240B. The control unit 210 acquires position information indicating the designated image position. This position information is, for example, coordinates in a coordinate system in which a captured image is defined.

  Instead of displaying one captured image and designating the image position as described above, a pair of captured images acquired by the anterior eye cameras 300A and 300B are displayed, and the image positions for both captured images are displayed. May be specified. In that case, position information can be created by using, for example, an average position of the two designated positions, that is, coordinates in the middle of the coordinates of the two designated positions.

(S97: Calculate the three-dimensional position of the eye to be examined)
The three-dimensional position calculation unit 2313 calculates the three-dimensional position of the characteristic part (pupil center) of the anterior segment Ea based on the positions of the anterior segment cameras 300A and 300B and the image position specified in step 96. . In this process, for example, the same process is performed using the image position specified in step 96 instead of the feature position specified by the feature position specifying unit 2312 in step 9 of FIG. 6 of the first embodiment. It is. Here, since the position information is coordinates in the coordinate system in which the captured image is defined, it is easy to perform this alternative application.

  In step 96, when the image position is specified only for the captured image acquired by one of the anterior eye cameras 300A and 300B, the three-dimensional position calculation unit 2313 corresponds to the corresponding position in the captured image acquired by the other. Process to identify. An example of this processing will be described. First, the three-dimensional position calculation unit 2313 performs image alignment processing on both captured images and associates the coordinate systems of both captured images (that is, obtains coordinate conversion between the two coordinate systems). Based on this coordinate conversion, the three-dimensional position calculation unit 2313 specifies the image position of the other captured image corresponding to the designated position for one captured image. The three-dimensional position calculation unit 2313 determines the anterior eye based on the positions of the anterior eye cameras 300A and 300B, the image position specified for one captured image, and the image position specified for the other captured image. The three-dimensional position of the characteristic part of the part Ea is calculated.

(S98: Perform alignment)
Based on the three-dimensional position of the pupil center calculated in step 97, the control unit 210 performs alignment of the inspection optical system with respect to the eye E. This alignment is executed, for example, in the same manner as in step 10 (movement processing of the inspection optical system) and step 11 (position convergence determination processing) in FIG. 6 of the first embodiment.

  According to this embodiment, when the characteristic part (pupil center, corneal apex, etc.) of the anterior segment cannot be detected from the captured image, alignment can be performed using the position specified by the user. Therefore, even if it is a case where a characteristic part cannot be detected, alignment can be performed smoothly and rapidly.

[Modification]
The image position specified by the characteristic position specifying unit 2312 can be treated as a candidate for a characteristic position corresponding to the characteristic part of the anterior eye part Ea. An example of the operation in that case will be described.

  The feature position specifying unit 2312 specifies the candidate position of the feature position corresponding to the feature part by executing the same processing as in the first embodiment. The number of candidate positions to be identified is one or two or more.

  The control unit 210 displays the captured image on the display unit 240A and displays information (candidate position information) indicating each candidate position specified by the feature position specifying unit 2312. The candidate position information is, for example, an image indicating a position (coordinates) in a captured image corresponding to the candidate position, and has a predetermined shape (such as a dot shape, a cross shape, or an arrow shape).

  The user designates desired one of the displayed candidate position information. This designation operation is performed using the operation unit 240B. The three-dimensional position calculation unit 2313 calculates the three-dimensional position of the characteristic part of the anterior segment Ea based on the coordinates of the designated candidate position information and the positions of the anterior segment cameras 300A and 300B.

  Note that the processing when a candidate position is designated only for one captured image is the same as in the above embodiment. Further, the displayed candidate position information can be arbitrarily moved in the same manner as in the above embodiment.

  In this modification, when only one candidate position information is displayed, the designation operation performed by the user is equivalent to determining whether or not to accept the candidate position. If not, the user performs a predetermined operation. Upon receiving this operation, the control unit 210 can switch the operation mode to the process of the above embodiment (FIG. 15).

  On the other hand, when two or more candidate position information is displayed, the designation operation performed by the user corresponds to selecting a candidate position. When no candidate position is selected, the user performs a predetermined operation. Upon receiving this operation, the control unit 210 can switch the operation mode to the process of the above embodiment (FIG. 15).

  According to this modification, the user can select a candidate for a feature position corresponding to the feature part of the anterior segment Ea, so that it is possible to improve the alignment accuracy and smooth the alignment.

<Fifth Embodiment>
As described in the above embodiment, the alignment may not be suitably performed depending on the imaging conditions of the anterior segment. For example, flare may be mixed in the captured image of the anterior segment due to individual differences (corneal shape, distance between cornea and crystalline lens, etc.) of the eye to be examined. If such a problem cannot be solved, the alignment is performed manually. Manual alignment is performed by a user searching for a suitable alignment position while observing an image of the eye to be examined. However, such manual alignment largely depends on the user's experience and skill level. Therefore, the reproducibility of the alignment is low and the variation due to the skill becomes large. In this embodiment, an ophthalmologic apparatus made by paying attention to such circumstances will be described.

  The ophthalmologic apparatus of this embodiment has the same configuration as that of the above embodiment (particularly, refer to FIG. 3). In particular, the ophthalmologic apparatus of this embodiment includes an alignment optical system 50 that projects an alignment index onto the eye E to be examined. An example of the operation of the orbital device according to this embodiment is shown in FIG. It is assumed that patient registration and selection of imaging type have already been performed. Further, the operation mode shown in FIG. 16 can be performed in response to the fact that the alignment mode described in the above embodiment has not been suitably performed. Further, the operation mode shown in FIG. 16 may be executed from the beginning of the inspection.

(S101: Display an observation image)
First, the control unit 210 causes the fundus camera unit 2 to acquire an observation image (moving image) of the eye E and causes the observation image acquired in time series to be displayed on the display unit 240A as a moving image in real time.

(S102: Project alignment index)
The controller 210 controls the alignment optical system 50 to project an alignment index onto the eye E. In addition, the execution timing of step 101 and step 102 is arbitrary. When Step 101 and Step 102 are executed, an image of the alignment index is drawn on the displayed observation image. Further, the control unit 210 displays information for assisting alignment along with the observation image. As an example of this information, there is an image showing the alignment target position of the alignment index whose display position moves as the inspection optical system moves.

(S103: Obtain the three-dimensional position of the eye to be examined)
The controller 210 controls the anterior eye cameras 300A and 300B to acquire a captured image. The analysis unit 231 obtains the three-dimensional position of the eye E based on the acquired captured image. This process is executed, for example, in the same manner as in the first embodiment.

(S104: Acquire relative position information)
The control unit 210 acquires relative position information indicating the relative position between the eye E and the inspection optical system based on the three-dimensional position of the eye E acquired in Step 103. This process is executed as follows, for example. First, the control unit 210 acquires the current position of the inspection optical system. The current position is acquired from, for example, a control history for the optical system driving unit 2A that moves the fundus camera unit 2. In addition, a position sensor that detects the position of the fundus camera unit 2 can be provided, and the current position can be acquired from the detection result of the position sensor. It is assumed that the coordinate system that defines the three-dimensional position (coordinates) of the eye E acquired in step 103 and the coordinate system that defines the current position (coordinates) of the inspection optical system are common. Alternatively, the coordinate transformation between both coordinate systems is known.

  The relative position information will be described. The relative position information is information indicating the relative position between the eye E and the inspection optical system as described above. As an example of this relative position, the other position with respect to one of the eye E and the inspection optical system, the difference between the position of the eye E with respect to a predetermined reference position and the position of the inspection optical system (vector difference, coordinate difference) and so on.

  In this embodiment, the displacement of the inspection optical system with respect to the alignment target position is used as relative position information. The alignment target position is a position of a suitable inspection optical system for inspecting the eye E, and the axis of the eye E and the inspection optical system in the x direction (left-right direction) and the y direction (up-down direction). Is the position away from the eye E by a predetermined working distance in the z direction (front-rear direction, optical axis direction). Since the working distance is known and the three-dimensional position of the eye E is acquired in step 103, for example, it is easy to obtain the coordinates of the alignment target position in the common coordinate system. Such relative position information includes the relative position in the optical axis direction of the inspection optical system, and in the horizontal direction and the vertical direction perpendicular to the optical axis direction.

(S105: Display relative position information)
The control unit 210 causes the display unit 240A to display the relative position information acquired in step 104. An example of the display mode of the relative position information will be described below.

  As a first example, the control unit 210 can display numerical values indicating displacements in the x direction, the y direction, and the z direction. In this case, the control unit 210 can display numerical values in, for example, three display spaces provided in advance within or outside the display area of the observation image.

  Similarly, character string information indicating displacement can be displayed. For example, when a displacement in the x direction exists on the left side of the alignment target position, a character string indicating that fact can be displayed.

  As a second example, the control unit 210 can display an image indicating each displacement in the x direction, the y direction, and the z direction. In this case, for example, the control unit 210 can display an image indicating the alignment target position, and can display an image indicating the displacement in each direction with respect to the alignment target position at a position corresponding to the displacement. For example, when the current position of the inspection optical system is located at the upper left of the alignment target position, an image indicating the displacement in the x direction and the y direction (for example, a dot image) is displayed at the upper left of the image indicating the alignment target position. be able to. At this time, the distance between the display positions of both images is determined based on the displacement in the xy plane.

  In the second example, since the observation image is an image obtained by photographing the eye E from the front, it is easy to display the displacement in the x direction and the y direction so that the displacement can be intuitively recognized. On the other hand, in the z direction (optical axis direction), it is necessary to devise so that the displacement can be intuitively recognized. As an example, the control unit 210 can indicate the displacement (relative position) in the z direction with a display color. Specifically, for example, when a displacement in the z direction exists within a predetermined allowable range including the alignment target position, an image indicating the displacement in the z direction is displayed in green, and the displacement is smaller than the minimum value of the allowable range. When it is small, the image is displayed in red, and when the displacement is larger than the maximum value of the allowable range, the image is displayed in yellow. Further, in order to indicate not only the direction of displacement but also the amount of displacement, the density of the display color of the image indicating the displacement in the z direction is changed, or the numerical values and images of the first example are displayed together with the image indicating the displacement in the z direction. It can be displayed.

  As a third example, information (character string information, image) indicating the direction and amount to which the inspection optical system should be moved can be displayed. As an example of character string information, when the optical axis of the inspection optical system is displaced 1 cm to the right with respect to the alignment target position, the movement direction and movement amount of the inspection optical system for canceling this displacement are shown. Information “left: 1 cm” can be displayed. As an example of an image, in the same case, an arrow indicating the moving direction of the inspection optical system (an arrow pointing to the left) can be displayed. At this time, the amount of movement can be indicated by the length of the arrow, for example.

(S106: Perform manual alignment)
The user moves the inspection optical system by performing a predetermined operation using the operation unit 240B while referring to the displayed observation image and relative position information.

  At this time, the control unit 210 can change the display of the relative position information in accordance with the movement contents of the inspection optical system. For example, the control unit 210 acquires the relative position information again in real time according to the movement contents of the inspection optical system, and displays the new relative position information in real time. Thereby, the display of the numerical value, the character string, and the image is updated in real time. As a specific example, when the position in the z direction of the inspection optical system gradually approaches the alignment target position (working distance) by the user's operation, the display color of the image indicating the displacement in the z direction changes from yellow to green.

  According to the ophthalmologic apparatus according to this embodiment, the optical system for examination for the eye E based on the highly accurate three-dimensional position of the eye E calculated from the captured images acquired by the anterior eye cameras 300A and 300B. Relative position, that is, the positional deviation of the inspection optical system with respect to the alignment target position can be presented. Therefore, alignment can be performed based on quantitative information without depending on the user's experience and skill level. Thereby, it is possible to improve the reproducibility of alignment and prevent variations due to skills.

  Note that it is possible to further improve the accuracy of manual alignment by referring to the eye information. The eye information is measurement information indicating the characteristics of the eye to be acquired, for example, by an examination performed on the eye E in advance. This measurement information may be acquired by the ophthalmic apparatus or may be acquired by another ophthalmic apparatus. The measurement information is stored in advance in the storage unit 212 in association with the patient ID, for example.

  The control unit 210 selects measurement information corresponding to the eye E based on the patient ID and the like. Further, the control unit 210 generates relative position information based on the selected measurement information and the three-dimensional position of the eye E acquired by the analysis unit 231. As an example of this process, the relative positions in the x and y directions can be corrected based on the corneal shape bias. Further, the relative position in the z direction can be corrected based on the axial length. The latter is particularly effective when examining the fundus.

  Thus, by generating the relative position information in consideration of the measurement information of the eye E, it is possible to acquire and present the relative position information with higher accuracy according to the individual difference of the eye to be examined.

<Sixth Embodiment>
Alignment by a conventional ophthalmic apparatus is performed by projecting an alignment index onto the cornea and moving the inspection optical system so that the projected image is arranged at a predetermined position. On the other hand, in the embodiment of the present invention, two or more photographed images obtained substantially simultaneously by two or more photographing units are analyzed to obtain a three-dimensional position of the eye to be examined, and for inspection based on the three-dimensional position. Alignment is performed by moving the optical system and the support.

  Here, the analysis processing for obtaining the three-dimensional position of the eye to be examined is performed based on the iris and pupil depicted in each captured image. Therefore, it is desirable that the alignment be performed with reference to the iris (or the pupil that is the aperture formed by the iris), instead of using the cornea as a reference. In this embodiment, a technique for improving the accuracy of alignment (in the z direction) with an iris (pupil) as a reference will be described. Hereinafter, description will be given with reference to FIG. 3 showing the configuration of the first embodiment.

  The storage unit 212 stores in advance distance information indicating the distance between the cornea and the iris (pupil). The distance shown in the distance information is obtained by an arbitrary method. For example, there are a standard distance based on a model eye (such as a Gull strand model eye), a statistical distance based on measurement results of a plurality of test eyes, and individual distances measured in the past for the test eye.

  Note that the measurement of the distance between the cornea and the iris can be executed, for example, as follows. First, an anterior segment tomogram is obtained by OCT measurement of the anterior segment of the eye to be examined. Next, the anterior segment tomogram is analyzed to extract an image region corresponding to the cornea (corneal region) and an image corresponding to the iris (iris region). Subsequently, the distance between the cornea and the iris is obtained by counting the number of pixels between the cornea region (the rear surface region of the cornea) and the iris region (the front surface region of the iris). Here, this distance is a distance along the z direction. Such a measurement may be performed by the ophthalmologic apparatus 1 itself or by another apparatus.

  The feature position specifying unit 2312 of the analysis unit 231 specifies a feature position corresponding to an iris (pupil) from the respective captured images of the anterior eye cameras 300A and 300B, as in the first embodiment.

  The three-dimensional position calculation unit 2313 calculates the three-dimensional position of the feature part based on the positions of the anterior eye cameras 300 </ b> A and 300 </ b> B and the feature position specified by the feature position specification unit 2312. In this process, the distance information stored in the storage unit 212 can be referred to. For example, when the distance between the cornea (vertex) of the eye E and the inspection optical system can be acquired, by adding this distance and the distance indicated by the distance information, the inspection optical system and the iris are The distance between them can be acquired with high accuracy. Note that the distance between the cornea and the inspection optical system can be obtained by conventional alignment using the alignment optical system 50 shown in FIG.

  Further, by subtracting the distance shown in the distance information from the distance between the iris (pupil) and the inspection optical system acquired as in the first embodiment, the inspection optical system and the cornea (vertex) The distance between is obtained. And it is possible to perform alignment of az direction using this obtained distance.

<Modification>
The configuration described above is merely an example for favorably implementing the present invention. Therefore, arbitrary modifications (omitted, replacement, addition, etc.) within the scope of the present invention can be made as appropriate.

  In the above-described embodiment, the main control unit 211 can display the composite image formed by the image composition unit 233 on the display unit 240A. Thereby, it is possible to observe the three-dimensional form of the anterior segment.

  In the above-described embodiment, the main control unit 211 can cause the display unit 240A to display at least one of two captured images obtained substantially simultaneously by the anterior eye camera 300A and 300B. Thereby, the form of the anterior segment can be observed from different viewpoints (imaging positions).

  If the light used for the examination by the ophthalmologic apparatus 1 is reflected in an image captured by the anterior eye camera 300, there is a risk of affecting image processing on the captured image. For example, light from an LED or SLD mounted on the ophthalmic apparatus 1 has a relatively high intensity, and if this is reflected in a captured image, there is a possibility that image processing cannot be performed suitably. In order to solve this problem, in the above-described embodiment, a filter that blocks light having a wavelength other than the wavelength of the environmental illumination is provided between each of the anterior segment camera 300 (two or more imaging units) and the eye E. It is possible to provide. The environmental lighting means lighting used in an environment where the ophthalmic apparatus 1 is disposed, and for example, lighting installed in a room where the ophthalmic apparatus 1 is installed corresponds to this. Moreover, environmental lighting may contain sunlight. In consideration of the purpose of the configuration, the filter may be configured to block wavelengths that affect imaging by the anterior segment camera 300 among wavelengths included in the environmental illumination. For example, it is possible to configure so as to block wavelength components (such as the output wavelengths of the LED and SLD) used by the ophthalmologic apparatus 1 for examination among wavelengths included in the environmental illumination. As a specific example of the filter, a filter that blocks a wavelength of 900 nm or less can be used. By applying such a configuration, it is possible to obtain a captured image in which a characteristic part (such as a pupil) of the anterior segment is clearly drawn while avoiding the influence of disturbance on the imaging performed by the anterior segment camera 300. Thereby, it is possible to suitably perform analysis processing for specifying a characteristic position (such as the pupil center) from the captured image.

  In the above embodiment, the optical path length difference between the optical path of the signal light LS and the optical path of the reference light LR is changed by changing the position of the optical path length changing unit 41, but this optical path length difference is changed. The method is not limited to this. For example, it is possible to change the optical path length difference by disposing a reflection mirror (reference mirror) in the optical path of the reference light and moving the reference mirror in the traveling direction of the reference light to change the optical path length of the reference light. Is possible. Further, the optical path length difference may be changed by moving the fundus camera unit 2 or the OCT unit 100 with respect to the eye E to change the optical path length of the signal light LS. In particular, when the measured object is not a living body part, the optical path length difference can be changed by moving the measured object in the depth direction (z direction).

  A computer program for realizing the above embodiment can be stored in any recording medium readable by a computer. Examples of the recording medium include a semiconductor memory, an optical disk, a magneto-optical disk (CD-ROM / DVD-RAM / DVD-ROM / MO, etc.), a magnetic storage medium (hard disk / floppy (registered trademark) disk / ZIP, etc.), and the like. Can be used.

  It is also possible to transmit / receive this program through a network such as the Internet or a LAN.

DESCRIPTION OF SYMBOLS 1,1000,1100 Ophthalmology apparatus 2 Fundus camera unit 2A Optical system drive part 10 Illumination optical system 30 Shooting optical system 31 Focusing lens 41 Optical path length change part 42 Galvano scanner 50 Alignment optical system 60 Focus optical system 100 OCT unit 101 Light source unit 105 Optical Attenuator 106 Polarization Adjuster 115 CCD Image Sensor 200 Arithmetic Control Unit 210 Control Unit 211 Main Control Unit 212 Storage Unit 212a Aberration Information 213 Optical System Position Acquisition Unit 220 Image Forming Unit 230 Image Processing Unit 231 Analysis Unit 2311 Image Correction Unit 2312 feature position specifying unit 2313 three-dimensional position calculating unit 2314 movement target position determining unit 232 image determining unit 233 image compositing unit 240A display unit 240B operation unit 300, 300A, 300B anterior eye camera 410 base 420 case 430 lens Housing portion 440 supporting section 440A chin receiving driver 500 proximity detector portion 600 contacts the detection portion E subject eye Ea anterior segment Ef fundus LS signal light LR reference light LC interference light

Claims (4)

An inspection optical system for inspecting the eye;
A driving unit that three-dimensionally moves the inspection optical system relative to the face of the subject;
An imaging unit that images the face including the eye to be examined from two or more different positions;
The photographed image obtained by the photographing unit by photographing from the two or more different positions is analyzed to determine whether an image of the anterior segment of the eye to be examined is included in a predetermined region in the photographed image. An image determination unit;
When the image determination unit determines that the image of the anterior eye part is included in the predetermined region, the captured image obtained by the imaging unit by imaging from the two or more different positions is analyzed. An analysis unit for obtaining a three-dimensional position of the eye to be examined;
An ophthalmologic apparatus comprising: a control unit configured to align the examination optical system with respect to the eye to be examined by controlling the driving unit based on the three-dimensional position acquired by the analysis unit. Including a photographing moving unit for moving the photographing unit;
When the image determination unit determines that the image of the anterior segment is not included in the predetermined region, the control unit moves the imaging unit in a direction away from the face of the subject. Controlling the photographing moving unit;
After the imaging unit is moved in a direction away from the subject's face, the image determination unit determines again whether or not the image of the anterior eye part is included in the predetermined region. The ophthalmic apparatus according to claim 1. Including a photographing moving unit for moving the photographing unit;
When the image determination unit determines that the image of the anterior segment is not included in the predetermined area, the control unit moves the imaging unit in a direction away from the optical axis of the inspection optical system. And controlling the shooting moving unit,
After the imaging unit is moved in a direction away from the optical axis of the inspection optical system, the image determination unit determines again whether or not the image of the anterior eye part is included in the predetermined region. The ophthalmic apparatus according to claim 1. Including a photographing moving unit for moving the photographing unit;
The ophthalmologic according to claim 1, wherein the control unit alternately performs determination by the image determination unit and movement of the imaging unit by the imaging moving unit in order to drive the position of the imaging unit. apparatus.

Images