JP2019154993A - Ophthalmologic apparatus, control method therefor, program, and storage medium - Google Patents

Abstract

To increase the degree of freedom in the observation of a subject eye using a wide-viewing angle OCT image.SOLUTION: An ophthalmologic apparatus according to the exemplary embodiment includes an image acquisition unit, an enlarged image forming unit, a display control unit, and a user interface. The image acquisition unit acquires a cross-sectional image of a subject eye. The enlarged image forming unit forms an enlarged image of a portion of the cross-sectional image. The display control unit causes display means to display the cross-sectional image and the enlarged image. The user interface is used to handle the enlarged image. The display control unit controls the display of the enlarged image on the basis of a signal from the user interface.SELECTED DRAWING: Figure 4A

Description

  The present invention relates to an ophthalmologic apparatus, a control method thereof, a program, and a recording medium.

  In ophthalmic practice, the importance of image diagnosis and image analysis is increasing. In particular, the application of optical coherence tomography (OCT) to ophthalmology has spurred this trend. OCT enables three-dimensional imaging and three-dimensional structure analysis / function analysis of an eye to be examined, and is effective for acquiring distributions of various measurement values, for example.

  In recent years, expansion of the OCT scan range, that is, widening the angle of view of OCT has been promoted. For example, in order to scan a wide range from the center to the periphery of the fundus at a time, an apparatus that has expanded the deflection angle of an optical scanner (galvano mirror, etc.) and optimized the structure, control, and imaging accordingly. Has been developed.

  An image obtained by wide-angle OCT scanning (wide-angle OCT image) has an advantage that a wide range can be drawn at a time, but is not suitable for detailed observation of a local region. For example, in diagnosing the fundus using OCT, it is very important to observe the macular responsible for the majority of visual acuity, but it is difficult to grasp the state of the macular in detail from a wide-angle OCT image.

  For this reason, an enlarged image of the range of interest in the wide-angle-of-view OCT image is displayed together with the wide-angle-of-view OCT image (for example, see Patent Document 1). However, in the conventional technique, the attention range selected by the user can only be enlarged and displayed at a specified magnification and a specified size, and the user cannot freely operate the enlarged image.

Japanese Patent No. 6161237

  An object of the present invention is to improve the degree of freedom in observation of an eye to be examined using a wide-angle OCT image.

  The first aspect of the exemplary embodiment includes an image acquisition unit that acquires a cross-sectional image of an eye to be examined, an enlarged image forming unit that forms an enlarged image of a part of the cross-sectional image, the cross-sectional image, and the enlarged image. And a user interface for operating the enlarged image, and the display control unit performs display control of the enlarged image based on a signal from the user interface. The ophthalmologic apparatus characterized by the above.

  A second aspect of the exemplary embodiment is the ophthalmic apparatus according to the first aspect, and when a magnification change operation is performed using the user interface, the display control unit receives a signal from the user interface. The display magnification of the enlarged image is changed based on the above.

  A third aspect of the exemplary embodiment is the ophthalmologic apparatus according to the first or second aspect, and when a size change operation is performed using the user interface, the display control unit The display size of the enlarged image is changed based on the signal from

  A fourth aspect of the exemplary embodiment is the ophthalmic apparatus according to any one of the first to third aspects, and when a direction change operation is performed using the user interface, the display control unit is The direction of the enlarged image is changed based on a signal from the user interface.

  A fifth aspect of the exemplary embodiment is the ophthalmologic apparatus according to any one of the first to fourth aspects, wherein the enlarged image forming unit specifies an image region corresponding to a predetermined part of the eye to be examined. For this purpose, it includes an analysis unit for analyzing the cross-sectional image, and forms an enlarged image in a range including the image region specified by the analysis unit.

  A sixth aspect of the exemplary embodiment is the ophthalmologic apparatus according to the fifth aspect, and when the analysis unit cannot identify the image region, the enlarged image forming unit associates with the predetermined part in advance. An enlarged image of a range in the cross-sectional image corresponding to the determined position is formed.

  A seventh aspect of the exemplary embodiment is the ophthalmologic apparatus according to the fifth aspect, wherein the enlarged image forming unit forms the cross-sectional image when the analysis unit cannot identify the image region. A range in the cross-sectional image is determined based on a fixation position when a scan for applying to the eye to be examined is performed, and an enlarged image of the range is formed.

  An eighth aspect of the exemplary embodiment is the ophthalmic apparatus according to the fifth aspect, and when the analysis unit cannot identify the image area, the enlarged image forming unit uses the user interface. An enlarged image of a range in the designated cross-sectional image is formed.

  A ninth aspect of the exemplary embodiment is the ophthalmologic apparatus according to any one of the fifth to eighth aspects, wherein the image acquisition unit acquires a fundus cross-sectional image, and the predetermined portion is a macula. The analysis unit applies at least segmentation to the fundus sectional image in order to identify the macular region.

  A tenth aspect of an exemplary embodiment is the ophthalmologic apparatus according to any one of the first to ninth aspects, and the display control unit displays the enlarged image on the cross-sectional image.

  An eleventh aspect of the exemplary embodiment is the ophthalmic apparatus according to the tenth aspect, in which when the position change operation is performed using the user interface, the display control unit receives a signal from the user interface. The display position of the enlarged image is changed based on the above.

  A twelfth aspect of the exemplary embodiment is the ophthalmic apparatus according to any one of the first to ninth aspects, in which the display control unit displays the cross-sectional image and the enlarged image side by side.

  A thirteenth aspect of the exemplary embodiment is the ophthalmologic apparatus according to any one of the first to twelfth aspects, wherein the image acquisition unit applies optical coherence tomography (OCT) to the eye to be examined. A data collecting unit that collects data; and an image forming unit that forms the cross-sectional image based on the data collected by the data collecting unit.

  A fourteenth aspect of an exemplary embodiment is the ophthalmic apparatus according to any one of the first to thirteenth aspects, wherein the image acquisition unit includes an image reception unit that receives the cross-sectional image from an external device or a recording medium. Including.

  A fifteenth aspect of the exemplary embodiment is a method for controlling an ophthalmologic apparatus, the method comprising: obtaining a cross-sectional image of an eye to be examined; forming an enlarged image of a part of the cross-sectional image; A step of displaying an image and the enlarged image on a display unit; and a step of performing display control of the enlarged image in response to an operation by a user.

  A sixteenth aspect of the exemplary embodiment is a program that causes an ophthalmologic apparatus to execute the control method according to the fifteenth aspect.

  A seventeenth aspect of the exemplary embodiment is a computer-readable non-transitory recording medium on which the program of the sixteenth aspect is recorded.

  According to the exemplary embodiment, it is possible to improve the degree of freedom in observing the eye to be examined using the wide-angle OCT image.

It is the schematic showing an example of the structure of the ophthalmic apparatus which concerns on exemplary embodiment. It is the schematic showing an example of the structure of the ophthalmic apparatus which concerns on exemplary embodiment. It is the schematic showing an example of the structure of the ophthalmic apparatus which concerns on exemplary embodiment. It is the schematic showing an example of the structure of the ophthalmic apparatus which concerns on exemplary embodiment. It is the schematic showing an example of the structure of the ophthalmic apparatus which concerns on exemplary embodiment. It is the schematic showing an example of the structure of the ophthalmic apparatus which concerns on exemplary embodiment. It is the schematic showing an example of the structure of the ophthalmic apparatus which concerns on exemplary embodiment. It is a flowchart showing an example of operation | movement of the ophthalmologic apparatus which concerns on exemplary embodiment. It is the schematic for demonstrating an example of operation | movement of the ophthalmologic apparatus which concerns on exemplary embodiment. It is the schematic for demonstrating an example of operation | movement of the ophthalmologic apparatus which concerns on exemplary embodiment. It is the schematic for demonstrating an example of operation | movement of the ophthalmologic apparatus which concerns on exemplary embodiment. It is the schematic for demonstrating an example of operation | movement of the ophthalmologic apparatus which concerns on exemplary embodiment. It is the schematic for demonstrating an example of operation | movement of the ophthalmologic apparatus which concerns on exemplary embodiment. It is the schematic for demonstrating an example of operation | movement of the ophthalmologic apparatus which concerns on exemplary embodiment. It is the schematic for demonstrating an example of operation | movement of the ophthalmologic apparatus which concerns on exemplary embodiment.

  An ophthalmologic apparatus, a control method thereof, a program, and a recording medium according to an exemplary embodiment will be described in detail with reference to the drawings. Any known technique including the disclosure content of the documents cited in the present specification can be incorporated into the embodiments. Further, unless otherwise specified, “image data” and “image” based thereon are not distinguished.

  In the exemplary embodiment, the case of processing an OCT image will be mainly described. An ophthalmologic apparatus according to an exemplary embodiment can measure the fundus of a living eye using Fourier domain OCT (eg, swept source OCT). The type of OCT applicable to the embodiment is not limited to the swept source OCT, and may be, for example, a spectral domain OCT or a time domain OCT. The application target of OCT is not limited to the fundus but may be the anterior segment or vitreous.

  Exemplary embodiments may be able to process images acquired with modalities different from OCT. For example, an image acquired by any one of a fundus camera, an SLO, a slit lamp microscope, and an ophthalmic surgical microscope may be processed. An ophthalmic apparatus according to an exemplary embodiment may include any of a fundus camera, an SLO, a slit lamp microscope, and an ophthalmic surgical microscope.

  The image of the eye to be examined that can be processed according to the exemplary embodiment may include an image obtained by analyzing an image acquired by the modality as described above. Examples of such an analysis image include an image (map, graph, etc.) representing the thickness distribution of the fundus tissue obtained by analyzing the OCT image, an image (map, graph, etc.) representing the curvature distribution of the cornea, and a lesion distribution. An image (map, graph, etc.) representing

<Constitution>
The ophthalmologic apparatus 1 of the exemplary embodiment shown in FIG. 1 includes a front image acquisition unit 2, an OCT unit 100, and an arithmetic control unit 200. The front image acquisition unit 2 is provided with an optical system and a mechanism for acquiring a front image of the eye to be examined. The OCT unit 100 is provided with a part of an optical system and a mechanism for performing OCT. Another part of the optical system and mechanism for performing OCT is provided in the front image acquisition unit 2. The arithmetic control unit 200 includes one or more processors that execute various types of arithmetic operations and controls. In addition to these, optional elements such as a member for supporting the subject's face (chin rest, forehead rest, etc.) and a lens unit for switching the OCT target site (for example, anterior segment OCT attachment) A unit may be provided in the ophthalmic apparatus 1.

  In this specification, the “processor” is, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), or a programmable logic device (eg, SPLD (Simple ProLigL). It means a circuit such as Programmable Logic Device (FPGA) or Field Programmable Gate Array (FPGA). For example, the processor implements the functions according to the embodiment by reading and executing a program stored in a storage circuit or a storage device.

<Front image acquisition unit 2>
The front image acquisition unit 2 is provided with an optical system for photographing the fundus oculi Ef of the eye E to be examined. The acquired image of the fundus oculi Ef (referred to as a fundus oculi image, a fundus oculi photo or the like) is a front image such as an observation image or a captured image. The observation image is obtained by moving image shooting using near infrared light. The captured image is a still image using flash light in the visible region.

  The front image acquisition unit 2 includes an illumination optical system 10 and a photographing optical system 30. The illumination optical system 10 irradiates the eye E with illumination light. The imaging optical system 30 detects the return light of the illumination light from the eye E. The measurement light from the OCT unit 100 is guided to the eye E through the optical path in the front image acquisition unit 2, and the return light is guided to the OCT unit 100 through the same optical path.

  The light (observation illumination light) output from the observation light source 11 of the illumination optical system 10 is reflected by the concave mirror 12, passes through the condensing lens 13, passes through the visible cut filter 14, and becomes near infrared light. Further, the observation illumination light is once converged in the vicinity of the photographing light source 15, reflected by the mirror 16, and passes through the relay lens system 17, the relay lens 18, the stop 19, and the relay lens system 20. The observation illumination light is reflected by the peripheral part of the perforated mirror 21 (region around the hole part), passes through the dichroic mirror 46, and is refracted by the objective lens 22 to illuminate the eye E (fundus Ef). To do. The return light of the observation illumination light from the eye E is refracted by the objective lens 22, passes through the dichroic mirror 46, passes through the hole formed in the central region of the perforated mirror 21, and passes through the dichroic mirror 55. The light is reflected by the mirror 32 via the photographing focusing lens 31. Further, the return light passes through the half mirror 33A, is reflected by the dichroic mirror 33, and forms an image on the light receiving surface of the image sensor 35 by the imaging lens 34. The image sensor 35 detects return light at a predetermined frame rate. Note that the focus of the photographing optical system 30 is adjusted to match the fundus oculi Ef or the anterior eye segment.

  The light (imaging illumination light) output from the imaging light source 15 is applied to the fundus oculi Ef through the same path as the observation illumination light. The return light of the imaging illumination light from the eye E is guided to the dichroic mirror 33 through the same path as the return light of the observation illumination light, passes through the dichroic mirror 33, is reflected by the mirror 36, and is reflected by the imaging lens 37. An image is formed on the light receiving surface of the image sensor 38.

  A liquid crystal display (LCD) 39 displays a fixation target (fixation target image). A part of the light beam output from the LCD 39 is reflected by the half mirror 33 </ b> A, reflected by the mirror 32, passes through the hole of the perforated mirror 21 through the photographing focusing lens 31 and the dichroic mirror 55. The light beam that has passed through the aperture of the aperture mirror 21 passes through the dichroic mirror 46, is refracted by the objective lens 22, and is projected onto the fundus oculi Ef.

  By changing the display position of the fixation target image on the screen of the LCD 39, the fixation position of the eye E to be examined by the fixation target can be changed. Examples of fixation positions include a fixation position for acquiring an image centered on the macula, a fixation position for acquiring an image centered on the optic nerve head, and between the macula and the optic nerve head. There are a fixation position for acquiring an image centered on the center of the fundus, a fixation position for acquiring an image of a part (a fundus peripheral portion) far away from the macula, and the like. A graphical user interface (GUI) or the like for designating at least one of such typical fixation positions can be provided. Further, a GUI or the like for manually moving the fixation position (display position of the fixation target) can be provided.

  The configuration for presenting the fixation target that can change the fixation position to the eye E is not limited to a display device such as an LCD. For example, a fixation matrix in which a plurality of light emitting units (light emitting diodes or the like) are arranged in a matrix (array) can be used instead of the display device. In this case, the fixation position of the eye E by the fixation target can be changed by selectively turning on the plurality of light emitting units. As another example, a fixation target whose fixation position can be changed can be generated by one or more movable light emitting units.

  The alignment optical system 50 generates an alignment index used for alignment of the optical system with respect to the eye E. The alignment light output from the light emitting diode (LED) 51 passes through the diaphragm 52, the diaphragm 53, and the relay lens 54, is reflected by the dichroic mirror 55, passes through the hole of the perforated mirror 21, and passes through the dichroic mirror 46. The light passes through and is projected onto the eye E through the objective lens 22. Return light (corneal reflection light or the like) of the alignment light from the eye E is guided to the image sensor 35 through the same path as the return light of the observation illumination light. Manual alignment and auto-alignment can be executed based on the received light image (alignment index image).

  As in the prior art, the alignment index image of this example is composed of two bright spot images whose positions change depending on the alignment state. When the relative position between the eye E and the optical system changes in the xy direction, the two bright spot images are integrally displaced in the xy direction. When the relative position between the eye E and the optical system changes in the z direction, the relative position (distance) between the two bright spot images changes. When the distance between the eye E to be examined and the optical system in the z direction matches a predetermined working distance, the two bright spot images overlap. When the position of the eye E and the position of the optical system coincide with each other in the xy direction, two bright spot images are presented in or near a predetermined alignment target. If the distance between the eye E and the optical system in the z direction matches the working distance, and the position of the eye E and the position of the optical system match in the xy direction, the two bright spot images overlap and align. Presented in the target.

  In the auto alignment, the data processing unit 230 detects the positions of the two bright spot images, and the main control unit 211 controls a moving mechanism 150 described later based on the positional relationship between the two bright spot images and the alignment target. . In the manual alignment, the main control unit 211 causes the display unit 241 to display two bright spot images together with the observation image of the eye E, and the user uses the operation unit 242 while referring to the two bright spot images displayed. Then, the moving mechanism 150 is operated.

  The focus optical system 60 generates a split index used for focus adjustment with respect to the eye E. The focus optical system 60 is moved along the optical path (illumination optical path) of the illumination optical system 10 in conjunction with the movement of the imaging focusing lens 31 along the optical path (imaging optical path) of the imaging optical system 30. The reflector 67 is inserted into and removed from the illumination optical path. When performing the focus adjustment, the reflecting surface of the reflecting bar 67 is inclinedly arranged in the illumination optical path. The focus light output from the LED 61 passes through the relay lens 62, is separated into two light beams by the split indicator plate 63, passes through the two-hole aperture 64, is reflected by the mirror 65, and is reflected by the condenser lens 66 as a reflecting rod 67. The light is once imaged and reflected on the reflection surface. Further, the focus light passes through the relay lens 20, is reflected by the perforated mirror 21, passes through the dichroic mirror 46, and is projected onto the eye E through the objective lens 22. The return light (fundus reflection light or the like) of the focus light from the eye E is guided to the image sensor 35 through the same path as the return light of the alignment light. Manual focusing and autofocusing can be executed based on the received light image (split index image).

  Diopter correction lenses 70 and 71 can be selectively inserted into the photographing optical path between the perforated mirror 21 and the dichroic mirror 55. The diopter correction lens 70 is a plus lens (convex lens) for correcting the intensity hyperopia. The diopter correction lens 71 is a minus lens (concave lens) for correcting intensity myopia.

  The dichroic mirror 46 combines the fundus imaging optical path and the OCT optical path (measurement arm). The dichroic mirror 46 reflects light in a wavelength band used for OCT and transmits light for fundus photographing. In the measurement arm, a collimator lens unit 40, a retroreflector 41, a dispersion compensation member 42, an OCT focusing lens 43, an optical scanner 44, and a relay lens 45 are provided in this order from the OCT unit 100 side.

  The retro-reflector 41 can be moved in the direction of the arrow shown in FIG. 1, thereby changing the length of the measurement arm. The change of the measurement arm length is used, for example, for optical path length correction according to the axial length, adjustment of the interference state, or the like.

  The dispersion compensation member 42 works together with the dispersion compensation member 113 (described later) disposed on the reference arm so as to match the dispersion characteristics of the measurement light LS and the dispersion characteristics of the reference light LR.

  The OCT focusing lens 43 is moved along the measurement arm to adjust the focus of the measurement arm. The movement of the photographing focusing lens 31, the movement of the focus optical system 60, and the movement of the OCT focusing lens 43 can be controlled in a coordinated manner.

  The optical scanner 44 is substantially disposed at a position optically conjugate with the pupil of the eye E. The optical scanner 44 deflects the measurement light LS guided by the measurement arm. The optical scanner 44 is, for example, a galvano scanner capable of two-dimensional scanning.

<OCT unit 100>
As illustrated in FIG. 2, the OCT unit 100 is provided with an optical system for applying the swept source OCT. This optical system includes an interference optical system. This interference optical system divides the light from the wavelength tunable light source (wavelength sweep type light source) into measurement light and reference light, and superimposes the return light of the measurement light from the eye E and the reference light via the reference light path. In addition, interference light is generated, and this interference light is detected. The detection result (detection signal) obtained by the interference optical system is a signal representing the spectrum of the interference light and is sent to the arithmetic control unit 200.

  The light source unit 101 includes, for example, a near-infrared wavelength tunable laser that changes the wavelength of emitted light at high speed. The light L0 output from the light source unit 101 is guided to the polarization controller 103 by the optical fiber 102 and its polarization state is adjusted. Further, the light L0 is guided to the fiber coupler 105 by the optical fiber 104 and is divided into the measurement light LS and the reference light LR. The optical path of the measurement light LS is called a measurement arm or the like, and the optical path of the reference light LR is called a reference arm or the like.

  The reference light LR is guided to the collimator 111 by the optical fiber 110 to be converted into a parallel light beam, and is guided to the retro-reflector 114 via the optical path length correction member 112 and the dispersion compensation member 113. The optical path length correction member 112 acts to match the optical path length of the reference light LR and the optical path length of the measurement light LS. The dispersion compensation member 113, together with the dispersion compensation member 42 disposed on the measurement arm, acts to match the dispersion characteristics between the reference light LR and the measurement light LS. The retro-reflector 114 is movable along the optical path of the reference light LR incident thereon, thereby changing the length of the reference arm. The change of the reference arm length is used, for example, for optical path length correction corresponding to the axial length, adjustment of the interference state, or the like.

  The reference light LR that has passed through the retroreflector 114 passes through the dispersion compensation member 113 and the optical path length correction member 112, is converted from a parallel light beam to a focused light beam by the collimator 116, and enters the optical fiber 117. The reference light LR incident on the optical fiber 117 is guided to the polarization controller 118 and its polarization state is adjusted. The reference light LR is guided to the attenuator 120 through the optical fiber 119 and the amount of light is adjusted. Led.

  On the other hand, the measurement light LS generated by the fiber coupler 105 is guided by the optical fiber 127 and converted into a parallel light beam by the collimator lens unit 40, and the retroreflector 41, the dispersion compensation member 42, the OCT focusing lens 43, and the optical scanner 44. Then, the light is reflected by the dichroic mirror 46 via the relay lens 45, refracted by the objective lens 22, and projected onto the eye E. The measurement light LS is scattered and reflected at various depth positions of the eye E. The return light from the eye E to be measured LS travels in the opposite direction on the same path as the forward path, is guided to the fiber coupler 105, and reaches the fiber coupler 122 via the optical fiber 128.

  The fiber coupler 122 generates interference light by superimposing the measurement light LS incident through the optical fiber 128 and the reference light LR incident through the optical fiber 121. The fiber coupler 122 generates a pair of interference light LC by branching the generated interference light at a predetermined branching ratio (for example, 1: 1). The pair of interference lights LC are guided to the detector 125 through optical fibers 123 and 124, respectively.

  The detector 125 includes, for example, a balanced photodiode. The balanced photodiode has a pair of photodetectors that respectively detect the pair of interference lights LC, and outputs a difference between a pair of detection results obtained by these. The detector 125 sends this output (detection signal) to the data acquisition system (DAQ) 130.

  A clock KC is supplied from the light source unit 101 to the data collection system 130. The clock KC is generated in synchronization with the output timing of each wavelength that is swept within a predetermined wavelength range by the wavelength variable light source in the light source unit 101. For example, the light source unit 101 divides the light L0 of each output wavelength to generate two branched lights, optically delays one of the branched lights, synthesizes the branched lights, and combines the obtained synthesized lights. The clock KC is generated based on the detection result. The data acquisition system 130 performs sampling of the detection signal input from the detector 125 based on the clock KC. The data collection system 130 sends the sampling result to the arithmetic and control unit 200.

  In this example, both an element for changing the measurement arm length (for example, the retroreflector 41) and an element for changing the reference arm length (for example, the retroreflector 114 or the reference mirror) are provided. However, only one element may be provided. In addition, elements for changing the difference (optical path length difference) between the measurement arm length and the reference arm length are not limited to these, and may be arbitrary elements (optical members, mechanisms, etc.).

<Control system>
A configuration example of the control system of the ophthalmologic apparatus 1 is shown in FIGS. The control unit 210, the image forming unit 220, and the data processing unit 230 are provided in the arithmetic control unit 200, for example. Further, the control system may include a communication device for performing data communication with an external device. Further, the control system may include a drive device (reader / writer) for performing a process of reading data recorded on the recording medium and a process of writing data to the recording medium.

<Control unit 210>
The control unit 210 executes various controls. The control unit 210 includes a main control unit 211 and a storage unit 212.

<Main control unit 211>
The main control unit 211 includes a processor, and controls each element of the ophthalmologic apparatus 1 (including the elements shown in FIGS. 1 to 4D).

  The imaging focusing lens 31 arranged in the imaging optical path and the focus optical system 60 arranged in the illumination optical path are moved by the imaging focusing drive unit 31A under the control of the main control unit 211. The retro-reflector 41 provided in the measurement arm is moved by the retro-reflector (RR) drive unit 41A under the control of the main control unit 211. The OCT focusing lens 43 arranged on the measurement arm is moved by the OCT focusing driving unit 43A under the control of the main control unit 211. The optical scanner 44 provided in the measurement arm operates under the control of the main control unit 211. The retro-reflector 114 arranged on the reference arm is moved by the retro-reflector (RR) driving unit 114A under the control of the main control unit 211. Each of the drive units described above includes an actuator such as a pulse motor that operates under the control of the main control unit 211.

  For example, the moving mechanism 150 moves at least the front image acquisition unit 2 in a three-dimensional manner. In a typical example, the moving mechanism 150 includes an x stage that can move in the ± x direction (left and right direction), an x moving mechanism that moves the x stage, and a y stage that can move in the ± y direction (up and down direction). , A y moving mechanism for moving the y stage, a z stage movable in the ± z direction (depth direction), and a z moving mechanism for moving the z stage. Each of these moving mechanisms includes an actuator such as a pulse motor that operates under the control of the main control unit 211.

<Storage unit 212>
The storage unit 212 stores various data. Examples of data stored in the storage unit 212 include OCT images, fundus images, and eye information. The eye information includes subject information such as patient ID and name, left / right eye identification information, electronic medical record information, and the like.

<Display control unit 213>
The display control unit 213 performs control for displaying information on the display unit 241 of the user interface 240. The processing executed by the display control unit 213 will be described later. The display control unit 213 is included in the main control unit 211.

<Storage control unit 214>
The storage control unit 214 performs control for storing the image of the eye E to be stored in the storage unit 212. Processing executed by the storage control unit 214 will be described later. The storage control unit 214 is included in the main control unit 211.

<Image forming unit 220>
The image forming unit 220 includes a processor, and forms OCT image data of the fundus oculi Ef based on a signal (sampling data) input from the data acquisition system 130. The OCT image data is, for example, B scan image data (two-dimensional tomographic image data).

  The process for forming the OCT image data includes noise removal (noise reduction), filter processing, fast Fourier transform (FFT), and the like, as in the conventional Fourier domain OCT. In the case of another type of OCT apparatus, the image forming unit 220 executes a known process corresponding to the type.

  The image forming unit 220 forms three-dimensional data of the fundus oculi Ef based on the signal input from the data collection system 130. This three-dimensional data is three-dimensional image data representing a three-dimensional region (volume) of the fundus oculi Ef. This three-dimensional image data means image data in which pixel positions are defined by a three-dimensional coordinate system. Examples of 3D image data include stack data and volume data.

  The stack data is image data obtained by three-dimensionally arranging a plurality of tomographic images obtained along a plurality of scanning lines based on the positional relationship of the scanning lines. That is, the stack data is an image obtained by expressing a plurality of tomographic images originally defined by individual two-dimensional coordinate systems using one three-dimensional coordinate system (that is, embedding in one three-dimensional space). It is data. Alternatively, the stack data is obtained by three-dimensionally arranging a plurality of A scan data respectively obtained for a plurality of scanning points (scanning point array) arranged two-dimensionally based on the positional relationship of the scanning points. Image data.

  Volume data is image data in which voxels arranged three-dimensionally are used as pixels, and is also called voxel data. Volume data is formed by applying interpolation processing, voxelization processing, or the like to stack data.

  The image forming unit 220 renders the three-dimensional image data to form a display image. Examples of applicable rendering methods include volume rendering, surface rendering, maximum value projection (MIP), minimum value projection (MinIP), and multi-section reconstruction (MPR).

  The image forming unit 220 can form an OCT front image (OCT en-face image) based on the three-dimensional image data. For example, the image forming unit 220 can construct projection data by projecting three-dimensional image data in the z direction (A line direction, depth direction). Further, the image forming unit 220 can construct a shadowgram by projecting a part of the three-dimensional image data in the z direction.

  The partial three-dimensional image data projected to construct the shadowgram is set using, for example, segmentation. Segmentation is a process for specifying a partial region in an image. Typically, the segmentation is used to specify an image region corresponding to a predetermined tissue of the fundus oculi Ef. The segmentation is executed by the image forming unit 220 or the data processing unit 230, for example.

<Data processing unit 230>
The data processing unit 230 includes a processor and applies various types of data processing to the image of the eye E. For example, the data processing unit 230 may be able to execute various correction processes such as brightness correction and dispersion correction.

  The data processing unit 230 can perform registration (registration) between two images acquired for the fundus oculi Ef. For example, the data processing unit 230 can perform registration between the three-dimensional image data acquired by OCT and the front image acquired by the front image acquisition unit 2. In addition, the data processing unit 230 can perform registration between two OCT images acquired by OCT. In addition, the data processing unit 230 can perform registration between the two front images acquired by the front image acquisition unit 2. It is also possible to apply registration to the analysis result of the OCT image and the analysis result of the front image. The registration can be executed by a known method, and includes, for example, feature point extraction and affine transformation.

  The data processing unit 230 includes, for example, a partial area setting unit 231 and an enlarged image forming unit 232.

  Although details will be described later, the ophthalmologic apparatus 1 acquires a cross-sectional image of the eye E, forms a partial enlarged image of the cross-sectional image, and causes the display unit 241 to display the cross-sectional image and the enlarged image. . Here, this cross-sectional image is typically a wide-angle OCT image. The display mode of the cross-sectional image and the enlarged image may be arbitrary. For example, the cross-sectional image and the enlarged image can be displayed side by side, or the enlarged image can be displayed on the cross-sectional image. The partial area setting unit 231 operates when displaying an enlarged image on a cross-sectional image. The enlarged image forming unit 232 forms an enlarged image from the cross-sectional image. Hereinafter, it is assumed that the cross-sectional image is a wide-angle OCT image.

<Partial area setting unit 231>
When displaying a part of the enlarged image on the wide-angle OCT image, the partial area setting unit 231 sets a partial area of the wide-angle OCT image. The display control unit 213 displays an enlarged image on the partial area set by the partial area setting unit 231. As described above, the partial region setting unit 231 sets a region in the wide-angle OCT image on which the enlarged image is displayed.

  The partial area setting unit 231 can automatically set a partial area in the wide-angle OCT image. A configuration example of the partial area setting unit 231 for automatic setting is shown in FIGS. 4B and 4C.

  4B includes a region-of-interest specifying unit 2311A and a setting unit 2312A. The region of interest specifying unit 2311A analyzes the wide-angle OCT image and specifies the region of interest. The setting unit 2312A sets a partial region in which the enlarged image is displayed outside the region of interest specified by the region of interest specifying unit 2311A.

  The region of interest is, for example, an image region corresponding to a predetermined part of the eye or a predetermined tissue set in advance. The region-of-interest specifying unit 2311A may be able to execute arbitrary image processing and data processing such as segmentation, threshold processing, edge detection, pattern matching, and labeling.

  An example of processing executed by the region of interest specifying unit 2311A will be described. It is assumed that the wide-angle-of-view OCT image is a cross-sectional image (B-scan image) of the fundus oculi Ef. In general, cross-sectional images obtained by OCT scanning with the fundus imaged include not only image regions corresponding to the retina and choroid, but also image regions corresponding to the vitreous body (vitreous region) and regions outside the eyeball. Corresponding image areas (out-eye areas) are also included. While the retina and choroid are typical observation objects, the vitreous body and the external position of the eyeball are rarely the observation objects. That is, the retina region and the choroid region are typical regions of interest, and the vitreous region and the extraocular region are typical non-interest regions. The region-of-interest specifying unit 2311A specifies at least one of the retinal region and the choroid region, for example, by analyzing a cross-sectional image obtained by an OCT scan using the fundus oculi Ef as an imaging target.

  In the first example, the region-of-interest specifying unit 2311A specifies an image region corresponding to the inner boundary membrane (ILM) by using segmentation. The setting unit 2312A sets a partial region in which an enlarged image is displayed in an image region (that is, a vitreous region or the like) on the cornea side (−z side) of the inner boundary membrane region specified by the region of interest specifying unit 2311A. can do. The specification of the retinal region includes specification of the boundary of the retinal region, such as specification of the inner boundary membrane region.

  In the second example, the region-of-interest specifying unit 2311A specifies an image region corresponding to the sclera by using segmentation. The setting unit 2312A can set a partial region in which an enlarged image is displayed in an image region (that is, a region outside the eyeball) on the back side (+ z side) of the sclera region specified by the region-of-interest specifying unit 2311A. it can.

  In the third example, the region-of-interest specifying unit 2311A specifies an image region corresponding to the choroid by using segmentation. The setting unit 2312A sets a partial region in which an enlarged image is displayed in an image region (that is, the sclera region and the extraocular region) on the back side (+ z side) of the choroid region specified by the region-of-interest specifying unit 2311A. can do.

  In the fourth example, the region-of-interest specifying unit 2311A specifies an image region corresponding to the retinal pigment epithelium (RPE) by using segmentation. The setting unit 2312A displays an enlarged image in an image region (that is, the choroid region, the sclera region, and the extraocular region) on the back side (+ z side) of the retinal pigment epithelium region specified by the region-of-interest specifying unit 2311A. Can be set.

  In the fifth example, the region-of-interest specifying unit 2311A specifies an image region corresponding to the Bruch's film by using segmentation. The setting unit 2312A displays an enlarged image in an image region (that is, the choroid region, the sclera region, and the extraocular region) on the back side (+ z side) of the Bruch's membrane region specified by the region-of-interest specifying unit 2311A. A partial area can be set.

  In the sixth example, the region-of-interest specifying unit 2311A uses the segmentation to perform the first region (for example, inner boundary membrane region) and the second region (for example, sclera region, choroid region, retinal pigment epithelium region). Or Bruch's film region). The setting unit 2312A displays an enlarged image outside an image region (for example, a retinal region, a choroid region, or a retinal choroid region) defined by the first region and the second region specified by the region-of-interest specifying unit 2311A. The partial area to be displayed can be set.

  In the seventh example, the region-of-interest specifying unit 2311A specifies an image region corresponding to the macula and / or the optic nerve head by using segmentation. The setting unit 2312A can set a partial region in which an enlarged image is displayed outside the image region specified by the region-of-interest specifying unit 2311A.

  The partial region setting unit 231B illustrated in FIG. 4C includes a non-interest region specifying unit 2311B and a setting unit 2312B. The non-region-of-interest specifying unit 2311B analyzes the wide-angle OCT image and specifies the non-region of interest. The setting unit 2312B sets a partial region in which the enlarged image is displayed inside the non-interest region specified by the non-interest region specifying unit 2311B.

  The non-interest region is typically a vitreous region or an extraocular region. The non-interest region specifying unit 2311B may be capable of executing arbitrary image processing and data processing such as segmentation, threshold processing, edge detection, pattern matching, and labeling. The identification of the non-interest region using the segmentation can be performed in the same manner as the above-described region-of-interest specification example.

  As another example, the non-interest region specifying unit 2311B can refer to the luminance, spatial frequency, size, and shape of the image region. For example, a connected image region having a brightness lower than the threshold and an area equal to or larger than the threshold can be specified as the non-interest region. In addition, a connected image region having a spatial frequency lower than the threshold and having a width equal to or larger than the threshold can be specified as the non-interest region. In addition, a connected image region that is convex toward the + z direction and has a width equal to or larger than a threshold value can be specified as a non-interest region (vitreous region). In addition, a connected image region that is concave in the −z direction and has a width equal to or larger than a threshold value can be specified as a non-interest region (outer eye region).

  The setting unit 2312B sets a partial region in which the enlarged image is displayed inside the non-interest region specified by the non-interest region specifying unit 2311B in this way.

  In addition to or instead of the automatic setting as described above, the partial area may be set manually or semi-automatically.

  In the case of manual setting, for example, the display control unit 213 causes the display unit 241 to display a wide-angle OCT image. The user designates a desired area in the displayed wide-angle OCT image using the operation unit 242. This designation operation may be a drag operation, for example. The partial area setting unit 231 sets an area designated by the user as a partial area where an enlarged image is displayed. For example, when the user performs an operation so as to surround the vitreous region in the wide-angle OCT image, the partial region setting unit 231 can set the vitreous region as a partial region where the enlarged image is displayed. .

  In the case of semi-automatic setting, for example, the display control unit 213 causes the display unit 241 to display a wide-angle OCT image. The user designates a desired position in the displayed wide-angle OCT image using the operation unit 242. This designation operation may be, for example, a click operation or a drag operation. For example, the partial region setting unit 231 specifies a connected image region including a position designated by the user by region growing or the like. The partial area setting unit 231 sets the connected image area specified in this way as a partial area where an enlarged image is displayed. For example, when the user designates a position in the vitreous region in the wide-angle OCT image, the partial region setting unit 231 specifies the vitreous region including the designated position and sets the partial image as the partial region in which the enlarged image is displayed. Can be set.

<Enlarged image forming unit 232>
The enlarged image forming unit 232 processes the wide field angle OCT image to form an enlarged image. For example, the enlarged image forming unit 232 can form an enlarged image by trimming and enlarging a part of the wide-angle OCT image.

  A configuration example of the enlarged image forming unit 232 is shown in FIG. 4D. The enlarged image forming unit 232A according to this example includes an analyzing unit 2321A and an enlarged range setting unit 2322A.

  The analysis unit 2321A analyzes the wide-angle OCT image in order to specify an image region corresponding to a predetermined part of the eye E. The enlarged range setting unit 2322A sets a range including the image region specified by the analysis unit 2321A. The enlarged image forming unit 232 trims the range set by the enlarged range setting unit 2322A and forms the enlarged image. Thus, the range set by the enlarged range setting unit 2322A is a range (enlarged range) in the wide-angle OCT image expressed as an enlarged image.

  When a wide-angle-of-view OCT image of the fundus oculi Ef is obtained, for example, the analysis unit 2321A analyzes the wide-angle-of-view OCT image and identifies an image region (macular region) corresponding to the macula. This analysis may include arbitrary image processing and data processing such as segmentation, threshold processing, edge detection, pattern matching, and labeling as in the above-described region of interest specification. Typically, the analysis to identify the macular region includes segmentation.

  The enlargement range setting unit 2322A sets the enlargement range so as to include the macular region specified by the analysis unit 2321A. The enlarged range has, for example, a predetermined shape and a predetermined dimension. Typically, the enlarged range may be a rectangular area with default dimensions. The enlarged range is set, for example, so that the macular region is arranged at the center thereof.

  It is possible to arbitrarily set the shape and dimensions of the enlarged range. In addition, it is possible to arbitrarily set the positional relationship between the image area specified by the analysis unit 2321A and the enlargement range. Further, only a part of the image area specified by the analysis unit 2321A may be included in the enlarged range.

  The analysis unit 2321A may specify an image region corresponding to a part other than the macula. For example, the analysis unit 2321A may be configured to be able to execute an analysis for specifying an image region corresponding to an arbitrary part of the eye to be examined, such as an optic disc, a blood vessel, a lesioned part, or a treatment mark.

  It is also assumed that the analysis unit 2321A fails to specify a macular region (or an image region corresponding to another part). In this case, the enlarged range setting unit 2322A can set the range in the wide-angle OCT image corresponding to the position associated with the macula (or other part) in advance as the enlarged range.

  For example, in many cases, a wide-angle OCT image is acquired by a fundus scan centered on the macula. Considering this, the enlargement range setting unit 2322A may be configured to set a range including the center position of the wide-angle OCT image as the enlargement range.

  Typically, the wide-angle-of-view OCT image is an image representing a two-dimensional space (two-dimensional cross section) spanned by the z direction (axial scan direction) and a direction orthogonal to the z direction (lateral scan direction). The enlargement range setting unit 2322A can set a range including the center position in the horizontal scan direction as the enlargement range. Similarly, in the axial scan direction, a range including the center position in the axial scan direction can be set as an enlarged range.

  For the axial scan direction, the enlargement range is determined based on the focus position (position of the OCT focusing lens 43) and the coherence gate position when the fundus scan for acquiring the wide-angle OCT image is applied to the eye E. It may be set.

  Further, the enlargement range setting unit 2322A can determine the position of the enlargement range by analyzing the wide-angle OCT image. For example, the pixel having the largest z coordinate value among the pixels constituting the inner boundary film region (that is, the pixel at the deepest position in the inner boundary film region) is specified, and the enlarged range is set so as to include the specified pixel. You may make it set. Alternatively, a position having the highest image quality evaluation value in the wide-angle OCT image may be specified, and the enlarged range may be set so as to include this position.

  As another example of processing that can be performed when the analysis unit 2321A cannot identify a macular region (or an image region corresponding to another region), the enlarged range setting unit 2322A forms a wide-angle-of-view OCT image. Therefore, the enlargement range can be determined based on the fixation position when the scan for the eye E is applied to the eye E.

  For example, when trying to identify a macular region from a wide-angle OCT image based on data collected by applying a fixation position corresponding to the macula, the enlarged range setting unit 2322A determines the center position of the wide-angle OCT image. The enlargement range can be set to include. More generally, when a fixation position corresponding to a certain part is applied and the image region corresponding to the part is a specific target, the enlargement range setting unit 2322A includes the center position of the wide-angle OCT image. An enlargement range can be set.

  On the other hand, when the fixation position corresponding to the first part is applied and the image region corresponding to the second part is a specific target, the enlarged range setting unit 2322A deviates from the first part. Based on the position, the position of the enlargement range in the wide-angle OCT image can be determined. For example, when trying to specify a macular region from a wide-angle OCT image based on data collected by applying a fixation position corresponding to the optic disc, the enlarged range setting unit 2322A determines the deviation of the macula from the optic disc. Based on this, the position of the enlargement range in the wide-angle OCT image can be determined. Here, the deviation of the macular relative to the optic disc is, for example, based on the positional relationship between the optic disc and the macula in a standard eye, or the optic disc identified from images acquired in the past for the eye E to be examined. It is determined based on the positional relationship with the macula.

  As still another example of processing that can be executed when the analysis unit 2321A cannot identify a macular region (or an image region corresponding to another region), the operation mode of the expansion range setting unit 2322A is automatically set to the expansion range. It is possible to switch from the mode set in the mode to the mode set manually. In the manual setting mode, the display control unit 213 causes the display unit 241 to display a wide field angle OCT image. The user uses the user interface 240 to specify a desired range for the displayed wide-angle OCT image. The enlarged range setting unit 2322A sets the range designated by the user as the enlarged range.

<User interface 240>
The user interface 240 includes a display unit 241 and an operation unit 242. The display unit 241 includes the display device 3. The operation unit 242 includes various operation devices and input devices. The user interface 240 may include a device such as a touch panel in which a display function and an operation function are integrated. Embodiments that do not include at least a portion of the user interface 240 can also be constructed. For example, the display device may be an external device connected to the ophthalmologic photographing apparatus.

<Operation>
The operation of the ophthalmologic apparatus 1 will be described. It should be noted that preparatory processes similar to those in the past, such as patient ID input, fixation target presentation, fixation position adjustment, alignment, focus adjustment, and OCT optical path length adjustment, have already been performed.

  First, an example of the operation of the ophthalmologic apparatus 1 for displaying a wide-angle OCT image and an enlarged image will be described with reference to FIG.

(S1: Wide-angle OCT scan applied to the fundus)
First, the ophthalmologic apparatus 1 applies a wide field angle OCT scan to the fundus oculi Ef. This wide field angle OCT scan may be a line scan or a three-dimensional scan. This line scan may be, for example, a scan along a line having a length of 9 mm or 12 mm. This three-dimensional scan may be, for example, a raster scan for an area having dimensions of 9 mm × 9 mm, 9 mm × 12 mm, or 12 mm × 12 mm. Note that the aspect of the wide field angle OCT scan is not limited to these.

(S2: Acquire frontal fundus image by fundus photography)
Next, the ophthalmologic apparatus 1 photographs the fundus oculi Ef by the front image acquisition unit 2. Thereby, a front fundus image is obtained.

(S3: Form wide-angle OCT image)
The image forming unit 220 forms a wide field angle OCT image of the fundus oculi Ef based on the data collected by the wide field angle OCT scan in step S1.

  When the line scan is applied in step S1, the image forming unit 220 forms a B scan image. When the 3D scan is applied in step S1, the image forming unit 220 forms 3D image data, and further renders the 3D image. This rendered image is, for example, a B-scan image. The wide-angle OCT image formed in step S3 is stored in the storage unit 212.

(S4: Display wide-angle OCT image and front fundus image)
The display control unit 213 causes the display unit 241 to display the wide-angle OCT image formed in step S3 and the front fundus image acquired in step S2.

  An example of the image displayed in step S4 is shown in FIG. The display unit 241 is provided with an OCT image display area 241a and a front image display area 241b. The display control unit 213 displays the wide-angle OCT image G1 formed in step S3 in the OCT image display area 241a. Further, the display control unit 213 displays the front fundus image G2 acquired in step S2 in the front image display area 241b. The layout of the display screen is arbitrary.

(S5: Set a partial area of the wide-angle OCT image)
The partial area setting unit 231 sets a partial area of the wide-angle OCT image formed in step S3. This partial area is an area where the enlarged image is superimposed and displayed in the subsequent processing. Note that if the wide-angle OCT image and the enlarged image are displayed side by side, it is not necessary to execute step S5.

  In the example illustrated in FIG. 7, an image region (fundus region) G11 corresponding to the fundus oculi Ef (for example, the retina and choroid) in the wide-angle OCT image G1 is the region of interest.

  When the partial region setting unit 231A illustrated in FIG. 4B is applied, the region-of-interest specifying unit 2311A specifies the fundus region G11, and the setting unit 2312A sets a partial region outside the specified fundus region G11. The partial area to be set is one or all of a part or the whole of the image area G12 located on the −z side of the fundus area G11 and a part or the whole of the image area G13 located on the + z side of the fundus area G11. Both.

  When the partial region setting unit 231B illustrated in FIG. 4C is applied, the region-of-interest specifying unit 2311B specifies an image region different from the fundus region G11. The specified image region is one or all of a part or the whole of the image region G12 located on the −z side of the fundus region G11 and a part or the whole of the image region G13 located on the + z side of the fundus region G11. Both. The setting unit 2312B sets a partial region inside the image region specified by the region-of-interest specifying unit 2311B (that is, a part or the whole of the specified image region).

(S6: Set the expansion range of the wide-angle OCT image)
The enlarged image forming unit 232 sets an enlarged range that is a part of the wide field angle OCT image formed in step S3. The setting of the enlargement range may be performed automatically or manually as described above.

(S7: forming an enlarged image)
The enlarged image forming unit 232 forms an enlarged image representing the enlarged range set in step S6. This process includes, for example, a process of trimming the enlargement range set in step S6 and a process of enlarging the image extracted by the trimming.

  When the macular G14 shown in FIG. 8 is an enlargement target, as shown in FIG. 9, an image region (macular region) G15 surrounding the macular G14 is set as an enlargement range in step 6, and the macular region G15 is trimmed in step S7. The enlarged image is formed.

(S8: An enlarged image is displayed on the wide-angle OCT image)
The display control unit 213 displays the enlarged image formed in step S7 on the partial area set in step S5.

  For example, as shown in FIG. 10, the display control unit 213 displays the enlarged image G16 of the macular region G15 formed in step S7 on the partial region (for example, the image region G12) set in step S5. Can do. Further, the display control unit 213 can display an image (enlarged range image) G17 indicating a region (that is, a macular region G15 that is an enlarged range) in the wide-angle OCT image G1 corresponding to the enlarged image G16.

  The display control unit 213 can change the display size of the enlarged image G <b> 16 based on the size of the partial region set by the partial region setting unit 231. The dimensions of the partial region may be defined by arbitrary parameters such as area, height (dimension in the z direction), width (dimension in the direction perpendicular to the z direction), diagonal length, and perimeter length. In addition, in the display size change control of the enlarged image G16, the display control unit 213 can change the shape of the partial region, the shape of the outer edge of the enlarged image, and the like.

  As a typical example, the display control unit 213 can display the enlarged image G16 with the maximum display size included in the partial region G12.

  As illustrated in FIG. 11, the display control unit 213 may display the enlarged image G18 so that only a part of the enlarged image G18 is positioned on the partial region G12. In other words, the display control unit 213 may display the enlarged image G18 so as to protrude from the partial region G12. Furthermore, the display control unit 213 can display an image (enlarged range image) G19 indicating an area in the wide-angle OCT image G1 corresponding to the enlarged image G16.

(S9: Change the expansion range?)
The user can observe the wide-angle-of-view OCT image, the enlarged image, and the front fundus image displayed on the display unit 241. The user can arbitrarily change the area (enlarged range) of the wide-angle OCT image displayed as the enlarged image. When the enlargement range is changed (S9: Yes), the process of this operation example moves to step S10. When the enlargement range is not changed (S9: No), this operation example ends.

(S10: The user specifies the enlargement range)
The user can change the enlargement range. That is, a new enlargement range can be designated.

  An operation for designating the enlargement range is performed using the user interface 240. This operation may be, for example, a drag operation surrounding a desired region in the wide-angle OCT image.

  When the enlarged range image G17 shown in FIG. 10 (or the enlarged range image G19 shown in FIG. 11 or the like) is displayed, the enlarged range image G17 may be operable. For example, the user can perform an operation of moving the enlarged range image G17 and an operation of changing the size and shape of the enlarged range image G17 using the user interface 240. The operation on the enlarged range image G17 may be a drag operation, for example. Alternatively, the enlarged range image G17 may be operated using a cursor key, a mouse wheel, a dedicated GUI, or the like.

(S11: forming a new enlarged image)
When a new enlarged range is designated in step S10, the enlarged image forming unit 232 forms a new enlarged image representing the new enlarged range.

(S12: Display a new enlarged image)
The display control unit 213 causes the display unit 241 to display the new enlarged image formed in step S11.

  At this time, the display control unit 213 may display the new enlarged image formed in step S11 instead of the enlarged image displayed in step S8. That is, the display control unit 213 may update the enlarged image displayed in step S8 with the new enlarged image formed in step S11.

  Alternatively, the display control unit 213 may display the new enlarged image formed in step S11 without controlling the enlarged image displayed in step S8. For example, two enlarged images may be displayed on the display unit 241. The number of enlarged images that can be displayed in parallel may be arbitrary.

  As another example, the display control unit 213 may display both the enlarged image and the new enlarged image while controlling the enlarged image displayed in step S8. For example, the new enlarged image formed in step S11 can be displayed while changing the display position, display size, and the like of the enlarged image displayed in step S8.

  The user can arbitrarily change the display mode of the enlarged image. The user interface 240 includes a GUI for changing the display position, magnification, display size, orientation, and the like of the enlarged image.

  The display position of the enlarged image is changed, for example, by dragging the display area (for example, display window) of the enlarged image. Alternatively, the display position of the enlarged image can be configured to be moved up, down, left, and right using a cursor key. Further, when changing the display position of the enlarged image on the wide-angle OCT image, the enlarged image may be moved, or the wide-angle OCT image may be moved. That is, the change in the display position between the wide-angle OCT image and the enlarged image may be a change in the relative display position.

  Changing the magnification of the enlarged image corresponds to changing the range of the wide-angle OCT image cut out as the enlarged image. The change of the enlargement range is, for example, designation of a range in the wide-angle OCT image by an operation of the enlargement range image or the like, and is performed using a mouse (for example, drag operation, mouse wheel operation), cursor keys, GUI, or the like. Is called. Typically, in order to designate a rectangular region having a desired position and size as an enlargement range, a diagonal line of the rectangular region can be designated by a drag operation.

  The change of the display size of the enlarged image is an operation of changing the size of the display area (for example, display window) of the enlarged image. For example, a mouse (for example, drag operation, mouse wheel operation), a cursor key, a GUI, etc. Done with.

  Here, the change of magnification changes the enlargement range without changing the dimensions of the display window, and the change of display dimension changes the dimensions of the display window without changing the enlargement range.

  It is possible to combine a change in magnification and a change in display dimensions. For example, it is possible to perform manual operation or automatic operation on the enlarged image, such as changing the enlargement range while changing the size of the display window.

  The change of the direction of the enlarged image corresponds to a rotation operation of the enlarged image, and is performed using, for example, a mouse (for example, drag operation, mouse wheel operation), a cursor key, a GUI, or the like.

  By applying such various operations to the enlarged image, the user can observe the local state in detail with the enlarged image while observing a wide range with the wide-angle OCT image.

  When the user performs an image storage operation using the operation unit 242, the storage control unit 214 stores the wide-angle OCT image and the enlarged image displayed on the display unit 241 in the storage unit 212. When the enlarged image is displayed on the wide-angle OCT image, the storage control unit 214 can save the wide-angle OCT image and the enlarged image in the storage unit 212 as a single image.

  For example, when an image storage operation is performed in the display state shown in FIG. 10, the storage control unit 214 displays the wide-angle OCT image G1 and the enlarged image G16 displayed in the OCT image display area 241a as shown in FIG. Is saved as a single image G3. The image G3 may include an image showing an enlarged range.

  As shown in FIG. 11, when the image saving operation is performed when the enlarged image G18 is protruding from the OCT image display area 241a, the saving control unit 214 adjusts the position, size, shape, etc. of the enlarged image G18, for example. Thus, the enlarged image G18 can be arranged in the OCT image display area 241a. At this time, the enlarged image G18 may be arranged outside the region of interest. After such processing, the storage control unit 214 can store the wide-angle-of-view OCT image G1 and the enlarged image G18 as a single image.

<Action and effect>
The operation and effect of the exemplary embodiment will be described.

  The ophthalmologic apparatus (1) according to an exemplary embodiment includes an image acquisition unit, an enlarged image forming unit (232), a display control unit (213), and a user interface (240). The image acquisition unit acquires a cross-sectional image of the eye to be examined. The enlarged image forming unit forms an enlarged image of a part of the cross-sectional image. The display control unit displays the cross-sectional image and the enlarged image on the display means. The user interface is used to operate this enlarged image. The display control unit performs display control of the enlarged image based on a signal from the user interface.

  In the ophthalmologic apparatus according to the exemplary embodiment, the image acquisition unit is a data collection unit (OCT unit 100, a measurement arm in the front image acquisition unit 2, etc.) that collects data by applying OCT to the eye to be examined (E). And an image forming unit (220) that forms a cross-sectional image (wide angle-of-view OCT image) based on the data collected by the data collecting unit.

  In the ophthalmologic apparatus according to the exemplary embodiment, the image acquisition unit may include an image reception unit that receives a cross-sectional image from an external device or a recording medium. The image reception unit may include, for example, any of the communication device and the drive device (reader / writer) described above.

  The number of enlarged images formed by the enlarged image forming unit may be an arbitrary number of 1 or more. When two or more enlarged images are formed, the display control unit can display at least one of them. For example, the display control unit can display two or more enlarged images side by side. Further, the display control unit can selectively display an enlarged image from two or more enlarged images. The display control unit may be configured to display thumbnails of two or more enlarged images side by side and display an enlarged image corresponding to the thumbnail in response to any one of the thumbnails being specified. .

  According to such an exemplary embodiment, in addition to observing a wide range with a wide-angle OCT image and observing a local region in detail with the enlarged image, the user can arbitrarily display the enlarged image in a display mode. It is possible to operate. As a result, it is possible to improve the degree of freedom in observing the subject's eye using the wide-angle OCT image.

  In the exemplary embodiment, when a magnification change operation is performed using the user interface, the display control unit can change the display magnification of the enlarged image based on a signal from the user interface.

  Thereby, the user can arbitrarily change the magnification of the enlarged image (that is, the range in the wide-angle OCT image displayed as the enlarged image). The magnification changing operation is performed using, for example, a mouse, a cursor key, a GUI, and the like.

  In the exemplary embodiment, when a size change operation is performed using the user interface, the display control unit can change the display size of the enlarged image based on a signal from the user interface.

  Accordingly, the user can arbitrarily change the display size of the enlarged image (that is, the size of the window in which the enlarged image is displayed). The dimension changing operation is performed using, for example, a mouse, a cursor key, a GUI, and the like.

  In the exemplary embodiment, when the orientation change operation is performed using the user interface, the display control unit can change the orientation of the enlarged image based on a signal from the user interface.

  Thereby, the user can arbitrarily change the display direction of the enlarged image. The direction changing operation is performed using, for example, a mouse, a cursor key, a GUI, or the like.

  In the exemplary embodiment, the enlarged image forming unit may include an analysis unit (2321A). An analysis part analyzes the cross-sectional image acquired by the image acquisition part, in order to identify the image area | region corresponded to the predetermined site | part (for example, macular) of the eye to be examined. The enlarged image forming unit can form an enlarged image in a range including the image region specified by the analyzing unit.

  As a result, it is possible to automatically detect an image corresponding to the target region of the eye to be examined and form an enlarged image thereof.

  In an exemplary embodiment, when the analysis unit fails to specify an image region corresponding to a predetermined portion of the eye to be examined, the enlarged image forming unit is configured to display a cross-sectional image corresponding to a position previously associated with the predetermined portion. An enlarged image of the range can be formed.

  As a result, when an image region corresponding to the target region of the eye to be examined cannot be automatically detected, an enlarged image in a range corresponding to the target region can be automatically formed. The user can observe the site of interest in detail by performing an operation on the enlarged image.

  In an exemplary embodiment, when the analysis unit fails to specify an image region corresponding to a predetermined part of the eye to be examined, the enlarged image forming unit is configured to display a scan when a scan for forming a cross-sectional image is applied to the eye to be examined. A range in the cross-sectional image can be determined based on the fixation position, and an enlarged image of the determined range can be formed.

  As a result, when the image region corresponding to the target region of the eye to be examined cannot be automatically detected, an enlarged image in a range corresponding to the fixation position applied at the time of scanning can be automatically formed. The user can observe the site of interest in detail by performing an operation on the enlarged image.

  In an exemplary embodiment, when the analysis unit fails to specify an image region corresponding to a predetermined part of the eye to be examined, the enlarged image forming unit displays an enlarged image of a range in the cross-sectional image designated using the user interface. It is possible to form.

  As a result, when the image area corresponding to the target region of the eye to be examined cannot be automatically detected, the operation mode for specifying the range displayed as the enlarged image is automatically shifted from the automatic mode to the manual mode. Is possible.

  In an exemplary embodiment, the image acquisition unit can acquire a fundus cross-sectional image. In this case, the predetermined part of the eye to be examined may be a macula. The analysis unit can apply at least segmentation to the fundus cross-sectional image in order to identify an image region (macular region) corresponding to the macula.

  This makes it possible to observe a wide-angle-of-view OCT image representing a wide range of the fundus and an enlarged image of the macular that bears most of the visual acuity in diagnosis of the fundus. In addition, since an enlarged image of the macula can be automatically formed, it is possible to facilitate and smooth the diagnosis.

  In an exemplary embodiment, the display control unit can display an enlarged image on a cross-sectional image (wide angle of view OCT image).

  By displaying the enlarged image on the cross-sectional image in this way, it is not necessary to provide an area for displaying the enlarged image separately from an area for displaying the cross-sectional image. Therefore, it is possible to efficiently display a plurality of images on a display screen with limited dimensions.

  In the exemplary embodiment, when a position change operation is performed using the user interface, the display control unit can change the display position of the enlarged image on the cross-sectional image based on a signal from the user interface. .

  Thereby, the user can arbitrarily change the display position of the enlarged image so that both the cross-sectional image and the enlarged image can be suitably observed. In addition, the user can arbitrarily operate the cross-sectional image so that both the cross-sectional image and the enlarged image can be suitably observed. The position changing operation is performed using, for example, a mouse, a cursor key, a GUI, or the like.

  In the exemplary embodiment, the display control unit can display the cross-sectional image and the enlarged image side by side.

  Thereby, the user can observe the entire cross-sectional image and the entire enlarged image.

  The exemplary embodiments provide a method for controlling an ophthalmic device. The ophthalmologic apparatus control method includes a step of obtaining a cross-sectional image of an eye to be examined, a step of forming an enlarged image of a part of the cross-sectional image, and a step of displaying the cross-sectional image and the enlarged image on a display means. And a step of controlling the display of the enlarged image in response to an operation by the user.

  Any of the various processes described in the exemplary embodiments can be applied to such an ophthalmologic apparatus control method.

  The exemplary embodiment provides a program that causes an ophthalmic apparatus to execute such a control method. It is also possible to create a computer-readable non-transitory recording medium that records such a program. This non-temporary recording medium may be in any form, and examples thereof include a magnetic disk, an optical disk, a magneto-optical disk, and a semiconductor memory.

  In addition to being able to observe a wide area with a wide-angle OCT image and observing a local region in detail with the enlarged image, any of the method, program, and recording medium according to the exemplary embodiment, The display mode of the enlarged image can be arbitrarily operated. As a result, it is possible to improve the degree of freedom in observing the subject's eye using the wide-angle OCT image.

  The configuration described above is merely an example of an embodiment of the present invention. Therefore, arbitrary modifications (omitted, replacement, addition, etc.) within the scope of the present invention can be made.

1 Ophthalmic apparatus 100 OCT unit 210 Control unit 212 Storage unit 213 Display control unit 214 Storage control unit 220 Image forming unit 230 Data processing unit 231, 231A, 231B Partial region setting unit 2311A Region of interest specifying unit 2311B Non-region of interest specifying unit 2312A, 2312B setting unit 232 enlarged image forming unit 2321A analyzing unit 2322A enlarged range setting unit 240 user interface 241 display unit 242 operation unit

Claims (17)

An image acquisition unit for acquiring a cross-sectional image of the eye to be examined;
An enlarged image forming unit for forming an enlarged image of a part of the cross-sectional image;
A display control unit for displaying the cross-sectional image and the enlarged image on a display unit;
A user interface for operating the enlarged image, and
The display control unit performs display control of the enlarged image based on a signal from the user interface;
An ophthalmic apparatus characterized by that. When a magnification change operation is performed using the user interface, the display control unit changes the display magnification of the enlarged image based on a signal from the user interface.
The ophthalmic apparatus according to claim 1. When a dimension change operation is performed using the user interface, the display control unit changes the display dimension of the enlarged image based on a signal from the user interface.
The ophthalmologic apparatus according to claim 1 or 2. When an orientation change operation is performed using the user interface, the display control unit changes the orientation of the enlarged image based on a signal from the user interface.
The ophthalmologic apparatus according to any one of claims 1 to 3. The enlarged image forming unit includes an analysis unit that analyzes the cross-sectional image in order to specify an image region corresponding to a predetermined part of the eye to be examined, and an enlarged image of a range including the image region specified by the analysis unit Forming,
The ophthalmologic apparatus according to any one of claims 1 to 4. When the analysis unit cannot identify the image area, the enlarged image forming unit forms an enlarged image of a range in the cross-sectional image corresponding to a position previously associated with the predetermined part.
The ophthalmic apparatus according to claim 5. When the analysis unit cannot identify the image region, the enlarged image forming unit determines whether the scan for forming the cross-sectional image is applied to the eye to be examined based on the fixation position. Determine the range of and form an enlarged image of the range,
The ophthalmic apparatus according to claim 5. When the analysis unit could not identify the image area, the enlarged image forming unit forms an enlarged image of the range in the cross-sectional image designated using the user interface,
The ophthalmic apparatus according to claim 5. The image acquisition unit acquires a fundus cross-sectional image,
The predetermined site is macular,
The analysis unit applies at least segmentation to the fundus cross-sectional image to identify a macular region;
The ophthalmologic apparatus according to claim 5, wherein the ophthalmologic apparatus is provided. The display control unit displays the enlarged image on the cross-sectional image;
The ophthalmologic apparatus according to any one of claims 1 to 9. When a position change operation is performed using the user interface, the display control unit changes the display position of the enlarged image based on a signal from the user interface.
The ophthalmic apparatus according to claim 10. The display control unit displays the cross-sectional image and the enlarged image side by side;
The ophthalmologic apparatus according to any one of claims 1 to 9. The image acquisition unit
A data collection unit that collects data by applying optical coherence tomography (OCT) to the eye to be examined;
The ophthalmologic apparatus according to claim 1, further comprising: an image forming unit that forms the cross-sectional image based on the data collected by the data collecting unit. The ophthalmologic apparatus according to claim 1, wherein the image acquisition unit includes an image receiving unit that receives the cross-sectional image from an external device or a recording medium. A method for controlling an ophthalmic device comprising:
Obtaining a cross-sectional image of the eye to be examined;
Forming an enlarged image of a portion of the cross-sectional image;
Displaying the cross-sectional image and the enlarged image on a display means;
A step of controlling display of an enlarged image in response to an operation by a user;
A method for controlling an ophthalmic apparatus.   The program which makes an ophthalmologic apparatus perform the control method of Claim 15. A computer-readable non-transitory recording medium on which the program according to claim 16 is recorded.

Images