JP7050488B2 - Ophthalmologic imaging equipment, its control method, programs, and recording media - Google Patents

Description

The present invention relates to an ophthalmologic imaging apparatus, a control method thereof, a program, and a recording medium.

Diagnostic imaging occupies an important position in the field of ophthalmology. In recent years, the use of optical coherence tomography (OCT) has been advancing. OCT has come to be used not only for acquiring B-scan images and three-dimensional images of the eye to be inspected, but also for acquiring front images (en-face images) such as C-scan images and shadowgrams.

In addition, a modality for acquiring an image emphasizing a specific part of the eye to be inspected has also been put into practical use. For example, OCT-Angiography, which forms an image in which retinal blood vessels and choroidal blood vessels are emphasized, is attracting attention (see, for example, Patent Document 1). Generally, the tissue (structure) of the scan site does not change with time, but the blood flow portion inside the blood vessel changes with time. In OCT angiography, an image is formed by emphasizing a portion (blood flow signal) in which such a temporal change exists. In addition, OCT angiography is also called OCT motion contrast imaging (motion contrast imaging) or the like. The images acquired by OCT angiography are called angiographic images, angiograms, motion contrast images, and the like.

In a typical conventional OCT angiography, a 3D scan of a predetermined size (eg, 9 mm x 9 mm) is applied to obtain an image representing the 3D distribution of the fundus blood vessels. On the other hand, it is desired to acquire a wider range of angiographic images. Panorama imaging is known as a technique for acquiring OCT data over a wide range of the fundus (see, for example, Patent Document 2).

Panorama photography is an imaging method in which a three-dimensional scan is applied to a plurality of different areas, and a plurality of three-dimensional images obtained by the three-dimensional scan are combined to construct a wide-area image. An overlapping area is set in the area adjacent to each other, and the relative position between the adjacent images is determined with respect to this overlapping area. Also, sequential 3D scans on different regions are typically achieved by moving the fixative position. Wide-area images acquired by panoramic photography are called panoramic images, mosaic images, and the like.

By the way, there are individual differences in the size and characteristics of the eyeball, for example, the axial length and diopter (refractive power of the eye) differ from person to person. As described above, even when a three-dimensional scan of a predetermined size is applied, the range of the fundus actually scanned varies depending on the axial length and diopter.

For example, as shown in FIG. 1, when the OCT measurement light is incident on the eye E1 having an axial length L1 and the eye E2 having an axial length L2 (> L1) at the same angle θ, the fundus of the eye E1 is examined. The height Y2 of the projection position of the measurement light on the fundus of the eye E2 to be inspected is larger than the height Y1 of the projection position of the measurement light in (Y2> Y1). That is, the longer the axial length, the higher the height of the projection position of the measured light on the fundus. On the other hand, the size of the OCT scan is defined by the maximum deflection angle of the measurement light. Therefore, even if the size conditions of the OCT scan are the same, the range of the fundus actually scanned changes according to the value of the axial length. The same applies to diopter.

Since the actual scan range is affected by the eyeball parameters in this way, the size of the overlapping area in panoramic photography also changes according to the eyeball parameters. For example, when the axial length of the eye to be inspected is long, the actual scan range is widened, so that the overlapping area is also widened. If the overlapping area becomes wider than necessary, the range actually drawn by the mosaic image becomes narrow, and the efficiency of panoramic photography decreases.

On the contrary, when the axial length of the eye to be inspected is short, the actual scan range is narrowed, so that the overlapping area is also narrowed, and in some cases, the overlapping area disappears. If the overlapping area becomes narrow, the relative position between adjacent images may not be obtained with sufficient accuracy. Further, when the overlapping area does not exist, the relative position between the adjacent images cannot be determined, and the mosaic image cannot be constructed.

In addition, the region of interest (for example, the center of the macula) to be drawn in the central region of the mosaic image may not be arranged in such a situation.

Japanese Patent Publication No. 2015-515894 Japanese Unexamined Patent Publication No. 2009-183332

An object of the present invention is to provide a technique capable of appropriately setting a plurality of fixative positions for acquiring a mosaic image using OCT regardless of individual differences in the size and characteristics of the eyeball. It is in.

The first aspect of the embodiment is an ophthalmologic imaging apparatus including a fixative system, an imaging unit, a control unit, a fixative position setting unit, an OCT image acquisition unit, and an image processing unit. The fixative system presents a fixative to the eye to be inspected. The photographing unit photographs the fundus of the eye to be inspected. The control unit executes fundus photography control that controls the fixative system and the imaging unit so as to acquire a frontal image of the fundus while presenting a fixative target corresponding to a predetermined fixation position to the eye to be inspected. The fixative position setting unit sets one or more fixative positions based on the front image acquired by the fundus photography control. The OCT image acquisition unit applies optical coherence tomography (OCT) to the fundus to acquire an image. The image acquisition unit processes the image acquired by the OCT image acquisition unit. The control unit sets the fixative system so as to sequentially present two or more fixative targets corresponding to two or more fixative positions including one or more fixative positions set by the fixative position setting unit to the eye to be inspected. OCT control is performed to control and control the OCT image acquisition unit so as to acquire a three-dimensional image of the fundus when each of these two or more fixative targets is presented to the eye to be inspected. The image processing unit includes a composition processing unit that forms a composite image of two or more three-dimensional images corresponding to two or more fixation positions acquired by OCT control.

The second aspect of the embodiment is the ophthalmologic imaging apparatus of the first aspect, and the fixative position setting unit includes a front image acquired by fundus photography control, an imaging area in fundus photography control, and 3 in OCT control. One or more fixative positions are set based on the positional relationship with the dimensional scan area.

The third aspect of the embodiment is the ophthalmologic imaging apparatus of the second aspect, and the control unit presents the first fixative target corresponding to the first fixative position to the eye to be inspected in the fundus imaging control. While doing so, the subject is presented with a first control that controls the fixative system and the imaging unit so as to acquire a first frontal image of the fundus, and a second fixative that corresponds to the second fixative position. While performing a second control that controls the fixative system and the imaging unit so as to acquire a second frontal image of the fundus, the fixative position setting unit includes the first frontal image and the second frontal image. To set one or more fixative positions based on.

A fourth aspect of the embodiment is the ophthalmologic imaging apparatus of the third aspect, wherein the fixative position setting unit identifies an overlapping region between the first front image and the second front image, and the fixation position setting unit identifies the overlapping region. One or more fixative positions are set based on the overlapping area.

A fifth aspect of the embodiment is the ophthalmologic imaging device of the fourth aspect, in which the fixative position setting unit calculates the dimension of the overlapping region and sets one or more fixative positions based on the dimension. ..

A sixth aspect of the embodiment is the ophthalmologic imaging apparatus of the fifth aspect, in which the fixative position setting unit sets one or more fixative positions so that the dimensions of the overlapping region are substantially equal to the default value. ..

A seventh aspect of the embodiment is the ophthalmologic imaging apparatus according to any one of the third to sixth aspects, wherein the first fixation position is for acquiring a frontal image centered on a predetermined portion of the fundus. The default fixative position, the second fixative position, is the default fixative position for acquiring a frontal image centered on a position separated by a predetermined distance in a predetermined direction from a predetermined site in the fundus of a standard eye. The position.

Eighth aspect of the embodiment is the ophthalmologic imaging device of the seventh aspect, in which the control unit presents the first fixative to the eye to be inspected prior to the first control and the second control. While performing preliminary control to control the fixative system and the imaging unit to acquire a preliminary frontal image of the fundus, the image processing unit biases the image of a predetermined portion of the fundus with respect to the center position of the preliminary frontal image. The position is calculated, the fixation position setting unit corrects each of the first fixation position and the second fixation position based on this deviation, and the control unit corrects the corrected first fixation position. Is applied to execute the first control, and the corrected second fixation position is applied to execute the second control.

A ninth aspect of the embodiment is the ophthalmologic imaging apparatus according to any one of the third to eighth aspects, wherein the fixative position setting unit is based on a first front image and a second front image. One or more fixative positions are set by correcting the deviation of the second fixative position with respect to the one fixative position.

The tenth aspect of the embodiment is the ophthalmologic imaging apparatus according to any one of the first to ninth aspects, and the control unit is an image acquisition unit so as to acquire a three-dimensional angiographic image of the fundus in OCT control. To control.

The eleventh aspect of the embodiment is a method of controlling an ophthalmologic imaging apparatus capable of applying imaging and optical coherence tomography (OCT) to the fundus of the eye to be inspected, and a imaging step and a fixative position. It includes a setting step, an OCT step, and a synthesis step. In the imaging step, a front image is acquired by applying imaging to the fundus while presenting a fixative target corresponding to a predetermined fixation position to the eye to be inspected. The fixative position setting step sets one or more fixative positions based on the front image acquired in the photographing step. The OCT step sequentially presents two or more fixation targets corresponding to two or more fixation positions including one or more fixation positions set in the fixation position setting step to the eye to be inspected, and two or more fixation targets. When each of the fixatives is presented to the eye to be inspected, OCT is applied to the fundus to acquire a three-dimensional image. The compositing step forms a composite image of two or more three-dimensional images corresponding to the two or more fixative positions acquired in the OCT step.

A twelfth aspect of the embodiment is a program for causing an ophthalmologic imaging apparatus capable of applying imaging and optical coherence tomography (OCT) to the fundus of the eye to be examined to execute the control method of the eleventh aspect.

A thirteenth aspect of the embodiment is a computer-readable non-temporary recording medium on which the program of the twelfth aspect is recorded.

According to the embodiment, it is possible to suitably set a plurality of fixative positions for acquiring a mosaic image using OCT regardless of individual differences in the size and characteristics of the eyeball.

It is a schematic diagram for demonstrating the background technique. It is a schematic diagram which shows an example of the structure of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is a schematic diagram which shows an example of the structure of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is a schematic diagram which shows an example of the structure of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is a schematic diagram which shows an example of the structure of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is a schematic diagram for demonstrating an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is a schematic diagram for demonstrating an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is a flowchart which shows an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is a schematic diagram for demonstrating an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is a schematic diagram for demonstrating an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is a schematic diagram for demonstrating an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is a schematic diagram for demonstrating an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is a schematic diagram for demonstrating an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment.

An ophthalmologic imaging apparatus according to an exemplary embodiment, a control method thereof, a program, and a recording medium will be described in detail with reference to the drawings. The ophthalmologic imaging apparatus of the embodiment is an ophthalmologic apparatus having a function of performing optical coherence tomography (OCT). The ophthalmologic imaging apparatus of the embodiment may be capable of performing OCT angiography of the fundus.

Hereinafter, an ophthalmologic imaging device in which a swept source OCT and a fundus camera are combined will be described, but the embodiment is not limited to this. The type of OCT is not limited to swept source OCT, and may be, for example, spectral domain OCT.

The swept source OCT divides the light from the variable wavelength light source (wavelength sweep light source) into the measurement light and the reference light, and superimposes the return light of the measurement light from the subject with the reference light to generate interference light. This is a method in which this interference light is detected by a balanced photodiode or the like, and the detection data collected according to the sweep of the wavelength and the scan of the measurement light is subjected to Fourier transform or the like to form an image.

Spectral domain OCT divides the light from the low coherence light source into measurement light and reference light, and superimposes the return light of the measurement light from the subject with the reference light to generate interference light, and the spectrum of this interference light. This is a method in which the distribution is detected by a spectroscope and the detected spectral distribution is subjected to Fourier transform or the like to form an image.

As described above, the swept source OCT is an OCT method for acquiring a spectral distribution by time division, and the spectral domain OCT is an OCT method for acquiring a spectral distribution by spatial division. The OCT method that can be used in the embodiment is not limited to these, and an embodiment using an arbitrary OCT method (for example, time domain OCT) different from these can also be adopted.

The ophthalmologic imaging apparatus according to the embodiment has a function of photographing the fundus of the eye to be inspected and acquiring a frontal image. Examples of ophthalmologic modalities that can be used for fundus photography include a scanning laser ophthalmoscope (SLO), a slit lamp microscope, a surgical microscope, and the like, in addition to the fundus camera described below. The ophthalmic modality that can be used in the embodiment is not limited to these, and it is also possible to adopt an embodiment using a modality other than ophthalmology.

In the present specification, unless otherwise specified, "image data" and "image" based on the "image data" are not distinguished. In addition, unless otherwise specified, the site or tissue of the eye to be inspected is not distinguished from the image showing it.

<Constitution>
The exemplary ophthalmologic imaging apparatus 1 shown in FIG. 2 includes a fundus camera unit 2, an OCT unit 100, and an arithmetic control unit 200. The fundus camera unit 2 is provided with an optical system and mechanism for acquiring a front image of the eye E to be inspected, and an optical system and mechanism for executing OCT. The OCT unit 100 is provided with an optical system and a mechanism for executing OCT. The arithmetic control unit 200 includes one or more processors configured to perform various processes (calculations, controls, etc.). In addition to these, any member such as a member for supporting the subject's face (chin rest, forehead pad, etc.) and a lens unit for switching the site to which OCT is applied (for example, an attachment for anterior ocular segment OCT), etc. Elements and units may be provided in the ophthalmologic imaging apparatus 1.

In the present specification, the "processor" is, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), a programmable logic device (for example, a SPLD (Simple It means a circuit such as Programmable Logic Device), FPGA (Field Programgable Gate Array)). The processor realizes the function according to the embodiment by reading and executing a program stored in a storage circuit or a storage device, for example.

<Fundus camera unit 2>
The fundus camera unit 2 is provided with an optical system for photographing the fundus Ef of the eye to be inspected E. The acquired digital image of the fundus Ef (called a fundus image, a fundus photograph, etc.) is generally a front image such as an observation image, a photographed image, or the like. The observed image is obtained by taking a moving image using near-infrared light. The captured image is a still image using flash light in the visible region.

The fundus camera unit 2 includes an illumination optical system 10 and a photographing optical system 30. The illumination optical system 10 irradiates the eye E to be inspected with illumination light. The photographing optical system 30 detects the return light of the illumination light applied to the eye E to be inspected. The measurement light from the OCT unit 100 is guided to the eye E to be inspected through the optical path in the fundus camera unit 2. The return light of the measurement light projected on the eye E (for example, the fundus Ef) is guided to the OCT unit 100 through the same optical path in the fundus camera unit 2.

The light output from the observation light source 11 of the illumination optical system 10 (observation illumination light) is reflected by the concave mirror 12, passes through the condenser lens 13, passes through the visible cut filter 14, and becomes near-infrared light. Further, the observation illumination light is once focused in the vicinity of the photographing light source 15, reflected by the mirror 16, and passed through the relay lens system 17, the relay lens 18, the diaphragm 19, and the relay lens system 20 to the perforated mirror 21. Be guided. Then, the observation illumination light is reflected at the peripheral portion of the perforated mirror 21 (the region around the perforated portion), passes through the dichroic mirror 46, is refracted by the objective lens 22, and illuminates the eye E (fundament Ef) to be inspected. do. The return light of the observation illumination light from the eye E to be inspected is refracted by the objective lens 22, passes through the dichroic mirror 46, passes through the hole formed in the central region of the perforated mirror 21, and passes through the dichroic mirror 55. , It is reflected by the mirror 32 via the photographing focusing lens 31. Further, this return light passes through the half mirror 33A, is reflected by the dichroic mirror 33, and is imaged on the light receiving surface of the image sensor 35 by the imaging lens 34. The image sensor 35 detects the return light at a predetermined frame rate. The focus of the photographing optical system 30 is adjusted so as to match the fundus Ef or the anterior eye portion.

The light output from the photographing light source 15 (photographing illumination light) is applied to the fundus Ef through the same path as the observation illumination light. The return light of the photographing illumination light from the eye E to be examined is guided to the dichroic mirror 33 through the same path as the return light of the observation illumination light, passes through the dichroic mirror 33, is reflected by the mirror 36, and is reflected by the imaging lens 37. An image is formed on the light receiving surface of the image sensor 38.

The liquid crystal display (LCD) 39 displays a fixative (fixation target image). A part of the light flux output from the LCD 39 is reflected by the half mirror 33A, reflected by the mirror 32, passes through the photographing focusing lens 31 and the dichroic mirror 55, and passes through the hole portion of the perforated mirror 21. The luminous flux that has passed through the hole of the perforated mirror 21 passes through the dichroic mirror 46, is refracted by the objective lens 22, and is projected onto the fundus Ef. Fixatives are typically used to guide and fix the line of sight. The direction in which the line of sight of the eye E to be examined is guided (and fixed), that is, the direction in which the fixation of the eye E to be examined is promoted is called the fixation position.

By changing the display position of the fixative image on the screen of the LCD 39, the fixative position of the eye E to be inspected by the fixative can be changed. Examples of fixative positions include the fixative position for acquiring an image centered on the macula, the fixative position for acquiring an image centered on the optic nerve head, and the position between the macula and the optic nerve head ( There is a fixative position for acquiring an image centered on the center of the fundus, and a fixative position for acquiring an image of a portion far away from the macula (peripheral part of the macula).

A graphical user interface (GUI) or the like for designating at least one of such typical fixative positions can be provided. Further, a GUI or the like for manually moving the fixative position (display position of the fixative target) can be provided. It is also possible to apply a configuration that automatically sets the fixative position.

The configuration for presenting a fixative target whose fixation position can be changed to the eye E to be inspected is not limited to a display device such as an LCD. For example, a device (fixation matrix) in which a plurality of light emitting units (light emitting diodes and the like) are arranged in a matrix can be adopted instead of the display device. In this case, the fixation position of the eye E to be inspected by the fixation target can be changed by selectively lighting the plurality of light emitting units. As another example, a device with one or more movable light emitting units can generate a fixative that can change the fixative position.

The alignment optical system 50 generates an alignment index used for alignment of the optical system with respect to the eye E to be inspected. The alignment light output from the light emitting diode (LED) 51 passes through the diaphragm 52, the diaphragm 53, and the relay lens 54, is reflected by the dichroic mirror 55, passes through the hole portion of the perforated mirror 21, and passes through the dichroic mirror 46. It is transmitted and projected onto the eye E to be inspected through the objective lens 22. The return light (corneal reflex light, etc.) of the alignment light from the eye E to be inspected is guided to the image sensor 35 through the same path as the return light of the observation illumination light. Manual alignment or auto alignment can be executed based on the received light image (alignment index image).

The focus optical system 60 generates a split index used for focus adjustment with respect to the eye E to be inspected. The focus optical system 60 is moved along the optical path (illumination optical path) of the illumination optical system 10 in conjunction with the movement of the photographing focusing lens 31 along the optical path (optical path) of the photographing optical system 30. The reflection rod 67 is inserted and removed from the illumination optical path. When adjusting the focus, the reflecting surface of the reflecting rod 67 is inclined and arranged in the illumination optical path. The focus light output from the LED 61 passes through the relay lens 62, is separated into two light fluxes by the split index plate 63, passes through the two-hole diaphragm 64, is reflected by the mirror 65, and is reflected by the condenser lens 66. It is once imaged on the reflecting surface of the lens and reflected. Further, the focus light passes through the relay lens 20, is reflected by the perforated mirror 21, passes through the dichroic mirror 46, and is projected onto the eye E to be inspected via the objective lens 22. The return light (reflected light from the fundus, etc.) of the focus light from the eye E to be inspected is guided to the image sensor 35 through the same path as the return light of the alignment light. Manual focusing or auto focusing can be executed based on the received light image (split index image).

The diopter correction lenses 70 and 71 can be selectively inserted into the photographing optical path between the perforated mirror 21 and the dichroic mirror 55. The diopter correction lens 70 is a plus lens (convex lens) for correcting high-intensity hyperopia. The diopter correction lens 71 is a minus lens (concave lens) for correcting high-intensity myopia.

The dichroic mirror 46 synthesizes a fundus photography optical path and an OCT optical path (measurement arm). The dichroic mirror 46 reflects light in the wavelength band used for OCT and transmits light for fundus photography. The measuring arm is provided with a collimator lens unit 40, a retroreflector 41, a dispersion compensation member 42, an OCT focusing lens 43, an optical scanner 44, and a relay lens 45 in this order from the OCT unit 100 side.

The retroreflector 41 is movable in the direction of the arrow shown in FIG. 2, whereby the length of the measuring arm is changed. The change in the measuring arm length is used, for example, for correcting the optical path length according to the axial length and adjusting the interference state.

The dispersion compensating member 42 acts together with the dispersion compensating member 113 (described later) arranged on the reference arm so as to match the dispersion characteristics of the measurement light LS and the dispersion characteristics of the reference light LR.

The OCT focusing lens 43 is moved along the measuring arm to adjust the focus of the measuring arm. The movement of the photographing focusing lens 31, the movement of the focus optical system 60, and the movement of the OCT focusing lens 43 can be controlled in a coordinated manner.

The optical scanner 44 is substantially located at a position optically conjugate with the pupil of the eye E to be inspected. The optical scanner 44 deflects the measurement light LS guided by the measurement arm. The optical scanner 44 is, for example, a galvano scanner capable of two-dimensional scanning. Typically, the optical scanner 44 is a one-dimensional scanner (x-scanner) for deflecting the measurement light in the ± x direction and a one-dimensional scanner (y-scanner) for deflecting the measurement light in the ± y direction. And include. In this case, for example, one of these one-dimensional scanners is placed at a position optically conjugated with the pupil, or a position optically coupled with the pupil is placed between these one-dimensional scanners.

<OCT unit 100>
The exemplary OCT unit 100 shown in FIG. 3 is provided with an optical system for performing a swept source OCT. This optical system includes an interference optical system. This interference optical system divides the light from the variable wavelength light source into the measurement light and the reference light, and superimposes the return light of the measurement light projected on the eye E to be examined and the reference light passing through the reference optical path to cause interference light. Is generated and this interference light is detected. The data (detection signal) obtained by the detection of the interference light is a signal representing the spectrum of the interference light and is sent to the arithmetic control unit 200.

The light source unit 101 includes, for example, a near-infrared wavelength tunable laser that changes the wavelength of emitted light at high speed. The light L0 output from the light source unit 101 is guided to the polarization controller 103 by the optical fiber 102, and its polarization state is adjusted. Further, the optical L0 is guided by the optical fiber 104 to the fiber coupler 105 and divided into the measurement optical LS and the reference optical LR. The optical path of the measurement light LS is called a measurement arm or the like, and the optical path of the reference light LR is called a reference arm or the like.

The reference optical LR generated by the fiber coupler 105 is guided by the optical fiber 110 to the collimator 111, converted into a parallel light flux, and guided to the retroreflector 114 via the optical path length correction member 112 and the dispersion compensation member 113. The optical path length correction member 112 acts to match the optical path length of the reference light LR with the optical path length of the measured light LS. The dispersion compensating member 113 acts together with the dispersion compensating member 42 arranged on the measurement arm to match the dispersion characteristics between the reference light LR and the measurement light LS. The retroreflector 114 is movable along the optical path of the reference light LR incident on it, thereby changing the length of the reference arm. The change of the reference arm length is used, for example, for correcting the optical path length according to the axial length, adjusting the interference state, and the like.

The reference optical LR via the retroreflector 114 is converted from a parallel luminous flux to a focused luminous flux by the collimator 116 via the dispersion compensating member 113 and the optical path length correction member 112, and is incident on the optical fiber 117. The reference light LR incident on the optical fiber 117 is guided to the polarization controller 118 to adjust its polarization state, is guided to the attenuator 120 through the optical fiber 119 to adjust the amount of light, and is guided to the fiber coupler 122 through the optical fiber 121. Be guided.

On the other hand, the measurement light LS generated by the fiber coupler 105 is guided to the collimator lens unit 40 through the optical fiber 127 and converted into a parallel light beam, and is converted into a parallel light beam, a retroreflector 41, a dispersion compensation member 42, an OCT focusing lens 43, and an optical scanner 44. , And is reflected by the dichroic mirror 46 via the relay lens 45, refracted by the objective lens 22, and projected onto the eye E to be inspected. The measurement light LS is scattered and reflected at various depth positions of the eye E to be inspected. The return light from the eye E to be inspected of the measurement light LS travels in the opposite direction on the measurement arm, is guided to the fiber coupler 105, and reaches the fiber coupler 122 via the optical fiber 128.

The fiber coupler 122 superimposes the measurement light LS incidented via the optical fiber 128 and the reference light LR incident via the optical fiber 121 to generate interference light. The fiber coupler 122 generates a pair of interference light LCs by branching the generated interference light at a predetermined branching ratio (for example, 1: 1). The pair of interference light LCs are guided to the detector 125 through the optical fibers 123 and 124, respectively.

The detector 125 includes, for example, a balanced photodiode. The balanced photodiode includes a pair of photodetectors that detect each pair of interference light LCs, and outputs the difference between the pair of detection signals obtained by these. The detector 125 sends this output (detection signal such as a difference signal) to the data collection system (DAQ) 130.

A clock KC is supplied to the data collection system 130 from the light source unit 101. The clock KC is generated in the light source unit 101 in synchronization with the output timing of each wavelength swept within a predetermined wavelength range by the tunable light source. The light source unit 101, for example, branches the light L0 of each output wavelength to generate two branched lights, optically delays one of the branched lights, synthesizes the branched lights, and produces the obtained combined light. It is detected and a clock KC is generated based on the detected signal. The data collection system 130 executes sampling of the detection signal (difference signal) input from the detector 125 based on the clock KC. The data collection system 130 sends the data obtained by this sampling to the arithmetic control unit 200.

In this example, both an element for changing the measurement arm length (for example, the retroreflector 41) and an element for changing the reference arm length (for example, the retroreflector 114 or the reference mirror) are provided. However, only one of these elements may be provided. Further, the elements for changing the difference (optical path length difference) between the measurement arm length and the reference arm length are not limited to these, and any element (optical member, mechanism, etc.) can be adopted. ..

<Operation control unit 200>
The arithmetic control unit 200 controls each part of the fundus camera unit 2, the display device 3, and the OCT unit 100. Further, the arithmetic control unit 200 executes various arithmetic processes. For example, the arithmetic control unit 200 performs signal processing such as Fourier transform on the spectral distribution based on the sampling data group obtained by the data collection system 130 for each series of wavelength scans (for each A line). Form a reflection intensity profile in the line. Further, the arithmetic control unit 200 forms image data by imaging the reflection intensity profile of each A line. The arithmetic processing for that purpose is the same as that of the conventional swept source OCT.

The arithmetic control unit 200 includes, for example, a processor, a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk drive, a communication interface, and the like. Various computer programs are stored in a storage device such as a hard disk drive. The arithmetic control unit 200 may include an operation device, an input device, a display device, and the like.

<Control system>
4 and 5 show an example of the configuration of the control system (processing system) of the ophthalmologic imaging apparatus 1. The control unit 210, the image forming unit 220, and the data processing unit 230 are provided in, for example, the arithmetic control unit 200.

<Control unit 210>
The control unit 210 includes a processor and controls each unit of the ophthalmologic imaging apparatus 1. The control unit 210 includes a main control unit 211 and a storage unit 212.

<Main control unit 211>
The main control unit 211 includes a processor and controls each element (including the elements shown in FIGS. 2 to 5) of the ophthalmologic imaging apparatus 1. The main control unit 211 is realized by the cooperation of the hardware including the circuit and the control software.

The photographing focusing lens 31 arranged in the photographing optical path and the focus optical system 60 arranged in the illumination optical path are moved by a photographing focusing drive unit (not shown) under the control of the main control unit 211. The retroreflector 41 provided on the measurement arm is moved by the retroreflector (RR) drive unit 41A under the control of the main control unit 211. The OCT focusing lens 43 arranged on the measuring arm is moved by the OCT focusing driving unit 43A under the control of the main control unit 211. The optical scanner 44 provided on the measurement arm operates under the control of the main control unit 211. The retroreflector 114 arranged on the reference arm is moved by the retroreflector (RR) drive unit 114A under the control of the main control unit 211. Each of these drive units includes an actuator such as a pulse motor that operates under the control of the main control unit 211.

The moving mechanism 150, for example, moves at least the fundus camera unit 2 three-dimensionally. In a typical example, the moving mechanism 150 includes an x stage that can move in the ± x direction (horizontal direction), an x moving mechanism that moves the x stage, and a y stage that can move in the ± y direction (vertical direction). , The y-moving mechanism that moves the y-stage, the z-stage that can move in the ± z direction (depth direction), and the z-moving mechanism that moves the z-stage are included. Each of these moving mechanisms includes an actuator such as a pulse motor that operates under the control of the main control unit 211.

<Memory unit 212>
The storage unit 212 stores various data. The data stored in the storage unit 212 includes, for example, image data of an OCT image, image data of a fundus image, eye information to be inspected, and the like. The eye test information includes subject information such as patient ID and name, left eye / right eye identification information, electronic medical record information, and the like.

The storage unit 212 may store positional relationship information indicating the positional relationship between the imaging range (fundus imaging area) in fundus photography and the range to which the three-dimensional OCT scan is applied (three-dimensional scan area). .. The fundus photography region may be defined, for example, by the characteristics (for example, shape, dimensions) of the region drawn as a frontal image by the fundus photography function of the ophthalmologic imaging apparatus 1. Further, the three-dimensional scan area may be defined by, for example, the characteristics (for example, shape, dimensions) of the area drawn as a three-dimensional image by the OCT function of the ophthalmologic imaging apparatus 1.

Here, the feature of the region drawn as a three-dimensional image may be the feature of the region drawn as a rendered image of this three-dimensional image. As a specific example, the feature of the region drawn as a three-dimensional image is the feature of the region drawn in the projection image obtained by projecting the three-dimensional image in the z direction, or a part of the three-dimensional image is drawn in the z direction. It may be a feature of the region depicted in the shadowgram obtained by projecting onto (eg, two-dimensional shape, area, perimeter, diameter).

The projection image and the shadow gram are front images, and can be defined in the same two-dimensional coordinate system (xy coordinate system) as the front image obtained by the fundus photography function. When a three-dimensional image is considered instead of such a two-dimensional image, the defined coordinate system (xy coordinate system) of the front image obtained by the fundus imaging function is changed to the defined coordinate system (xyz coordinate system) of the three-dimensional image. It can be embedded.

In the present embodiment, as described above, the fundus photography optical path and the OCT optical path (measurement arm) are connected by the dichroic mirror 46. More specifically, in the dichroic mirror 46, the optical path for fundus photography and the measurement arm are coaxially coupled to each other. That is, the dichroic mirror 46 connects the fundus photography optical path and the measurement arm so that the optical axis of the fundus photography optical path and the optical axis of the measurement arm intersect.

Further, as described above, the dimensions of the OCT scan are defined by the maximum deflection angle of the measurement light. Therefore, in the present embodiment, the three-dimensional scan region is defined by the maximum deflection angle (maximum deflection angle in the x direction and maximum deflection angle in the y direction) of the light LS measured by the optical scanner 44.

Further, in the present embodiment, similarly to a typical fundus camera, an optical member (shooting field diaphragm) for defining the contour of the fundus photography area is arranged, or the contour of the fundus photography area is defined. A digital aperture is set for the image sensors 35 and 38.

An example of the positional relationship between the fundus photography area and the three-dimensional scan area will be described with reference to FIG. Reference numeral 300 indicates an optical axis (objective optical axis) 300 of the objective lens 22, reference numeral 310 indicates a fundus photography region (its contour), and reference numeral 320 indicates a three-dimensional scan region (its contour). The fundus photography region 310 is circular, and its center is arranged on the objective optical axis 300. The three-dimensional scan area 320 is a square, and its center is arranged on the objective optical axis 300. That is, in this example, the fundus photography region 310 and the three-dimensional scan region 320 are arranged coaxially with each other. Further, the fundus photography area 310 truly includes the three-dimensional scan area 320.

The shape and / or size of the fundus photography region 310 may be fixed or variable. The shape and / or dimension of the fundus photography region 310 can be changed, for example, by selecting the imaging field diaphragm, controlling the aperture size of the photographing field diaphragm, or controlling the digital aperture.

The shape and / or dimensions of the three-dimensional scan area 320 may be fixed or variable. Changes in the shape and / or dimensions of the 3D scan area 320 are, for example, control of the optical scanner 44 (eg, control of maximum deflection angle, control of x-scanner, control of y-scanner, x-scanner and y-scanner). It can be realized by the coordinated control with.

The relative position between the fundus photography area 310 and the three-dimensional scan area 320 may be fixed or variable. The relative position change between the fundus photography area 310 and the 3D scan area 320 can be made, for example, by one or a combination of two or more of the following controls: the shape of the fundus photography area 310. And / change of dimensions; change of position of fundus photography area 310; change of shape and / or dimension of 3D scan area 320; change of position of 3D scan area 320. Here, the position of the fundus photography region 310 can be changed, for example, by selecting the photographing field diaphragm, controlling the opening position of the photographing field diaphragm, or controlling the digital aperture. Further, the position of the three-dimensional scan area 320 can be changed, for example, by controlling the optical scanner 44.

When the fundus photography area 310 and the three-dimensional scan area 320 are arranged non-coaxially with each other, for example, the relative displacement between the center of the fundus photography area 310 and the center of the three-dimensional scan area 320, and / or the fundus. The relative position between the fundus photography area 310 and the 3D scan area 320 can be determined in advance or at any time by the relative position between the contour of the imaging area 310 and the contour of the 3D scan area 320. ..

In the present embodiment, the positional relationship between the fundus photography area 310 and the three-dimensional scan area 320 obtained according to any of the above examples is stored in the storage unit 212 as positional relationship information in advance or at any time. To. Such positional relationship information includes, for example, relative position information between the fundus photography area 310 and the three-dimensional scan area 320 as illustrated in FIG. 6, setting information and / or control information regarding the fundus photography area 310, and It may include at least one of the setting information and / or the control information regarding the three-dimensional scan area 320.

<Image forming unit 220>
The image forming unit 220 forms image data based on the data collected by the data collecting system 130. The image forming unit 220 includes a processor. The image forming unit 220 is realized by the cooperation of the hardware including the circuit and the image forming software.

The image forming unit 220 forms the cross-sectional image data based on the data collected by the data collecting system 130. This processing includes signal processing such as noise reduction (noise reduction), filtering, and fast Fourier transform (FFT), as in the conventional swept source OCT.

The image data formed by the image forming unit 220 is a group of images formed by imaging reflection intensity profiles in a plurality of A lines (scan lines along the z direction) arranged in an area to which an OCT scan is applied. A data set containing image data (a group of A-scan image data).

The image data formed by the image forming unit 220 is, for example, one or more B-scan image data, or stack data formed by embedding a plurality of B-scan image data in a single three-dimensional coordinate system. The image forming unit 220 can also perform voxelization processing on the stack data to form volume data (voxel data). Stack data and volume data are typical examples of 3D image data represented by a 3D coordinate system.

When OCT angiography is performed, the main control unit 211 repeatedly scans the same area of the fundus Ef a predetermined number of times. The image forming unit 220 can form a motion contrast image based on the data set collected by the data acquisition system 130 in this repeated scan. This motion contrast image is an angiographic image that emphasizes the temporal change of the interference signal caused by the blood flow of the fundus Ef. Typically, OCT angiography is applied to the three-dimensional region of the fundus Ef to obtain an image showing the three-dimensional distribution of blood vessels in the fundus Ef.

The image forming unit 220 can process three-dimensional image data. For example, the image forming unit 220 can construct new image data by applying rendering to the three-dimensional image data. Rendering methods include volume rendering, maximum value projection (MIP), minimum value projection (MinIP), surface rendering, and multi-section reconstruction (MPR). Further, the image forming unit 220 can construct projection data by projecting three-dimensional image data in the z direction (A-line direction, depth direction). Further, the image forming unit 220 can construct a shadow gram by projecting a part of the three-dimensional image data in the z direction. A part of the three-dimensional image data projected to construct the shadow gram is set by using, for example, segmentation described later.

When OCT angiography is performed, the image forming unit 220 can construct arbitrary 2D angiographic image data and / or arbitrary pseudo 3D angiographic image data from the 3D angiographic image data. Is. For example, the image forming unit 220 can construct two-dimensional angiographic image data representing an arbitrary cross section of the fundus Ef by applying the multi-section reconstruction to the three-dimensional angiographic image data. Further, it is possible to construct the anterior angiographic image data by projecting the three-dimensional angiographic image data or a part thereof in the z direction.

<Data processing unit 230>
The data processing unit 230 executes various data processing. For example, the data processing unit 230 can apply image processing or analysis processing to OCT image data, or can apply image processing or analysis processing to observation image data or captured image data. The data processing unit 230 includes, for example, at least one of a processor and a dedicated circuit board.

The configuration of the exemplary data processing unit 230 is shown in FIG. The data processing unit 230 of this example includes a fixative position setting unit 231 and an image processing unit 232. The fixative system 250 is configured to present the fixative to the eye E to be inspected. The fixative system 250 of this example includes an LCD 39 and an optical system for projecting a light flux output from the LCD 39 onto the fundus Ef. Further, the OCT image acquisition unit 260 is configured to apply OCT to the fundus Ef of the eye E to be inspected to acquire an image. The OCT image acquisition unit 260 of this example includes an element group that constitutes a measurement arm provided in the fundus camera unit 2, an element group provided in the OCT unit 100, and an image forming unit 220. Further, the photographing unit 270 is configured to photograph the fundus Ef. The photographing unit 270 of this example includes an illumination optical system 10 and a photographing optical system 30.

<Fixation position setting unit 231>
The fixative position setting unit 231 sets the fixative position for applying OCT to the fundus Ef. In particular, the fixative position setting unit 231 can set the fixative position for applying panoramic photography (panorama OCT) to the fundus Ef based on the front image of the fundus Ef acquired by the photographing unit 270. be. The processing that can be executed by the fixation position setting unit 231 of this example will be described later.

<Image processing unit 232>
The image processing unit 232 processes the OCT image acquired by the OCT image acquisition unit 260. For example, the image processing unit 232 can apply segmentation to the two-dimensional cross-sectional image data or the three-dimensional image data. Segmentation is a process of identifying a partial area in an image. Typically, segmentation is utilized to identify an image region that corresponds to a predetermined tissue of the fundus Ef.

As described above, the image forming unit 220 can project the image region specified by the segmentation in the z direction to construct a shadow gram (front angiographic image data or the like). Examples of shadowgrams include shadowgrams corresponding to any depth region of the fundus Ef (eg, superficial retina, deep retina, choroidal capillary plate, strong membrane, etc.) and any tissue (eg, inner limiting membrane, etc.). Nerve fiber layer, ganglion cell layer, inner reticulum layer, inner nuclear layer, outer reticulum layer, outer granule layer, external limiting membrane, retinal pigment epithelium, Bruch's membrane, choroid, choroidal choroid border, strong membrane, any of these There are shadowgrams corresponding to some of them, at least two or more combinations of these, etc.).

The image processing unit 232 may be capable of processing an image (observation image, captured image, etc.) acquired by the photographing unit 270, or processing an image acquired by another ophthalmologic photographing apparatus. For example, the image processing unit 232 analyzes the frontal image of the fundus Ef acquired by the photographing unit 270 to identify an image region corresponding to a predetermined portion (macula, optic disc, etc.) of the fundus Ef, or the fundus Ef. It is possible to specify an image region corresponding to the contour of a predetermined portion of the fundus, and to specify a pixel corresponding to a predetermined position of the fundus Ef (center of macula, center of papilla, etc.). This processing may include threshold processing regarding pixel values, edge detection, template matching, and the like.

The image processing unit 232 includes an image processing processor and an image analysis processor. The image processor is realized by the cooperation of the hardware including the circuit and the image processing software. Further, the image analysis processor is realized by the cooperation of the hardware including the circuit and the image analysis software.

The processing that can be executed by the image processing unit 232 of this example will be described later.

<Synthesis processing unit 2321>
The image processing unit 232 includes a composition processing unit 2321. The composition processing unit 2321 forms a composite image of two or more three-dimensional images acquired corresponding to two or more fixation positions different from each other in panoramic photography. The processing that can be executed by the synthesis processing unit 2321 of this example will be described later.

<User interface 240>
The user interface 240 includes a display unit 241 and an operation unit 242. The display unit 241 includes a display device 3. The operation unit 242 includes various operation devices and input devices. The user interface 240 may include a device such as a touch panel in which a display function and an operation function are integrated. It is also possible to build embodiments that do not include at least a portion of the user interface 240. For example, the display device may be an external device connected to the ophthalmologic imaging device.

<About panoramic shooting>
The panoramic photography that can be performed in this example will be described. In this example, the fixative position for panoramic photography is set by using the front image of the fundus Ef acquired by the photographing unit 270. This preliminary fundus photography is for, for example, to set a first preliminary fundus photography for setting the center position of the panoramic photography and a plurality of fixation positions for a plurality of OCTs performed in the panoramic photography. Includes a second preliminary fundus photography. The execution of the first preliminary fundus photography is optional. The second preliminary fundus photography may be performed without going through the first preliminary fundus photography.

<About the first preliminary fundus photography, etc.>
An example of the first preliminary fundus photography will be described. In the first preliminary fundus photography, the main control unit 211 presents the first fixation target for acquiring a frontal image centered on a predetermined portion of the fundus Ef to the eye E to be examined, and the frontal image of the fundus Ef. The fixative system 250 and the photographing unit 270 are controlled so as to acquire (referred to as a preliminary front image). In this example, the macula (center of the macula, fovea centralis) is adopted as a typical example of this predetermined site (that is, the first fixation position), but other sites of the fundus (for example, the optic disc or the center of the fundus) are predetermined. It may be a site.

The image processing unit 232 calculates the deviation of the image at a predetermined portion of the fundus Ef with respect to the center position of the preliminary front image.

For example, the image processing unit 232 first analyzes the preliminary front image to obtain the coordinates of the pixel corresponding to the center of the macula. Subsequently, the image processing unit 232 obtains the difference between the coordinates of the identified center of the macula and the coordinates of the center position of the preliminary front image. The difference between the coordinates of the center of the macula and the coordinates of the center position of the preliminary front image is the deviation of the actual center of the macula with respect to the center position of the fundus photography area (photograph field) applied in the first preliminary fundus photography. Corresponds to.

The fixative position setting unit 231 can correct the first fixative position based on the deviation obtained by the image processing unit 232. For example, the fixative position setting unit 231 corrects the first fixative position so that the deviation obtained by the image processing unit 232 is canceled (that is, the deviation becomes zero). As a result, the center position of the fundus photography region (center position of panoramic photography) substantially coincides with the portion corresponding to the first fixation position (macular center).

Further, the fixative position setting unit 231 can correct the default second fixative position. As a specific example, the fixative position setting unit 231 corrects the same as the correction amount of the first fixative position so that the relative position between the first fixative position and the second fixative position is maintained. The amount is applied to the second fixative position. That is, the fixative position setting unit 231 applies a correction amount corresponding to the inverse vector of the deviation (vector) obtained by the image processing unit 232 to the second fixative position.

The main control unit 211 can perform a second preliminary fundus photography by applying the first fixative position and the second fixative position corrected by the fixative position setting unit 231.

<About the second preliminary fundus photography, etc.>
An example of the second preliminary fundus photography will be described. In the second preliminary fundus photography, the main control unit 211 executes the first control and the second control. In the first control, the main control unit 211 presents the first fixative target corresponding to the first fixative position to the eye E to be inspected, and presents the front image of the fundus Ef (referred to as the first front image). The fixative system 250 and the imaging unit 270 are controlled so as to acquire. Similarly, in the second control, the main control unit 211 presents the second fixative target corresponding to the second fixative position to the eye E to be inspected, and the front image of the fundus Ef (with the second front image). The fixative system 250 and the photographing unit 270 are controlled so as to acquire (call).

In the first control, the main control unit 211 controls the fixative system 250 so as to display the fixative at the display position (pixel) of the LCD 39 corresponding to the first fixative position, and the fixative system 250 thereof is controlled. The imaging unit 270 is controlled so as to capture the fundus Ef in the state. As a result, a first front image corresponding to the first fixative position is obtained.

Similarly, in the second control, the main control unit 211 controls the fixative system 250 so as to display the fixative at the display position (pixel) of the LCD 39 corresponding to the second fixative position, for example. Moreover, the imaging unit 270 is controlled so as to capture the fundus Ef in that state. As a result, a second front image corresponding to the second fixation position is obtained.

Here, the first fixative position is a default fixative position for acquiring a frontal image centered on a predetermined portion of the fundus, and for example, as described above, a frontal image centered on the macula is acquired. It may be a fixative position to do so. Further, the second fixative position is, for example, a default fixative position for acquiring a frontal image centered on a position separated by a predetermined distance in a predetermined direction from the predetermined portion in the fundus of a standard eye. It's okay.

An example of the first fixative position and the second fixative position is shown in FIG. Reference numeral 411 indicates a first fixative (maculac fixative) corresponding to the first fixative position (macular center). Reference numeral 412 indicates a fundus photography region (macular imaging range) centered on the first fixative position. Reference numeral 413 indicates a three-dimensional scan region (macula scan range) centered on the first fixative position. In this example, the positional relationship between the macula imaging range 412 and the macula scanning range 413 corresponds to the positional relationship information stored in the storage unit 212 (see FIG. 6).

Further, reference numeral 421 indicates a second fixative (peripheral fixative) corresponding to the second fixative position (position separated from the center of the macula by a predetermined distance in the lower left direction). Reference numeral 422 indicates a fundus photography region (peripheral photography range) centered on the second fixative position. Reference numeral 423 indicates a three-dimensional scan area (peripheral scan range) centered on the second fixation position. In this example, the positional relationship between the peripheral shooting range 422 and the peripheral scanning range 423 is the same as the positional relationship between the macula shooting range 412 and the macula scanning range 413, and the positional relationship information stored in the storage unit 212. Corresponds to.

In FIG. 7, reference numeral 432 indicates an overlapping region (overlapping shooting range) between the macula shooting range 412 and the peripheral shooting range 422, and reference numeral 433 is a overlapping region between the macula scanning range 413 and the peripheral scanning range 423. (Duplicate scan range) is shown. As described above, since the positional relationship between the macula imaging range 412 and the macula scan range 413 corresponds to the positional relationship information, this positional relationship is substantially fixed. Similarly, since the positional relationship between the peripheral shooting range 422 and the peripheral scan range 423 corresponds to the positional relationship information, this positional relationship is also substantially fixed. Therefore, if one of the overlapping shooting range 432 and the overlapping scanning range 433 is determined, the other is also determined.

As shown in FIG. 7, it is assumed that the second fixative position (peripheral fixative 421) is arranged at the lower left of the first fixative position (macula fixative 411). When the eye to be inspected E is a standard eye, the macula fixative 411 is placed in the upper right corner of the overlap scan range 433 and the peripheral fixative 421 is placed in the lower left corner, as shown in FIG. .. That is, the first fixative position (macula fixative 411) and the second fixative position (peripheral fixative) so that such an arrangement is achieved when the eye E to be inspected is a standard eye. The positional relationship with the optotype 421) is preset. Typically, when the eye E to be inspected is a standard eye, the macular fixative 411 is placed in a predetermined tolerance in the upper right corner and a peripheral fixative in a predetermined tolerance in the lower left corner. An overlapping scan range 433 is obtained with dimensions such that the 421 is located. As described above, since there is a certain relationship between the overlapping imaging range 432 and the overlapping scanning range 433, the dimensions of the overlapping scanning range 433 obtained when the eye to be inspected E is a standard eye are determined in advance. It is possible to do.

Here, the standard eye is typically an eye whose axial length belongs to the standard range (for example, an eye that is neither long-axis long eye nor short-axis long eye) and / or diopter. Is an eye that belongs to the standard range (eg, an eye that is neither myopic nor distant).

On the other hand, for example, when the axial length of the eye E to be inspected is shorter than the standard, the size of the macula imaging range is smaller than the dimension of the macula imaging range 412 in the case of a standard eye, and The dimensions of the peripheral imaging range are also smaller than the peripheral imaging range 422 for a standard eye. Therefore, the dimension of the overlapping imaging range when the axial length of the eye to be inspected E is shorter than the standard is smaller than that of the overlapping imaging range 432 in the case of the standard eye. In this case, the macular fixative 411 is not placed in the predetermined tolerance in the upper right corner of the overlap scan range and / or the peripheral fixative 421 is not placed in the predetermined tolerance in the lower left corner.

On the contrary, when the axial length of the eye E to be inspected is longer than the standard, the size of the macula imaging range is larger than the dimension of the macula imaging range 412 in the case of a standard eye, and the size is peripheral. The dimensions of the imaging range are also larger than the peripheral imaging range 422 for a standard eye. Therefore, the dimension of the overlapping imaging range when the axial length of the eye to be inspected E is longer than the standard is larger than that of the overlapping imaging range 432 in the case of the standard eye. Also in this case, the macula fixative 411 is not placed in the predetermined allowable range in the upper right corner of the overlapping scan range, and / or the peripheral fixative 421 is not placed in the predetermined allowable range in the lower left corner.

In this way, the dimension of the overlapping region between the first front image and the second front image changes according to the value of the axial length of the eye E to be inspected. More specifically, the shorter the axial length of the eye E to be inspected, the smaller the dimension of the overlapping region, and the longer the axial length of the eye E to be inspected, the larger the dimension of the overlapping region. The same applies to eyeball parameters such as diopter. In the present embodiment, a plurality of fixatives for panoramic photography can be set by utilizing such a relationship.

More generally, the fixation position setting unit 231 of the present embodiment can set the fixation position for panoramic photography based on the first front image and the second front image.

In one example, the fixative position setting unit 231 can identify an overlapping region between the first front image and the second front image. This processing is performed, for example, in the first partial region in the first front image and the second partial region in the second front image, and the first partial region having a high degree of matching (image correlation, etc.). And by identifying a second subregion. In this example, the fixative position setting unit 231 can further set the fixative position for panoramic photography based on the specified overlapping region.

For example, the fixative position setting unit 231 calculates the dimension of the overlapping region between the first front image and the second front image, and sets the fixative position for panoramic photography based on this dimension. May be good. Here, the parameter indicating the dimension of the overlapping region may include at least one of a length in the x direction, a length in the y direction, a circumference, an area, and the like.

For example, the fixative position setting unit 231 so that the dimension of the overlapping area between the first front image and the second front image is substantially equal to the default value (or is included in the default tolerance range). ) You may set the fixative position for panoramic photography. This default value (or tolerance) indicates, for example, the dimension (or tolerance of the dimension value) of the overlapping region that should be obtained if the eye E to be inspected is a standard eye.

Further, the fixation position setting unit 231 corrects the deviation of the second fixation position with respect to the first fixation position based on the first front image and the second front image, thereby performing panoramic shooting. You may set the fixative position for this. Typically, when the first fixative position corresponds to the macula, the deviation of the second fixative position with respect to the first fixative position in the second preliminary fundus photography is shown in the first frontal image. By correcting based on and the second front image, the peripheral fixative position located in the vicinity of the second fixative position can be set as one of the fixative positions for panoramic photography.

<motion>
The operation of the ophthalmologic imaging apparatus 1 according to the present embodiment will be described. FIG. 8 shows an example of the operation of the ophthalmologic imaging apparatus 1. It is assumed that general preparatory processes for fundus photography, such as patient information input, alignment, and focus adjustment, have already been completed. Further, it is assumed that general preparatory processing for OCT such as interference sensitivity adjustment and z position adjustment is executed at an arbitrary timing.

(S1: Perform the first preliminary fundus photography)
First, the ophthalmologic imaging apparatus 1 performs the above-mentioned first preliminary fundus photography. The first preliminary fundus photography is performed to set the center position of the panoramic photography. In the first preliminary fundus photography of this example, the main control unit 211 controls the fixative system 250 so as to present the default macular fixative to the eye E to be inspected, and the macular fixative. The imaging unit 270 is controlled so as to capture the fundus Ef of the eye E to be inspected. Thereby, a preliminary front image is obtained.

Here, the default macula fixative is typically the visible light spot displayed at the center position of the LCD39 display screen (ie, the position on the optical axis of the optical path branched by the half mirror 33A). be. However, the default macular fixative is not limited to this.

(S2: Set the center position of panoramic shooting)
The main control unit 211 sends the preliminary front image acquired in the first preliminary fundus photography in step S1 to the data processing unit 230. The image processing unit 232 calculates the deviation of the image of the macula of the fundus Ef with respect to the center position of the preliminary front image.

Here, reference is made to FIG. 9A. Reference numeral 500 indicates a preliminary front image. The contour of the preliminary front image 500 is circular. Reference numeral 501 indicates a center position (center position on the xy plane) of the preliminary front image 500. Reference numeral 502 indicates the position of the macula (center of the macula) depicted in the preliminary front image. Reference numeral 503 indicates the deviation of the macula center 502 with respect to the center position 501 of the preliminary front image 500. In this example, the image processing unit 232 analyzes the preliminary front image 500 to calculate the deviation 503 of the macula center 502 with respect to the center position 501.

The fixative position setting unit 231 corrects the fixative position (that is, the display position of the visible bright spot on the display screen of the LCD 39) corresponding to the default fixative for macula based on the calculated deviation 503. The position of the fundus Ef (macula) corresponding to the corrected fixative for macula is set at the center position of the panoramic image. That is, by applying the translation of the direction and distance corresponding to the inverse vector of the vector represented by the deviation 503 to the default macula fixative, as shown in FIG. 9B, the (virtual) frontal image 550. The position of the default macular fixative is corrected so that the macula center 551 is drawn at the center position. Further, the fixation position setting unit 231 makes the same correction for the default peripheral fixation position (second fixation position).

(S3: Start the second preliminary fundus photography)
When the setting of the center position of the panoramic photography (position correction of the macula fixative and further, position correction of the peripheral fixative) is completed, the process shifts to the second preliminary fundus photography. In the second preliminary fundus photography of this example, the above-mentioned first control is executed by applying the first fixative position corrected in step S2, and the second fixative position corrected in step S2 is performed. The above-mentioned second control is executed by applying the visual position.

(S4: Execute the first control to acquire the first front image)
In the first control, the main control unit 211 presents the first frontal image of the fundus Ef to the eye E to be inspected while presenting the first fixative target corresponding to the first fixative position corrected in step S2. The fixative system 250 and the photographing unit 270 are controlled so as to acquire.

In this example, the main control unit 211 displays the visible bright spot at the position (pixel) of the display screen of the LCD 39 corresponding to the fixative position of the macula-corrected fixative target corrected in step S2. Further, the main control unit 211 controls the imaging unit 270 so as to capture the fundus Ef and acquire the first front image.

(S5: Execute the second control to acquire the second front image)
After the completion of the first control in step S4, the process shifts to the second control. In the second control, the main control unit 211 presents the second frontal image of the fundus Ef to the eye E to be inspected while presenting the second fixative target corresponding to the second fixative position corrected in step S2. The fixative system 250 and the photographing unit 270 are controlled so as to acquire.

In this example, the main control unit 211 displays the visible bright spot at the position (pixel) of the display screen of the LCD 39 corresponding to the fixative position of the peripheral fixation target corrected in step S2. Further, the main control unit 211 controls the imaging unit 270 so as to capture the fundus Ef and acquire a second front image.

In this example, the second control is executed after the first control, but conversely, the first control may be executed after the second control.

(S6: Set multiple fixative positions for panoramic shooting)
After the first control and the second control are completed, the process shifts to the setting of the fixation position for panoramic photography. The fixative position setting unit 231 sets a plurality of fixative positions for panoramic shooting based on the first front image acquired in step S4 and the second front image acquired in step S5. ..

For example, it is assumed that the first front image 601 and the second front image 602 shown in FIG. 10A are acquired. It is assumed that the first front image 601 and the second front image 602 have the same shape and dimensions as the preliminary front image 500, respectively.

The fixative position setting unit 231 first identifies an overlapping region 603 between the first front image 601 and the second front image 602 (see FIG. 10B).

Next, the fixative position setting unit 231 calculates the dimensions of the specified overlapping region 603. In this example, the fixation position setting unit 231 calculates the length Rx (mm) of the overlapping region 603 in the x direction and the length Ry (mm) in the y direction as the dimensions of the overlapping region 603.

Subsequently, the fixative position setting unit 231 sets a plurality of fixative positions for panoramic photography based on the calculated dimensions Rx (mm) and Ry (mm) of the overlapping region 603. For example, the fixative position setting unit 231 sets the fixative position of the peripheral fixation target corrected in step S2 so that the dimensions Rx (mm) and Ry (mm) of the overlapping region 603 are substantially equal to the default values. Further correction. In other words, the fixative position setting unit 231 sets the display position (pixel position of the display screen of the LCD 39) of the peripheral fixative (visible bright spot) corrected in step S2 to the dimension Rx (mm) of the overlapping region 603. And Ry (mm) are changed so as to be substantially equal to the default value.

If the eye to be inspected E is a standard eye, the dimensions Rx (mm) and Ry (mm) of the overlapping region 603 are both substantially equal to the default values. On the other hand, when the eye to be inspected E is not a standard eye, at least one of the dimensions Rx and Ry of the overlapping region 503 is substantially different from the default value.

Here, "the dimension is substantially equal to the default value" means, for example, the case where the dimension is included in the range of the preset tolerance (error with respect to the default value). Further, "the dimension is substantially different from the default value" means, for example, the case where the dimension is not included in the range of the preset tolerance (error with respect to the default value).

As described above, the cause of the difference between the dimensions Rx (mm) and Ry (mm) of the overlapping region 603 and the default value is the fixative position due to the difference in the values of the eyeball parameters such as the axial length and the diopter. It is in displacement. In this example, by correcting such a displacement of the fixation position, the peripheral fixation position for panoramic photography is optimized.

For example, the fixative position setting unit 231 calculates the difference (Q-Rx, Q-Ry) between each of the dimensions Rx (mm) and Ry (mm) of the overlapping region 603 and the default value Q (mm). Further, the displacement between the display position of the macula fixative and the display position of the peripheral fixative located at the lower left thereof is Dx (pixels, dots) in the x direction and Dy (pixels, dots) in the y direction. ) (Here, Dx = Dy may be satisfied). Then, the display position of the peripheral fixative may be moved by the number of dots corresponding to ([Q-Rx] / Dx, [Q-Ry] / Dy). The fixative position setting unit 231 can perform such an operation.

In this way, the fixation position setting unit 231 can set the peripheral fixation position located at the lower left with respect to the fixation position for macular imaging. Using this result, it is possible to set other peripheral fixation positions.

For example, as shown in FIG. 11, it is assumed that the first peripheral fixation position 701 located at the lower left of the macula 700 (fixation position for macula photography) is set as described above. The first peripheral fixation position 701 is set at a position separated from the macula 700 in the lower left direction by a distance T. In this case, the fixation position setting unit 231 sets the second peripheral fixation position 702 at a position separated by a distance T in the upper left direction from the macula 700, and (2) a distance T in the upper right direction from the macula 700. The third peripheral fixation position 703 can be set at a position only separated from the macula 700, and the fourth peripheral fixation position 704 can be set at a position separated by a distance T in the lower right direction from the macula 700.

The number of the plurality of peripheral fixation positions is not limited to four, and the arrangement of the plurality of peripheral fixation positions is not limited to the arrangement shown in FIG. In general, setting (correcting) a plurality of peripheral fixation positions according to a preset arrangement of a plurality of peripheral fixation positions (for example, a default arrangement, an arrangement specified by a user or an ophthalmologic imaging device 1). Is possible.

(S7: Perform panoramic shooting to acquire multiple 3D images)
The main control unit 211 controls the fixation system 250 so as to sequentially present a plurality of fixation targets corresponding to the plurality of (peripheral) fixation positions set in step S6 to the eye E to be inspected, and these The OCT image acquisition unit 260 is controlled to acquire a three-dimensional image of the fundus Ef when each of the fixatives of the above is presented to the eye E to be inspected.

As an example, a case where the four peripheral fixation positions 701 to 704 shown in FIG. 11 are applied to panoramic photography will be described.

First, the main control unit 211 controls the fixation system 250 so as to present the first peripheral fixation target corresponding to the first peripheral fixation position 701, and further, the first peripheral fixation target. The OCT image acquisition unit 260 is controlled so as to execute a three-dimensional scan in the state where is presented. As a result, the first peripheral three-dimensional image corresponding to the first peripheral scan range 711 shown in FIG. 11 is acquired. The dimensions of the first peripheral three-dimensional image (first peripheral scan range) are W (mm) for both the length in the x direction and the length in the y direction.

Next, the main control unit 211 controls the fixation system 250 so as to present the second peripheral fixation target corresponding to the second peripheral fixation position 702, and further, the second peripheral fixation. The OCT image acquisition unit 260 is controlled so as to execute a three-dimensional scan with the target presented. As a result, a second peripheral three-dimensional image corresponding to the second peripheral scan range 712 shown in FIG. 11 is acquired. The dimensions of the second peripheral three-dimensional image (second peripheral scan range) are W (mm) for both the length in the x direction and the length in the y direction.

Subsequently, the main control unit 211 controls the fixation system 250 so as to present a third peripheral fixation target corresponding to the third peripheral fixation position 703, and further controls the third peripheral fixation. The OCT image acquisition unit 260 is controlled so as to execute a three-dimensional scan with the target presented. As a result, a third peripheral three-dimensional image corresponding to the third peripheral scan range 713 shown in FIG. 11 is acquired. The dimensions of the third peripheral three-dimensional image (third peripheral scan range) are W (mm) for both the length in the x direction and the length in the y direction.

Finally, the main control unit 211 controls the fixation system 250 to present a fourth peripheral fixation target corresponding to the fourth peripheral fixation position 704, and further controls the fourth peripheral fixation. The OCT image acquisition unit 260 is controlled so as to execute a three-dimensional scan with the target presented. As a result, a fourth peripheral three-dimensional image corresponding to the fourth peripheral scan range 714 shown in FIG. 11 is acquired. The dimension of the fourth peripheral three-dimensional image (fourth peripheral scan range) is W (mm) for both the length in the x direction and the length in the y direction.

Further, the two peripheral three-dimensional images adjacent to each other have an overlapping region (margin) having a width suitable for synthesizing them. For example, in the example shown in FIG. 11, the first peripheral scan range and the second peripheral scan range have an overlapping region having a width ΔW, and the second peripheral scan range and the third peripheral scan range have a width ΔW. The third peripheral scan range and the fourth peripheral scan range have an overlapping area with a width ΔW, and the fourth peripheral scan range and the first peripheral scan range have an overlapping width ΔW. Has an area.

(S8: Form a composite image)
The compositing processing unit 2321 forms a compositing image (mosaic image) of a plurality of three-dimensional images acquired in step S7. As an example, in the example shown in FIG. 11, the synthesis processing unit 2321 synthesizes the first to fourth peripheral three-dimensional images to form a single three-dimensional image. It is also possible to synthesize any two or more three-dimensional images among the plurality of three-dimensional images acquired in step S7.

The process of synthesizing a plurality of 3D images is, for example, matching of overlapping regions using image correlation and the like, and positioning of peripheral 3D images using the result of this matching, as in the conventional image synthesizing technique. , Includes a compositing process with these peripheral three-dimensional images.

(S9: Display / save composite image)
The main control unit 211 can display the composite image formed in step S8 on the display unit 241. Further, the main control unit 211 performs control for storing the composite image in the storage unit 212, controlling for transmitting the composite image to an external device, and controlling for recording the composite image on the recording medium. Is possible.

Further, the main control unit 211 can display a part or all of the plurality of three-dimensional images formed in step S7 on the display unit 241. This is the end of the process related to this example.

<Modification example>
In the operation example described above, after the first preliminary fundus photography is performed, the second preliminary fundus photography including the first control and the second control is performed. However, it is possible to omit the first control of the second preliminary fundus photography.

For example, the preliminary front image acquired by the first preliminary fundus photography and the deviation 503 described above can be used in place of the first front image acquired by the first control. That is, since the common first fixation position is applied in the first control of the first preliminary fundus photography and the second preliminary fundus photography, it was obtained in the first preliminary fundus photography. A frontal image in which the position of the preliminary frontal image is shifted based on the displacement 503 can be used in place of the first frontal image obtained by the first control.

<Action / effect>
The operation and effect of the ophthalmologic imaging apparatus 1 according to the present embodiment will be described.

The ophthalmologic imaging apparatus (1) according to the present embodiment includes a fixative system (250), an imaging unit (270), a control unit (main control unit 211), a fixative position setting unit (231), and an OCT image. It includes an acquisition unit (260) and an image processing unit (232).

The fixative system (250) presents a fixative to the eye to be inspected (E). The photographing unit (270) photographs the fundus (Ef) of the eye to be inspected (E).

The control unit (211) presents a fixative target corresponding to a predetermined fixation position to the eye to be inspected (E), and acquires a front image of the fundus (Ef). 270) is controlled. This control is called fundus photography control.

The fixation position setting unit (231) sets one or more fixation positions (at least the first peripheral fixation position 701) for panoramic photography based on the front image acquired by the fundus photography control. The fixation position setting unit (231) has two or more fixation positions for panoramic photography (for example, a first peripheral fixation position 701 and a second to fourth peripheral fixation positions 702 to 704). It is also possible to set two or more peripheral fixation positions, including any one or more. Further, at least one of one or more fixation positions for panoramic photography may be configured so that the user can set or correct it.

Further, the fixative position setting unit (231) includes a front image acquired by fundus photography control, a photographing area (fundus photography area 310) in fundus photography control, and a three-dimensional scan area (320) in OCT control for panoramic photography. ) And one or more fixation positions for panoramic photography may be set based on the positional relationship (positional relationship information).

The OCT image acquisition unit (260) applies optical coherence tomography (OCT) to the fundus (Ef) to acquire an image.

The image processing unit (232) processes the image acquired by the OCT image acquisition unit (260). The image processing unit (232) includes a composition processing unit (2321).

The control unit (211) has two or more fixation positions (first to fourth peripheral fixation) including one or more fixation positions set by the fixation position setting unit (231) as OCT control (panoramic photography). The fixative system (250) is controlled so that two or more fixatives (first to fourth peripheral fixatives) corresponding to the visual positions 701 to 704) are sequentially presented to the eye to be inspected (E). And, when each of two or more fixatives (first to fourth peripheral fixatives) is presented to the eye to be inspected (E), a three-dimensional image of the fundus (Ef) is acquired. The OCT image acquisition unit (260) is controlled.

The synthesis processing unit (2321) has two or more three-dimensional images (first to fourth) corresponding to two or more fixation positions (first to fourth peripheral fixation positions 701 to 704) acquired by OCT control. A composite image (mosaic image) of the peripheral three-dimensional image) is formed.

According to such an embodiment, it is possible to set a plurality of fixative positions for panoramic photography by actually performing fundus photography control. Thereby, regardless of individual differences such as eyeball size information such as axial length and eyeball characteristic information such as diopter, it is preferable to set a plurality of fixative positions for acquiring a mosaic image using OCT. Is possible.

In the fundus photography control, the control unit (211) has a first control (first control in the second preliminary fundus photography) and a second control (second control in the second preliminary fundus photography). And may be executed.

As the first control, the control unit (211) presents the first fixative target corresponding to the first fixative position to the eye to be inspected (E), and the first front image (601) of the fundus (Ef). ) Is controlled by the fixative system (250) and the photographing unit (270).

As a second control, the control unit (211) presents the second fixative target corresponding to the second fixative position to the eye to be inspected (E), and the second front image (602) of the fundus (Ef). ) Is controlled by the fixative system (250) and the photographing unit (270).

When the first control and the second control are executed, the fixative position setting unit (231) takes a panoramic image based on the first front image (601) and the second front image (602). One or more fixation positions (at least the first peripheral fixation position 701) can be set for this purpose.

According to such a configuration, two (or more) front images corresponding to two different (or more) fixation positions are actually acquired, and a plurality of fixations for panoramic shooting are performed using these front images. The visual position can be set. As a result, for example, even when the photographing unit (270) cannot perform wide-angle photography or ultra-wide-angle photography, multiple fixation positions for panoramic photography over a wide range of the fundus can be determined by individual differences in eyeball size and eyeball characteristics. It is possible to set regardless of.

When the imaging unit (270) is capable of performing wide-angle imaging (ultra-wide-angle imaging), for example, the control unit (211) controls the fundus photography to correspond to a single predetermined fixation position. The fixative system (250) and the imaging unit (270) can be controlled so as to perform wide-angle photography while presenting the optotype to the eye to be inspected (E) and acquire a wide-angle frontal image of the fundus (Ef). The fixative position setting unit (231) can set one or more fixative positions for panoramic photography based on this wide-angle front image.

When the first control and the second control are executed, the fixative position setting unit (231) has an overlapping region (602) between the first front image (601) and the second front image (602). 603) can be identified and one or more fixative positions for panoramic photography can be set based on this overlapping region (603).

According to such a configuration, according to such a configuration, it is possible to set a suitable fixative position for panoramic photography based on the overlapping state of the first front image and the second front image. It is possible.

When the overlapping region (603) between the first front image (601) and the second front image (602) is specified, the fixative position setting unit (231) has the dimensions of the overlapping region (603). And one or more fixative positions for panoramic photography can be set based on this dimension.

With such a configuration, it is possible to set a suitable fixative position for panoramic photography based on the degree of overlap between the first front image and the second front image.

When the first control and the second control are executed in the fundus photography control, the fixative position setting unit (231) is used for panoramic photography so that the dimensions of the overlapping region (603) are substantially equal to the default values. One or more fixative positions can be set. This default value indicates, for example, the dimension of the overlapping region (the allowable range of the dimension value) that should be obtained when the eye to be inspected (E) is a standard eye.

According to such a configuration, fixation for panoramic photography is performed so that a plurality of three-dimensional images (first to fourth peripheral three-dimensional images) obtained by panoramic photography have overlapping regions suitable for panoramic composition. It is possible to set the position.

When the first control and the second control are executed in the fundus photography control, the first fixative position is a default fixative position for acquiring a frontal image centered on a predetermined part of the fundus. good. Further, the second fixative position may be a default fixative position for acquiring a frontal image centered on a position separated by a predetermined distance in a predetermined direction from the predetermined portion in the fundus of a standard eye. ..

According to such a configuration, the panorama of the eye to be inspected (E) is applied by applying the first fixation position and the second fixation position preset so that panoramic photography for a standard eye can be suitably performed. It is possible to set the fixative position for shooting.

Prior to the first control and the second control, the control unit (211) presents the first fixative target corresponding to the first fixative position to the eye to be inspected (E) and the fundus (Ef). Preliminary control (first preliminary fundus photography) may be performed to control the fixative system (250) and the imaging unit (270) to acquire the preliminary frontal image (500).

When the preliminary control is executed, the image processing unit (232) calculates the deviation (503) of the image of the predetermined portion of the fundus (Ef) with respect to the central position (501) of the preliminary front image (500). Can be done. Further, the fixative position setting unit (231) can correct each of the first fixative position and the second fixative position based on this deviation (503). In addition, the control unit (211) can apply the corrected first fixation position to execute the first control, and apply the corrected second fixation position to perform the first control. The control of 2 can be executed.

According to such a configuration, the first fixation position and the second fixation position corrected by using the preliminary front image obtained in the first preliminary fundus photography are applied to the second. 2 preliminary fundus photography (first control and second control) can be performed. As a result, regardless of individual differences in the eyeball parameters of the eye to be inspected, it is possible to make the first fixation position correspond to a predetermined part of the fundus, and further, a position separated from the predetermined part of the fundus by a predetermined distance in a predetermined direction. It becomes possible to correspond to the second fixation position.

When the first control and the second control are executed in the fundus photography control, the fixative position setting unit (231) has the first front image (601) and the second control acquired by the first control. By correcting the deviation of the second fixative position with respect to the first fixative position based on the second front image (602) obtained in, one or more fixative positions for panoramic photography can be obtained. Can be set.

With such a configuration, it is possible to suitably correct the relative position of the second fixative position with respect to the first fixative position.

When the first control and the second control are executed in the fundus imaging control, the first fixation position is the default fixation position for acquiring a frontal image centered on the macula (fixation for macula imaging). Position), and the second fixative position is the default fixative position for acquiring a three-dimensional image centered on a position separated by a predetermined distance from the macula in a predetermined direction in the base of the standard eye. It may be (peripheral fixative position). Further, the fixative position setting unit (231) is based on the first front image (601) and the second front image (602), and the second fixation position (fixation position for yellow spot imaging) is the second. By correcting the deviation of the fixation position (peripheral fixation position) of, the first fixation position (yellow spot) corresponding to the position in the fundus (Ef) separated from the yellow spot by the first distance in the first direction. Set the first peripheral fixative position 701) corresponding to a position separated by a distance T in the lower left direction from the yellow spot in the second direction (upper right direction) opposite to the first direction (lower left direction). A second fixation position (third peripheral fixation position 703) corresponding to a position separated by one distance (distance T) is set, and a third direction (lower left direction) orthogonal to the first direction (lower left direction) is set. A third fixation position (second peripheral fixation position 702) is set at a position 1 distance (distance T) away from the yellow spot (upper left direction), which is opposite to the third direction (upper left direction). A fourth fixation position (fourth peripheral fixation position 704) corresponding to a position separated by a first distance (distance T) from the yellow spot may be set in the fourth direction (lower right direction) of. .. In addition, the control unit (211) is based on a plurality of fixative positions (first to fourth peripheral fixative positions 701 to 704) including the first, second, third and fourth fixative positions. OCT control (panoramic photography) may be executed.

With such a configuration, it is possible to automatically and suitably set a plurality of fixation positions for panoramic photography.

In the present embodiment, the control unit (211) may control the OCT image acquisition unit (260) so as to acquire a three-dimensional angiographic image of the fundus (Ef) in the OCT control (panoramic photography).

With such a configuration, it is possible to suitably acquire a three-dimensional angiographic image (mosaic image) over a wide range of the fundus.

The control method of the ophthalmologic imaging device according to the present embodiment is a method of controlling an ophthalmologic imaging device capable of applying imaging and optical coherence tomography (OCT) to the fundus of the eye to be inspected, and the imaging step. , Includes a fixative position setting step, an OCT step, and a synthesis step.

In the imaging step, while presenting a fixative target corresponding to a predetermined fixation position to the eye to be inspected (E), imaging is applied to the fundus (Ef) to acquire a frontal image. The imaging step may include any process relating to the second preliminary fundus imaging described in this embodiment.

The fixative position setting step sets one or more fixative positions for panoramic shooting based on the front image acquired in the shooting step. The fixative position setting step may include any process related to the fixative position setting described in the present embodiment.

In the OCT step, two or more fixation targets corresponding to two or more fixation positions including one or more fixation positions set in the fixation position setting step are sequentially presented to the eye to be inspected (E), and OCT is performed to acquire a three-dimensional image of the fundus (Ef) when each of these two or more fixative targets is presented to the eye to be inspected (E). The OCT step may include any processing related to panoramic photography described in the present embodiment.

The compositing step forms a composite image (mosaic image) of two or more three-dimensional images corresponding to the two or more fixative positions acquired in the OCT step. The compositing step may include any process relating to image compositing described in this embodiment.

It is possible to create a program that causes the ophthalmologic imaging apparatus according to the present embodiment to execute such a control method. It is also possible to create a computer-readable non-temporary recording medium on which such a program is recorded. This non-temporary recording medium may be in any form, and examples thereof include a magnetic disk, an optical disk, a magneto-optical disk, and a semiconductor memory.

The embodiments described above are merely examples of the present invention. A person who intends to carry out the present invention can arbitrarily make modifications (omission, substitution, addition, etc.) within the scope of the gist of the present invention.

1 Ophthalmology imaging device 210 Control unit 211 Main control unit 230 Data processing unit 231 Fixation position setting unit 232 Image processing unit 2321 Synthesis processing unit 250 Fixation system 260 OCT image acquisition unit 270 Imaging unit

Claims (11)

A fixative system that presents a fixative to the eye to be inspected,
An imaging unit that photographs the fundus of the eye to be inspected,
A control unit that executes fundus photography control that controls the fixation system and the imaging unit so as to acquire a frontal image of the fundus while presenting a fixation target corresponding to a predetermined fixation position to the eye to be inspected.
A fixative position setting unit that sets one or more fixative positions based on the front image acquired by the fundus photography control.
An OCT image acquisition unit that acquires an image by applying optical coherence tomography (OCT) to the fundus, and
Including an image processing unit that processes an image acquired by the OCT image acquisition unit.
The control unit sequentially presents two or more fixative targets corresponding to the two or more fixative positions including the one or more fixative positions set by the fixative position setting unit to the eye to be inspected. An OCT that controls the fixative system and controls the OCT image acquisition unit so as to acquire a three-dimensional image of the fundus when each of the two or more fixative targets is presented to the eye to be inspected. Take control and
The image processing unit includes a composition processing unit that forms a composite image of two or more three-dimensional images corresponding to the two or more fixation positions acquired by the OCT control.
The fixative position setting unit is based on the positional relationship between the front image acquired by the fundus photography control, the image pickup area in the fundus photography control, and the three-dimensional scan area in the OCT control. After setting the above fixation position,
In the fundus photography control, the control unit presents the first fixative target corresponding to the first fixative position to the eye to be inspected and acquires the first front image of the fundus. To acquire a second frontal image of the fundus while presenting the first control for controlling the system and the photographing unit and the second fixative target corresponding to the second fixative position to the eye to be inspected. The second control that controls the fixative system and the imaging unit is executed.
The fixative position setting unit executes the setting of the one or more fixative positions based on the first front image and the second front image.
The fixative position setting unit is
An overlapping region between the first front image and the second front image was identified.
Set the fixative position of 1 or more based on the overlapping region.
An ophthalmologic imaging device characterized by this. The fixative position setting unit is
Calculate the dimensions of the overlapping area and
Set the fixative position of 1 or more based on the dimensions.
The ophthalmologic photographing apparatus according to claim 1. The fixative position setting unit sets one or more fixative positions so that the dimensions of the overlapping region are substantially equal to the default value.
The ophthalmologic photographing apparatus according to claim 2. A fixative system that presents a fixative to the eye to be inspected,
An imaging unit that photographs the fundus of the eye to be inspected,
A control unit that executes fundus photography control that controls the fixation system and the imaging unit so as to acquire a frontal image of the fundus while presenting a fixation target corresponding to a predetermined fixation position to the eye to be inspected.
A fixative position setting unit that sets one or more fixative positions based on the front image acquired by the fundus photography control.
An OCT image acquisition unit that acquires an image by applying optical coherence tomography (OCT) to the fundus, and
With an image processing unit that processes the image acquired by the OCT image acquisition unit
Including
The control unit sequentially presents two or more fixative targets corresponding to the two or more fixative positions including the one or more fixative positions set by the fixative position setting unit to the eye to be inspected. An OCT that controls the fixative system and controls the OCT image acquisition unit so as to acquire a three-dimensional image of the fundus when each of the two or more fixative targets is presented to the eye to be inspected. Take control and
The image processing unit includes a composition processing unit that forms a composite image of two or more three-dimensional images corresponding to the two or more fixation positions acquired by the OCT control.
The fixative position setting unit is based on the positional relationship between the front image acquired by the fundus photography control, the image pickup area in the fundus photography control, and the three-dimensional scan area in the OCT control. After setting the above fixation position,
In the fundus photography control, the control unit presents the first fixative target corresponding to the first fixative position to the eye to be inspected and acquires the first front image of the fundus. To acquire a second frontal image of the fundus while presenting the first control for controlling the system and the photographing unit and the second fixative target corresponding to the second fixative position to the eye to be inspected. The second control that controls the fixative system and the imaging unit is executed.
The fixative position setting unit executes the setting of the one or more fixative positions based on the first front image and the second front image.
The first fixative position is a default fixative position for acquiring a frontal image centered on a predetermined portion of the fundus.
The second fixative position is a default fixative position for acquiring a frontal image centered on a position separated by a predetermined distance in a predetermined direction from the predetermined portion in the fundus of a standard eye.
An ophthalmologic imaging device characterized by this. Prior to the first control and the second control, the control unit presents the first fixative to the eye to be inspected and obtains a preliminary frontal image of the fundus. Perform preliminary control to control the system and the imaging unit,
The image processing unit calculates the deviation of the image of the predetermined portion of the fundus with respect to the center position of the preliminary front image, and calculates the deviation.
The fixative position setting unit corrects each of the first fixative position and the second fixative position based on the deviation.
The control unit
Applying the corrected first fixation position to perform the first control,
The corrected second fixation position is applied to perform the second control.
The ophthalmologic photographing apparatus according to claim 4. A fixative system that presents a fixative to the eye to be inspected,
An imaging unit that photographs the fundus of the eye to be inspected,
A control unit that executes fundus photography control that controls the fixation system and the imaging unit so as to acquire a frontal image of the fundus while presenting a fixation target corresponding to a predetermined fixation position to the eye to be inspected.
A fixative position setting unit that sets one or more fixative positions based on the front image acquired by the fundus photography control.
An OCT image acquisition unit that acquires an image by applying optical coherence tomography (OCT) to the fundus, and
With an image processing unit that processes the image acquired by the OCT image acquisition unit
Including
The control unit sequentially presents two or more fixative targets corresponding to the two or more fixative positions including the one or more fixative positions set by the fixative position setting unit to the eye to be inspected. An OCT that controls the fixative system and controls the OCT image acquisition unit so as to acquire a three-dimensional image of the fundus when each of the two or more fixative targets is presented to the eye to be inspected. Take control and
The image processing unit includes a composition processing unit that forms a composite image of two or more three-dimensional images corresponding to the two or more fixation positions acquired by the OCT control.
The fixative position setting unit is based on the positional relationship between the front image acquired by the fundus photography control, the image pickup area in the fundus photography control, and the three-dimensional scan area in the OCT control. After setting the above fixation position,
In the fundus photography control, the control unit presents the first fixative target corresponding to the first fixative position to the eye to be inspected and acquires the first front image of the fundus. To acquire a second frontal image of the fundus while presenting the first control for controlling the system and the photographing unit and the second fixative target corresponding to the second fixative position to the eye to be inspected. The second control that controls the fixative system and the imaging unit is executed.
The fixative position setting unit executes the setting of the one or more fixative positions based on the first front image and the second front image.
The fixation position setting unit corrects the deviation of the second fixation position with respect to the first fixation position based on the first front image and the second front image. Set the above fixative position
An ophthalmologic imaging device characterized by this. It is a method of controlling an ophthalmologic imaging device capable of applying imaging and optical coherence tomography (OCT) to the fundus of the eye to be inspected.
An imaging step of applying imaging to the fundus to acquire a frontal image while presenting a fixative target corresponding to a predetermined fixation position to the eye to be inspected.
A fixative position setting step for setting one or more fixative positions based on the front image acquired in the shooting step, and a fixative position setting step.
Two or more fixative targets corresponding to two or more fixative positions including the one or more fixative positions set in the fixative position setting step are sequentially presented to the eye to be inspected, and the two or more fixative targets are presented to the eye to be inspected. An OCT step of applying OCT to the fundus to acquire a three-dimensional image when each of the fixatives is presented to the eye to be inspected.
With the compositing step of forming a composite image of two or more three-dimensional images corresponding to the two or more fixation positions acquired in the OCT step.
Including
The fixative position setting step is one or more based on the positional relationship between the front image acquired in the imaging step, the imaging region in the imaging step, and the three-dimensional scanning region in the OCT step. Perform the fixative position setting and
The imaging step includes a first imaging step of acquiring a first frontal image of the fundus while presenting a first fixation target corresponding to the first fixation position to the eye to be inspected, and a second fixation. Including a second imaging step of acquiring a second frontal image of the fundus while presenting a second fixative target corresponding to the visual position to the eye to be inspected.
The fixative position setting step executes the setting of the one or more fixative positions based on the first front image and the second front image.
The fixative position setting step includes a step of specifying an overlapping region between the first front image and the second front image, and a step of setting one or more fixative positions based on the overlapping region. And including
A control method for an ophthalmologic imaging device, characterized in that. It is a method of controlling an ophthalmologic imaging device capable of applying imaging and optical coherence tomography (OCT) to the fundus of the eye to be inspected.
An imaging step of applying imaging to the fundus to acquire a frontal image while presenting a fixative target corresponding to a predetermined fixation position to the eye to be inspected.
A fixative position setting step for setting one or more fixative positions based on the front image acquired in the shooting step, and a fixative position setting step.
Two or more fixative targets corresponding to two or more fixative positions including the one or more fixative positions set in the fixative position setting step are sequentially presented to the eye to be inspected, and the two or more fixative targets are presented to the eye to be inspected. An OCT step of applying OCT to the fundus to acquire a three-dimensional image when each of the fixatives is presented to the eye to be inspected.
With the compositing step of forming a composite image of two or more three-dimensional images corresponding to the two or more fixation positions acquired in the OCT step.
Including
The fixative position setting step is one or more based on the positional relationship between the front image acquired in the imaging step, the imaging region in the imaging step, and the three-dimensional scanning region in the OCT step. Perform the fixative position setting and
The imaging step includes a first imaging step of acquiring a first frontal image of the fundus while presenting a first fixation target corresponding to the first fixation position to the eye to be inspected, and a second fixation. Including a second imaging step of acquiring a second frontal image of the fundus while presenting a second fixative target corresponding to the visual position to the eye to be inspected.
The fixative position setting step executes the setting of the one or more fixative positions based on the first front image and the second front image.
The first fixative position is a default fixative position for acquiring a frontal image centered on a predetermined portion of the fundus.
The second fixative position is a default fixative position for acquiring a frontal image centered on a position separated by a predetermined distance in a predetermined direction from the predetermined portion in the fundus of a standard eye.
A control method for an ophthalmologic imaging device, characterized in that. It is a method of controlling an ophthalmologic imaging device capable of applying imaging and optical coherence tomography (OCT) to the fundus of the eye to be inspected.
An imaging step of applying imaging to the fundus to acquire a frontal image while presenting a fixative target corresponding to a predetermined fixation position to the eye to be inspected.
A fixative position setting step for setting one or more fixative positions based on the front image acquired in the shooting step, and a fixative position setting step.
Two or more fixative targets corresponding to two or more fixative positions including the one or more fixative positions set in the fixative position setting step are sequentially presented to the eye to be inspected, and the two or more fixative targets are presented to the eye to be inspected. An OCT step of applying OCT to the fundus to acquire a three-dimensional image when each of the fixatives is presented to the eye to be inspected.
With the compositing step of forming a composite image of two or more three-dimensional images corresponding to the two or more fixation positions acquired in the OCT step.
Including
The fixative position setting step is one or more based on the positional relationship between the front image acquired in the imaging step, the imaging region in the imaging step, and the three-dimensional scanning region in the OCT step. Perform the fixative position setting and
The imaging step includes a first imaging step of acquiring a first frontal image of the fundus while presenting a first fixation target corresponding to the first fixation position to the eye to be inspected, and a second fixation. Including a second imaging step of acquiring a second frontal image of the fundus while presenting a second fixative target corresponding to the visual position to the eye to be inspected.
The fixative position setting step executes the setting of the one or more fixative positions based on the first front image and the second front image.
The fixative position setting step corrects the deviation of the second fixation position with respect to the first fixation position based on the first front image and the second front image. Set the above fixative position
A control method for an ophthalmologic imaging device, characterized in that. A program for causing an ophthalmologic imaging apparatus capable of applying imaging and optical coherence tomography (OCT) to the fundus of an eye to be examined to execute the control method according to any one of claims 7 to 9. A computer-readable non-temporary recording medium on which the program according to claim 10 is recorded.

Images