JP7134324B2 - OPHTHALMIC PHOTOGRAPHIC APPARATUS, CONTROL METHOD, PROGRAM, AND RECORDING MEDIUM THEREOF - Google Patents

Description

The present invention relates to an ophthalmologic imaging apparatus, its control method, program, and recording medium.

Image diagnosis occupies an important position in the field of ophthalmology. In recent years, utilization of optical coherence tomography (OCT) is progressing. OCT has come to be used not only for acquiring B-scan images and three-dimensional images of an eye to be inspected, but also for acquiring front images (en-face images) such as C-scan images and shadowgrams.

In addition, a modality that obtains an image in which a specific portion of the subject's eye is emphasized has also been put to practical use. For example, OCT-angiography, which forms an image in which retinal vessels and choroidal vessels are emphasized, has attracted attention (see, for example, Patent Document 1). In general, the tissue (structure) of the scan site does not change over time, but the blood flow portion inside the blood vessel changes over time. In OCT angiography, an image is formed by emphasizing a portion (blood flow signal) where such temporal changes exist. OCT angiography is also called OCT motion contrast imaging. Images obtained by OCT angiography are called angiographic images, angiograms, motion contrast images, and the like.

In a typical conventional OCT angiography, a three-dimensional scan of predetermined size (eg, 9 mm×9 mm) is applied to obtain an image representing the three-dimensional distribution of the fundus blood vessels. On the other hand, it is desired to acquire an angiographic image of a wider range. Panoramic imaging is known as a technique for acquiring OCT data of a wide range of the fundus (see Patent Document 2, for example).

Panorama imaging is an imaging technique that applies three-dimensional scanning to a plurality of different regions and synthesizes the resulting three-dimensional images to construct a wide-area image. An overlapping area is set in areas adjacent to each other, and relative positions between adjacent images are determined based on this overlapping area. In addition, sequential three-dimensional scanning of different regions is typically achieved by moving the fixation position. A wide-area image obtained by panoramic photography is called a panoramic image, a mosaic image, or the like.

By the way, there are individual differences in the size and characteristics of the eyeball. For example, the axial length of the eye and the diopter (eye refractive power) differ from person to person. As described above, even when three-dimensional scanning of a predetermined size is applied, the range of the fundus that is actually scanned varies depending on the axial length of the eye and the diopter.

For example, as shown in FIG. 1, when the OCT measurement light is incident at the same angle θ on the subject eye E1 with an axial length L1 and the subject eye E2 with an axial length L2 (>L1), the fundus of the subject eye E1 The height Y2 of the projection position of the measurement light on the fundus of the subject's eye E2 is larger than the height Y1 of the projection position of the measurement light on (Y2>Y1). That is, the longer the axial length of the eye, the higher the projection position of the measurement light on the fundus. On the other hand, the OCT scan size is defined by the maximum deflection angle of the measurement light. Therefore, even if the OCT scan size condition is the same, the range of the fundus that is actually scanned changes according to the value of the axial length of the eye. Diopter is also the same.

Since the actual scan range is affected by the eyeball parameters in this way, the size of the overlapping region in panoramic photography also changes according to the eyeball parameters. For example, when the axial length of the eye to be examined is long, the actual scan range is widened, so the overlapping area is also widened. If the overlapping area becomes wider than necessary, the range actually rendered by the mosaic image will become narrower, and the efficiency of panorama photography will decrease.

Conversely, when the axial length of the subject's eye is short, the actual scan range is narrow, so the overlapping area is also narrow, and in some cases the overlapping area is eliminated. If the overlapping area becomes narrow, there is a possibility that relative positions between adjacent images cannot be obtained with sufficient accuracy. Also, if there is no overlap region, the relative positions between adjacent images cannot be determined and a mosaic image cannot be constructed.

In addition, a situation may arise in which a site of interest (for example, the center of the macula) desired to be rendered in the central region of the mosaic image is not arranged as such.

Japanese translation of PCT publication No. 2015-515894 JP 2009-183332 A

An object of the present invention is to provide a technique that enables setting of a plurality of fixation positions for obtaining a mosaic image using OCT, regardless of individual differences in eyeball size and characteristics. It is in.

An ophthalmologic imaging apparatus according to an embodiment includes a fixation system that presents a fixation target to an eye to be examined, an imaging unit that photographs the fundus of the eye to be examined, and a fixation target corresponding to a predetermined fixation position to the eye to be examined. a control unit that executes fundus imaging control that controls the fixation system and the imaging unit so as to acquire a front image of the fundus while presenting; A fixation position setting unit that sets the above fixation position, an OCT image acquisition unit that acquires an image by applying optical coherence tomography (OCT) to the fundus, and an image acquired by the OCT image acquisition unit. and an image processing unit for processing, wherein the control unit sequentially selects two or more fixation targets corresponding to two or more fixation positions including the one or more fixation positions set by the fixation position setting unit. and acquiring a three-dimensional image of the fundus when each of the two or more fixation targets is presented to the eye to be examined. performing OCT control for controlling the OCT image acquisition unit, and combining the image processing unit to form a combined image of two or more three-dimensional images corresponding to the two or more fixation positions acquired by the OCT control; The fixation position setting unit includes a processing unit, and the fixation position setting unit adjusts the positional relationship between the front image acquired by the fundus imaging control and the imaging area in the fundus imaging control and the three-dimensional scanning area in the OCT control. The one or more fixation positions are set based on the control unit, and the control unit performs both the first control and the second control in the fundus imaging control performed prior to the OCT control. , the first control is performed by controlling the fixation system and the The imaging unit is controlled, and the second control acquires a second front image of the fundus while presenting a second fixation target corresponding to a second fixation position to the eye to be examined. Controlling a fixation system and the imaging unit, the fixation position setting unit setting the one or more fixation positions based on the first front image and the second front image. characterized by

According to the embodiment, it is possible to suitably set a plurality of fixation positions for acquiring a mosaic image using OCT regardless of individual differences in eyeball size and characteristics.

1 is a schematic diagram for explaining background art; FIG. 1 is a schematic diagram illustrating an example configuration of an ophthalmic imaging apparatus according to an exemplary embodiment; FIG. 1 is a schematic diagram illustrating an example configuration of an ophthalmic imaging apparatus according to an exemplary embodiment; FIG. 1 is a schematic diagram illustrating an example configuration of an ophthalmic imaging apparatus according to an exemplary embodiment; FIG. 1 is a schematic diagram illustrating an example configuration of an ophthalmic imaging apparatus according to an exemplary embodiment; FIG. FIG. 4 is a schematic diagram for explaining an example of the operation of an ophthalmic imaging apparatus according to an exemplary embodiment; FIG. 4 is a schematic diagram for explaining an example of the operation of an ophthalmic imaging apparatus according to an exemplary embodiment; 4 is a flow chart representing an example of the operation of an ophthalmic imaging apparatus according to an exemplary embodiment; FIG. 4 is a schematic diagram for explaining an example of the operation of an ophthalmic imaging apparatus according to an exemplary embodiment; FIG. 4 is a schematic diagram for explaining an example of the operation of an ophthalmic imaging apparatus according to an exemplary embodiment; FIG. 4 is a schematic diagram for explaining an example of the operation of an ophthalmic imaging apparatus according to an exemplary embodiment; FIG. 4 is a schematic diagram for explaining an example of the operation of an ophthalmic imaging apparatus according to an exemplary embodiment; FIG. 4 is a schematic diagram for explaining an example of the operation of an ophthalmic imaging apparatus according to an exemplary embodiment;

An ophthalmologic imaging apparatus, its control method, program, and recording medium according to exemplary embodiments will be described in detail with reference to the drawings. The ophthalmologic imaging apparatus of the embodiment is an ophthalmologic apparatus having a function of executing optical coherence tomography (OCT). The ophthalmic imaging apparatus of the embodiment may be capable of performing OCT angiography of the fundus.

An ophthalmologic imaging apparatus combining a swept-source OCT and a fundus camera will be described below, but embodiments are not limited to this. The type of OCT is not limited to swept source OCT, and may be spectral domain OCT, for example.

Swept source OCT divides light from a wavelength tunable light source (wavelength swept light source) into measurement light and reference light, and generates interference light by superimposing return light of the measurement light from the object on the reference light, This interference light is detected by a balanced photodiode or the like, and Fourier transform or the like is performed on the detection data collected according to the wavelength sweep and measurement light scanning to form an image.

Spectral domain OCT divides light from a low coherence light source into measurement light and reference light, generates interference light by superimposing the return light of the measurement light from the object on the reference light, and generates the interference light spectrum In this method, the distribution is detected by a spectrometer, and the detected spectral distribution is subjected to Fourier transform or the like to form an image.

Thus, the swept-source OCT is an OCT technique that acquires a spectral distribution by time division, and the spectral domain OCT is an OCT technique that acquires a spectral distribution by space division. Note that the OCT techniques that can be used in the embodiments are not limited to these, and embodiments that use arbitrary OCT techniques different from these (for example, time domain OCT) can also be adopted.

An ophthalmologic imaging apparatus according to an embodiment has a function of imaging the fundus of an eye to be examined to acquire a front image. Examples of ophthalmic modalities that can be used for fundus imaging include scanning laser ophthalmoscopes (SLOs), slit lamp microscopes, surgical microscopes, as well as fundus cameras as described below. Note that the ophthalmic modalities that can be used in the embodiments are not limited to these, and embodiments using modalities other than ophthalmic modalities can also be adopted.

In this specification, "image data" and "images" based thereon are not distinguished unless otherwise specified. In addition, unless otherwise specified, the site or tissue of the subject's eye is not distinguished from the image representing it.

<Constitution>
The exemplary ophthalmic imaging apparatus 1 shown in FIG. 2 includes a fundus camera unit 2, an OCT unit 100, and an arithmetic and control unit 200. As shown in FIG. The fundus camera unit 2 is provided with an optical system and a mechanism for acquiring a front image of the eye to be examined E and an optical system and a mechanism for executing OCT. The OCT unit 100 is provided with an optical system and a mechanism for performing OCT. The arithmetic control unit 200 includes one or more processors configured to perform various types of processing (calculation, control, etc.). In addition to these, optional parts such as a member for supporting the subject's face (chin rest, forehead rest, etc.) and a lens unit for switching the site to which OCT is applied (for example, attachment for anterior segment OCT) elements or units may be provided in the ophthalmologic imaging apparatus 1 .

In this specification, the "processor" includes, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), a programmable logic device (e.g., SPLD (Simple Programmable Logic Device (CPLD) Programmable Logic Device), FPGA (Field Programmable Gate Array)) or the like. The processor implements the functions according to the embodiment by, for example, reading and executing a program stored in a storage circuit or storage device.

<Fundus camera unit 2>
The fundus camera unit 2 is provided with an optical system for photographing the fundus Ef of the eye E to be examined. The acquired digital image of the fundus oculi Ef (called a fundus image, a fundus photograph, etc.) is generally a front image such as an observed image or a photographed image. Observation images are obtained by moving image shooting using near-infrared light. The photographed image is a still image using flash light in the visible region.

The fundus camera unit 2 includes an illumination optical system 10 and an imaging optical system 30 . The illumination optical system 10 irradiates the eye E to be inspected with illumination light. The imaging optical system 30 detects return light of the illumination light with which the eye E to be examined is irradiated. Measurement light from the OCT unit 100 is guided to the subject's eye E through an optical path in the fundus camera unit 2 . Return light of the measurement light projected onto the eye E (for example, the fundus oculi Ef) is guided to the OCT unit 100 through the same optical path in the fundus camera unit 2 .

Light (observation illumination light) output from the observation light source 11 of the illumination optical system 10 is reflected by the concave mirror 12, passes through the condenser lens 13, passes through the visible cut filter 14, and becomes near-infrared light. Further, the observation illumination light is once converged in the vicinity of the photographing light source 15, reflected by the mirror 16, passed through the relay lens system 17, the relay lens 18, the diaphragm 19, and the relay lens system 20, to the perforated mirror 21. be guided. The observation illumination light is reflected by the periphery of the perforated mirror 21 (area around the perforation), passes through the dichroic mirror 46, is refracted by the objective lens 22, and illuminates the eye E (fundus oculi Ef). do. The return light of the observation illumination light from the subject's eye E is refracted by the objective lens 22, passes through the dichroic mirror 46, passes through the hole formed in the central region of the apertured mirror 21, and passes through the dichroic mirror 55. , through a focusing lens 31 and reflected by a mirror 32 . Further, this return light passes through the half mirror 33A, is reflected by the dichroic mirror 33, and is imaged on the light receiving surface of the image sensor 35 by the imaging lens . The image sensor 35 detects returned light at a predetermined frame rate. Note that the focus of the imaging optical system 30 is adjusted so as to match the fundus oculi Ef or the anterior segment of the eye.

The light (imaging illumination light) output from the imaging light source 15 irradiates the fundus oculi Ef through the same path as the observation illumination light. The return light of the imaging illumination light from the subject's eye E is guided to the dichroic mirror 33 through the same path as the return light of the observation illumination light, passes through the dichroic mirror 33 , is reflected by the mirror 36 , is reflected by the imaging lens 37 . An image is formed on the light receiving surface of the image sensor 38 .

A liquid crystal display (LCD) 39 displays a fixation target (fixation target image). A part of the light beam output from the LCD 39 is reflected by the half mirror 33 A, reflected by the mirror 32 , passes through the focusing lens 31 and the dichroic mirror 55 , and passes through the aperture of the apertured mirror 21 . The luminous flux that has passed through the aperture of the perforated mirror 21 is transmitted through the dichroic mirror 46, refracted by the objective lens 22, and projected onto the fundus oculi Ef. A fixation target is typically used for eye guidance and fixation. The direction in which the line of sight of the subject's eye E is guided (and fixed), that is, the direction in which fixation of the subject's eye E is encouraged is called a fixation position.

By changing the display position of the fixation target image on the screen of the LCD 39, the fixation position of the subject's eye E by the fixation target can be changed. Examples of fixation positions include a fixation position for acquiring an image centered on the macula, a fixation position for acquiring an image centered on the optic disc, and a position between the macula and the optic disc ( There is a fixation position for acquiring an image centered on the center of the eye fundus, and a fixation position for acquiring an image of a site far away from the macula (eye fundus periphery).

A graphical user interface (GUI) or the like may be provided for specifying at least one such exemplary fixation position. Further, a GUI or the like for manually moving the fixation position (the display position of the fixation target) can be provided. It is also possible to apply a configuration that automatically sets the fixation position.

A configuration for presenting a fixation target whose fixation position is changeable to the eye to be examined E is not limited to a display device such as an LCD. For example, a device (fixation matrix) in which a plurality of light-emitting units (light-emitting diodes, etc.) are arranged in a matrix can be employed instead of the display device. In this case, the fixation position of the subject's eye E by the fixation target can be changed by selectively lighting a plurality of light emitting units. As another example, a device with one or more movable light emitters can generate a fixation target whose fixation position can be changed.

The alignment optical system 50 generates an alignment index used for alignment of the optical system with respect to the eye E to be examined. Alignment light output from a light-emitting diode (LED) 51 passes through a diaphragm 52, a diaphragm 53, and a relay lens 54, is reflected by a dichroic mirror 55, passes through the hole of the perforated mirror 21, and passes through the dichroic mirror 46. It is transmitted and projected onto the subject's eye E via the objective lens 22 . Return light of the alignment light from the subject's eye E (corneal reflected light, etc.) is guided to the image sensor 35 through the same path as return light of the observation illumination light. Manual alignment or automatic alignment can be performed based on the received light image (alignment index image).

The focus optical system 60 generates a split index used for focus adjustment of the eye E to be examined. The focus optical system 60 is moved along the optical path of the illumination optical system 10 (illumination optical path) in conjunction with the movement of the imaging focusing lens 31 along the optical path of the imaging optical system 30 (imaging optical path). The reflecting bar 67 is inserted into and removed from the illumination optical path. When performing focus adjustment, the reflecting surface of the reflecting bar 67 is arranged at an angle in the illumination optical path. Focus light output from the LED 61 passes through a relay lens 62, is split into two light beams by a split index plate 63, passes through a two-hole diaphragm 64, is reflected by a mirror 65, and is reflected by a condenser lens 66 onto a reflecting rod 67. is once imaged on the reflective surface of , and then reflected. Further, the focused light passes through the relay lens 20 , is reflected by the perforated mirror 21 , passes through the dichroic mirror 46 , and is projected onto the subject's eye E via the objective lens 22 . The return light of the focus light from the subject's eye E (reflected light from the fundus, etc.) is guided to the image sensor 35 through the same path as the return light of the alignment light. Manual focusing and autofocusing can be performed based on the received light image (split index image).

Diopter correction lenses 70 and 71 can be selectively inserted in the imaging optical path between the apertured mirror 21 and the dichroic mirror 55 . The dioptric correction lens 70 is a plus lens (convex lens) for correcting high hyperopia. The dioptric correction lens 71 is a minus lens (concave lens) for correcting strong myopia.

The dichroic mirror 46 synthesizes the fundus imaging optical path and the OCT optical path (measurement arm). The dichroic mirror 46 reflects light in the wavelength band used for OCT and transmits light for fundus imaging. The measurement arm is provided with a collimator lens unit 40, a retroreflector 41, a dispersion compensation member 42, an OCT focusing lens 43, an optical scanner 44, and a relay lens 45 in order from the OCT unit 100 side.

The retroreflector 41 is movable in the direction of the arrow shown in FIG. 2, thereby changing the length of the measuring arm. The change in measurement arm length is used, for example, for optical path length correction according to the axial length of the eye, adjustment of the interference state, and the like.

The dispersion compensating member 42 works together with a dispersion compensating member 113 (described later) arranged on the reference arm to match the dispersion characteristics of the measurement light LS and the reference light LR.

An OCT focusing lens 43 is moved along the measuring arm to focus the measuring arm. In addition, the movement of the imaging focusing lens 31, the movement of the focusing optical system 60, and the movement of the OCT focusing lens 43 can be controlled in a coordinated manner.

The optical scanner 44 is substantially arranged at a position optically conjugate with the pupil of the eye E to be examined. A light scanner 44 deflects the measuring light LS guided by the measuring arm. The optical scanner 44 is, for example, a galvanometer scanner capable of two-dimensional scanning. Typically, the optical scanner 44 includes a one-dimensional scanner (x-scanner) for deflecting the measurement light in the ±x directions and a one-dimensional scanner (y-scanner) for deflecting the measurement light in the ±y directions. including. In this case, for example, either one of these one-dimensional scanners is placed at a position optically conjugate with the pupil, or a position optically conjugate with the pupil is placed between these one-dimensional scanners.

<OCT unit 100>
The exemplary OCT unit 100 shown in FIG. 3 is provided with optics for performing swept-source OCT. This optical system includes interference optics. This interference optical system divides the light from the wavelength tunable light source into measurement light and reference light, and superimposes the return light of the measurement light projected on the subject's eye E and the reference light that has passed through the reference optical path to obtain interference light. and detect this interference light. Data (detection signal) obtained by detecting the interference light is a signal representing the spectrum of the interference light and is sent to the arithmetic control unit 200 .

The light source unit 101 includes, for example, a near-infrared tunable laser that changes the wavelength of emitted light at high speed. The light L0 output from the light source unit 101 is guided to the polarization controller 103 by the optical fiber 102, and the polarization state is adjusted. Further, the light L0 is guided by the optical fiber 104 to the fiber coupler 105 and split into the measurement light LS and the reference light LR. The optical path of the measurement light LS is called a measurement arm or the like, and the optical path of the reference light LR is called a reference arm or the like.

The reference light LR generated by the fiber coupler 105 is guided by the optical fiber 110 to the collimator 111 , converted into a parallel beam, and guided to the retroreflector 114 via the optical path length correction member 112 and the dispersion compensation member 113 . The optical path length correction member 112 acts to match the optical path length of the reference light LR and the optical path length of the measurement light LS. The dispersion compensation member 113 works together with the dispersion compensation member 42 arranged on the measurement arm to match the dispersion characteristics between the reference light LR and the measurement light LS. The retroreflector 114 is movable along the optical path of the reference beam LR incident on it, thereby changing the length of the reference arm. A change in the reference arm length is used, for example, for optical path length correction according to the axial length of the eye, adjustment of the interference state, and the like.

The reference light LR that has passed through the retroreflector 114 passes through the dispersion compensating member 113 and the optical path length correcting member 112 , is converted by the collimator 116 from a parallel beam into a focused beam, and enters the optical fiber 117 . The reference light LR incident on the optical fiber 117 is guided to the polarization controller 118 to have its polarization state adjusted, guided to the attenuator 120 through the optical fiber 119 to have its light amount adjusted, and passed through the optical fiber 121 to the fiber coupler 122. be guided.

On the other hand, the measurement light LS generated by the fiber coupler 105 is guided to the collimator lens unit 40 through the optical fiber 127 and converted into a parallel light beam, which is then converted into a parallel light beam by the retroreflector 41, the dispersion compensating member 42, the OCT focusing lens 43, and the optical scanner 44. , and a relay lens 45, reflected by a dichroic mirror 46, refracted by an objective lens 22, and projected onto an eye E to be examined. The measurement light LS is scattered and reflected at various depth positions of the eye E to be examined. The return light of the measurement light LS from the subject's eye E travels in the opposite direction through the measurement arm, is guided to the fiber coupler 105 , and reaches the fiber coupler 122 via the optical fiber 128 .

The fiber coupler 122 superimposes the measurement light LS input via the optical fiber 128 and the reference light LR input via the optical fiber 121 to generate interference light. The fiber coupler 122 splits the generated interference light at a predetermined splitting ratio (for example, 1:1) to generate a pair of interference lights LC. A pair of interference lights LC are guided to detector 125 through optical fibers 123 and 124, respectively.

Detector 125 includes, for example, a balanced photodiode. A balanced photodiode includes a pair of photodetectors that respectively detect a pair of interference lights LC, and outputs a difference between a pair of detection signals obtained by these. Detector 125 sends this output (a detected signal such as a differential signal) to data acquisition system (DAQ) 130 .

A clock KC is supplied from the light source unit 101 to the data collection system 130 . The clock KC is generated in the light source unit 101 in synchronization with the output timing of each wavelength swept within a predetermined wavelength range by the wavelength tunable light source. The light source unit 101, for example, splits the light L0 of each output wavelength to generate two split lights, optically delays one of these split lights, combines these split lights, and produces the resulting combined light. A clock KC is generated based on the detection signal. The data acquisition system 130 samples the detection signal (difference signal) input from the detector 125 based on the clock KC. Data collection system 130 sends the data obtained by this sampling to arithmetic and control unit 200 .

In this example, both an element for changing the measurement arm length (eg retroreflector 41) and an element for changing the reference arm length (eg retroreflector 114 or reference mirror) are provided. However, only one of these elements may be provided. Also, the elements for changing the difference (optical path length difference) between the measurement arm length and the reference arm length are not limited to these, and arbitrary elements (optical members, mechanisms, etc.) can be adopted. .

<Arithmetic control unit 200>
The arithmetic control unit 200 controls each part of the retinal camera unit 2 , the display device 3 and the OCT unit 100 . Further, the arithmetic control unit 200 executes various kinds of arithmetic processing. For example, the arithmetic and control unit 200 performs signal processing such as Fourier transform on the spectral distribution based on the group of sampling data obtained by the data acquisition system 130 for each series of wavelength scans (for each A line), so that each A Form a reflection intensity profile in the line. Furthermore, the arithmetic and control unit 200 forms image data by imaging the reflection intensity profile of each A line. Arithmetic processing therefor is the same as in conventional swept source OCT.

The arithmetic control unit 200 includes, for example, a processor, RAM (Random Access Memory), ROM (Read Only Memory), hard disk drive, communication interface, and the like. Various computer programs are stored in a storage device such as a hard disk drive. The arithmetic and control unit 200 may include an operation device, an input device, a display device, and the like.

<Control system>
An example of the configuration of the control system (processing system) of the ophthalmologic imaging apparatus 1 is shown in FIGS. 4 and 5. FIG. The control section 210, the image forming section 220 and the data processing section 230 are provided in the arithmetic control unit 200, for example.

<Control unit 210>
The control unit 210 includes a processor and controls each unit of the ophthalmologic imaging apparatus 1 . Control unit 210 includes main control unit 211 and storage unit 212 .

<Main control unit 211>
The main control unit 211 includes a processor and controls each element of the ophthalmologic imaging apparatus 1 (including the elements shown in FIGS. 2 to 5). The main control unit 211 is implemented by cooperation of hardware including circuits and control software.

The photographic focusing lens 31 arranged in the photographic optical path and the focusing optical system 60 arranged in the illumination optical path are moved by a photographic focusing driving section (not shown) under the control of the main control section 211 . A retroreflector 41 provided on the measurement arm is moved by a retroreflector (RR) driving section 41A under the control of the main control section 211 . The OCT focus lens 43 placed on the measurement arm is moved by the OCT focus driver 43A under control of the main controller 211 . The optical scanner 44 provided on the measurement arm operates under the control of the main controller 211 . A retroreflector 114 located on the reference arm is moved by a retroreflector (RR) driver 114A under the control of the main controller 211 . Each of these drive units includes an actuator such as a pulse motor that operates under control of the main control unit 211 .

The moving mechanism 150 moves, for example, at least the retinal camera unit 2 three-dimensionally. In a typical example, the moving mechanism 150 includes an x stage that can move in ±x directions (horizontal direction), an x moving mechanism that moves the x stage, and a y stage that can move in ±y directions (vertical direction). , a y-moving mechanism for moving the y-stage, a z-stage movable in the ±z direction (depth direction), and a z-moving mechanism for moving the z-stage. Each of these moving mechanisms includes an actuator such as a pulse motor that operates under control of the main control section 211 .

<Storage unit 212>
The storage unit 212 stores various data. The data stored in the storage unit 212 includes, for example, image data of an OCT image, image data of a fundus image, information on an eye to be examined, and the like. The eye information to be examined includes subject information such as a patient ID and name, left/right eye identification information, electronic medical record information, and the like.

The storage unit 212 may store positional relationship information indicating a positional relationship between an imaging range (fundus imaging region) in fundus photography and a range (three-dimensional scanning region) to which three-dimensional OCT scanning is applied. . The fundus photographing area may be defined, for example, by the features (for example, shape and size) of the area rendered as the front image by the fundus photographing function of the ophthalmic photographing apparatus 1 . Also, the three-dimensional scan area may be defined, for example, by the features (eg, shape and size) of the area rendered as a three-dimensional image by the OCT function of the ophthalmologic imaging apparatus 1 .

Here, the feature of the area rendered as the 3D image may be the feature of the area rendered as the rendered image of the 3D image. As a specific example, the feature of the area rendered as a 3D image is the feature of the area rendered in the projection image obtained by projecting the 3D image in the z direction, or the feature of the area rendered in the projection image obtained by projecting the 3D image in the z direction. (eg, two-dimensional shape, area, perimeter, diameter).

A projection image and a shadowgram are front images, and can be defined in the same two-dimensional coordinate system (xy coordinate system) as the front image obtained by the fundus imaging function. When considering a three-dimensional image instead of such a two-dimensional image, the defining coordinate system (xy coordinate system) of the front image obtained by the fundus imaging function is changed to the defining coordinate system (xyz coordinate system) of the three-dimensional image. It can be embedded.

In this embodiment, the fundus imaging optical path and the OCT optical path (measurement arm) are coupled by the dichroic mirror 46, as described above. More specifically, the dichroic mirror 46 coaxially couples the fundus imaging optical path and the measurement arm. That is, the dichroic mirror 46 couples the fundus imaging optical path and the measurement arm so that the optical axis of the fundus imaging optical path and the optical axis of the measurement arm intersect.

Furthermore, as mentioned above, the dimensions of the OCT scan are defined by the maximum deflection angle of the measurement light. Therefore, in the present embodiment, the three-dimensional scan area is defined by the maximum deflection angles (maximum deflection angle in the x direction and maximum deflection angle in the y direction) of the measurement light LS by the optical scanner 44 .

In addition, in this embodiment, as in a typical fundus camera, an optical member (field diaphragm) for defining the contour of the fundus imaging area is arranged, or A digital aperture is set for the image sensors 35 and 38 at .

An example of the positional relationship between the fundus imaging area and the three-dimensional scanning area will be described with reference to FIG. Reference numeral 300 indicates the optical axis (objective optical axis) 300 of the objective lens 22, reference numeral 310 indicates the fundus imaging area (its contour), and reference numeral 320 indicates the three-dimensional scanning area (its contour). The fundus imaging area 310 is circular and its center is located on the objective optical axis 300 . The three-dimensional scan area 320 is square and its center is located on the objective optical axis 300 . That is, in this example, the fundus imaging area 310 and the three-dimensional scanning area 320 are arranged coaxially with each other. Also, the fundus imaging area 310 truly includes the three-dimensional scan area 320 .

The shape and/or size of the fundus imaging area 310 may be fixed or variable. Changing the shape and/or size of the fundus imaging region 310 can be accomplished, for example, by selecting a field diaphragm, controlling the aperture size of the field diaphragm, or controlling a digital diaphragm.

The shape and/or dimensions of the three-dimensional scan area 320 may be fixed or variable. Changing the shape and/or dimensions of the three-dimensional scan area 320 can be achieved, for example, by controlling the optical scanner 44 (eg, controlling the maximum deflection angle, controlling the x-scanner, controlling the y-scanner, controlling the x-scanner and y-scanner linked control).

The relative position between the fundus imaging area 310 and the three-dimensional scanning area 320 may be fixed or variable. Changing the relative position between the fundus imaging area 310 and the 3D scanning area 320 can be done, for example, by one or a combination of two or more of the following controls: the shape of the fundus imaging area 310; change the position of the fundus imaging area 310; change the shape and/or size of the three-dimensional scan area 320; change the position of the three-dimensional scan area 320. Here, changing the position of the fundus imaging region 310 can be realized by, for example, selecting the imaging field diaphragm, controlling the opening position of the imaging field diaphragm, or controlling the digital diaphragm. Further, the change of the position of the three-dimensional scan area 320 can be realized by controlling the optical scanner 44, for example.

When the fundus imaging region 310 and the 3D scanning region 320 are arranged non-coaxially with each other, for example, the relative displacement between the center of the fundus imaging region 310 and the center of the 3D scanning region 320 and/or the fundus The relative position between the contour of the imaging region 310 and the contour of the 3D scanning region 320 allows the relative position between the fundus imaging region 310 and the 3D scanning region 320 to be determined in advance or at any time. .

In the present embodiment, the positional relationship between the fundus imaging region 310 and the three-dimensional scanning region 320 obtained according to any of the above examples is stored as positional relationship information in the storage unit 212 in advance or at any time. be. Such positional relationship information includes, for example, relative position information between the fundus imaging region 310 and the three-dimensional scan region 320 as illustrated in FIG. 6, setting information and/or control information regarding the fundus imaging region 310, and At least one of setting information and/or control information regarding the 3D scan area 320 may be included.

<Image forming unit 220>
The image forming section 220 forms image data based on the data collected by the data collection system 130 . Image forming unit 220 includes a processor. The image forming unit 220 is implemented by cooperation of hardware including circuits and image forming software.

The image forming section 220 forms cross-sectional image data based on the data collected by the data collection system 130 . This processing includes signal processing such as denoising (noise reduction), filtering, and fast Fourier transform (FFT), similar to conventional swept-source OCT.

The image data formed by the image forming unit 220 is a group of images formed by imaging reflection intensity profiles in a plurality of A-lines (scan lines along the z-direction) arranged in the area to which the OCT scan is applied. 1 is a data set containing image data (a group of A-scan image data);

The image data formed by the image forming unit 220 is, for example, one or more B-scan image data, or stack data formed by embedding a plurality of B-scan image data in a single three-dimensional coordinate system. The image forming unit 220 can also form volume data (voxel data) by voxelizing the stack data. Stack data and volume data are typical examples of three-dimensional image data represented by a three-dimensional coordinate system.

When OCT angiography is performed, the main controller 211 repeatedly scans the same region of the fundus oculi Ef a predetermined number of times. Imager 220 may form motion contrast images based on the data sets collected by data collection system 130 in this repeated scan. This motion contrast image is an angiographic image obtained by emphasizing temporal changes in interference signals caused by blood flow in the fundus oculi Ef. Typically, OCT angiography is applied to a three-dimensional region of the fundus oculi Ef to obtain an image representing the three-dimensional distribution of blood vessels in the fundus oculi Ef.

The image forming section 220 can process three-dimensional image data. For example, the image forming unit 220 can construct new image data by applying rendering to the 3D image data. Rendering techniques include volume rendering, maximum intensity projection (MIP), minimum intensity projection (MinIP), surface rendering, and multiplanar reconstruction (MPR). Further, the image forming unit 220 can construct projection data by projecting the three-dimensional image data in the z direction (A-line direction, depth direction). Also, the image forming unit 220 can construct a shadowgram by projecting a portion of the three-dimensional image data in the z-direction. A part of the three-dimensional image data projected to construct the shadowgram is set using, for example, segmentation, which will be described later.

When OCT angiography is performed, the image forming unit 220 can construct arbitrary two-dimensional angiographic image data and/or arbitrary pseudo three-dimensional angiographic image data from the three-dimensional angiographic image data. is. For example, the image forming unit 220 can construct two-dimensional angiographic image data representing an arbitrary section of the fundus oculi Ef by applying multi-planar reconstruction to the three-dimensional angiographic image data. It is also possible to project the 3D angiographic image data or a portion thereof in the z-direction to construct frontal angiographic image data.

<Data processing unit 230>
The data processing unit 230 executes various data processing. For example, the data processing unit 230 can apply image processing or analysis processing to OCT image data, or apply image processing or analysis processing to observed image data or photographed image data. The data processing unit 230 includes, for example, at least one of a processor and a dedicated circuit board.

A configuration of an exemplary data processing unit 230 is shown in FIG. The data processing section 230 of this example includes a fixation position setting section 231 and an image processing section 232 . The fixation system 250 is configured to present a fixation target to the eye E to be examined. The fixation system 250 of this example includes the LCD 39 and an optical system for projecting the light flux output from the LCD 39 onto the fundus oculi Ef. Further, the OCT image acquisition unit 260 is configured to acquire an image by applying OCT to the fundus Ef of the eye E to be examined. The OCT image acquisition section 260 of this example includes a group of elements forming a measurement arm provided in the retinal camera unit 2 , a group of elements provided in the OCT unit 100 , and an image forming section 220 . Further, the photographing unit 270 is configured to photograph the fundus oculi Ef. The imaging unit 270 of this example includes the illumination optical system 10 and the imaging optical system 30 .

<Fixation position setting unit 231>
The fixation position setting unit 231 sets a fixation position for applying OCT to the fundus oculi Ef. In particular, the fixation position setting unit 231 can set a fixation position for applying panoramic imaging (panoramic OCT) to the fundus oculi Ef based on the front image of the fundus oculi Ef acquired by the imaging unit 270. be. Processing that can be executed by the fixation position setting unit 231 of this example will be described later.

<Image processing unit 232>
The image processing section 232 processes the OCT images acquired by the OCT image acquisition section 260 . For example, the image processor 232 can apply segmentation to two-dimensional cross-sectional image data or three-dimensional image data. Segmentation is the process of identifying subregions in an image. Typically, segmentation is used to identify image regions corresponding to predetermined tissues of the fundus oculi Ef.

As described above, the imaging unit 220 can project the image regions identified by the segmentation in the z-direction to construct a shadowgram (such as frontal angiography image data). Examples of shadowgrams include shadowgrams corresponding to arbitrary depth regions of the fundus oculi Ef (e.g., superficial retina, deep retina, choroidal capillary plate, sclera, etc.) and arbitrary tissues (e.g., internal limiting membrane, Nerve fiber layer, ganglion cell layer, inner reticular layer, inner nuclear layer, outer reticular layer, outer nuclear layer, outer limiting membrane, retinal pigment epithelium, Bruch's membrane, choroid, choroid-scleral junction, sclera, any of these , a combination of at least two of these, etc.).

The image processing unit 232 may be capable of processing images (observed images, captured images, etc.) acquired by the imaging unit 270 and processing images acquired by other ophthalmologic imaging devices. For example, the image processing unit 232 analyzes the front image of the fundus oculi Ef acquired by the imaging unit 270 to specify an image region corresponding to a predetermined portion (macula, optic papilla, etc.) of the fundus oculi Ef, or It is possible to specify an image region corresponding to the contour of a predetermined portion of the eye fundus Ef, and to specify pixels corresponding to predetermined positions (macular center, papilla center, etc.) of the fundus oculi Ef. This processing may include thresholding of pixel values, edge detection, template matching, and the like.

The image processing unit 232 includes an image processing processor and an image analysis processor. The image processor is implemented by cooperation of hardware including circuits and image processing software. Also, the image analysis processor is realized by cooperation of hardware including a circuit and image analysis software.

Processing that can be executed by the image processing unit 232 of this example will be described later.

<Synthesis processing unit 2321>
The image processing section 232 includes a composition processing section 2321 . The composition processing unit 2321 forms a composite image of two or more three-dimensional images acquired corresponding to two or more different fixation positions in panoramic photography. Processing that can be executed by the composition processing unit 2321 of this example will be described later.

<User Interface 240>
User interface 240 includes display unit 241 and operation unit 242 . Display unit 241 includes display device 3 . The operation unit 242 includes various operation devices and input devices. The user interface 240 may include a device, such as a touch panel, that combines a display function and an operation function. It is also possible to construct embodiments that do not include at least a portion of user interface 240 . For example, the display device may be an external device connected to the ophthalmic imaging equipment.

<About panorama shooting>
Panoramic photography that can be performed in this example will be described. In this example, the front image of the fundus oculi Ef acquired by the imaging unit 270 is used to set the fixation position for panoramic imaging. This preliminary fundus photography includes, for example, a first preliminary fundus photography for setting the central position of panoramic photography and a plurality of fixation positions for multiple OCT performed in panoramic photography. and a second preliminary fundus photography. Note that execution of the first preliminary fundus photographing is optional. The second preliminary fundus photography may be performed without the first preliminary fundus photography.

<Regarding the first preliminary fundus photography, etc.>
A first example of preliminary fundus photography will be described. In the first preliminary fundus photography, the main control unit 211 presents the eye E to be examined with a first fixation target for obtaining a front image centering on a predetermined portion of the fundus oculi Ef. The fixation system 250 and the imaging unit 270 are controlled to acquire a front image (referred to as a preliminary front image). In this example, the macula (macular center, fovea centralis) is used as a typical example of the predetermined site (that is, the first fixation position), but other sites of the fundus (eg, the optic papilla or the fundus center) are used as the predetermined sites. It may be a part.

The image processing unit 232 calculates the deviation of the image of the predetermined portion of the fundus oculi Ef with respect to the central position of the preliminary front image.

For example, the image processing unit 232 first analyzes the preliminary front image to obtain the coordinates of the pixel corresponding to the center of the macula. Subsequently, the image processing unit 232 obtains the difference between the specified coordinates of the center of the macula and the coordinates of the center position of the preliminary front image. The difference between the coordinates of the macula center and the coordinates of the center position of the preliminary frontal image is the deviation of the actual macula center relative to the center position of the fundus imaging area (field) applied in the first preliminary fundus photography. corresponds to

Based on the deviation obtained by the image processing unit 232, the fixation position setting unit 231 can correct the first fixation position. For example, the fixation position setting unit 231 corrects the first fixation position so that the deviation obtained by the image processing unit 232 is canceled (that is, the deviation becomes zero). As a result, the central position of the fundus imaging region (the central position of the panorama imaging) substantially coincides with the site (macular center) corresponding to the first fixation position.

Furthermore, the fixation position setting section 231 can correct the default second fixation position. As a specific example, the fixation position setting unit 231 sets the same correction amount as the first fixation position so that the relative position between the first fixation position and the second fixation position is maintained. Quantity is applied to the second fixation position. That is, the fixation position setting section 231 applies a correction amount corresponding to the inverse vector of the deflection (vector) obtained by the image processing section 232 to the second fixation position.

The main control unit 211 can apply the first fixation position and the second fixation position corrected by the fixation position setting unit 231 to perform second preliminary fundus photography.

<Second preliminary fundus photography, etc.>
A second example of preliminary fundus photography will be described. In the second preliminary fundus imaging, the main controller 211 executes first control and second control. In the first control, the main control unit 211 presents the first fixation target corresponding to the first fixation position to the eye E to be examined, and displays a front image of the fundus oculi Ef (referred to as a first front image). The fixation system 250 and the imaging unit 270 are controlled so as to acquire. Similarly, in the second control, the main control unit 211 presents the second fixation target corresponding to the second fixation position to the subject's eye E, and presents the front image of the fundus oculi Ef (the second front image). control the fixation system 250 and the imaging unit 270 so as to acquire the

In the first control, the main control unit 211 controls the fixation system 250 to display the fixation target at the display position (pixel) of the LCD 39 corresponding to the first fixation position, and The photographing unit 270 is controlled so as to photograph the fundus oculi Ef in this state. Thereby, a first frontal image corresponding to the first fixation position is obtained.

Similarly, in the second control, the main control unit 211 controls the fixation system 250 to display the fixation target at the display position (pixel) of the LCD 39 corresponding to the second fixation position, In addition, the photographing unit 270 is controlled so as to photograph the fundus oculi Ef in that state. A second frontal image corresponding to the second fixation position is thereby obtained.

Here, the first fixation position is a default fixation position for acquiring a front image centered on a predetermined site of the fundus. It may be a fixation position for Also, the second fixation position is, for example, a default fixation position for acquiring a frontal image centered at a position a predetermined distance away from the predetermined site in a predetermined direction in the fundus of a standard eye. you can

An example of a first fixation position and a second fixation position is shown in FIG. Reference numeral 411 denotes a first fixation target (macular fixation target) corresponding to the first fixation position (macular center). Reference numeral 412 denotes a fundus imaging area (macula imaging area) centered on the first fixation position. Reference numeral 413 denotes a three-dimensional scanning area (macula scanning area) centered on the first fixation position. In this example, the positional relationship between the macular imaging range 412 and the macular scanning range 413 corresponds to the positional relationship information stored in the storage unit 212 (see FIG. 6).

Reference numeral 421 denotes a second fixation target (peripheral fixation target) corresponding to the second fixation position (a position a predetermined distance away from the center of the macula in the lower left direction). Reference numeral 422 denotes a fundus imaging area (peripheral imaging range) centered on the second fixation position. Reference numeral 423 indicates a three-dimensional scan area (peripheral scan range) centered on the second fixation position. In this example, the positional relationship between the peripheral imaging range 422 and the peripheral scanning range 423 is the same as the positional relationship between the macular imaging range 412 and the macular scanning range 413, and the positional relationship information stored in the storage unit 212 is corresponds to

In FIG. 7, reference numeral 432 denotes an overlapping region (overlapping imaging range) between the macular imaging range 412 and the peripheral imaging range 422, and reference numeral 433 denotes an overlapping region between the macular scanning range 413 and the peripheral scanning range 423. (overlapping scan range) is shown. As described above, since the positional relationship between the macular imaging range 412 and the macular scanning range 413 corresponds to the positional relationship information, this positional relationship is substantially fixed. Similarly, since the positional relationship between the peripheral imaging range 422 and the peripheral scanning range 423 corresponds to positional relationship information, this positional relationship is also substantially fixed. Therefore, if one of the overlapping imaging range 432 and the overlapping scanning range 433 is determined, the other is also determined.

As shown in FIG. 7, it is assumed that the second fixation position (periphery fixation target 421) is arranged at the lower left of the first fixation position (macula fixation target 411). When the subject's eye E is a standard eye, as shown in FIG. 7, the macular fixation target 411 is arranged at the upper right corner of the overlapping scan range 433, and the peripheral fixation target 421 is arranged at the lower left corner. . That is, the first fixation position (macular fixation target 411) and the second fixation position (peripheral fixation target 411) are arranged so that such an arrangement is realized when the subject's eye E is a standard eye. The positional relationship with the visual target 421) is set in advance. Typically, when the eye to be examined E is a standard eye, the macular fixation target 411 is arranged in a predetermined allowable range in the upper right corner, and the peripheral fixation target is arranged in a predetermined allowable range in the lower left corner. An overlapping scan range 433 is obtained having dimensions such that 421 is located. As described above, since there is a certain relationship between the overlapping imaging range 432 and the overlapping scanning range 433, the dimensions of the overlapping scanning range 433 obtained when the subject's eye E is a standard eye are determined in advance. It is possible to

Here, a standard eye typically means an eye whose axial length falls within a standard range (for example, an eye that is neither long-axis long eye nor short-axis long eye), and/or diopter is an eye in the standard range (eg, an eye that is neither myopic nor hyperopic).

On the other hand, for example, when the axial length of the eye to be examined E is shorter than the standard, the dimension of the macular imaging range is smaller than the dimension of the macular imaging range 412 for a standard eye, and The size of the peripheral field of view is also smaller than the peripheral field of view 422 for a standard eye. Therefore, the dimensions of the overlapping imaging range when the axial length of the subject's eye E is shorter than the standard are smaller than the overlapping imaging range 432 for the standard eye. In this case, the macular fixation target 411 is not placed in the predetermined allowable range of the upper right corner of the overlapping scan range, and/or the peripheral fixation target 421 is not placed in the predetermined allowable range of the lower left corner.

Conversely, when the axial length of the eye to be examined E is longer than the standard, the dimension of the macular imaging range is larger than the dimension of the macular imaging range 412 for a standard eye, and The size of the field of view is also larger than the peripheral field of view 422 for a standard eye. Therefore, the dimensions of the overlapped imaging range when the axial length of the subject's eye E is longer than the standard are larger than the overlapped imaging range 432 for a standard eye. Also in this case, the macular fixation target 411 is not placed in the predetermined allowable range of the upper right corner of the overlapping scan range, and/or the peripheral fixation target 421 is not placed in the predetermined allowable range of the lower left corner.

In this manner, the dimension of the overlapping region between the first front image and the second front image changes according to the value of the axial length of the eye E to be examined. More specifically, the shorter the axial length of the eye E to be examined, the smaller the size of the overlapping region, and the longer the axial length of the eye E to be examined, the larger the size of the overlapping region. The same applies to eyeball parameters such as diopter. In this embodiment, it is possible to set a plurality of fixation targets for panorama imaging using such a relationship.

More generally, the fixation position setting unit 231 of the present embodiment can set the fixation position for panorama imaging based on the first front image and the second front image.

In one example, the fixation position setting section 231 can identify an overlapping region between the first front image and the second front image. This process is performed, for example, on the first partial area in the first front image and the second partial area in the second front image, where the degree of matching (image correlation, etc.) is high. and a second partial area. In this example, the fixation position setting section 231 can further set the fixation position for panoramic imaging based on the identified overlapping region.

For example, the fixation position setting unit 231 calculates the size of the overlapping region between the first front image and the second front image, and sets the fixation position for panorama imaging based on this size. good too. Here, the parameters indicating the dimensions of the overlapping region may include at least one of the length in the x direction, the length in the y direction, the perimeter, the area, and the like.

For example, the fixation position setting unit 231 sets the dimension of the overlapping region between the first front image and the second front image so that it is substantially equal to the default value (or is included in the default allowable range). ) You may set the fixation position for panoramic photography. This default value (or allowable range) indicates, for example, the size of the overlapping region to be obtained when the eye to be examined E is a standard eye (or the allowable range of dimensional values).

In addition, the fixation position setting unit 231 corrects the deviation of the second fixation position with respect to the first fixation position based on the first front image and the second front image, thereby performing panoramic imaging. You may set the fixation position for Typically, when the first fixation position corresponds to the macula, the deviation of the second fixation position with respect to the first fixation position in the second preliminary fundus photography is represented by the first front image. and the second front image, a peripheral fixation position located near the second fixation position can be set as one of the fixation positions for panorama imaging.

<motion>
The operation of the ophthalmologic imaging apparatus 1 according to this embodiment will be described. An example of the operation of the ophthalmologic imaging apparatus 1 is shown in FIG. It is assumed that general preparatory processes for fundus imaging, such as patient information input, alignment, and focus adjustment, have already been completed. It is also assumed that general preparatory processing for OCT, such as interference sensitivity adjustment and z-position adjustment, is executed at arbitrary timing.

(S1: Execute first preliminary fundus photography)
First, the ophthalmologic photographing apparatus 1 executes the above-described first preliminary fundus photographing. The first preliminary fundus photography is performed to set the central position of panoramic photography. In the first preliminary fundus imaging of this example, the main control unit 211 controls the fixation system 250 to present the default macular fixation target to the eye E to be examined, and The photographing unit 270 is controlled to photograph the fundus Ef of the subject's eye E for which is presented. A preliminary frontal image is thereby obtained.

Here, the default macular fixation target is typically a visible bright point displayed at the center position of the display screen of the LCD 39 (that is, the position on the optical axis of the optical path split by the half mirror 33A). be. However, the default macular fixation target is not limited to this.

(S2: Set the center position of panorama shooting)
The main control unit 211 sends to the data processing unit 230 the preliminary front image acquired in the first preliminary fundus imaging in step S1. The image processing unit 232 calculates the displacement of the macular image of the fundus oculi Ef with respect to the central position of the preliminary front image.

Reference is now made to FIG. 9A. Reference numeral 500 indicates a preliminary frontal image. The outline of the preliminary frontal image 500 is circular. A reference numeral 501 indicates the center position of the preliminary front image 500 (the center position in the xy plane). Reference numeral 502 indicates the position of the macula (macular center) drawn on the preliminary front image. Reference numeral 503 indicates the displacement of the macular center 502 with respect to the center position 501 of the preliminary frontal image 500 . In this example, the image processing unit 232 analyzes the preliminary front image 500 to calculate the displacement 503 of the macular center 502 with respect to its center position 501 .

The fixation position setting unit 231 corrects the fixation position corresponding to the default macular fixation target (that is, the display position of the visible bright spot on the display screen of the LCD 39) based on the calculated deviation 503. FIG. The position of the fundus oculi Ef (macula) corresponding to the corrected macular fixation target is set as the central position of the panorama imaging. That is, by applying the translation of the direction and distance corresponding to the inverse vector of the vector represented by the displacement 503 to the default macular fixation target, a (virtual) front image 550 is obtained as shown in FIG. 9B. The position of the default macular fixation target is corrected so that the macular center 551 is rendered at the center position. Furthermore, the fixation position setting section 231 performs similar corrections on the default peripheral fixation position (second fixation position).

(S3: Start second preliminary fundus photography)
When the setting of the central position of panoramic photography (correction of the position of the fixation target for the macula and further correction of the position of the fixation target for the periphery) is completed, the process shifts to second preliminary fundus photography. In the second preliminary fundus photography of this example, the above-described first control is executed by applying the first fixation position corrected in step S2, and the second fixation position corrected in step S2 is applied. Applying the viewing position, the aforementioned second control is executed.

(S4: Execute first control to acquire first front image)
In the first control, the main control unit 211 displays the first front image of the fundus oculi Ef while presenting the first fixation target corresponding to the first fixation position corrected in step S2 to the subject's eye E. The fixation system 250 and the imaging unit 270 are controlled so as to acquire.

In this example, the main control unit 211 displays a visible bright spot at a position (pixel) on the display screen of the LCD 39 corresponding to the fixation position of the macular fixation target corrected in step S2. Furthermore, the main control unit 211 controls the photographing unit 270 to photograph the fundus oculi Ef and acquire the first front image.

(S5: Execute second control to acquire second front image)
After completion of the first control in step S4, the process shifts to the second control. In the second control, the main control unit 211 displays the second front image of the fundus oculi Ef while presenting the second fixation target corresponding to the second fixation position corrected in step S2 to the subject's eye E. The fixation system 250 and the imaging unit 270 are controlled so as to acquire.

In this example, the main control unit 211 displays a visible bright spot at a position (pixel) on the display screen of the LCD 39 corresponding to the fixation position of the peripheral fixation target corrected in step S2. Furthermore, the main control unit 211 controls the photographing unit 270 to photograph the fundus oculi Ef and acquire a second front image.

In this example, the second control is executed after the first control, but conversely, the first control may be executed after the second control.

(S6: Set multiple fixation positions for panoramic photography)
When the first control and the second control are completed, the process shifts to setting the fixation position for panorama imaging. The fixation position setting unit 231 sets a plurality of fixation positions for panorama imaging based on the first front image acquired in step S4 and the second front image acquired in step S5. .

For example, assume that a first front image 601 and a second front image 602 shown in FIG. 10A are acquired. The first front image 601 and the second front image 602 are each assumed to have the same shape and dimensions as the preliminary front image 500 .

The fixation position setting unit 231 first identifies an overlap region 603 between the first front image 601 and the second front image 602 (see FIG. 10B).

Next, the fixation position setting unit 231 calculates the dimensions of the identified overlapping region 603 . In this example, the fixation position setting unit 231 calculates the length Rx (mm) in the x direction and the length Ry (mm) in the y direction of the overlapping region 603 as the dimensions of the overlapping region 603 .

Subsequently, the fixation position setting unit 231 sets a plurality of fixation positions for panorama imaging based on the calculated dimensions Rx (mm) and Ry (mm) of the overlapping region 603 . For example, the fixation position setting unit 231 sets the fixation position of the peripheral fixation target corrected in step S2 so that the dimensions Rx (mm) and Ry (mm) of the overlapping region 603 are substantially equal to the default values. Correct further. In other words, the fixation position setting unit 231 sets the display position (pixel position on the display screen of the LCD 39) of the peripheral fixation target (visible bright point) corrected in step S2 to the dimension Rx (mm) of the overlapping region 603. and Ry (mm) are changed to be approximately equal to the default value.

If the subject's eye E is a standard eye, both the dimensions Rx (mm) and Ry (mm) of the overlapping region 603 are substantially equal to the default values. On the other hand, if the subject's eye E is not a standard eye, at least one of the dimensions Rx and Ry of the overlapping region 503 is substantially different from the default value.

Here, "the dimension is approximately equal to the default value" means, for example, that the dimension falls within a preset tolerance (error relative to the default value). Also, "the dimension is substantially different from the default value" means, for example, the case where the dimension is not included in the range of a preset allowable error (error relative to the default value).

Thus, the cause of the difference between the dimensions Rx (mm) and Ry (mm) of the overlapping region 603 and the default values is the fixation position resulting from the difference in eyeball parameter values such as axial length and diopter. in displacement. In this example, by correcting such a displacement of the fixation position, the peripheral fixation position for panoramic photography is optimized.

For example, the fixation position setting unit 231 calculates the difference (Q−Rx, Q−Ry) between each of the dimensions Rx (mm) and Ry (mm) of the overlapping region 603 and the default value Q (mm). Also, the displacement between the display position of the macular fixation target and the display position of the peripheral fixation target located at the lower left is Dx (pixel, dot) in the x direction and Dy (pixel, dot) in the y direction. ) (where Dx=Dy may be). Then, the display position of the peripheral fixation target should be moved by the number of dots corresponding to ([Q-Rx]/Dx, [Q-Ry]/Dy). The fixation position setting unit 231 can perform such calculations.

In this way, the fixation position setting unit 231 can set the peripheral fixation position located to the lower left of the macular imaging fixation position. Using this result, it is possible to set other peripheral fixation positions.

For example, as shown in FIG. 11, assume that a first peripheral fixation position 701 located at the lower left of the macula 700 (fixation position for macular imaging) is set in the manner described above. A first peripheral fixation position 701 is set at a position separated by a distance T in the lower left direction from the macula 700 . In this case, the fixation position setting unit 231 (1) sets the second peripheral fixation position 702 at a position separated by a distance T in the upper left direction from the macula 700, and (2) sets a distance T in the upper right direction from the macula 700. (3) A fourth peripheral fixation position 704 can be set at a position away from the macula 700 by a distance T in the lower right direction.

The number of multiple peripheral fixation positions is not limited to four, and the arrangement of the multiple peripheral fixation positions is not limited to the arrangement shown in FIG. In general, setting (correcting) a plurality of peripheral fixation positions according to a preset arrangement of a plurality of peripheral fixation positions (for example, a default arrangement, an arrangement designated by the user or the ophthalmic imaging apparatus 1). is possible.

(S7: Acquire a plurality of 3D images by executing panorama shooting)
The main control unit 211 controls the fixation system 250 so as to sequentially present to the subject's eye E a plurality of fixation targets corresponding to the plurality of (peripheral) fixation positions set in step S6. are presented to the eye E to be examined, the OCT image acquisition unit 260 is controlled to acquire a three-dimensional image of the fundus oculi Ef.

As an example, a case where the four peripheral fixation positions 701 to 704 shown in FIG. 11 are applied to panoramic photography will be described.

First, the main control unit 211 controls the fixation system 250 to present the first peripheral fixation target corresponding to the first peripheral fixation position 701, and furthermore, controls the first peripheral fixation target. is presented, the OCT image acquisition unit 260 is controlled to perform a three-dimensional scan. Thereby, a first peripheral three-dimensional image corresponding to the first peripheral scan range 711 shown in FIG. 11 is acquired. The dimensions of the first peripheral three-dimensional image (first peripheral scan range) are W (mm) in both the x-direction length and the y-direction length.

Next, the main control unit 211 controls the fixation system 250 to present a second peripheral fixation target corresponding to the second peripheral fixation position 702, and furthermore, controls the second peripheral fixation target. The OCT image acquisition unit 260 is controlled to perform a three-dimensional scan while the target is presented. Thereby, a second peripheral three-dimensional image corresponding to the second peripheral scan range 712 shown in FIG. 11 is acquired. The dimensions of the second peripheral three-dimensional image (second peripheral scan range) are W (mm) in both the x-direction length and the y-direction length.

Subsequently, the main control unit 211 controls the fixation system 250 to present a third peripheral fixation target corresponding to the third peripheral fixation position 703, and furthermore, controls the third peripheral fixation target. The OCT image acquisition unit 260 is controlled to perform a three-dimensional scan while the target is presented. Thereby, a third peripheral three-dimensional image corresponding to the third peripheral scan range 713 shown in FIG. 11 is acquired. The dimensions of the third peripheral three-dimensional image (third peripheral scan range) are W (mm) in both the x-direction length and the y-direction length.

Finally, the main control unit 211 controls the fixation system 250 to present a fourth peripheral fixation target corresponding to the fourth peripheral fixation position 704, and furthermore, controls the fourth peripheral fixation target. The OCT image acquisition unit 260 is controlled to perform a three-dimensional scan while the target is presented. Thereby, a fourth peripheral three-dimensional image corresponding to the fourth peripheral scan range 714 shown in FIG. 11 is obtained. The dimensions of the fourth peripheral three-dimensional image (fourth peripheral scan range) are W (mm) in both the x-direction length and the y-direction length.

Also, two surrounding three-dimensional images that are adjacent to each other have an overlapping area (margin) with a suitable width for synthesizing them. For example, in the example shown in FIG. 11, the first peripheral scan range and the second peripheral scan range have an overlapping region with a width ΔW, and the second peripheral scan range and the third peripheral scan range have a width ΔW , the third peripheral scan range and the fourth peripheral scan range have an overlap region of width ΔW, and the fourth peripheral scan range and the first peripheral scan range have an overlap of width ΔW have an area.

(S8: Form composite image)
The synthesizing unit 2321 forms a synthetic image (mosaic image) of the plurality of three-dimensional images acquired in step S7. As an example, in the example shown in FIG. 11, the synthesizing unit 2321 synthesizes the first to fourth peripheral three-dimensional images to form a single three-dimensional image. It is also possible to synthesize arbitrary two or more three-dimensional images among the plurality of three-dimensional images acquired in step S7.

The process of synthesizing a plurality of three-dimensional images includes, for example, similar to conventional image synthesizing techniques, matching between overlapping regions using image correlation, etc., and positioning of surrounding three-dimensional images using the result of this matching. , synthesis processing with these peripheral three-dimensional images.

(S9: display/save composite image)
The main control unit 211 can cause the display unit 241 to display the composite image formed in step S8. In addition, the main control unit 211 stores the composite image in the storage unit 212, controls transmission of the composite image to an external device, and controls recording of the composite image on a recording medium. is possible.

Also, the main control unit 211 can cause the display unit 241 to display part or all of the plurality of three-dimensional images formed in step S7. With this, the processing according to this example ends.

<Modification>
In the operation example described above, after performing the first preliminary fundus imaging, the second preliminary fundus imaging including the first control and the second control is performed. However, it is possible to omit the first control of the second preliminary fundus photography.

For example, the preliminary front image obtained by the first preliminary fundus photography and the displacement 503 described above can be used instead of the first front image obtained by the first control. That is, in the first control of the first preliminary fundus photography and the second preliminary fundus photography, since the common first fixation position is applied, A front image obtained by shifting the position of the preliminary front image based on the displacement 503 can be used instead of the first front image obtained by the first control.

〈Action and effect〉
The operation and effects of the ophthalmologic imaging apparatus 1 according to this embodiment will be described.

The ophthalmologic imaging apparatus (1) according to this embodiment includes a fixation system (250), an imaging unit (270), a control unit (main control unit 211), a fixation position setting unit (231), and an OCT image. It includes an acquisition unit (260) and an image processing unit (232).

A fixation system (250) presents a fixation target to the subject's eye (E). A photographing unit (270) photographs the fundus (Ef) of the eye (E) to be examined.

A control unit (211) controls a fixation system (250) and an imaging unit ( 270). This control is called fundus imaging control.

A fixation position setting unit (231) sets one or more fixation positions (at least the first peripheral fixation position 701) for panorama imaging based on the front image acquired by the fundus imaging control. Note that the fixation position setting unit (231) sets two or more fixation positions for panoramic photography (for example, the first peripheral fixation position 701 and the second to fourth peripheral fixation positions 702 to 704). It is also possible to set two or more peripheral fixation positions, including any one or more. Further, the user may set or correct at least one of the one or more fixation positions for panoramic photography.

In addition, the fixation position setting unit (231) includes a front image acquired by fundus imaging control, an imaging area (fundus imaging area 310) in fundus imaging control, and a three-dimensional scan area (320) in OCT control for panoramic imaging. ) and the positional relationship (positional relationship information), one or more fixation positions for panorama imaging may be set.

An OCT image acquisition unit (260) acquires an image by applying optical coherence tomography (OCT) to the fundus (Ef).

The image processing section (232) processes the image acquired by the OCT image acquisition section (260). The image processing section (232) includes a composition processing section (2321).

As OCT control (panoramic imaging), the control unit (211) sets two or more fixation positions (first to fourth peripheral fixations) including one or more fixation positions set by the fixation position setting unit (231). A fixation system (250) is controlled so as to sequentially present two or more fixation targets (first to fourth peripheral fixation targets) corresponding to visual positions 701 to 704) to the subject's eye (E). and acquiring a three-dimensional image of the fundus (Ef) when each of the two or more fixation targets (first to fourth peripheral fixation targets) is presented to the eye (E) to be examined. It controls the OCT image acquisition unit (260).

The synthesizing unit (2321) synthesizes two or more three-dimensional images (first to fourth 3D image) to form a composite image (mosaic image).

According to such an embodiment, a plurality of fixation positions for panorama imaging can be set by actually performing fundus imaging control. Thereby, it is possible to preferably set a plurality of fixation positions for acquiring a mosaic image using OCT, regardless of individual differences in eyeball size information such as eye axial length and eyeball characteristic information such as diopter. becomes possible.

In the fundus imaging control, the control unit (211) performs first control (first control in the second preliminary fundus imaging) and second control (second control in the second preliminary fundus imaging). and may be executed.

As a first control, the control unit (211) presents the first fixation target corresponding to the first fixation position to the eye (E) to be examined, and displays the first front image (601 ) is obtained by controlling the fixation system (250) and the imaging unit (270).

As a second control, the control unit (211) displays a second front image (602) of the fundus (Ef) while presenting the second fixation target corresponding to the second fixation position to the eye (E) ) is obtained by controlling the fixation system (250) and the imaging unit (270).

When the first control and the second control are executed, the fixation position setting unit (231) performs panorama imaging based on the first front image (601) and the second front image (602). One or more fixation positions (at least the first peripheral fixation position 701) can be set for.

According to such a configuration, two (or more) frontal images corresponding to two (or more) different fixation positions are actually acquired, and these frontal images are used to obtain a plurality of fixed images for panorama imaging. View position can be set. As a result, for example, even if the imaging unit (270) cannot perform wide-angle imaging or ultra-wide-angle imaging, multiple fixation positions for panorama imaging over a wide range of the fundus can be adjusted to individual differences in eyeball size and eyeball characteristics. can be set regardless of

When the imaging unit (270) is capable of wide-angle imaging (ultra-wide-angle imaging), for example, the control unit (211) controls a fixed position corresponding to a single predetermined fixation position as fundus imaging control. The fixation system (250) and imaging unit (270) can be controlled so as to acquire a wide-angle frontal image of the fundus (Ef) by executing wide-angle imaging while presenting the target to the eye (E). A fixation position setting unit (231) can set one or more fixation positions for panoramic photography based on this wide-angle front image.

When the first control and the second control are executed, the fixation position setting unit (231) sets the overlap region ( 603) and set one or more fixation positions for panoramic imaging based on this overlap region (603).

According to such a configuration, according to such a configuration, it is possible to set a fixation position suitable for panoramic photography based on the overlapping state of the first front image and the second front image. It is possible.

When the overlap region (603) between the first front image (601) and the second front image (602) is identified, the fixation position setting unit (231) determines the size of the overlap region (603) can be calculated, and one or more fixation positions for panoramic photography can be set based on this dimension.

According to such a configuration, it is possible to set a fixation position suitable for panoramic photography based on the degree of overlap between the first front image and the second front image.

When the first control and the second control are executed in the fundus imaging control, the fixation position setting unit (231) adjusts the size of the overlapping region (603) for panorama imaging so that it is substantially equal to the default value. One or more fixation positions can be set. This default value indicates, for example, the size of the overlap region (allowable range of size values) that should be obtained when the eye to be examined (E) is a standard eye.

According to such a configuration, a plurality of three-dimensional images (first to fourth peripheral three-dimensional images) obtained by panoramic photography have overlapping regions suitable for panoramic synthesis. It is possible to set the position.

When the first control and the second control are executed in the fundus imaging control, the first fixation position is a default fixation position for acquiring a front image centering on a predetermined portion of the fundus. good. Further, the second fixation position may be a default fixation position for acquiring a front image centered at a position a predetermined distance away from the predetermined site in a predetermined direction in the fundus of a standard eye. .

According to such a configuration, by applying the first fixation position and the second fixation position that are preset so as to be able to preferably perform the panoramic photographing of the standard eye, the panorama image of the subject's eye (E) is obtained. It is possible to set the fixation position for imaging.

Before the first control and the second control, the control unit (211) presents the first fixation target corresponding to the first fixation position to the eye (E), and Preliminary control (first preliminary fundus photography) may be performed to control the fixation system (250) and imaging unit (270) to acquire a preliminary frontal image (500).

When the preliminary control is executed, the image processing unit (232) calculates the deviation (503) of the image of the predetermined site of the fundus oculi (Ef) with respect to the central position (501) of the preliminary front image (500). can be done. Furthermore, the fixation position setting unit (231) can correct the first fixation position and the second fixation position based on this deviation (503). In addition, the control unit (211) can apply the corrected first fixation position to perform the first control, and apply the corrected second fixation position to perform the second control. 2 controls can be implemented.

According to such a configuration, the first fixation position and the second fixation position corrected by using the preliminary front image obtained by the first preliminary fundus imaging are applied to perform the second fixation position. Two preliminary fundus shots (first control and second control) can be performed. As a result, regardless of individual differences in ocular parameters of the subject's eye, it is possible to make the first fixation position correspond to a predetermined portion of the fundus, and furthermore, a position at a predetermined distance away from the predetermined portion of the fundus in a predetermined direction. can be made to correspond to the second fixation position.

When the first control and the second control are executed in the fundus imaging control, the fixation position setting unit (231) sets the first front image (601) acquired in the first control and the second control one or more fixation positions for panoramic imaging by correcting the deviation of the second fixation position relative to the first fixation position based on the second frontal image (602) acquired at can be set.

With such a configuration, it is possible to suitably correct the relative position of the second fixation position with respect to the first fixation position.

When the first control and the second control are executed in the fundus imaging control, the first fixation position is the default fixation position for acquiring a front image centered on the macula (fixation for macular imaging). position), and the second fixation position is the default fixation position for acquiring a three-dimensional image centered at a predetermined distance in a predetermined direction from the macula at the fundus of a standard eye. (peripheral fixation position). Furthermore, the fixation position setting unit (231) sets the second fixation position (fixation position for macular imaging) for the first fixation position (macula imaging fixation position) based on the first front image (601) and the second front image (602). By correcting the deviation of the fixation position (peripheral fixation position) of the eye fundus (Ef), the first fixation position (macula A first peripheral fixation position 701) corresponding to a position separated by a distance T in the lower left direction from the macula is set, and a second direction (upper right direction) opposite to the first direction (lower left direction) is set from the macula. A second fixation position (third peripheral fixation position 703) corresponding to a position separated by a distance of 1 (distance T) is set, and a third direction ( A third fixation position (second peripheral fixation position 702) is set at a position separated from the macula by a first distance (distance T) in the upper left direction), and is opposite to the third direction (upper left direction). A fourth fixation position (fourth peripheral fixation position 704) corresponding to a position separated from the macula by the first distance (distance T) in the fourth direction (lower right direction) may be set. . In addition, the control unit (211) controls the display based on a plurality of fixation positions (first to fourth peripheral fixation positions 701-704) including the first, second, third and fourth fixation positions. OCT control (panoramic imaging) may be executed.

According to such a configuration, it is possible to automatically and suitably set a plurality of fixation positions for panoramic photography.

In this embodiment, the control unit (211) may control the OCT image acquisition unit (260) so as to acquire a three-dimensional angiographic image of the fundus (Ef) in OCT control (panoramic imaging).

With such a configuration, it is possible to suitably acquire a three-dimensional angiographic image (mosaic image) over a wide range of the fundus.

A control method for an ophthalmic imaging apparatus according to the present embodiment is a method for controlling an ophthalmic imaging apparatus capable of applying imaging and optical coherence tomography (OCT) to the fundus of an eye to be inspected, comprising an imaging step; , a fixation position setting step, an OCT step, and a synthesis step.

The imaging step presents a fixation target corresponding to a predetermined fixation position to the eye to be examined (E) and applies imaging to the fundus oculi (Ef) to acquire a front image. The imaging step may include any processing related to the second preliminary fundus imaging described in this embodiment.

The fixation position setting step sets one or more fixation positions for panorama imaging based on the front image acquired in the imaging step. The fixation position setting step may include any processing related to fixation position setting described in this embodiment.

The OCT step sequentially presents to the subject's eye (E) two or more fixation targets corresponding to two or more fixation positions including one or more fixation positions set in the fixation position setting step, and OCT is performed to acquire a three-dimensional image of the fundus (Ef) when each of these two or more fixation targets is presented to the eye (E) to be examined. The OCT step may include any processing related to panoramic imaging described in this embodiment.

The synthesizing step forms a synthetic image (mosaic image) of two or more three-dimensional images corresponding to two or more fixation positions acquired in the OCT step. The compositing step may include any processing related to image compositing described in this embodiment.

It is possible to create a program that causes the ophthalmologic imaging apparatus according to this embodiment to execute such a control method. Also, it is possible to create a computer-readable non-transitory recording medium recording such a program. This non-transitory recording medium may be in any form, examples of which include magnetic disks, optical disks, magneto-optical disks, and semiconductor memories.

The embodiment described above is merely an example of the present invention. A person who intends to implement the present invention can arbitrarily make modifications (omission, substitution, addition, etc.) within the scope of the gist of the present invention.

1 ophthalmic imaging apparatus 210 control unit 211 main control unit 230 data processing unit 231 fixation position setting unit 232 image processing unit 2321 synthesis processing unit 250 fixation system 260 OCT image acquisition unit 270 imaging unit

Claims (5)

a fixation system that presents a fixation target to an eye to be examined;
a photographing unit for photographing the fundus of the eye to be examined;
a control unit that executes fundus imaging control that controls the fixation system and the imaging unit so as to acquire a front image of the fundus while presenting a fixation target corresponding to a predetermined fixation position to the eye;
a fixation position setting unit that sets one or more fixation positions based on the front image acquired by the fundus imaging control;
an OCT image acquisition unit that acquires an image by applying optical coherence tomography (OCT) to the fundus;
an image processing unit that processes the image acquired by the OCT image acquisition unit;
The control unit sequentially presents to the eye to be examined two or more fixation targets corresponding to two or more fixation positions including the one or more fixation positions set by the fixation position setting unit. OCT for controlling the fixation system and for controlling the OCT image acquisition unit to acquire a three-dimensional image of the fundus when each of the two or more fixation targets is presented to the eye to be examined. run the control,
The image processing unit includes a synthesis processing unit that forms a synthesized image of two or more three-dimensional images corresponding to the two or more fixation positions acquired by the OCT control,
The fixation position setting unit performs the 1 Execute the above fixation position setting,
The control unit executes both first control and second control in the fundus imaging control executed before the OCT control, and the first control corresponds to a first fixation position. controlling the fixation system and the photographing unit so as to acquire a first front image of the fundus while presenting a first fixation target to the eye to be examined; controlling the fixation system and the imaging unit to acquire a second front image of the fundus while presenting a second fixation target corresponding to the fixation position to the eye to be examined;
The ophthalmic imaging apparatus, wherein the fixation position setting unit sets the one or more fixation positions based on the first front image and the second front image. In a preliminary control executed prior to the fundus imaging control, the control unit presents a default fixation target to the eye to be inspected and acquires a preliminary front image of the fundus. controlling the imaging unit;
The ophthalmologic imaging apparatus according to claim 1, wherein the fixation position setting unit sets the first fixation position and the second fixation position based on the preliminary front image. A method for controlling an ophthalmic imaging apparatus capable of applying imaging and optical coherence tomography (OCT) to the fundus of an eye to be examined, comprising:
a photographing step of presenting a fixation target corresponding to a predetermined fixation position to the eye to be examined and applying photographing to the fundus to obtain a front image;
a fixation position setting step of setting one or more fixation positions based on the front image acquired in the photographing step;
sequentially presenting to the eye to be examined two or more fixation targets corresponding to two or more fixation positions including the one or more fixation positions set in the fixation position setting step; an OCT step of acquiring a three-dimensional image by applying OCT to the fundus when each of the fixation targets is presented to the eye to be examined;
forming a composite image of two or more three-dimensional images corresponding to the two or more fixation positions obtained in the OCT step;
In the fixation position setting step, the one or more Execute the fixation position setting,
The imaging step is executed before the OCT control, and acquires a first front image of the fundus while presenting the eye to be examined with a first fixation target corresponding to a first fixation position. 1 imaging step, and a second imaging step of acquiring a second front image of the fundus while presenting a second fixation target corresponding to a second fixation position to the eye to be examined,
The method of controlling an ophthalmologic imaging apparatus, wherein the fixation position setting step sets the one or more fixation positions based on the first front image and the second front image. 4. A program for causing an ophthalmologic imaging apparatus capable of applying imaging and optical coherence tomography (OCT) to the fundus of an eye to be examined to execute the control method according to claim 3. A computer-readable non-transitory recording medium on which the program according to claim 4 is recorded.

Images