JP6942626B2 - Ophthalmologic imaging equipment, its control method, programs, and recording media - Google Patents

Description

The present invention relates to an ophthalmologic imaging apparatus, a control method thereof, a program, and a recording medium.

Diagnostic imaging occupies an important position in the field of ophthalmology. In recent years, the use of optical coherence tomography (OCT) has been advancing. OCT has come to be used not only for acquiring B-scan images and three-dimensional images of the eye to be inspected, but also for acquiring front images (en-face images) such as C-scan images and shadowgrams.

In addition, a modality for acquiring an image emphasizing a specific part of the eye to be inspected has also been put into practical use. For example, OCT-Angiography, which forms an image in which retinal blood vessels and choroidal blood vessels are emphasized, is attracting attention (see, for example, Patent Document 1). Generally, the tissue (structure) of the scan site does not change with time, but the blood flow portion inside the blood vessel changes with time. In OCT angiography, an image is formed by emphasizing a portion (blood flow signal) in which such a temporal change exists. In addition, OCT angiography is also called OCT motion contrast imaging (motion contrast imaging) or the like. The images acquired by OCT angiography are called angiographic images, angiograms, motion contrast images, and the like.

In a typical conventional OCT angiography, a three-dimensional scan of a predetermined size (for example, 9 mm × 9 mm) is applied to obtain an image representing the three-dimensional distribution of fundus blood vessels. On the other hand, it is desired to acquire a wider range of angiographic images. Panorama photography is known as a technique for acquiring OCT data over a wide range of the fundus (see, for example, Patent Document 2).

Panorama photography is an imaging method in which a three-dimensional scan is applied to a plurality of different areas and a plurality of three-dimensional images obtained thereby are combined to construct a wide-area image. Overlapping areas are set in the areas adjacent to each other, and the relative positions between the adjacent images are determined with respect to the overlapping areas. Also, sequential three-dimensional scans of different regions are typically achieved by moving the fixation position. Wide area images acquired by panoramic photography are called panoramic images, mosaic images, and the like.

By the way, there are individual differences in the size and characteristics of the eyeball, for example, the axial length and diopter (optical power) differ from person to person. Even when a three-dimensional scan of a predetermined size is applied as described above, the range of the fundus actually scanned varies depending on the axial length and diopter.

For example, as shown in FIG. 1, when the OCT measurement light is incident on the eye E1 having the axial length L1 and the eye E2 having the axial length L2 (> L1) at the same angle θ, the fundus of the eye E1 is examined. The height Y2 of the projection position of the measurement light on the fundus of the eye E2 to be inspected is larger than the height Y1 of the projection position of the measurement light in (Y2> Y1). That is, the longer the axial length, the higher the height of the projection position of the measurement light on the fundus. On the other hand, the size of the OCT scan is defined by the maximum deflection angle of the measurement light. Therefore, even if the size conditions of the OCT scan are the same, the range of the fundus actually scanned changes according to the value of the axial length. The same applies to diopter.

Since the actual scan range is affected by the eyeball parameters in this way, the size of the overlapping area in panoramic photography also changes according to the eyeball parameters. For example, when the axial length of the eye to be inspected is long, the actual scanning range is widened, so that the overlapping area is also widened. If the overlapping area becomes wider than necessary, the range actually drawn by the mosaic image becomes narrow, and the efficiency of panoramic shooting decreases.

On the contrary, when the axial length of the eye to be inspected is short, the actual scanning range is narrowed, so that the overlapping area is also narrowed, and in some cases, the overlapping area is eliminated. If the overlapping area becomes narrow, the relative position between adjacent images may not be obtained with sufficient accuracy. Further, when the overlapping area does not exist, the relative position between the adjacent images cannot be determined, and the mosaic image cannot be constructed.

In addition, the region of interest (for example, the center of the macula) to be drawn in the central region of the mosaic image may not be arranged in such a manner.

Special Table 2015-515894 Japanese Unexamined Patent Publication No. 2009-183332

An object of the present invention is to provide a technique capable of setting a plurality of fixation positions for acquiring a mosaic image using OCT, regardless of individual differences in the size and characteristics of the eyeball. It is in.

A first aspect of the embodiment is a fixation system that presents a fixation target to the eye to be inspected, an image acquisition unit that acquires an image by applying optical coherence stromography (OCT) to the fundus of the eye to be inspected, and a first aspect of the embodiment. A first that controls the fixation system and the image acquisition unit so as to acquire a first three-dimensional image of the fundus while presenting a first fixation target corresponding to the fixation position of 1 to the eye to be inspected. And the fixation system and the image acquisition unit so as to acquire a second three-dimensional image of the fundus while presenting a second fixation target corresponding to the second fixation position to the eye to be inspected. A fixation position setting that sets one or more new fixation positions based on the control unit that executes the second control for controlling the first three-dimensional image and the second three-dimensional image. The control unit includes two or more units and an image processing unit that processes an image acquired by the image acquisition unit, and the control unit corresponds to two or more fixation positions including the one or more new fixation positions. A three-dimensional image of the fundus when the fixation system is controlled so that the fixation targets are sequentially presented to the subject and each of the two or more fixation targets is presented to the subject. A third control for controlling the image acquisition unit is executed so as to acquire the image, and the image processing unit has two or more three-dimensional objects corresponding to the two or more fixation positions acquired by the third control. A composite image of an image This is an ophthalmic imaging apparatus including a composite processing unit for forming an image.

A second aspect of the embodiment is the ophthalmologic imaging apparatus of the first aspect, wherein the fixation position setting unit is an overlapping region between the first three-dimensional image and the second three-dimensional image. Is specified, and one or more new fixation positions are set based on the overlapping region.

A third aspect of the embodiment is the ophthalmologic imaging apparatus of the second aspect, wherein the fixation position setting unit calculates the dimension of the overlapping region, and based on the dimension, the one or more new fixation. It is characterized by setting a visual position.

A fourth aspect of the embodiment is the ophthalmologic imaging apparatus of the third aspect, wherein the fixation position setting unit has one or more new fixations so that the dimensions of the overlapping region are substantially equal to a predetermined value. It is characterized by setting a visual position.

A fifth aspect of the embodiment is the ophthalmologic imaging apparatus according to any one of the first to fourth aspects, and the first fixation position acquires a three-dimensional image centered on a predetermined portion of the fundus of the eye. The second fixation position is for acquiring a three-dimensional image centered on a position separated by a predetermined distance in a predetermined direction from the predetermined portion in the fundus of a standard eye. It is characterized in that it is the default fixation position of.

A sixth aspect of the embodiment is the ophthalmologic imaging apparatus of the fifth aspect, wherein the control unit performs the first fixation target before the first control and the second control. Preliminary control for controlling the fixation system and the image acquisition unit is executed so as to acquire a preliminary three-dimensional image of the fundus while presenting to the eye to be inspected, and the image processing unit performs the preliminary three-dimensional image. The deviation of the image of the predetermined portion of the fundus of the eye with respect to the central position of the eye is calculated, and the fixation position setting unit determines each of the first fixation position and the second fixation position based on the deviation. The control unit applies the corrected first fixation position to execute the first control, and applies the corrected second fixation position to the second fixation position. It is characterized by executing control.

A seventh aspect of the embodiment is the ophthalmologic imaging apparatus according to any one of the first to sixth aspects, wherein the fixation position setting unit includes the first three-dimensional image and the second three-dimensional image. It is characterized in that a new fixation position of 1 or more is set by correcting the deviation of the second fixation position with respect to the first fixation position based on the above.

The eighth aspect of the embodiment is the ophthalmologic imaging apparatus according to any one of the first to seventh aspects, and the first fixation position is the default for acquiring a three-dimensional image centered on the yellow spot. The second fixation position is a default fixation position for acquiring a three-dimensional image centered on a position separated from the yellow spot by a predetermined distance in a predetermined direction in the fundus of a standard eye. It is a visual position, and the fixation position setting unit deviates the second fixation position with respect to the first fixation position based on the first three-dimensional image and the second three-dimensional image. By correcting the above, a first new fixation position corresponding to a position separated from the yellow spot by a first distance in the first direction from the fundus of the eye to be inspected is set, and the first direction is defined as the first direction. A second new fixation position corresponding to a position separated from the yellow spot by the first distance from the yellow spot is set in the opposite second direction, and from the yellow spot in a third direction orthogonal to the first direction. A third new fixation position is set at a position separated by the first distance, and corresponds to a position separated from the yellow spot by the first distance in a fourth direction opposite to the third direction. A fourth new fixation position is set, and the control unit sets the third fixation position based on a plurality of fixation positions including the first, second, third, and fourth new fixation positions. It is characterized by performing control.

A ninth aspect of the embodiment is the ophthalmologic imaging apparatus according to any one of the first to eighth aspects, and the control unit is centered on the first fixation position in the first control. The image acquisition unit is controlled so as to apply OCT to the first partial region located on the side of the second fixation position in the three-dimensional scan region, and in the second control, the second fixation is performed. It is characterized in that the image acquisition unit is controlled so as to apply OCT to the second partial region located on the side of the first fixation position in the three-dimensional scan region centered on the position.

The tenth aspect of the embodiment is the ophthalmologic imaging apparatus according to any one of the first to ninth aspects, and the control unit acquires a three-dimensional angiographic image of the fundus in the third control. The image acquisition unit is controlled as described above.

The eleventh aspect of the embodiment is the ophthalmologic imaging device of the tenth aspect, and the control unit acquires a three-dimensional angiographic image of the fundus in each of the first and second controls. It is characterized in that the image acquisition unit is controlled.

A twelfth aspect of the embodiment is the ophthalmologic imaging apparatus according to any one of the first to eleventh aspects, wherein any one or more of the new fixation positions is the first fixation position or the first fixation position. When substantially matching the fixation position of 2, the control unit performs the fixation system and the image acquisition so as to skip the acquisition of the three-dimensional image corresponding to the new fixation position in the third control. The unit is controlled, and the synthesis processing unit is characterized in that the first three-dimensional image or the second three-dimensional image is applied to the formation of the composite image.

A thirteenth aspect of the embodiment is a method of controlling an ophthalmologic imaging apparatus capable of applying optical coherence stromography (OCT) to the fundus of an eye to be inspected, the first corresponding to a first fixation position. The first control step of acquiring the first three-dimensional image of the fundus while presenting the fixation target of the eye to the eye to be inspected, and the second fixation target corresponding to the second fixation position of the eye to be inspected. Based on the second control step of acquiring the second three-dimensional image of the fundus while presenting to, and the first three-dimensional image and the second three-dimensional image, one or more new optometry The fixation position setting step for setting the position and two or more fixation targets corresponding to the two or more fixation positions including the one or more new fixation positions are sequentially presented to the eye to be inspected, and the above-mentioned Acquired by the third control step and the third control step of causing OCT to acquire a three-dimensional image of the fundus when each of the two or more fixation targets is presented to the eye to be inspected. It is a control method of an ophthalmologic imaging apparatus including a composite step of forming a composite image of two or more three-dimensional images corresponding to the two or more fixation positions.

A fourteenth aspect of the embodiment is a program that causes an ophthalmologic imaging apparatus capable of applying optical coherence tomography (OCT) to the fundus of the eye to be examined to execute the control method of the thirteenth aspect.

A fifteenth aspect of the embodiment is a computer-readable non-temporary recording medium on which the program of the fourteenth aspect is recorded.

According to the embodiment, it is possible to preferably set a plurality of fixation positions for acquiring a mosaic image using OCT regardless of individual differences in the size and characteristics of the eyeball.

It is the schematic for demonstrating the background technique. It is the schematic which shows an example of the structure of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is the schematic which shows an example of the structure of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is the schematic which shows an example of the structure of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is the schematic which shows an example of the structure of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is the schematic for demonstrating an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is the schematic for demonstrating an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is the schematic for demonstrating an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is a flowchart which shows an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is the schematic for demonstrating an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is the schematic for demonstrating an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is the schematic for demonstrating an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is the schematic for demonstrating an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is the schematic for demonstrating an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment. It is the schematic for demonstrating an example of the operation of the ophthalmologic imaging apparatus which concerns on an exemplary embodiment.

The ophthalmologic imaging apparatus according to the exemplary embodiment, its control method, program, and recording medium will be described in detail with reference to the drawings. The ophthalmologic imaging apparatus of the embodiment is an ophthalmologic apparatus having a function of performing optical coherence tomography (OCT). The ophthalmologic imaging apparatus of the embodiment may be capable of performing OCT angiography of the fundus.

Hereinafter, an ophthalmologic imaging apparatus in which a swept source OCT and a fundus camera are combined will be described, but the embodiment is not limited thereto. The type of OCT is not limited to swept source OCT, and may be, for example, spectral domain OCT.

The swept source OCT divides the light from the variable wavelength light source (wavelength sweep light source) into the measurement light and the reference light, and superimposes the return light of the measurement light from the test object on the reference light to generate interference light. This is a method in which this interference light is detected by a balanced photodiode or the like, and the detection data collected in response to the sweeping of the wavelength and the scanning of the measurement light is subjected to Fourier transform or the like to form an image.

Spectral domain OCT divides the light from the low coherence light source into measurement light and reference light, and superimposes the return light of the measurement light from the subject with the reference light to generate interference light, and the spectrum of this interference light. This is a method in which the distribution is detected by a spectroscope and the detected spectral distribution is subjected to Fourier transform or the like to form an image.

As described above, the swept source OCT is an OCT method for acquiring the spectral distribution by time division, and the spectral domain OCT is an OCT method for acquiring the spectral distribution by spatial division. The OCT method that can be used in the embodiment is not limited to these, and it is also possible to adopt an embodiment that uses an arbitrary OCT method (for example, time domain OCT) different from these.

The ophthalmologic photographing apparatus according to the embodiment may or may not have a function of acquiring a photograph (digital photograph) of the eye to be inspected. Typical examples of ophthalmic modalities having the function of acquiring digital photographs include a fundus camera, a scanning laser ophthalmoscope (SLO), a slit lamp microscope, an anterior ocular segment imaging camera, and a surgical microscope. A frontal image such as a fundus photograph can be used for observing the fundus, setting a scan area, tracking, and the like. The ophthalmic modality that can be used in the embodiment is not limited to these, and it is also possible to adopt an embodiment that uses a modality other than ophthalmology.

In the present specification, unless otherwise specified, "image data" and "image" based on the "image data" are not distinguished. Similarly, unless otherwise noted, no distinction is made between the site or tissue of the eye to be inspected and the image representing it.

<composition>
The exemplary ophthalmologic imaging apparatus 1 shown in FIG. 2 includes a fundus camera unit 2, an OCT unit 100, and an arithmetic control unit 200. The fundus camera unit 2 is provided with an optical system and mechanism for acquiring a frontal image of the eye E to be inspected, and an optical system and mechanism for executing OCT. The OCT unit 100 is provided with an optical system and a mechanism for executing OCT. The arithmetic control unit 200 includes one or more processors configured to perform various processes (calculations, controls, etc.). In addition to these, optional members (jaw holder, forehead pad, etc.) for supporting the subject's face, lens unit for switching the site to which OCT is applied (for example, attachment for anterior ocular segment OCT), etc. Elements and units may be provided in the ophthalmologic imaging apparatus 1.

In the present specification, the "processor" is, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), a programmable logic device (for example, a SPLD (Simple It means a circuit such as Programmable Logic Device), FPGA (Field Programmable Gate Array)). The processor realizes the function according to the embodiment by reading and executing a program stored in a storage circuit or a storage device, for example.

<Fundus camera unit 2>
The fundus camera unit 2 is provided with an optical system for photographing the fundus Ef of the eye to be inspected E. The acquired digital image of the fundus Ef (called a fundus image, a fundus photograph, etc.) is generally a front image such as an observation image, a photographed image, or the like. The observed image is obtained by taking a moving image using near infrared light. The captured image is a still image using flash light in the visible region.

The fundus camera unit 2 includes an illumination optical system 10 and a photographing optical system 30. The illumination optical system 10 irradiates the eye E to be inspected with illumination light. The photographing optical system 30 detects the return light of the illumination light applied to the eye E to be inspected. The measurement light from the OCT unit 100 is guided to the eye E to be inspected through the optical path in the fundus camera unit 2. The return light of the measurement light projected on the eye E (for example, fundus Ef) is guided to the OCT unit 100 through the same optical path in the fundus camera unit 2.

The light (observation illumination light) output from the observation light source 11 of the illumination optical system 10 is reflected by the concave mirror 12, passes through the condenser lens 13, passes through the visible cut filter 14, and becomes near-infrared light. Further, the observation illumination light is once focused in the vicinity of the photographing light source 15, reflected by the mirror 16, and passed through the relay lens system 17, the relay lens 18, the diaphragm 19, and the relay lens system 20 to the perforated mirror 21. Be guided. Then, the observation illumination light is reflected at the peripheral portion of the perforated mirror 21 (the region around the perforated portion), passes through the dichroic mirror 46, is refracted by the objective lens 22, and illuminates the eye E (fundus Ef) to be inspected. do. The return light of the observation illumination light from the eye E to be inspected is refracted by the objective lens 22, passes through the dichroic mirror 46, passes through the hole formed in the central region of the perforated mirror 21, and passes through the dichroic mirror 55. , It is reflected by the mirror 32 via the photographing focusing lens 31. Further, this return light passes through the half mirror 33A, is reflected by the dichroic mirror 33, and is imaged on the light receiving surface of the image sensor 35 by the imaging lens 34. The image sensor 35 detects the return light at a predetermined frame rate. The focus of the photographing optical system 30 is adjusted so as to match the fundus Ef or the anterior eye portion.

The light output from the photographing light source 15 (photographing illumination light) is applied to the fundus Ef through the same path as the observation illumination light. The return light of the photographing illumination light from the eye E to be examined is guided to the dichroic mirror 33 through the same path as the return light of the observation illumination light, passes through the dichroic mirror 33, is reflected by the mirror 36, and is reflected by the imaging lens 37. An image is formed on the light receiving surface of the image sensor 38.

The liquid crystal display (LCD) 39 displays a fixation target (fixation target image). A part of the light flux output from the LCD 39 is reflected by the half mirror 33A, reflected by the mirror 32, passes through the photographing focusing lens 31 and the dichroic mirror 55, and passes through the hole portion of the perforated mirror 21. The luminous flux that has passed through the hole of the perforated mirror 21 passes through the dichroic mirror 46, is refracted by the objective lens 22, and is projected onto the fundus Ef. The fixation target is typically used to guide and fix the line of sight. The direction in which the line of sight of the eye E to be examined is guided (and fixed), that is, the direction in which the fixation of the eye E to be examined is promoted is called the fixation position.

By changing the display position of the fixation target image on the screen of the LCD 39, the fixation position of the eye E to be inspected by the fixation target can be changed. Examples of fixation positions include the fixation position for acquiring an image centered on the macula, the fixation position for acquiring an image centered on the optic nerve head, and the position between the macula and the optic nerve head ( There is a fixation position for acquiring an image centered on the fundus (center of the fundus) and a fixation position for acquiring an image of a portion (peripheral part of the fundus) far away from the macula.

A graphical user interface (GUI) or the like for designating at least one of such typical fixation positions can be provided. In addition, a GUI or the like for manually moving the fixation position (display position of the fixation target) can be provided. It is also possible to apply a configuration that automatically sets the fixation position.

The configuration for presenting the fixation target whose fixation position can be changed to the eye E to be inspected is not limited to a display device such as an LCD. For example, a device (fixation matrix) in which a plurality of light emitting units (light emitting diodes and the like) are arranged in a matrix can be adopted instead of the display device. In this case, the fixation position of the eye E to be inspected by the fixation target can be changed by selectively lighting the plurality of light emitting units. As another example, a device having one or more movable light emitting units can generate an fixation target whose fixation position can be changed.

The alignment optical system 50 generates an alignment index used for alignment of the optical system with respect to the eye E to be inspected. The alignment light output from the light emitting diode (LED) 51 passes through the aperture 52, the aperture 53, and the relay lens 54, is reflected by the dichroic mirror 55, passes through the hole portion of the perforated mirror 21, and passes through the dichroic mirror 46. It is transmitted and projected onto the eye E to be inspected through the objective lens 22. The return light (corneal reflex light, etc.) from the eye E to be inspected for the alignment light is guided to the image sensor 35 through the same path as the return light of the observation illumination light. Manual alignment and auto-alignment can be executed based on the received light image (alignment index image).

The focus optical system 60 generates a split index used for focus adjustment with respect to the eye E to be inspected. The focus optical system 60 is moved along the optical path (illumination optical path) of the illumination optical system 10 in conjunction with the movement of the imaging focusing lens 31 along the optical path (photographing optical path) of the photographing optical system 30. The reflection rod 67 is inserted and removed from the illumination optical path. When adjusting the focus, the reflecting surface of the reflecting rod 67 is inclined and arranged in the illumination optical path. The focus light output from the LED 61 passes through the relay lens 62, is separated into two light beams by the split index plate 63, passes through the two-hole diaphragm 64, is reflected by the mirror 65, and is reflected by the condensing lens 66. Once imaged on the reflecting surface of, it is reflected. Further, the focus light is reflected by the perforated mirror 21 via the relay lens 20, passes through the dichroic mirror 46, and is projected onto the eye E to be inspected via the objective lens 22. The return light (reflected light from the fundus, etc.) of the focus light from the eye E to be inspected is guided to the image sensor 35 through the same path as the return light of the alignment light. Manual focusing or auto focusing can be executed based on the received light image (split index image).

The diopter correction lenses 70 and 71 can be selectively inserted into the photographing optical path between the perforated mirror 21 and the dichroic mirror 55. The diopter correction lens 70 is a plus lens (convex lens) for correcting high-intensity hyperopia. The diopter correction lens 71 is a minus lens (concave lens) for correcting intense myopia.

The dichroic mirror 46 synthesizes a fundus photography optical path and an OCT optical path (measurement arm). The dichroic mirror 46 reflects light in the wavelength band used for OCT and transmits light for fundus photography. The measuring arm is provided with a collimator lens unit 40, a retroreflector 41, a dispersion compensation member 42, an OCT focusing lens 43, an optical scanner 44, and a relay lens 45 in this order from the OCT unit 100 side.

The retroreflector 41 is movable in the direction of the arrow shown in FIG. 2, thereby changing the length of the measuring arm. The change in the measurement arm length is used, for example, for correcting the optical path length according to the axial length and adjusting the interference state.

The dispersion compensating member 42, together with the dispersion compensating member 113 (described later) arranged on the reference arm, acts to match the dispersion characteristics of the measurement light LS and the dispersion characteristics of the reference light LR.

The OCT focusing lens 43 is moved along the measuring arm to adjust the focus of the measuring arm. The movement of the photographing focusing lens 31, the movement of the focus optical system 60, and the movement of the OCT focusing lens 43 can be controlled in a coordinated manner.

The optical scanner 44 is substantially located at a position optically conjugate with the pupil of the eye E to be inspected. The optical scanner 44 deflects the measurement light LS guided by the measurement arm. The optical scanner 44 is, for example, a galvano scanner capable of two-dimensional scanning. Typically, the optical scanner 44 includes a one-dimensional scanner for deflecting the measurement light in the ± x direction and a one-dimensional scanner for deflecting the measurement light in the ± y direction. In this case, for example, one of these one-dimensional scanners is arranged at a position optically conjugate with the pupil, or a position optically conjugate with the pupil is arranged between these one-dimensional scanners.

<OCT unit 100>
The exemplary OCT unit 100 shown in FIG. 3 is provided with an optical system for performing swept source OCT. This optical system includes an interference optical system. This interference optical system divides the light from the variable wavelength light source into the measurement light and the reference light, and superimposes the return light of the measurement light projected on the eye E to be examined and the reference light passing through the reference optical path to cause the interference light. Is generated and this interference light is detected. The data (detection signal) obtained by the detection of the interference light is a signal representing the spectrum of the interference light and is sent to the arithmetic control unit 200.

The light source unit 101 includes, for example, a near-infrared wavelength tunable laser that changes the wavelength of emitted light at high speed. The light L0 output from the light source unit 101 is guided by the optical fiber 102 to the polarization controller 103, and its polarization state is adjusted. Further, the optical L0 is guided by the optical fiber 104 to the fiber coupler 105 and divided into the measurement optical LS and the reference optical LR. The optical path of the measurement light LS is called a measurement arm or the like, and the optical path of the reference light LR is called a reference arm or the like.

The reference light LR generated by the fiber coupler 105 is guided by the optical fiber 110 to the collimator 111, converted into a parallel luminous flux, and guided to the retroreflector 114 via the optical path length correction member 112 and the dispersion compensation member 113. The optical path length correction member 112 acts to match the optical path length of the reference light LR with the optical path length of the measurement light LS. The dispersion compensating member 113, together with the dispersion compensating member 42 arranged on the measurement arm, acts to match the dispersion characteristics between the reference light LR and the measurement light LS. The retroreflector 114 is movable along the optical path of the reference light LR incident on it, thereby changing the length of the reference arm. The change of the reference arm length is used, for example, for correcting the optical path length according to the axial length and adjusting the interference state.

The reference light LR that has passed through the retroreflector 114 is converted from a parallel luminous flux to a focused luminous flux by the collimator 116 via the dispersion compensating member 113 and the optical path length correction member 112, and is incident on the optical fiber 117. The reference light LR incident on the optical fiber 117 is guided by the polarization controller 118 to adjust its polarization state, is guided to the attenuator 120 through the optical fiber 119 to adjust the amount of light, and is guided to the fiber coupler 122 through the optical fiber 121. Be guided.

On the other hand, the measurement optical LS generated by the fiber coupler 105 is guided to the collimator lens unit 40 through the optical fiber 127 and converted into a parallel light beam, and is converted into a parallel light beam, the retroreflector 41, the dispersion compensation member 42, the OCT focusing lens 43, and the optical scanner 44. , And is reflected by the dichroic mirror 46 via the relay lens 45, refracted by the objective lens 22, and projected onto the eye E to be inspected. The measurement light LS is scattered and reflected at various depth positions of the eye E to be inspected. The return light from the eye E to be inspected of the measurement light LS travels in the opposite direction on the measurement arm, is guided to the fiber coupler 105, and reaches the fiber coupler 122 via the optical fiber 128.

The fiber coupler 122 superimposes the measurement light LS incidented via the optical fiber 128 and the reference light LR incidented via the optical fiber 121 to generate interference light. The fiber coupler 122 generates a pair of interference light LCs by branching the generated interference light at a predetermined branching ratio (for example, 1: 1). The pair of interference light LCs are guided to the detector 125 through the optical fibers 123 and 124, respectively.

The detector 125 includes, for example, a balanced photodiode. The balanced photodiode includes a pair of photodetectors that detect each pair of interference light LCs, and outputs the difference between the pair of detection signals obtained by these. The detector 125 sends this output (detection signal such as a difference signal) to the data collection system (DAQ) 130.

A clock KC is supplied to the data collection system 130 from the light source unit 101. The clock KC is generated in the light source unit 101 in synchronization with the output timing of each wavelength swept within a predetermined wavelength range by the tunable light source. The light source unit 101, for example, branches the light L0 of each output wavelength to generate two branched lights, optically delays one of the branched lights, synthesizes the branched lights, and produces the obtained combined light. It detects and generates a clock KC based on the detected signal. The data collection system 130 executes sampling of the detection signal (difference signal) input from the detector 125 based on the clock KC. The data collection system 130 sends the data obtained by this sampling to the arithmetic control unit 200.

In this example, both an element for changing the measurement arm length (for example, the retroreflector 41) and an element for changing the reference arm length (for example, the retroreflector 114 or the reference mirror) are provided. However, only one of these elements may be provided. Further, the elements for changing the difference (optical path length difference) between the measurement arm length and the reference arm length are not limited to these, and any element (optical member, mechanism, etc.) can be adopted. ..

<Calculation control unit 200>
The arithmetic control unit 200 controls each part of the fundus camera unit 2, the display device 3, and the OCT unit 100. In addition, the arithmetic control unit 200 executes various arithmetic processes. For example, the arithmetic control unit 200 performs signal processing such as Fourier transform on the spectral distribution based on the sampling data group obtained by the data collection system 130 for each series of wavelength scans (for each A line), thereby performing each A. Form a reflection intensity profile in the line. Further, the arithmetic control unit 200 forms image data by imaging the reflection intensity profile of each A line. The arithmetic processing for that purpose is the same as that of the conventional swept source OCT.

The arithmetic control unit 200 includes, for example, a processor, a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk drive, a communication interface, and the like. Various computer programs are stored in a storage device such as a hard disk drive. The arithmetic control unit 200 may include an operation device, an input device, a display device, and the like.

<Control system>
Examples of the configuration of the control system (processing system) of the ophthalmologic imaging apparatus 1 are shown in FIGS. 4 and 5. The control unit 210, the image forming unit 220, and the data processing unit 230 are provided in, for example, the arithmetic control unit 200.

<Control unit 210>
The control unit 210 includes a processor and controls each unit of the ophthalmologic imaging apparatus 1. The control unit 210 includes a main control unit 211 and a storage unit 212.

<Main control unit 211>
The main control unit 211 includes a processor and controls each element of the ophthalmologic imaging apparatus 1 (including the elements shown in FIGS. 2 to 5). The main control unit 211 is realized by the cooperation between the hardware including the circuit and the control software.

The photographing focusing lens 31 arranged in the photographing optical path and the focusing optical system 60 arranged in the illumination optical path are moved by a photographing focusing drive unit (not shown) under the control of the main control unit 211. The retroreflector 41 provided on the measuring arm is moved by the retroreflector (RR) drive unit 41A under the control of the main control unit 211. The OCT focusing lens 43 arranged on the measuring arm is moved by the OCT focusing driving unit 43A under the control of the main control unit 211. The optical scanner 44 provided on the measuring arm operates under the control of the main control unit 211. The retroreflector 114 arranged on the reference arm is moved by the retroreflector (RR) drive unit 114A under the control of the main control unit 211. Each of these drive units includes an actuator such as a pulse motor that operates under the control of the main control unit 211.

The moving mechanism 150 moves, for example, at least the fundus camera unit 2 three-dimensionally. In a typical example, the moving mechanism 150 includes an x stage that can move in the ± x direction (horizontal direction), an x moving mechanism that moves the x stage, and a y stage that can move in the ± y direction (vertical direction). , The y-moving mechanism that moves the y-stage, the z-stage that can move in the ± z direction (depth direction), and the z-moving mechanism that moves the z-stage are included. Each of these moving mechanisms includes an actuator such as a pulse motor that operates under the control of the main control unit 211.

<Memory unit 212>
The storage unit 212 stores various types of data. The data stored in the storage unit 212 includes, for example, image data of an OCT image, image data of a fundus image, eye information to be inspected, and the like. The eye test information includes subject information such as patient ID and name, left eye / right eye identification information, electronic medical record information, and the like.

<Image forming unit 220>
The image forming unit 220 forms image data based on the data collected by the data collecting system 130. The image forming unit 220 includes a processor. The image forming unit 220 is realized by the cooperation of the hardware including the circuit and the image forming software.

The image forming unit 220 forms the cross-sectional image data based on the data collected by the data collecting system 130. This processing includes signal processing such as noise removal (noise reduction), filtering, and fast Fourier transform (FFT), as in the conventional swept source OCT.

The image data formed by the image forming unit 220 is a group of images formed by imaging reflection intensity profiles in a plurality of A lines (scan lines along the z direction) arranged in an area to which an OCT scan is applied. A data set containing image data (a group of A-scan image data).

The image data formed by the image forming unit 220 is, for example, one or more B-scan image data, or stack data formed by embedding a plurality of B-scan image data in a single three-dimensional coordinate system. The image forming unit 220 can also perform volume data (voxel data) by performing interpolation processing or the like on the stack data. Stack data and volume data are typical examples of three-dimensional image data represented by a three-dimensional coordinate system.

When OCT angiography is performed, the main control unit 211 repeatedly scans the same area of the fundus Ef a predetermined number of times. The image forming unit 220 can form a motion contrast image based on the data set collected by the data collecting system 130 in this repeated scan. This motion contrast image is an angiographic image that emphasizes the temporal change of the interference signal due to the blood flow of the fundus Ef. Typically, OCT angiography is applied to the three-dimensional region of the fundus Ef to obtain an image showing the three-dimensional distribution of blood vessels in the fundus Ef.

The image forming unit 220 can process three-dimensional image data. For example, the image forming unit 220 can construct new image data by applying rendering to the three-dimensional image data. Rendering methods include volume rendering, maximum value projection (MIP), minimum value projection (MinIP), surface rendering, and multi-section reconstruction (MPR). Further, the image forming unit 220 can construct the projection data by projecting the three-dimensional image data in the z direction (A line direction, depth direction). Further, the image forming unit 220 can construct a shadow gram by projecting a part of the three-dimensional image data in the z direction. A part of the three-dimensional image data projected to construct the shadow gram is set by using, for example, segmentation described later.

When OCT angiography is performed, the image forming unit 220 can construct arbitrary 2D angiographic image data and / or arbitrary pseudo 3D angiographic image data from 3D angiographic image data. Is. For example, the image forming unit 220 can construct two-dimensional angiographic image data representing an arbitrary cross section of the fundus Ef by applying the multi-section reconstruction to the three-dimensional angiographic image data.

<Data processing unit 230>
The data processing unit 230 executes various data processing. For example, the data processing unit 230 can apply image processing or analysis processing to OCT image data, or apply image processing or analysis processing to observation image data or captured image data. The data processing unit 230 includes, for example, at least one of a processor and a dedicated circuit board.

The configuration of the exemplary data processing unit 230 is shown in FIG. The data processing unit 230 of this example includes a fixation position setting unit 231 and an image processing unit 232. The fixation system 250 is configured to present the fixation target to the eye E to be inspected. The fixation system 250 of this example includes an LCD 39 and an optical system for projecting a light flux output from the LCD 39 onto the fundus Ef. Further, the image acquisition unit 260 is configured to acquire an image by applying OCT to the fundus Ef of the eye E to be inspected. The image acquisition unit 260 of this example includes an element group that constitutes a measurement arm provided in the fundus camera unit 2, an element group provided in the OCT unit 100, and an image forming unit 220.

<Fixed position setting unit 231>
The fixation position setting unit 231 sets the fixation position for applying OCT to the fundus Ef. In particular, the fixation position setting unit 231 can set the fixation position for applying panoramic photography to the fundus Ef. The processing that can be executed by the fixation position setting unit 231 of this example will be described later.

<Image processing unit 232>
The image processing unit 232 processes the OCT image acquired by the image acquisition unit 260. Even if the image processing unit 232 can process the fundus image (observation image, captured image, etc.) acquired by the fundus camera unit 2, or process the image acquired by another ophthalmologic imaging device. good.

For example, the image processing unit 232 can apply segmentation to the two-dimensional cross-sectional image data or the three-dimensional image data. Segmentation is a process of identifying a partial area in an image. Typically, segmentation is utilized to identify an image region that corresponds to a predetermined tissue of the fundus Ef.

As described above, the image forming unit 220 can project the image region specified by the segmentation in the z direction to construct a shadow gram (frontal angiography image data or the like). Examples of shadowgrams include shadowgrams corresponding to any depth region of the fundus Ef (eg, superficial retina, deep retina, choroidal capillary plate, sclera, etc.) and any tissue (eg, inner border membrane, etc.). Nerve fiber layer, ganglion cell layer, inner reticular layer, inner granule layer, outer plexiform layer, outer granule layer, outer border membrane, retinal pigment epithelium, Bruch's membrane, choroid, choroidal sclera border, sclera, any of these There are shadowgrams corresponding to some of them, at least two or more combinations of these, etc.).

The image processing unit 232 includes an image processing processor and an image analysis processor. The image processing processor is realized by the collaboration between the hardware including the circuit and the image processing software. Further, the image analysis processor is realized by the collaboration between the hardware including the circuit and the image analysis software.

The processing that can be executed by the image processing unit 232 of this example will be described later.

<Synthesis processing unit 2321>
The image processing unit 232 includes a composition processing unit 2321. The composition processing unit 2321 forms a composite image of two or more three-dimensional images acquired corresponding to two or more fixation positions that are different from each other in panoramic photography. The processing that can be executed by the synthesis processing unit 2321 of this example will be described later.

<User interface 240>
The user interface 240 includes a display unit 241 and an operation unit 242. The display unit 241 includes a display device 3. The operation unit 242 includes various operation devices and input devices. The user interface 240 may include a device such as a touch panel in which a display function and an operation function are integrated. It is also possible to build embodiments that do not include at least a portion of the user interface 240. For example, the display device may be an external device connected to the ophthalmologic imaging device.

<About panoramic shooting>
The panoramic shooting that can be performed in this example will be described. In this example, OCT is applied to the fundus Ef in order to set the fixation position for panoramic photography. This preliminary OCT is, for example, a first preliminary OCT for setting the center position of panoramic photography and a first preliminary OCT for setting a plurality of fixation positions for a plurality of OCTs performed in panoramic photography. Includes 2 preliminary OCTs. The execution of the first preliminary OCT is optional. The second preliminary OCT may be performed without going through the first preliminary OCT.

<About the first preliminary OCT, etc.>
An example of the first preliminary OCT will be described. In the first preliminary OCT, the main control unit 211 presents a first fixation target for acquiring a three-dimensional image centered on a predetermined portion of the fundus Ef to the eye E, and three-dimensionally the fundus Ef. The fixation system 250 and the image acquisition unit 260 are controlled so as to acquire an image (referred to as a preliminary three-dimensional image). In this example, this predetermined site (that is, the first fixation position) is assumed to be the macula (the center of the macula, the fovea centralis), but it may be another site of the fundus (for example, the optic disc or the center of the fundus). good.

The image processing unit 232 calculates the deviation of the image of a predetermined portion of the fundus Ef with respect to the center position of the preliminary three-dimensional image.

For example, the image processing unit 232 first analyzes the preliminary three-dimensional image to obtain the coordinates of the pixel corresponding to the center of the macula. This process includes, for example, a process of identifying an image region corresponding to the inner limiting membrane by segmentation, and a process of identifying the coordinates of the center of the macula from the shape of the identified image region.

Subsequently, the image processing unit 232 obtains the difference between the coordinates of the identified center of the macula and the coordinates of the center position of the preliminary three-dimensional image. Here, the center position of the preliminary three-dimensional image may be defined as, for example, the center position of the array region of a plurality of line scans constituting the raster scan, or the center position of the three-dimensional region to be imaged. The difference between the coordinates of the macula center and the coordinates of the center position of the preliminary 3D image corresponds to the actual deviation of the macula center with respect to the center position of the 3D scan applied in the first preliminary OCT.

Based on the deviation obtained by the image processing unit 232, the fixation position setting unit 231 can correct the first fixation position. For example, the fixation position setting unit 231 corrects the first fixation position so that the deviation obtained by the image processing unit 232 is canceled (that is, the deviation becomes zero). As a result, the center position of the three-dimensional scan (center position of panoramic photography) substantially coincides with the portion (macula) corresponding to the first fixation position.

Further, the fixation position setting unit 231 can correct the default second fixation position. As a specific example, the fixation position setting unit 231 corrects the same as the correction amount of the first fixation position so that the relative position between the first fixation position and the second fixation position is maintained. The amount is applied to the second fixation position. That is, the fixation position setting unit 231 applies a correction amount corresponding to the inverse vector of the deviation (vector) obtained by the image processing unit 232 to the second fixation position.

The main control unit 211 can perform the second preliminary OCT by applying the first fixation position and the second fixation position corrected by the fixation position setting unit 231.

<About the second preliminary OCT, etc.>
An example of the second preliminary OCT will be described. In the second preliminary OCT, the main control unit 211 executes the first control and the second control. In the first control, the main control unit 211 presents the first fixation target corresponding to the first fixation position to the eye E to be examined, and the three-dimensional image of the fundus Ef (referred to as the first three-dimensional image). ) Is controlled so that the fixation system 250 and the image acquisition unit 260 are acquired. Similarly, in the second control, the main control unit 211 presents the second fixation target corresponding to the second fixation position to the eye E to be examined, and the three-dimensional image of the fundus Ef (second three-dimensional). The fixation system 250 and the image acquisition unit 260 are controlled so as to acquire an image).

In the first control, the main control unit 211 controls the fixation system 250 so as to display the fixation target at the display position (pixel) of the LCD 39 corresponding to the first fixation position, and the fundus of the eye. The image acquisition unit 260 is controlled so as to scan the three-dimensional region of Ef and form the first three-dimensional image.

Similarly, in the second control, the main control unit 211 controls the fixation system 250 so as to display the fixation target at the display position (pixel) of the LCD 39 corresponding to the second fixation position, for example. In addition, the image acquisition unit 260 is controlled so as to scan the three-dimensional region of the fundus Ef to form a second three-dimensional image.

Here, the first fixation position is a default fixation position for acquiring a three-dimensional image centered on a predetermined portion of the fundus, and for example, as described above, a three-dimensional image centered on the macula. It may be a fixation position for obtaining. The second fixation position is a default fixation position for acquiring a three-dimensional image centered on a position separated by a predetermined distance in a predetermined direction from the predetermined portion in the fundus of a standard eye.

An example of the first fixation position and the second fixation position is shown in FIG. Reference numeral 301 indicates a first fixation target (fixed target for photographing the macula) corresponding to the macula, which is the first fixation position. Reference numeral 311 indicates a three-dimensional scan range centered on the macula (scan range for photographing the macula). The scan range 311 for macular photography is set, for example, to have a length in the x direction of L (mm) and a length in the y direction of L (mm). The pattern of this three-dimensional scan is, for example, a raster scan. This raster scan includes, for example, a plurality of line scans extending in the x direction, and these line scans are arranged in the y direction parallel to each other.

Further, reference numeral 302 indicates a second fixation target (peripheral imaging fixation target or peripheral fixation target) corresponding to a position (second fixation position) separated from the macula in the lower left direction by a predetermined distance. .. Reference numeral 312 indicates a three-dimensional scan range (scan range for peripheral photography) centered on the second fixation position. The peripheral imaging scan range 312 is set to have a length in the x direction of L (mm) and a length in the y direction of L (mm), as in the case of the macula imaging scan range 311 for example.

On the display screen of the LCD 39, the macula imaging fixation target 301 and the peripheral imaging fixation target 302 are separated by D (pixels, dots).

When the eye to be inspected E is a standard eye, as shown in FIG. 6, the overlapping region between the macula imaging scan range 311 and the peripheral imaging scan range 312 has a length of La (mm) in the x direction and y. The length in the direction is La (mm). In such a case, the first three-dimensional image obtained by scanning the scan range 311 for yellow spot photography with the first control and the scan range 312 obtained by scanning the scan range 312 for peripheral photography with the second control. The overlapping region with the three-dimensional image of 2 has a length of La (mm) in the x direction and a length of La (mm) in the y direction.

Here, the standard eye is typically an eye whose axial length belongs to the standard range (for example, an eye that is neither long-axis long eye nor short-axis long eye) and / or diopter. Is an eye that belongs to the standard range (eg, an eye that is neither near-sighted nor far-sighted).

On the other hand, for example, when the axial length of the eye E to be inspected is shorter than the standard, as shown in FIG. 7, the dimensions of the scan range 321 for macular photography and the scan range 322 for peripheral photography are the same as those of the standard eye. It becomes smaller in comparison. Here, if the length in the x direction is M (mm) and the length in the y direction is M (mm) for each of the scan range 321 for macular photography and the scan range 322 for peripheral photography, M <L. .. Further, the overlapping region of the scan range 321 for macular photography and the scan range 322 for peripheral photography has a length of Ma (mm) in the x direction and a length of Ma (mm) in the y direction. Here, Ma <La. When the axial length of the eye to be inspected E is shorter than the standard in this way, the first three-dimensional image obtained by scanning the scan range 321 for yellow spot imaging with the first control and the peripheral imaging with the second control. The overlapping region with the second three-dimensional image obtained by scanning the scan range 322 has a length of Ma (mm) in the x direction and a length of Ma (mm) in the y direction.

On the contrary, when the axial length of the eye E to be inspected is longer than the standard, as shown in FIG. 8, the dimensions of the scan range 331 for macular photography and the scan range 332 for peripheral photography are compared with those of the standard eye. Will grow. Here, if the length in the x direction is N (mm) and the length in the y direction is N (mm) for each of the scan range 331 for macular photography and the scan range 332 for peripheral photography, N> L. .. Further, the overlapping region of the scan range 331 for macular photography and the scan range 332 for peripheral photography has a length of Na (mm) in the x direction and a length of Na (mm) in the y direction. Here, Na> La. When the axial length of the eye to be inspected E is longer than the standard in this way, the first three-dimensional image obtained by scanning the scan range 331 for yellow spot imaging with the first control and the peripheral imaging with the second control. The overlapping region with the second three-dimensional image obtained by scanning the scan range 332 has a length of Na (mm) in the x direction and a length of Na (mm) in the y direction.

In this way, the dimension of the overlapping region between the first three-dimensional image and the second three-dimensional image changes according to the value of the axial length of the eye E to be inspected. More specifically, the shorter the axial length of the eye E to be inspected, the smaller the dimension of the overlapping region, and the longer the axial length of the eye E to be inspected, the larger the dimension of the overlapping region. The same applies to eyeball parameters such as diopter. In the present embodiment, a plurality of fixation targets for panoramic photography can be set by utilizing such a relationship.

More generally, the fixation position setting unit 231 of the present embodiment sets the fixation position for panoramic photography based on the first three-dimensional image and the second three-dimensional image.

In one example, the fixation position setting unit 231 first identifies an overlapping region between the first three-dimensional image and the second three-dimensional image. In this process, for example, the first partial region in the first three-dimensional image and the second partial region in the second three-dimensional image have a high degree of matching (image correlation, etc.). It is realized by specifying a subregion and a second subregion. In this example, the fixation position setting unit 231 further sets the fixation position for panoramic photography based on the specified overlapping region.

For example, the fixation position setting unit 231 calculates the dimension of the overlapping region between the first three-dimensional image and the second three-dimensional image, and sets the fixation position for panoramic photography based on this dimension. You may. Here, the parameter indicating the dimension of the overlapping region may include at least one of a length in the x direction, a length in the y direction, a diagonal length, an area, a volume, and the like.

For example, the fixation position setting unit 231 sets the fixation position for panoramic photography so that the dimension of the overlapping region between the first three-dimensional image and the second three-dimensional image is substantially equal to the default value. You may. This default value indicates, for example, the dimension (dimension range) of the overlapping region that should be obtained when the eye E to be inspected is a standard eye. For example, as shown in FIG. 6, the default values are length La in the x direction, length La in the y direction, diagonal length (√2) × La, area La × La, and volume La × La × ζ ( ζ may include, for example, at least one of (image range in the z direction) and the like.

Further, the fixation position setting unit 231 corrects the deviation of the second fixation position with respect to the first fixation position based on the first three-dimensional image and the second three-dimensional image, thereby panoramic. The fixation position for shooting may be set. Typically, when the first fixation position corresponds to the macula, the deviation of the second fixation position with respect to the first fixation position in the second preliminary OCT is captured in the first three-dimensional image. By correcting based on the second three-dimensional image and the second three-dimensional image, the peripheral fixation position located in the vicinity of the second fixation position can be set as one of the fixation positions for panoramic photography.

<motion>
The operation of the ophthalmologic imaging apparatus 1 according to the present embodiment will be described. An example of the operation of the ophthalmologic imaging device 1 is shown in FIG. It is assumed that general preparatory processes such as patient information input, alignment, focus adjustment, interference sensitivity adjustment, and z position adjustment have already been completed.

(S1: Perform the first preliminary OCT)
First, the ophthalmologic imaging apparatus 1 executes the first preliminary OCT described above. The first preliminary OCT is performed to set the center position of panoramic photography. In the first preliminary OCT of this example, the main control unit 211 controls the fixation system 250 so as to present the default fixation target for macular photography to the eye E to be examined, and the fixation for macular photography is achieved. The image acquisition unit 260 is controlled so as to apply a three-dimensional scan to the fundus Ef of the eye E to be inspected on which the target is presented. Thereby, a preliminary three-dimensional image is obtained.

Here, the default fixation target for macular photography is typically a visible bright spot displayed at the center position of the display screen of the LCD 39 (that is, the position on the optical axis of the optical path branched by the half mirror 33A). Is. However, the default macular imaging target is not limited to this. Also, the 3D scan applied to the first preliminary OCT is typically, but is not limited to, a raster scan.

(S2: Set the center position for panoramic shooting)
The main control unit 211 sends the preliminary three-dimensional image acquired in the first preliminary OCT of step S1 to the data processing unit 230. The image processing unit 232 calculates the deviation of the image of the macula of the fundus Ef with respect to the center position of the preliminary three-dimensional image.

Here, reference is made to FIG. 10A. Reference numeral 400 indicates a preliminary three-dimensional image. It is assumed that the length of the preliminary three-dimensional image 400 in the x direction and the length in the y direction are both R (mm). Reference numeral 401 indicates a center position (center position on the xy plane) of the preliminary three-dimensional image 400. Reference numeral 402 indicates the position of the macula (center of the macula) depicted in the preliminary three-dimensional image. Reference numeral 403 indicates the deviation of the macula center 402 with respect to the center position 401 of the preliminary three-dimensional image 400. In this example, the image processing unit 232 calculates the deviation 403 of the macula center 402 with respect to the center position 401 by analyzing the preliminary three-dimensional image 400.

The fixation position setting unit 231 corrects the fixation position (that is, the display position of the visible bright spot on the display screen of the LCD 39) corresponding to the default fixation target for macular photography based on the calculated deviation 403. .. The position of the fundus Ef (macula) corresponding to the corrected fixation target for macular imaging is set at the center position of panoramic imaging. That is, by applying the translation of the direction and distance corresponding to the inverse vector of the vector represented by the deviation 403 to the default macula imaging fixation target, as shown in FIG. 10B, a (virtual) three-dimensional image. The position of the default macular imaging target is corrected so that the macula 451 is visualized at the center position of 450. Further, the fixation position setting unit 231 makes the same correction for the default peripheral fixation position (second fixation position).

(S3: Start the second preliminary OCT)
When the setting of the center position of the panoramic photography (position correction of the fixation target for macular photography and further position correction of the peripheral fixation target) is completed, the process shifts to the second preliminary OCT. In the second preliminary OCT of this example, the first control described above is executed by applying the first fixation position corrected in step S2, and the second fixation corrected in step S2. The second control described above is performed by applying the position.

(S4: Execute the first control to acquire the first three-dimensional image)
In the first control, the main control unit 211 presents the first fixation target corresponding to the first fixation position corrected in step S2 to the eye E to be examined, and the first three-dimensional image of the fundus Ef. The fixation system 250 and the image acquisition unit 260 are controlled so as to acquire the image.

In this example, the main control unit 211 displays the visible bright spot at the position (pixel) of the display screen of the LCD 39 corresponding to the fixation position of the fixation target for macular photography corrected in step S2. Further, the main control unit 211 controls the image acquisition unit 260 so as to apply a three-dimensional scan to the fundus Ef to form a first three-dimensional image.

(S5: Execute the second control to acquire the second three-dimensional image)
After the completion of the first control in step S4, the process shifts to the second control. In the second control, the main control unit 211 presents the second fixation target corresponding to the second fixation position corrected in step S2 to the eye E to be examined, and the second three-dimensional image of the fundus Ef. The fixation system 250 and the image acquisition unit 260 are controlled so as to acquire the image.

In this example, the main control unit 211 displays the visible bright spot at the position (pixel) of the display screen of the LCD 39 corresponding to the fixation position of the peripheral fixation target corrected in step S2. Further, the main control unit 211 controls the image acquisition unit 260 so as to apply a three-dimensional scan to the fundus Ef to form a second three-dimensional image.

In this example, the second control is executed after the first control, but conversely, the first control may be executed after the second control.

Further, the imaging method applied in the first control and / or the second control may be a general three-dimensional OCT scan or a three-dimensional OCT angiography. Alternatively, other imaging methods (eg, functional OCT) can be applied to the first and / or second control.

(S6: Set multiple fixation positions for panoramic shooting)
When the first control and the second control are completed, the process shifts to the setting of the fixation position for panoramic photography. The fixation position setting unit 231 sets a plurality of fixation positions for panoramic shooting based on the first three-dimensional image acquired in step S4 and the second three-dimensional image acquired in step S5. Set.

For example, it is assumed that the first three-dimensional image 501 and the second three-dimensional image 502 shown in FIG. 11A are acquired. Further, similarly to the preliminary three-dimensional image 400, the length of the first three-dimensional image 501 in the x direction and the length in the y direction are both R (mm), and the length of the second three-dimensional image 502 in the x direction. And the length in the y direction are both R (mm).

The fixation position setting unit 231 first identifies an overlapping region 503 between the first three-dimensional image 501 and the second three-dimensional image 502.

Next, the fixation position setting unit 231 calculates the dimensions of the specified overlapping region 503 (see FIG. 11B). In this example, the fixation position setting unit 231 calculates the length Rx (mm) of the overlapping region 503 in the x direction and the length Ry (mm) in the y direction (see FIG. 11B).

Next, the fixation position setting unit 231 sets a plurality of fixation positions for panoramic photography based on the calculated dimensions Rx (mm) and Ry (mm) of the overlapping region 503. For example, the fixation position setting unit 231 further sets the fixation position of the peripheral fixation target corrected in step S2 so that the dimensions Rx (mm) and Ry (mm) of the overlapping region 503 are substantially equal to the default values. to correct. In other words, the fixation position setting unit 231 sets the display position (pixel position of the display screen of the LCD 39) of the peripheral fixation target (visible bright spot) corrected in step S2 to the dimension Rx (mm) of the overlapping region 503 and the dimension Rx (mm). Change Ry (mm) so that it is approximately equal to the default value.

If the eye E to be inspected is a standard eye, the dimensions Rx (mm) and Ry (mm) of the overlapping region 503 are both substantially equal to the default R / 2 (mm). On the other hand, when the eye E to be inspected is not a standard eye, at least one of the dimensions Rx and Ry of the overlapping region 503 is substantially different from the default value R / 2 (mm).

Here, "the dimension is substantially equal to the default value" means, for example, the case where the dimension is included in the range of the preset tolerance (error with respect to the default value). Further, "the dimension is substantially different from the default value" means, for example, the case where the dimension is not included in the range of the preset tolerance (error with respect to the default value).

As described above, the cause of the difference between the dimensions Rx (mm) and Ry (mm) of the overlapping region 503 and the default value R / 2 (mm) is the difference in the values of the eyeball parameters such as the axial length and the diopter. It is due to the displacement of the fixation position. In this example, by correcting such a displacement of the fixation position, the peripheral fixation position for panoramic photography is optimized.

For example, the fixation position setting unit 231 has a difference (R / 2-Rx, R / 2-) between the dimensions Rx (mm) and Ry (mm) of the overlapping region 503 and the default value R / 2 (mm). Ry) is calculated. Further, the displacement between the display position of the fixation target for macular photography and the display position of the peripheral fixation target located at the lower left thereof is Dx (pixels, dots) in the x direction and Dy (pixels, dots) in the y direction. ) (Here, Dx = Dy may be used). Then, the display position of the peripheral fixation target may be moved by the number of dots corresponding to ([R / 2-Rx] / Dx, [R / 2-Ry] / Dy). The fixation position setting unit 231 can perform such an operation.

In this way, the fixation position setting unit 231 can set the peripheral fixation position located at the lower left with respect to the fixation position for macular photography. Using this result, it is possible to set other peripheral fixation positions.

For example, as shown in FIG. 12, it is assumed that the first peripheral fixation position 601 located at the lower left of the macula 600 (fixation position for macula photography) is set as described above. The first peripheral fixation position 601 is set at a position separated from the macula 600 in the lower left direction by a distance T. In this case, the fixation position setting unit 231 sets the second peripheral fixation position 602 at a position separated from the macula 600 in the upper left direction by a distance T, and (2) distances T from the macula 600 in the upper right direction. The third peripheral fixation position 603 can be set at a position only separated by, and (3) the fourth peripheral fixation position 604 can be set at a position separated by a distance T in the lower right direction from the macula 600.

The number of the plurality of peripheral fixation positions is not limited to four, and the arrangement of the plurality of peripheral fixation positions is not limited to the arrangement shown in FIG. In general, setting (correcting) a plurality of peripheral fixation positions according to a preset arrangement of a plurality of peripheral fixation positions (for example, a default arrangement, an arrangement specified by a user or an ophthalmologic imaging device 1). Is possible.

(S7: Perform panoramic shooting to acquire multiple 3D images)
The main control unit 211 controls the fixation system 250 so as to sequentially present a plurality of fixation targets corresponding to the plurality of (peripheral) fixation positions set in step S6 to the eye E to be inspected, and these The image acquisition unit 260 is controlled so as to acquire a three-dimensional image of the fundus Ef when each of the fixation targets of the above is presented to the eye E to be inspected.

As an example, a case where the four peripheral fixation positions 601 to 604 shown in FIG. 12 are applied to panoramic photography will be described.

First, the main control unit 211 controls the fixation system 250 so as to present the first peripheral fixation target corresponding to the first peripheral fixation position 601, and further, the first peripheral fixation target is presented. The image acquisition unit 260 is controlled so as to execute the three-dimensional scan in this state. As a result, the first peripheral three-dimensional image corresponding to the first peripheral scan range 611 shown in FIG. 12 is acquired. The dimensions of the first peripheral three-dimensional image (first peripheral scan range) are R (mm) for both the length in the x direction and the length in the y direction.

Next, the main control unit 211 controls the fixation system 250 so as to present the second peripheral fixation target corresponding to the second peripheral fixation position 602, and further, the second peripheral fixation target The image acquisition unit 260 is controlled so as to execute the three-dimensional scan in the presented state. As a result, a second peripheral three-dimensional image corresponding to the second peripheral scan range 612 shown in FIG. 12 is acquired. The dimensions of the second peripheral three-dimensional image (second peripheral scan range) are R (mm) for both the length in the x direction and the length in the y direction.

Subsequently, the main control unit 211 controls the fixation system 250 so as to present the third peripheral fixation target corresponding to the third peripheral fixation position 603, and further, the third peripheral fixation target sets the third peripheral fixation target. The image acquisition unit 260 is controlled so as to execute the three-dimensional scan in the presented state. As a result, a third peripheral three-dimensional image corresponding to the third peripheral scan range 613 shown in FIG. 12 is acquired. The dimensions of the third peripheral three-dimensional image (third peripheral scan range) are R (mm) for both the length in the x direction and the length in the y direction.

Finally, the main control unit 211 controls the fixation system 250 so as to present the fourth peripheral fixation target corresponding to the fourth peripheral fixation position 604, and further, the fourth peripheral fixation target sets the fourth peripheral fixation target. The image acquisition unit 260 is controlled so as to execute the three-dimensional scan in the presented state. As a result, a fourth peripheral three-dimensional image corresponding to the fourth peripheral scan range 614 shown in FIG. 12 is acquired. The dimensions of the fourth peripheral three-dimensional image (fourth peripheral scan range) are R (mm) for both the length in the x direction and the length in the y direction.

Further, the two peripheral three-dimensional images adjacent to each other have an overlapping region (margin) having a width suitable for synthesizing them. For example, in the example shown in FIG. 12, the first peripheral scan range and the second peripheral scan range have an overlapping region of width ΔR, and the second peripheral scan range and the third peripheral scan range have a width ΔR. The third peripheral scan range and the fourth peripheral scan range have overlapping areas of width ΔR, and the fourth peripheral scan range and the first peripheral scan range have overlapping width ΔR. Has an area.

(S8: Form a composite image)
The compositing processing unit 2321 forms a composite image (mosaic image) of a plurality of three-dimensional images acquired in step S7. As an example, in the example shown in FIG. 12, the synthesis processing unit 2321 synthesizes the first to fourth peripheral three-dimensional images to form a single three-dimensional image. It is also possible to combine any two or more three-dimensional images among the plurality of three-dimensional images acquired in step S7.

The process of synthesizing a plurality of 3D images includes, for example, matching of overlapping regions using image correlation and the like, and positioning of peripheral 3D images using the result of this matching, as in the conventional image synthesizing technique. , Including a compositing process with these peripheral three-dimensional images.

(S9: Display / save composite image)
The main control unit 211 can display the composite image formed in step S8 on the display unit 241. Further, the main control unit 211 controls to store the composite image in the storage unit 212, to transmit the composite image to an external device, and to record the composite image on the recording medium. Is possible.

Further, the main control unit 211 can display a part or all of the plurality of three-dimensional images formed in step S7 on the display unit 241. This completes the process related to this example.

<Modification example>
In the operation example described above, after the first preliminary OCT is performed, the second preliminary OCT including the first control and the second control is performed. However, it is possible to omit the first control of the second preliminary OCT.

For example, the preliminary three-dimensional image acquired by the first preliminary OCT and the deviation 403 described above can be used in place of the first three-dimensional image acquired by the first control. That is, since the common first fixation position is applied in the first control of the first preliminary OCT and the second preliminary OCT, the preliminary 3 obtained in the first preliminary OCT is applied. A three-dimensional image obtained by shifting the position of the three-dimensional image based on the displacement 403 can be used in place of the first three-dimensional image obtained by the first control.

In the above operation example, in the second preliminary OCT, as shown in FIGS. 11A and 11B, a three-dimensional scan of a scan range (full scan range) of R (mm) × R (mm) is executed. However, the three-dimensional scan may be performed only for a part of this scan range (partial scan range).

For example, in the first control of the second preliminary OCT, the main control unit 211 has the second full scan range 701 (three-dimensional scan range centered on the first fixation position) of the first full scan range 701. Controlling the image acquisition unit 260 so as to apply the three-dimensional scan to the first partial scan range 711 located on the side of the scan range 702 (the side of the three-dimensional scan range centered on the second fixation position). Can be done.

Similarly, in the second control of the second preliminary OCT, the main control unit 211 is the first of the second full scan range 702 (three-dimensional scan range centered on the second fixation position). The image acquisition unit 260 is controlled so that the three-dimensional scan is applied to the second partial scan range 712 located on the side of the full scan range 701 (the side of the three-dimensional scan range centered on the first fixation position). be able to.

In the first partial scan range 711 and the second partial scan range 712, for example, the displacement (direction, distance) between the first fixation position and the second fixation position and the fixation are appropriately performed. It is preset to include this overlapping area based on the dimensions of the overlapping area that are expected when it is assumed to be.

Even with the second preliminary OCT to which such a partial scan range is applied, it is possible to identify the overlapping region and calculate its dimensions as in the case of the above operation example.

In the above operation example, in the second control of the second preliminary OCT, the second fixation position is applied to perform a three-dimensional scan, and the peripheral fixation position corrected for the second fixation position is further performed. The three-dimensional scan to which the above is applied is executed in panoramic photography, but the latter can be omitted when the displacement between the second fixation position and the corrected peripheral fixation position is small.

For example, the main control unit 211 displaces the second fixation position applied to acquire the second three-dimensional image 502 shown in FIG. 11A and the first peripheral fixation position 601 shown in FIG. Is smaller than a predetermined threshold value. That is, the main control unit 211 determines whether or not the second fixation position and the first peripheral fixation position 601 substantially match.

When it is determined that the displacement is equal to or greater than the threshold value, the main control unit 211 executes a three-dimensional scan to which the first peripheral fixation position 601 is applied in the panoramic shooting, as in the above operation example.

On the other hand, when it is determined that the displacement is smaller than the threshold value, the main control unit 211 excludes the three-dimensional scan to which the first peripheral fixation position 601 is applied from the panoramic shooting. That is, the main control unit 211 controls the fixation system 250 and the image acquisition unit 260 so as to skip the acquisition of the three-dimensional image corresponding to the first peripheral fixation position 601 in the panoramic shooting. In this case, in the panoramic shooting, only the second, third, and fourth peripheral fixation positions 602, 603, and 604 are executed.

The compositing processing unit 2321 includes the first peripheral three-dimensional image acquired by the second control of the second preliminary OCT, and the second, third, and fourth peripheral three-dimensional images acquired by panoramic photography. A composite image can be formed by synthesizing.

In the above operation example, the plurality of scan ranges applied in the panoramic photography do not include the scan range applied in the first control of the second preliminary OCT, but may include this. In that case, the main control unit 211 determines whether the first fixation position and the corrected fixation position for panoramic photography substantially match, and if they substantially match, the fixation in panorama photography. It is possible to skip the 3D scan to which the visual position is applied. Further, the synthesis processing unit 2321 can apply the three-dimensional image acquired by the first control of the second preliminary OCT to the formation of the composite image.

<Action / effect>
The operation and effect of the ophthalmologic imaging apparatus 1 according to the present embodiment will be described.

The ophthalmologic imaging apparatus (1) according to the present embodiment includes a fixation system (250), an image acquisition unit (260), a control unit (main control unit 211), a fixation position setting unit (231), and an image. Includes a processing unit (232).

The fixation system (250) presents an fixation target to the eye to be inspected (E). The image acquisition unit (260) acquires an image by applying optical coherence tomography (OCT) to the fundus (Ef) of the eye to be inspected (E).

The control unit (211) executes a first control (first control in the second preliminary OCT) and a second control (second control in the second preliminary OCT).

In the first control, the control unit (211) presents the first fixation target corresponding to the first fixation position to the eye to be inspected (E), and the first three-dimensional image of the fundus (Ef) ( The fixation system (250) and the image acquisition unit (260) are controlled so as to acquire 501).

In the second control, the control unit (211) presents the second fixation target corresponding to the second fixation position to the eye to be inspected (E), and the second three-dimensional image of the fundus (Ef) ( The optometry system (250) and the image acquisition unit (260) are controlled so as to acquire 502).

The fixation position setting unit (231) is based on the first three-dimensional image (501) acquired by the first control and the second three-dimensional image (502) acquired by the second control. , Set one or more new fixation positions (at least the first peripheral fixation position 601) for panoramic photography. The fixation position setting unit (231) has one of two or more new fixation positions (for example, the first peripheral fixation position 601 and the second to fourth peripheral fixation positions 602-604). It is also possible to set two or more peripheral fixation positions consisting of the above. Further, the user may set the fixation position for panoramic shooting.

The image processing unit (232) processes the image acquired by the image acquisition unit (260). The image processing unit (232) includes a compositing processing unit (2321).

The control unit (211) has two or more fixation positions (first to first) including one or more new fixation positions set by the fixation position setting unit (231) as a third control (panorama shooting). The fixation system (250) so as to sequentially present two or more fixation targets (first to fourth peripheral fixation targets) corresponding to the peripheral fixation positions 601 to 604) to the eye to be inspected (E). And acquires a three-dimensional image of the fundus (Ef) when each of two or more fixation targets (first to fourth peripheral fixation targets) is presented to the eye to be inspected (E). The image acquisition unit (260) is controlled in this way.

The synthesis processing unit (2321) has two or more three-dimensional images (first to fourth) corresponding to two or more fixation positions (first to fourth peripheral fixation positions 601 to 604) acquired by the third control. A composite image (mosaic image) of the fourth peripheral three-dimensional image) is formed.

According to such an embodiment, a plurality of fixation positions for panoramic photography can be set by actually performing the first control and the second control. Thereby, regardless of individual differences such as eyeball size information such as axial length and eyeball characteristic information such as diopter, it is possible to preferably set a plurality of fixation positions for acquiring a mosaic image using OCT. Is possible.

In the present embodiment, the fixation position setting unit (231) is a first three-dimensional image (501) acquired by the first control and a second three-dimensional image (502) acquired by the second control. An overlapping region (503) with and from may be specified, and one or more new fixation positions for panoramic shooting may be set based on the overlapping region (503).

According to such a configuration, it is possible to set a suitable fixation position for panoramic photography based on the overlapping state of the first three-dimensional image and the second three-dimensional image.

Further, in the present embodiment, the fixation position setting unit (231) calculates the dimension of the overlapping region (503), and sets one or more new fixation positions for panoramic photography based on this dimension. May be good.

According to such a configuration, it is possible to set a suitable fixation position for panoramic photography based on the degree of overlap between the first three-dimensional image and the second three-dimensional image.

Further, in the present embodiment, the fixation position setting unit (231) sets one or more new fixation positions for panoramic photography so that the dimensions of the overlapping region (503) are substantially equal to the default values. May be good. This default value indicates, for example, the dimension (dimension range) of the overlapping region that should be obtained when the eye to be inspected (E) is a standard eye.

According to such a configuration, for panoramic photography, a plurality of three-dimensional images (first to fourth peripheral three-dimensional images) obtained in panoramic photography have overlapping regions so as to be suitably combined. It is possible to set the fixation position.

In the present embodiment, the first fixation position may be a default fixation position for acquiring a three-dimensional image centered on a predetermined portion of the fundus. Further, the second fixation position is a predetermined fixation position for acquiring a three-dimensional image centered on a position separated by a predetermined distance in a predetermined direction from the predetermined portion in the fundus of a standard eye. good.

According to such a configuration, the panorama of the eye to be inspected (E) is applied by applying the first fixation position and the second fixation position preset so that the panoramic image for a standard eye can be suitably performed. It is possible to set the optometry position for shooting.

Further, in the present embodiment, before the first control and the second control, the control unit (211) presents the first fixation target corresponding to the first fixation position to the eye to be inspected (E). While doing so, a preliminary control (first preliminary OCT) for controlling the fixation system (250) and the image acquisition unit (260) so as to acquire a preliminary three-dimensional image (400) of the fundus (Ef) is executed. You may. Further, the image processing unit (232) may calculate the deviation (403) of the image of the predetermined portion of the fundus (Ef) with respect to the center position (401) of the preliminary three-dimensional image (400). Further, the fixation position setting unit (231) may correct each of the first fixation position and the second fixation position based on the deviation (403). In addition, the control unit (211) applies the corrected first fixation position to execute the first control, and applies the corrected second fixation position to perform the second control. May be executed.

According to such a configuration, the first fixation position and the second fixation position corrected by using the preliminary three-dimensional image obtained by the first preliminary OCT are applied to the second fixation position. Two preliminary OCTs can be performed. As a result, the first fixation position can be made to correspond to a predetermined part of the fundus regardless of individual differences in the eyeball parameters of the eye to be inspected, and further, at a position separated from the predetermined part of the fundus by a predetermined distance in a predetermined direction. A second fixation position can be associated.

In the present embodiment, the fixation position setting unit (231) is a first three-dimensional image (501) acquired by the first control and a second three-dimensional image (502) acquired by the second control. Based on the above, the deviation of the second fixation position with respect to the first fixation position may be corrected, and one or more new fixation positions for panoramic photography may be set.

According to such a configuration, it is possible to suitably correct the relative position of the second fixation position with respect to the first fixation position.

In the present embodiment, the first fixation position may be a predetermined fixation position (fixation position for macula photography) for acquiring a three-dimensional image centered on the macula, and the second fixation position may be used. May be a predetermined fixation position (peripheral fixation position) for acquiring a three-dimensional image centered on a position separated from the macula by a predetermined distance in a predetermined direction in the fundus of a standard eye. Further, the fixation position setting unit (231) with respect to the first fixation position (fixation position for yellow spot photography) based on the first three-dimensional image (501) and the second three-dimensional image (502). By correcting the deviation of the second fixation position (peripheral fixation position), it corresponds to the position of the fundus (Ef) of the eye to be inspected (E) separated from the yellow spot by the first distance in the first direction. A first new fixation position (first peripheral fixation position 601 corresponding to a position separated from the yellow spot by a distance T in the lower left direction) is set, and a second position opposite to the first direction (lower left direction) is set. A second new fixation position (third peripheral fixation position 603) corresponding to a position separated from the yellow spot by a first distance (distance T) is set in the direction of (upper right direction), and the first direction is set. A third new fixation position (second peripheral fixation position 602) is set at a position separated from the yellow spot by a first distance (distance T) in a third direction (upper left direction) orthogonal to (lower left direction). A fourth new fixation position corresponding to a position set and separated from the yellow spot by a first distance (distance T) in a fourth direction (lower right direction) opposite to the third direction (upper left direction). (Fourth peripheral fixation position 604) may be set. In addition, the control unit (211) is assigned to a plurality of fixation positions (first to fourth peripheral fixation positions 601-604) including the first, second, third, and fourth fixation positions. Based on this, a third control (panoramic photography) may be executed.

According to such a configuration, it is possible to automatically and preferably set a plurality of fixation positions for panoramic photography.

In the present embodiment, the control unit (211) performs a three-dimensional scan area (first full) centered on the first fixation position in the first control (first control in the second preliminary OCT). The image acquisition unit (260) may be controlled so as to apply the OCT to the first partial region (first partial scan range 711) located on the side of the second fixation position in the scan range 701). Further, in the second control (second control in the second preliminary OCT), the control unit (211) has a three-dimensional scan area centered on the second fixation position (second full scan range 702). ), The image acquisition unit (260) may be controlled so as to apply the OCT to the second partial region (second partial scan range 712) located on the side of the first fixation position.

According to such a configuration, since it is only necessary to perform OCT on only a part of the three-dimensional scan area (first full scan range 701, second full scan range 702), the first control and the second It is possible to shorten the time required for controlling the. This time saving effect can be said to be remarkable, for example, when three-dimensional OCT angiography is performed in the first control and the second control.

In the present embodiment, the control unit (211) may control the image acquisition unit (260) so as to acquire a three-dimensional angiographic image of the fundus (Ef) in the third control (panoramic photography).

With such a configuration, it is possible to suitably acquire a three-dimensional angiographic image (mosaic image) over a wide range of the fundus.

Further, in the present embodiment, the control unit (211) controls the image acquisition unit (260) so as to acquire a three-dimensional angiographic image of the fundus (Ef) in each of the first and second controls. May be good.

According to such a configuration, it is possible to set the fixation position for panoramic photography by utilizing the distribution of the fundus blood vessels. Further, when the three-dimensional angiographic image acquired in the first and / or second control is used for constructing the mosaic image, the imaging time can be significantly shortened.

In the present embodiment, any one or more new fixation positions for panoramic photography set by the fixation position setting unit (231) substantially coincides with the first fixation position or the second fixation position. In the third control (panoramic shooting), the control unit (211) acquires a three-dimensional image corresponding to such a new fixation position (three-dimensional corresponding to the first peripheral fixation position 601). The fixation system (250) and the image acquisition unit (260) may be controlled so as to skip the image acquisition). Further, the synthesis processing unit (2321) may apply the first three-dimensional image or the second three-dimensional image (first peripheral three-dimensional image) to the formation of the composite image.

According to such a configuration, the shooting time can be shortened. This effect can be said to be remarkable when three-dimensional OCT angiography is applied.

The method for controlling the ophthalmologic imaging apparatus according to the present embodiment is a method for controlling the ophthalmologic imaging apparatus capable of applying optical coherence tomography (OCT) to the fundus of the eye to be inspected. The second control step, the fixation position setting step, the third control step, and the synthesis step are included.

The first control step acquires a first three-dimensional image (501) of the fundus (Ef) while presenting the first fixation target corresponding to the first fixation position to the eye to be inspected (E). The first control step may include any process relating to the first control of the second preliminary OCT described in this embodiment.

The second control step acquires a second three-dimensional image (502) of the fundus (Ef) while presenting the second fixation target corresponding to the second fixation position to the eye to be inspected (E). The second control step may include any process relating to the second control of the second preliminary OCT described in this embodiment.

The fixation position setting step sets one or more new fixation positions for panoramic photography based on the first three-dimensional image (501) and the second three-dimensional image (502). The fixation position setting step may include any processing related to fixation position setting described in the present embodiment.

The third control step corresponds to two or more fixation positions (first to fourth peripheral fixation positions 601-604) including one or more new fixation positions set in the fixation position setting step. Two or more fixation targets (first to fourth peripheral fixation targets) are sequentially presented to the eye to be inspected (E), and two or more fixation targets (first to fourth peripheral fixation targets) are presented. OCT is performed to acquire a three-dimensional image of the fundus (Ef) when each of the above is presented to the eye to be inspected (E). The third control step may include any processing related to panoramic photography described in the present embodiment.

The compositing step is a combination of two or more three-dimensional images (first to fourth) corresponding to two or more fixation positions (first to fourth peripheral fixation positions 601-604) acquired by the third control step. A composite image (mosaic image) of the peripheral three-dimensional image) is formed. The compositing step may include any process relating to image compositing described in this embodiment.

It is possible to create a program that causes the ophthalmologic imaging apparatus according to the present embodiment to execute such a control method. It is also possible to create a computer-readable non-temporary recording medium on which such a program is recorded. The non-temporary recording medium may be in any form, and examples thereof include a magnetic disk, an optical disk, a magneto-optical disk, and a semiconductor memory.

The embodiments described above are merely examples of the present invention. A person who intends to carry out the present invention can arbitrarily make modifications (omission, substitution, addition, etc.) within the scope of the gist of the present invention.

1 Ophthalmology imaging device 210 Control unit 211 Main control unit 230 Data processing unit 231 Fixed vision position setting unit 232 Image processing unit 2321 Synthesis processing unit 250 Fixed vision system 260 Image acquisition unit

Claims (15)

The fixation system that presents the fixation target to the eye to be inspected,
An image acquisition unit that applies optical coherence tomography (OCT) to the fundus of the eye to be inspected to acquire an image, and an image acquisition unit.
A first that controls the fixation system and the image acquisition unit so as to acquire a first three-dimensional image of the fundus while presenting a first fixation target corresponding to the first fixation position to the eye to be inspected. The fixation system and the image acquisition so as to acquire a second three-dimensional image of the fundus while presenting the control of 1 and the second fixation target corresponding to the second fixation position to the eye to be inspected. A control unit that executes a second control that controls the unit,
An fixation position setting unit that sets one or more new fixation positions based on the first three-dimensional image and the second three-dimensional image.
Including an image processing unit that processes an image acquired by the image acquisition unit,
The control unit controls the fixation system so as to sequentially present two or more fixation targets corresponding to the two or more fixation positions including the one or more new fixation positions to the eye to be inspected. In addition, a third control for controlling the image acquisition unit so as to acquire a three-dimensional image of the fundus when each of the two or more fixation targets is presented to the eye to be inspected is executed.
The image processing unit includes a composite processing unit that forms a composite image of two or more three-dimensional images corresponding to the two or more fixation positions acquired by the third control. .. The fixation position setting unit is
An overlapping region between the first 3D image and the second 3D image is identified.
The ophthalmologic imaging apparatus according to claim 1, wherein a new fixation position of one or more is set based on the overlapping region. The fixation position setting unit is
Calculate the dimensions of the overlapping area and
The ophthalmologic imaging apparatus according to claim 2, wherein a new fixation position of one or more is set based on the dimensions. The ophthalmologic imaging apparatus according to claim 3, wherein the fixation position setting unit sets a new fixation position of one or more so that the dimensions of the overlapping region are substantially equal to a default value. The first fixation position is a default fixation position for acquiring a three-dimensional image centered on a predetermined portion of the fundus.
The second fixation position is a default fixation position for acquiring a three-dimensional image centered on a position separated by a predetermined distance in a predetermined direction from the predetermined portion in the fundus of a standard eye. The ophthalmologic imaging apparatus according to any one of claims 1 to 4. Prior to the first control and the second control, the control unit obtains a preliminary three-dimensional image of the fundus while presenting the first fixation target to the eye to be inspected. Preliminary control to control the visual system and the image acquisition unit is executed.
The image processing unit calculates the deviation of the image of the predetermined portion of the fundus with respect to the center position of the preliminary three-dimensional image.
The fixation position setting unit corrects each of the first fixation position and the second fixation position based on the deviation.
The control unit
Applying the corrected first fixation position to perform the first control,
The ophthalmologic imaging apparatus according to claim 5, wherein the corrected second fixation position is applied to execute the second control. The fixation position setting unit corrects the deviation of the second fixation position with respect to the first fixation position based on the first three-dimensional image and the second three-dimensional image. The ophthalmologic imaging apparatus according to any one of claims 1 to 6, wherein a new fixation position of one or more is set. The first fixation position is a default fixation position for acquiring a three-dimensional image centered on the macula.
The second fixation position is a default fixation position for acquiring a three-dimensional image centered on a position separated from the macula by a predetermined distance in a predetermined direction in the fundus of a standard eye.
The fixation position setting unit is
By correcting the deviation of the second fixation position with respect to the first fixation position based on the first three-dimensional image and the second three-dimensional image, in the fundus of the eye to be inspected. Set a first new fixation position corresponding to a position one distance away from the macula in the first direction.
A second new fixation position corresponding to the position separated from the macula by the first distance is set in the second direction opposite to the first direction.
A third new fixation position is set at a position separated from the macula by the first distance in the third direction orthogonal to the first direction.
A fourth new fixation position corresponding to the position separated from the macula by the first distance is set in the fourth direction opposite to the third direction.
Claims 1 to 1, wherein the control unit executes the third control based on a plurality of fixation positions including the first, second, third, and fourth new fixation positions. 7. The ophthalmologic imaging apparatus according to any one of 7. The control unit
In the first control, the image acquisition is performed so as to apply OCT to the first partial region located on the side of the second fixation position in the three-dimensional scan region centered on the first fixation position. Control the part,
In the second control, the image acquisition is performed so that the OCT is applied to the second partial region located on the side of the first fixation position in the three-dimensional scan region centered on the second fixation position. The ophthalmologic imaging apparatus according to any one of claims 1 to 8, wherein the unit is controlled. The ophthalmologic imaging according to any one of claims 1 to 9, wherein the control unit controls the image acquisition unit so as to acquire a three-dimensional angiographic image of the fundus in the third control. Device. The ophthalmologic imaging according to claim 10, wherein the control unit controls the image acquisition unit so as to acquire a three-dimensional angiographic image of the fundus in each of the first and second controls. Device. When any of the one or more new fixation positions substantially coincides with the first fixation position or the second fixation position, the control unit performs the new fixation in the third control. The fixation system and the image acquisition unit are controlled so as to skip the acquisition of the three-dimensional image corresponding to the visual position.
The ophthalmologic imaging apparatus according to any one of claims 1 to 11, wherein the synthesis processing unit applies the first three-dimensional image or the second three-dimensional image to the formation of the composite image. A method of controlling an ophthalmologic imaging apparatus capable of applying optical coherence tomography (OCT) to the fundus of an eye to be examined.
A first control step of acquiring a first three-dimensional image of the fundus while presenting a first fixation target corresponding to the first fixation position to the eye to be inspected.
A second control step of acquiring a second three-dimensional image of the fundus while presenting a second fixation target corresponding to the second fixation position to the eye to be inspected.
A fixation position setting step for setting one or more new fixation positions based on the first three-dimensional image and the second three-dimensional image, and
Two or more fixation targets corresponding to two or more fixation positions including the one or more new fixation positions are sequentially presented to the eye to be inspected, and each of the two or more fixation targets is the subject. A third control step that causes OCT to acquire a three-dimensional image of the fundus when presented to the optometry.
A control method for an ophthalmologic imaging apparatus, comprising a composite step of forming a composite image of two or more three-dimensional images corresponding to the two or more fixation positions acquired by the third control step. A program for causing an ophthalmologic imaging apparatus capable of applying optical coherence tomography (OCT) to the fundus of an eye to be examined to execute the control method according to claim 13. A computer-readable non-temporary recording medium on which the program according to claim 14 is recorded.

Images