JP2020006232A - Information processing device and information processing method - Google Patents

Abstract

To reduce an amount of movement of a line of sight when observing an SLO image and an En-Face image.SOLUTION: An information processing device includes: a first acquisition part for acquiring a front image of a fundus; a second acquisition part for acquiring an En-Face image on the basis of a plurality of tomographic images of the fundus; and a display control part for displaying the En-Face image while being superposed on the front image on a display part.SELECTED DRAWING: Figure 6

Description

  The disclosed technology relates to an information processing apparatus and an information processing method for processing an image of an eye to be examined.

  An OCT (Optical Coherence Tomography) apparatus is used for acquiring a tomographic image of a fundus of an eye to be examined.

  It is known to generate an En-Face image, which is a two-dimensional image of the fundus viewed from the front, using pixels of a predetermined layer of a plurality of tomographic images obtained by an OCT apparatus (Patent Document 1). ). Further, Patent Literature 1 describes that an En-Face image and an SLO image acquired by an SLO (Scanning Laser Ophthalmoscope) are displayed side by side.

JP 2014-45869 A

  However, in Patent Literature 1, since the SLO image and the En-Face image are displayed side by side, there is a problem that the examiner needs to move his / her eyes greatly in order to compare the SLO image and the En-Face image. is there.

  It is an object of the disclosed technology to reduce the amount of movement of the line of sight when observing an SLO image and an En-Face image.

  It is to be noted that the present invention is not limited to the above-described object, and it is an operation effect derived from each configuration shown in an embodiment for carrying out the invention described later, and it is another object of the present invention to provide an operation effect that cannot be obtained by the conventional technology. It can be positioned as one.

One of the disclosed information processing devices is:
A first acquisition unit that acquires a front image of the eye to be inspected,
A second acquisition unit configured to acquire an En-Face image of the subject's eye using a plurality of tomographic images at different positions of the subject's eye obtained using an OCT optical system;
A display control unit that superimposes the En-Face image on the front image and displays the display on a display unit,
The display control unit is configured to change a depth range of the En-Face image superimposed on the front image in the subject's eye.

  According to the disclosed technology, it is possible to reduce the amount of movement of the line of sight when observing the SLO image and the En-Face image.

(A) is a figure which shows an example of a schematic structure of an ophthalmologic apparatus. FIG. 2B is a diagram illustrating an example of a configuration of an optical system of OCT. FIG. 3C is a diagram illustrating an example of an OCT scanning method. FIG. 3 is a diagram illustrating an example of a function of the image processing apparatus. It is a figure showing an example of the setting method of the depth range in a tomographic image. It is a figure showing an example of a photography screen. It is a figure showing an example of a photography flow. (A)-(d) is a figure which shows an example of a photography result screen.

  The disclosed ophthalmologic apparatus and information processing apparatus will be described with reference to FIGS. The configuration shown in the following examples is merely an example, and the present invention is not limited to the following embodiments.

[Example 1]
<Schematic configuration of device>
A schematic configuration of the fundus oculi device in the present embodiment will be described with reference to FIG.

  FIG. 1A is a diagram illustrating a configuration of an ophthalmologic apparatus. An optical head 900 includes a measurement optical system for capturing a two-dimensional image (SLO image) of a fundus and a tomographic image. Reference numeral 950 denotes a stage that can move the optical head in the xyz directions in the figure.

  Reference numeral 925 denotes a personal computer (information processing device) that controls the stage unit, and generates a front image, a tomographic image, and an En-Face image. When OCTA is selected as the imaging method, the information processing device 925 generates, for example, an OCTA En-Face image.

  A storage unit 926 stores various types of information. 928 is a display unit, for example, the display unit 928 is a liquid crystal monitor. Reference numeral 929 denotes an input unit for instructing a personal computer, and is specifically composed of a keyboard and a mouse. Note that the input unit 929 may be a touch panel.

  An optical system included in the optical head 900 will be described with reference to FIG. 1 (b).

  First, the measurement optical system will be described. An objective lens 101 is installed facing the subject's eye 100, and the optical path 201 of the OCT optical system, the optical path 202 for the SLO optical system and the fixation lamp, It is branched into an optical path 203 for anterior eye observation for each wavelength band.

  In the optical path 202, an avalanche photodiode (APD) 142 receives reflected light from the fundus by a perforated mirror 139 via an XY scanner 135. The XY scanner 135 is illustrated as a single mirror, but performs scanning in two axial directions including an X scanning scanner 401 and a Y scanning scanner 402. Light from the SLO light source 143 for fundus observation and the fixation lamp 141 enters the optical path 202 by the third dichroic mirror 140. Here, reference numerals 136, 137, and 138 denote lenses, and 137 is driven by a motor (not shown) for focusing a fixation lamp and light for fundus observation. Light having a center wavelength of 780 nm is emitted from the SLO light source 143. The fixation lamp 141 generates visible light to encourage the subject to fixate.

  In the optical path 203, 132 and 133 are lenses, and 134 is an infrared CCD for anterior eye observation. The CCD 134 has sensitivity at a wavelength of illumination light for anterior eye observation (not shown), specifically, around 970 nm.

  The optical path 201 forms an OCT optical system as described above, and is for capturing a tomographic image of the fundus of the eye 100 to be inspected. More specifically, an interference signal for forming a tomographic image is obtained. Reference numeral 102 denotes a lens; 104, a shutter for irradiating light to the eye to be examined only during imaging; and 103, an XY scanner for scanning light on the fundus. Although the XY scanner 103 is illustrated as a single mirror, it performs scanning in the XY biaxial directions. Reference numerals 105 and 106 denote lenses. The lens 105 is driven by a motor (not shown) to focus light from a light source 114 emitted from a fiber 108 connected to a fiber coupler 110 on the fundus of the eye 100 to be inspected. You. By this focusing, the light from the fundus of the eye 100 to be examined is simultaneously focused on the tip of the fiber 108 in the form of a spot and is incident.

  Next, an optical path from the light source 114 to the subject's eye and a configuration of the reference optical system will be described.

  The light source 114 is a wavelength-swept light source capable of changing the wavelength, and emits light having a center wavelength of 1040 nm and a bandwidth of 100 nm, for example. In addition, the above-mentioned center wavelength and bandwidth are examples, and are not limited to these values. The light emitted from the light source 114 is guided to a fiber coupler 112 via a fiber 113, and is branched into a fiber 115 for measuring a light amount and a fiber 111 for OCT measurement. The power of the light emitted from the light source 114 is measured by a PM (Power Meter) 116 via a fiber 115. Light passing through the fiber 111 is guided to the fiber coupler 110. The fiber coupler 110 functions as a splitting unit that splits an optical path through which light from the light source 114 is transmitted into a reference optical path and a measurement optical path. That is, the light from the light source by the fiber coupler 110 is measured light (also referred to as OCT measurement light). ) And a reference beam. The branch ratio of the fiber coupler 112 is 99: 1, and the branch ratio of the fiber coupler 110 is 90 (reference light): 10 (measurement light). Note that the branching ratio is an example and is not limited to the above value.

  The measurement light split by the fiber coupler 110 is emitted from the collimator 107 via the fiber 108 as parallel light. Reference numeral 109 denotes a polarization adjusting unit on the measurement light side provided in the optical fiber 108. The polarization adjustment unit has several parts where the optical fiber is routed in a loop. By rotating the loop part about the longitudinal direction of the fiber, the fiber is twisted, and the polarization of the measurement light and the reference light is changed. The states can be adjusted and adjusted. In this apparatus, the polarization states of the measurement light and the reference light are adjusted and fixed in advance.

  The measurement light emitted from the collimator 107 passes through the measurement optical system, and can scan an area in a desired range on the fundus of the eye 100 to be inspected.

  On the other hand, the reference light branched by the fiber coupler 110 is emitted as a parallel light from the collimator 119 via the fiber 117 and the polarization adjusting unit 118. The emitted reference light is reflected by the reference mirrors 120 and 121 on the coherence gate stage 122 and reaches the fiber coupler 126 via the collimator 123 and the fiber 124.

  The coherence gate stage 122 functions as a change unit that changes the positions of the reference mirrors 120 and 121 in the optical axis direction, and adjusts the optical path length of the reference light by using such a function. The mirrors 120 and 121 are adjusted so that the position where the optical path length of the measurement light and the optical path length of the reference light are equal is near the imaging target. The coherence gate stage 122 is driven by a motor (not shown) to cope with a difference in the axial length of the eye to be examined.

  The fiber coupler 126 functions as a multiplexing unit that multiplexes the reference light via the reference optical path and the measurement light via the measurement optical path. As a result, the measurement light and reference light that have reached the fiber coupler 126 are multiplexed into interference light, and the differential light (balanced) is a photodetector that detects the multiplexed light via the fibers 127 and 128. The receiver 129 converts the interference signal into an electric signal. The information processing device 925 receives an output from the differential detector 129. Then, the information processing device 925 generates a tomographic image by performing a general reconstruction process on the received signal.

  The above is the process of acquiring information relating to a tomogram at a certain point of the subject's eye 100. The ophthalmologic apparatus can acquire a two-dimensional tomographic image by performing this process a plurality of times in the X direction. In addition, the ophthalmologic apparatus can acquire a three-dimensional tomographic image by executing the above process a plurality of times in the X direction and the Y direction, respectively. Scanning for obtaining a two-dimensional or three-dimensional tomographic image is performed by the X-scanning scanner 401 and / or the Y-scanning scanner 402 described above.

  It should be noted that the X-scanning scanner 401 and the Y-scanning scanner 402 are each constituted by a deflecting mirror arranged so that the rotation axes are orthogonal to each other. The X scanning scanner 401 performs scanning in the X axis direction, and the Y scanning scanner 402 performs scanning in the Y axis direction. Each of the X-axis direction and the Y-axis direction is a direction perpendicular to the eye axis direction of the subject's eye 100, and is a direction perpendicular to each other.

  In the above example, the configuration of SS-OCT has been described, but SD-OCT may be used.

<Description of OCTA>
OCTA in the present embodiment will be described with reference to FIG.

  In OCTA, it is desirable to acquire a plurality of tomographic images at the same place on the fundus in order to measure a time change of an interference signal due to a blood flow. In this embodiment, the OCT apparatus performs a scan in which the B scan at the same position on the fundus is repeated m times at each of n Y positions.

  FIG. 1C shows an example of a specific scanning method. The OCT apparatus repeats B scans m times at each of n Y positions y1 to yn on the fundus plane. If m is large, the number of measurements at the same place increases, so that the accuracy of blood flow detection is improved. On the other hand, the scanning time becomes longer, and there arises a problem that motion artifacts occur in the image due to the movement of the eyes (fine fixation) during scanning and a problem that the burden on the subject increases. In this embodiment, m = 3 in consideration of the balance between the two. The number of repetitions of the B scan is not limited to three. Note that m may be freely changed according to the A-scan speed of the OCT apparatus and the amount of movement of the subject's eye 100. p indicates the number of A scan samples in one B scan. That is, the plane image size is determined by p × n. If p × n is large, a wide range can be scanned with the same measurement pitch, but the scan time becomes long, and the above-described problems of motion artifact and patient burden occur. In FIG. 1C, Δx is the distance between adjacent X positions (x pitch), and Δy is the distance between adjacent Y positions (y pitch). In the present embodiment, the x pitch is determined as の of the beam spot diameter of the irradiation light on the fundus and is set to 10 μm. Also, Δy is set to 10 μm similarly to Δx. In addition, these numerical values are examples and may be changed as appropriate. In order to reduce the scanning time, Δy may be set to be larger than 10 μm, but it is preferable to set it in a range not exceeding the beam spot diameter of 20 μm. Regarding the x pitch and the y pitch, although the definition deteriorates as the fundus beam spot diameter is increased, an image in a wide range can be acquired with a small data capacity. The x pitch and the y pitch may be changed freely according to clinical requirements.

  The information processing device 925 acquires the correlation or variance of each pixel between the three B scans obtained at each Y position as a motion contrast value. Then, the information processing device 925 can acquire a three-dimensional OCTA image by assigning a luminance value to the motion contrast value. For example, the information processing device 925 may assign a higher luminance value as the variance increases, or the information processing device 925 may assign a higher luminance value as the correlation value decreases.

<Description of image processing method>
An image processing method according to the present embodiment will be described with reference to FIG.

  FIG. 2 is a diagram illustrating a functional configuration of the information processing device 925. The information processing device 925 executes a first acquisition unit 301, a second acquisition unit 302, a layer recognition unit 303, a generation unit 304, and a display control by executing a program stored in the storage unit 926 by a processor such as a CPU (not shown). It functions as the unit 305.

  Note that the information processing device 925 may have one or more CPUs. Further, the storage unit 926 may include a plurality of memories. That is, when at least one or more processors (such as a CPU) and at least one memory are connected and at least one or more processors execute a program stored in at least one or more memories, the processor of the information processing device 925 is Functions as the above means.

  The first acquisition unit 301 acquires a tomographic image based on the output of the differential detector 129. In addition, the first acquisition unit 301 further acquires a front image of the fundus (hereinafter, sometimes referred to as an SLO image) based on the output of the APD 142. The first acquisition unit 301 acquires a three-dimensional OCTA image. Specifically, the first acquisition unit 301 calculates a correlation between m tomographic images generated based on interference signals obtained by m repeated B scans. The first acquisition unit 301 acquires the three-dimensional OCTA image based on the correlation between the tomographic images by performing the calculation of the correlation for each of a plurality of Y positions. For example, the first acquisition unit 301 acquires an OCTA image in which blood vessels are enhanced by assigning a higher luminance as the correlation is lower. Since the OCTA image can be generated by various known methods, a detailed description is omitted.

  Further, the second acquisition unit 302 acquires an En-Face image. More specifically, the second acquisition unit 302 acquires an OCTA En-Face image and an intensity En-Face image. Here, the En-Face image of the intensity is an En-Face image obtained from a plurality of normal tomographic images showing the signal intensity, and is different from the En-Face image of OCTA obtained from the three-dimensional OCTA image. It is an image. The second acquisition unit 302 includes a layer recognition unit 303 and a generation unit 304.

  The layer recognizing unit 303 extracts the layer structure of the object to be measured (retina) from the tomographic image obtained by the first obtaining unit 301, and recognizes the shape of each layer boundary. The recognition of the layer boundary can be realized by a known method such as a method of recognizing the layer boundary based on a change in luminance in the depth direction.

  The layer recognition unit 303 recognizes a layer boundary of a layer such as RNFL, GCL, INL, ONL + IS, OS, RPE, and BM. The specified shape of the layer boundary is input to the generation unit 304 together with the tomographic image.

  Based on the layer boundary recognized by the layer recognition unit 303, the generation unit 304 accumulates (or averages) the pixels of the pixel value column in a predetermined depth region of the tomographic image for each pixel column (each A scan). ) To generate a strong En-Face image. Note that the generation unit 304 may select one pixel from a pixel value sequence in a predetermined depth region of the tomographic image for each pixel sequence to generate a strong En-Face image. Further, based on the layer boundary recognized by the layer recognition unit 303, the generation unit 304 converts pixels of a pixel value column of the OCT image in a predetermined depth region from the three-dimensional OCTA image for each pixel column (A An OCTA En-Face image is generated by integrating (or adding and averaging) each scan. The generation unit 304 may generate an OCTA En-Face image by selecting one pixel from a pixel value sequence in a predetermined depth region of a three-dimensional OCTA image for each pixel sequence. Since the three-dimensional OCTA image and the tomographic image from which the layer boundary is obtained are common tomographic images, the generation unit 304 determines the position of the layer boundary obtained by the layer recognition unit 303 in the three-dimensional OCTA image. Can be easily identified. Further, not limited to the above example, various known methods can be used to generate the En-Face image. For example, the depth range (depth range at the fundus) in the tomographic image for generating the En-Face image is determined based on the layer boundary, but is determined by a plurality of horizontal straight lines perpendicular to the depth direction. It may be.

  Note that when the depth region for generating the En-Face image is changed according to an instruction from the input unit 929, the generation unit 304 sequentially regenerates the En-Face image. Accordingly, the generation unit 304 appropriately generates an En-Face image of a depth region according to the operator's request. For example, the change of the depth range by the input unit can be realized by, for example, moving the layer boundary superimposed on the tomographic image by dragging as shown in FIGS. Note that the generation unit 304 may generate an En-Face image when the generation unit 304 detects that the layer boundary has been dragged and dropped, or may generate the fact that the layer boundary has been moved by dragging. The generation of the En-Face image may be performed regardless of whether the drop is performed when the unit 304 detects the drop. Note that the layer boundary may be moved not only by dragging but also by rotating the mouse wheel.

  The generation unit 304 may be configured to generate an En-Face image using the layer boundary information and the tomographic image acquired from an external storage device (not shown).

  The display control unit 305 selectively causes the display unit 928 to display the tomographic image, the front image acquired by the first acquiring unit 301, and the Enta-Face image of the luminance and OCTA acquired by the second acquiring unit 302. For example, the display control unit 305 causes the display unit 928 to display the luminance or OCTA En-Face image superimposed on the front image. Further, when the depth region for generating the En-Face image is changed according to an instruction from the input unit 929, the display control unit 305 sequentially displays the En-Faces sequentially generated by the generation unit 304 on the display unit. I do.

  An example of the operation of the ophthalmologic apparatus configured as described above will be described with reference to FIGS.

  FIG. 5 is a flowchart showing an example of the photographing procedure. As a premise, the display control unit 305 causes the display unit 928 to display the display screen shown in FIG. Note that reference numeral 1001 denotes a display indicating one of the left and right eyes. In FIG. 4, an anterior eye image 1003 is displayed in an area 1002, and a fundus image 1012 in which a tomographic imaging area is superimposed is displayed in an area 1011. A tomographic image is displayed in the area 1006. Note that a mouse cursor 1005 that can be moved by the input unit 929 is also displayed.

  In step S2001, a scan mode is selected by the operator. In other words, the processor included in the information processing device 925 recognizes the scan mode selected by the operator. Specifically, the operator selects a desired scan mode from the scan mode button 1004 of the measurement screen 1000 shown in FIG. The scan mode button 1004 includes a Macula 3D button 1014, a Glaucoma 3D button 1015, a Disc 3D button 1016, an Interior 3D button 1017, and an OCTA button 1013. When the scan mode button is clicked, the processor included in the information processing device 925 recognizes the clicked scan mode and sets an optimal scan pattern and fixation position for each scan mode in the OCT device. The scanning pattern includes, for example, 3D scan, radial scan, cross scan, circle scan, and raster scan.

  Next, in step S2002, when the processor included in the information processing device 925 detects that the Start button 1008 has been pressed, the processor controls the OCT device to automatically perform focus adjustment and alignment adjustment. When finely adjusting the focus or alignment, the operator adjusts the position of the optical head with respect to the eye to be examined by moving the slider 1018 in the Z direction, adjusts the focus with the slider 1010, and adjusts the position of the coherence gate with the slider 1009. I do.

  In step S2003, when the processor included in the information processing device 925 detects that the Capture button 1007 has been pressed, the processor controls the OCT device to image the subject's eye in the set scan pattern. Then, when imaging is performed by the OCT apparatus, images of the subject's eye (SLO image, OCT image, En-Face image, three-dimensional OCTA image, etc.) are acquired by the first generation unit 301 and the second generation unit 302.

  Then, in step S2004, the display control unit 305 causes the display unit 928 to display an image of the subject's eye.

  FIG. 6 shows an example of a shooting result screen displayed on the display unit 928 by the display control unit 305 in step S2004. In the photographing result screen 3100 shown in FIG. 6A, a strong En-Face image 3104 is displayed on the first display area 3102 so as to be superimposed on a front image (SLO image) 3103 of the fundus. The size and position of the region of the intensity En-Face image 3104 can be changed by an operation (for example, drag and drop) using the input unit 929. Specifically, the display control unit 305 receives a signal from the input unit 929, and causes the display unit 928 to change the size and position of the region of the strong En-Face image 3104. In the initial state, the OCTA En-Face image may be displayed in the first display area 3102 instead of the strong En-Face image.

  Note that an image to be superimposed on the front image 3103 can be selected by selecting any one of the strength En-Face image, the OCTA En-Face image, the SLO image, and the projection image from the pull-down menu 3101. For example, when detecting that the OCTA En-Face image is selected from the pull-down menu 3101, the display control unit 305 causes the display unit 928 to display the OCTA En-Face image instead of the strength En-Face image. . Note that the projection image is an image generated by performing averaging over the entire region in the depth direction, and is an image different from the En-Face image using a part of the region in the depth direction.

  In the second display area 3112, an OCTA En-Face image 3113 in the same depth area as the intensity En-Face image 3104 is displayed. From the pull-down menu 3111, any one of the intensity En-Face image, the OCTA En-Face image, the SLO image, and the projection image can be selected. For example, when detecting that the En-Face image of the intensity is selected from the pull-down menu 3111, the display control unit 305 causes the display unit 928 to display the En-Face image of the intensity instead of the En-Face image of OCTA. .

  In the third display area 3121, a tomographic image 3122 corresponding to the position of the line 3105 indicating the acquisition position of the tomographic image in the SLO image 3103 is displayed. The line 3105 can be moved by dragging using the input unit 929. The display control unit 305 detects the position of the line 3105, and causes the display unit 928 to display a tomographic image corresponding to the detected position. The line 3114 superimposed and displayed on the OCTA En-Face image 3113 has the same function as the line 3105, and thus the detailed description is omitted. Note that when one of the line 3105 and the line 3114 moves, the display control unit 305 controls the display unit 928 so that the other moves in conjunction with it.

  Further, in the tomographic image 3122, the layer boundaries recognized by the layer recognition unit 303 are superimposed and displayed as boundary lines 3123. A boundary line 3124 is superimposed on the tomographic image 3122 at a position separated from the boundary line 3123 by a predetermined distance (for example, 10 μm) in the depth direction. Note that a depth region may be defined by specifying a specific layer boundary such as RPE and ILM for both of the two boundary lines. The depth region defined by the boundary line 3123 and the boundary line 3124 indicates the depth region of the En-Face image 3104 of intensity and the En-Face image 3113 of OCTA.

  If the display control unit 305 detects that a desired retinal layer boundary (RNFL, GCL, INL, ONL + IS, OS, RPE, BM) has been selected from the pull-down menu 3120, the display control unit 305 corresponds to the selected layer boundary. The display positions of the boundary lines 3123 and 3124 are changed by the display unit 928. In addition, the boundaries 3123 and 3124 can be freely and independently changed in position by dragging using the input portion 929. Further, the boundaries 3123 and 3124 are not independent and can be moved while maintaining a constant interval.

  In the fourth display area 3107, an En-Face image 3108 having a different depth from the En-Face image 3104 is displayed. A fifth display area 3116 displays an OCTA En-Face image 3117 in the same depth region as the intensity En-Face image 3108. In the sixth display area 3126, a tomographic image 3127 corresponding to the position of the line 3105 indicating the acquisition position of the tomographic image in the SLO image 3103 is displayed. The positions of the boundary line 3128 and the boundary line 3129 are different from those of the boundary line 3123 and the boundary line 3124, and the state of the fundus in different depth directions can be individually confirmed. Note that the functions of the line 3110 and the line 3118 have the same functions as the line 3105 and the line 3114, and thus the description thereof is omitted. Note that all the positions of the lines 3105, 3110, 3114, and 3118 may be linked so as to be the same position on the fundus. Further, since the pull-down menus 3106, 3115, and 3125 have the same functions as the pull-down menus 3101, 3111, and 3120, the description is omitted.

  Note that the lines 3105, 3110, 3114, and 3118 may not be displayed in the initial state where the screen of FIG. 6A is displayed in order to increase the visibility of the OCTA En-Face image. In this case, the line 3110 can be switched between display and non-display of the lines 3105, 3110, 3114, and 3118 by the display switch button 3119. That is, the display control unit 305 detects an operation on the display switching button 3119 and controls whether to display the lines 3105, 3110, 3114, and 3118. In addition, in the case other than the OCTA mode, the En-Face image of the OCTA is not included, but a shooting result screen having the same configuration as that of FIG. 6A is displayed. For example, in FIG. 6A, the portion where the OCTA En-Face image is displayed is replaced with a strong En-Face image or a projection image. In that case, the display control unit 305 may cause the display unit 928 to display a line indicating the position of the tomographic image in the initial state of the imaging result screen. That is, whether or not to display the line indicating the position of the tomographic image in the initial state of the imaging result screen may be switched according to the imaging mode.

  In the above embodiment, the SLO image is displayed in the display area 3102, but another image such as an En-Face image or an OCTA image may be displayed. In the initial state, the OCTA En-Face image may be superimposed on the SLO image instead of the strong En-Face image 3104 in the first display area.

  According to the above embodiment, since the En-Face image of the intensity or the En-Face image of OCTA is displayed on the SLO image which is an example of the front image, the En-Face image is compared with the front image. Movement of the line of sight can be reduced.

  When the depth position is changed, the intensity superimposed on the SLO image 3103 or the OCTA En-Face image 3112 and the OCTA En-Face image 3112 change in conjunction with each other, so that the operator can easily change a plurality of En-Face images. The Face image can be changed.

[Example 2]
Example 2 will be described with reference to FIG. The configuration of the ophthalmologic apparatus is the same as that of the first embodiment, and a description thereof will not be repeated. In the second embodiment, the photographing result screen is different from the first embodiment. FIG. 6B is the same as FIG. 6A, which is the shooting result screen according to the first embodiment, from the second display area to the sixth display area, and a description thereof will be omitted.

  In the first display area 3203 in FIG. 6B, an OCTA En-Face image 3205 and an intensity En-Face image 3206 are displayed superimposed on the front image (SLO image) 3204 of the fundus. In FIG. 6B, the Enta-Face image 3205 of OCTA is displayed on the left and the En-Face image 3206 of intensity is displayed on the right, but the left and right may be reversed.

  An OCTA En-Face image 3205 is displayed in the first display area 3203, but the displayed image can be changed by selecting a strong En-Face image, an SLO image, and a projection image from the pull-down menu 3201. I can do it. Similarly, an En-Face image 3206 is displayed. However, an image to be displayed can be changed by selecting any one of an En-Face image, an SLO image, and a projection image of OCTA from the pull-down menu 3202. More specifically, the display control unit 305 receives the type of the image selected from the pull-down menus 3201 and 3202, and superimposes the selected image on the SLO image 3204 and causes the display unit 928 to display the selected image. Note that, similarly to the first embodiment, when the depth region of the En-Face image is changed by changing the positions of the boundaries 3123 and 3124, the display control unit 305 controls the Enta-Face image 3205 and the OCTA En-Face image 3205. The intensity En-Face image 3206 is updated.

  According to the above-described embodiment, the En-Face image of the intensity and the En-Face image of the OCTA are displayed on the SLO image by half, so that in addition to the effect of the first embodiment, different types of En-Face images are obtained. -It is possible to confirm the Face image without switching by operation.

  Note that the regions of the intensity En-Face image and the OCTA En-Face image have the same size, but the size of each region can be changed by, for example, dragging the boundary between both En-Face images. You may comprise. That is, when the display control unit 305 detects the movement of the boundary between the two En-Face images, the display control unit 305 changes the size of the region between the En-Face image and the En-Face image of OCTA to the display unit 928. Let it.

  Further, the region of the En-Face image of the intensity and the En-Face image of OCTA may be divided not vertically but vertically.

  When the positions of the boundaries 3123 and 3124 are changed, only the En-Face image on the SLO image 3204 of the same type as the En-Face image displayed in the second display area may be updated.

[Example 3]
Example 3 will be described with reference to FIG. The configuration of the ophthalmologic apparatus is the same as that of the first embodiment, and a description thereof will not be repeated. In the third embodiment, the photographing result screen is different from the first embodiment. FIG. 6C is the same as FIG. 6A which is the photographing result screen according to the first embodiment from the second display area, the fourth display area to the sixth display area, and the description is omitted. I do.

  In the first display area 3303, a front image image (SLO image) 3304 of the fundus on which the En-Face image 3305 is superimposed is displayed. Further, an Enta-Face image 3306 of OCTA is displayed on the En-Face image 3305. The displayed En-Face image 3305 of the intensity can be changed by selecting one of the OCTA En-Face image, SLO image, and projection image from the pull-down menu 3301.

  Similarly, the displayed OCTA En-Face image 3306 can be changed by selecting any of the strong En-Face image, SLO image, or projection image from the pull-down menu 3302. Specifically, the display control unit 305 causes the display unit 928 to display the image selected using the pull-down menus 3301 and 3302.

  In the third display area 3308, a tomographic image 3309 corresponding to the line 3307 in the SLO image 3304 is displayed. The strength En-Face image 3305 is an En-Face image of the region in the depth direction between the boundary lines 3310 and 3311. The OCTA En-Face image 3306 is an En-Face image of the region in the depth direction between the boundary lines 3312 and 3313. The display control unit 305 determines that the En-Face image 3305 of intensity corresponds to the boundaries 3310 and 3311 and that the En-Face image 3306 of OCTA corresponds to the boundaries 3312 and 3313. The boundary line and the En-Face image are displayed on the display unit 928 so as to be clearly indicated. For example, the display control unit 305 causes the display unit 928 to display the color of the outer frame of the En-Face image in the same color as the corresponding border line.

  The operator can operate the boundaries 3310 and 3311 independently of the boundaries 3312 and 3313. Therefore, in this embodiment, the depth range of each En-Face image can be set individually.

  The OCTA En-Face image displayed in the second area corresponds to an area in the depth direction defined by the positions of the boundaries 3312 and 3313. The OCTA En-Face image displayed in the second area may be updated only when the boundaries 3312 and 3313 indicating the area in the depth direction of the OCTA En-Face image are changed. That is, in FIG. 6C, when the boundaries 3310 and 3311 are changed, only the En-Face image 3305 of the intensity may be updated by the display control unit 305.

  Furthermore, the display control unit 305 may cause the display unit 928 to change the size and position of the OCTA En-Face image 3306 in response to a signal from the input unit 929. For example, when the position of the OCTA En-Face image 3306 is changed, the display control unit 305 causes the display unit 928 to change the horizontal display position of the boundaries 3312 and 3313 in the third display area.

  Also, in the example shown in FIG. 6C, the OCTA En-Face image 3306 is displayed on a part of the intensity En-Face image 3305, but the OCTA En-Face image is displayed on a part of the OCTA En-Face image. A strong En-Face image may be displayed.

  According to the present embodiment, it is possible to individually set the depth direction for different types of En-Face images.

[Example 4]
Example 4 will be described with reference to FIG. The configuration of the ophthalmologic apparatus is the same as that of the first embodiment, and a description thereof will not be repeated. In the fourth embodiment, the photographing result screen is different from that of the first embodiment. FIG. 6B is the same as FIG. 6A which is the photographing result screen according to the first embodiment from the second display area, the fourth display area to the sixth display area, and the description is omitted. I do.

  In the first display area 3403, a front image image (SLO image) 3404 of the fundus on which the En-Face image 3406 of intensity is superimposed is displayed. Further, the En-Face images 3405 and 3407 of OCTA are superimposed on the En-Face image 3406 of the intensity.

  By making the region shape of the OCTA En-Face image 3405 circular by the display control unit 305, the operator can observe an image in the depth direction around the nipple. The size and shape of the region can be arbitrarily changed according to an instruction input from the input unit 929. More specifically, the display control unit 305 causes the display unit 928 to change the region shape of the En-Face image according to the input from the input unit 929.

  The displayed En-Face image 3406 can be changed by selecting any of the OCTA En-Face image, SLO image, and projection image from the pull-down menu 3401. Similarly, the displayed OCTA En-Face images 3405 and 3407 can be changed by selecting any of the strong En-Face images, SLO images, and projection images from the pull-down menu 3402.

  In the third display region 3409, a tomographic image 3310 corresponding to the line 3308 in the SLO image 3404 is displayed. The strength En-Face image 3406 is an En-Face image of a region in the depth direction between the boundary lines 3311 and 3312. An OCTA En-Face image 3405 is an En-Face image of a region in the depth direction between the boundary lines 3415 and 3416. Similarly, an OCTA En-Face image 3407 is an En-Face image of a region in the depth direction between the boundary lines 3413 and 3414.

  The display control unit 305 causes the display unit 928 to display each boundary line and the En-Face image so as to clearly indicate the correspondence between the En-Face image and the boundary line, as in the third embodiment. Specifically, the correspondence between the boundary line and the En-Face image may be indicated by using a color as in the third embodiment.

  In FIG. 6D, even in the case of the same type of En-Face image, it is possible to individually set the respective regions in the depth direction of the OCTA En-Face images 3405 and 3407. More specifically, even when the boundaries 3413 and 3414 are changed via the input unit 929, the display control unit 305 does not update the OCTA En-Face image 3405 and updates only the OCTA En-Face image 3407. The display unit 929 is controlled to perform the operation. Therefore, the operator can see at a glance images of different depth ranges of the same type of En-Face image. That is, the display control unit 305 can cause the display unit 928 to display an OCTA En-Face image having a different depth range in the fundus for each region of the front image.

  Note that the range in the depth direction of the OCTA En-Face image displayed in the second display area may be linked to either of the OCTA En-Face images 3405 and 3407. Further, for example, the OCTA En-Face image displayed in the second display area may be linked to the OCTA En-Face images 3405 and 3407 having a larger area, or may be linked to the OCTA En-Face image having a smaller area. It is good also as making it do.

  In the example shown in FIG. 6D, a plurality of OCTA En-Face images 3405 and 3407 are displayed on a part of the intensity En-Face image 3406. However, on the OCTA En-Face image, May be displayed on a part of the image. Note that the En-Face images 3405 and 3407 of OCTA may be directly superimposed directly on the SLO image 3304 without displaying the En-Face image 3406 of the intensity.

  According to the present embodiment, it is possible to grasp at a glance images of the same type of En-Face images in different depth directions. In addition, since the shape of the En-Face image can be changed, an En-Face image suitable for the purpose can be displayed.

[Other embodiments]
In the above embodiment, the displayed image is changed using a pull-down menu. However, when the display unit 929 includes a touch panel, the displayed image may be changed by tapping the image. Good.

  Further, in the above embodiment, the En-Face image is superimposed on the SLO image, but the SLO image may be superimposed on the En-Face image.

  Further, in the above embodiment, the SLO image is taken as an example of the front image, but the fundus image captured by the fundus camera may be handled as the front image.

  Although the embodiment has been described in detail, the disclosed technology can take an embodiment as, for example, a system, an apparatus, a method, a program, or a recording medium (storage medium). Specifically, the present invention may be applied to a system including a plurality of devices (for example, a host computer, an interface device, an imaging device, a web application, etc.), or may be applied to a device including a single device. Good.

  Needless to say, the object of the present invention is achieved by the following. That is, a recording medium (or a storage medium) that records a program code (computer program) of software that realizes the functions of the above-described embodiments is supplied to a system or an apparatus. Needless to say, such a storage medium is a computer-readable storage medium. Then, the computer (or CPU or MPU) of the system or apparatus reads out and executes the program code stored in the recording medium. In this case, the program code itself read from the recording medium implements the functions of the above-described embodiment, and the recording medium on which the program code is recorded constitutes the present invention.

One of the disclosed information processing devices is:
A first acquisition unit that acquires a front image of the eye to be inspected,
A second acquisition unit that acquires an En-Face image of the subject's eye using a plurality of tomographic images at different positions of the subject's eye obtained using an OCT optical system;
A display control unit that superimposes the En-Face image on the front image and displays the display on a display unit,
The display control unit is configured to be able to set a depth range of the En-Face image superimposed on the front image in the subject's eye using information on a layer boundary in the tomographic image .

Claims (16)

A first acquisition unit that acquires a front image of the eye to be inspected,
A second acquisition unit that acquires an En-Face image of the subject's eye using a plurality of tomographic images at different positions of the subject's eye obtained using an OCT optical system;
A display control unit that superimposes the En-Face image on the front image and displays the display on a display unit,
The information processing apparatus according to claim 1, wherein the display control unit is configured to be able to change a depth range of the En-Face image superimposed on the front image in the subject's eye.   The information processing apparatus according to claim 1, wherein the En-Face image is an OCTA En-Face image of the eye to be inspected.   The information processing apparatus according to claim 2, wherein the display control unit causes the display unit to display an En-Face image of the OCTA having a different depth range for each area of the front image.   4. The information processing apparatus according to claim 1, wherein the display control unit is configured to change a size, a shape, and a position of the En-Face image in the front image. 5. . The display control unit causes the display unit to display the En-Face image at a size different from the En-Face image superimposed on the front image,
The display control unit may include a depth range of the En-Face image superimposed on the front image in the subject's eye, and an En-Face image having a size different from the En-Face image superimposed on the front image. 5. The information processing apparatus according to claim 1, wherein the information processing apparatus is configured to be able to change the depth range of the subject's eye in conjunction therewith.   The display control unit may cause the display unit to display the En-Face image having a size larger than the En-Face image superimposed on the front image without superimposing the En-Face image on the front image. Item 6. The information processing apparatus according to any one of Items 1 to 5.   2. The display control unit, wherein the En-Face image having a size larger than the En-Face image superimposed on the front image and the front image are displayed side by side on the display unit. The information processing device according to any one of claims 1 to 6. The display control unit displays the front image on which the En-Face image is superimposed on a first display area on a shooting result screen displayed on the display unit, and displays the En-F image superimposed on the front image. The En-Face image having a size larger than the Face image is displayed in a second display area, and a tomographic image of the subject's eye obtained by using the OCT optical system is displayed in a third display area,
The said display control part changes the said depth range by moving the line on the tomographic image displayed on the said 3rd display area according to the instruction | indication from an operator. The information processing apparatus according to any one of claims 1 to 7.   The information processing apparatus according to claim 8, wherein the line is a boundary line indicating a layer boundary superimposed on a tomographic image displayed in the third display area. The second acquisition unit acquires, as the En-Face image, an En-Face image of the intensity of the eye to be inspected and an En-Face image of the OCTA of the eye to be inspected,
10. The display control unit according to claim 1, wherein the display control unit superimposes the En-Face image of the intensity and the En-Face image of the OCTA on the front image at the same time and displays the image on the display unit. The information processing device according to item.   The information processing apparatus according to claim 10, wherein the display control unit causes the display unit to display an En-Face image of the intensity different in the depth range, an En-Face image of the OCTA, and the display unit.   The information processing apparatus according to claim 10, wherein the display control unit displays the OCTA En-Face image on the display unit by superimposing the OCTA En-Face image on the En-Face image of the intensity.   4. The image according to claim 1, wherein the front image is larger in size than the En-Face image, and is obtained using another optical system having an optical path partially common to the OCT optical system. The information processing device according to any one of claims 12 to 12.   14. The information processing apparatus according to claim 13, wherein the front image is an image obtained using an SLO optical system. A display unit configured to superimpose a plurality of tomographic images at different positions of the eye to be inspected obtained using an OCT optical system, the En-Face images obtained using the plurality of tomographic images being superimposed on a front image of the eye to be inspected; A step of displaying the
Changing a depth range of the En-Face image superimposed on the front image in the subject's eye;
An information processing method comprising:   A program for causing a computer to execute each step of the information processing method according to claim 15.

Images