JP2019154495A - Information processing device, information processing method, and program - Google Patents

Abstract

To accelerate a frame rate in an OCTA moving image.SOLUTION: An information processing device includes acquisition means for acquiring an interference signal of a return light obtained by a measurement light in which a light from a light source is divided irradiated onto an eye to be examined, and a reference light in which the light from the light source is divided, generation means for generating a frame that constitutes a motion contrast moving image by using n (n being an integer of two or more) interference signals acquired by the acquisition means at continuous timings, and display processing means for continuously reproducing and displaying a plurality of frames along the time series. The generation means generates a second frame reproduced and displayed at a second timing subsequent to the reproduction and display of a first frame, by using at least one interference signal used for the generation of the first frame reproduced and displayed at the first timing.SELECTED DRAWING: Figure 7

Description

  The present invention relates to an information processing apparatus, an information processing method, and a program related to a medical image.

  Conventionally, there is an optical coherence tomography (hereinafter referred to as OCT) as an ophthalmologic apparatus that captures a tomographic image of an eye to be examined. Furthermore, in recent years, it has become possible to generate an image related to the fundus blood flow using these tomographic images and obtain an image similar to a conventional fundus fluorescence contrast examination. This image is generally called OCT Angiography (hereinafter referred to as OCTA).

  In the generation of the OCTA image, interference signals at the same location are acquired a plurality of times, each tomographic image is generated, and the change in luminance value between the same locations of the tomograms is imaged between the tomographic images. In tomographic images with different imaging times, it is known that the luminance inside the blood vessel changes because the blood cell position in the blood vessel changes. An image obtained by imaging the amount of change in the luminance value of the tomographic image is called an OCTA tomographic image, and the amount of change in the luminance value is called a motion contrast value. It is possible to construct three-dimensional OCTA volume data by generating an OCTA tomographic image from one tomographic image and then sequentially changing the position in the normal direction of the tomographic image to generate an OCTA tomographic image in the same manner. . An image obtained by projecting this three-dimensional data in the in-plane direction of the tomographic image and in a direction orthogonal to the normal direction thereof is referred to as an OCTA image (or motion contrast image).

Japanese Patent Laid-Open No. 2006-10656

  However, when an OCTA moving image is to be reproduced and displayed in real time, an OCTA frame image obtained at substantially the same time as the OCTA imaging is displayed. For this reason, there has been a problem that the update frame rate of the moving image becomes slow and difficult to observe.

  The present invention has been made in view of such problems, and an object thereof is to increase the frame rate in OCTA moving images.

  Therefore, the present invention is an information processing apparatus, and obtains an interference signal between return light that irradiates a subject's eye with measurement light obtained by dividing light from a light source and reference light obtained by dividing light from the light source Means, a generating means for generating a frame constituting a motion contrast video using n (n is an integer of 2 or more) interference signals acquired at successive timings by the acquisition means, and a plurality of time series Display processing means for continuously reproducing and displaying the frames, wherein the generating means uses at least one interference signal used for generating the first frame reproduced and displayed at the first timing. Then, a second frame that is reproduced and displayed at a second timing following the reproduction and display of the first frame is generated.

  According to the present invention, the frame rate in an OCTA moving image can be increased.

1 is an overall view of an ophthalmic imaging system. It is a hardware block diagram of a control apparatus. It is a functional block diagram of a control apparatus. It is explanatory drawing of the conditions relevant to OCTA imaging | photography. It is a flowchart which shows a moving image reproduction process. It is a flowchart which shows a three-dimensional OCT image acquisition process. It is a flowchart which shows a two-dimensional OCTA image generation process. It is a flowchart which shows an addition average process. It is a flowchart which shows a pseudo SLO image generation process. It is a figure which shows an example of a display screen. It is a figure which shows the timing of the process which concerns on an OCTA image. It is a figure which shows the timing of the process which concerns on a pseudo SLO image.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
(First embodiment)
FIG. 1 is an overall view of an ophthalmologic imaging system according to the first embodiment. The ophthalmologic photographing system includes a photographing device 100 and a control device 200. The imaging apparatus 100 includes a light source 110, a sample optical system 120, a reference optical system 130, and interference optics as a measurement optical system for capturing a two-dimensional image and a tomographic image of the anterior eye Ea and fundus Er of the eye E. System 140.

  The light source 110 is a super luminescent diode (SLD) that is a low-coherent light source, and the coupler 111 splits the light into measurement light and reference light under a desired branching ratio. The center wavelength is 855 nm and the wavelength bandwidth is about 100 nm. Here, the bandwidth affects the resolution in the optical axis direction of the obtained tomographic image. Further, although SLD is selected as the type of light source in the embodiment, other low-coherent light can also be used. In addition, since the center wavelength affects the lateral resolution of the obtained tomographic image, it is desirable that the center wavelength be as short as possible, and infrared light is desirable so as not to burden the subject. For both reasons, the center wavelength was set to 855 nm. In addition, the specific numerical value of the center wavelength of the light source 110 and a wavelength bandwidth is an illustration, and it is good also as another numerical value.

The measurement light passes through the coupler 111 and is emitted from the collimator 121 to the sample optical system 120. In the sample optical system 120, a focus lens 122, an X galvano scanner 123 and a Y galvano scanner 124 which are variable in angle, and objective lenses 125 and 126 are arranged. A beam spot is formed. Here, the beam spot guided onto the fundus is scanned two-dimensionally on the fundus by driving the X galvano scanner 123 (for the main scanning direction) and the Y galvano scanner 124 (for the sub scanning direction). The measurement light reflected and scattered by the fundus of the eye E is guided to the interference optical system 140 via the sample optical system 120 and then via the coupler 111.

  On the other hand, the reference light is guided to the reference optical system 130, becomes collimated light by the collimator lens 131, passes through the ND filter 132, and is attenuated to a predetermined light amount. Thereafter, the reference light is reflected by the mirror 133 that can move in the optical axis direction and can correct the optical path length difference with the sample optical system 120 while maintaining the collimated state, and is folded back to the same optical path. The folded reference light is guided to the interference optical system 140 via the coupler 111 after passing through the ND filter 132 and the collimator lens 131. In addition, the reference optical system 130 is provided with a polarization adjustment paddle 134 in which an optical fiber is bundled in a plurality of annular shapes, so that the interference state between the measurement light and the reference light is improved. The polarization state of the reference light can be adjusted.

  The measurement light returned from the sample optical system 120 and the reference light returned from the reference optical system 130 are combined by the coupler 111 and guided to the interference optical system 140. The combined light is emitted from the collimator 141, dispersed by the diffraction grating 142, received by the line sensor 144 through the lens 143, and output as an interference signal (hereinafter referred to as OCT signal). The line sensor 144 is arranged so that each pixel receives light corresponding to the wavelength component of the light dispersed by the diffraction grating 142. In this embodiment, a Michelson interferometer is used as an interferometer, but a Mach-Zehnder interferometer may be used.

  The control device 200 performs processing such as control of the imaging device 100 for acquiring an OCT signal, generation of an OCTA image, and the like. The control device 200 is an example of an information processing device. FIG. 2 is a hardware configuration diagram of the control device 200. The control device 200 includes a CPU 201, a ROM 202, a RAM 203, an HDD 204, a display unit 205, an input unit 206, and a communication unit 207. The CPU 201 reads a control program stored in the ROM 202 and executes various processes. The RAM 203 is used as a temporary storage area such as a main memory and a work area for the CPU 201. The HDD 204 stores various data, various programs, and the like. The display unit 205 displays various information. The input unit 206 has a keyboard and a mouse and accepts various operations by the user. The communication unit 207 performs communication processing with the imaging apparatus 100 via a network. Note that the functions and processes of the control device 200 described later are realized by the CPU 201 reading a program stored in the ROM 202 or the HDD 204 and executing this program. As another example, the CPU 201 may read a program stored in a recording medium such as an SD card instead of the ROM 202 or the like.

  As another example, at least a part of the functions and processes of the control device 200 may be realized by, for example, cooperating a plurality of CPUs, RAMs, ROMs, and storages. As another example, at least a part of the functions and processes of the control device 200 may be realized using a hardware circuit.

  FIG. 3 is a functional configuration diagram of the control device 200. The control device 200 includes an imaging control unit 301, an OCT image acquisition unit 302, an OCTA image generation unit 303, an addition averaging unit 304, a pseudo SLO image generation unit 305, and a display processing unit 306. . The shooting control unit 301 controls shooting by the shooting apparatus 100. The OCT image acquisition unit 302 acquires an OCT image. The OCTA image generation unit 303 generates an OCTA image. The addition averaging unit 304 performs addition averaging processing on the two images obtained by the OCTA image generation unit 303. The pseudo SLO image generation unit 305 generates a pseudo SLO image based on the OCTA image after the averaging process. The display processing unit 306 displays various information on the display unit 205. For example, the display processing unit 306 reproduces and displays a two-dimensional OCTA moving image in which a two-dimensional OCTA image (still image) after addition averaging is one frame. The display processing unit 306 also reproduces and displays a pseudo SLO moving image having a pseudo SLO image (still image) as one frame, and reproduces and displays a two-dimensional OCT tomographic moving image having an OCT image (still image) as one frame.

Next, conditions related to OCTA imaging will be described with reference to FIG. FIG. 4A shows the X galvano scanner 123 and Y on the scan region 400 corresponding to the fundus Er of the eye E to be examined.
A scan pattern for controlling the galvano scanner 124 and scanning the fundus Er of the eye E is shown. Signal acquisition in the depth direction at one point on the fundus oculi Er is called an A scan and is indicated by a point 401. A series of A scans acquired during one scanning in the main scanning direction by driving and controlling at least one of the scanner 123 and the scanner 124 is called a B scan, and is indicated by an arrow 402. . The imaging control unit 301 can set the number of A scans m acquired during one B scan. Further, the imaging control unit 301 can set the number of B scans n that has moved the scanning locus in the sub-scanning direction in the scan pattern. As the A scan number m and the B scan number n are increased, the lateral resolution of the OCTA image can be increased.

  FIG. 4B shows an interference signal waveform 410 input to the line sensor 144, where the horizontal axis indicates the line sensor pixel position and the vertical axis indicates the interference signal intensity. The imaging control unit 301 can set the sampling range and position to be read out of the line sensor pixels. By changing the sampling range and position, the range and position in the depth direction of the OCT tomographic image can be set. In addition to the conditions described above, the imaging control unit 301 can set a scan pattern, a scan size, a scan position, and the like.

  FIG. 5 is a flowchart showing the moving image reproduction process. The moving image reproduction process is started in response to pressing of a moving image shooting start button 1001 (FIG. 10) on the display screen 1000 to be described later. In step S <b> 501, the shooting control unit 301 performs moving image shooting settings. The imaging control unit 301 determines a position in the depth direction to be displayed as an OCTA moving image in accordance with a user operation. It is assumed that the user can select an arbitrary depth by operating a slider corresponding to the depth direction displayed on the display unit 205. As another example, the display unit 205 may display selection buttons such as a retina, a choroid, and a deep layer, and set a display target layer in response to pressing of the selection button. Note that at least a part of the retinal pigment epithelium layer from the inner boundary membrane may be set as a display target. Through the processing described later, the OCTA moving image of the set layer is reproduced and displayed. The imaging control unit 301 further sets the read position and range of the line sensor 144 so as to correspond to the selected depth direction.

  Next, in S502, the OCT image acquisition unit 302 acquires a three-dimensional OCT image of the retina. Next, in S503, the OCTA image generation unit 303 generates a two-dimensional OCTA image. Next, in S504, the addition averaging unit 304 determines the two-dimensional OCTA image obtained in the process of S503 (current process) in the current loop process, and the process of S503 in the previous loop process (previous process). The two-dimensional OCTA image obtained in step 1 is acquired. Then, the addition averaging unit 304 performs addition averaging processing on the acquired two two-dimensional OCTA images.

  Next, in S505, the pseudo SLO image generation unit 305 performs a pseudo SLO image generation process. In step S <b> 506, the display processing unit 306 controls to read an image from the storage unit and display the image on the display unit 205. The display processing unit 306 displays a two-dimensional OCT image (tomographic image), OCTA image, and pseudo SLO image. This process will be described in detail later. In step S507, the shooting control unit 301 determines whether to end shooting. The shooting control unit 301 determines to end shooting when a stop button 1002 (FIG. 10) on the display screen 1000 described later is pressed. When the shooting control unit 301 ends the shooting (YES in step S507), the shooting control unit 301 ends the moving image reproduction process. If the photographing control unit 301 does not end photographing (NO in S507), the photographing control unit 301 advances the process to S502.

  FIG. 6 is a flowchart showing detailed processing in the three-dimensional OCT image acquisition processing (S502) shown in FIG. In step S601, the imaging control unit 301 turns on the light source 110 and starts acquiring an OCT signal (interference signal). Then, the imaging control unit 301 performs B scan of the number of A scans m by drivingly controlling at least one of the galvano scanner 123 and the galvano scanner 124. The OCT image acquisition unit 302 samples the OCT signal input from the line sensor 144 and stores it in the storage unit. Next, in S602, the imaging control unit 301 moves the galvano scanner in the sub-scanning direction.

  In step S <b> 603, the imaging control unit 301 determines whether the B scan that has moved in the sub-scanning direction has been performed n times. If it has been performed n times (YES in S603), the imaging control unit 301 advances the process to S604. If it has not been performed n times (NO in S603), the imaging control unit 301 advances the process to S601 and continues the B scan with a different scanning locus. The OCT signal obtained by repeating the processing of S601 to S603 n times becomes a three-dimensional OCT image of the retina. In S604, the OCT image acquisition unit 302 stores the three-dimensional OCT image in a storage unit such as the ROM 202. Thus, the three-dimensional OCT image acquisition process is completed.

  FIG. 7 is a flowchart showing detailed processing in the two-dimensional OCTA image generation processing (S503) shown in FIG. In step S <b> 701, the OCT image acquisition unit 302 reads an OCT signal for 1 B scan of a three-dimensional OCT image from the storage unit, performs frequency analysis, and generates an OCT tomographic image. Here, the OCT tomographic image is a two-dimensional OCT image. In step S <b> 702, the imaging control unit 301 changes the signal processing target B scan. In step S <b> 703, the imaging control unit 301 determines whether B-scan OCT tomographic image generation has been performed n times. If it has been performed n times (YES in S703), the imaging control unit 301 advances the process to S704. If not performed n times (NO in S703), the imaging control unit 301 advances the process to S701, and generates an OCT tomographic image of a different B scan. An OCT tomographic image obtained by repeating the processes of S701 and S702 n times becomes a three-dimensional OCT tomographic image. In S704, the OCT image acquisition unit 302 stores the generated three-dimensional OCT tomographic image in the storage unit.

  In step S <b> 705, the OCTA image generation unit 303 determines whether the three-dimensional OCT tomographic image stored in the storage unit in step S <b> 704 is the first three-dimensional OCT tomographic image generated in the moving image reproduction process. . If it is the first three-dimensional OCT tomographic image (YES in S705), the OCTA image generation unit 303 ends the two-dimensional OCTA image generation process. If the OCTA image generator 303 is not the first three-dimensional OCT tomographic image (NO in S705), the process proceeds to S706. In step S <b> 706, the OCTA image generation unit 303 reads the three-dimensional OCT tomographic image generated once before stored in the storage unit. That is, when the three-dimensional OCT tomographic image generated this time is the t-th three-dimensional OCT tomographic image generated in the moving image reproduction process, in S706, the three-dimensional OCT generated at the (t−1) th time. Read a tomographic image. In the moving image reproduction process, a three-dimensional CT tomographic image is generated along a time series. Accordingly, the three-dimensional OCT tomographic image generated at the t-th time is represented as an image (frame) at time t, and the three-dimensional OCT tomographic image generated at the (t−1) -th time is represented as an image (frame at time (t−1)). )It can be expressed as.

  Next, in S707, the OCTA image generation unit 303 aligns the three-dimensional OCT tomographic image at time t and the three-dimensional OCT tomographic image at time t-1 stored in the storage unit. Next, in S708, the OCTA image generation unit 303 calculates the amount of change in the luminance value of the OCT tomographic image for each 1B scan from the two aligned three-dimensional OCT tomographic images. The change amount of the luminance value of the tomographic image is imaged to generate an OCTA tomographic image. The OCTA tomographic image generated here is an OCTA tomographic image at time t. In step S709, the OCTA image generation unit 303 changes the B scan to be processed. In step S710, the OCTA image generation unit 303 determines whether the B-scan OCTA tomographic image generation has been performed n times. If the OCTA image generation unit 303 has performed n times (YES in S710), the process proceeds to S711. If it is not performed n times (NO in S710), the OCTA image generation unit 303 advances the process to S708, and generates an OCTA tomographic image of a different B scan.

  In S711, the OCTA image generation unit 303 constructs a three-dimensional OCTA image from a plurality of OCTA tomographic images generated by the loop processing in S708 and S709. Then, the OCTA image generation unit 303 extracts the layer boundary of the fundus retina, and uses the two-dimensional planar image in the in-plane direction of the tomographic image including the desired layer and the direction orthogonal to the normal direction as the two-dimensional OCTA image. Generate. Next, in S712, the OCTA image generation unit 303 stores the two-dimensional OCTA image generated in S711 in the storage unit as a two-dimensional OCTA image at time t. Thus, the two-dimensional OCTA image generation process ends.

  As another example, the OCTA image generation unit 303 performs the OCTA image generation process by limiting the data of some layers based on the position in the depth direction designated by the user operation. Also good. The partial layer may be a partial layer of the retinal pigment epithelium layer from the inner boundary membrane. As a result, the amount of calculation can be reduced, and the OCTA moving image can be processed at high speed. That is, the range in the depth direction used for generating the OCTA moving image is a range narrower than the depth range used for generating the three-dimensional OCTA image (still image). In other words, the range in the depth direction used for generating the OCTA moving image is a part of the depth range used for generating the three-dimensional OCTA image (still image).

  FIG. 8 is a flowchart showing detailed processing in the averaging process (S504) shown in FIG. In step S <b> 801, the addition averaging unit 304 acquires the OCTA image at time t obtained by the current process and the OCTA image at time (t−1) obtained by the previous process from the storage unit. The addition averaging unit 304 aligns the two acquired OCTA images. In step S <b> 802, the addition averaging unit 304 performs addition averaging of the two aligned OCTA images. Next, in S803, the addition averaging unit 304 stores the OCTA image after the addition averaging process in the storage unit as an OCTA image at time t. This completes the averaging process.

  FIG. 9 is a flowchart showing the pseudo SLO image generation process (S505) shown in FIG. In step S901, the pseudo SLO image generation unit 305 reads the three-dimensional OCT image at time t generated in the current process from the storage unit. In step S <b> 902, the pseudo SLO image generation unit 305 extracts layer data including the retinal surface layer from the read three-dimensional OCT image at time t. This is called an en face, and this image is a pseudo SLO image. Next, in S903, the pseudo SLO image generation unit 305 stores the pseudo SLO image generated in S903 in the storage unit.

  Next, in S904, a pseudo SLO image at time (t-1) is read from the storage unit. Next, in S905, the pseudo SLO image generation unit 305 aligns the pseudo SLO image at time t generated in S902 and the pseudo SLO image at time (t-1). Next, in S906, the pseudo SLO image generation unit 305 performs an average of the two pseudo SLO images that have been aligned. Thereby, the S / N of the pseudo SLO image can be improved. Next, in S907, the pseudo SLO image generation unit 305 stores the pseudo SLO image after the averaging process in S906 in the storage unit. Thus, the pseudo SLO image generation process is completed.

  Next, the image display process (S506) shown in FIG. 5 will be described. The pseudo SLO image generation unit 305 displays a display screen 1000 shown in FIG. In an area 1010 of the display screen 1000, an OCTA moving image having an OCTA image as one frame is displayed. In a region 1020, a two-dimensional OCT tomographic moving image having a two-dimensional OCT image (tomographic image) as one frame is displayed. In area 1030, a pseudo SLO having a pseudo SLO image as one frame is displayed. In step S506, the display processing unit 306 updates the moving image frames of the OCTA image, the two-dimensional OCT image, and the pseudo SLO image. The display processing unit 306 updates the OCTA image as the frame of the OCTA moving image from the frame at time t−1 to the frame at time t. Similarly, the display processing unit 306 updates the frame of the two-dimensional OCT tomographic moving image and the pseudo SLO moving image to the frame at time t.

  FIG. 11 is a diagram illustrating processing timing related to the OCTA image. FIG. 11 shows the generation timing of the three-dimensional OCTA image, the OCTA image, and the OCTA image after the averaging process in time series. Assuming that the processing time point is time t, in the OCTA image after averaging, which is displayed as an OCTA moving image, the frame at time t is generated from the OCTA image at time t and the OCTA image at time (t−1). . An OCTA image at time t is generated from a three-dimensional OCT image at times t, (t−1), and (t−2), and an OCTA image at time (t−1) is time (t−1), It is generated from the three-dimensional OCT image of (t-2) and (t-3). The display processing unit 306 continuously reproduces and displays a plurality of frames of the OCTA moving image obtained in the order along the time series while updating at a timing corresponding to the generation timing. Accordingly, when one OCTA image is generated from three OCT images, the OCTA image can be updated at an interval for generating one OCTA image that is shorter than an interval for generating three OCTA images. This process is an example of a process of reproducing and displaying the second frame at the second timing after t1 time corresponding to the timing of acquiring one interference signal from the first timing.

  In the moving image reproduction process shown in FIG. 5, the OCTA image at time (t−1) and the three-dimensional OCT image at time (t−1) used when generating the OCTA image after the averaging of time (t−1). Is stored in the storage unit. Therefore, the addition averaging unit 304 reads out and uses the OCTA image at time (t−1) and the three-dimensional OCT image at time (t−1) stored in the storage unit, thereby obtaining the result after the addition averaging of time t. The time for generating the OCTA image can be shortened. Thereby, an OCTA image can be displayed at high speed. Note that the number of OCTA images used for averaging is not limited to that in the embodiment, and the averaging process may be performed using three or more OCTA images.

  As described above, the control device 200 may generate a frame constituting a motion contrast moving image using n (n is an integer of 2 or more) interference signals obtained at successive timings. Furthermore, in this case, the control apparatus 200 includes (n−m) interference signals (m is an integer of 1 or more and less than n) out of n interference signals n used for generating the first frame, The second frame may be generated using the obtained m interference signals.

  In this case, the reproduction / display timing of the second frame is a second timing after tm time corresponding to the timing at which m interference signals are acquired from the first timing of the reproduction / display of the first frame. Also good. Furthermore, the second timing may be before tn time after the timing at which n interference signals are acquired from the first timing, and is not limited to after tm time.

  As another example, the control device 200 may display the OCTA image as a moving image without performing the averaging process. In this case, as illustrated in FIG. 11, the control device 200 determines the time t based on the two OCT images (interference signals) of the OCT image at time t and the OCT image at time (t−1). An OCTA image is generated. Also in this case, one frame is generated using n interference signals, and (n−m) interference signals and subsequently obtained m interference signals are used. Two frames may be generated. At this time, it is desirable that the (n−m) interference signals are m interference signals in the latter half of the n interference signals. Thereby, an image along a time series can be generated. Furthermore, it is desirable that the second frame playback and display timing be the second timing after tm time, but it may be before tm time elapses.

  FIG. 12 is a diagram illustrating processing timings related to the pseudo SLO image. FIG. 12 shows the generation timing of the pseudo SLO image and the pseudo SLO image after the addition average in time series. In the pseudo SLO image after the averaging, which is displayed as a pseudo SLO moving image when the processing time point is time t, the frame at time t includes the pseudo SLO image at time t and the pseudo SLO at time (t−1). Generated from In the moving image reproduction process, a pseudo SLO image at time (t−1) is stored in the storage unit. Accordingly, the addition averaging unit 304 reads out and uses the pseudo SLO of the time (t−1) stored in the storage unit, thereby reducing the time required for generating the pseudo SLO image after the addition averaging of the time t. Can do. Thereby, a pseudo SLO image can be displayed at high speed.

  As described above, the control device 200 according to the present embodiment can update the frames constituting the OCTA moving image after the averaging process with the frequency of acquiring the OCT image. Also, assuming that the processing time point is time t, the control device 200 determines that the OCTA at time t based on the OCT image at time t, the OCT image at time (t−1), and the OCT image at time (t−2). Generate an image. Similarly, the control device 200 generates the OCTA image at time (t + 1) based on the OCT image at time (t + 1), the OCT image at time t, and the OCT image at time (t−1). .

  This process uses the at least one OCT image (interference signal) used to generate the first frame to be reproduced and displayed at the first timing, and at the second timing following the reproduction and display of the first frame. It is an example of the process which produces | generates the 2nd flame | frame displayed by reproduction | regeneration.

  Returning to FIG. 10, the display screen 1000 will be described. Reference numerals 1001 and 1002 denote a moving image shooting start button and a stop button, respectively. In addition, the user can perform shooting adjustment even during moving image display. In accordance with the operation of the slide bar 1003, the focus control unit 214 drives the focus lens 122 to enable focus adjustment. Further, according to the operation of the slide bar 1004, the optical path length control unit 213 drives the mirror 133 so that the optical path length can be adjusted. When an Auto button 1005 for focus adjustment or Auto 1006 for optical passbook adjustment is selected, adjustment can be automatically made based on at least one of an OCT signal, an OCT tomographic image, an OCTA tomographic image, and an OCTA image.

  Further, the user can select a layer range of the fundus retina to be extracted as an OCTA image by using the OCTA extraction range selection pull-downs 307 and 308 while viewing the OCT tomographic image displayed in the area 1020. Further, a plurality of layer ranges of the fundus retina may be selected, and accordingly, a plurality of OCTA images may be simultaneously displayed in the area 1010. An indicator 1009 indicates image quality, and the state of shooting adjustment can be confirmed. The indicator 1009 is an index calculated based on at least one of an OCT signal, an OCT tomographic image, an OCTA tomographic image, and an OCTA image.

  As described above, the control device 200 according to the present embodiment uses the at least one interference signal used for generating the first frame to be reproduced and displayed at the first timing, and continues to the first frame. A second frame that is reproduced and displayed at the timing of 2 is generated. Thereby, the frame rate in the OCTA moving image can be increased.

(Other embodiments)
The present invention is not limited to the above-described embodiment, and various modifications and changes can be made without departing from the spirit of the present invention. As a first modification, Line-OCT may be applied to the above embodiment. In the present embodiment, the case where spot light is scanned two-dimensionally using a plurality of galvano scanners has been described. On the other hand, Line-OCT is a mechanism for increasing the speed of OCT by forming irradiation light in a line shape, scanning it in a direction perpendicular to the line direction in which it is formed, and making the light receiving center a two-dimensional sensor. The number of scans is reduced, and the OCT operation is speeded up. Regarding Line-OCT, for example, Japanese Patent Laid-Open No. 2006-116028 can be referred to. Furthermore, FF-OCT (Full Field OCT) in which irradiation light is two-dimensionally formed and mechanical scanning is eliminated has been proposed, and FF-OCT may be applied to the above embodiment.

  As a second modification, the system of the present embodiment can be applied to an apparatus that detects blood flow in a region other than the fundus by optical coherence tomography. In addition, for example, the present invention can be applied to an object to be inspected such as skin or organ other than the eye. In this case, the present invention has an aspect as a medical device such as an endoscope other than the ophthalmologic apparatus. Therefore, it is preferable that the present invention is grasped as an ophthalmologic apparatus exemplified by an ophthalmologic apparatus, and the eye to be examined is grasped as one aspect of the object to be inspected.

  Further, by executing the program code read by the computer, an operating system (OS) or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing. This is also included. Furthermore, the program code read from the recording medium is written in the memory in the function expansion card or function expansion unit attached to the computer, and the arithmetic device in the expansion card or expansion unit performs part or all of the actual processing, This includes the case where the functions of the above-described embodiments are realized.

100 photographing device 200 control device

Claims (8)

An acquisition means for acquiring an interference signal between the return light obtained by irradiating the eye to be examined with the measurement light obtained by dividing the light from the light source and the reference light obtained by dividing the light from the light source;
Generating means for generating a frame constituting a motion contrast video using n (n is an integer of 2 or more) interference signals acquired at successive timings by the acquisition means;
Display processing means for continuously reproducing and displaying the plurality of frames in time series,
The generation means reproduces at a second timing following the reproduction display of the first frame by using at least one interference signal used for generating the first frame reproduced and displayed at the first timing. An information processing apparatus that generates a second frame to be displayed.   The display processing means reproduces and displays the second frame before a time tn after a timing at which n interference signals are acquired from the first timing. The information processing apparatus described. In the case where the generating unit generates a frame using n interference signals, (n−m) (m is 1 or more and n) of n interference signals used for generating the first frame. Less than 2) and the m interference signals acquired by the acquisition means following the n interference signals used to generate the first frame, and the second frame. Produces
The display processing means reproduces and displays the second frame at a second timing after tm time corresponding to a timing at which m interference signals are acquired from the first timing. The information processing apparatus according to 1.   The generating means uses the (n−m) interference signals obtained at a later timing among the n interference signals used for generating the first frame, and generates the second frame. The information processing apparatus according to claim 3, wherein: The generating means generates a frame using two interference signals, and one interference signal obtained at a later timing among the two interference signals used for generating the first frame. And generating the second frame based on the two interference signals used for generating the first frame and the one interference signal acquired by the acquisition means.
5. The display processing unit reproduces and displays a second frame at a second timing after t1 time corresponding to a timing at which one interference signal is acquired from the first timing. The information processing apparatus described in 1.   The information processing apparatus according to claim 1, wherein the generation unit generates a frame indicating a tomographic image of a part of the retinal pigment epithelium layer from the inner boundary membrane. An information processing method executed by an information processing apparatus,
An acquisition step of acquiring an interference signal between the return light that irradiates the eye to be examined with the measurement light obtained by dividing the light from the light source and the reference light obtained by dividing the light from the light source;
A generation step of generating a frame constituting a motion contrast video using n (n is an integer of 2 or more) interference signals acquired at successive timings in the acquisition step;
A display processing step of continuously reproducing and displaying the plurality of frames in time series,
In the generation step, using at least one interference signal used for generating the first frame reproduced and displayed at the first timing, at the second timing following the reproduction display of the first frame. An information processing method comprising generating a second frame to be reproduced and displayed.   The program for functioning a computer as each means of the information processing apparatus of any one of Claims 1 thru | or 6.

Images