JP2019055134A - Ophthalmologic imaging apparatus and ophthalmologic information processing apparatus - Google Patents

Abstract

To provide an ophthalmologic imaging apparatus and an ophthalmologic information processing apparatus which present blood flow information of a plurality of eyeground blood vessels acquired by OCT blood flow measurement in a manner appropriate for diagnosis and screening.SOLUTION: A blood data generation unit 33 applies OCT blood flow measurement to each of a plurality of blood vessel positions at the eyeground of a subject eye to acquire a plurality of blood flow data sets corresponding to the plurality of blood vessel positions. A front image acquisition unit 60 acquires a front image of the eyeground. A display control unit 13 causes a display device 2 to display the front image acquired by the front image acquisition unit. The display control unit also causes the display device to display information of the plurality of measurement positions indicating the plurality of blood vessel positions applied with the OCT blood flow measurement, together with the front image. The display control unit further causes the display device to display, in parallel with the front image, at least one blood flow graph representing a time-series change of the respective predetermined blood flow parameter based on at least one of the plurality of blood flow data sets.SELECTED DRAWING: Figure 1

Description

  Embodiments relate to an ophthalmologic photographing apparatus and an ophthalmologic information processing apparatus.

  Image diagnosis occupies an important position in the field of ophthalmology. In recent years, utilization of optical coherence tomography (OCT) has been advanced. OCT has been used not only for acquiring B-scan images and three-dimensional images of the eye to be examined, but also for acquiring front images (en-face images) such as C-scan images, projection images, and shadowgrams. Yes.

  Furthermore, acquiring the image which emphasized the specific site | part of the eye to be examined, and acquiring functional information are also performed. For example, based on time-series data collected by OCT, a B-scan image or a front image (blood vessel emphasized image, angiogram) in which the fundus blood vessel is emphasized can be constructed. This technique is called OCT Angiography. In addition, information relating to blood flow can be acquired based on phase information of time-series data collected by OCT. This technique is called OCT blood flow measurement.

Special table 2015-515894 gazette JP2013-184018A

  There are cases where it is desired to grasp the blood flow state of a plurality of blood vessels in the fundus for diagnosis and screening. In this case, OCT blood flow measurement is performed for a plurality of blood vessels in the fundus, and the obtained plurality of blood flow information is used as a diagnostic material. However, in the conventional technology, such a plurality of blood flow information cannot be presented in a suitable manner.

  An object of the embodiment is to provide a technique for presenting blood flow information of a plurality of fundus blood vessels acquired using OCT blood flow measurement in a suitable manner for diagnosis and screening.

  In the first aspect of the embodiment, optical coherence tomography (OCT) blood flow measurement is applied to each of a plurality of blood vessel positions on the fundus of the eye to be examined, and a plurality of blood flows corresponding to the plurality of blood vessel positions. A blood flow data acquisition unit that acquires data; a front image acquisition unit that acquires a front image of the fundus; and a display processing unit that displays information on a display unit, the display processing unit including the front image acquisition unit The front image acquired by the above is displayed, a plurality of measurement position information indicating the plurality of blood vessel positions to which OCT blood flow measurement is applied is displayed together with the front image, and at least one of the plurality of blood flow data The ophthalmologic photographing apparatus displays at least one blood flow graph representing a time-series change of a predetermined blood flow parameter in parallel with the front image.

  A second aspect of the embodiment is the ophthalmologic imaging apparatus according to the first aspect, wherein the display processing unit parallels a plurality of blood flow graphs corresponding to the plurality of blood vessel positions to which OCT blood flow measurement is applied. Can be displayed.

  A third aspect of the embodiment is the ophthalmologic photographing apparatus according to the first or second aspect, wherein the display processing unit includes each of the at least one blood flow graph displayed on the display unit, Related information that visually associates with the measurement position information indicating the blood vessel position corresponding to the blood flow graph is displayed.

  A fourth aspect of the embodiment is the ophthalmologic photographing apparatus according to the third aspect, in which the display processing unit is common in the vicinity of each of the measurement position information and the blood flow graph corresponding to each other as the related information. Display incidental information.

  A fifth aspect of the embodiment is the ophthalmologic photographing apparatus according to the third or fourth aspect, wherein the display processing unit uses the measurement position information and the blood flow graph corresponding to each other as the related information in a common color. To display.

  A sixth aspect of the embodiment is the ophthalmologic photographing apparatus according to any one of the first to fifth aspects, includes an operation unit, and any one of the plurality of measurement position information is selected using the operation unit. The display processing unit displays a blood flow graph corresponding to the selected measurement position information.

  A seventh aspect of the embodiment is the ophthalmologic photographing apparatus according to any one of the first to fifth aspects, includes an operation unit, and corresponds to a blood flow graph that is already displayed among the plurality of measurement position information. When the measurement position information to be selected is selected using the operation unit, the display processing unit changes the display mode of the blood flow graph corresponding to the selected measurement position information.

  An eighth aspect of the embodiment is the ophthalmologic photographing apparatus according to any one of the first to seventh aspects, and in the blood flow graph, the first coordinate axis indicates time, and the second coordinate axis is a blood flow velocity. And a two-dimensional Cartesian coordinate system indicating any blood flow parameter of blood flow per unit time.

  A ninth aspect of the embodiment is the ophthalmologic imaging apparatus according to the eighth aspect, and when the blood flow parameter is a blood flow rate per unit time, the display processing unit is based on the plurality of blood flow data. Then, a total blood flow graph representing a time series change of blood flow per unit time at the plurality of blood vessel positions is displayed.

  A tenth aspect of the embodiment is the ophthalmologic photographing apparatus according to any one of the first to ninth aspects, wherein at least one of the plurality of blood flow data and a plurality of blood flow graphs corresponding to the plurality of blood flow data is synchronized with each other. Includes a synchronization processor.

  An eleventh aspect of the embodiment is the ophthalmologic imaging apparatus according to the tenth aspect, in which the blood flow data acquisition unit applies OCT blood flow measurement to the plurality of blood vessel positions in time series. Including a reception unit that receives biological information of the subject that changes from the biological information monitor, the synchronization processing unit based on the biological information received by the reception unit, the plurality of blood flow data and At least one of the corresponding plurality of blood flow graphs is synchronized with each other.

  A twelfth aspect of the embodiment is the ophthalmologic photographing apparatus according to the tenth aspect, wherein the synchronization processing unit extracts a feature value from each of the plurality of blood flow data, and based on the extracted feature value At least one of the plurality of blood flow data and the plurality of blood flow graphs corresponding thereto is synchronized with each other.

  A thirteenth aspect of the embodiment is the ophthalmologic photographing apparatus according to the tenth aspect, wherein the synchronization processing unit corresponds to the plurality of blood flow data and these based on waveforms of the plurality of blood flow graphs. At least one of the plurality of blood flow graphs is synchronized with each other.

  A fourteenth aspect of the embodiment is the ophthalmologic photographing apparatus according to any one of the first to thirteenth aspects, wherein the display processing unit displays the plurality of blood flow data or a plurality of blood flow graphs corresponding thereto. Based on this, a plurality of blood vessel images in the front image corresponding to the plurality of blood vessel positions are displayed in color.

  A fifteenth aspect of the embodiment is the ophthalmologic imaging apparatus according to the fourteenth aspect, wherein the display processing unit is based on time-series changes in blood flow parameters in the plurality of blood flow data or the plurality of blood flow graphs. The display colors of the plurality of blood vessel images are changed in time series.

  A sixteenth aspect of the embodiment is the ophthalmologic imaging apparatus according to the fourteenth or fifteenth aspect, wherein the plurality of blood vessel images are converted into arterial images based on the plurality of blood flow data or the plurality of blood flow graphs. Including a blood vessel classification unit for classifying into vein images, and the display processing unit displays the arterial image and the vein image in different colors.

  A seventeenth aspect of the embodiment is the ophthalmologic photographing apparatus according to any one of the first to sixteenth aspects, wherein the front image includes a color fundus image, a monochrome fundus image, a fluorescent fundus image, an OCT cross-sectional image, and an OCT. Any of a projection image, an OCT shadowgram, and an OCT blood vessel enhancement image.

  In an eighteenth aspect of the embodiment, optical coherence tomography (OCT) blood flow measurement is applied to each of a plurality of blood vessel positions on the fundus of the subject's eye, and a plurality of blood flows corresponding to the plurality of blood vessel positions is applied. A blood flow data acquisition unit that acquires data; a front image reception unit that receives a front image of the fundus; and a display processing unit that displays information on a display unit; and the display processing unit is configured by the front image reception unit. The received front image is displayed, and a plurality of measurement position information indicating the plurality of blood vessel positions to which OCT blood flow measurement is applied is displayed together with the front image, and at least one of the plurality of blood flow data And at least one blood flow graph, each representing a time-series change of a predetermined blood flow parameter, is displayed in parallel with the front image.

  The matter in any one of the second to seventeenth aspects can be applied to the ophthalmologic photographing apparatus according to the eighteenth aspect of the embodiment.

  In a nineteenth aspect of the embodiment, a plurality of positions corresponding to the plurality of blood vessel positions obtained by applying optical coherence tomography (OCT) blood flow measurement to each of the plurality of blood vessel positions on the fundus of the subject eye. A blood flow data receiving unit that receives the blood flow data, a front image acquisition unit that acquires a front image of the fundus, and a display processing unit that displays information on a display unit, the display processing unit including the front image The front image acquired by the acquisition unit is displayed, a plurality of measurement position information indicating the plurality of blood vessel positions to which the OCT blood flow measurement is applied is displayed together with the front image, and among the plurality of blood flow data An ophthalmologic imaging apparatus that displays at least one blood flow graph representing a time-series change of a predetermined blood flow parameter in parallel with the front image based on at least one A.

  The matter in any one of the second to seventeenth aspects can be applied to the ophthalmologic photographing apparatus according to the nineteenth aspect of the embodiment.

  In a twentieth aspect of the embodiment, a plurality of blood vessel positions corresponding to the plurality of blood vessel positions acquired by applying optical coherence tomography (OCT) blood flow measurement to each of a plurality of blood vessel positions on the fundus of the subject eye. A storage unit that stores blood flow data and a front image of the fundus; and a display processing unit that displays information on a display unit. The display processing unit displays the front image, and OCT blood flow measurement is performed. A plurality of measurement position information indicating the plurality of applied blood vessel positions is displayed together with the front image, and based on at least one of the plurality of blood flow data, each is a time-series change of a predetermined blood flow parameter. Is an ophthalmologic information processing apparatus that displays at least one blood flow graph representing the in parallel with the front image.

  The matter in any one of the second to seventeenth aspects can be applied to the ophthalmologic information processing apparatus according to the twentieth aspect of the embodiment.

  According to the embodiment, it is possible to present blood flow information of a plurality of fundus blood vessels acquired using OCT blood flow measurement in a suitable manner for diagnosis and screening.

It is the schematic showing an example of the structure of the ophthalmologic imaging device which concerns on exemplary embodiment. It is the schematic for demonstrating an example of the process which the ophthalmologic imaging device which concerns on exemplary embodiment performs. It is a flowchart showing an example of operation | movement of the ophthalmologic imaging device which concerns on exemplary embodiment. It is the schematic for demonstrating an example of the process which the ophthalmologic imaging device which concerns on exemplary embodiment performs. It is the schematic for demonstrating an example of the process which the ophthalmologic imaging device which concerns on exemplary embodiment performs. It is the schematic for demonstrating an example of the process which the ophthalmologic imaging device which concerns on exemplary embodiment performs. It is the schematic for demonstrating an example of the process which the ophthalmologic imaging device which concerns on exemplary embodiment performs. It is the schematic for demonstrating an example of the process which the ophthalmologic imaging device which concerns on exemplary embodiment performs. It is the schematic for demonstrating an example of the process which the ophthalmologic imaging device which concerns on exemplary embodiment performs. It is the schematic for demonstrating an example of the process which the ophthalmologic imaging device which concerns on exemplary embodiment performs. It is the schematic showing an example of the structure of the ophthalmologic imaging device which concerns on exemplary embodiment. It is the schematic showing an example of the structure of the ophthalmologic imaging device which concerns on exemplary embodiment. It is the schematic showing an example of the structure of the ophthalmologic imaging device which concerns on exemplary embodiment. It is the schematic showing an example of the structure of the ophthalmologic information processing apparatus which concerns on exemplary embodiment.

  An exemplary embodiment of the present invention will be described with reference to the drawings. In addition, it is possible to use arbitrary well-known techniques including the description matter of the literature referred in this specification for embodiment.

  The ophthalmologic photographing apparatus and the ophthalmologic information processing apparatus according to the embodiment have a function of displaying various information based on blood flow data acquired by applying OCT blood flow measurement to the fundus of the eye to be examined. The ophthalmologic information processing apparatus according to the embodiment receives, for example, blood flow data obtained by applying an OCT blood flow measurement to a fundus of an eye to be examined by a separately provided OCT apparatus, and various information based on the blood flow data. Execute the display. On the other hand, the ophthalmologic imaging apparatus according to the embodiment acquires blood flow data by applying OCT blood flow measurement to the fundus of the eye to be examined, and executes display of various information based on the blood flow data.

Data acquired by applying OCT to the fundus of the eye to be examined (fundus OCT data) may be data in any form. For example, the fundus OCT data may include one or more of the following (1) to (5).
(1) Data collected by OCT scan of the fundus (raw data)
(2) Image data obtained by processing raw data (3) Intermediate data obtained during a series of processes for generating image data from raw data (4) Obtained by processing raw data Blood flow data (5) Intermediate data obtained in the middle of a series of processes for generating blood flow data from raw data

  The type of fundus OCT data is not limited to these. Embodiments can also process various information associated with fundus OCT data. Examples of such information include subject identification information, subject eye identification information, identification information indicating whether the subject eye is the left eye or the right eye, imaging date and time, and the like.

  The ophthalmologic photographing apparatus and the ophthalmologic information processing apparatus according to the embodiment include a processor that executes data display processing. The ophthalmologic information processing apparatus according to the embodiment may further include a processor that processes raw data and intermediate data. The ophthalmologic imaging apparatus according to the embodiment includes an optical system, a drive system, a control system, and a data processing system for executing OCT in addition to these processors.

  The ophthalmologic imaging apparatus of the embodiment is configured to be able to execute, for example, Fourier domain OCT. The Fourier domain OCT includes a spectral domain OCT and a swept source OCT. Spectral domain OCT is a technique for constructing an image by acquiring a spectrum of interference light by spatial division using a broadband low-coherence light source and a spectroscope and performing Fourier transform on the spectrum. Swept source OCT uses a wavelength swept light source (wavelength variable light source) and a photodetector (balanced photodiode, etc.) to acquire the spectrum of interference light in a time-sharing manner, and constructs an image by Fourier transforming it. It is a technique to do. The method of OCT is not limited to Fourier domain OCT, but may be time domain OCT or unfaced OCT.

  The ophthalmologic imaging apparatus and the ophthalmologic information processing apparatus according to the embodiment may include a modality (for example, a modality other than OCT) for imaging the eye and / or other parts. Typical examples include a fundus camera, SLO, a slit lamp microscope, and an ophthalmic surgical microscope. In addition, the ophthalmologic imaging apparatus and the ophthalmologic information processing apparatus according to the embodiment may include a configuration for measuring characteristics of the eye and / or other parts and a configuration for performing an examination.

  The ophthalmologic photographing apparatus and the ophthalmologic information processing apparatus according to the embodiment execute a process of displaying a front image of the fundus in addition to the display process based on the fundus blood flow data acquired by the OCT blood flow measurement. The fundus front image is a fundus image from the front (corneal side) viewpoint of the eye to be examined. The fundus front image may be an image acquired by an arbitrary modality. For example, the fundus front image may be an image constructed from data acquired by applying OCT to the fundus, or may be an image based on data acquired by applying a modality other than OCT to the fundus. Typical examples of the latter include fundus photographs (for example, color fundus images, monochrome fundus images, fluorescent images, etc.) obtained by a fundus camera or SLO. The ophthalmologic imaging apparatus according to the embodiment includes at least one of a configuration for OCT and a configuration for other modalities.

  The data processing function (calculation function, image processing function, control function, etc.) in the ophthalmologic photographing apparatus and the ophthalmologic information processing apparatus according to the embodiment includes, for example, hardware such as a processor and a storage device, a calculation program, an image processing program, and control This is realized by cooperation with software such as programs. A part of the hardware may be provided in an external device that can communicate with the ophthalmologic information processing apparatus or the ophthalmologic photographing apparatus according to the embodiment. Further, at least a part of the software may be stored in advance in the ophthalmologic information processing apparatus or ophthalmologic photographing apparatus according to the embodiment, and / or may be stored in advance in an external apparatus.

<Ophthalmic photography device>
<Constitution>
An ophthalmologic imaging apparatus according to an exemplary embodiment will be described. A configuration example of the ophthalmologic photographing apparatus according to the present embodiment is shown in FIG. The ophthalmologic photographing apparatus 1 collects fundus data using OCT, generates fundus blood flow data based on the collected data, acquires a front image of the fundus, obtains fundus blood flow data, a fundus front image, and Various information can be displayed based on the above.

  The fundus blood flow data is data representing a blood flow state (blood flow dynamics) in a fundus blood vessel (retinal blood vessel, choroidal blood vessel, etc.). Examples of fundus blood flow data include blood flow direction, blood flow velocity, time series change in blood flow velocity, blood flow, blood flow per unit time, time series change in blood flow per unit time, total blood flow, etc. .

  Moreover, the ophthalmologic imaging apparatus 1 can form an image representing the fundus oculi form based on data collected using OCT. A fundus morphological image is an image representing the shape of the fundus oculi. Examples of fundus morphological images include B-scan images, C-scan images, projection images, shadowgrams, and blood vessel enhancement images.

  In the present embodiment, both morphological images and blood flow data can be formed based on data obtained by applying OCT blood flow measurement to the fundus. In addition, you may make it perform separately the OCT scan (for example, B scan, three-dimensional scan) for acquiring a morphological image, and the OCT scan (OCT blood flow measurement) for acquiring blood flow data. . Moreover, you may perform the OCT scan for acquiring data other than these. For example, OCT angiography can be performed.

  Further, the ophthalmologic photographing apparatus 1 acquires the above-described fundus front image. In the present embodiment, the fundus front image may include an OCT front image such as a C-scan image, a projection image, or a shadowgram. Further, the fundus front image may include an image acquired by an arbitrary modality such as a fundus camera, an SLO, a slit lamp microscope, or an ophthalmic surgical microscope.

  A part of data used for displaying information may be acquired by another device. For example, one of the fundus blood flow data and the fundus front image may be acquired by another device. Further, the fundus morphological image may be acquired by applying OCT to the fundus using another device. Data acquired by another device is input to the ophthalmologic photographing apparatus according to the embodiment.

  The ophthalmologic photographing apparatus 1 can display various information such as a fundus front image, blood flow information, and fundus morphological image on the display device 2. The display device 2 may be a part of the ophthalmologic photographing apparatus 1 or may be an external device connected to the ophthalmic photographing apparatus 1. The ophthalmologic photographing apparatus 1 can send various information to a computer, a storage device, an ophthalmic apparatus, and the like.

  The ophthalmologic imaging apparatus 1 includes a control unit 10, a storage unit 20, an OCT data acquisition unit 30, an operation unit 50, and a front image acquisition unit 60. The control unit 10 includes a scan control unit 11, a synchronization processing unit 12, and a display control unit 13. The OCT data acquisition unit 30 includes an OCT scanner 31, an image forming unit 32, and a blood flow data generation unit 33.

  Optionally, the ophthalmologic photographing apparatus 1 may include a data input unit 40. Although details will be described later, in the present embodiment, the data input unit 40 is provided when a configuration using biological information from a biological information monitor is applied.

<Control unit 10>
The control unit 10 controls each unit of the ophthalmologic photographing apparatus 1. The control unit 10 includes a processor. The “processor” is, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), a programmable logic device (for example, SPLD (Simple Programmable L). , A circuit such as a field programmable gate array (FPGA). For example, the control unit 10 can realize the functions according to the embodiment by reading and executing a program stored in a storage circuit or a storage device (such as the storage unit 20 or an external device).

  The control unit 10 may include a communication interface for transmitting and receiving data via a communication line such as a local area network (LAN), the Internet, or a dedicated line.

<Scan control unit 11>
The scan control unit 11 controls the OCT scanner 31. For example, the scan control unit 11 controls the OCT scanner 31 to control the light source, control the optical scanner, change the optical path length of the measurement light and / or reference light, adjust the polarization, adjust the light amount, adjust the focus, change the fixation position, etc. Control the various elements involved. Some examples of processing that can be executed by the scan control unit 11 will be described later.

  In the present embodiment, OCT blood flow measurement is applied to each of a plurality of blood vessel positions on the fundus of the eye to be examined. Thereby, a plurality of blood flow data corresponding to a plurality of blood vessel positions are obtained. The plurality of blood vessel positions are a plurality of positions in one or more blood vessels in the fundus of the eye to be examined. In the present embodiment, each of the plurality of blood vessel positions corresponds to an attention cross section described later.

<Synchronization processing unit 12>
The synchronization processing unit 12 executes a process for synchronizing at least one of a plurality of blood flow data corresponding to a plurality of blood vessel positions on the fundus and a plurality of blood flow graphs (described later) corresponding to these.

  That is, the synchronization processing unit 12 performs a process for synchronizing a plurality of blood flow data corresponding to a plurality of blood vessel positions on the fundus and a process for synchronizing a plurality of blood flow graphs based on the blood flow data with each other. One or both of these can be performed.

  Thereby, the relative positional relationship (relative positional relationship in the time direction) between a plurality of blood flow graphs displayed on the display device 2 can be adjusted. In the present embodiment, both the synchronization between the plurality of blood flow data and the synchronization between the plurality of blood flow graphs are executed for displaying the plurality of blood flow graphs. It can be said that it is substantially the same processing.

  The blood flow graph is graph information representing a time-series change of a predetermined blood flow parameter created based on blood flow data corresponding to the blood vessel position of the fundus. The blood flow parameter represented by the blood flow graph may include at least one of an arbitrary parameter indicated by the blood flow data and an arbitrary parameter that can be obtained by processing the blood flow data. An example of the blood flow graph will be described later.

  In the present embodiment, the blood flow parameters include, for example, the direction of blood flow, blood flow velocity, time-series change in blood flow velocity, blood flow, blood flow per unit time, time series change in blood flow per unit time, and Any one or more parameters of the total blood flow may be included. However, the types of blood flow parameters are not limited to these.

  The synchronization processing unit 12 may be configured to execute any of the following first to third examples, for example.

  A first example of the synchronization process will be described. In this example, the synchronization processing unit 12 executes synchronization processing with reference to feature values of a plurality of blood flow data. More specifically, the synchronization processing unit 12 extracts feature values from each of the plurality of blood flow data, and performs synchronization processing of a plurality of blood flow data and / or a plurality of blood flow graphs based on the extracted feature values. Execute synchronous processing. In this example, the feature value may be an arbitrary feature value that can be specified by processing blood flow data, and typically may be a peak value or the like. For example, the synchronization processing unit 12 synchronizes the plurality of blood flow data and / or the plurality of blood flow graphs so that the plurality of feature values specified from the plurality of blood flow data are arranged at the same position on the time axis. Synchronization processing can be executed.

  A second example of the synchronization process will be described. In this example, the synchronization processing unit 12 executes synchronization processing with reference to waveforms of a plurality of blood flow graphs. More specifically, the synchronization processing unit 12 extracts feature points of the waveform from each of the plurality of blood flow data, and performs synchronization processing of the plurality of blood flow data and / or a plurality of blood based on the extracted feature points. Execute the synchronization process of the flow graph. In this example, the feature points of the waveform may be arbitrary feature points that can be identified by processing the blood flow graph. Typically, peak points, points with zero slope, inflection points, and feature patterns are used. It may be a point included in the portion to be presented. For example, the synchronization processing unit 12 synchronizes the plurality of blood flow data and / or the plurality of blood flow graphs so that the plurality of feature points identified from the plurality of blood flow graphs are arranged at the same position on the time axis. Synchronization processing can be executed.

  A third example of the synchronization process will be described. In this example, the synchronization process is executed with reference to the biological information (vital sign) of the subject input via the data input unit 40. The biological information is acquired using an arbitrary biological information monitor. The biological information monitor is also called a vital sign monitor or clinical monitor, and is a device for monitoring a vital sign of a person. Examples of vital signs include those related to cardiovascular function, those related to respiratory function, those related to metabolic function, and those related to brain function.

  Examples of biological information monitors for measuring cardiovascular function include an electrocardiograph, a heart rate monitor, a pulse meter, and a blood pressure monitor. An example of a biological information monitor for measuring respiratory function is a respirometer. An example of a biological information monitor for measuring metabolic function is an activity meter. Examples of biological information monitors for measuring brain function include electroencephalographs, magnetoencephalographs, and functional magnetic resonance imaging (fMRI) devices.

  The biological information monitors listed above are merely examples, and biological information monitors applicable to the embodiments are not limited to these. For example, a biological information monitor for detecting vital signs such as body temperature, urination, defecation, and consciousness state can be applied to the embodiment.

  When this example is applied, the data input unit 40 is provided in the ophthalmologic photographing apparatus 1. The data input unit 40 includes, for example, an interface (for example, a communication interface or a terminal) that receives a signal output from the biological information monitor. The data input unit 40 receives, for example, the biological information of the subject that changes in time series from the biological information monitor before and / or during the application of the OCT blood flow measurement. The synchronization processing unit 12 synchronizes at least one of the plurality of blood flow data and the plurality of blood flow graphs with each other based on the biological information received by the data input unit 40.

  In this example, the synchronization processing unit 12 may be configured to control the operation of the data acquisition unit 30 based on biological information input from the biological information monitor.

  For example, the synchronization processing unit 12 can control the operation of the OCT scanner 31 based on the biological information detected by the biological information monitor. As a specific example, when the biological information monitor includes an electrocardiograph, the synchronization processing unit 12 uses the OCT scanner 31 in accordance with the timing of a predetermined time phase (for example, R wave) of the electrocardiogram obtained by the electrocardiograph. A scan can be started. Thereby, OCT blood flow measurement can be started with a predetermined time phase of the heartbeat as a trigger.

  Further, the synchronization processing unit 12 can end the scanning by the OCT scanner 31 in accordance with the timing of a predetermined time phase (for example, R wave) of the electrocardiogram obtained by the electrocardiograph. Thereby, OCT blood flow measurement can be terminated with a predetermined time phase of the heartbeat as a trigger.

  Further, as a combination of these, the synchronization processing unit 12 starts scanning by the OCT scanner 31 in accordance with the timing of a predetermined time phase (for example, R wave) of the electrocardiogram obtained by the electrocardiograph, and repeats the time phase. The number of times can be counted, and the scan can be terminated when the count value reaches a predetermined number of times (for example, once, twice, or three times). Thereby, blood flow data over a period corresponding to a predetermined number of repetitions of the heartbeat cycle can be collected.

  In another example, the synchronization processing unit 12 can control the image forming unit 32 to form an image corresponding to a predetermined time phase (for example, R wave) of an electrocardiogram obtained by an electrocardiograph. Further, the synchronization processing unit 12 can control the image forming unit 32 so as to form a plurality of images over a period corresponding to a predetermined number of repetitions of the heartbeat cycle. The synchronization processing unit 12 selects an image corresponding to a predetermined time phase of the electrocardiogram from among a plurality of images acquired by the image forming unit 32, or selects an image group over a predetermined period of the electrocardiogram. It is possible.

  In still another example, the synchronization processing unit 12 causes the blood flow data generation unit 33 to form blood flow data according to the timing of a predetermined time phase (for example, R wave) of the electrocardiogram obtained by the electrocardiograph. Can be controlled. In addition, the synchronization processing unit 12 can control the blood flow data generation unit 33 so as to form blood flow data over a period corresponding to a predetermined number of repetitions of the heartbeat cycle. The synchronization processing unit 12 selects blood flow data corresponding to a predetermined time phase of the electrocardiogram from among a plurality of blood flow data acquired by the blood flow data generation unit 33, or a predetermined period of the electrocardiogram. A wide range of blood flow data groups can be selected.

  By applying any of the processes according to this example in OCT blood flow measurement for each of a plurality of blood vessel positions on the fundus of the subject eye, a plurality of blood flow data corresponding to the plurality of blood vessel positions can be synchronized with each other. Furthermore, a plurality of blood flow graphs based on a plurality of blood flow data can be synchronized with each other.

  The synchronization process that can be executed by the synchronization processing unit 12 is not limited to the above example. Further, even when a biological information monitor of a type other than the electrocardiograph is applied, the same processing can be executed.

<Display control unit 13>
The display control unit 13 executes control for displaying information on the display device 2. The display control unit 13 can execute display control based on the information stored in the storage unit 20.

  The display control unit 13 can perform processing (generation, processing, synthesis, etc.) regarding information displayed on the display device 2. Such processing may be executed by linking the display control unit 13 and other elements (other elements of the control unit 10, the data processing unit 40, etc.).

<Storage unit 20>
Various data are stored in the storage unit 20. In this example, at least OCT data 21 is stored in the storage unit 20. The storage unit 20 may store a front image such as a fundus photograph. Note that at least part of the OCT data may be stored in an external storage device and provided to the ophthalmologic imaging apparatus 1 as required. The storage unit 20 includes, for example, a storage device such as a hard disk drive or a semiconductor memory.

<OCT data 21>
The OCT data 21 includes any one or more of the above-described fundus OCT data (1) to (5). Typically, the ophthalmologic imaging apparatus 1 generates morphological images and blood flow data from raw data collected by an OCT scan of the fundus oculi, and stores OCT data 21 including these in the storage unit 20. In other words, in a typical example, the above-described fundus OCT data (2) and (4) are included in the OCT data 21. When OCT angiography is applied, the OCT data 21 includes data collected by OCT angiography, a blood vessel enhancement image based on the collected data, and the like.

<OCT data acquisition unit 30>
The OCT data acquisition unit 30 acquires data (for example, at least a part of the OCT data 21 stored in the storage unit 20) by applying OCT to the fundus of the eye to be examined. As described above, the OCT data acquisition unit 30 includes the OCT scanner 31, the image forming unit 32, and the blood flow data generation unit 33. The image forming unit 32 includes a processor that executes an image forming program. The blood flow data generation unit 33 includes a processor that executes a blood flow data generation program.

<OCT scanner 31>
The OCT scanner 31 performs a fundus OCT scan under the control of the scan control unit 11. Thereby, fundus data (raw data) is collected. The OCT scanner 31 includes a configuration for performing optical interference measurement using, for example, a spectral domain OCT or a swept source OCT. Such an OCT scanner 31 includes an OCT optical system, a drive system, a data acquisition system (DAQ), a control system, and the like, as in the prior art.

  The OCT optical system includes, for example, an interference optical system, an optical scanner, and a photodetector. The interference optical system splits the light output from the light source into measurement light and reference light, projects this measurement light onto the fundus, and superimposes the return light of the measurement light from the fundus on the reference light to generate interference light To do. The optical scanner includes a galvano scanner and the like, and deflects measurement light. Thereby, the projection position of the measurement light on the fundus is moved. The photodetector detects (the spectrum of) interference light generated by the interference optical system.

  The drive system moves and operates elements included in the OCT optical system. The data collection system collects detection results obtained sequentially by the OCT optical system. The control system controls the OCT optical system, the drive system, the data acquisition system, and the like under the control of the scan control unit 11 (or other elements of the control unit 10).

  In OCT blood flow measurement, the OCT scanner 31 repeatedly scans a cross section intersecting a blood vessel at a preset measurement position and collects data. In other words, the OCT scanner 31 repeatedly scans a cross section of interest that intersects the blood vessel of interest and collects data. The scan mode at this time is, for example, line scan (B scan). This line scan is repeatedly executed at a predetermined frequency, for example. Data collected by such repeated scanning is sent to the image forming unit 32.

  In the OCT blood flow measurement, the OCT scanner 31 further performs a scan for obtaining the inclination angle of the target blood vessel in the target cross section. This scan is performed on, for example, two cross sections intersecting the target blood vessel. Here, two cross sections can be arranged in the vicinity of the target cross section.

  One of the two cross sections for obtaining the inclination angle of the target blood vessel may be the target cross section itself. The other cross section is set in the vicinity of the target cross section. In this case, the data obtained by the repeated scanning of the target section described above can be used for calculating the tilt angle.

  In summary, typically, the scan performed in the OCT blood flow measurement may be a combination of the repetitive scan of the cross section of interest and the scan of the other two cross sections, or the repetitive scan of the cross section of interest and the other one cross section. It may be combined with scanning.

  The mode of scanning for obtaining the inclination angle of the blood vessel of interest in the cross section of interest is not limited to these. For example, three or more cross sections can be scanned. Alternatively, it is possible to scan a three-dimensional region including the target cross section (three-dimensional scan). As another example, a cross section that intersects the cross section of interest and is along the blood vessel of interest can be scanned. The OCT blood flow measurement will be described in detail in the description of the blood flow data generation unit 33.

  When performing OCT angiography, the OCT scanner 31 scans a three-dimensional region of the fundus. The scan mode at this time is, for example, raster scan (three-dimensional scan). This raster scan is executed, for example, so as to scan each of a plurality of B cross sections (B scan planes) a predetermined number of times (for example, four times). In other words, this raster scan is executed so as to sequentially scan a plurality of B cross sections by a predetermined number of times or according to a predetermined sequence. The three-dimensional data set collected by the OCT scanner 31 is sent to the image forming unit 32.

  The mode of scanning that can be executed by the OCT scanner 31 is not limited to the above-described mode. For example, the OCT scanner 31 can perform a line scan, a circle scan, a radial scan, a three-dimensional scan, and the like as an OCT scan for acquiring a morphological image.

<Image forming unit 32>
The image forming unit 32 forms an OCT image based on the data collected by the OCT scanner 31. For example, in OCT blood flow measurement, the image forming unit 32 forms a plurality of cross-sectional images (B-scan images) for each B cross-section based on the three-dimensional data set collected by the OCT scanner 31. The image forming process at this time includes, for example, noise removal (noise reduction), filter processing, fast Fourier transform (FFT), and the like, as in the conventional OCT technique.

  The image forming unit 32 can construct stack data by embedding these cross-sectional images in a single three-dimensional coordinate system. In this stack data, the number of cross-sectional images corresponding to the number of scan repetitions is assigned to each B cross-section. Further, the image forming unit 32 can form volume data (voxel data) by performing interpolation processing or the like on the stack data. In this volume data, the number of voxel groups corresponding to the number of scan repetitions is assigned to the position corresponding to each B cross section.

  The image forming unit 32 renders the stack data or the volume data, so that a B scan image (longitudinal section image, axial section image), C scan image (transverse section image, horizontal section image), projection image, shadowgram Etc. can be formed.

  An image of an arbitrary cross section such as a B scan image or a C scan image is formed by selecting pixels (pixels, voxels) on a specified cross section from a three-dimensional data set. Alternatively, the image of an arbitrary cross section is formed by projecting a slice having a preset thickness in the thickness direction.

  The projection image is formed by projecting stack data or volume data in a predetermined direction (Z direction, depth direction, A scan direction). The shadowgram is formed by projecting a part of stack data or volume data (for example, partial data corresponding to a specific layer) in a predetermined direction. A fundus image with the viewpoint of the cornea side of the eye to be examined, such as a C-scan image, a projection image, or a shadowgram, is referred to as a front image.

  The image forming unit 32 can execute various image processes in addition to rendering. For example, there are segmentation for obtaining a specific tissue and tissue boundary, and size analysis for obtaining the size (layer thickness, volume, etc.) of the tissue. When a specific layer (or a specific layer boundary) is obtained by segmentation, it is possible to reconstruct a B-scan image or a front image so that the specific layer becomes flat. Such an image is called a flattened image.

  The image forming unit 32 can form a blood vessel emphasized image. A blood vessel enhancement image is an image in which an image region (blood vessel region) corresponding to a blood vessel is identified by analyzing OCT data, and the expression mode of the blood vessel region is changed to enhance it. A plurality of OCT data obtained by repeatedly scanning substantially the same range of the eye to be examined is used for specifying the blood vessel region.

  The blood vessel emphasized image represents, for example, a blood vessel distribution (that is, a three-dimensional distribution of blood vessels) in a three-dimensional region of the fundus subjected to OCT scanning. There are several types of techniques for forming a blood vessel enhanced image. A typical technique for this will be described. In this process, a three-dimensional data set including a plurality of B scan images arranged in time series for each B cross section by repeatedly scanning each of the plurality of B cross sections of the eye to be examined is used. Note that there are fixation and tracking as a method for repeatedly scanning substantially the same B section.

  In the process of forming a blood vessel emphasized image, first, alignment of a plurality of B scan images is executed for each B cross section. This alignment is performed using, for example, a known image matching technique. As a typical example, it is possible to execute extraction of a feature region in each B-scan image and alignment of a plurality of B-scan images by alignment of the extracted plurality of feature regions.

  Subsequently, a process of specifying an image region changing between the plurality of aligned B-scan images is performed. This process includes, for example, a process for obtaining a difference between different B-scan images. Each B-scan image is luminance image data representing the form of the eye to be examined, and an image region corresponding to a part other than a blood vessel is considered to be substantially unchanged. On the other hand, considering that the backscattering contributing to the interference signal changes randomly due to blood flow, an image region in which a change occurs between a plurality of aligned B-scan images (for example, a pixel whose difference is not zero, or It can be estimated that a pixel whose difference is equal to or greater than a predetermined threshold is a blood vessel region.

  Information indicating that it is a blood vessel region is assigned to the image region thus identified. By executing the above process on a plurality of B cross sections, a three-dimensionally distributed blood vessel region is obtained. By rendering such a three-dimensional blood vessel enhancement image, a front image representing a blood vessel distribution, an image of an arbitrary cross section, a shadowgram of an arbitrary range, and the like are generated.

  The process for forming the blood vessel emphasized image is not limited to this. For example, the blood vessel region can be specified by a conventional method using Doppler OCT, or the blood vessel region can be specified by using a conventional image processing method. Moreover, it is possible to identify a blood vessel region for each part by using different methods depending on the part. For example, the blood vessel region can be specified using the above-described typical method or Doppler OCT method for the retina, and the blood vessel region can be specified using the image processing method for the choroid.

<Blood flow data generation unit 33>
The blood flow data generation unit 33 operates in OCT blood flow measurement. The blood flow data generation unit 33 is based on the image of the cross section of interest formed by the image forming unit 32 based on the data collected by the OCT scanner 31 in the OCT blood flow measurement, and the inclination angle of the blood vessel of interest in the cross section of interest. Blood flow data representing a blood flow state in the blood vessel of interest is generated.

  The data collected by the OCT scanner 31 in the OCT blood flow measurement is different from the data (first data) collected by repeatedly scanning the cross section of interest intersecting the blood vessel of interest and the cross section of interest and different from the cross section of interest. And data (second data) obtained by scanning one or more cross sections (cross sections in the vicinity of the target cross section). Instead of the second data, for example, the inclination angle of the blood vessel of interest at the position of the cross section of interest or at a position near the cross section obtained separately from the OCT blood flow measurement can be used. As an example, it is possible to use an inclination angle obtained from a blood vessel enhancement image obtained by OCT angiography.

  The image forming unit 32 forms a fundus morphological image and a phase image based on data collected by the OCT scanner 31 in OCT blood flow measurement. The morphological image and the phase image obtained by OCT blood flow measurement are images corresponding to the same cross section. Typically, a morphological image and a phase image corresponding to the target cross section (B cross section) are obtained.

  As described above, in typical OCT blood flow measurement, two types of scans (auxiliary scan and main scan) are performed on the fundus. The auxiliary scan is executed to scan one or more cross sections (cross sections in the vicinity of the target cross section) different from the target cross section and collect the second data. In a typical auxiliary scan, two or more cross sections intersecting the blood vessel of interest are scanned with measurement light. Data acquired by the auxiliary scan is used to obtain the inclination angle of the target blood vessel in the target cross section. On the other hand, the main scan is executed in order to collect first data by repeatedly scanning a cross section of interest intersecting the blood vessel of interest with measurement light. The section on which the auxiliary scan is performed is arranged in the vicinity of the target section. This scan is Doppler measurement using OCT.

  For example, the target cross section of the auxiliary scan and the main scan is oriented so as to be orthogonal to the traveling direction of the blood vessel of interest. In addition, the distance between the target cross section of the auxiliary scan and the target cross section (inter-section distance) is set in advance or set for each examination. As an example of the latter, it is possible to set the distance between cross sections based on a predetermined factor such as the curvature of the blood vessel of interest at or near the cross section of interest and the inspection accuracy. Further, the user may set a desired distance between cross sections.

  The scan is preferably performed over at least one cardiac cycle of the patient's heart. Thereby, blood flow data in all time phases of the heartbeat are obtained. The execution time of the main scan may be a predetermined time set in advance, or may be a time set for each patient or for each examination.

  The image forming unit 32, for example, a cross-sectional image representing the form of the first auxiliary cross section based on the data collected by the auxiliary scan for the two auxiliary cross sections set in the vicinity of the target cross section, and the second auxiliary cross section A cross-sectional image representing the shape of the target cross section. At this time, it is possible to improve the image quality by using a technique such as addition averaging, or to select one optimum image from two or more cross-sectional images of each auxiliary cross-section.

  Further, the image forming unit 32 forms a cross-sectional image group representing a time-series change in the cross section of interest based on data collected by the main scan (repetitive scan) with respect to the cross section of interest. This process is realized, for example, by forming a cross-sectional image from data collected at each scan repetition.

  The processing executed by the image forming unit 32 includes, for example, noise removal (noise reduction), filter processing, fast Fourier transform (FFT), and the like, as in the conventional OCT technique. The process for forming the cross-sectional image of the target cross section described here is the same as the morphological image forming process executed by the image forming unit 32.

  Furthermore, the image forming unit 32 forms a phase image representing a time-series change of the phase difference in the cross section of interest based on the data collected by the main scan for the cross section of interest. The data used for this processing is the same as the data used for forming the cross-sectional image (group) of the target cross-section. Therefore, there is a natural positional correspondence between the cross-sectional image of the target cross-section and the phase image, and registration is obvious.

  An example of a phase image forming method will be described. In a typical example, a phase image is obtained by calculating a phase difference between adjacent A-line complex signals (signals corresponding to adjacent scan points). In other words, the phase image of this example is formed based on the time series change of the pixel value (luminance value) of each pixel of the cross-sectional image of the target cross section. For an arbitrary pixel, the image forming unit 32 considers a graph of a time-series change in luminance value. The image forming unit 32 obtains a phase difference Δφ between two time points t1 and t2 (t2 = t1 + Δt) separated by a predetermined time interval Δt in this graph. The phase difference Δφ is defined as the phase difference Δφ (t1) at the time point t1 (more generally, any time point between the two time points t1 and t2). By executing this process for each of a number of preset time points, a time-series change in phase difference in the pixel can be obtained.

  The phase image represents the value of the phase difference at each time point of each pixel as an image. This imaging process can be realized, for example, by expressing the value of the phase difference with the display color or brightness. At this time, a color indicating that the phase has increased along the time series (for example, red) can be different from a color indicating that the phase has decreased (for example, blue). Also, the magnitude of the phase change amount can be expressed by the darkness of the display color. By adopting such an expression method, the direction and size of the blood flow can be expressed by color and density. A phase image is formed by executing the above processing for each pixel.

  The time-series change of the phase difference is obtained by ensuring the phase correlation by sufficiently reducing the time interval Δt. At this time, oversampling in which the time interval Δt is set to a value less than the time corresponding to the resolution of the cross-sectional image is performed in the measurement light scan.

  The blood flow data generation unit 33 can execute, for example, a blood vessel region specifying process, an inclination angle calculation process, and a blood flow data generation process. The blood flow data generation processing includes, for example, at least blood flow velocity calculation processing, and may further include blood vessel diameter calculation processing and blood flow volume calculation processing.

  In the blood vessel region specifying process, the blood flow data generation unit 33 specifies a blood vessel region in each cross-sectional image corresponding to the blood vessel of interest. Furthermore, the blood flow data generation unit 33 specifies a blood vessel region in the phase image corresponding to the target cross section. The blood vessel region is specified by analyzing the pixel value of each image (for example, threshold processing). The blood vessel region in the phase image may be specified based on the blood vessel region in the cross-sectional image corresponding to the target cross-section and the result of registration between the cross-sectional image and the phase image.

  In the tilt angle calculation process, the blood flow data generation unit 33 calculates the tilt angle of the target blood vessel in the target cross section based on the image (group) formed from the data acquired by the auxiliary scan.

  An example of the tilt angle calculation process will be described. Please refer to FIG. Symbol B0 indicates a cross-sectional image (a cross-sectional image of interest) in the cross-section of interest where the blood vessel inclination angle is calculated. A blood vessel region V0 is depicted in the attention cross-sectional image B0. Reference numerals B11 and B12 indicate two cross-sectional images (auxiliary cross-sectional images) in two auxiliary cross-sections located in the vicinity of the target cross-section B0. In the auxiliary cross-sectional image B11, the blood vessel region V11 in the auxiliary cross-section B11 of the same blood vessel (target blood vessel) as the blood vessel region V0 is depicted. Similarly, the blood vessel region V12 in the auxiliary cross section B12 of the target blood vessel is depicted in the auxiliary cross sectional image B12.

  The blood flow data generation unit 33 calculates the inclination of the blood vessel of interest in the cross section of interest based on the cross section of interest image B0 and the auxiliary cross sectional images B11 and B12. Note that the number of auxiliary sectional images to be referred to is not limited to two, and may be an arbitrary number of one or more.

  The blood flow data generation unit 33 calculates the inclination of the blood vessel of interest in the cross section of interest based on the blood vessel regions V0, V11, and V12 and the distance between cross sections. The distance between cross sections may be a distance between the auxiliary cross-sectional image B11 and the auxiliary cross-sectional image B12. Alternatively, the cross-sectional distance may be defined by at least one of the distance between the auxiliary cross-sectional image B11 and the target cross-sectional image B0 and the distance between the auxiliary cross-sectional image B12 and the target cross-sectional image B0. Good. Let L be the interval between the auxiliary sectional image B11 (or B12) and the target sectional image B0.

  An A scan direction (a direction indicated by an arrow pointing downward) illustrated in FIG. 2 indicates, for example, the direction of the A scan image included in the target cross-sectional image B0. This A scan image may be, for example, an A scan image located at the center of a plurality of A scan images included in the target cross-sectional image B0.

  In a typical example, the blood flow data generation unit 33 can calculate the inclination A of the blood vessel of interest in the cross section of interest based on the positional relationship between the three blood vessel regions V0, V11, and V12. This positional relationship is obtained, for example, by connecting three blood vessel regions V0, V11, and V12. More specifically, the blood flow data generation unit 33 specifies the feature points of the three blood vessel regions V0, V11, and V12 and connects these feature points. The feature points referred to here include a center position (axis position), a center of gravity position, an uppermost portion, and the like. In addition, as a method of connecting these feature points, there are a method of connecting with line segments, a method of connecting with approximate curves (spline curve, Bezier curve, etc.), and the like.

  Furthermore, the blood flow data generation unit 33 calculates the inclination A based on a line connecting these feature points. When the line segment is used, the blood flow data generation unit 33, for example, a first line segment that connects the feature point of the blood vessel region V0 in the target cross-sectional image B0 and the feature point of the blood vessel region V11 in the auxiliary cross-sectional image B11. And the slope of the second line segment connecting the feature point of the blood vessel region V0 and the feature point of the blood vessel region V12 in the auxiliary cross-sectional image B12 can be calculated. As an example of this calculation process, the average value of the slopes of two line segments can be obtained. Further, as an example of connecting with an approximate curve, the slope of the approximate curve at the intersection position of the approximate curve and the target cross section can be obtained.

  In this example, the blood vessel regions in three cross sections are considered, but the inclination can be obtained in consideration of the blood vessel regions in the two cross sections. As a specific example, the inclination A of the blood vessel of interest in the cross section of interest can be obtained based on the blood vessel region V11 in the auxiliary cross-sectional image B11 and the blood vessel region V12 in the auxiliary cross-sectional image B12. Alternatively, the inclination A of the target blood vessel in the target cross section can be obtained based on the blood vessel region V11 in the auxiliary cross-sectional image B11 and the blood vessel region V0 in the target cross-sectional image B0. For example, the inclination of the first line segment or the second line segment can be obtained and used as the inclination A of the target blood vessel.

  In the above example, only one value of the inclination A is obtained, but the inclination may be obtained for each of two or more positions (or regions) in the blood vessel region V0. In this case, two or more obtained slope values can be used separately, or one value (for example, an average value) statistically obtained from these slope values can be used as the slope A.

  In the blood flow data generation process, the blood flow data generation unit 33 relates to the target blood vessel based on the phase image formed based on the main scan (Doppler OCT) and the inclination angle obtained by the blood flow data generation unit 33. Generate blood flow data. As described above, in a typical example, blood flow data generation processing includes blood flow velocity calculation processing, blood vessel diameter calculation processing, and blood flow volume calculation processing.

  The blood flow data generation unit 33 can calculate the blood flow velocity in the target cross section of the blood flowing in the target blood vessel based on the time series change of the phase difference obtained as the phase image. The value calculated by this process may be a blood flow velocity at a certain point in time, or a time-series change in blood flow velocity (blood flow velocity change data). In the former case, for example, it is possible to selectively acquire the blood flow velocity in a predetermined time phase of the electrocardiogram (for example, the time phase of the R wave). Further, the time range in the latter is the entire time or arbitrary part of the time when the cross section of interest is scanned.

  When the blood flow velocity change data is obtained, the blood flow data generation unit 33 can calculate the statistical value of the blood flow velocity in the time range. The statistical values include an average value, standard deviation, variance, median value, maximum value, minimum value, maximum value, minimum value, and the like. It is also possible to create a histogram for blood flow velocity values.

  As described above, the blood flow data generation unit 33 can calculate the blood flow velocity using the Doppler OCT method. For example, the following relational expression is used for calculating the blood flow velocity.

Δf: Doppler shift received by scattered light of measurement light n: Refractive index of medium (blood) v: Flow velocity of medium (blood flow velocity)
θ: Angle (inclination angle) formed by the incident direction of the measurement light and the direction of flow of the medium
λ: Center wavelength of measurement light

  In a typical example, the refractive power n of the medium and the center wavelength λ of the measurement light are known, the Doppler shift Δf is obtained from the time-series change of the phase difference, and the inclination angle θ is the inclination angle calculation process or blood vessel angle distribution. Obtained from. The blood flow data generation unit 33 can calculate the blood flow velocity v by substituting these values into the relational expression.

  In the blood vessel diameter calculation process, the blood flow data generation unit 33 calculates the diameter of the target blood vessel in the target cross section. As an example of this calculation method, there are a first calculation method using a front image of the fundus and a second calculation method using a cross-sectional image.

  When the first calculation method is applied, the fundus region including the position of the cross section of interest is imaged in advance. This fundus photographing is performed by the front image acquisition unit 60, for example. Alternatively, a front image of the fundus acquired and saved in the past may be read. Further, a blood vessel emphasized image may be used.

  The blood flow data generation unit 33 is based on various factors that determine the relationship between the scale on the image and the scale in the real space, such as the imaging angle of view (imaging magnification), working distance, and information on the eyeball optical system. Set the scale in the front image. This scale represents the length in real space. As a specific example, this scale associates an interval between adjacent pixels with a scale in real space (for example, an interval between pixels = 10 μm). It is also possible to calculate in advance the relationship between various values of the above factor and the scale in the real space, and store information expressing this relationship in a table format or a graph format. In this case, a scale corresponding to the factor is selectively applied.

  The blood flow data generation unit 33 calculates the diameter of the blood vessel of interest in the cross section of interest, that is, the diameter of the blood vessel region, based on the scale and the pixels included in the blood vessel region. As a specific example, the blood flow data generation unit 33 can obtain a maximum value or an average value of diameters in various directions of the blood vessel region. Alternatively, the blood flow data generation unit 33 can approximate the outline of the blood vessel region in a circle or an ellipse, and obtain the diameter of the circle or the ellipse. Since the area of the blood vessel region can be (substantially) determined once the blood vessel diameter is determined, the area may be calculated instead of obtaining the blood vessel diameter.

  A second calculation method will be described. In the second calculation method, a cross-sectional image of the fundus in the cross section of interest is used. This cross-sectional image may be a cross-sectional image based on the main scan, or may be obtained separately. The scale in this cross-sectional image is determined according to the scanning mode of the measurement light. The length of the cross section of interest is determined based on various factors that determine the relationship between the scale on the image and the scale in the real space, such as working distance and information on the eyeball optical system. For example, the blood flow data generation unit 33 can obtain the interval between adjacent pixels based on the length of the cross section of interest, and can calculate the diameter of the blood vessel of interest in the cross section of interest in the same manner as the first calculation method.

  In the blood flow calculation process, the blood flow data generation unit 33 calculates the flow rate of blood flowing in the target blood vessel based on the blood flow velocity calculation result and the blood vessel diameter calculation result. An example of this process will be described below.

  It is assumed that the blood flow in the blood vessel is a Hagen-Poiseille flow. Further, the blood vessel diameter is set as w, and the maximum blood flow velocity is set as Vm. In this case, the blood flow rate Q is expressed by the following relational expression.

  The blood flow data generation unit 33 substitutes the blood vessel diameter w obtained by the blood vessel diameter calculation processing and the maximum value Vm in the blood flow velocity obtained by the blood flow velocity calculation processing into the above relational expression (unit: A blood flow rate Q (per hour) can be calculated.

<Operation unit 50>
The operation unit 50 is used for a user to input an instruction to the ophthalmologic photographing apparatus 1. The operation unit 50 may include a known operation device used for an ophthalmologic apparatus or a computer. For example, the operation unit 50 may include a mouse, a touch pad, a trackball, a keyboard, a pen tablet, an operation panel, a joystick, a button, a switch, and the like.

  The operation unit 50 may include a touch panel. In this case, the display control unit 13 can display a GUI for inputting instructions and information on the touch panel.

<Front image acquisition unit 60>
The front image acquisition unit 60 acquires a front image of the fundus. The process for acquiring the front image is arbitrary.

  In the first example, the front image acquisition unit 60 may include a configuration for photographing the fundus. For example, the front image acquisition unit 60 may include an optical system of an arbitrary ophthalmic modality such as an optical system of a fundus camera, an optical system of an SLO, an optical system of a slit lamp microscope, or an optical system of an ophthalmic surgical microscope.

  The front image may be an OCT front image such as a C scan image, a projection image, a shadowgram, or a blood vessel emphasized image. In this case, the front image acquisition unit 60 may be included in the OCT data acquisition unit 30 (particularly, the OCT scanner 31 and the image forming unit 32).

  Alternatively, the front image acquisition unit 60 forms a front image based on data acquired by the OCT data acquisition unit 30 (for example, data collected by the OCT scanner 31, image data formed by the image forming unit 32, etc.). A processor may be included.

  In the second example, the front image acquisition unit 60 may include a configuration for acquiring a front image of the fundus of the eye to be examined from an external device.

  For example, the front image acquisition unit 60 may include a communication interface for transmitting and receiving data via a communication line such as a LAN, the Internet, or a dedicated line. In this case, the front image acquisition unit 60 can acquire a front image of the fundus of the eye to be examined stored in, for example, an electronic medical record system or an image archiving system, using a patient ID, a DICOM tag, or the like as a search query.

  Alternatively, the front image acquisition unit 60 may include a data reader that reads data recorded in advance on a recording medium (particularly, a front image of the fundus of the eye to be examined).

<Operation>
An example of the operation of the ophthalmologic photographing apparatus 1 according to this embodiment will be described. A typical example of the operation of the ophthalmologic photographing apparatus 1 is shown in FIG. Preliminary processing such as input of patient ID, alignment of the optical system with respect to the subject's eye, focus adjustment of the optical system, OCT optical path length adjustment, fixation position adjustment, OCT scan range setting, etc. has already been performed. And

(S1: Acquire front image of fundus)
First, the control unit 10 controls the front image acquisition unit 60 to acquire a front image of the fundus of the eye to be examined. In addition, the timing which acquires a front image is not limited to this example.

  In general, arbitrary timing before OCT blood flow measurement, arbitrary timing when OCT blood flow measurement is performed, arbitrary timing between OCT blood flow measurement and OCT blood flow measurement, and OCT blood flow The fundus image can be acquired at any timing after the measurement. For example, when an image obtained by visible light imaging such as a color fundus image is used as a front image, the front image is acquired after OCT blood flow measurement in consideration of the effect of miosis by visible light. Control can be performed.

(S2: OCT blood flow measurement is applied to a plurality of blood vessel positions on the fundus)
The ophthalmologic imaging apparatus 1 applies OCT blood flow measurement to each of a plurality of blood vessel positions on the fundus of the eye to be examined. In this example, the blood vessel position is set as an attention cross section of the attention blood vessel.

  In OCT blood flow measurement, the scan control unit 11 controls a light source and an optical scanner included in the OCT scanner 31. For each of a plurality of blood vessel positions (that is, a plurality of cross sections of interest), the OCT scanner 31 repeatedly scans a first cross section that intersects the blood vessel of interest at the blood vessel positions under the control of the scan control unit 11, and performs first data. In addition, the second data is collected by scanning one or more auxiliary cross sections intersecting the target blood vessel in the vicinity of the target cross section. Note that the order of collecting the first data and the second data is arbitrary.

(S3: Form a morphological image for each blood vessel position)
For each of a plurality of blood vessel positions (that is, a plurality of cross sections of interest), the image forming unit 32 corresponds to the cross section of interest 1 based on the first data collected by repeatedly scanning the cross section of interest in step S2. The above morphological image (B-scan image) is formed. Typically, the same number of morphological images as the number of scan repetitions can be formed. Thereby, for each of the plurality of blood vessel positions, a time-series B-scan image corresponding to the blood vessel position is obtained. Note that a smaller number of morphological images than the number of scan repetitions may be formed.

  Further, for each of the plurality of blood vessel positions, the image forming unit 32 scans one or more auxiliary cross sections in step S2 and based on the second data collected, the morphological image (B Scan image).

  Each morphological image formed in step S <b> 3 is stored in the storage unit 20 as OCT data 21.

(S4: The inclination angle of the target blood vessel is obtained for each blood vessel position)
For each of a plurality of blood vessel positions (that is, a plurality of cross sections of interest), the blood flow data generation unit 33 is based on two or more morphological images among the plurality of morphological images formed in step S3 with respect to the vascular position. The inclination angle of the target blood vessel in the target cross section is obtained. In this process, for example, a combination of two morphological images corresponding to two auxiliary cross sections or a combination of a morphological image corresponding to one auxiliary cross section and a morphological image corresponding to the target cross section is used.

(S5: A phase image is formed for each blood vessel position)
For each of a plurality of blood vessel positions (that is, a plurality of cross sections of interest), the image forming unit 32 performs a phase corresponding to the cross section of interest based on the first data collected by repeatedly scanning the cross section of interest in step S2. Form an image.

  The phase image formed in step S5 is stored in the storage unit 20 as the OCT data 21.

(S6: Blood flow data is obtained for each blood vessel position)
For each of a plurality of blood vessel positions (that is, a plurality of cross sections of interest), the blood flow data generation unit 33, based on the inclination angle of the blood vessel of interest obtained in step S4 and the phase image formed in step S5, Blood flow data for a blood vessel of interest passing through the cross section of interest is generated. This blood flow data includes, for example, data representing a time series change in blood flow in the blood vessel of interest. As an example of such data, a time-series change in blood flow velocity in the measurement period of the OCT blood flow measurement performed in step S2 (typically, a period longer than one cardiac cycle), the measurement period There are time-series changes in blood flow per unit time.

  The blood flow data generated in step S6 is stored in the storage unit 20 as OCT data 21.

(S7: Create a blood flow graph for each blood vessel position)
For each of a plurality of blood vessel positions (that is, a plurality of cross sections of interest), the display control unit 13 creates a blood flow graph representing the fundus blood flow dynamics of the eye to be examined based on the blood flow data generated in step S6. . This blood flow graph represents a time-series change of blood flow in the target blood vessel in the target cross section.

The blood flow graph creation processing includes, for example, the following processing.
(1) The blood flow data (eg, blood flow velocity or blood flow per unit time) generated in step S6, the horizontal axis (first coordinate axis) indicates time t, and the vertical axis (second coordinate axis) (2) The process which connects the plotted point cloud with a line.

  Here, the value of the plotted point group (that is, the value on the vertical axis) is, for example, the value of a plurality of pixels (that is, blood values) corresponding to the cross section of the target blood vessel in the corresponding time phase (that is, the value on the horizontal axis). It may be a statistical value of a value corresponding to the magnitude of the flow velocity. The statistical value may be, for example, an average value, an intermediate value, a mode value, a maximum value, a minimum value, or the like. Alternatively, the value on the vertical axis may be a value of a predetermined pixel (for example, a pixel located at the center, a pixel located at the center of gravity, etc.) in the vascular section of interest in the corresponding time phase.

  Moreover, the process which connects the plotted point group with a line includes the process which connects the points which adjoin temporally with a line. A line connecting adjacent points may be a straight line or a curved line. When the connecting line is a curve, for example, an arbitrary approximate curve (for example, a spline curve, a Bezier curve, etc.) having a plotted point group as a control point can be applied. Further, the point cloud may be interpolated by applying Lagrange interpolation or the like.

(S8: Synchronize multiple blood flow graphs with each other)
For example, the synchronization processing unit 12 applies the above-described synchronization processing to the plurality of blood flow graphs created in step S7.

(S9: front image, measurement position information, and blood flow graph are displayed)
The display control unit 13 includes a front image of the fundus acquired in step S1, a plurality of measurement position information indicating a plurality of blood vessel positions to which the OCT blood flow measurement is applied, and a plurality of blood flow graphs created in step S7. At least one of them is displayed on the display device 2.

  The plurality of pieces of measurement position information are displayed together with the front image of the fundus. Typically, the plurality of pieces of measurement position information are displayed so as to be superimposed on the front image of the fundus. Alternatively, the plurality of pieces of measurement position information are displayed in the vicinity of the front image of the fundus.

  Several examples will be described for the association between the fundus front image and a plurality of blood vessel positions (typically, the determination of the display positions of the plurality of measurement position information in the fundus front image). Note that the method for associating the fundus front image with a plurality of blood vessel positions is not limited to the following example.

  In the first example, a plurality of blood vessel positions with respect to a predetermined fundus front image (for example, a front image acquired at step S1 or at an arbitrary timing, or an image that can be associated (registered) with the front image) And the OCT blood flow measurement in step S2 is applied to these blood vessel positions. OCT blood flow measurement for a plurality of set blood vessel positions is performed through, for example, a plurality of processes as follows: fundus observation (that is, repetitive acquisition of a front image) is performed in parallel with OCT blood flow measurement. Registration is performed between the fundus observation image obtained thereby and the predetermined fundus front image described above; each of a plurality of blood vessel positions is set to a position in the fundus observation image based on the registration result. Transform; OCT blood flow measurement is applied to the position set in the fundus observation image. In this example, for each of a plurality of blood vessel positions set for a predetermined fundus front image, blood flow data obtained by OCT blood flow measurement applied to a position corresponding to the blood vessel position is used. A based blood flow graph is associated.

  In the second example, fundus observation is performed in parallel with OCT blood flow measurement. A plurality of positions to which the OCT blood flow measurement is applied (that is, a plurality of blood vessel positions) are recorded as positions (coordinates) in a fundus observation image obtained by fundus observation. Registration between the fundus observation image and the front image of the fundus acquired in step S1 or the like is executed. Through the registration result, each of the plurality of blood vessel positions recorded together with the fundus observation image is converted into a position in the front image of the fundus. In this example, the position in the front image corresponding to the blood vessel position is associated with the blood flow graph at each of the plurality of blood vessel positions to which the OCT blood flow measurement is applied.

  An example of the information displayed in step S9 is shown in FIG. Reference numeral 110 is a front image of the fundus obtained in step S1. Reference numerals 121, 122, 123, 124, 125, and 126 correspond to a plurality of pieces of measurement position information, and indicate a plurality of blood vessel positions to which the OCT blood flow measurement is applied in step S2. That is, each of the measurement position information 121 to 126 indicates the position of the B section to which the main scan is applied. In this example, OCT blood flow measurement is applied to six blood vessel positions on the fundus.

  In this example, in step S7, six blood flow graphs 141, 142, 143, 144, 145 and 146 corresponding to the six blood vessel positions indicated by the six measurement position information 121 to 126 are created. The created six blood flow graphs 141 to 146 are synchronized with each other in step S8. Each of the blood flow graphs 141 to 146 in this example represents a time-series change in blood flow velocity (v).

  In this example, the display control unit 13 further displays related information that visually associates the six measurement position information 121 to 126 with the six blood flow graphs 141 to 146. “Visually correlating” means, for example, presenting the correspondence between the measurement position information and the blood flow graph so as to be recognizable through vision.

  The related information in this example includes common incidental information presented in the vicinity of the measurement position information and the blood flow graph corresponding to each other. Specifically, with respect to the measurement position information 121 and the blood flow graph 141 corresponding to each other, the incidental information “A” 131 is presented in the vicinity of the measurement position information 121, and the incidental information “A” 151 shared therewith is provided. Is presented in the vicinity of the blood flow graph 141.

  Similarly: for the measurement position information 122 and the blood flow graph 142 corresponding to each other, the accompanying information “B” 132 is presented in the vicinity of the measuring position information 122 and the common accompanying information “B” 152 is blood. Presented in the vicinity of the flow graph 142; for the measurement position information 123 and the blood flow graph 143 that correspond to each other, the accompanying information “C” 133 is presented in the vicinity of the measurement position information 123, and is common to this. The accompanying information “C” 153 is presented in the vicinity of the blood flow graph 143; with respect to the measurement position information 124 and the blood flow graph 144 corresponding to each other, the accompanying information “D” 134 is presented in the vicinity of the measurement position information 124. And supplementary information “D” 154 common to this is presented in the vicinity of the blood flow graph 144; the measurement position information 125 and the blood flow graph 145 corresponding to each other; Accordingly, the incidental information “E” 135 is presented in the vicinity of the measurement position information 125, and the incidental information “E” 155 in common therewith is presented in the vicinity of the blood flow graph 145; As for the information 126 and the blood flow graph 146, the accompanying information “F” 136 is presented in the vicinity of the measurement position information 126, and the accompanying information “F” 156 common to this is presented in the vicinity of the blood flow graph 146. ing.

  The incidental information 151 to 156 of this example includes alphabets, but the incidental information is not limited to this. For example, the incidental information may include other types of character strings (for example, numbers, national characters, etc.). Also, the incidental information may include image information such as marks.

  With such incidental information (related information), the user can easily grasp the correspondence between the blood vessel position to which the OCT blood flow measurement is applied (that is, the position indicated by the measurement position information) and the blood flow graph. . For example, the user can easily specify a blood flow graph obtained as a result of OCT blood flow measurement at a certain blood flow position. Conversely, the user can easily grasp which blood vessel position represents a measurement result of a certain blood flow graph. In general, the same effect can be obtained when an arbitrary number of measurement position information and an arbitrary number of blood flow graphs are displayed.

  Another example of information displayed in step S9 is shown in FIG. Reference numeral 110 is a front image of the fundus obtained in step S1. Reference numerals 161, 162, 163, 164, 165, and 166 correspond to a plurality of measurement position information, and indicate a plurality of blood vessel positions to which the OCT blood flow measurement is applied in step S2.

  Also in this example, six blood flow graphs 171, 172, 173, 174, 175 and 176 corresponding to the six blood vessel positions indicated by the six measurement position information 161 to 166 are created. The created six blood flow graphs 171 to 176 are synchronized with each other in step S8. Each of the blood flow graphs 171 to 176 in this example represents a time-series change in blood flow velocity (v).

  In this example, the display control unit 13 displays related information different from the example shown in FIG. The related information in this example is color information attached to the measurement position information 161 to 166 and the blood flow graphs 171 to 176. Specifically, the display control unit 13 displays the measurement position information and the blood flow graph corresponding to each other in a common color. For example: the measurement position information 161 and the blood flow graph 171 corresponding to each other are displayed in a common black color; the measurement position information 162 and the blood flow graph 172 corresponding to each other are displayed in a common red color; The measurement position information 163 and the blood flow graph 173 corresponding to each other are displayed in a common blue color; the measurement position information 164 and the blood flow graph 174 corresponding to each other are displayed in a common yellow color; The measurement position information 165 and the blood flow graph 175 are displayed in a common green color; the measurement position information 166 and the blood flow graph 176 corresponding to each other are displayed in a common orange color.

  Even with such incidental information (related information), the user can easily grasp the correspondence between the blood vessel position to which the OCT blood flow measurement is applied (that is, the position indicated by the measurement position information) and the blood flow graph. it can.

  An example of information display control will be described with reference to FIGS. 6A and 6B. Reference numeral 110 is a front image of the fundus obtained in step S1. Reference numerals 181, 182, 183, 184, 185, and 186 correspond to a plurality of measurement position information, and indicate a plurality of blood vessel positions to which the OCT blood flow measurement is applied in step S 2.

  Also in this example, six blood flow graphs 191, 192, 193, 194, 195 and 196 corresponding to the six blood vessel positions indicated by the six measurement position information 181 to 186 are created. The created six blood flow graphs 191 to 196 are synchronized with each other in step S8. Each of the blood flow graphs 191 to 196 in this example represents a time-series change in blood flow velocity (v).

  In this example, first, all of the blood flow graphs 191 to 196 are displayed. At this stage, any one or more of the blood flow graphs 191 to 196 may be displayed.

  The user selects desired measurement position information from the measurement position information 181 to 186 using the operation unit 50. This selection operation is, for example, an operation of clicking desired measurement position information using a pointing device such as a mouse.

  In this example, it is assumed that measurement position information corresponding to a blood flow graph already displayed on the display device 2 is selected. For example, in the example shown in FIG. 6A, since all six blood flow graphs 191 to 196 are already displayed, one of the six pieces of measurement position information 181 to 186 is selected. The case where the measurement position information corresponding to the blood flow graph not currently displayed on the display device 2 is selected will be described in the following example.

  When the user selects desired measurement position information, the display control unit 13 changes the display mode of the blood flow graph corresponding to the selected measurement position information. This control is performed, for example, by changing the display mode of the blood flow graph itself corresponding to the selected measurement position information and / or around the blood flow graph corresponding to the selected measurement position information (or in the vicinity thereof). ) Includes a control for changing the display mode.

  Examples of control for changing the display mode of the blood flow graph itself include control for changing the color of the blood flow graph, control for changing the thickness of the blood flow graph, line types of the blood flow graph (solid line, dotted line, broken line, etc.) ), A control for changing the previous concentration of the blood flow graph, and the like can be executed.

  As an example of control for changing the display mode around the blood flow graph (or the vicinity thereof), control for displaying the above-mentioned incidental information in the vicinity of the blood flow graph, control for changing the display color around the blood flow graph, It is possible to execute any one of the controls for changing the concentration around the blood flow graph.

  Along with such a change in the display mode of the blood flow graph, the display control unit 13 performs control for changing the display mode of the measurement position information selected by the user and / or surroundings of the selected measurement position information (or Control for changing the display mode in the vicinity thereof may be executed. The change of the display mode related to the measurement position information is performed, for example, in the same manner as the change of the display mode related to the blood flow graph.

  For example, the display control unit 13 changes the display color of the selected measurement position information and the display color of the blood flow graph corresponding thereto to the same color. FIG. 6B shows an example in which the user selects the measurement position information 182 and the display control unit 13 changes the display mode of the measurement position information 182 and the display mode of the blood flow graph 192 corresponding thereto.

  In another example, the display control unit 13 displays the same additional information in the vicinity of the selected measurement position information and the vicinity of the blood flow graph corresponding to the selected measurement position information.

  According to such display control, the user can select a desired blood vessel position (that is, the position indicated by the measurement position information), and further, the correspondence between the selected blood vessel position and the blood flow graph is easy. Can grasp.

  An example of information display control will be described with reference to FIGS. 7A and 7B. Reference numeral 110 is a front image of the fundus obtained in step S1. Reference numerals 201, 202, 203, 204, 205, and 206 correspond to a plurality of measurement position information, and indicate a plurality of blood vessel positions to which the OCT blood flow measurement is applied in step S2.

  Also in this example, six blood flow graphs 211, 212, 213, 214, 215, and 216 corresponding to the six blood vessel positions indicated by the six measurement position information 201 to 206 are created. The created six blood flow graphs 211 to 216 are synchronized with each other in step S8. Each of the blood flow graphs 211 to 216 in this example represents a time-series change in blood flow velocity (v).

  In the stage shown in FIG. 7A, none of the blood flow graphs 191 to 196 is displayed. At this stage, a part of the blood flow graphs 191 to 196 may be displayed.

  The user selects desired measurement position information from the measurement position information 201 to 206 using the operation unit 50. This selection operation is, for example, an operation of clicking desired measurement position information using a pointing device such as a mouse. In this example, it is assumed that measurement position information corresponding to a blood flow graph that is not displayed on the display device 2 is selected at the stage of the selection operation. For example, in the example shown in FIG. 7A, since none of the six blood flow graphs 211 to 216 is displayed, one of the six pieces of measurement position information 201 to 206 is selected. In addition, the case where the measurement position information corresponding to the blood flow graph already displayed on the display device 2 is selected has been described in the example illustrated in FIGS. 6A and 6B.

  When the user selects desired measurement position information, the display control unit 13 causes the display device 2 to display a blood flow graph corresponding to the selected measurement position information. Along with such display control of the blood flow graph, the display control unit 13 controls to change the display mode of the measurement position information selected by the user and / or around (or in the vicinity of) the selected measurement position information. ) May be executed to change the display mode.

  In FIG. 7B, the user selects the measurement position information 202 and 204, the display control unit 13 changes the display mode of the measurement position information 202 and 204, and displays the blood flow graphs 212 and 204 corresponding thereto. An example of the case is shown.

  In this example, the display control unit 13 may display the related information described above that visually associates each selected measurement position information with the blood flow graph corresponding to the selected measurement position information.

  According to such display control, the user can select a desired blood vessel position (that is, the position indicated by the measurement position information) and observe the blood flow graph. Furthermore, the user can easily grasp the correspondence between the selected blood vessel position and the blood flow graph.

  An example of information display control will be described with reference to FIG. In this example, it is assumed that the blood flow parameter is a blood flow volume per unit time, and the blood flow graph represents a time-series change in the blood flow volume per unit time.

  In this case, the display control unit 13 uses a plurality of blood vessel positions to which the OCT blood flow measurement is applied based on a plurality of blood flow data corresponding to the plurality of blood vessel positions to which the OCT blood flow measurement is applied. A total blood flow graph representing a time-series change in blood flow per unit time at any two of the blood vessel positions) can be displayed. In other words, the display control unit 13 can display a time-series change in a value calculated from two or more blood flow volumes acquired for two or more blood vessel positions. This value may be any statistical value that can be calculated from two or more blood flows. This statistical value is, for example, the sum of two or more blood flows (total blood flow), an average value of two or more blood flows (average blood flow), two or more blood flow variations (standard deviation, variance, etc.), 2 It may be the maximum value or the minimum value of the above blood flow. In addition, when the sum of a plurality of blood flows corresponding to all of a plurality of blood vessel positions to which OCT blood flow measurement is applied is calculated, a time series change of the total blood flow is obtained as a blood flow parameter, and is calculated for a predetermined period. The total blood flow is obtained by integrating over.

  An example of information displayed in this example is shown in FIG. Similar to the example shown in FIG. 4, in this example, the front image 110 of the fundus, a plurality of pieces of measurement position information 221, 222, 223, 224, 225, and 226, and a plurality of blood flow graphs 241, 242, 243, 244 245 and 246 are displayed. Further, as in the example shown in FIG. 4, related information that associates the plurality of measurement position information 221 to 246 with the plurality of blood flow graphs 241 to 246 is displayed. Specifically, the related information includes a plurality of incidental information groups 231, 232, 233, 234, 235 and 236 displayed in the vicinity of each of the plurality of measurement position information 221, 222, 223, 224, 225 and 226, Blood flow graphs 241, 242, 243, 244, 245, and 246, and accompanying information groups 251, 252, 253, 254, 255, and 256, which are displayed in the vicinity.

  However, unlike the blood flow graphs 141 to 146 shown in FIG. 4, each of the blood flow graphs 241 to 246 in this example represents a time-series change in the blood flow rate Q per unit time.

  When the blood flow parameter is a blood flow volume per unit time as in this example, the display control unit 13 includes a plurality of blood flows corresponding to a plurality of blood vessel positions (that is, positions indicated by the plurality of measurement position information 221 to 226). Based on the data (for example, a plurality of blood flow graphs 241 to 246), a total blood flow graph 240 representing a time series change of the sum of blood flow per unit time at a plurality of blood vessel positions can be displayed. As described above, a graph (statistical value graph) representing a time-series change of an arbitrary statistical value such as the average blood flow rate may be displayed.

  In the example shown in FIG. 8, the total blood flow graph 240 is displayed together with the blood flow graphs 241 to 246, but the display mode of the statistical value graph is not limited to this. For example, a statistical value graph may be displayed together with one or more graphs of a plurality of blood flow graphs, or only a statistical value graph may be displayed.

  Information indicating the contribution of each blood flow graph (or any two or more blood flow graphs) in the statistical value graph can be displayed. For example, information indicating the contribution to the total blood flow as a percentage can be displayed in the vicinity of each blood flow graph and / or in the vicinity of each measurement position information. In addition, information indicating the magnitude of the contribution to the statistical value can be displayed. For example, the display color of each blood flow graph and / or the display color of each measurement position information can be set according to the size of the contribution to the total blood flow.

  In order to compare two or more blood flow data (such as a blood flow graph), vibration analysis is applied to each of the blood flow data, and the result can be expressed as a graph. For the vibration analysis, for example, complex Fourier transform or fast Fourier transform can be used. The vibration analysis graph is configured such that, for example, the horizontal axis indicates a vibration mode (frequency mode) and the vertical axis indicates amplitude or intensity. In addition to or instead of the blood flow graph described above, a vibration analysis graph can be displayed. It is also possible to analyze the vibration analysis graph to determine the number of vibration modes and the strength (amplitude) of each vibration mode, and to compare between two or more vibration analysis graphs.

  Another example of information display control will be described. In this example, the display control unit 13 changes the display color of the blood vessel image (blood vessel region) in the front image of the fundus according to the blood flow data (or a blood flow graph based on the blood flow data) obtained by OCT blood flow measurement. Control. As a result, it is possible to obtain an image like a thermography representing the distribution of blood flow dynamics in the fundus of the eye to be examined.

  Further, the display control unit 13 displays the display colors of the plurality of blood vessel images in the front image of the fundus in time series based on the time series change of the blood flow parameter in the blood flow data (or the blood flow graph based on the blood flow data). Can be changed. As a result, a time-series image such as dynamic thermography representing a time-series change in the distribution of blood flow dynamics in the fundus of the subject's eye is obtained.

  In order to display such an image, for example, the ophthalmologic photographing apparatus 1 stores in advance a look-up table (LUT) in which blood flow parameter values are associated with display colors.

  For example, the display control unit 13 identifies an image of a blood vessel corresponding to blood flow data (or a blood flow graph based on the blood flow data) (that is, a blood vessel to which OCT blood flow measurement for creating the blood flow graph is applied). To do. Thereby, a blood vessel image corresponding to blood flow data (or a blood flow graph based on the blood flow data) is specified. This specific processing includes arbitrary image processing such as threshold processing, edge detection, region growing, and labeling. Thereby, a connected image region (blood vessel image) corresponding to each blood vessel is specified.

  In specifying the connected image region, the intersection of blood vessels can be considered. For example, the intersection of blood vessels can be detected from a change in blood vessel diameter determined from a fundus front image or an angiogram (motion contrast image). It is also possible to detect the intersection of blood vessels from a three-dimensional angiogram.

  The display control unit 13 determines the display color of the corresponding blood vessel image based on each of the plurality of blood flow data (or a blood flow graph based thereon) and a lookup table. More specifically, the display control unit 13 specifies a display color corresponding to a value indicated by blood flow data (or a blood flow graph based thereon) from the lookup table.

  In some cases, two or more blood vessel positions are set for a single blood vessel. That is, two or more blood vessel positions may be set for the same blood vessel. In such a case, one blood vessel image can be divided into two or more partial images, and the display color can be determined for each partial image. In addition, a change in the value of a blood flow parameter between two blood vessel positions can be estimated from two blood flow data (or two blood flow graphs based on the two blood flow data) at two different blood vessel positions. Furthermore, a display color corresponding to the estimated value that changes intermittently or continuously obtained in this way can be determined based on a lookup table.

  The same estimation process can be applied to any blood vessel regardless of the set number of blood vessel positions. The estimation process in this case is executed based on various morphological parameters related to the blood vessel, such as a change in the blood vessel diameter, the length of the blood vessel, the position of the branch, and the number of branches.

  According to such information display control, the user can intuitively grasp the blood flow parameter distribution.

  Still another example of information display control will be described. In this example, the fundus artery and vein are displayed in different colors. A configuration example for this is shown in FIG. FIG. 9 shows the control unit 10A. For example, the control unit 10A is applied instead of the control unit 10 of FIG. The control unit 10 </ b> A includes a blood vessel classification unit 14. Based on a plurality of blood flow data corresponding to a plurality of blood vessel positions (or a plurality of blood flow graphs based thereon), the blood vessel classification unit 14 converts a plurality of blood vessel images drawn in the front image of the fundus into an artery. The image is classified into a corresponding image (arterial image) and an image corresponding to a vein (vein image).

  The processing executed by the blood vessel classification unit 14 is determined according to the type of image to be analyzed, for example. The blood vessel classification unit 14 may be configured to switch processing to be executed according to the type of image to be analyzed (for example, the type of modality). Hereinafter, examples of blood vessel classification (arterial / venous determination) will be described, but the present invention is not limited to these.

  When the image to be analyzed is a fundus photograph, the blood vessel classification unit 14 can execute arterial / vein determination based on, for example, the brightness of the axial portion of the blood vessel image (enhanced blood column reflexes). .

  When the image to be analyzed is a phase image obtained by OCT blood flow measurement, the blood vessel classification unit 14 can execute arterial / vein determination based on blood flow dynamics and the direction of blood flow. For example, the arterial / vein determination can be performed based on the shape (amplitude, wave height, average value, maximum value, minimum value, frequency, wavelength, etc.) of the blood flow graph. Further, based on the determination result regarding one blood vessel, the direction of blood flow in the one blood vessel, and the direction of blood flow in the other blood vessel, the arterial / vein determination of the other blood vessel can be performed.

  The display control unit 13 displays the arterial image and the vein image classified by the blood vessel classification unit 14 in different colors. For example, the arterial image can be displayed in red and the vein image can be displayed in blue.

  According to such information display control, the user can intuitively distinguish the fundus artery and vein. Furthermore, it is possible to easily grasp the arterial blood flow dynamics and the venous blood flow dynamics.

  Another example will be described. For the arterial image, a warm color lookup table corresponding to blood flow data (or a blood flow graph based on the blood flow data) is set in advance. Further, a cold color look-up table corresponding to blood flow data (or a blood flow graph based on the blood flow data) is set in advance for the vein image.

  For each classified arterial image, the display control unit 13 determines the display color of the arterial image based on the blood flow data (or a blood flow graph based on the blood flow data) and a warm color lookup table. Moreover, the display control unit 13 determines the display color of the vein image for each classified vein image based on the blood flow data (or a blood flow graph based on the blood flow data) and a cold color lookup table. Further, the display control unit 13 displays the arterial image and the vein image with the determined display colors.

  The ophthalmologic imaging apparatus 1 and the modifications described above are basically configured to be able to perform both acquisition of a fundus front image (fundus imaging) and OCT blood flow measurement. On the other hand, the ophthalmologic imaging apparatus according to the embodiment may be capable of executing only one of front image acquisition (fundus imaging) and OCT blood flow measurement.

  A case where the front image is acquired from the outside will be described. In this example, the fundus front image is a color fundus image, monochrome fundus image, fluorescent fundus image, OCT cross-sectional image (C scan image), OCT projection image, OCT shadowgram, and OCT blood vessel, as in the above embodiment. It may be one of the emphasized images. Alternatively, the fundus front image of this example may be an image acquired by fundus fluorescence contrast (for example, fluorescein fluorescence contrast, indocyanine green fluorescence contrast, spontaneous fluorescence contrast, etc.).

  FIG. 10 shows a configuration example of the ophthalmologic photographing apparatus according to this example. Similar to the ophthalmologic photographing apparatus 1 of the above embodiment, the ophthalmic photographing apparatus 1A applies OCT blood flow measurement to each of a plurality of blood vessel positions on the fundus of the eye to be examined, and a plurality of corresponding to a plurality of blood vessel positions. Blood flow data can be acquired. Further, unlike the above embodiment, the ophthalmologic photographing apparatus 1A includes a front image receiving unit 70 that receives a front image of the fundus from the outside. The front image receiving unit 70 may include, for example, a communication interface for performing data communication with an external device, a device for reading data from a recording medium, and the like. Each component other than the front image receiving unit 70 may be the same as the corresponding component in the ophthalmologic photographing apparatus 1.

  On the other hand, an example of an ophthalmologic photographing apparatus configured to acquire blood flow data from the outside is shown in FIG. The ophthalmologic imaging apparatus 1B includes a front image acquisition unit 60 that acquires a front image of the fundus of the eye to be examined, similarly to the ophthalmologic imaging apparatus 1 of the above embodiment. The ophthalmologic photographing apparatus 1B includes a blood flow data receiving unit 80, unlike the above embodiment. The blood flow data receiving unit 80 receives a plurality of blood flow data corresponding to a plurality of blood vessel positions obtained by applying OCT blood flow measurement to each of a plurality of blood vessel positions on the fundus of the eye to be examined. The blood flow data receiving unit 80 may include, for example, a communication interface for performing data communication with an external device, a device for reading data from a recording medium, and the like. Each component other than the blood flow data receiving unit 80 may be the same as the corresponding component in the ophthalmologic photographing apparatus 1.

  In the embodiment shown in FIGS. 10 and 11, for example, the display control unit 13 performs registration between an OCT projection image (or a frame of a fundus observation image) and a front image, and this registration. Using this result, the association between the blood vessel position (that is, the display position of the measurement position information) and the blood flow graph may be executed.

<Ophthalmologic information processing device>
An ophthalmologic information processing apparatus according to an exemplary embodiment will be described. A configuration example of the ophthalmologic information processing apparatus of the present embodiment is shown in FIG. The ophthalmologic information processing apparatus 300 stores fundus data acquired using OCT, and displays various information based on the stored data.

  The ophthalmologic information processing apparatus 300 can display various information such as a fundus front image, blood flow information, and a blood vessel emphasized image on the display device 2. The display device 2 may be a part of the ophthalmologic information processing apparatus 300, or may be an external device connected to the ophthalmologic information processing apparatus 300. The ophthalmologic information processing apparatus 300 can send various types of information to a computer, a storage device, an ophthalmologic apparatus, and the like.

  The ophthalmologic information processing apparatus 300 includes a control unit 310, a storage unit 320, a data processing unit 330, a data input unit 340, and an operation unit 350. The control unit 310 includes a synchronization processing unit 312 and a display control unit 213. The storage unit 320 stores at least OCT data 321. The storage unit 320 may store a front image such as a fundus photograph. If the front image is an OCT image, the front image is included in the OCT data 321.

  Each element of the ophthalmologic information processing apparatus 300 has, for example, the same configuration and function as the corresponding element in the ophthalmologic photographing apparatus 1 described above. That is, the control unit 310 has the same configuration and function as the control unit 10, the synchronization processing unit 312 has the same configuration and function as the synchronization processing unit 12, and the display control unit 313 is the same as the display control unit 13. The storage unit 320 has the same configuration and function as the storage unit 20, and the operation unit 350 has the same configuration and function as the operation unit 50.

The OCT data 321 may be data in the same form as the OCT data 21. For example, the OCT data 321 may include one or more of the following (1) to (5).
(1) Data collected by OCT scan of the fundus (raw data)
(2) Image data obtained by processing raw data (3) Intermediate data obtained during a series of processes for generating image data from raw data (4) Obtained by processing raw data Blood flow data (5) Intermediate data obtained in the middle of a series of processes for generating blood flow data from raw data

  The data processing unit 330 executes various data processing. The data processing unit 330 may have the same configuration and function as at least a part of the image forming unit 32. The data processing unit 330 may have the same configuration and function as at least a part of the blood flow data generation unit 33.

  The data input unit 340 inputs the OCT data 321 and / or the data that is the basis thereof to the ophthalmologic information processing apparatus 300 from the outside. When the frontal image of the fundus is not an OCT image (for example, when the frontal image is a fundus photograph), the data input unit 340 displays the frontal image of the fundus separately from the OCT data 321 and / or the original data. Input to the ophthalmologic information processing apparatus 300 from the outside. The data input unit 340 may include, for example, a communication interface for performing data communication with an external device, a device that reads data from a recording medium, and the like.

  The display control unit 313 performs the following display control: displays a front image; displays a plurality of measurement position information indicating a plurality of blood vessel positions to which OCT blood flow measurement is applied, together with the front image; Based on at least one of the data, at least one blood flow graph, each representing a time-series change of a predetermined blood flow parameter, is displayed in parallel with the front image.

  In the embodiment shown in FIG. 12, for example, the display control unit 313 performs registration between the OCT projection image (or the frame of the fundus observation image) and the front image, and uses the result of this registration. Then, the association between the blood vessel position (that is, the display position of the measurement position information) and the blood flow graph may be executed.

<Action and effect>
Operations and effects of the ophthalmologic photographing apparatus and the ophthalmologic information processing apparatus according to the above exemplary embodiment will be described.

  In the exemplary embodiment, the ophthalmic imaging apparatus (1) includes a blood flow data acquisition unit (OCT data acquisition unit 30), a front image acquisition unit (60), and a display processing unit (such as the display control unit 13). Including. The blood flow data acquisition unit applies OCT blood flow measurement to the fundus of the eye to be examined, and acquires a plurality of blood flow data corresponding to a plurality of blood vessel positions. The front image acquisition unit acquires a front image of the fundus of the eye to be examined. The display processing unit displays information on the display means (display device 2).

  Specifically, the display processing unit displays the front image (110) acquired by the front image acquisition unit. Further, the display processing unit displays a plurality of pieces of measurement position information (121 to 126, etc.) indicating a plurality of blood vessel positions to which the OCT blood flow measurement is applied together with the front image. In addition, the display processing unit displays at least one blood flow graph (such as 141 to 146) each representing a time-series change of a predetermined blood flow parameter based on at least one of the plurality of blood flow data. Display in parallel with the front image.

  In another exemplary embodiment, the ophthalmologic imaging apparatus (1A) includes a blood flow data acquisition unit (OCT data acquisition unit 30), a front image reception unit (70), and a display processing unit (such as the display control unit 13). Including. The blood flow data acquisition unit applies OCT blood flow measurement to the fundus of the eye to be examined, and acquires a plurality of blood flow data corresponding to a plurality of blood vessel positions. The front image receiving unit receives a front image of the fundus of the eye to be examined from the outside. The display processing unit displays information on the display means (display device 2).

  Specifically, the display processing unit displays the front image received by the front image receiving unit. Further, the display processing unit displays a plurality of measurement position information indicating a plurality of blood vessel positions to which the OCT blood flow measurement is applied together with the front image. In addition, based on at least one of the plurality of blood flow data, the display processing unit displays at least one blood flow graph, each representing a time-series change of a predetermined blood flow parameter, in parallel with the front image. Display.

  In still another exemplary embodiment, the ophthalmologic imaging apparatus (1B) includes a blood flow data receiving unit (80), a front image acquisition unit (60), and a display processing unit (such as the display control unit 13). . The blood flow data receiving unit receives a plurality of blood flow data corresponding to a plurality of blood vessel positions acquired by applying OCT blood flow measurement to each of a plurality of blood vessel positions on the fundus of the eye to be examined. The front image acquisition unit acquires a front image of the fundus of the eye to be examined. The display processing unit displays information on the display means (display device 2).

  Specifically, the display processing unit displays the front image acquired by the front image acquisition unit. Further, the display processing unit displays a plurality of measurement position information indicating a plurality of blood vessel positions to which the OCT blood flow measurement is applied together with the front image. In addition, based on at least one of the plurality of blood flow data, the display processing unit displays at least one blood flow graph, each representing a time-series change of a predetermined blood flow parameter, in parallel with the front image. Display.

  According to these embodiments, the user can grasp the position where the OCT blood flow measurement is applied from the measurement position information displayed together with the front image, and further grasp the blood flow dynamics at the position from the blood flow graph. Can do. In particular, according to these embodiments, a plurality of blood flow information obtained by applying OCT blood flow measurement to a plurality of blood vessels in the fundus of the eye to be examined can be presented in a suitable manner. Accordingly, diagnosis and screening based on blood flow information of a plurality of fundus blood vessels can be facilitated, and accuracy and accuracy of diagnosis and screening can be improved.

  In the embodiment, the display processing unit may be configured to display a plurality of blood flow graphs corresponding to a plurality of blood vessel positions to which OCT blood flow measurement is applied in parallel.

  According to such a configuration, it is possible to support comprehensive grasp of the blood flow dynamics of the fundus from a plurality of blood flow graphs corresponding to a plurality of blood vessel positions.

  The display processing unit selectively selects one or more blood flow graphs (and two or more blood flow graphs) from among a plurality of blood flow graphs corresponding to a plurality of blood vessel positions to which OCT blood flow measurement is applied. (In parallel).

  In the embodiment, the display processing unit visually displays each of at least one blood flow graph displayed on the display unit and measurement position information indicating a blood vessel position corresponding to the blood flow graph (or these). The related information to be associated may be displayed.

  According to such a configuration, the user can easily grasp the correspondence between the blood vessel position on the fundus and the blood flow graph by referring to the related information.

  In the embodiment, the display processing unit may be configured to display common incidental information in the vicinity of the measurement position information and the blood flow graph corresponding to each other as the related information.

  According to such a configuration, the user can easily determine the correspondence between the blood vessel position on the fundus and the blood flow graph by referring to the common incidental information given to the measurement position information and the blood flow graph. It is possible to grasp.

  In the embodiment, the display processing unit may be configured to display the measurement position information and the blood flow graph corresponding to each other as related information in a common color.

  According to such a configuration, the user can easily grasp the correspondence between the blood vessel position on the fundus and the blood flow graph by referring to the display color of the measurement position information and the display color of the blood flow graph. Is possible.

  The ophthalmologic photographing apparatus according to an exemplary embodiment may further include an operation unit. Furthermore, the display processing unit may be configured to display a blood flow graph corresponding to the selected measurement position information when any of the plurality of measurement position information is selected using the operation unit.

  According to such a configuration, the user can observe the blood flow graph at the blood vessel position only by designating the desired blood vessel position on the fundus of the subject's eye. Thereby, it is possible to facilitate and smooth the work for diagnosis and screening.

  The ophthalmologic photographing apparatus according to an exemplary embodiment may further include an operation unit. Further, the display processing unit selects blood corresponding to the selected measurement position information when measurement position information corresponding to the blood flow graph already displayed is selected from the plurality of measurement position information using the operation unit. The display mode of the flow graph may be changed.

  According to such a configuration, the user can easily specify the blood flow graph at the blood vessel position only by designating the desired blood vessel position on the fundus of the eye to be examined. Thereby, it is possible to facilitate and smooth the work for diagnosis and screening.

  In the embodiment, the blood flow graph is represented by a two-dimensional orthogonal coordinate system in which the first coordinate axis indicates time, and the second coordinate axis indicates a blood flow parameter of either blood flow velocity or blood flow rate per unit time. It may be constituted as follows.

  According to such a configuration, a time series change in blood flow velocity and a time series change in blood flow per unit time can be presented as a graph. Thereby, the user can easily grasp the time series change of the blood flow velocity and the time series change of the blood flow per unit time.

  In the embodiment, when the blood flow parameter is a blood flow rate per unit time, the display processing unit is a total blood that represents a time-series change in the blood flow rate per unit time at a plurality of blood vessel positions based on a plurality of blood flow data. It may be configured to display a flow rate graph.

  According to such a configuration, it is possible to grasp not only the blood flow dynamics of a plurality of blood vessels but also the integrated blood flow dynamics of a plurality of blood vessels.

  The ophthalmologic imaging apparatus according to the exemplary embodiment may further include a synchronization processing unit that synchronizes at least one of the plurality of blood flow data and the plurality of blood flow graphs corresponding thereto.

  According to the configuration in which a plurality of blood flow data corresponding to a plurality of blood vessel positions are synchronized, various processes can be executed using a plurality of synchronized blood flow data, so that the accuracy and accuracy of diagnosis and screening are improved. Can be achieved. According to the configuration in which a plurality of blood flow graphs are synchronized, a plurality of blood flow graphs whose positions in the time series direction are adjusted can be displayed, so that it is possible to improve accuracy and accuracy of diagnosis and screening. Become.

  The ophthalmologic imaging apparatus according to the exemplary embodiment may further include a reception unit (data input unit 40). The data input unit 40 receives the biological information of the subject that changes in time series from the biological information monitor when the blood flow data acquisition unit applies OCT blood flow measurement to a plurality of blood vessel positions. Furthermore, the synchronization processing unit may be configured to synchronize at least one of the plurality of blood flow data and the plurality of blood flow graphs corresponding to each other based on the biological information received by the reception unit.

  According to such a configuration, synchronization processing for at least one of the plurality of blood flow data and the plurality of blood flow graphs corresponding thereto can be executed based on the biological information of the subject. By referring to the biological information of the subject in this way, it is possible to improve the accuracy and accuracy of the synchronization process.

  In the embodiment, the synchronization processing unit extracts feature values from each of the plurality of blood flow data, and outputs at least one of the plurality of blood flow data and the plurality of blood flow graphs corresponding to the extracted blood flow data based on the extracted feature values. It may be configured to synchronize with each other.

  According to such a configuration, synchronization processing for at least one of the plurality of blood flow data and the plurality of blood flow graphs corresponding thereto can be executed based on the feature value of the blood flow data. By referring to the characteristic value of the blood flow data in this way, it is possible to improve the accuracy and accuracy of the synchronization process.

  In the embodiment, the synchronization processing unit may be configured to synchronize at least one of the plurality of blood flow data and the plurality of blood flow graphs corresponding thereto based on the waveforms of the plurality of blood flow graphs.

  According to such a configuration, synchronization processing for at least one of the plurality of blood flow data and the plurality of blood flow graphs corresponding thereto can be executed based on the waveform of the blood flow graph. By referring to the waveform of the blood flow graph in this way, it is possible to improve the accuracy and accuracy of the synchronization process.

  In the embodiment, the display processing unit is configured to color-display a plurality of blood vessel images in a front image corresponding to a plurality of blood vessel positions based on a plurality of blood flow data or a plurality of blood flow graphs corresponding thereto. May have been.

  According to such a configuration, the user can intuitively grasp the distribution state of the blood flow dynamics in the fundus of the eye to be examined by referring to the display colors of the plurality of blood vessel images.

  In the embodiment, the display processing unit is configured to change the display colors of the plurality of blood vessel images in time series based on the time series change of the blood flow parameters in the plurality of blood flow data or the plurality of blood flow graphs. It may be.

  According to such a configuration, the user can intuitively understand the time-series change in the distribution state of the blood flow dynamics in the fundus of the eye to be examined by referring to the time-series change in the display colors of the plurality of blood vessel images. It becomes possible to grasp.

  The ophthalmologic imaging apparatus according to the exemplary embodiment may further include a blood vessel classification unit (14). The blood vessel classification unit classifies a plurality of blood vessel images into an arterial image and a vein image based on a plurality of blood flow data or a plurality of blood flow graphs. Further, the display processing unit may be configured to display the arterial image and the vein image in different colors.

  According to such a configuration, the user can intuitively determine the artery and vein distributed in the fundus of the eye to be examined. Furthermore, it is possible to easily grasp the arterial blood flow dynamics and the venous blood flow dynamics.

  In the embodiment, the front image is any one of a color fundus image, a monochrome fundus image, a fluorescent fundus image, an OCT cross-sectional image (C scan image), an OCT projection image, an OCT shadowgram, and an OCT blood vessel enhancement image. Good.

  The ophthalmologic information processing apparatus (300) according to an exemplary embodiment includes a storage unit (320) and a display control unit (313). The storage unit stores a plurality of blood flow data corresponding to a plurality of blood vessel positions obtained by applying OCT blood flow measurement to each of a plurality of blood vessel positions on the fundus of the eye to be examined, and a front image of the fundus. To do. The display control unit displays information on the display means (display device 2).

  Specifically, the display processing unit displays the front image (110). Further, the display processing unit displays a plurality of pieces of measurement position information (121 to 126, etc.) indicating a plurality of blood vessel positions to which the OCT blood flow measurement is applied together with the front image. In addition, the display processing unit displays at least one blood flow graph (such as 141 to 146) each representing a time-series change of a predetermined blood flow parameter based on at least one of the plurality of blood flow data. Display in parallel with the front image.

  According to such an embodiment, the user can grasp the position where the OCT blood flow measurement is applied from the measurement position information displayed together with the front image, and further grasp the blood flow dynamics at the position from the blood flow graph. be able to. In particular, according to such an embodiment, it is possible to present a plurality of blood flow information obtained by applying OCT blood flow measurement to a plurality of blood vessels in the fundus of the eye to be examined in a suitable manner. Accordingly, diagnosis and screening based on blood flow information of a plurality of fundus blood vessels can be facilitated, and accuracy and accuracy of diagnosis and screening can be improved.

  For the ophthalmologic information processing apparatus according to the embodiment, the ophthalmologic photographing apparatus 1, 1A, or 1B described above, or any item described as a modification thereof can be applied.

  The operations and effects of the embodiments are not limited to these, and the operations and effects provided by the respective items described as the embodiments and the operations and effects provided by a combination of a plurality of items should be considered. In addition, any of the above-described embodiments, other embodiments, known techniques, and the like can be arbitrarily combined in order to obtain a desired action and / or effect, or for other purposes.

  The configuration described above is merely an example for favorably implementing the present invention. Therefore, arbitrary modifications (omitted, replacement, addition, etc.) within the scope of the present invention can be made as appropriate.

DESCRIPTION OF SYMBOLS 1, 1A, 1B Ophthalmic imaging device 2 Display device 10 Control part 11 Scan control part 12 Synchronization processing part 13 Display control part 14 Blood vessel classification part 20 Storage part 21 OCT data 30 OCT data acquisition part 31 OCT scanner 32 Image formation part 33 Blood Flow data generation unit 40 Data input unit 50 Operation unit 60 Front image acquisition unit 70 Front image reception unit 80 Blood flow data reception unit 110 Front images 121, 122, 123, 124, 125, 126 Measurement position information 131, 132, 133, 134, 135, 136 Attached information 141, 142, 143, 144, 145, 146 Blood flow graphs 151, 152, 153, 154, 155, 156 Attached information 300 Ophthalmic information processing device 310 Control unit 312 Synchronization processing unit 313 Display control unit 320 storage unit 321 OCT data 330 data processing unit 34 Data input unit 350 operation unit

Claims (20)

A blood flow data acquisition unit that applies optical coherence tomography (OCT) blood flow measurement to each of a plurality of blood vessel positions on the fundus of the subject eye, and acquires a plurality of blood flow data corresponding to the plurality of blood vessel positions. When,
A front image acquisition unit for acquiring a front image of the fundus;
A display processing unit for displaying information on the display means,
The display processing unit
Displaying the front image acquired by the front image acquisition unit;
A plurality of measurement position information indicating the plurality of blood vessel positions to which OCT blood flow measurement is applied are displayed together with the front image;
Based on at least one of the plurality of blood flow data, at least one blood flow graph each representing a time-series change of a predetermined blood flow parameter is displayed in parallel with the front image.
Ophthalmic photography device. The display processing unit can display in parallel a plurality of blood flow graphs corresponding to the plurality of blood vessel positions to which OCT blood flow measurement is applied.
The ophthalmologic photographing apparatus according to claim 1. The display processing unit displays related information that visually associates each of the at least one blood flow graph displayed on the display unit with measurement position information indicating a blood vessel position corresponding to the blood flow graph. ,
The ophthalmologic photographing apparatus according to claim 1 or 2. The display processing unit displays, as the related information, common incidental information in the vicinity of the measurement position information and the blood flow graph corresponding to each other,
The ophthalmologic photographing apparatus according to claim 3. The display processing unit displays the measurement position information and the blood flow graph corresponding to each other as the related information in a common color,
The ophthalmologic photographing apparatus according to claim 3 or 4. Including the operation part,
When any one of the plurality of measurement position information is selected using the operation unit, the display processing unit displays a blood flow graph corresponding to the selected measurement position information.
The ophthalmologic photographing apparatus according to any one of claims 1 to 5. Including the operation part,
When measurement position information corresponding to a blood flow graph that has already been displayed is selected using the operation unit, the display processing unit selects blood corresponding to the selected measurement position information. Change the display mode of the flow graph,
The ophthalmologic photographing apparatus according to any one of claims 1 to 5. The blood flow graph is expressed by a two-dimensional orthogonal coordinate system in which the first coordinate axis indicates time and the second coordinate axis indicates a blood flow parameter of any one of blood flow velocity and blood flow per unit time.
The ophthalmologic photographing apparatus according to any one of claims 1 to 7. When the blood flow parameter is a blood flow volume per unit time, the display processing unit represents a total blood flow volume representing a time-series change in the blood flow volume per unit time at the plurality of blood vessel positions based on the plurality of blood flow data. Display a graph,
The ophthalmologic photographing apparatus according to claim 8. A synchronization processor for synchronizing at least one of the plurality of blood flow data and a plurality of blood flow graphs corresponding to the plurality of blood flow data;
The ophthalmologic photographing apparatus according to any one of claims 1 to 9. When the blood flow data acquisition unit applies OCT blood flow measurement to the plurality of blood vessel positions, the blood flow data acquisition unit includes a reception unit that receives the biological information of the subject that changes in time series from the biological information monitor,
The synchronization processing unit synchronizes at least one of the plurality of blood flow data and a plurality of blood flow graphs corresponding to the plurality of blood flow data based on the biological information received by the reception unit,
The ophthalmologic photographing apparatus according to claim 10. The synchronization processing unit extracts a feature value from each of the plurality of blood flow data, and at least one of the plurality of blood flow data and a plurality of blood flow graphs corresponding to each other based on the extracted feature value. Synchronize,
The ophthalmologic photographing apparatus according to claim 10. The synchronization processing unit synchronizes at least one of the plurality of blood flow data and a plurality of blood flow graphs corresponding to the plurality of blood flow data based on waveforms of the plurality of blood flow graphs;
The ophthalmologic photographing apparatus according to claim 10. The display processing unit color-displays a plurality of blood vessel images in the front image corresponding to the plurality of blood vessel positions based on the plurality of blood flow data or a plurality of blood flow graphs corresponding thereto.
The ophthalmologic photographing apparatus according to any one of claims 1 to 13. The display processing unit changes the display color of the plurality of blood vessel images in time series based on the time series change of blood flow parameters in the plurality of blood flow data or the plurality of blood flow graphs.
The ophthalmologic photographing apparatus according to claim 14. A blood vessel classification unit for classifying the plurality of blood vessel images into arterial images and vein images based on the plurality of blood flow data or the plurality of blood flow graphs;
The display processing unit displays the arterial image and the vein image in different colors;
The ophthalmologic photographing apparatus according to claim 14 or 15. The front image is any one of a color fundus image, a monochrome fundus image, a fluorescent fundus image, an OCT cross-sectional image, an OCT projection image, an OCT shadowgram, and an OCT blood vessel enhancement image.
The ophthalmologic photographing apparatus according to any one of claims 1 to 16. A blood flow data acquisition unit that applies optical coherence tomography (OCT) blood flow measurement to each of a plurality of blood vessel positions on the fundus of the subject eye, and acquires a plurality of blood flow data corresponding to the plurality of blood vessel positions. When,
A front image receiving unit that receives a front image of the fundus;
A display processing unit for displaying information on the display means,
The display processing unit
Displaying the front image received by the front image receiving unit;
A plurality of measurement position information indicating the plurality of blood vessel positions to which OCT blood flow measurement is applied are displayed together with the front image;
Based on at least one of the plurality of blood flow data, at least one blood flow graph each representing a time-series change of a predetermined blood flow parameter is displayed in parallel with the front image.
Ophthalmic photography device. Blood flow data for receiving a plurality of blood flow data corresponding to the plurality of blood vessel positions, obtained by applying optical coherence tomography (OCT) blood flow measurement to each of a plurality of blood vessel positions on the fundus of the subject eye A reception department;
A front image acquisition unit for acquiring a front image of the fundus;
A display processing unit for displaying information on the display means,
The display processing unit
Displaying the front image acquired by the front image acquisition unit;
A plurality of measurement position information indicating the plurality of blood vessel positions to which OCT blood flow measurement is applied are displayed together with the front image;
Based on at least one of the plurality of blood flow data, at least one blood flow graph each representing a time-series change of a predetermined blood flow parameter is displayed in parallel with the front image.
Ophthalmic photography device. A plurality of blood flow data corresponding to the plurality of blood vessel positions obtained by applying optical coherence tomography (OCT) blood flow measurement to each of a plurality of blood vessel positions on the fundus of the eye to be examined; A storage unit for storing images;
A display processing unit for displaying information on the display means,
The display processing unit
Displaying the front image,
A plurality of measurement position information indicating the plurality of blood vessel positions to which OCT blood flow measurement is applied are displayed together with the front image;
Based on at least one of the plurality of blood flow data, at least one blood flow graph each representing a time-series change of a predetermined blood flow parameter is displayed in parallel with the front image.
Ophthalmic information processing device.

Images