WO2024043041A1

WO2024043041A1 - Ophthalmologic device, method for controlling ophthalmologic device, program, and recording medium

Info

Publication number: WO2024043041A1
Application number: PCT/JP2023/028514
Authority: WO
Inventors: 達夫山口; 龍坂東
Original assignee: 株式会社トプコン
Priority date: 2022-08-22
Filing date: 2023-08-04
Publication date: 2024-02-29
Also published as: JP2024029416A

Abstract

The ophthalmologic device according to one embodiment includes a first imaging unit, a second imaging unit and an evaluation processing unit. The first imaging unit includes a first optical system that meets Scheimpflug conditions, and is configured such that first imaging under a first imaging condition is applied to an anterior eye segment of an eye to be examined. The second imaging unit includes a second optical system that meets Scheimpflug conditions, and is configured such that second imaging under a second imaging condition that is different from the first imaging condition is applied to the anterior eye segment in parallel with the first imaging. The evaluation processing unit is configured so as to generate evaluation information about a floating substance in an aqueous humor on the basis of a first image generated in the first imaging by the first imaging unit and a second image generated in the second imaging by the second imaging unit.

Description

Ophthalmological device, method for controlling ophthalmological device, program, and recording medium

The present invention relates to an ophthalmologic apparatus, a method for controlling an ophthalmologic apparatus, a program, and a recording medium.

Image diagnosis occupies an important position in the field of ophthalmology. Various ophthalmological devices are used in ophthalmological image diagnosis. Ophthalmological equipment includes slit lamp microscopes, fundus cameras, scanning laser ophthalmoscopes (SLO), and optical coherence tomography (OCT). In addition, various inspection and measurement devices such as refractometers, keratometers, tonometers, specular microscopes, wavefront analyzers, and microperimeters are also equipped with functions for photographing the anterior segment and fundus of the eye.

Among these various ophthalmological devices, one of the most widely and frequently used devices is the slit lamp microscope, which is also called a stethoscope for ophthalmologists. A slit lamp microscope is an ophthalmological device that illuminates a subject's eye with slit light and observes or photographs the illuminated cross section from the side with a microscope (see, for example, Patent Documents 1 and 2). Additionally, a slit lamp microscope is known that can scan a three-dimensional area of the eye to be examined at high speed by using an optical system configured to satisfy Scheimpflug conditions (for example, see Patent Document 3). reference). In addition to the slit lamp microscope, a rolling shutter camera is also known as an imaging method that scans an object with slit light.

Slit lamp microscopes are used not only to observe ocular tissues (eyelids, conjunctiva, cornea, iris, anterior chamber, crystalline lens, vitreous, retina, etc.), but also to evaluate floating objects in the aqueous humor (in the anterior chamber). are also used (for example, see Patent Documents 4 and 5). Suspended substances in the aqueous humor include inflammatory cells, white blood cells (macrophages, lymphocytes, etc.), and blood proteins.

JP 2016-159073 Publication Japanese Patent Application Publication No. 2016-179004 JP2019-213733A International Publication No. 2018/003906 Special Publication No. 2022-520832

One purpose of the present invention is to improve the quality of evaluation of suspended matter in the aqueous humor.

One exemplary aspect of the embodiment is an ophthalmological apparatus including a first imaging unit, a second imaging unit, and an evaluation processing unit. The first imaging unit includes a first optical system that satisfies Scheimpflug conditions, and is configured to apply first imaging under first imaging conditions to the anterior segment of the subject's eye. The second photographing unit includes a second optical system that satisfies Scheimpflug conditions, and performs a second photograph under a second photographing condition different from the first photographing condition in parallel with the first photographing. Configured for application to the eye. The evaluation processing unit is configured to evaluate the floating state in the aqueous humor based on the first image generated by the first imaging by the first imaging unit and the second image generated by the second imaging by the second imaging unit. The device is configured to generate evaluation information of an object.

Other exemplary aspects of embodiments are ophthalmic devices and methods of controlling. This ophthalmologic apparatus includes a first imaging section, a second imaging section, and a processor. The first imaging section includes a first optical system that satisfies Scheimpflug conditions. The second photographing section includes a second optical system that satisfies Scheimpflug conditions. The method of this aspect causes the processor of the ophthalmological apparatus to function as a control unit and an evaluation processing unit. The control unit controls the first imaging unit to apply the first imaging under the first imaging condition to the anterior segment of the eye to be examined, and the control unit controls the first imaging unit to apply the first imaging under the first imaging condition to the anterior segment of the eye to be examined, and to apply the first imaging under the first imaging condition to the anterior segment of the eye to be examined. It operates to control the second imaging unit to apply the second imaging to the anterior segment in parallel with the first imaging. The evaluation processing unit is configured to evaluate the floating state in the aqueous humor based on the first image generated by the first imaging by the first imaging unit and the second image generated by the second imaging by the second imaging unit. It operates to generate evaluation information of things.

Yet another exemplary aspect of the embodiment is a program for operating an ophthalmological device. This ophthalmologic apparatus includes a first imaging section, a second imaging section, and a processor. The first imaging section includes a first optical system that satisfies Scheimpflug conditions. The second photographing section includes a second optical system that satisfies Scheimpflug conditions. The program of this aspect causes the processor of the ophthalmological apparatus to function as a control unit and an evaluation processing unit. The control unit controls the first imaging unit to apply the first imaging under the first imaging condition to the anterior segment of the eye to be examined, and the control unit controls the first imaging unit to apply the first imaging under the first imaging condition to the anterior segment of the eye to be examined, and to apply the first imaging under the first imaging condition to the anterior segment of the eye to be examined. It operates to control the second imaging unit to apply the second imaging to the anterior segment in parallel with the first imaging. The evaluation processing unit is configured to evaluate the floating state in the aqueous humor based on the first image generated by the first imaging by the first imaging unit and the second image generated by the second imaging by the second imaging unit. It operates to generate evaluation information of things.

Yet another exemplary aspect of the embodiment is a computer-readable non-transitory recording medium on which a program for operating an ophthalmological device is recorded. This ophthalmologic apparatus includes a first imaging section, a second imaging section, and a processor. The first imaging section includes a first optical system that satisfies Scheimpflug conditions. The second photographing section includes a second optical system that satisfies Scheimpflug conditions. The program recorded on the recording medium of this aspect causes the processor of the ophthalmological apparatus to function as a control unit and an evaluation processing unit. The control unit controls the first imaging unit to apply the first imaging under the first imaging condition to the anterior segment of the eye to be examined, and the control unit controls the first imaging unit to apply the first imaging under the first imaging condition to the anterior segment of the eye to be examined, and to apply the first imaging under the first imaging condition to the anterior segment of the eye to be examined. It operates to control the second imaging unit to apply the second imaging to the anterior segment in parallel with the first imaging. The evaluation processing unit is configured to evaluate the floating state in the aqueous humor based on the first image generated by the first imaging by the first imaging unit and the second image generated by the second imaging by the second imaging unit. It operates to generate evaluation information of things.

According to the embodiment, it is possible to improve the quality of evaluation of suspended matter in the aqueous humor.

FIG. 1 is a schematic diagram illustrating the configuration of an ophthalmologic apparatus according to an exemplary aspect of an embodiment. 5 is a timing chart illustrating processing performed by an ophthalmologic apparatus according to an exemplary aspect of the embodiment. 5 is a timing chart illustrating processing performed by an ophthalmologic apparatus according to an exemplary aspect of the embodiment. 5 is a timing chart illustrating processing performed by an ophthalmologic apparatus according to an exemplary aspect of the embodiment. 5 is a timing chart illustrating processing performed by an ophthalmologic apparatus according to an exemplary aspect of the embodiment. 5 is a timing chart illustrating processing performed by an ophthalmologic apparatus according to an exemplary aspect of the embodiment. FIG. 1 is a schematic diagram illustrating the configuration of an ophthalmologic apparatus according to an exemplary aspect of an embodiment. FIG. 2 is a schematic diagram for explaining an example of processing performed by an ophthalmologic apparatus according to an exemplary aspect of the embodiment. FIG. 2 is a schematic diagram for explaining an example of processing performed by an ophthalmologic apparatus according to an exemplary aspect of the embodiment. FIG. 2 is a schematic diagram for explaining an example of processing performed by an ophthalmologic apparatus according to an exemplary aspect of the embodiment. FIG. 2 is a schematic diagram for explaining an example of processing performed by an ophthalmologic apparatus according to an exemplary aspect of the embodiment. FIG. 2 is a schematic diagram for explaining an example of processing performed by an ophthalmologic apparatus according to an exemplary aspect of the embodiment. FIG. 2 is a schematic diagram for explaining an example of processing performed by an ophthalmologic apparatus according to an exemplary aspect of the embodiment. FIG. 2 is a schematic diagram for explaining an example of processing performed by an ophthalmologic apparatus according to an exemplary aspect of the embodiment. FIG. 2 is a schematic diagram for explaining an example of processing performed by an ophthalmologic apparatus according to an exemplary aspect of the embodiment. FIG. 2 is a schematic diagram for explaining an example of processing performed by an ophthalmologic apparatus according to an exemplary aspect of the embodiment. FIG. 1 is a schematic diagram illustrating the configuration of an ophthalmologic apparatus according to an exemplary aspect of an embodiment. FIG. 2 is a schematic diagram for explaining an example of processing performed by an ophthalmologic apparatus according to an exemplary aspect of the embodiment. FIG. 2 is a schematic diagram for explaining an example of processing performed by an ophthalmologic apparatus according to an exemplary aspect of the embodiment. FIG. 1 is a schematic diagram illustrating the configuration of an ophthalmologic apparatus according to an exemplary aspect of an embodiment. 3 is a flowchart illustrating processing performed by an ophthalmologic apparatus according to an exemplary aspect of an embodiment. 3 is a flowchart illustrating processing performed by an ophthalmologic apparatus according to an exemplary aspect of an embodiment. 3 is a flowchart illustrating processing performed by an ophthalmologic apparatus according to an exemplary aspect of an embodiment. 3 is a flowchart illustrating processing performed by an ophthalmologic apparatus according to an exemplary aspect of an embodiment. FIG. 1 is a schematic diagram illustrating the configuration of an ophthalmologic apparatus according to an exemplary aspect of an embodiment. FIG. 1 is a schematic diagram illustrating the configuration of an ophthalmologic apparatus according to an exemplary aspect of an embodiment.

Some non-limiting exemplary aspects of embodiments will be described in detail with reference to the drawings.

Any known technology can be combined with any aspect of the present disclosure. For example, any matter disclosed in the documents cited herein can be combined with any aspect of the present disclosure. Furthermore, any known technology in the technical field related to the present disclosure can be combined with any aspect of the present disclosure.

All contents disclosed in Patent Document 3 (Japanese Unexamined Patent Publication No. 2019-213733) are incorporated into the present disclosure by reference. Furthermore, any technical matter disclosed by the applicant of the present application regarding technology related to the present disclosure (matters disclosed in patent applications, papers, etc.) can be combined with any aspect of the present disclosure.

It is possible to at least partially combine any two or more of the various aspects of the present disclosure.

At least some of the functionality of the elements described in this disclosure is implemented using circuitry or processing circuitry. The circuit configuration or processing circuit configuration includes a general-purpose processor, a special-purpose processor, an integrated circuit, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit) configured and/or programmed to perform at least a portion of the disclosed functions. ), ASIC (Application Specific Integrated Circuit), programmable logic device (for example, SPLD (Simple Programmable Logic Device), CPLD (Complex Pr Logic Device), FPGA (Field Programmable Gate Array), conventional circuit configurations, and any of these A processor is considered to be a processing circuitry or circuitry that includes transistors and/or other circuitry. In this disclosure, the term circuitry, unit, means, or similar terminology refers to the disclosure Hardware that performs at least some of the functions disclosed herein, or hardware that is programmed to perform at least some of the functions disclosed. or may be known hardware programmed and/or configured to perform at least some of the functions described.A processor where the hardware may be considered a type of circuitry. , the term circuitry, unit, means, or similar terms is a combination of hardware and software, the software being used to configure the hardware and/or the processor.

<Overview of embodiment>
One purpose of the embodiments of the present disclosure is to improve the quality of evaluation of suspended matter in the aqueous humor. To this end, the embodiments of the present disclosure perform a plurality of parallel imaging (multiple simultaneous imaging) using a plurality of optical systems that satisfy Scheimpflug conditions under mutually different imaging conditions, The apparatus is configured to evaluate floating objects in the aqueous humor based on a plurality of images (image group) generated by the plurality of parallel imaging operations.

Note that the object of evaluation according to the embodiments of the present disclosure is not limited to floating objects present in the aqueous humor. Some exemplary embodiments include other floaters present within the eye (e.g., floaters present in the vitreous), floaters present on the ocular surface (e.g., floaters present in tear fluid), It may be configured to evaluate floating objects present in the ocular appendages (orbital socket, eyelid, conjunctiva, lacrimal organ, ocular muscle). Therefore, one purpose of the embodiments of the present disclosure is to improve the quality of evaluation of floating objects within the eye, on the ocular surface, or in the ocular appendage, and to satisfy the Scheimpflug conditions. Multiple parallel shootings (multiple simultaneous shootings) using multiple optical systems are performed under mutually different shooting conditions, and multiple images (image group) generated by these multiple parallel shootings are ) is configured to evaluate the floating objects. In the present disclosure, an embodiment that deals with floating objects in the aqueous humor will be described in detail, but it is clear that similar operations can be performed with a similar configuration even when other floating objects are the object. The present disclosure does not intentionally exclude embodiments that deal with floating matter other than floating matter in the aqueous humor (floating matter that is or can become an evaluation target in ophthalmology).

In some embodiments, a group of images is collected from a three-dimensional region of the anterior segment of the eye by repeatedly performing a plurality of parallel imaging while moving a plurality of optical systems with respect to the eye to be examined; The system is configured to evaluate suspended matter in the aqueous humor in this three-dimensional region based on the image group. For three-dimensional scanning of the anterior segment of the eye using an optical system that satisfies Scheimpflug's conditions (that is, collecting images from a three-dimensional region of the anterior segment), see Patent Document 3 (Japanese Patent Laid-Open No. 2019-213733). Please refer. Embodiments according to the present disclosure utilize this three-dimensional scanning, and include performing a plurality of parallel imaging using a plurality of optical systems under mutually different imaging conditions, and A further feature is that floating objects in the aqueous humor are evaluated based on a plurality of images collected by conventional photography.

As is widely known, Scheimpflug conditions are conditions related to the optical system that projects illumination light onto the object (illumination optical system) and the optical system that photographs the object (photographic optical system). This stipulates that the illumination optical system and photographing optical system are configured so that the principal surface of the lens and the film surface intersect on the same straight line. In an optical system that satisfies the Scheimpflug condition, the object surface is not parallel to the lens principal surface, so according to the Scheimpflug camera, it is possible to simultaneously focus over a wide depth range from near objects to far objects. You can take pictures using For example, in anterior segment imaging, it is possible to focus on a wide depth range from at least the anterior surface of the cornea to the posterior surface of the crystalline lens, and to express the entire main observation target of the anterior segment in high definition. is possible.

In the embodiments of the present disclosure, the number of optical systems that satisfy Scheimpflug conditions may be arbitrary. As described above, the Scheimpflug condition is a condition regarding the pair of the illumination optical system and the photographing optical system, so the "number of optical systems" in the embodiments of the present disclosure refers to More specifically, it is the number of photographic optical systems.

In some exemplary embodiments, the number of illumination optics (α) and the number of imaging optics (β) are equal (α = β), and the number of pairs of illumination optics and imaging optics is also equal. There are α pieces (= β pieces).　　　

On the other hand, in some other exemplary embodiments, the number of illumination optical systems (α) and the number of photographic optical systems (β) are different (α≠β). When the number of illumination optical systems is smaller than the number of photographic optical systems (α<β), at least one illumination optical system is shared by two or more photographic optical systems. Conversely, when the number of illumination optical systems is greater than the number of photographing optical systems (α>β), at least one photographing optical system performs photographing using two or more illumination optical systems.

In the exemplary aspects described below, this disclosure details an ophthalmic device that satisfies the following conditions, but embodiments are not limited thereto: The ophthalmic device includes at least two optical systems (at least (a first optical system and a second optical system); the first optical system includes a first illumination optical system and a second photographing optical system configured to satisfy Scheimpflug conditions. the second optical system includes a second illumination optical system and a second photographing optical system configured to satisfy Scheimpflug conditions; the first illumination optical system and the second illumination optical system (that is, the first illumination optical system and the second illumination optical system are the same); the first photographing optical system and the second photographing optical system are different. Those skilled in the art will be able to understand the configuration of an ophthalmological apparatus in which the number of illumination optical systems and/or the number of imaging optical systems differs from that of this embodiment through the description of this embodiment.

A plurality of parallel imaging operations using a plurality of optical systems that satisfy the Scheimpflug condition, which are performed according to the embodiments of the present disclosure, are performed under different imaging conditions. The imaging conditions may be any conditions that can be employed in ophthalmological imaging.

Note that, although the photographing conditions in the exemplary embodiments detailed in this disclosure include at least the exposure time conditions described below, the embodiments are not limited thereto. For example, the imaging conditions in some exemplary embodiments may include conditions that have the same or similar effect as the exposure time conditions. In addition, the imaging conditions of some exemplary aspects can be combined with the exposure time conditions to improve the quality of the embodiments of the present disclosure (improvement of imaging quality, improvement of imaging efficiency, imaging of subjects and/or patients). conditions that contribute to reducing the burden on optometry (such as reducing the burden on optometry).

Some examples of imaging conditions that can be adopted in the embodiment of the present disclosure will be described. Types of photographing conditions include, for example, conditions related to the optical system (optical system conditions), conditions related to movement of the optical system (movement conditions), and conditions other than these.

Types of optical system conditions include conditions related to the illumination optical system for projecting illumination light onto the eye to be examined (illumination conditions), conditions for the photographic optical system to photograph the eye to be examined using an image sensor (exposure conditions), etc. There is.

Types of illumination conditions include conditions regarding the intensity of illumination light (illumination intensity conditions), conditions regarding the projection time of illumination light (illumination time conditions), etc. The projection time of the illumination light is the length of the period (projection period) during which the illumination light is projected onto the eye to be examined. In this disclosure, the projection time of illumination light may be referred to as illumination time.

Examples of illumination intensity conditions include conditions related to the light source that emits illumination light (for example, the height of the light source control pulse), conditions related to the neutral density filter provided in the illumination optical system (for example, conditions related to the selection of two or more neutral density filters) conditions, conditions related to variable neutral density filter control), etc.

Examples of illumination time conditions include conditions related to the light source that emits illumination light (for example, the width of the light source control pulse), conditions related to the shutter provided in the illumination optical system (for example, the opening time of the shutter), etc.

There is an exposure time condition as a type of exposure condition. The exposure time conditions include, for example, conditions related to the image sensor (eg, exposure time of the image sensor), conditions related to the shutter provided in the photographic optical system (eg, shutter opening time), and the like. The exposure time is the length of a period (exposure period) during which the image sensor can receive light.

As mentioned above and as will be described in detail later, the imaging conditions in some exemplary embodiments of the present disclosure include exposure time conditions. An ophthalmologic apparatus according to an embodiment of the present disclosure includes a plurality of optical systems (a pair of an illumination optical system and a photographing optical system) that satisfy Scheimpflug conditions. Below, various matters will be explained in the case where two optical systems that satisfy the Scheimpflug condition are provided, but they will also be explained when there are three or more optical systems that satisfy the Scheimpflug condition. Those skilled in the art will understand that the following matters hold true.

Two optical systems that each satisfy Scheimpflug conditions are referred to as a first optical system and a second optical system. That is, the first optical system satisfies the Scheimpflug condition, and the second optical system satisfies the Scheimpflug condition. The photographing unit including the first optical system is referred to as a first photographing section, and the photographing unit including the second optical system is referred to as a second photographing section. In addition to the first optical system, the first imaging unit includes, for example, electrical or electronic elements (circuits, connection lines, connectors, etc.) and elements included in the first optical system (optical elements, etc.). It includes the driving mechanism, metal fittings, etc. The same applies to the second photographing section.

The first imaging unit (first optical system) and the second imaging unit (second optical system) perform imaging in parallel in time under mutually different imaging conditions. That is, in some exemplary aspects, while the first imaging section performs imaging under a first imaging condition (first imaging), the imaging unit performs imaging under a second imaging condition different from the first imaging condition. Photographing (second photographing) is performed by the second photographing section.

Some example aspects provide a method for performing a first image capture at a first exposure time condition by a first image capturing unit, while performing a second image capture at a second exposure time condition different from the first exposure time condition. Photographing is performed by the second photographing section. For example, the first optical system and the second optical system include separate image sensors, and the image sensor of the first optical system is called the first image sensor, and the image sensor of the second optical system is called the first image sensor. This is called the second image sensor. In another example, the first optical system uses a first region of the image sensor as the first image sensor, and the second optical system uses a second region of the same image sensor (a region different from the first region). ) may be configured to be used as the second image sensor.

The first exposure time condition includes the exposure time of the first image sensor in the first imaging unit (referred to as the first exposure time). Further, the second exposure time condition includes the exposure time of the second image sensor in the second imaging section (referred to as the second exposure time). The value of the second exposure time for the second imaging section is set larger than the value of the first exposure time for the first imaging section. Note that when three or more imaging units are provided, the three or more exposure times corresponding to the three or more imaging units are different from each other.

The value of the first exposure time and the value of the second exposure time may be determined based on arbitrary parameters, such as the characteristics (size, movement speed) of the suspended matter in the aqueous humor that is the detection target, the illumination It may be determined based on parameters such as light intensity (light amount) and illumination light projection time. The value of the first exposure time and/or the value of the second exposure time may be constant or variable. Regarding the value of the first exposure time and/or the second exposure time, a plurality of values may be provided, each corresponding to a plurality of types of suspended matter in the aqueous humor. The value of the first exposure time and/or the value of the second exposure time may be determined by analyzing a preliminary image obtained by photographing the anterior segment of the eye to be examined.

The movement conditions are imaging conditions used when performing a three-dimensional scan of the anterior segment of the eye using an optical system that satisfies Scheimpflug conditions. Types of movement conditions include optical system movement range (scan range, scan start position, scan end position), movement distance (scan distance), movement speed (scan speed), movement timing (scan start timing, scan end timing, etc.) ), movement modes (continuous movement, intermittent movement, etc.).

Conditions other than optical system conditions and movement conditions include conditions related to linkage (synchronization) of two or more conditions, conditions related to the eye to be examined, etc.

Examples of conditions related to coordination of two or more conditions include conditions related to coordination of two or more optical system conditions, conditions related to coordination of two or more movement conditions, and conditions related to coordination of one or more optical system conditions and one or more movement conditions. There are conditions regarding cooperation with.

Examples of conditions related to the eye to be examined include conditions related to fixation, conditions related to use of a contrast medium, conditions related to use of a mydriatic agent, conditions related to eye characteristics, etc. The eye characteristics may include parameters that affect or can affect the brightness of the eye image, such as pupil diameter, iris color, etc. be.

Embodiments according to the present disclosure may be configured to execute control for realizing the above-described imaging function (imaging). This control may include, for example, one or two of the following: control of the optical system (illumination optical system and/or photographing optical system), control of elements of the photographing section other than the optical system, and control of elements other than the photographing section. It may include a combination of more than one control. Moreover, the embodiment according to the present disclosure may be configured to be able to execute control for realizing functions other than the above-mentioned photographing function.

Control of the illumination optical system may be any type of control, for example, electrical control such as light source control (on/off) or electronic shutter control, or mechanical shutter control or rotary shutter control. It may be mechanical control such as control, or it may be a combination of electrical control and mechanical control. Note that these shutters are provided in the illumination optical system, and are designed to switch between passing and blocking the illumination light output from the light source (that is, switching between projecting and not projecting the illumination light to the subject's eye). )Function.

Control of the illumination optical system is not limited to control for switching between a state in which illumination light is projected onto the eye to be examined (projection state) and a state in which it is not projected (non-projection state); Control may also be used to modulate the intensity or amount of illumination light.

Note that switching between the projection state and the non-projection state corresponds to switching the intensity of the illumination light projected onto the eye to be examined between a positive value and zero. In contrast, intensity modulation corresponds to switching the intensity of illumination light projected onto the eye to be examined between a first value and a second value that are different from each other. Here, both the first value and the second value are non-negative values, and either one or both of the first value and the second value is a positive value. Therefore, switching between the projection state and the non-projection state can be said to correspond to one example of intensity modulation.

The control of the photographing optical system may be any type of control, for example, electrical control such as control of an image sensor or control of an electronic shutter, or control of a mechanical shutter or control of a rotary shutter. It may be mechanical control or a combination of electrical control and mechanical control.

Embodiments according to the present disclosure employ the imaging method described above, that is, a plurality of parallel imaging using a plurality of optical systems satisfying the Scheimpflug condition are performed under mutually different imaging conditions, The apparatus is configured to evaluate suspended matter in the aqueous humor based on the plurality of images thus acquired. Some non-limiting examples of the evaluation of suspended matter in the aqueous humor are described in some illustrative embodiments below.

Several exemplary aspects of the embodiments outlined above will now be described. Although the present disclosure mainly describes exemplary aspects of an ophthalmic device, exemplary aspects of a method for controlling an ophthalmic device, exemplary aspects of a program, and exemplary aspects of a recording medium, aspects of embodiments is not limited to these. For example, those skilled in the art will understand that the present disclosure provides various aspects of medical methods, various aspects of imaging methods, various aspects of data processing methods, and the like.

<Ophthalmological equipment>
Some exemplary aspects of ophthalmic devices according to embodiments are provided.

FIG. 1 shows the configuration of an ophthalmological apparatus according to one aspect of the embodiment. The ophthalmological apparatus 1000 of this embodiment includes an imaging section 1100, a control section 1200, an evaluation processing section 1300, and a movement mechanism 1400.

The photographing unit 1100 generates a digital image (Scheimpflug image) by photographing the anterior segment of the eye to be examined using an optical system that satisfies Scheimpflug conditions. The photographing section 1100 includes a first photographing section 1110 and a second photographing section 1120.

The first imaging unit 1110 includes an optical system (first optical system) 1111 that satisfies Scheimpflug conditions. The first optical system 1111 includes an image sensor (first image sensor) 1112 for generating a digital image. Some non-limiting specific examples of the configuration of the first imaging unit 1110 will be described later. The first imaging unit 1110 applies imaging to the anterior segment of the subject's eye under preset imaging conditions (first imaging conditions). Photographing performed by the first photographing unit 1110 under the first photographing conditions is referred to as first photographing. The image generated by the first photographing is called a first image.

The second photographing unit 1120 includes an optical system (second optical system) 1121 that satisfies Scheimpflug conditions. The second optical system 1121 includes an image sensor (second image sensor) 1122 for generating a digital image. Regarding the configuration of the second imaging unit 1120, some non-limiting specific examples thereof will be described later. The second imaging unit 1120 applies imaging to the anterior segment of the subject's eye under preset imaging conditions (second imaging conditions). Photographing performed by the second photographing unit 1120 under the second photographing condition is referred to as second photographing. The image generated by the second shooting is called a second image.

As described above, in this aspect, the configuration of the first imaging unit 1110 and the configuration of the second imaging unit 1120 are (substantially) the same. Note that in some exemplary embodiments, the configuration of the first imaging unit and the configuration of the second imaging unit may be different.

Furthermore, in some exemplary embodiments, a part of the first optical system in the first imaging section and a part of the second optical system in the second imaging part may be common. For example, a configuration may be adopted in which a common objective lens is used as the objective lens of the first optical system and the objective lens of the second optical system. Further, a configuration is adopted in which the light guided by the common optical path of the first optical system and the second optical system is split into two and detected by the first image sensor and the second image sensor, respectively. Good too. The configuration in which the first optical system and the second optical system are partially shared is not limited to these examples.

The first imaging and the second imaging are performed in parallel. Further, the first imaging condition and the second imaging condition are different from each other. In this aspect, the first photographing condition includes the value of the exposure time (first exposure time) of the first image sensor 1112, and the second photographing condition includes the value of the exposure time of the second image sensor 1122. (second exposure time). In this aspect, the second exposure time is longer than the first exposure time.

Considering that the configurations of the first imaging unit 1110 and the second imaging unit 1120 are substantially the same as described above, it is assumed that the second exposure time is longer than the first exposure time. However, generality is not lost. Note that in an embodiment where the configuration of the first imaging section and the configuration of the second imaging section are substantially different, the relationship between the exposure time of one imaging section and the exposure time of the other imaging section is asymmetric. Although it is assumed that the present embodiment also includes such a case, it is clear from the present disclosure that the present embodiment includes such a case.

The control unit 1200 is configured to control each part of the ophthalmologic apparatus 1000. As shown in FIG. 1, the control unit 1200 controls the imaging unit 1110, the evaluation processing unit 1300, the moving mechanism 1400, etc. based on predetermined imaging conditions.

Although not shown, the control unit 1200 may be configured to control any element of the ophthalmologic apparatus 1000 and/or peripheral devices of the ophthalmologic apparatus 1000. Examples of such elements and/or peripheral devices of the ophthalmological apparatus 1000 include a user interface, a communication device, an element other than the imaging unit 1100, an element for testing an eye to be examined, and another device in a system including the ophthalmological apparatus 1000. , another device used with ophthalmologic device 1000, and the like.

The control unit 1200 includes hardware elements such as a processor and a storage device. The storage device stores computer programs such as control programs. The functions of the control unit 1200 are realized by cooperation between software such as a control program and hardware such as a processor.

In this aspect, the control unit 1200 controls the imaging unit 1100 to perform first imaging by the first imaging unit 1110 and second imaging by the second imaging unit 1120 in parallel and different from each other. Execute with conditions. That is, the control unit 1200 of this aspect controls the imaging unit 1100 to cause the first imaging unit 1110 to perform the first imaging under the first imaging condition, while performing the first imaging under the first imaging condition. The second photographing unit 1120 is caused to perform the second photographing under the second photographing condition. More specifically, the control unit 1200 of this embodiment controls the imaging unit 1100 to change the first imaging in which the exposure time of the first image sensor 1112 is set to the first exposure time to the first imaging unit 1100. The second imaging unit 1120 is caused to perform second imaging in which the exposure time of the second image sensor 1122 is set to a second exposure time longer than the first exposure time while causing the imaging unit 1110 to perform the second imaging.

By performing two shots in parallel with different exposure times, an image depicting the movement of suspended matter in the aqueous humor over a relatively short period and an image depicting the movement of suspended matter within the aqueous humor over a relatively long period were created. An image is obtained. In this aspect, the first image generated by the first imaging unit 1110 is an image depicting the movement of suspended matter in the aqueous humor over a relatively short period, and the first image generated by the second imaging unit 1120 The second image is an image depicting the movement of suspended matter in the aqueous humor over a relatively long period of time. The ophthalmological apparatus 1000 of this embodiment has a novel function of evaluating floating matter in the aqueous humor by comparing these two images. This evaluation process will be described later.

The moving mechanism 1400 is configured to move the imaging unit 1100 (at least the first optical system 1111 and the second optical system 1121). Note that the moving mechanism 1400 may include a mechanism that has the same function as moving the imaging section 1100 (in other words, a mechanism that has the same effect as moving the imaging section 1110). Examples of such mechanisms include a mechanism (illumination scanner, movable illumination mirror) that moves the illumination position by deflecting illumination light (slit light), and a mechanism that moves the illumination position by deflecting the light directed from the eye to the imaging unit 1100. There are mechanisms for moving the camera (photo scanner, movable photograph mirror), etc.

The control unit 1200 controls the first image and the first image by controlling the image capturing unit 1100 (control of the first image capturing unit 1110 and controlling the second image capturing unit 1120) in combination with control of the moving mechanism 1400. The first photographing unit 1110 and the second photographing unit 1120 generate a plurality of pairs with the second image. In other words, the control unit 1200 combines the control of the first imaging unit 1110, the control of the second imaging unit 1120, and the control of the movement mechanism 1400 to scan a three-dimensional region of the anterior segment of the subject's eye (anterior (ocular scan), that is, image collection from a three-dimensional region of the anterior segment of the eye to be examined. The anterior segment scan is performed by changing the positions of the first optical system 1111 and the second optical system 1121 with respect to the anterior segment, and performing the first imaging by the first imaging unit 1110 and the second imaging by the second imaging unit 1120. This is an imaging mode that performs pairing operations multiple times with shooting. As a result, a plurality of image pairs (a plurality of pairs of a first image and a second image) each depicting a plurality of different parts of the anterior segment are obtained.

Some examples of aspects of the anterior segment scan performed by the control unit 1200 in combination with the control of the imaging unit 1110 and the control of the movement mechanism 1400 will be described below.

The scan shown in FIG. 2A consists of light emission from a light source (output of illumination light, projection of illumination light onto the subject's eye), exposure from camera A (first image sensor 1112), and exposure from camera B (second image sensor 1122). This is realized by linked control (synchronous control) between the exposure and the scan position (the position of the moving imaging unit 1100).

More specifically, the scan in FIG. 2A involves repeating control to continuously output illumination light and exposing the first image sensor 1112 at a relatively short exposure time (first exposure time) "a". control to repeatedly perform exposure of the second image sensor 1122 at a relatively long exposure time (second exposure time) "b", and control to repeatedly perform exposure from the scan start position to the scan end position. This is a synchronous combination of control for continuously moving the section 1100. Here, the first exposure time "a" and the second exposure time "b" are shown in FIG. 2C.

Repetitive exposure of the first image sensor 1112 is performed by alternately repeating exposure during the first exposure time and charge transfer (and exposure standby). Similarly, the repetitive exposure of the second image sensor 1122 is performed by alternately repeating exposure at the second exposure time and charge transfer (and exposure standby).

The scanning shown in FIG. 2A has the advantage that illumination light control is simple and scanning can be achieved through relatively simple synchronous control.

In the scan of FIG. 2A, the intensity (light amount) of the illumination light can be modulated according to the exposure timing of the two image sensors 1112 and 1122. For example, the intensity of the illumination light may be relatively high during the exposure period of the first image sensor 1112, and the intensity of the illumination light may be relatively low during the exposure period of the second image sensor 1122. By performing intensity modulation, the brightness of the image obtained by the first image sensor 1112 is increased with a relatively short exposure time, and the image is made clearer and has higher definition. Saturation of the brightness of the image obtained by the image sensor 1122 can be prevented.

The scan shown in FIG. 2B is executed in the same manner as the scan shown in FIG. 2A with regard to exposure control of the first image sensor 1112, exposure control of the second image sensor 1122, and scan position control, but As for control, unlike the scan of FIG. 2A in which illumination light is emitted continuously, illumination light is output intermittently (pulse light emission).

More specifically, the scan in FIG. 2B involves repeated control to output illumination light intermittently and exposure of the first image sensor 1112 at a relatively short exposure time (first exposure time) "a". control to repeatedly perform exposure of the second image sensor 1122 at a relatively long exposure time (second exposure time) "b", and control to repeatedly perform exposure from the scan start position to the scan end position. This is a synchronous combination of control for continuously moving the section 1100. Here, the first exposure time "a" and the second exposure time "b" are shown in FIG. 2C.

Although the scan of FIG. 2B has the disadvantage that synchronization control is more complicated than the scan of FIG. 2A, it is possible to shorten the time during which the illumination light is projected onto the eye to be examined. This has the advantage that the burden on the subject can be reduced.

Similarly to the scan in FIG. 2A, in the scan in FIG. 2B as well, the intensity (light amount) of the illumination light may be modulated according to the exposure timing of the two image sensors 1112 and 1122.

The scan shown in FIG. 2D is executed in the same manner as the scan shown in FIG. 2A with respect to illumination light emission control, exposure control of the first image sensor 1112, and exposure control of the second image sensor 1122, but the scanning position Regarding control, unlike the scan of FIG. 2A in which the imaging unit 1100 is moved continuously, the imaging unit 1100 is moved intermittently.

More specifically, the scan in FIG. 2D repeats control to continuously output illumination light and exposure of the first image sensor 1112 at a relatively short exposure time (first exposure time) "a". control to repeatedly perform exposure of the second image sensor 1122 at a relatively long exposure time (second exposure time) "b", and control to repeatedly perform exposure from the scan start position to the scan end position. This is a synchronous combination of control to move the section 1100 intermittently. Here, the first exposure time "a" and the second exposure time "b" are shown in FIG. 2C.

The scan shown in FIG. 2E is executed in the same manner as the scan shown in FIG. 2B with regard to illumination light emission control, exposure control of the first image sensor 1112, and exposure control of the second image sensor 1122, but the scanning position Regarding control, unlike the scan of FIG. 2B in which the imaging unit 1100 is moved continuously, the imaging unit 1100 is moved intermittently.

More specifically, the scan in FIG. 2E involves repeated control to output illumination light intermittently and exposure of the first image sensor 1112 at a relatively short exposure time (first exposure time) "a". control to repeatedly perform exposure of the second image sensor 1122 at a relatively long exposure time (second exposure time) "b", and control to repeatedly perform exposure from the scan start position to the scan end position. This is a synchronous combination of control to move the section 1100 intermittently. Here, the first exposure time "a" and the second exposure time "b" are shown in FIG. 2C.

When the imaging unit 1100 is moved intermittently as in the scan shown in FIG. 2D and the scan shown in FIG. 2E, the complexity of synchronization control increases, and vibrations due to repeated sudden starts and stops of the imaging unit 1100 occur. Although there are disadvantages such as the risk of occurrence of image blurring, the advantage is that each image capturing can be performed with the image capturing unit 1100 stopped, so that blurring or blurring of the image due to movement of the image capturing unit 1100 does not occur. There is.

Although several examples of the aspect of the anterior segment scan of this aspect have been described above, the aspect of the anterior segment scan is not limited to these. Furthermore, it is possible to select the scanning mode to be applied to the anterior segment based on the advantages and disadvantages described above, or to at least partially combine two or more scanning modes.

Note that in some exemplary embodiments, two or more images acquired with the optical system stationary (i.e., two images acquired at the same optical system position) without scanning (moving the optical system) evaluation of suspended matter in the aqueous humour. Such non-scan imaging and evaluation can be performed by an ophthalmological apparatus equipped with a moving mechanism like the ophthalmological apparatus 1000 of this embodiment, or an ophthalmic apparatus not equipped with a moving mechanism. In an ophthalmologic apparatus equipped with a moving mechanism, it may be possible to select a mode in which scanning-based imaging and evaluation is performed and a mode in which non-scanning imaging and evaluation are performed.

The evaluation processing unit 1300 generates a first image generated by the first imaging performed by the first imaging unit 1110 under the first imaging condition, and an image generated by the second imaging unit under the second imaging condition. 1120 is configured to generate evaluation information on suspended matter in the aqueous humor in the anterior segment (anterior chamber) of the eye to be examined.

The evaluation information may be any information regarding suspended matter in the aqueous humor. For example, the evaluation information may include information regarding any item indicating the state of the floating object in the aqueous humor, information regarding any item grasped based on the state of the floating object in the aqueous humor, and the like. In addition, evaluation information includes numerical information (values of predetermined parameters, etc.), information indicating judgment results (grade indicating the pathology of a specific disease, grade indicating the degree of progression of a specific disease, presence or absence of suspicion of a specific disease, (probability, etc.), information indicating the data used to derive the judgment result, information that visualizes any of these information, etc. may be included.

The evaluation processing unit 1300 includes hardware elements such as a processor and a storage device. A computer program such as an evaluation processing program is stored in the storage device. The functions of the evaluation processing unit 1300 are realized by cooperation between software such as an evaluation processing program and hardware such as a processor.

Some exemplary aspects (some configuration examples, some processing examples, etc.) of the evaluation processing unit 1300 will be described below.

In one exemplary embodiment shown in FIG. 3, the evaluation processing section 1300 includes a floating object image detection section 1310 and an evaluation information generation section 1320. The functions of the floating object image detection unit 1310 are realized by cooperation between software such as a floating object image detection program and hardware such as a processor. Further, the functions of the evaluation information generation unit 1320 are realized by cooperation between software such as an evaluation information generation program and hardware such as a processor.

The floating object image detection unit 1310 is configured to detect a first floating object image in the first image and a second floating object image in the second image, which correspond to the same floating object in the aqueous humor. There is. More specifically, the floating object image detection unit 1310 detects an image of floating objects in the aqueous humor from a first image generated by first imaging performed by the first imaging unit 1110 under first imaging conditions. (the first floating object image) and from the second image generated by the second imaging performed by the second imaging unit 1120 under the second imaging condition. It is configured to detect an image of an object (second floating object image).

The evaluation information generation unit 1320 determines whether the aqueous humor is detected based on a pair of a first floating object image and a second floating object image that correspond to the same floating object in the aqueous humor detected by the floating object image detection unit 1310. The system is configured to generate floating object evaluation information.

As mentioned above, the first imaging and the second imaging are performed in parallel. For example, in the examples shown in FIGS. 2A to 2E, the exposure period (first exposure period) of the first image sensor 1112 for the first image capture is the same as that of the second image sensor 1122 for the second image capture. This corresponds to a part of the exposure period (second exposure period). Further, the configuration of the first imaging unit 1110, the configuration of the second imaging unit 1120, and the relative positional relationship between the first imaging unit 1110 and the second imaging unit 1120 are known. Therefore, it is possible to determine the correspondence between the pixel positions (coordinates) of the first image and the pixel positions (coordinates) of the second image. That is, it is possible to determine a coordinate transformation between a coordinate system for defining pixel positions in the first image and a coordinate system for defining pixel positions in the second image. The floating object image detection unit 1310 may be configured to detect the same image of the floating object in the aqueous humor from both images by using this correspondence (coordinate transformation).

In some exemplary embodiments, floater image detection unit 1310 first performs image segmentation to identify an anterior chamber region corresponding to the anterior chamber in the first image, and further performs image segmentation to identify an anterior chamber region corresponding to the anterior chamber in the first image; Perform image segmentation to identify floating object images. These image segmentations may be machine learning-based processes, non-machine learning-based processes, or a combination of machine learning-based processes and non-machine learning-based processes.

As a result, one or more floating object images are detected from the first image. Typically, multiple floating object images are detected from the first image. The set of floating object images detected from the first image is called a first image set. Similarly, a second image set is detected, which is a set of floating object images detected from the second image.

Furthermore, the floating object image detection unit 1310 detects a second image based on a known correspondence relationship (coordinate transformation) between the pixel position (coordinates) of the first image and the pixel position (coordinates) of the second image. A positional correspondence between the first image set and the second image set is determined. This positional correspondence is information representing a pairing relationship between an element of the first image set (first floating object image) and an element of the second image set (second floating object image). . In other words, this positional correspondence determines a pair of one first floating object image and one second floating image. In other words, two images of floating objects that exist at substantially the same position are determined. In other words, two images of the same floating object are determined.

The evaluation information generation unit 1320 of this embodiment generates this image based on the pair of images of the same floating object (the pair of the first floating object image and the second floating object image) determined by the above-mentioned positional correspondence relationship. It may be configured to generate evaluation information of suspended matter in the aqueous humor corresponding to the pair.

In some other exemplary aspects, floater image detection unit 1310 first performs image segmentation to identify an anterior chamber region corresponding to the anterior chamber in the first image; Perform image segmentation to identify floating object images in the region. As a result, one or more floating object images are detected from the first image. One of the floating object images detected from the first image is called a first floating object image.

Next, the floating object image detection unit 1310 determines the coordinates of the first floating object image detected from the first image. The coordinates of the first floating object image are, for example, the coordinates of the center of gravity of the first floating object image, the coordinates of the center of the first floating object image, the coordinates of one or more points on the outline of the first floating object. , the coordinates of a representative position of an approximate figure of the outline of the first floating object image (for example, the center of an approximate ellipse, the center of an approximate circle, etc.), and the coordinates of one or more points on the outline of the first floating object image. It may be any of the coordinates.

Next, the floating object image detection unit 1310 performs the following based on the known correspondence relationship (coordinate transformation) between the pixel position (coordinates) of the first image and the pixel position (coordinate) of the second image. A floating object image at a position corresponding to the coordinates of the first floating object image is detected from the second image. Note that in this aspect, since it is assumed that the second exposure time is longer than the first exposure time, the floating object image detection unit 1310 detects the second exposure time corresponding to the coordinates of the first floating object image. A floating object image that exists to include the position (coordinates) in the image is detected as a floating object image in a second image (second floating object image) corresponding to the same floating object as the first floating object image. do.

The evaluation information generation unit 1320 of this aspect corresponds to the pair of images of the same floating object (the pair of the first floating object image and the second floating object image) determined in this way. The present invention may be configured to generate evaluation information on suspended matter in the aqueous humor.

In some other exemplary aspects, floater image detection unit 1310 first performs image segmentation to identify an anterior chamber region corresponding to the anterior chamber in the second image; Perform image segmentation to identify floating object images in the region. As a result, one or more floating object images are detected from the second image. One of the floating object images detected from the second image is referred to as a second floating object image.

Next, the floating object image detection unit 1310 determines the coordinates of the second floating object image detected from the second image. The coordinates of the second floating object image are, for example, the coordinates of the center of gravity of the second floating object image, the coordinates of the center of the second floating object image, the coordinates of one or more points on the outline of the second floating object. , the coordinates of a representative position of an approximate figure of the outline of the second floating object image, and the coordinates of one or more points on the outline of the second floating object image.

Next, the floating object image detection unit 1310 performs the following based on the known correspondence relationship (coordinate transformation) between the pixel position (coordinates) of the first image and the pixel position (coordinate) of the second image. A floating object image at a position corresponding to the coordinates of the second floating object image is detected from the first image. Note that in this aspect, since it is assumed that the second exposure time is longer than the first exposure time, the floating object image detection unit 1310 detects, for example, the second exposure time corresponding to the coordinates of the second floating object image. A floating object image that exists so as to include the position (coordinates) in the first image, or a floating object that exists closest to the position (coordinates) in the first image that corresponds to the coordinates of the second floating object image. The image is detected as a floating object image in the first image (first floating object image) corresponding to the same floating object as the second floating object image.

Several examples of the processing executed by the evaluation processing unit 1300 will be explained.

A first example of processing executed by the evaluation processing unit 1300 will be described with reference to FIGS. 4A to 4D. The evaluation processing unit 1300 of this example determines the movement direction of the suspended matter in the aqueous humor based on the second image generated by the second imaging performed by the second imaging unit 1120 under the second imaging condition. is configured to estimate. The direction of movement of suspended matter in the aqueous humor is one example of evaluation information.

The image 2100 shown in FIG. 4A is the first image generated by the first imaging performed by the first imaging unit 1110 under the first imaging condition, and the image 2200 is the first image generated under the second imaging condition. Below is a second image generated by second photography performed by the second photography unit 1120. Here, the first imaging and the second imaging were performed in parallel.

In FIG. 4A, "Z" indicates the direction along the axis of the subject's eye (Z direction), and "X" indicates the left and right direction for the subject (horizontal direction, X direction) in the direction orthogonal to the Z direction. , "Y" indicates a direction (vertical direction, body axis direction, Y direction) orthogonal to both the X direction and the Z direction. The same applies to other drawings (such as FIGS. 4B to 4D).

Reference numeral 2110 indicates an image of floating objects in the aqueous humor (first floating object image) detected from the first image 2100 by the floating object image detection unit 1310, and reference numeral 2210 indicates the image of floating objects in the aqueous humor detected from the first image 2100 by the floating object image detection unit 1310. 2 shows an image of the same floating object in the aqueous humor detected from the second image 2200 (second floating object image). Note that the first floating object image 2110 may be an approximate figure (for example, an approximate circle, an approximate ellipse, etc.) of the image of the floating object in the aqueous humor, and the second floating object image 2210 may be an approximate figure of the image of the floating object in the aqueous humor. It may be an approximate figure (for example, an approximate circle, an approximate ellipse, etc.) of the image of the floating object.

The evaluation information generation unit 1320 of this example generates evaluation information from the second image 2200. First, the evaluation information generation unit 1320 calculates the maximum dimension of the second floating object image 2210 by analyzing the second floating object image 2210 detected from the second image 2200 by the floating object image detection unit 1310. .

The maximum dimension is the maximum value of the distance between two points on the boundary (outline, outer edge, edge) of the second floating object image 2210. In other words, the maximum dimension is the maximum length of a line segment connecting two points on the boundary of the second floating object image 2210. If the second floating object image 2210 is circular, its maximum dimension is the length of the diameter of the circle. If the second floating object image 2210 is elliptical, its maximum dimension is the length of the major axis of the ellipse. Reference numeral 2220 in FIG. 4B indicates the major axis of the second elliptical floating object image 2210.

Further, the evaluation information generation unit 1320 of this example sets the direction along the line segment that defines the maximum dimension of the second floating object image 2210 as the moving direction of the floating object in the aqueous humor. In other words, the evaluation information generation unit 1320 of this example determines the direction of a straight line passing through two points on the boundary of the second floating object image 2210 that defines the maximum dimension of the second floating object image 2210 within the aqueous humor. The direction of movement of floating objects. Reference numeral 2230 in FIG. 4C indicates the moving direction of the floating object in the aqueous humor, which corresponds to the long axis 2220 of the elliptical second floating object image 2210 shown in FIG. 4B.

Reference numeral 2110a in FIG. 4D indicates that the first floating object image 2110 in the first image 2100 shown in FIG. Shows the captured image (area).

In this example, as shown in FIGS. 2A to 2E, the exposure period (first exposure period) of the first image sensor 1112 for the first image capture is different from the exposure period (first exposure period) of the first image sensor 1112 for the first image capture. It is assumed that this corresponds to the initial part of the exposure period (second exposure period) of the element 1122.

In this case, a region 2110a in the second image 2200 shown in FIG. 4D is a region (initial position region) that is estimated to be the initial position of the floating object in the aqueous humor during the second exposure period. On the other hand, a region 2110b in the second image 2200 shown in FIG. 4D is a region (final position region) estimated to be the final position of the object suspended in the aqueous humor during the second exposure period.

The movement direction 2230 (FIG. 4C) determined by the evaluation information generation unit 1320 indicates the direction from the initial position area 2110a to the final position area 2110b. In this way, the moving direction 2230 is information representing the moving state of the suspended matter in the aqueous humor during the second exposure period.

This concludes the description of the first example of the process executed by the evaluation processing unit 1300 (estimation of the moving direction of the suspended matter in the aqueous humor based on the second image).

Next, a second example of processing executed by the evaluation processing unit 1300 will be described. The evaluation processing unit 1300 of this example uses a first image generated by the first imaging performed by the first imaging unit 1110 under the first imaging condition, and a second image generated under the second imaging condition. The second image generated by the second imaging performed by the imaging unit 1120 is configured to estimate the movement vector of the suspended matter in the aqueous humor. The movement vector includes the movement direction and movement amount (movement distance) of the floating object in the aqueous humor, and is an example of evaluation information.

FIG. 5A shows a first image 2300 and a second image 2400 that are processed in this example. The floating object image detection unit 1310 of this example detects the first floating object image 2310 in the first image 2300 and the second floating object image 2410 in the second image 2400. The evaluation information generation unit 1320 of this example estimates the movement vector of the floating object in the aqueous humor based on the first floating object image 2310 and the second floating object image 2410 detected by the floating object image detection unit 1310. do.

In some exemplary aspects, the evaluation information generation unit 1320 determines the feature points of the first floating object image 2310 and calculates the feature points of the first floating object image 2310 and the second floating object image 2410. The method may be configured to estimate a movement vector of suspended matter in the aqueous humor.

The feature point of the first floating object image 2310 may be a representative point of the first floating object image 2310, for example, the center, the center of gravity, one or more points on the boundary, etc. Reference numeral 2320 in FIG. 5B indicates one example of feature points of the first floating object image 2310. The following will explain using this exemplary feature point 2320.

In a more specific aspect, the evaluation information generation unit 1320 specifies the position in the second floating object image 2410 that corresponds to the feature point 2320 of the first floating object image 2310, and The moving vector of the floating object in the aqueous humor may be estimated based on the position in the image 2410 (the position in the second floating object image 2410 corresponding to the feature point 2320).

Reference numeral 2320a in FIG. 5C indicates the position of an image obtained by mapping the feature point 2320 of the first floating object image 2310 to the second image 2400 by coordinate transformation between the first image 2300 and the second image 2400. . The evaluation information generation unit 1320 of this example estimates the movement vector of the floating object in the aqueous humor based on the position 2320a in the second floating object image 2410 that corresponds to the feature point 2320 of the first floating object image 2310.

In a more specific aspect, the evaluation information generation unit 1320 includes a position 2320a in the second floating object image 2410 corresponding to the feature point 2320 of the first floating object image 2310, as well as a position 2320a of the first image sensor 1112. Based on the timing relationship between the exposure period (the exposure period in the first photographing, the first exposure period) and the exposure period of the second image sensor 1122 (the exposure period in the second photographing, the second exposure period) may be configured to estimate a movement vector of suspended matter in the aqueous humor.

As described above, the first exposure period corresponds to a part (partial period) of the second exposure period. The timing relationship (exposure timing relationship) between the first exposure period and the second exposure period is the (temporal) position of the first exposure period in the second exposure period, that is, the second exposure period. This is information representing the position of the partial period in . The position of the sub-period corresponding to the first exposure period may be defined, for example, by any point in time in the sub-period, for example by the start, middle, or end of the first exposure period. good.

The evaluation information generation unit 1320 of this example estimates the moving direction of the floating object in the aqueous humor based on the second floating object image 2410 in the second image 2400, for example, as in the first example described above. I can do it.

On the other hand, in estimating the moving amount (moving distance) of floating objects in the aqueous humor, for example, the evaluation information generation unit 1320 corresponds to the feature points 2320 of the second floating object image 2410 and the first floating object image 2310 The position 2320a in the second floating object image 2410 and the exposure timing relationship are referenced.

Specifically, the evaluation information generation unit 1320 generates the first floating object image 2310 based on the temporal positional relationship between the first exposure period and the second exposure period shown in the exposure timing relationship. The position 2320a corresponding to the feature point 2320 represents which point in the movement of the suspended matter in the aqueous humor (which point on the movement route) in the second exposure period is determined.

As shown in FIGS. 2A to 2E, when the first exposure period corresponds to the beginning of the second exposure period, the position 2320a corresponding to the feature point 2320 of the first floating object image 2310 is located during the second exposure period. represents the start point of movement of suspended matter in the aqueous humor (starting point of the movement route). Further, when the first exposure period corresponds to the end of the second exposure period, the position 2320a corresponding to the feature point 2320 of the first floating object image 2310 corresponds to the position 2320a of the floating object in the aqueous humor during the second exposure period. It represents the end point of movement (the end point of the movement route). Further, when the first exposure period corresponds to the middle point of the second exposure period, the position 2320a corresponding to the feature point 2320 of the first floating object image 2310 is the position of the floating object in the aqueous humor during the second exposure period. represents the center point of movement (the center point of the movement route). In general, if the first exposure period corresponds to p percent points between the start point (0 percent point) and the end point (100 percent point) of the second exposure period (0≦p≦100), then the first The position 2320a corresponding to the feature point 2320 of the floating object image 2310 is p percent point in time between the start and end of the movement of the floating object in the aqueous humor during the second exposure period (from the starting point to the ending point of the movement route). p percent points between The time points (points) determined in this manner will be referred to as corresponding time points (corresponding points).

Next, the evaluation information generation unit 1320 uses the corresponding time point determined as described above, the spread (range, boundary) of the second floating object image 2410, and the moving direction of the floating object in the aqueous humor. , the amount of movement of suspended matter in the aqueous humor can be estimated.

A case where the first exposure period corresponds to the beginning of the second exposure period will be described with further reference to FIGS. 5D and 5E. In this case, the position 2320a corresponding to the feature point 2320 of the first floating object image 2310 represents the starting point of the movement route of the floating object in the aqueous humor during the second exposure period.

The evaluation information generation unit 1320 calculates the movement of the floating objects in the aqueous humor during the second exposure period based on the movement direction of the floating objects in the aqueous humor and the spread (range, boundary) of the second floating object image 2410. The end point (end point of the travel route) can be estimated.

For example, as shown in FIG. 5D, the evaluation information generation unit 1320 finds two

intersections

2410a and 2410b between a straight line 2420 along the moving direction of the floating object in the aqueous humor and the boundary of the second floating object image 2410. In this example, the first intersection 2410a is located on the side closer to the starting point (position 2320a) of the movement route of the suspended matter in the aqueous humor. The evaluation information generation unit 1320 calculates the distance D between the position 2320a and the first intersection 2410a.

Furthermore, the evaluation information generation unit 1320 determines a position 2320b displaced by a distance D from the second intersection 2410b along the straight line 2420 in the direction of the position 2320a (first intersection 2410a). This position 2320b is estimated to be the end point of the movement route of the suspended matter in the aqueous humor during the second exposure period.

The evaluation information generation unit 1320 calculates the distance between the position 2320a and the position 2320b. This distance is estimated to be the moving distance of the suspended matter in the aqueous humor during the second exposure period. Reference numeral 2430 shown in FIG. 5E is an estimated movement vector of the floating object in the aqueous humor during the second exposure period. This movement vector is information representing the direction and amount of movement of the objects suspended in the aqueous humor during the second exposure period, and is information representing the state of movement of the objects suspended within the aqueous humor during the second exposure period.

Note that if the first exposure period corresponds to the end of the second exposure period or if the first exposure period corresponds to the middle of the second exposure period, generally the first exposure period corresponds to the second exposure period. Even in the case where the second exposure period corresponds to an arbitrary partial period of the exposure period, it is possible to obtain the movement vector of the suspended matter in the aqueous humor in the second exposure period by a method similar to the above method.

This concludes the description of the second example of the process executed by the evaluation processing unit 1300 (estimation of the movement vector of suspended matter in the aqueous humor based on the first image and the second image).

FIG. 6 shows one configuration example of an ophthalmological apparatus that can be adopted to realize the first example and second example described above. The ophthalmological apparatus 1000A of this example is obtained by adding an illumination system 1130 to the ophthalmological apparatus 1000 of FIG.

The illumination system 1130 is included in the imaging unit 1100 and is configured to project a slit light onto the anterior segment of the subject's eye. In this example, the first imaging unit 1110 and the second imaging unit 1120 share a single illumination system 1130, but as described above, the illumination system for the first imaging unit 1110 and the second imaging unit An illumination system for the imaging unit 1120 may be provided separately. Some non-limiting specific examples of the illumination system 1130 will be described below.

The longitudinal direction of the beam shape (cross-sectional shape of the beam) of the slit light is aligned with a predetermined direction, for example, aligned with the Y direction. The moving mechanism 1400 is configured to integrally move the first imaging section 1110, the second imaging section 1120, and the illumination system 1130. The moving direction is, for example, a direction perpendicular to the longitudinal direction of the beam shape of the slit light, and is, for example, the X direction. This makes it possible to scan a three-dimensional region of the anterior segment of the subject's eye and collect a series of Scheimpflug images. Regarding such three-dimensional scanning, please refer to Patent Document 3 (Japanese Patent Laid-Open No. 2019-213733).

Note that according to the three-dimensional scan of this aspect, a series of Scheimpflug images (a plurality of first images) collected by the first imaging unit 1110 and a series of Scheimpflug images collected by the first imaging unit 1120 A proof image (a plurality of second images) is obtained. In other words, according to the three-dimensional scan of this embodiment, a plurality of pairs of the first image and the second image, ie, a plurality of image pairs in which different parts of the anterior segment are respectively depicted, are obtained.

Each Scheimpflug image (first image, second image) acquired by the ophthalmological apparatus 1000A of this aspect is arranged along a coordinate axis along the longitudinal direction of the beam shape of the slit light and along the projection direction of the slit light onto the subject's eye. This is an image representing a cross section of the anterior segment of the eye expressed in a two-dimensional coordinate system defined by the coordinate axes. When the longitudinal direction of the beam shape of the slit light is the Y direction, and the projection direction of the slit light is the Z direction, the ophthalmological apparatus 1000A of this embodiment can, for example, An image pair such as the pair with image 2200 (the pair of first image 2300 and second image 2400 shown in FIG. 5A) can be obtained.

Furthermore, the ophthalmological apparatus 1000A of this embodiment moves the first imaging unit 1110, the second imaging unit 1120, and the illumination system 1130 in the A plurality of image pairs can be collected, each corresponding to a cross section of the image.

The evaluation processing unit 1300 can generate evaluation information for floating objects in the aqueous humor based on each of a plurality of image pairs collected by three-dimensional scanning. This makes it possible to generate evaluation information for floating objects in the aqueous humor in a plurality of cross sections (for example, YZ cross sections) of the anterior segment. In other words, it is possible to generate evaluation information of floating substances in the aqueous humor in a three-dimensional region of the eye to be examined.

Further, the evaluation processing unit 1300 generates a three-dimensional distribution of predetermined evaluation values regarding floating objects in the aqueous humor based on a plurality of pieces of evaluation information on a plurality of cross sections of the anterior segment generated based on a plurality of pairs. I can do it. This evaluation value may be any type of evaluation value described in this disclosure. Visual information (eg, a color map) can be created and displayed from the generated three-dimensional distribution. Furthermore, the generated three-dimensional distribution can be analyzed.

In addition, the ophthalmological apparatus 1000A of this aspect projects the slit light onto the anterior segment of the eye onto which the illumination system 1130 projects the slit light, while the first imaging unit 1110 performs the first imaging under the first imaging condition. and second photography under the second photography condition by the second photography unit 1120 can be performed in parallel.

Furthermore, the ophthalmological apparatus 1000A of this embodiment uses the evaluation processing unit 1300 to generate a pair of the first image and the second image generated by the first imaging and the second imaging performed together with the projection of the slit light. Based on this, evaluation information on suspended matter in the aqueous humor can be generated.

More specifically, the floating object image detection unit 1310 of the ophthalmological apparatus 1000A of this aspect detects a first floating object image from a first image, and detects a second floating object image from a second image. be able to. Furthermore, the evaluation information generation unit 1320 of the ophthalmological apparatus 1000A of this embodiment generates illumination based on the first floating image detected from the first image and the second floating object image detected from the second image. The amount of movement of suspended matter in the aqueous humor in the first direction (e.g., Z direction), which is the projection direction of the slit light applied to the anterior segment by the system 1130, and the longitudinal direction of the beam shape of this slit light (e.g., The amount of movement of suspended matter in the aqueous humor in the Y direction) can be estimated.

With this, it is possible to detect the state of movement of the objects suspended in the aqueous humor in the first direction and the state of movement of the objects suspended in the aqueous humor in the second direction. Furthermore, the movement state of the suspended matter in the aqueous humor in a cross section parallel to the plane defined by the first direction and the second direction (for example, the YZ plane) (that is, the movement vector of the suspended matter in the aqueous humor in the cross section) can be detected.

The process of estimating the amount of movement in the first direction and the process of estimating the amount of movement in the second direction can be performed, for example, by the method described above, but the estimation method is not limited to this. For example, based on the displacement between the feature points of the first floating object image detected from the first image and the feature points of the second floating object image detected from the second image, the first The amount of movement in the direction and the amount of movement in the second direction can be estimated. As described above, the feature point of the floating object image may be any representative point of the floating object image, such as the center, the center of gravity, or one or more points on the boundary.

The evaluation information generation unit 1320 of the ophthalmological apparatus 1000A of this aspect operates in a third direction (for example, the X direction) orthogonal to both the first direction (for example, the Z direction) and the second direction (for example, the Y direction). It may be configured to estimate the amount of movement of suspended matter in the aqueous humor.

FIG. 7A shows a first image 2500 and a second image 2600 that are processed in this example. In this example, the first direction is the Z direction, the second direction is the Y direction, and the third direction is the X direction. Floating object image detection section 1310 detects first floating object image 2510 in first image 2500 and second floating object image 2610 in second image 2600.

For example, the evaluation information generation unit 1320 generates a first floating object image 2510 detected from the first image 2500 and a second floating object image 2510 detected from the second image 2600 using any of the methods described in the present disclosure. Estimating the movement vector of the floating object in the aqueous humor in the YZ plane based on the object image 2610, that is, estimating the movement vector of the floating object in the aqueous humor in the Y direction and the movement amount Δy of the floating object in the aqueous humor in the Z direction. The amount of movement Δz can be estimated.

Furthermore, the evaluation information generation unit 1320 can estimate the movement amount Δx of the floating object in the aqueous humor in the X direction based on the second floating object image 2610 detected from the second image 2600. In some exemplary aspects, the evaluation information generation unit 1320 is configured to estimate the movement amount Δx of the floating object in the aqueous humor in the X direction based on the degree of blurring of the second floating object image 2610. It's fine.

An example of a process for estimating the amount of movement Δx of floating matter in the aqueous humor in the X direction will be described. It is assumed that the objective lens of the second optical system 1121 of the second imaging unit 1120 has a numerical aperture NA. The evaluation information generation unit 1320 calculates the dimensions of the second floating object image 2610 detected from the second image 2600 generated by the second imaging unit 1120 and the numerical aperture NA of the objective lens of the second imaging unit 1120. Based on this, the amount of movement Δx of the suspended matter in the aqueous humor in the X direction can be estimated.

The dimension of the second floating object image 2610 may be, for example, the width w of the second floating object image 2610. The width w of the second floating object image 2610 is, for example, the dimension of the second floating object image 2610 in the direction perpendicular to the long axis 2220 of the second floating object image 2210 shown in FIG. It may be the length of the minor axis of the floating object image 2210 of No. 2 (see FIG. 7B). Even when the second floating object image 2610 is not elliptical, the dimensions (width) of the second floating object image 2610 can be determined in a similar manner.

The evaluation information generation unit 1320 calculates the amount of movement Δx in the X direction based on the width w of the second floating object image 2610 and the numerical aperture NA of the objective lens of the second imaging unit 1120 using the following formula. It is possible: Δx=w/(2×NA). Here, it is assumed that the imaging unit 1100 (second imaging unit 1120) has sufficient resolution in the depth direction (Z direction).

Furthermore, the evaluation information generation unit 1320 can calculate the three-dimensional movement amount D of the suspended matter in the aqueous humor using the following formula: D=(Δx^2+Δy^2+Δre^2)^(1/2). Furthermore, the evaluation information generation unit 1320 can obtain a three-dimensional movement vector (X, Y, Z)=(Δx, Δy, Δz) of the suspended matter in the aqueous humor.

Furthermore, the evaluation information generation unit 1320 can also calculate the moving speed of floating objects in the aqueous humor. For example, the evaluation information generation unit 1320 generates information such as the second exposure time “b” of the second image sensor 1122 of the second imaging unit 1120, the amount of movement Δx of the floating matter in the aqueous humor in the X direction, the amount of movement Δx of the floating matter in the aqueous humor, Based on the movement amount Δy of the object in the Y direction and the movement amount Δz of the object suspended in the aqueous humor in the z direction, the movement speed V ₁ of the object suspended in the aqueous humor can be calculated by the following formula: V ₁ =D/b=[(Δx^2+Δy^2+Δz^2)^(1/2)]/b. This moving speed V ₁ is an estimated value of the three-dimensional moving speed (speed) of the object suspended in the aqueous humor during the exposure period (second exposure period) of the second imaging unit 1120. Furthermore, the evaluation information generation unit 1320 can obtain a three-dimensional movement velocity vector (v _x , v _y , v _z )=(Δx/b, Δy/b, Δz/b) of the suspended matter in the aqueous humor. can.

As another example, the evaluation information generation unit 1320 may calculate the first exposure time “a” of the first image sensor 1112 of the first image capturing unit 1110 and the second exposure time “a” of the second image sensor 1122 of the second image capturing unit 1120. Exposure time "b" of 2, the amount of movement Δx of the floating substances in the aqueous humor in the X direction, the amount of movement Δy of the floating substances in the aqueous humor in the Y direction, and the amount of movement of the floating substances in the aqueous humor in the z direction Δz Based on this, the moving speed V ₂ of the suspended matter in the aqueous humor can be calculated by the following formula: V ₂ = D/(ba) = [(Δx^2+Δy^2+Δre^2)^(1/2 )]/(ba). This moving speed V ₂ is determined during the period from the end of the exposure period (first exposure period) of the first imaging section 1100 to the end of the exposure period (second exposure period) of the second imaging section 1120. This is an estimated value of the three-dimensional moving speed (speed) of suspended matter in the aqueous humor. In addition, the evaluation information generation unit 1320 generates a three-dimensional movement velocity vector (v _x , v _y , v _z )=(Δx/(ba), Δy/(ba)), Δz/(ba)) can be found.

In this way, the evaluation information generation unit 1320 generates a cluster based on the first floating object image and the second floating object image detected from the first image and the second image, respectively, by the floating object image detection unit 1310. It is possible to estimate the speed of movement of suspended objects in water.

The evaluation processing unit 1300 according to some exemplary aspects will be described. As shown in FIG. 8, the evaluation processing section 1300 of this embodiment includes a type identification section 1330 in addition to a floating object image detection section 1310 and an evaluation information generation section 1320 similar to those of the embodiment of FIG.

The type identification unit 1330 identifies images acquired by the imaging unit 1100 (a first image generated by the first imaging unit 1110 under a first imaging condition, and a second image generated by the first imaging unit 1110 under a second imaging condition). The second image generated by the imaging unit 1120) is configured to identify the type of suspended matter in the aqueous humor. Types of suspended matter in the aqueous humor include inflammatory cells, white blood cells (macrophages, lymphocytes, etc.), and blood proteins. The function of the type identification unit 1330 is realized by cooperation between software such as a type identification program and hardware such as a processor.

When a plurality of floating object images are detected from the image, the type identifying unit 1330 can identify, for each of the plurality of detected floating object images, the type of the floating object in the aqueous humor that corresponds to that floating object image. can. Further, the type identification unit 1330 can classify a plurality of floating object images based on the result of type identification.

In some exemplary embodiments, the type identification unit 1330 depicts the floating object image in the image based on the characteristics of the floating object image detected by the floating object image detection unit 1310 from the image acquired by the imaging unit 1100. It may be configured to identify the type of suspended matter in the aqueous humor. Examples of the characteristics of the floating object image used as criteria for identifying the type in this example include the brightness, size, shape, distribution state (number, density, position, etc.) of the floating object image, and movement state (moving direction, amount of movement, etc.). movement speed, etc.).

In some exemplary embodiments, the type identifying unit 1330 determines the type of floater in the aqueous humor depicted in the image of the anterior segment of the subject (patient) based on the subject's (patient) medical data. may be configured to identify the The medical data referred to in identifying the type in this example includes disease names (diagnosis names, suspected disease names, etc.), test data, doctor's findings, and the like. The medical data is obtained, for example, from patient data (electronic medical records, reports, medical documents, etc.) stored in a database.

In some exemplary embodiments, the type identification unit 1330 may be configured to identify the type of the object suspended in the aqueous humor based on an image obtained by imaging using polarized light. Photographing using polarized light is performed, for example, by projecting illumination light in a first polarization direction onto the subject's eye, and extracting and detecting a component in the second polarization direction from the returned light from the subject's eye.

By performing imaging with the first polarization direction and the second polarization direction parallel to each other, it is possible to detect a component whose polarization direction has not changed due to reflection at the subject's eye (regular reflection component). . As a result, a specular reflection image of the anterior segment of the eye is obtained.

Furthermore, by performing imaging with the first polarization direction and the second polarization direction orthogonal to each other, a component whose polarization direction has changed due to reflection at the subject's eye (diffuse reflection component) can be detected. I can do it. As a result, a diffuse reflection image of the anterior segment of the eye is obtained.

The evaluation processing unit 1300 of this embodiment may be configured to identify the type of floating matter in the aqueous humor based on the intensity ratio between the specular reflection image and the diffuse reflection image. First, the evaluation processing unit 1300 of this embodiment detects a floating object image from a specular reflection image and also detects a floating object image from a diffuse reflection image using a floating object image detection unit 1310.

If necessary, the type identification unit 1330 performs registration between the specular reflection image and the diffuse reflection image, and identifies one or more floating objects identified from the specular reflection image based on the result of this registration. A correspondence is established between the position (coordinates) of the image and the position (coordinate) of one or more floating object images identified from the diffuse reflection image. As a result, the floating object image in the specular reflection image and the floating object image in the diffuse reflection image, which correspond to the same floating object in the aqueous humor, are identified and associated with each other.

Next, the type identifying unit 1330 calculates the intensity value of the floating object image in the specular reflection image corresponding to one floating object in the aqueous humor, and also calculates the intensity value of the floating object image in the diffuse reflection image corresponding to the same floating object in the aqueous humor. Find the intensity value of the image. Intensity values are determined based on pixel values.

For example, the intensity value may be any statistic calculated from pixel values in the floating object image. This statistic may be, for example, an average, variance, standard deviation, maximum value, minimum value, mode, median value, etc.

Next, the type identifying unit 1330 determines the intensity value of a floating object image (specular reflection floating object image) in the specular reflection image corresponding to one floating object in the aqueous humor and the diffuse reflection corresponding to the same floating object in the aqueous humor. The intensity value of the floating object image (diffuse reflection floating object image) in the image is compared.

In some exemplary aspects, the type identification unit 1330 calculates a ratio T1/T2 between the intensity T1 of the specularly reflected floating object image and the intensity T2 of the diffusely reflected floating object image, and sets this ratio T1/T2 to a predetermined value. is compared with the threshold value TH. For example, if the absolute value abs(T1/T2) of the ratio T1/T2 is greater than or equal to the threshold TH, the type identifying unit 1330 estimates that the floating material is a macrophage, and also specifies the absolute value of the ratio T1/T2. If the value abs(T1/T2) is below a threshold TH, the float may be configured to be presumed to be a lymphocyte.

The evaluation information generating section 1320 of the evaluation processing section 1300 of this embodiment can generate evaluation information according to the type of floating matter in the aqueous humor specified by the type specifying section 1330. For example, the evaluation information generation unit 1320 may be configured to generate evaluation information for each type of floating matter in the aqueous humor.

In some exemplary embodiments, the type identification unit 1330 may be configured to refer to color information of the image in addition to or instead of the intensity values described above. If the first image acquired by the first image capture unit 1110 and/or the second image acquired by the second image capture unit 1120 are color images, the type identification unit 1330 may, for example, The configuration may be such that the type of floating matter in the aqueous humor is identified using at least one of three color component images (R component image, G component image, B component image), or three color component images. It may be configured to identify the type of floating matter in the aqueous humor using information generated based on the information (for example, luminance signal value (Y)), or to convert a color image into a monochrome image to identify the type of floating matter in the aqueous humor. It may be configured to identify the type of thing.

The type identification method executed by the type identification unit 1330 is not limited to the above example. For example, the type identifying unit 1330 can identify the type of floating matter in the aqueous humor based on evaluation of reflection wavelength characteristics using optical coherence tomography (OCT). The type identification method in this example is disclosed in the following documents, for example: RUOBING QIAN, RYAN P. MCNABB, KEVIN C. ZHOU, HAZEM M. MOUSA, DANIEL R. SABAN, VICTOR L. PEREZ, ANTHONY N. KUO , AND JOSEPH A. IZATT, “In vivo quantitative analysis of anterior chamber white blood cell mixture composition using spectroscopic optical coherence tomography”, Vol. 12, No. 4/1 April 2021 / Biomedical Optics Express, pp. 2134-2148. When the type identification method of this example is adopted, the ophthalmologic apparatus may include, for example, a known OCT scanner in addition to the configuration shown in FIG. 1 and the configuration shown in FIG. 8. Alternatively, the ophthalmologic apparatus may be configured to apply the type identification method of this example to an OCT image acquired by a separately provided OCT scanner.

Several examples will be described regarding the operation of the ophthalmological apparatus according to the embodiment. Two or more operational examples may be at least partially combined. Furthermore, matters described in one example of operation can be applied to other examples of operation. Furthermore, any of the matters described in this disclosure or equivalent matters may be combined with each operation example.

The first operation example will be explained with reference to FIG. In this operation example, the ophthalmological apparatus 1000 first applies a first imaging under the first imaging condition and a second imaging under the second imaging condition to the anterior segment of the eye to be examined ( S1).

The first imaging is performed by the first imaging unit 1110, and the second imaging is performed by the second imaging unit 1120. Parallel execution of the first imaging and the second imaging is realized by synchronous control executed by the control unit 1200.

Further, the ophthalmological apparatus 1000 estimates the anterior segment of the subject's eye based on the first image and second image generated by the first imaging and second imaging, respectively, which were performed in parallel in step S1. Evaluation information regarding floating objects present in the aqueous humor (in the anterior chamber) is generated (S2).

The evaluation information generated in step S2 may include, for example, the moving direction, moving amount, moving vector, moving speed, moving acceleration, etc. of the suspended matter in the aqueous humor.

The evaluation information generated in step S2 has various uses. For example, the evaluation information is stored in a storage device (not shown), and/or provided to generate visual information displayed on a display device (not shown), and/or provided to analysis processing by a computer (not shown).

A second operation example will be described with reference to FIG. In this operational example, the ophthalmological apparatus 1000 first performs a first imaging under a first imaging condition and a second imaging under a second imaging condition in the same manner as step S1 of the first operational example. In parallel, it is applied to the anterior segment of the eye to be examined (S11).

Next, the ophthalmological apparatus 1000 detects a first floating object image corresponding to a floating object in the aqueous humor from the first image generated by the first imaging in step S11 (S12), and A second floating object image corresponding to the same floating object in the aqueous humor is detected from the second image generated in the second imaging (S13).

Note that the step of detecting the first floating object image and the step of detecting the second floating object may be performed in any order, or these steps may be performed in parallel.

Next, the ophthalmological apparatus 1000 detects the tuft based on the first floating object image detected from the first image in step S12 and the second floating object image detected from the second image in step S13. Evaluation information for floating objects in water is generated (S14). The generated evaluation information is provided for various purposes.

A third operation example will be described with reference to FIG. 11. In this operation example, the ophthalmological apparatus 1000 first applies a scan to a three-dimensional region of the anterior segment of the eye to be examined (S21).

The three-dimensional scan in step S21 is realized by combining parallel execution of first imaging under the first imaging condition and second imaging under the second imaging condition, and movement of the imaging position. Ru. The parallel execution of the first photographing under the first photographing condition and the second photographing under the second photographing condition is realized in the same manner as step S1 of the first operation example. The movement of the photographing position is realized by the movement mechanism 1400 moving the photographing section 1100 (first optical system 1111 and second optical system 1121) under the control of the control section 1200.

Through the three-dimensional scan in step S21, the first image and the second image generated in the first and second photography performed in parallel are obtained from the three-dimensional area of the anterior segment of the subject's eye. Multiple pairs are collected. That is, by the three-dimensional scan in step S21, a plurality of image pairs (a pair of a first image and a second image) each depicting the state of a plurality of cross sections in a three-dimensional region of the anterior segment of the subject's eye are generated. be done.

Next, for each of the plurality of imaging positions (scanning positions), the ophthalmological apparatus 1000 performs an imaging process based on the pair of the first image and the second image corresponding to the imaging position. Evaluation information on floating matter in the aqueous humor present in the cross section of the eye is generated (S22). As a result, a plurality of pieces of evaluation information respectively corresponding to a plurality of photographing positions can be obtained.

Next, based on the plurality of pieces of evaluation information generated in step S22, the ophthalmological apparatus 1000 determines a predetermined value regarding the floating matter in the aqueous humor present in the three-dimensional region of the anterior segment to which the three-dimensional scan in step S21 was applied. A three-dimensional distribution of evaluation values is generated (S23).

The three-dimensional distribution generated in step S23 can be provided for various purposes. For example, the three-dimensional distribution is stored in a storage device (not shown), and/or provided to generate visual information displayed on a display device (not shown), and/or provided to analysis processing by a computer (not shown). . Similarly, the plural pieces of evaluation information generated in step S22 can also be provided for various purposes.

A fourth operation example will be described with reference to FIG. 12. In this operational example, the ophthalmological apparatus 1000 first performs a first imaging under a first imaging condition and a second imaging under a second imaging condition in the same manner as step S1 of the first operational example. In parallel, it is applied to the anterior segment of the eye to be examined (S31).

Next, the ophthalmological apparatus 1000 specifies the type of floating matter in the aqueous humor depicted in the first image and second image generated in the first imaging and second imaging in step S31 ( S32).

Next, the ophthalmological apparatus 1000 generates evaluation information of the floating matter in the aqueous humor according to the type of the floating matter in the aqueous humor identified in step S32 (S33).

The evaluation information generated in step S33 according to the type of suspended matter in the aqueous humor is provided for various purposes. For example, the evaluation information generated in this operation example is stored according to the type of floating matter in the aqueous humor, and/or provided to generate visual information according to the type of floating matter in the aqueous humor, and /Or provided for analysis processing according to the type of suspended matter in the aqueous humor.

FIG. 13 shows one example of a more specific configuration of the ophthalmologic apparatus according to the embodiment. FIG. 13 is a top view.

The direction along the axis of the eye E to be examined is the Z direction, and among the directions perpendicular to this, the left and right directions for the examinee are the X direction, and the directions perpendicular to both the X direction and the Z direction (vertical direction, body axis direction) ) is the Y direction.

The ophthalmological apparatus of this example is a slit lamp microscope system 1 having a configuration similar to that disclosed in Patent Document 3 (Japanese Patent Laid-Open No. 2019-213733), and includes an illumination optical system 2 and a photographing optical system 3. , a moving image photographing optical system 4, an optical path coupling element 5, a moving mechanism 6, a control section 7, a data processing section 8, a communication section 9, and a user interface 10.

The cornea of the eye E to be examined is indicated by the symbol C, and the crystalline lens is indicated by the symbol CL. The anterior chamber corresponds to the area between the cornea C and the crystalline lens CL (the area between the cornea C and the iris).

For details of each element of the slit lamp microscope system 1, please refer to Patent Document 3 (Japanese Patent Application Laid-Open No. 2019-213733).

The illumination optical system 2 projects a slit light onto the anterior segment of the eye E to be examined. Reference numeral 2a indicates the optical axis (illumination optical axis) of the illumination optical system 2.

The photographing optical system 3 photographs the anterior segment of the eye onto which the slit light from the illumination optical system 2 is projected. Reference numeral 3a indicates the optical axis (photographing optical axis) of the photographing optical system 3. The optical system 3A guides light from the anterior segment of the subject's eye E onto which the slit light is projected to the image sensor 3B. The image sensor 3B receives the light guided by the optical system 3A on its imaging surface. The image sensor 3B includes an area sensor (CCD area sensor, CMOS area sensor, etc.) having a two-dimensional imaging area. Although not shown in FIG. 13, the photographing optical system 3 includes two photographing optical systems (a first photographing section and a second photographing section). The two photographing optical systems will be described later with reference to FIG. 14.

The illumination optical system 2 and the photographing optical system 3 function as a Scheimpflug camera, and are designed so that the object surface along the illumination optical axis 2a, the imaging surface of the optical system 3A and the image sensor 3B satisfy Scheimpflug conditions. In other words, the YZ plane (including the object plane) passing through the illumination optical axis 2a, the main surface of the optical system 3A, and the imaging surface of the image sensor 3B are configured to intersect on the same straight line.

Thereby, the illumination optical system 2 and the photographing optical system 3 can perform photographing in a state in which at least the range from the posterior surface of the cornea C to the anterior surface of the crystalline lens CL (anterior chamber) is in focus. In addition, the illumination optical system 2 and the photographing optical system 3 are in focus at least in the range from the vertex of the front surface of the cornea C (Z=Z1) to the vertex of the rear surface of the crystalline lens CL (Z=Z2). It can be performed. Note that the coordinate Z=Z0 indicates the intersection of the illumination optical axis 2a and the photographing optical axis 3a.

The video photographing optical system 4 is a video camera, and takes a video of the anterior segment of the eye E in parallel with the photographing of the eye by the illumination optical system 2 and the photographing optical system 3. The optical path coupling element 5 couples the optical path of the illumination optical system 2 (illumination optical path) and the optical path of the video imaging optical system 4 (video imaging optical path).

A specific example of an optical system including the illumination optical system 2, the photographing optical system 3, the moving image photographing optical system 4, and the optical path coupling element 5 is shown in FIG. The optical systems shown in FIG. 14 include an illumination optical system 20 which is an example of the illumination optical system 2, a left photographing optical system 30L and a right photographing optical system 30R which are examples of the photographing optical system 3, and an example of the video photographing optical system 4. The optical system 40 includes a moving image photographing optical system 40, which is a moving image photographing optical system 40, and a beam splitter 47, which is an example of an optical path coupling element 5.

Reference numeral 20a indicates the optical axis (illumination optical axis) of the illumination optical system 20, reference numeral 30La indicates the optical axis (left imaging optical axis) of the left photographing optical system 30L, and reference numeral 30Ra indicates the optical axis (of the right photographing optical system 30R). right photographing optical axis). The angle θL indicates the angle between the illumination optical axis 20a and the left photographing optical axis 30La, and the angle θR indicates the angle between the illumination optical axis 20a and the right photographing optical axis 30Ra. Coordinate Z=Z0 indicates the intersection of the illumination optical axis 20a, the left photographing optical axis 30La, and the right photographing optical axis 30Ra.

The moving mechanism 6 moves the illumination optical system 20, the left photographing optical system 30L, and the right photographing optical system 30R in the direction shown by the arrow 49 (X direction).

The illumination light source 21 of the illumination optical system 20 outputs illumination light (for example, visible light), and the positive lens 22 refracts the illumination light. The slit forming section 23 forms a slit to allow part of the illumination light to pass through. The generated slit light is refracted by the

objective lens groups

24 and 25, reflected by the beam splitter 47, and projected onto the anterior segment of the eye E to be examined.

The reflector 31L and the imaging lens 32L of the left photographing optical system 30L direct light from the anterior segment of the eye onto which the slit light is projected by the illumination optical system 20 (light traveling in the direction of the left photographing optical system 30L) to the imaging element. Leads to 33L. The image sensor 33L receives the guided light at an image pickup surface 34L.

The left photographing optical system 30L repeatedly performs photographing in parallel with the movement of the illumination optical system 20, left photographing optical system 30L, and right photographing optical system 30R by the moving mechanism 6. As a result, a plurality of anterior segment images (a series of Scheimpflug images) are obtained.

The object surface along the illumination optical axis 20a, the optical system including the reflector 31L and the imaging lens 32L, and the imaging surface 34L satisfy the Scheimpflug condition. The right photographing optical system 30R also has a similar configuration and function.

Scheimpflug image collection by the left photographing optical system 30L and Scheimpflug image collection by the right photographing optical system 30R are performed in parallel with each other. For example, the left photographing optical system 30L is used for the first photographing under the first photographing condition, and the right photographing optical system 30R is used for the second photographing under the second photographing condition. Alternatively, the left photographing optical system 30L is used for the second photographing under the second photographing condition, and the right photographing optical system 30R is used for the first photographing under the first photographing condition.

The control unit 7 can synchronize repeated shooting by the left shooting optical system 30L and repeated shooting by the right shooting optical system 30R. Thereby, a correspondence relationship between the series of Scheimpflug images obtained by the left photographing optical system 30L and the series of Scheimpflug images obtained by the right photographing optical system 30R is obtained.

Note that the process of determining the correspondence between the plurality of anterior eye segment images obtained by the left photographing optical system 30L and the plurality of anterior eye segment images obtained by the right photographing optical system 30R is performed by the control unit 7 or the data. It may also be executed by the processing unit 8.

The video photographing optical system 40 photographs a video of the anterior segment of the subject's eye E from a fixed position in parallel with the photographing by the left photographing optical system 30L and the photographing by the right photographing optical system 30R. The light that has passed through the beam splitter 47 is reflected by a reflector 48 and enters the moving image photographing optical system 40 . The light incident on the moving image photographing optical system 40 is refracted by an objective lens 41 and then imaged by an imaging lens 42 on an imaging surface of an image sensor 43 (area sensor). The moving image photographing optical system 40 is used for monitoring the movement of the eye E to be examined, alignment, tracking, processing of collected Scheimpflug images, and the like.

Referring back to FIG. 13. The moving mechanism 6 moves the illumination optical system 2 and the photographing optical system 3 integrally in the X direction.

The control unit 7 controls each part of the slit lamp microscope system 1. The control unit 7 executes the control of the illumination optical system 2, the photographing optical system 3, and the moving mechanism 6, and the control of the video photographing optical system 4 in parallel with each other, thereby performing a three-dimensional scan (a series of scans) of the anterior segment of the eye. (collection of Scheimpflug images) and video recording of the anterior segment (collection of a series of time-series images) can be performed in parallel.

In addition, the control unit 7 performs three-dimensional scanning of the anterior segment of the eye by controlling the illumination optical system 2, the photographing optical system 3, and the moving mechanism 6, and controlling the video photographing optical system 4 in synchronization with each other. and video recording of the anterior segment of the eye can be synchronized with each other.

When the photographing optical system 3 includes a left photographing optical system 30L and a right photographing optical system 30R, the control unit 7 controls repeated photographing (collection of Scheimpflug image groups) by the left photographing optical system 30L and repetition by the right photographing optical system 30R. Photographing (collection of Scheimpflug image groups) can be synchronized with each other. As a result, the pair operation of the first photographing under the first photographing condition and the second photographing under the second photographing condition and the movement of the photographing position are combined (in parallel). can be executed synchronously).

The control unit 7 includes a processor, a storage device, and the like. The storage device stores computer programs such as various control programs. The functions of the control unit 7 are realized by cooperation between software such as a control program and hardware such as a processor. The control unit 7 controls the illumination optical system 2, the photographing optical system 3, and the movement mechanism 6 in order to scan the three-dimensional region of the anterior segment of the eye E to be examined using the slit light. For details of this control, please refer to Patent Document 3 (Japanese Unexamined Patent Publication No. 2019-213733). The control unit 7 has the function of the control unit 1200 of the ophthalmological apparatus 1000. The functions of the control unit 7 are not limited to those described here.

The data processing unit 8 executes various data processing. The data processing unit 8 includes a processor, a storage device, and the like. The storage device stores computer programs such as various data processing programs. The functions of the data processing section 8 are realized by cooperation between software such as a data processing program and hardware such as a processor. The data processing section 8 has the function of the evaluation processing section 1300 of the ophthalmological apparatus 1000. The function of the data processing section 8 is not limited to this.

The communication unit 9 performs data communication between the slit lamp microscope system 1 and other devices. The user interface 10 includes any user interface devices such as a display device and an operation device.

The slit lamp microscope system 1 shown in FIGS. 13 and 14 is a non-limiting example, and the configuration for implementing the ophthalmologic apparatus 1000 (1000A) is not limited to the slit lamp microscope system 1.

Some non-limiting features of the ophthalmological device according to the embodiment will be described.

A first aspect of the ophthalmological apparatus according to the embodiment includes a first optical system that satisfies Scheimpflug conditions, and applies first imaging under a first imaging condition to the anterior segment of the eye to be examined. It includes a first imaging section and a second optical system that satisfies Scheimpflug conditions, and performs a second imaging under a second imaging condition different from the first imaging condition in parallel with the first imaging. a second imaging unit applied to the anterior segment of the eye; and a second imaging unit applied to the anterior segment of the eye; The ophthalmologic apparatus includes an evaluation processing unit that generates evaluation information of an object.

The second aspect of the ophthalmological apparatus according to the embodiment includes the following non-limiting features in addition to the non-limiting features of the first aspect. The first optical system includes a first image sensor, the second optical system includes a second image sensor, and the first imaging condition is an exposure time of the first image sensor. The second photographing condition includes a second exposure time that is the exposure time of the second image sensor, and the second exposure time is equal to the first exposure time. longer than

The third aspect of the ophthalmological apparatus according to the embodiment includes the following non-limiting features in addition to the non-limiting features of the second aspect. The evaluation processing section is a floating object image detection section that detects a first floating object image in the first image and a second floating object image in the second image that correspond to the same floating object in the aqueous humor. and an evaluation information generation unit that generates evaluation information of the floating object in the aqueous humor based on the first floating object image and the second floating object image.

The fourth aspect of the ophthalmological apparatus according to the embodiment includes the following non-limiting features in addition to the non-limiting features of the third aspect. The evaluation information generation unit estimates the moving direction of the floating object in the aqueous humor based on the second floating object image.

The fifth aspect of the ophthalmological apparatus according to the embodiment includes the following non-limiting features in addition to the non-limiting features of the third or fourth aspect. The evaluation information generation unit estimates a movement vector of the floating object in the aqueous humor based on the first floating object image and the second floating object image.

The sixth aspect of the ophthalmological apparatus according to the embodiment includes the following non-limiting features in addition to the non-limiting features of the fifth aspect. The evaluation information generation unit obtains feature points of the first floating object image, and estimates the movement vector based on the feature points of the first floating object image and the second floating object image.

The seventh aspect of the ophthalmological apparatus according to the embodiment includes the following non-limiting features in addition to the non-limiting features of the sixth aspect. The evaluation information generation unit specifies a position in the second floating object image that corresponds to the feature point of the first floating object image, and calculates the movement vector based on the position corresponding to the feature point. presume.

The eighth aspect of the ophthalmological apparatus according to the embodiment includes the following non-limiting features in addition to the non-limiting features of the seventh aspect. The evaluation information generation unit is configured to calculate the position in the second floating object image corresponding to the feature point of the first floating object image, the exposure period of the first image sensor, and the second imaging device. The movement vector is estimated based on the timing relationship with the exposure period of the element.

The ninth aspect of the ophthalmological apparatus according to the embodiment has the following non-limiting features in addition to the non-limiting features of any of the third to eighth aspects. further comprising an illumination system that projects a slit light onto the anterior segment of the eye, the first imaging and the second imaging are applied to the anterior segment onto which the slit light is projected, and the evaluation information generating unit estimates the amount of movement of the floating material in the aqueous humor in the first direction, which is the projection direction of the slit light, and the amount of movement of the floating material in the aqueous humor in the longitudinal direction of the beam shape of the slit light.

The tenth aspect of the ophthalmological apparatus according to the embodiment includes the following non-limiting features in addition to the non-limiting features of the ninth aspect. The evaluation information generation unit estimates the amount of movement of the floating object in the aqueous humor in a third direction perpendicular to both the first direction and the second direction.

The eleventh aspect of the ophthalmological apparatus according to the embodiment includes the following non-limiting features in addition to the non-limiting features of the tenth aspect. The second optical system includes an objective lens, and the evaluation information generation unit estimates the amount of movement in the third direction based on the dimensions of the second floating object image and the numerical aperture of the objective lens. do.

The twelfth aspect of the ophthalmologic apparatus according to the embodiment includes the following non-limiting features in addition to the non-limiting features of the eleventh aspect. The evaluation information generation unit calculates the width of the second floating object image as the dimension of the second floating object image.

The thirteenth aspect of the ophthalmological apparatus according to the embodiment has the following non-limiting features in addition to the non-limiting features of any of the tenth to twelfth aspects. The evaluation information generation unit is configured to generate the second exposure time of the second image sensor, the amount of movement in the first direction, the amount of movement in the second direction, and the movement in the third direction. Based on the amount, the moving speed of the suspended matter in the aqueous humor is estimated.

The fourteenth aspect of the ophthalmological apparatus according to the embodiment has the following non-limiting features in addition to the non-limiting features of any of the tenth to thirteenth aspects. The evaluation information generation unit is configured to generate the first exposure time of the first image sensor, the second exposure time of the second image sensor, the amount of movement in the first direction, and the second direction. The moving speed of the floating object in the aqueous humor is estimated based on the moving amount in the third direction and the moving amount in the third direction.

The fifteenth aspect of the ophthalmological apparatus according to the embodiment has the following non-limiting features in addition to the non-limiting features of any one of the third to fourteenth aspects. The evaluation information generation unit estimates the moving speed of the floating object in the aqueous humor based on the first floating object image and the second floating object image.

The 16th aspect of the ophthalmological apparatus according to the embodiment has the following non-limiting features in addition to the non-limiting features of any of the 3rd to 15th aspects. The floating object image detection unit detects a first image set including images of a plurality of objects floating in the aqueous humor from the first image, and detects images of a plurality of objects floating in the aqueous humor from the second image. detecting a second image set including the first image set and determining a positional correspondence relationship between the first image set and the second image set, and the evaluation information generating unit Based on a pair of one element of the first image set and one element of the second image set, evaluation information of floating matter in the aqueous humor corresponding to the pair is generated.

The seventeenth aspect of the ophthalmological apparatus according to the embodiment has the following non-limiting features in addition to the non-limiting features of any one of the third to sixteenth aspects. The floating object image detection unit detects a floating object image from one of the first image and the second image, determines the coordinates of the floating object image in the one image, and calculates the coordinates of the floating object image in the one image, and and the other image of the second image, the floating object image at a position corresponding to the coordinates is detected, and the evaluation information generation section detects the floating object image detected from the one image and the floating object image detected from the one image. Based on the pair with the floating object image detected from the other image, evaluation information of the floating object in the aqueous humor corresponding to the pair is generated.

The 18th aspect of the ophthalmological apparatus according to the embodiment has the following non-limiting features in addition to the non-limiting features of any of the 2nd to 17th aspects. By combining a moving mechanism that moves the first optical system and the second optical system, control of the first photographing section, control of the second photographing section, and control of the moving mechanism, the The image forming apparatus further includes a control section that causes the first photographing section and the second photographing section to generate a plurality of pairs of the first image and the second image.

The nineteenth aspect of the ophthalmological apparatus according to the embodiment includes the following non-limiting features in addition to the non-limiting features of the eighteenth aspect. The evaluation processing section generates evaluation information based on each of the plurality of pairs.

The 20th aspect of the ophthalmological apparatus according to the embodiment includes the following non-limiting features in addition to the non-limiting features of the 19th aspect. The evaluation processing section generates a three-dimensional distribution of predetermined evaluation values based on the plurality of evaluation information generated based on the plurality of pairs.

The twenty-first aspect of the ophthalmological apparatus according to the embodiment has the following non-limiting features in addition to the non-limiting features of any of the second to twentieth aspects. The evaluation processing section includes a type specifying section that specifies the type of floating matter in the aqueous humor depicted in the first image and the second image.

The 22nd aspect of the ophthalmological apparatus according to the embodiment includes the following non-limiting features in addition to the non-limiting features of the 21st aspect. The evaluation processing section generates evaluation information according to the type of the floating object in the aqueous humor specified by the type specifying section.

As described in the present disclosure, an ophthalmological device having these non-limiting features can improve the quality of the process of evaluating suspended matter in the aqueous humor based on images acquired in ophthalmic imaging. It is possible.

By combining any of the matters described in the present disclosure with an ophthalmological device having any of the non-limiting features, it is possible to further improve the quality of the evaluation of suspended matter in the aqueous humor, and Those skilled in the art will appreciate that it is possible to provide a variety of applications for the assessment of suspended solids in water.

<Other embodiments>
Although embodiments of ophthalmological devices have been described so far, embodiments according to the present disclosure are not limited to ophthalmological devices. Embodiments other than ophthalmological devices include a method for controlling an ophthalmological device, a program, a recording medium, and the like. Similar to the embodiments of the ophthalmological device, these embodiments also allow for improved quality of the evaluation of suspended matter in the aqueous humor.

A method for controlling an ophthalmological apparatus according to one embodiment is a method for controlling an ophthalmological apparatus.

This ophthalmological apparatus includes a first imaging section, a second imaging section, and a processor. The first imaging section includes a first optical system that satisfies Scheimpflug conditions. The second photographing section includes a second optical system that satisfies Scheimpflug conditions.

The method according to this embodiment is configured to cause a processor included in the ophthalmologic apparatus to function as a control unit and an evaluation processing unit.

The processor functioning as a control unit according to the method according to the present embodiment controls the first imaging unit to apply the first imaging under the first imaging condition to the anterior segment of the subject's eye; The second imaging unit is controlled to apply a second imaging under a second imaging condition different from the imaging conditions to the anterior segment of the eye in parallel with the first imaging.

According to the method according to the present embodiment, the processor functioning as an evaluation processing unit evaluates the amount of suspended matter in the aqueous humor based on the first image generated in the first imaging and the second image generated in the second imaging. generate evaluation information.

Any of the items described in this disclosure can be combined with the method according to this embodiment.

A program according to one embodiment is a program for operating an ophthalmological apparatus.

The program according to this embodiment is configured to cause a processor included in an ophthalmologic apparatus to function as a control unit and an evaluation processing unit.

A processor functioning as a control unit according to the program according to the present embodiment controls the first imaging unit to apply the first imaging under the first imaging condition to the anterior segment of the subject's eye, and The second imaging unit is controlled to apply a second imaging under a second imaging condition different from the imaging conditions to the anterior segment of the eye in parallel with the first imaging.

According to the program according to the present embodiment, the processor functioning as an evaluation processing unit evaluates the floating matter in the aqueous humor based on the first image generated in the first imaging and the second image generated in the second imaging. generate evaluation information.

Any items described in this disclosure can be combined with the program according to this embodiment.

The recording medium according to one embodiment is a computer-readable non-temporary recording medium in which a program for operating an ophthalmological apparatus is recorded.

The program recorded on the recording medium according to this embodiment is configured to cause the processor included in the ophthalmologic apparatus to function as a control unit and an evaluation processing unit.

A processor functioning as a control unit according to a program recorded in a recording medium according to the present embodiment includes a first imaging unit for applying a first imaging under a first imaging condition to the anterior segment of the subject's eye. and control of a second imaging unit to apply a second imaging to the anterior segment of the eye in parallel with the first imaging under a second imaging condition different from the first imaging condition. .

The processor functioning as an evaluation processing unit by the program recorded on the recording medium according to the present embodiment is configured to compare the first image generated in the first imaging and the second image generated in the second imaging. Based on this, evaluation information for suspended matter in the aqueous humor is generated.

Any of the items described in this disclosure can be combined with the recording medium according to this embodiment.

The computer-readable non-temporary recording medium that can be used as the recording medium according to the present embodiment may be any type of recording medium, such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory. It may be.

Any of the items described in the ophthalmological device embodiments can be combined in non-ophthalmological device embodiments.

For example, items arbitrarily selected from various items described as arbitrary aspects of the ophthalmological apparatus according to the embodiments may be used as an embodiment of the ophthalmological apparatus control method, a program embodiment, and a recording medium embodiment. It can be combined with etc.

Furthermore, any of the matters described in the present disclosure can be combined into an embodiment of a method for controlling an ophthalmologic apparatus, an embodiment of a program, an embodiment of a recording medium, and the like.

This disclosure presents several embodiments and some exemplary aspects thereof. These embodiments and aspects are merely illustrative of the invention. Therefore, any modification (omission, substitution, addition, etc.) within the scope of the gist of the present invention can be applied to the embodiments and aspects presented in this disclosure.

1 Slit lamp microscope system (ophthalmological equipment)
2 Illumination optical system 3 Photographic optical system 3B Image sensor 6 Movement mechanism 7 Control section 20 Illumination optical system 30L Left photographing optical system 30R Right photographing

optical system

33L,

33R Imaging elements

1000, 1000A Ophthalmic apparatus 1100 Photographing section 1110 First photographing section 1111 First optical system 1112 First image sensor 1120 Second image sensor 1121 Second optical system 1122 Second image sensor 1130 Illumination system 1200 Control section 1300 Evaluation processing section 1310 Floating object image detection section 1320 Evaluation information generation Section 1330 Type identification section 1400 Movement mechanism

Claims

a first imaging unit that includes a first optical system that satisfies Scheimpflug conditions and applies first imaging under first imaging conditions to the anterior segment of the subject's eye;
including a second optical system that satisfies Scheimpflug conditions, and applies a second imaging to the anterior segment of the eye in parallel with the first imaging under a second imaging condition different from the first imaging condition. a second photography department,
an ophthalmology clinic comprising: an evaluation processing unit that generates evaluation information of suspended matter in the aqueous humor based on a first image generated in the first imaging and a second image generated in the second imaging. Device.
The first optical system includes a first image sensor,
The second optical system includes a second image sensor,
The first imaging condition includes a first exposure time that is an exposure time of the first image sensor,
The second photographing condition includes a second exposure time that is an exposure time of the second image sensor,
the second exposure time is longer than the first exposure time,
The ophthalmological device of claim 1.
The evaluation processing unit is
a floating object image detection unit that detects a first floating object image in the first image and a second floating object image in the second image that correspond to the same floating object in the aqueous humor;
an evaluation information generation unit that generates evaluation information of the floating object in the aqueous humor based on the first floating object image and the second floating object image;
The ophthalmological device according to claim 2.
The evaluation information generation unit estimates a moving direction of the floating object in the aqueous humor based on the second floating object image.
The ophthalmological device according to claim 3.
The evaluation information generation unit estimates a movement vector of the floating object in the aqueous humor based on the first floating object image and the second floating object image.
The ophthalmological device according to claim 3.
The evaluation information generation unit includes:
determining feature points of the first floating object image;
estimating the movement vector based on the feature point of the first floating object image and the second floating object image;
The ophthalmological device according to claim 5.
The evaluation information generation unit includes:
specifying a position in the second floating object image that corresponds to the feature point of the first floating object image;
estimating the movement vector based on the position corresponding to the feature point;
The ophthalmological device according to claim 6.
The evaluation information generation unit is configured to determine the position in the second floating object image that corresponds to the feature point of the first floating object image, the exposure period of the first imaging device, and the second imaging device. estimating the movement vector based on a timing relationship with an exposure period of the element;
The ophthalmological device according to claim 7.
further comprising an illumination system that projects a slit light onto the anterior segment of the eye,
The first imaging and the second imaging are applied to the anterior segment of the eye onto which the slit light is projected,
The evaluation information generation unit is configured to calculate the amount of movement of the floating object in the aqueous humor in a first direction that is the projection direction of the slit light, and the amount of movement of the floating object in the aqueous humor in the longitudinal direction of the beam shape of the slit light. to estimate,
The ophthalmological device according to claim 3.
The evaluation information generation unit estimates a movement amount of the suspended matter in the aqueous humor in a third direction orthogonal to both the first direction and the second direction.
The ophthalmological device according to claim 9.
The second optical system includes an objective lens,
The evaluation information generation unit estimates the amount of movement in the third direction based on the dimensions of the second floating object image and the numerical aperture of the objective lens.
The ophthalmological device of claim 10.
The evaluation information generation unit calculates a width of the second floating object image as the dimension of the second floating object image.
The ophthalmological device of claim 11.
The evaluation information generation unit is configured to calculate the second exposure time of the second image sensor, the amount of movement in the first direction, the amount of movement in the second direction, and the movement in the third direction. estimating the movement speed of the suspended matter in the aqueous humor based on the amount;
The ophthalmological device of claim 10.
The evaluation information generation unit includes the first exposure time of the first image sensor, the second exposure time of the second image sensor, the amount of movement in the first direction, and the second direction. estimating the moving speed of the floating object in the aqueous humor based on the moving amount in the third direction and the moving amount in the third direction;
The ophthalmological device of claim 10.
The evaluation information generation unit estimates a moving speed of the floating object in the aqueous humor based on the first floating object image and the second floating object image.
The ophthalmological device according to claim 3.
The floating object image detection section includes:
detecting a first image set including images of a plurality of floating objects in the aqueous humor from the first image;
detecting a second image set including images of a plurality of suspended objects in the aqueous humor from the second image;
determining a positional correspondence between the first image set and the second image set;
The evaluation information generation unit is configured to respond to a pair based on a pair of one element of the first image set and one element of the second image set, which are associated based on the positional correspondence relationship. generate evaluation information of suspended matter in the aqueous humor,
The ophthalmological device according to claim 3.
The floating object image detection section includes:
detecting a floating object image from one of the first image and the second image;
Determine the coordinates of the floating object image in the one image,
detecting a floating object image at a position corresponding to the coordinates from the other of the first image and the second image;
The evaluation information generation unit is configured to determine, based on a pair of the floating object image detected from the one image and the floating object image detected from the other image, the floating object in the aqueous humor corresponding to the pair. generate evaluation information;
The ophthalmological device according to claim 3.
a moving mechanism that moves the first optical system and the second optical system;
By combining the control of the first photographing unit, the control of the second photographing unit, and the control of the moving mechanism, a plurality of pairs of the first image and the second image are further comprising: an imaging unit and a control unit that causes the second imaging unit to generate the image;
The ophthalmological device according to claim 2.
The evaluation processing unit generates evaluation information based on each of the plurality of pairs.
The ophthalmological device of claim 18.
The evaluation processing unit generates a three-dimensional distribution of predetermined evaluation values based on the plurality of evaluation information generated based on the plurality of pairs.
The ophthalmological device of claim 19.
The evaluation processing unit includes a type identifying unit that identifies the type of floating matter in the aqueous humor depicted in the first image and the second image.
The ophthalmological device according to claim 2.
The evaluation processing unit generates evaluation information according to the type of the floating substance in the aqueous humor specified by the type identification unit.
The ophthalmological device of claim 21.
Controls an ophthalmological apparatus including a first imaging unit including a first optical system that satisfies Scheimpflug conditions, a second imaging unit that includes a second optical system that satisfies Scheimpflug conditions, and a processor. A method of
The processor,
controlling the first imaging unit to apply first imaging under a first imaging condition to the anterior segment of the subject's eye; and controlling a second imaging unit under a second imaging condition different from the first imaging condition. a control unit that controls the second imaging unit to apply imaging to the anterior segment in parallel with the first imaging;
A method for functioning as an evaluation processing unit that generates evaluation information for suspended matter in the aqueous humor based on a first image generated in the first imaging and a second image generated in the second imaging. .
Operates an ophthalmological apparatus that includes a first imaging unit including a first optical system that satisfies Scheimpflug conditions, a second imaging unit that includes a second optical system that satisfies Scheimpflug conditions, and a processor. It is a program to make
The processor,
controlling the first imaging unit to apply first imaging under a first imaging condition to the anterior segment of the subject's eye; and controlling a second imaging unit under a second imaging condition different from the first imaging condition. a control unit that controls the second imaging unit to apply imaging to the anterior segment in parallel with the first imaging;
A program that functions as an evaluation processing unit that generates evaluation information for suspended matter in the aqueous humor based on a first image generated in the first image capture and a second image generated in the second image capture. .
Operates an ophthalmological apparatus that includes a first imaging unit including a first optical system that satisfies Scheimpflug conditions, a second imaging unit that includes a second optical system that satisfies Scheimpflug conditions, and a processor. A computer-readable non-transitory recording medium on which a program for
The program causes the processor to
controlling the first imaging unit to apply first imaging under a first imaging condition to the anterior segment of the subject's eye; and controlling a second imaging unit under a second imaging condition different from the first imaging condition. a control unit that controls the second imaging unit to apply imaging to the anterior segment in parallel with the first imaging;
a recording unit that functions as an evaluation processing unit that generates evaluation information for suspended matter in the aqueous humor based on a first image generated in the first image capture and a second image generated in the second image capture; Medium.