WO2023176599A1

WO2023176599A1 - Fundus-imaging device and fundus-imaging method

Info

Publication number: WO2023176599A1
Application number: PCT/JP2023/008671
Authority: WO
Inventors: 達昌今井
Original assignee: ソニーグループ株式会社
Priority date: 2022-03-16
Filing date: 2023-03-07
Publication date: 2023-09-21

Abstract

A fundus-imaging device according to the present disclosure comprises: a first optical unit (2) provided between an eye to be examined and an imaging unit for imaging the fundus of the eye to be examined, the first optical unit (2) changing the field-of-view direction of the imaging unit with respect to the eye to be examined; and a second optical unit (4) provided between the first optical unit and the imaging unit, the second optical unit (4) correcting the direction of travel of light emitted from the fundus and beamed into the imaging unit via the first optical unit.

Description

Fundus imaging device and fundus imaging method

The present disclosure relates to a fundus imaging device and a fundus imaging method.

Fundus imaging devices that photograph the fundus of the eye through the pupil are known. Fundus imaging devices are broadly classified into stationary devices and handheld devices. In a stationary type device, a fundus imaging device is installed on a table or the like, the subject's head is fixed relative to the fundus imaging device, and fundus imaging is performed. On the other hand, in a hand-held device, a person holds the fundus imaging device and, for example, brings the fundus imaging device into contact with the head (eyeball portion) of the subject to photograph the fundus.

In conventional fundus imaging devices, the optical axis from the tip of the photographic lens to the imaging surface is fixed. Therefore, in order to appropriately set the image frame on the imaging surface side, the photographer needs to move the entire optical system of the fundus imaging device itself in six axes. This image frame setting work is called alignment adjustment. The alignment adjustment procedure is different between a stationary fundus imaging device and a handheld fundus imaging device.

An alignment adjustment method for a stationary fundus imaging device is, for example, as follows.
(1) While viewing the image of the anterior segment of the eye using a fundus imaging device installed on a table, the photographer instructs the patient to look straight ahead on the imaging optical axis and fixes the patient's line of sight. I do.
(2) The photographer uses a controller etc. to control the alignment adjustment mechanism built into the fundus imaging device, and moves the entire optical system in the direction of the imaging optical axis and the three axes on the plane perpendicular to the imaging optical axis. move it.

For example, an alignment adjustment method for a hand-held fundus imaging device is as follows.
(1) While viewing an image of the anterior segment of the eye using a fundus imaging device held in the photographer's hand, the photographer instructs the subject to look approximately straight ahead and fixes the line of sight.
(2) The photographer moves the fundus imaging device so that the line of sight of the subject overlaps the imaging optical axis, and holds the device in his hand in that state.

Japanese Patent Application Publication No. 2008-000155 Special Publication No. 2020-507386

Conventional stationary fundus imaging devices require the subject's head to be fixed to the device and then move the entire optical system of the device in six axes, resulting in an increase in size. In addition, a stationary fundus imaging device requires the skill of the photographer to properly fix the subject's line of sight, so it is necessary to have someone with appropriate photography skills present at the time of photography.

On the other hand, a handheld fundus imaging device does not have a built-in alignment adjustment mechanism and has a structure consisting only of an optical system, thereby realizing miniaturization. However, since the photographer needs to carry out the alignment adjustment while holding the fundus imaging device by hand, the alignment adjustment work becomes more complicated. Therefore, like a stationary type device, a handheld fundus imaging device also requires the presence of a person with appropriate skills at the time of imaging.

An object of the present disclosure is to provide a fundus imaging device and a fundus imaging method that can be miniaturized and have easy alignment adjustment.

A fundus imaging device according to the present disclosure includes: a first optical section that is provided between an eye to be examined and an imaging section that images the fundus of the eye to be examined, and that changes the visual field direction of the imaging section with respect to the eye to be examined; a second optical section that is provided between the first optical section and the imaging section and corrects the traveling direction of light emitted from the fundus and irradiated to the imaging section via the first optical section; and.

1 is a schematic diagram schematically showing the configuration of a fundus imaging device according to an existing technique. 1 is a schematic diagram schematically showing the configuration of a fundus imaging device according to an existing technique. 1 is a schematic diagram schematically showing the configuration of a fundus imaging device according to the present disclosure. 1 is a schematic diagram schematically showing the configuration of a fundus imaging device according to the present disclosure. FIG. 1 is a schematic diagram showing the configuration of an example of a fundus imaging device according to a first embodiment. FIG. 3 is a schematic diagram showing a configuration example of an anterior eye observation unit applicable to the first embodiment. FIG. 2 is a schematic diagram showing an example of a configuration of an annular light source applicable to the first embodiment. FIG. 2 is a functional block diagram of an example for explaining the functions of the fundus imaging device according to the first embodiment. 2 is a flowchart of an example for explaining the overall flow of fundus imaging by the fundus imaging device according to the first embodiment. 7 is a flowchart of an example showing alignment adjustment processing according to the first embodiment in more detail. 7 is a flowchart of an example showing in more detail the focus adjustment process according to the first embodiment. 2 is a flowchart of an example showing the photographing process according to the first embodiment in more detail. FIG. 3 is a schematic diagram for explaining an overview of visual field deflection according to the first embodiment. FIG. 3 is a schematic diagram for explaining a method of specifying the position of a pupil portion that is applicable to the first embodiment. FIG. 3 is a schematic diagram for explaining an overview of optical axis adjustment according to the first embodiment. It is a schematic diagram showing the composition of an example of the fundus imaging device concerning the 1st modification of a 1st embodiment. FIG. 2 is a schematic diagram showing the configuration of an example of a fundus imaging device according to a second modification of the first embodiment. FIG. 7 is a schematic diagram showing the configuration of an example of an optical element according to a second modification of the first embodiment. FIG. 7 is a schematic diagram for explaining a usage pattern of a fundus imaging device according to a second embodiment. FIG. 2 is a functional block diagram of an example for explaining the functions of a fundus imaging device according to a second embodiment. FIG. 7 is a schematic diagram showing a configuration example of an indicator when visual information is used, which is applicable to the second embodiment. FIG. 7 is a schematic diagram for explaining a usage pattern of a fundus imaging device according to a third embodiment. FIG. 7 is a functional block diagram of an example for explaining the functions of a fundus imaging device according to a third embodiment. FIG. 7 is a functional block diagram of an example for explaining the functions of a fundus imaging device according to a third embodiment.

Hereinafter, embodiments of the present disclosure will be described in detail based on the drawings. Note that in the following embodiments, the same portions are given the same reference numerals, and redundant explanation will be omitted.

Hereinafter, embodiments of the present disclosure will be described in the following order.
1. Overview of technology related to the present disclosure 1-1. Regarding existing technology 1-2. Technology related to the present disclosure 2. First embodiment 2-1-1. Configuration according to first embodiment 2-1-2. Outline of processing according to first embodiment 2-1-3. Details of alignment adjustment processing according to first embodiment 2-2. First modification of first embodiment 2-3. Second modification of the first embodiment 3. Second embodiment 4. Third embodiment

(1. Overview of technology related to this disclosure)
The present disclosure relates to a fundus imaging device for photographing a human fundus. The fundus imaging device according to the present disclosure can be applied to medical applications. The present disclosure is not limited to this, and the fundus imaging device according to the present disclosure can also be applied to security applications using fundus images.

(1-1. Regarding existing technology)
Prior to describing the present disclosure, existing technology related to the technology of the present disclosure will be described for ease of understanding.

There are two types of fundus imaging devices: one is a stationary device that takes images of the fundus by fixing the subject's head to the fundus imaging device installed on a table, and the other is a stationary device that takes images of the fundus by fixing the subject's head to the fundus imaging device installed on a table or the like. There are two types of devices: hand-held devices that are placed in contact with the subject's head (eyeballs) to photograph the fundus.

In conventional fundus imaging devices, the optical axis from the tip of the photographic lens to the imaging surface is fixed. Therefore, in order to appropriately set the image frame on the imaging surface side, the photographer needs to move the entire optical system of the fundus imaging device itself in six axes. This image frame setting work is called alignment. The alignment procedure is different between a stationary fundus imaging device and a handheld fundus imaging device.

An example of an alignment method for a stationary fundus imaging device is as follows.
(1) While viewing the image of the anterior segment of the eye using a fundus imaging device installed on a table, the photographer instructs the patient to look straight ahead on the imaging optical axis and fixes the patient's line of sight. I do.
(2) The photographer uses a controller, etc. to control the alignment mechanism built into the fundus imaging device, and moves the entire optical system in the direction of the imaging optical axis and along three axes on a plane perpendicular to the imaging optical axis. let

An example of an alignment method for a hand-held fundus imaging device is as follows.
(1) While viewing the image of the anterior segment of the eye using a fundus imaging device held by the photographer, the photographer instructs the subject to look approximately straight ahead, and fixes the patient's line of sight.
(2) The photographer moves the fundus imaging device so that the line of sight of the subject overlaps the imaging optical axis, and holds the device in his hand in that state.

On the other hand, a handheld fundus imaging device does not have a built-in alignment mechanism and has a structure consisting only of an optical system, thereby realizing miniaturization. However, since the photographer needs to carry out alignment while holding the fundus imaging device by hand, the alignment work becomes more complicated. Therefore, like a stationary type device, a handheld fundus imaging device also requires the presence of a person with appropriate skills at the time of imaging.

One of the reasons why it is necessary to have a skilled person present during shooting is that the alignment mechanism on the device side has a low degree of freedom. If the alignment mechanism inside the device has a sufficient degree of freedom, it is thought that the photographer will be able to use remote adjustment or the automatic adjustment mechanism on the device side. However, if an attempt is made to increase the degree of freedom in adjusting the alignment mechanism in a conventional fundus imaging device, it is expected that the device will become even larger, and there is a risk that the equipment that can be introduced will be limited.

In response to this, structures of fundus imaging devices that can increase the degree of freedom of the alignment mechanism have been proposed. For example, Patent Document 1 describes a fundus imaging device in which the degree of freedom of the alignment mechanism is increased by arranging a concave mirror whose angle is adjustable on the optical path. In Patent Document 1, alignment adjustment can be performed while fixing the device body by fixing the device body to the face and adjusting the position of the entrance pupil using a concave mirror. However, in order to achieve alignment using this method, the subject needs to direct his/her line of sight to the intersection of the rotation axes of the concave mirror. Therefore, if the subject's visual acuity is impaired or the subject's line of sight cannot be properly guided for some reason, accurate alignment adjustment is difficult.

Furthermore, as in Patent Document 2 and Non-Patent Document 1, for example, a method has been proposed that does not require a person with appropriate skills to be present at the time of photographing.

Patent Document 2 describes a small fundus imaging device that uses a head-mounted display type housing, houses an imaging optical system, its drive system, and a control system inside the housing, and has an automatic alignment adjustment function. has been done. According to Patent Document 2, it is possible to eliminate the need for a photographer with appropriate skills to be present when photographing the fundus. However, since Patent Document 2 employs a conventional stationary alignment method in which the imaging optical system itself is moved, there is a trade-off between the reduction in device capacity and the optical axis adjustment range. In addition, in Patent Document 2, the gaze fixation method is also assumed to be realized by fixation of the target by the subject himself or by voice instructions directed to the subject from the outside, so the above-mentioned Patent Document Issues similar to 1 may occur.

Non-Patent Document 1 describes a method in which the subject himself or herself performs alignment while viewing an index projected onto the retina. According to the method disclosed in Non-Patent Document 1, similarly to Patent Document 2 mentioned above, it is possible to eliminate the need for a photographer with specialized skills at the time of photographing. However, the alignment according to Non-Patent Document 1 is not effective for patients with visual acuity abnormalities.

(1-2. Technology related to this disclosure)
The technology according to the present disclosure will be briefly described. In the following, from the viewpoint of increasing the degree of freedom of the alignment mechanism, the technology according to the present disclosure will be described using the configuration described in Patent Document 1 as an example of existing technology.

FIGS. 1A and 1B are schematic diagrams schematically showing the configuration of a fundus imaging device according to existing technology. In fundus photography, the pupil is generally captured on an imaging optical axis extending vertically from the imaging center of the imaging device, and the intraocular and fundus of the subject's eye are, for example, magnified and photographed through the pupil.

Note that in FIGS. 1A and 1B, which will be described below, and FIGS. 2A and 2B, which will be described later, parts of the fundus imaging device necessary for explanation are excerpted and other optical elements and the like are omitted.

Section (a) of FIG. 1A shows an example in which fundus photography is appropriately performed in a configuration according to existing technology. In this example, a reflecting mirror 520 that is rotatable about a rotation axis 521 is provided on an imaging optical axis 512 of an image sensor 530. Further, it is assumed that the reflecting mirror 520 is arranged so that when the subject looks in the horizontal direction 503 in the figure, the line of sight coincides with the rotation axis 521. Light emitted from the fundus 502 of the eye to be examined 500 through the pupil 501 is irradiated onto the reflecting mirror 520 through the optical path 510a and reflected, and is irradiated onto the image sensor 530 through the optical path 511a, where it is photographed.

In the example of section (a) in FIG. 1A, the subject's line of sight is in the horizontal direction 503 in the figure, and the line of sight is directed toward the center of the reflecting mirror 520 (rotation axis 521). Therefore, by adjusting the angle of the reflecting mirror 520, the optical path 511a can be overlapped with the imaging optical axis 512 at the imaging center of the imaging element 530.

Section (b) of FIG. 1A shows an example of an image captured by the image sensor 530 in the state of section (a) of FIG. 1A. In the captured image 540 captured by the image sensor 530, a subject's eye image 550 including a pupil image 551 and a fundus image 552 is included approximately in the center. The position of the pupil image 551 substantially coincides with the position of the imaging optical axis 512 in the image sensor 530.

Section (a) of FIG. 1B shows an example in which fundus photography is not performed appropriately in a configuration related to the existing technology. According to section (a) of FIG. 1B, the subject's line of sight is inclined with respect to the horizontal direction 503, and the center of the reflector 520 (rotation axis 521) It is aimed at a location that is off-center. That is, in section (a) of FIG. 1A, the optical path 510a of the light emitted from the fundus 502 through the pupil 501 is approximately horizontal in the diagram, but in section (a) of FIG. The optical path 510b is directed diagonally upward to the right in the figure. Further, it is assumed that the reflecting mirror 520 initially has an inclination 520b shown by a dashed line in the figure.

In the example of section (a) of FIG. 1B, light emitted from the fundus 502 of the eye to be examined 500 through the pupil 501 is irradiated onto the reflector 520 according to the optical path 510b, is reflected, and is emitted in the direction of the optical path 511b. . In this state, the reflected light from the reflecting mirror 520 is not applied to the image sensor 530, and the captured image 540 does not include an image of the fundus 502.

In this case, by adjusting the inclination 520a of the reflecting mirror 520, the reflected light from the reflecting mirror 520 can be irradiated onto the image sensor 530. In the example of section (b) in FIG. 1B, by changing the inclination of the reflecting mirror 520 by the angle θ to obtain an inclination 520b, it is possible to move the optical path 511c of the reflected light from the reflecting mirror 520 closer to the imaging optical axis 512. It is. Thereby, the image sensor 530 is irradiated with the reflected light from the reflecting mirror 520.

Even in the case shown in section (a) of FIG. 1B, it is difficult to overlap the optical path 511c with the imaging optical axis 512. Therefore, even when viewed under magnification on the imaging optical axis 512, for example, it is difficult to obtain an appropriate fundus image 552 as shown in section (b) of FIG. 1A. Section (b) of FIG. 1B shows an example of an image captured by the image sensor 530 in the state of section (a) of FIG. 1B. It can be seen that in the captured image 540, the positions of the pupil image 551 and the fundus image 552 are shifted with respect to the position of the imaging optical axis 512.

In order to solve the above-mentioned problems with the existing technology, the present disclosure introduces one or more optical axis adjustment elements on the optical axis of the fundus imaging device, so that the subject can fixate at an appropriate position. Alignment can be adjusted on the device side even if the device is not installed.

FIGS. 2A and 2B are schematic diagrams schematically showing the configuration of a fundus imaging device according to the present disclosure. As shown in section (a) of FIGS. 2A and 2B, in the present disclosure, in contrast to the configuration described in FIGS. In between, an optical axis adjustment element 560 (second optical section) for adjusting the optical axis is added.

In the examples of FIGS. 2A and 2B, the optical axis adjustment element 560 is shown as a concave lens. Such a change in the optical path by the optical axis adjustment element 560 according to the present disclosure can be realized by applying, for example, a technique used for optical image stabilization.

In the example of section (a) in FIG. 2A, similar to section (a) in FIG. The slope 520b is set accordingly. Light from the fundus 502 is irradiated onto the reflecting mirror 520 through an optical path 510b, and the reflected light is emitted in the direction of an optical path 511c according to the inclination 520b.

In this case, the optical axis adjustment element 560 changes the optical path 511c of the light emitted from the reflecting mirror 520 and irradiated onto the imaging device 530 to an optical path 513 that overlaps the imaging optical axis 512. Thereby, the optical path 511c of the light emitted from the fundus 502 through the pupil 501 and reflected by the reflector 520, which is inclined with respect to the horizontal direction 503, shown in section (a) of FIG. The optical path 513 can be changed to overlap the optical path 513.

Section (b) of FIG. 2A shows an example of an image captured by the image sensor 530 in the state of section (a) of FIG. 2A. In the captured image 540 captured by the image sensor 530, a subject's eye image 550 including a pupil image 551 and a fundus image 552 is included approximately in the center. The position of the pupil image 551 substantially coincides with the position of the imaging optical axis 512 in the image sensor 530.

Furthermore, the technology according to the present disclosure can be applied to photographing the peripheral fundus, which is the periphery of the fundus 502. An example of photographing the peripheral fundus 502' using the technology according to the present disclosure will be schematically described using FIG. 2B. In this case, the optical axis adjustment element 560 is adjusted as described using section (a) of FIG. 2A, and the optical path 513 of the light emitted from the optical axis adjustment element 560 is aligned with the imaging optical axis 512. Match. Then, the angle of the reflecting mirror 520 is changed as appropriate. In the illustrated example, the angle of the reflecting mirror 520 is changed from an inclination 520b to an inclination 520d. Thereby, it is possible to enlarge the area of the object to be imaged.

Section (b) of FIG. 2B shows an example of an image captured by the image sensor 530 in the state of section (a) of FIG. 2B. In the captured image 540 captured by the image sensor 530, a subject's eye image 550 including a pupil image 551 and a fundus image 552 is included approximately in the center. The position of the pupil image 551 substantially coincides with the position of the imaging optical axis 512 in the image sensor 530. Furthermore, it can be seen that the peripheral fundus image 553 is captured in a wide range relative to the fundus image 552 shown in section (b) of FIG. 2A.

As described above, according to the technology according to the present disclosure, in addition to changing the angle of the reflecting mirror 520, by using the optical axis adjustment element 560, it is possible to increase the degree of freedom in alignment adjustment in fundus photography. Furthermore, this makes it possible to eliminate the need for a person with appropriate photographic skills to be present during photographing.

(2. First embodiment)
A first embodiment of the present disclosure will be described.

(2-1-1. Configuration according to the first embodiment)
FIG. 3 is a schematic diagram showing the configuration of an example of the fundus imaging device according to the first embodiment. In FIG. 3, the fundus imaging device 100 includes an optical section B1, an imaging processing section B2, and an information processing section B3.

In the example of FIG. 3, the optical section B1 and the imaging processing section B2 are shown to be provided in the same housing, but this is not limited to this example, and the optical section B1 and the imaging processing section B2 are provided in different cases. It may be provided in the housing. Furthermore, the information processing section B3 may be provided in the same casing as the optical section B1 and the imaging processing section B2, and the information processing section B3 may be further provided in the casing.

The optical part B1 is provided with a mounting part 1 that is brought into contact with the subject's eye S, which is the eyeball of the subject 200. The mounting portion 1 is configured such that the distance between the optical portion B1 and the eye S to be examined can be changed by a drive mechanism 24. For example, the drive mechanism 24 expands and contracts the mounting portion 1 in the optical axis direction to adjust the distance between the eye S to be examined and the entire device in the optical axis direction. The relative position of the optical part B1 with respect to the eye S to be examined is fixed by the mounting part 1. Light obtained from the eye S to be examined passes through the device interface part D and enters the inside of the optical part B1. The device interface part D may be a hole, or may be provided with an optical element such as a protective glass, a lens, or a filter.

The optical section B1 includes optical elements 2 to 6, a device control section 23, and an annular light source 41. Note that the

optical elements

3 and 6 can be omitted. The optical element 2 is, for example, a concave mirror, and is provided so that its inclination (angle) can be changed by a drive mechanism 25 with respect to a predetermined point. The inclination of the optical element 2 is changed, for example, using its center as a reference point for changing the inclination. By adjusting the inclination of the optical element 2 using the drive mechanism 25, the pupil image and the fundus image of the eye S to be examined can be placed within a certain range within the image frame of the image sensor 7, which will be described later.

The optical element 2 is not limited to a concave mirror, but may be a plane mirror, a lens, or a hologram optical element. The optical element 2 changes the direction of the visual field of the subject 200 via the optical element 2 by rotating around the rotation axis.

That is, the optical element 2 is provided between the eye S to be examined and the imaging element 7, which is an imaging unit that images the fundus of the eye S, and is a first optical element that changes the visual field direction of the imaging unit with respect to the eye S to be examined. Functions as an optical section.

Note that here, the field of view refers to the field of view when looking from the image sensor 7 in the direction of the imaging optical axis. At this time, for example, if the direction of the optical axis is changed by the optical element 2 or the like, the field of view to which the change has been made is made the field of view of the imaging element 7.

The optical element 4 corresponds to the optical axis adjustment element 560 described in FIGS. 2A and 2B, and is movable by the drive mechanism 26. The drive mechanism 26 is configured such that an optical path 50a connecting the pupil of the eye S to the fundus is changed to an optical path 50b by the optical element 2, and the optical path 50b whose direction has been changed overlaps with the imaging optical axis of the imaging device 7, which will be described later. The optical element 4 is controlled so that the angle becomes 50c.

In the example of FIG. 3, the optical element 4 is shown as a concave lens, and is movable by a drive mechanism 26 in a direction perpendicular to the optical axis (horizontal direction in the figure). For the optical element 4, a known optical image stabilization technique can be applied. The optical element 4 corrects the traveling direction of light that is emitted from the eye S to be examined and enters through the optical element 2, which is the first optical section.

That is, the optical element 4 is provided between a first optical part (optical element 2) and an imaging part (imaging element 7), and is emitted from the fundus and irradiated onto the imaging part through the first optical part. It functions as a second optical section that corrects the traveling direction of light.

The optical element 5 is driven by the drive mechanism 27 to adjust the focus of the image formed on the image sensor 7. As the optical element 5, a known autofocus mechanism can be applied.

The device according to the first embodiment includes a drive mechanism 24 that adjusts the mounting portion 1, an optical element 2 and a drive mechanism 25, an optical element 4 and a drive mechanism 26, and an optical element 5 and a drive mechanism 27. An alignment adjustment mechanism is configured to perform alignment adjustment.

Note that although the drive mechanism 24 acting on the mounting portion 1 and the drive mechanism 25 acting on the optical element 2 are described as separate structures in the above, this is not limited to this example. For example, the operation of the drive mechanism 24 may be combined with the operation of the drive mechanism 25 to move the optical element 2 both in the tilt direction and in the depth direction with respect to the eye S to be examined.

In the example of FIG. 3, a concave mirror is used as the optical element 2 for changing the field of view, but by adding an optical element 3 between the optical element 2 and the optical element 4, a plane mirror is used as the optical element 2. It is also possible to use For example, a convex lens can be applied to the optical element 3.

Note that the

optical elements

2, 4, and 5 described above are the minimum necessary optical element configurations for performing fundus imaging according to the present disclosure, and do not limit the optical element configuration or arrangement. For example, the optical element 3 may be added as described above, or the optical element 6 may be further added. Further, for example, the arrangement of

optical elements

3 and 6 may be exchanged. Further, when the optical elements 3 to 6 are composed of lenses, one or more of them is not limited to a solid lens, but it is also possible to use a liquid lens or a hologram optical element. Further miniaturization is possible by using liquid lenses or hologram optical elements instead of solid lenses.

In the optical section B1, the device control section 23 includes a processor such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), a ROM (Read Only Memory) in which programs are stored, and a work memory for the processor. It includes RAM (Random Access Memory) and an interface to the outside. The device control unit 23 operates according to a program stored in the ROM, for example, using the RAM as a work memory, and controls the overall operation of the fundus imaging device 100. For example, the device control unit 23 can control the above-mentioned drive mechanisms 25 to 27 and the annular light source 41 via the interface. Further, the device control section 23 may control the operations of the image sensor 7 and the development processing section 8, which will be described later.

The UI (User Interface) 21 and port 22 included in the optical section B1 will be explained. The UI 21 can include a user operation section that accepts user operations, and a display section using indicators and the like. The user operation unit can include buttons, toggle switches, a keyboard, and pointing devices such as a mouse and a touch panel. The present invention is not limited to this, and the user operation section may include other input means (such as voice input). Further, the indicator may simply indicate lighting/non-lighting, or may be a display device such as an LCD (Liquid Crystal Display). The device control unit 23 can also control the operation of the fundus imaging device 100 in response to user operations on the UI 21 provided in the optical section B1.

For example, the control communication line 11 is connected to the port 22. The device control unit 23 can communicate with, for example, the information processing unit B3 via the port 22 and the control communication line 11. Note that although the description has been made here such that the port 22 and the information processing section B3 are connected by wire through the control communication line 11, this is not limited to this example. You may.

In FIG. 3, the imaging processing section B2 includes an imaging device 7, a development processing section 8, and a device control section 23. The image sensor 7 includes, for example, a pixel array in which pixels that output electrical signals according to irradiated light are arranged in a matrix. The image sensor 7 forms an image of the incident light that has entered through the optical elements 2 to 5 described above, and outputs a signal (image signal) corresponding to the imaged light.

The image sensor 7 is driven by a drive circuit (not shown) and can capture moving images at a predetermined frame rate. Further, the image sensor 7 can capture a still image according to a trigger given while capturing a moving image. Furthermore, the image sensor 7 can also capture only still images without capturing moving images.

The development processing unit 8 performs predetermined image processing on the image signal of the moving image or still image output from the image sensor 7. For example, the development processing unit 8 performs AD (Analog to Digital) conversion processing on the image signal output as an analog signal from the image sensor 7, and converts the image signal into a digital image signal. Convert to image data. The development processing unit 8 may further perform image processing such as development processing such as demosaic processing, noise removal processing, and white balance adjustment processing on the image data.

Image data subjected to image processing in the development processing section 8 is output from a port 9 and transmitted to the information processing section B3 via an image communication line 10 connected to the port 9, for example. Note that although the description has been made here in which the port 9 is connected by wire through the image communication line 10, this is not limited to this example, and the port 9 and the information processing section B3 may be connected by wireless communication. Further, in FIG. 3, port 9 for transmitting image data and port 22 for transmitting control signals etc. are shown as separate ports, but this is not limited to this example. It is also possible to combine them into one port.

The information processing unit B3 includes a processor such as a CPU, and a memory such as a ROM and a RAM. The information processing unit B3 can further include a storage device using a nonvolatile storage medium such as a hard disk drive or flash memory. The information processing unit B3 can further include an input device (keyboard, touch panel, etc.) that accepts user input, and a display device that displays information.

The information processing unit B3 generates a device control signal for alignment adjustment in the fundus imaging device 100 based on image data based on the output of the image sensor 7 and information obtained from the anterior eye observation unit described below. The information processing section B3 transmits the generated device control signal to the device control section 23 of the optical section B1 via the control communication line 11, for example, as feedback information for the operations of the

optical elements

2, 4, and 5.

(Anterior eye observation part)
Although omitted in FIG. 3, the optical section B1 includes an anterior eye observation section for observing the anterior eye segment of the eye S to be examined. The anterior eye observation unit makes it possible to observe the state of the anterior eye segment of the subject's eye S by photographing or measuring the anterior eye segment when performing alignment adjustment. Information obtained by the anterior eye observation section is sent to the device control section 23 and fed back to the alignment adjustment mechanism.

The anterior eye observation unit may include an imaging optical system as a measuring device for measuring the anterior eye segment. An imaging device (including a development processing section if necessary) may be used as the configuration of the anterior eye observation section. The configuration of the anterior eye observation unit is not limited to this example, and other configurations may be used as long as the measurement target is achieved. Further, in addition to the imaging device, an auxiliary device such as a distance measurement sensor or a marker indicator projection unit may be added to the anterior eye observation unit in order to obtain anterior eye information.

FIG. 4 is a schematic diagram showing a configuration example of an anterior eye observation unit applicable to the first embodiment. Optical section B1 includes at least one of anterior

eye observation sections

28a, 28b, and 28c. In addition, below, the anterior

eye observation parts

28a, 28b, and 28c may be collectively called the anterior eye observation part 28.

The anterior eye observation section 28a is an example in which the anterior eye observation section 28 is provided around the attachment section 1. By using the anterior eye observation unit 28a, it becomes possible to directly observe the anterior eye segment of the eye S to be examined. In this case, the anterior eye observation unit 28a photographs the anterior eye segment from an oblique direction, but by applying projective transformation or the like to the captured image, converts the captured image into an image viewed from the optical axis direction. It is possible to do so.

The anterior eye observation unit 28b provides a mirror 29 in the optical path of the light emitted from the optical element 2, and images the light reflected by the mirror 29, thereby making it possible to observe the anterior eye segment. The mirror 29 may be a half mirror that transmits and reflects incident light. The present invention is not limited to this, and the mirror 29 may be a movable mirror that performs total reflection. In this case, the mirror 29 may be inserted obliquely to the optical path during anterior eye observation by the anterior eye observation unit 28b, and may be arranged so as not to obstruct the optical path when anterior eye observation is not performed. Moreover, a trimming filter that transmits and reflects only light of a specific wavelength may be applied to the mirror 29.

When a concave mirror or a plane mirror is used as the optical element 2, an anterior eye observation section 28c can be provided. The anterior eye observation section 28c is arranged at a position via the optical element 2 on a line passing through, for example, the center of the optical element 2 from the wearing section 1 (eye S to be examined). In this case, a half mirror is used for the optical element 2, or a trimming filter that transmits only a specific wavelength is used, etc., so that light other than the light rays directed to the image sensor 7, which will be described later, also reaches 28c. There is a need to.

If necessary, a measuring device (for example, a distance sensor) added to the anterior

eye observation unit

28a, 28b, or 28c or a projector 30 for projecting an index (such as a marker) that can be observed by the image sensor 7 may be installed. Good too. The index projected onto the anterior eye segment by the projector 30 can also be photographed and observed by an image sensor included in the anterior

eye observation unit

28a, 28b, or 28c. By projecting the index onto the anterior eye segment using the projector 30, it is possible to facilitate adjustment processing (described later) using the anterior

eye observation unit

28a, 28b, or 28c. When transmitting the output of the anterior

eye observation section

28a, 28b, or 28c to an external device, it may be outputted from the development processing section 8, which will be described later, or a port 22 for control communication, or an additional output port may be provided. It's okay.

As described above, the optical section B1 includes the annular light source 41. The annular light source 41 is a light source configured in an annular shape so that the center portion transmits light. FIG. 5 is a schematic diagram showing an example of the configuration of the annular light source 41 applicable to the first embodiment. In FIG. 5, the annular light source 41 includes an adjustment light source section 41a (first light source section) that emits light with a wavelength outside the visible light region (for example, infrared light), and an adjustment light source section 41a (first light source section) that emits light with a wavelength in the visible light region. A photographing light source section 41b (second light source section) is included. In the example of FIG. 5, the annular light source 41 has concentric circles in which the adjustment light source section 41a and the photographing light source section 41b share a center, and the center portion 52 is a light transmission area.

The adjustment light source section 41a is used, for example, in alignment adjustment and focus adjustment. The photographing light source section 41b is used when actually photographing the fundus. By using light with a wavelength outside the visible light range during adjustment, it is possible to prevent the pupil of the subject's eye S from constricting due to glare or the like. Hereinafter, the light emitted by the adjustment light source section 41a will be referred to as adjustment light, and the light emitted by the photographing light source section 41b will be referred to as photographing light.

Note that as the illumination for the anterior

eye observation section

28a, 28b, or 28c, for example, an excitation light source for fluorescence observation or a light source with a spectrum optimized for focus adjustment by the optical element 5 may be applied.

Note that when the anterior eye segment is photographed and observed using the image sensor 7 based on the index projected onto the anterior eye segment by the projector 30, it is preferable to appropriately adjust the optical elements 2 to 6, for example. By appropriately adjusting the optical elements 2 to 6, the imaging device 7 can capture the anterior eye segment in a wide imaging range equivalent to when the anterior eye segment is photographed based on the index by the anterior

eye observation unit

28a, 28b, or 28c. It becomes possible to photograph. Furthermore, if the imaging device 7 is capable of photographing with the adjustment light and photographing with the photographing light, the adjustment process performed using the anterior

eye observation unit

28a, 28b or 28c can be performed with the imaging device 7. It is also possible to realize this.

FIG. 6 is an example functional block diagram for explaining the functions of the fundus imaging device 100 according to the first embodiment.

In FIG. 6, the optical section B1 includes a device control section 300, each mechanism 302, a UI (User Interface) 21, an anterior eye observation section 28, and an annular light source 41. The device control section 300 corresponds to the device control section 23 described using FIG. 3, and includes a CPU, ROM, RAM, and various interfaces.

Each mechanism 302 includes the drive mechanisms 24 to 27 described using FIG. 3. The operation of the drive mechanisms 24 to 27 is controlled by control signals output from the device control section 300. The anterior eye observation section 28 includes at least one of the aforementioned anterior

eye observation sections

28a, 28b, and 28c. The photographing operation by the imaging device in the anterior eye observation section 28 is controlled by a control signal output from the device control section 300.

The photographing operation in the anterior eye observation unit 28 controlled by the device control unit 300 includes not only the operation of the image sensor itself such as exposure, but also the operation of the image sensor itself such as exposure time (shutter speed) and gain adjustment for the image signal output from the image sensor. This may include setting parameters related to imaging. Note that the device control unit 300 may set this parameter using a predetermined setting value, or may set this parameter using a setting value corresponding to a user operation on the UI 21 or input unit 353, which will be described later. Good too.

Furthermore, the anterior eye observation section 28 may further include a projector 30 whose operation is controlled by control signals similarly passed from the device control section 300. The annular light source 41 includes the above-mentioned adjustment light source section 41a and photographing light source section 41b. Turning on/off of the adjustment light source section 41a and the photographing light source section 41b is controlled by a control signal output from the device control section 300. The device control section 300 may further control the amount of light emitted from each of the adjustment light source section 41a and the photographing light source section 41b. For example, the device control unit 300 may control the amount of light emitted according to a user operation on the UI 21 or input unit 353, which will be described later.

The UI 21 includes an input device for receiving operations on the fundus imaging device 100 by the subject 200. The UI 21 receives signals from input devices such as buttons, toggle switches, keyboards, and pointing devices such as mice and touch panels. The UI 21 passes a control signal to the device control unit 300 in response to a user's operation on the input device. The device control section 300 may control the operation of each section of the fundus imaging device 100 according to this control signal.

The image processing section B2 includes an image sensor 7 and a development processing section 8. The imaging operation of the image sensor 7 is controlled by a control signal output from the device control section 300. The photographing operation of the image sensor 7 controlled by the device control unit 300 includes not only the operation of the image sensor itself such as exposure, but also the photographing operations for the image sensor such as exposure time (shutter speed) and gain adjustment for the image signal output from the image sensor. This may include setting parameters related to. Note that the device control unit 300 may set this parameter using a predetermined setting value, or may set this parameter using a setting value corresponding to a user operation on the UI 21 or input unit 353, which will be described later. Good too.

The development processing section 8 is supplied with an image signal output from the image sensor 7. The development processing section 8 performs various signal processing including development processing on the supplied imaging signal according to a control signal output from the apparatus control section 300.

The development processing section 8 may adjust the parameters of the signal processing to be performed on the imaging signal, according to the needs of the photographer. For example, the device control unit 300 sets parameters for signal processing that the development processing unit 8 performs on the imaged signal in response to a user operation on the UI 21 or input unit 353, which will be described later. It is passed to the processing section 8. The development processing section 8 executes signal processing on the image signal supplied from the image sensor 7 according to the parameters passed from the apparatus control section 300.

In the example of FIG. 6, the imaging processing unit B2 is provided with a port 9 for communicating with the outside. Here, the port 9 shown in FIG. 6 may be one in which the port 9 and the port 22 in FIG. 3 are combined into one port, as described above. Image data subjected to various signal processing in the development processing section 8 and image data output from the anterior eye observation section 28 are transmitted from the port 9 to the information processing section B3 via the image communication line 10.

The information processing section B3 includes a signal processing section 351, a display section 352, and an input section 353. Further, the information processing section B3 is provided with a port 350 for communicating with the outside.

Each image data output from the port 9 of the imaging processing section B2 is received by the port 350 via the image communication line 10, and is supplied to the signal processing section 351. The signal processing unit 351 performs predetermined processing on each supplied image data. For example, the signal processing unit 351 generates an adjustment control signal for performing alignment adjustment and focus adjustment based on the image data output from the development processing unit 8 or the anterior eye observation unit 28. The generation of the adjustment control signal by the signal processing unit 351 will be described later.

The adjustment control signal generated by the signal processing unit 351 is output from the port 350 and transmitted to the imaging processing unit B2 via the image communication line 10. The adjustment control signal is received by the port 9 in the imaging processing section B2, and is passed to the device control section 300 in the optical section B1. The device control unit 300 controls, for example, the drive mechanisms 24 to 27 included in each mechanism 302 based on this adjustment control signal, and performs alignment adjustment and focus adjustment.

The display unit 352 displays information on a display device such as a display or an indicator. For example, the signal processing section 351 can cause the display section 352 to display an image based on the image data output from the anterior eye observation section 28 and the development processing section 8 on a display or the like. However, the present invention is not limited to this, and the display section 352 may only display operation information using an indicator or the like, and the image data itself may be transmitted to the outside.

The input unit 353 receives signals from input devices such as buttons, toggle switches, keyboards, and pointing devices such as mice and touch panels. The input unit 353 passes a control signal corresponding to a user's operation on the input device to the signal processing unit 351. The signal processing unit 351 can control processing of image data according to this control signal.

(2-1-2. Outline of processing according to the first embodiment)
Next, the processing in the fundus imaging apparatus 100 according to the first embodiment will be schematically explained using the flowcharts of FIGS. 7 to 10.

FIG. 7 is an example flowchart for explaining the overall flow of fundus imaging by the fundus imaging device 100 according to the first embodiment.

In FIG. 7, in step S100, the subject's eye portion is brought into contact with the mounting section 1, and the fundus imaging device 100 is mounted. At this time, the subject directs his/her field of vision toward the optical element 2 via the device interface section D in the mounting section 1. More specifically, it is preferable for the subject to direct his or her field of vision toward the center of the optical element 2.

Hereinafter, the direction in which the subject looks from the mounting part 1 to the optical element 2 will be referred to as "the subject looking in front", and the direction of the optical element 2 seen from the mounting part 1 will be defined as the direction in front of the subject. shall be.

When the fundus imaging device 100 is worn by the subject in step S100, the imaging operation by the anterior eye observation unit 28 and the image sensor 7 is started, and, for example, image data in the form of a moving image is transmitted from the anterior eye observation unit 28 and the image sensor 7. Output.

In the next step S101, the fundus imaging device 100 executes alignment adjustment processing based on the image data acquired from the anterior eye observation unit 28 and the image sensor 7. In other words, if the subject's eye remains in contact with the attachment part 1 in step S100, there is a possibility that the field of view of the image sensor 7 and the direction in which the subject is facing do not match. be. Therefore, in step S101, the fundus imaging device 100 performs alignment adjustment processing to deflect the field of view of the image sensor 7 and adjust the optical axis with respect to the image sensor 7. More specifically, the fundus imaging device 100 tilts the optical element 2, for example, so that the optical path 50c through which the light from the eye S to be examined is irradiated onto the imaging element 7 overlaps the imaging optical axis of the imaging element 7. , and the position of the optical element 4.

Further, in step S101, the fundus imaging device 100 adjusts the distance between the optical unit B1 and the eye S to be examined appropriately, for example, by the drive mechanism 24 of the mounting unit 1, so that the eye S to be examined is photographed at an appropriate size. control and adjust the angle of view.

In the next step S102, the fundus imaging device 100 controls the drive mechanism 27 based on the image data acquired from the image sensor 7 to execute focus adjustment processing.

In the next step S103, the fundus imaging device 100 determines whether to perform fundus imaging based on the result of the alignment adjustment process in step S101 and the result of the focus adjustment process in step S102. If the result of at least one of the alignment adjustment and the focus adjustment is insufficient, the fundus imaging apparatus 100 determines not to perform fundus imaging (step S103, "No"), and returns the process to step S101.

On the other hand, the fundus imaging device 100 determines to perform fundus imaging if both the alignment adjustment and the focus adjustment result are sufficient (step S103, "No"), and moves the process to step S104. In step S104, the fundus imaging device 100 uses the imaging device 7 to perform fundus imaging of the eye S to be examined.

FIG. 8 is an example flowchart showing the alignment adjustment process according to the first embodiment in more detail. The series of processes shown in FIG. 8 corresponds to the process of step S101 in the flowchart of FIG.

In FIG. 8, in step S110, the device control section 300 turns on the adjustment light source section 41a in the annular light source 41. At this time, the photographing light source section 41b is not turned on. As described above, in the first embodiment, in alignment adjustment, the adjustment light source section 41a that emits light with a wavelength outside the visible light region is turned on, and the photographing light source section 41b that emits light with a wavelength outside the visible light region is turned on. Do not let it light up. Thereby, it is possible to prevent the pupil of the eye S to be examined from constricting due to glare or the like.

In the next step S111, the device control unit 300 determines whether the amount of light from the adjustment light source unit 41a turned on in step S110 is appropriate. In other words, in step S111, the device control unit 300 determines whether imaging with appropriate brightness is possible in the anterior eye observation unit 28 using the light emitted by the adjustment light source unit 41a turned on in step S110. judge.

For example, the device control unit 300 may make the determination in step S111 depending on the deterioration of the light emission intensity of the adjustment light source unit 41a. As a more specific example, the device control unit 300 accumulates and stores the time during which the adjustment light source unit 41a is turned on, and determines that the light amount is inappropriate when the accumulated time reaches a certain time. It can be determined that

Furthermore, the device control unit 300 may make the determination in step S111 depending on the deterioration in sensitivity of the image sensor included in the anterior eye observation unit 28. As a more specific example, the device control unit 300 accumulates and stores the time during which the image sensor included in the anterior eye observation unit 28 is used, and when the accumulated time reaches a certain time, It may be determined that the amount of light is not appropriate.

The present invention is not limited to this, and the device control unit 300 may perform this determination by capturing an image using the image sensor of the anterior eye observation unit 28 and obtaining the amount of light from the adjustment light source unit 41a based on the image capture result. Furthermore, a measuring device for measuring the amount of light emitted by the adjustment light source section 41a may be added, and the device control section 300 may make this determination based on the amount of light measured by this measuring device.

Furthermore, the device control unit 300 may make the determination in step S111 according to changes in the surrounding environment. For example, a measurement device that measures the environment outside the fundus imaging device 100 (for example, the amount of environmental light) is added to the fundus imaging device 100, and the device control unit 300 controls the measurement results measured by the measurement device. The determination in step S111 may be made based on the following. The external environment may be measured separately.

Furthermore, the device control unit 300 can also make the determination in step S111 according to user operations on the UI 21 or the input unit 353.

If the device control unit 300 determines in step S111 that the light amount is not appropriate (step S111, "No"), the process moves to step S112.

In step S112, the device control unit 300 adjusts the amount of light emitted by the adjustment light source unit 41a. For example, the device control unit 300 estimates the amount of attenuation of the light amount according to the cumulative lighting time of the adjustment light source unit 41a and the cumulative usage time of the image sensor of the anterior eye observation unit 28, and based on this estimation result, adjusts the adjustment light source. The amount of light emitted from the portion 41a may be adjusted. Further, the device control unit 300 may adjust the amount of light emitted by the adjustment light source unit 41a based on the imaging result by the image sensor included in the anterior eye observation unit 28 or the measurement result of the amount of environmental light. Further, the device control unit 300 may adjust the amount of light emitted by the adjustment light source unit 41a in response to user operations on the UI 21 or the input unit 353.

The invention is not limited to this, and the device control unit 300 may adjust the shutter time and gain settings in the imaging operation by the imaging device of the anterior eye observation unit 28 in step S112. Further, the device control unit 300 may adjust the shutter time and gain settings of the image sensor 7 in step S112. Further, the device control section 300 may adjust the gain setting in the development processing section 8 in step S112. For the adjustment in step S112, an algorithm used for automatic exposure adjustment in general cameras may be applied.

Upon completion of the light amount adjustment process in step S112, the device control unit 300 returns the process to step S111.

On the other hand, if the device control unit 300 determines in step S111 that the light amount by the adjustment light source unit 41a is appropriate (step S111, "Yes"), the process moves to step S113.

In step S113, the device control unit 300 photographs the anterior segment of the eye S to be examined using the anterior eye observation unit 28. The device control unit 300 also executes imaging using the image sensor 7.

The optical unit B1 outputs the image data photographed and acquired by the anterior eye observation unit 28 in step S113 and the image data photographed and acquired by the image sensor 7 from the port 9. Each image data output from the port 9 is transmitted to the information processing section B3 via the image communication line 10. Each image data is received by the port 350 in the information processing section B3 and passed to the signal processing section 351.

In the next step S114, the signal processing unit 351 acquires the alignment state based on the image data acquired by the anterior eye observation unit 28 and the image data acquired by the image sensor 7. For example, the signal processing unit 351 identifies the position of the pupil of the eye S to be examined based on the image data acquired by the anterior eye observation unit 28. Further, the signal processing unit 351 specifies, for example, the position where the image sensor 7 is irradiated with the light emitted from the pupil of the eye S, based on the image data acquired by the image sensor 7 or the anterior eye observation unit 28. . Furthermore, the signal processing unit 351 specifies the size of the fundus image based on the light on the captured image based on the image data. In other words, this is a process of specifying the angle of view in imaging by the image sensor 7.

In the next step S115, the signal processing unit 351 generates an adjustment control signal for performing alignment adjustment based on each piece of information specified in step S114. The adjustment control signal here may include a control signal for deflecting the field of view of the image sensor 7 and a control signal for adjusting the angle of view of the image sensor 7.

The signal processing unit 113 outputs the generated adjustment control signal from the port 350. The adjustment control signal output from the port 350 is received by the port 9 of the imaging processing section B2 via the image communication line 10, and is passed to the device control section 300. The device control unit 300 controls each mechanism 302 based on the adjustment control signal passed thereto.

In the next step S116, the signal processing unit 351 determines whether the pupil position (for example, the position of the pupil, iris, etc.) of the eye S to be examined is appropriate based on each piece of information specified in step S112. When the signal processing unit 351 determines that the pupil position is not appropriate (step S116, "No"), the process returns to step S113.

On the other hand, if the signal processing unit 351 determines that the pupil position is appropriate (step S116, "Yes"), it ends the series of processes according to the flowchart of FIG. 8 and moves the process to step S102 of FIG. .

FIG. 9 is an example flowchart showing the focus adjustment process according to the first embodiment in more detail. The series of processes shown in FIG. 9 corresponds to the process of step S102 in the flowchart of FIG.

In FIG. 9, in step S120, the device control section 300 turns on the adjustment light source section 41a in the annular light source 41. At this time, the photographing light source section 41b is not turned on.

In the next step S121, the device control unit 300 determines whether the amount of light from the adjustment light source unit 41a turned on in step S120 is appropriate. The determination process in step S121 is the same as the determination process described in step S111 in the flowchart of FIG. 8, so the description here will be omitted.

If the device control unit 300 determines in step S121 that the light amount is not appropriate (step S121, "No"), the process moves to step S122. In step S122, the device control section 300 adjusts the amount of light emitted by the adjustment light source section 41a. The light amount adjustment process in step S122 is the same as the light amount adjustment process described in step S112 in the flowchart of FIG. 8, so the description here will be omitted.

Upon completion of the light amount adjustment process in step S122, the device control unit 300 returns the process to step S121.

On the other hand, if the device control unit 300 determines in step S121 that the amount of light from the adjustment light source unit 41a is appropriate (step S121, "Yes"), the process moves to step S123.

In step S123, the device control unit 300 executes imaging using the image sensor 7. The photographing in step S123 is provisional photographing before the original purpose of photographing the fundus of the eye S to be examined using the image sensor 7.

The image data photographed in step S123 is output from the port 9 and transmitted to the information processing section B3 via the image communication line 10. The image data is received by the port 350 in the information processing section B3 and passed to the signal processing section 351.

In the next step S124, the signal processing unit 351 confirms the image data of the temporary photograph taken in step S123. In the next step S125, the signal processing unit 351 determines whether focus adjustment is appropriate based on the image data confirmed in step S122. For example, the signal processing unit 351 may determine whether focus adjustment is appropriate based on edge information of the image data.

If the signal processing unit 351 determines that the focus adjustment is not appropriate (step S125, "No"), the process moves to step S126.

In step S126, the signal processing unit 351 generates an adjustment control signal that instructs focus adjustment, and outputs the generated adjustment control signal from the port 350. The adjustment control signal output from the port 350 is received by the port 9 of the imaging processing section B2 via the image communication line 10, and is passed to the device control section 300. The device control unit 300 controls the drive mechanism 27 based on the adjustment control signal passed thereto. After the process in step S126, the process returns to step S124.

On the other hand, if the signal processing unit 351 determines that the focus adjustment is properly performed in step S125 (step S123, "Yes"), the signal processing unit 351 ends the series of processes according to the flowchart of FIG. The process moves to step S103.

FIG. 10 is an example flowchart showing the photographing process according to the first embodiment in more detail. The series of processes shown in FIG. 10 corresponds to the process of step S104 in the flowchart of FIG. Note that the photographing according to the flowchart of FIG. 10 is called the actual photographing, and is distinguished from the temporary photographing in step S121 of FIG.

In FIG. 10, in step S140, for example, the device control section 300 performs offset adjustment for the difference in optical path length between the adjustment light from the adjustment light source section 41a and the photographing light from the photographing light source section 41b. For example, if the wavelength when infrared light is used as the adjustment light is 850 nm, and the wavelength of the photographing light is, for example, a representative value of 550 nm, there is a difference of 300 nm between them. Therefore, the alignment adjustment performed using the adjustment light has a known deviation from the time of photographing using the photographing light according to this difference. Based on this deviation, the device control unit 300 determines an offset value for the alignment adjustment made using the adjustment light, corrects the control value resulting from the alignment adjustment, and performs the offset adjustment.

In the next step S141, the device control unit 300 lights the photographing light source unit 41b with a flash. In the next step S142, the device control unit 300 uses the image sensor 7 to perform actual imaging of the fundus of the eye S to be examined. Since the photographing light source unit 41b is lit with a flash in step S141, it is possible to suppress the contraction of the pupils due to light.

When the actual photographing is performed in step S142, the series of processes according to the flowchart of FIG. 10 and the above-mentioned FIG. 7 are completed.

(2-1-3. Details of alignment adjustment processing according to the first embodiment)
Next, the alignment adjustment process according to the first embodiment will be described in more detail.

The alignment adjustment process according to the first embodiment includes the following three steps.
(1) Adjustment of angle of view (2) Deflection of field of view (3) Adjustment of optical axis

(1) View angle adjustment The view angle adjustment process in step S101 in FIG. 7 and step S112 in FIG. 8 will be described.

In the angle of view adjustment, the angle of view of the image sensor 7 is adjusted by changing the optical path length from the eye S to the image sensor 7. This adjustment can be realized by adjusting the depth length of the mounting portion 1 (the length in the direction from the eye S to the optical element 2) using the drive mechanism 24. This is not limited to this, and can be realized by adding a movement mechanism in the depth direction (direction from the subject's eye S toward the optical element 2) to the drive mechanism 25 that drives the optical element 2, and moving the optical element 2 in parallel in the depth direction. It is also possible to do so.

For example, the signal processing unit 351 calculates the amount of adjustment in the angle of view adjustment based on the image information obtained from the image sensor 7 or the information obtained from the anterior eye observation unit 28. For example, when calculating the adjustment amount based on the image information acquired by the anterior eye observation unit 28, the signal processing unit 351 adjusts the angle of view so that the object displayed within the angle of view has a specified size. conduct. The target object may be an ocular structure such as a pupil diameter or an iris diameter, or a predetermined pattern projected from the projector 30 around the anterior segment of the eye. The present invention is not limited to this, and by adding a distance measuring sensor or the like to the anterior eye observation section 28, the distance between the optical section B1 and the eye S to be examined may be directly measured.

(2) Field of View Deflection The field of view deflection processing in step S101 in FIG. 7 and step S113 in FIG. 8 will be explained using FIGS. 11 and 12.

FIG. 11 is a schematic diagram for explaining an overview of visual field deflection according to the first embodiment. In FIG. 11, the eye S to be examined, the optical element 2 and its drive mechanism 25 in the optical section B1, the optical element 4, and the image sensor 7 are extracted and shown from the configuration of the fundus imaging device 100, and other parts are omitted. are doing.

In FIG. 11, the fundus of the eye S to be examined is Pf, and the pupil (center of the pupil) is Pp. A straight line connecting the fundus Pf and the pupil Pp is defined as a chief ray Af. The principal ray Af contacts the optical element 2 for visual field deflection at a point Pa, and then reaches a position Pb' on the principal plane of the optical element 4 for optical axis adjustment.

Further, the center of the imaging area of the image sensor 7 is defined as a position Pi, and the axis of the light beam incident perpendicularly to the position Pi is defined as the imaging optical axis Ai. The imaging optical axis Ai passes through a position Pb on the principal plane of the optical element 4, and exits toward the optical element 2, the device interface D, and the eye S to be examined. Note that in an initial state in which field deflection and optical axis adjustment are not performed, the imaging optical axis passes through the center of the device interface portion D in a direction perpendicular to the device interface.

The field of view deflection refers to adjusting the inclination of the optical element 2 using the drive mechanism 25 to make the positions Pb and Pb' coincide or sufficiently close to each other. Note that the center of rotation of the optical element 2 is assumed to be a point Pc. For visual field deflection, once the relative positions of the fundus Pf, pupil Pp, point Pc, and position Pb are specified, the position of the point Pa where the distance between Pb and Pb' is the minimum is optimally determined based on the following constraints. It can be calculated as a problem.

Constraint condition (1): Point Pa is on principal ray Af.
Constraint condition (2): Point Pa is on the optical element 2 whose rotation center is point Pc.

A method for specifying the relative positions of the four points mentioned above (fundus Pf, pupil Pp, point Pc, and position Pb) will be described. Hereinafter, for the sake of explanation, fundus Pf, pupil Pp, point Pc, and position Pb will be referred to as point Pf, point Pp, point Pc, and point Pb, respectively, as appropriate.

First, point Pf is made to coincide with the photographing optical axis before field deflection and optical axis adjustment at the time of mounting in step S100 of FIG. This can be realized by arranging the device interface part D at a position sufficiently close to the eye S to be examined. This is not limited to this, and can also be realized by limiting the mounting position of the mounting section 1 on the subject 200. As a method of limiting the mounting position of the mounting part 1 on the subject 200, for example, it is possible to form the shape of the mounting part 1 so as to follow a specific part of the face. The present invention is not limited to this, and by specifying the part of the face of the subject 200 that is to be brought into contact with the mounting section 1, it is also possible to limit the mounting position of the mounting section 1 on the subject 200. Furthermore, a reference marker may be projected onto the face of the subject 200 from the mounting portion 1 or the like, and alignment may be performed using the reference marker as an index.

The relative positional relationship between points Pb and Pc is determined by the structure of optical section B1. Further, it is known that the axial length of adults (about 15 years old or older) is about 23 to 25 mm, and there is little individual variation. Therefore, if point Pf is placed on the initial imaging optical axis, the distance between Pf and Pc will not vary significantly for each 200 subjects if one appropriate initial value is set. it is conceivable that. Furthermore, the distance between the device interface D and the eye S to be examined, which is caused by individual differences in the ocular axial length and the degree of pressure applied to the attachment part 1 in step S100, is absorbed when adjusting the angle of view. Therefore, when the mounting of the mounting section 1 in step S100 is completed, it can be said that the relative positional relationship of the points Pf, Pb, and Pc is specified on the world coordinate system W _B1 in the optical section B1.

The invention is not limited to this, but a distance sensor that measures the distance to the surface of the eye S to be examined is added to the anterior eye observation unit 28, and each point Pf, Pb and The relative positional relationship of Pc may also be specified.

It is known that the axial length of a newborn baby is approximately 17 mm, which is slightly smaller than that of an adult. Therefore, in order to realize fundus imaging of subjects 200 in a wide range of age groups, for example, several patterns of initial values of the Pf-Pb distance are prepared in the fundus imaging device 100, and the photographer can switch them at the time of imaging. It is a good idea to make sure that you can

Next, the position of the pupil Pp of the eye S to be examined is specified. For example, the signal processing unit 351 calculates the position of the pupil Pp based on the information on the pupil position obtained from the anterior eye observation unit 28. FIG. 12 is a schematic diagram for explaining a method for specifying the position of the pupil portion Pp that is applicable to the first embodiment.

Section (a) of FIG. 12 shows how an image of the anterior segment of the eye is captured on the imaging surface of the anterior eye observation unit 28. As shown in this figure, the coordinate system W _a of the image sensor 31 of the anterior eye observation section 28 can be transformed from the world coordinate system W _B1 of the entire optical section B1 using a specific affine transformation matrix M ₄₄ .

The coordinate system W _a has its origin at the center of the imaging surface of the image sensor 31, the X _a axis and the Y _a axis coincide with the horizontal direction and the vertical direction of the image sensor, respectively, and the Z _a axis coincides with the optical axis direction. Further, the plane that intersects perpendicularly with this Z _a axis and in which the pupil portion Pp is present is defined as the anterior ocular segment plane F. Furthermore, let f be the focal length of the imaging optical system of the anterior eye observation section 28, and let L be the distance from the imaging surface of the anterior eye observation section 28 to the anterior eye surface F on the Z _a axis.

In the anterior eye plane F, it is assumed that the pupil Pp has a diameter Φ _i . Further, it is assumed that the pupil portion Pp is projected with a diameter Φ _i ' on the imaging surface of the image sensor 31.

The focal length f is known because it is uniquely determined by the device configuration of the optical section B1. Further, since the distance L also converges to a constant value at the time when the above-described view angle adjustment process is completed, it is known at the time when the visual field deflection starts. Then, with reference to section (b) of FIG. 12, it is assumed that the pupil portion Pp is imaged at the coordinates I _p (x, y) on the imaging surface of the image sensor of the anterior eye observation section 28. By using the similarity relationship of focal length f:distance L from the coordinates I _p (x, y) of the imaging position, the coordinates of the pupil portion Pp in the coordinate system W _a can be determined. As described above, the position of the pupil portion Pp in the coordinate system W _a and, in turn, in the world coordinate system W _B1 is specified. As described above, the positions of each point Pf, Pp, Pb, and Pc in the world coordinate system W _B1 have been specified.

(3) Optical axis adjustment The optical axis adjustment process in step S101 in FIG. 7 and step S113 in FIG. 8 will be explained using FIG. 13.

FIG. 13 is a schematic diagram for explaining an overview of optical axis adjustment according to the first embodiment. In FIG. 13, as in FIG. 11 described above, the eye S to be examined, the optical element 2 and its drive mechanism 25 in the optical section B1, the optical element 4, and the image sensor 7 are extracted from the configuration of the fundus imaging device 100. The other parts are omitted.

In the optical axis adjustment, by moving the optical element 4 for optical axis adjustment, the principal ray traveling from the eye S to the optical element 4 is made to coincide with the imaging optical axis of the imaging element 7. This adjustment is realized by adjusting the position and orientation of the optical element 4 using the drive mechanism 26 that drives the optical element 4.

FIG. 13 shows a state in which point Pb and point Pb' are sufficiently close to each other due to the above-described visual field deflection process. In the process up to the field of view deflection described above, the direction of the chief ray A _f and the positions of points Pa and Pb' on the world coordinate system W _B1 are specified. Therefore, the angle _{θ i} that the chief ray A _f incident on the optical element 4 makes with the imaging optical axis of the image sensor 7 can be calculated.

The technique of superimposing obliquely incident light rays on an appropriate optical axis by adjusting the attitude and position of a part of the optical system is a known technique that is also used in lens shift image stabilization. If the angle θ _i can be calculated, the position and orientation of the optical element 4 can be determined by back calculation from the calculated angle θ _i .

As described above, in the first embodiment of the present disclosure, the inclination of the optical element 2 for visual field deflection and the position and orientation of the optical element 4 for optical axis adjustment are acquired by the anterior eye observation unit 28. The control is performed based on the image data acquired by the image sensor 7 and the image data acquired by the image sensor 7. As a result, the degree of freedom in alignment adjustment can be increased compared to existing techniques, and it is possible to provide a fundus imaging device that can be miniaturized and whose alignment adjustment is easy.

Further, the fundus imaging device 100 according to the first embodiment uses light with a wavelength outside the visible light range for illumination during alignment adjustment and focus adjustment, and also lights a flash during actual imaging. It is possible to prevent the pupil of the subject's eye S from constricting due to glare or the like. This eliminates the need to use mydriatic drugs and allows non-medical personnel to perform imaging, and furthermore, allows imaging to be performed remotely from a remote location without a medical personnel present.

(2-2. First modification of the first embodiment)
Next, a first modification of the first embodiment will be described. FIG. 14 is a schematic diagram showing the configuration of an example of a fundus imaging device according to a first modification of the first embodiment. In FIG. 14, a fundus imaging device 100a according to a first modification example connects an optical section B1 and an imaging processing section B2 by an attachment 71, and makes the imaging processing section B2 removable.

The attachment 71 physically connects the optical section B1 and the imaging device 72 so that the incident light from the optical section B1 forms an image on the imaging device within the imaging device 72. The imaging device 72 may be a lens-mounted still image camera or a video camera, or may be an electronic device with a camera function such as a smartphone. Further, a communication terminal for communicating control signals and the like between the imaging device 72 and the device control unit 300 may be added to the attachment 71, or an additional communication line 73 for wired or wireless communication may be prepared. It's okay.

In this way, by making the imaging device 72 that performs fundus photography removable, the user can update the imaging device 72 side or change the imaging device 72 depending on the shooting situation, like a general interchangeable lens camera. Selectable. Furthermore, by making it possible to use existing electronic devices with an imaging function, such as a smartphone with a built-in camera or a single-lens reflex camera with interchangeable lenses, as the imaging device 72, the imaging device 7 and the developing processing unit can be used on the fundus imaging device 100a side. 8 is no longer necessary, making it possible to reduce the size and cost.

(2-3. Second modification of the first embodiment)
Next, a second modification of the first embodiment will be described. FIG. 15 is a schematic diagram showing the configuration of an example of a fundus imaging device according to a second modification of the first embodiment. Note that in FIG. 15, the information processing section B3 is omitted.

In the first embodiment described above, the optical element 2 made of a concave mirror or a plane mirror was used for field deflection. On the other hand, in the second modification of the first embodiment, as shown in FIG. 15, an optical element 2a including an objective lens 60 is used for field deflection. A convex lens can be applied to the objective lens 60. As the objective lens 60, a combination lens made by combining a plurality of lenses may be applied.

FIG. 16 is a schematic diagram showing the configuration of an example of an optical element 2a according to a second modification of the first embodiment. In FIG. 16, the optical element 2a includes an objective lens 60 and an objective lens holder 60' that holds the objective lens 60. The objective lens holder 60' is connected to the

outer frames

61a and 61a' via

respective drive mechanisms

61b and 61b'.

In the example of FIG. 16, the drive mechanism 61b' is connected to the outer frame 61a' on the outer periphery and the outer frame 61a on the inner periphery, and rotates the outer frame 61a on the inner periphery with respect to the fixed outer frame 61a'. A drive mechanism 61b is connected to the outer frame 61a on the inner periphery and the objective lens holder 60', and rotates the objective lens holder 60' with respect to the outer frame 61a' on the outer periphery. Thereby, the objective lens 60 has two rotation axes that intersect perpendicularly to the optical axis.

The

drive mechanisms

61b and 61b' each rotate at an angle according to an instruction amount indicated by a control signal supplied from the device control section 300. The device control section 300 generates a control signal instructing the rotation angle based on the device control signal transmitted from the information processing section B3 through the above-described visual field deflection process, and passes it to the

drive mechanisms

61b and 61b'. The

drive mechanisms

61b and 61b' rotate the outer frame 61a and the objective lens holder 60' according to the control signals. Thereby, the field of view deflection for the image sensor 7 is realized.

In the second modification of the first embodiment, since the objective lens 60 is used as the optical element 2a for visual field deflection in the fundus imaging device 100b, there is no need to bend the fundus imaging device 100b, making the device more compact. It is possible to

(3. Second embodiment)
A second embodiment of the present disclosure will be described. The second embodiment is an example of a fundus imaging device that enables automatic imaging. The fundus imaging device according to the second embodiment is capable of automatically executing the alignment adjustment process, focus adjustment process, and imaging process described in the flowchart of FIG. 7, for example, in response to a trigger operation by the subject 200. . That is, by using the fundus imaging device according to the second embodiment, the subject 200 can directly perform fundus imaging without the presence of a person with appropriate imaging techniques.

That is, in many cases, the subject 200 does not have specialized photographic techniques for intraocular and fundus photography. Furthermore, with the existing technology, it is necessary to fix the line of sight of the subject 200 during imaging, making it difficult for the subject 200 to operate the device during imaging. Therefore, when the subject 200 directly performs fundus imaging, the alignment adjustment and control of the fundus imaging device are all automatically performed within the fundus imaging device, and basically the patient 200 operates the device during imaging and performs the imaging. It is necessary to eliminate the need for actions such as checking the situation.

FIG. 17 is a schematic diagram for explaining how the fundus imaging device according to the second embodiment is used. In FIG. 17, a fundus imaging device 100c according to the second embodiment includes a main body 110a including an optical section B1 and an imaging processing section B2 (none of which are shown), and a subject terminal 120. Ru. The main body portion 110a is provided with a UI 21 for the subject 200 to instruct the start of fundus imaging processing.

The subject 200 holds the main body part 110a with, for example, his/her own hand 210, and brings a part of his/her face (eye area) into contact with the mounting part 1 of the main body part 110a to keep it in a fixed state. The main body portion 110a may be of a hand-held type provided with a grip portion for easy holding by the hand 210, or may be of a stationary type installed on a pedestal or the like.

At this time, since the subject 200 needs to fix his/her line of sight, it is difficult for the subject 200 to directly view and operate the UI 21 . Therefore, it is preferable that the UI 21 has a simple function, such as a button only for starting automatic shooting. Note that if the photographer is someone other than the subject 200, the UI 21 may be an input device that requires visual observation during operation, such as a keyboard, mouse, or touch panel.

The subject terminal 120 is capable of monitoring the operating status of the main body 110a, checking the fundus image taken by the main body 110a, and transmitting it to the outside. It may be configured such that the fundus photographing operation in the main body section 110a is controlled from the subject terminal 120.

As the subject terminal 120, a general-purpose information processing device such as a smartphone, a tablet computer, or a personal computer can be applied. In this case, the subject terminal 120 can be configured by installing an application program for executing fundus imaging processing according to the second embodiment into the information processing device. The present invention is not limited to this, and the subject terminal 120 may be a terminal device dedicated to this fundus imaging device 100c.

FIG. 18 is an example functional block diagram for explaining the functions of the fundus imaging device 100c according to the second embodiment. In FIG. 18, the configurations of the optical section B1 and the imaging processing section B2 are the same as those of the optical section B1 and the imaging processing section B2 in the fundus imaging apparatus 100 according to the first embodiment described using FIG. The explanation will be omitted.

In the fundus imaging device 100c according to the second embodiment, the information processing section B3 includes a subject terminal 120, an automatic adjustment processing section 130, and an indicator 131. Furthermore, in the information processing section B3, the automatic adjustment processing section 130 and the indicator 131 are provided in the main body section 110a. In contrast, the subject terminal 120 is configured separately from the main body portion 110a. The present invention is not limited to this, and it is also possible to incorporate the functions of the subject terminal 120 into the main body 110a.

The subject terminal 120 includes a display section 121, a storage section 122, and a communication section 123. The display unit 121 causes a display device included in the subject terminal 120 to display an image. The storage unit 122 stores data in a storage medium included in the subject terminal 120 and reads data stored in the storage medium. The communication section 123 communicates with the main body section 110a via the image communication line 10. Further, the communication unit 123 can also communicate via an external network by wired or wireless communication.

For example, in the main body section 110a, the imaging processing section B2 transmits image data captured and acquired by the imaging device 7 to the subject terminal 120 via the image communication line 10. The subject terminal 120 can receive the image data transmitted from the main body section 110a through the communication section 123, and cause the display section 121 to display an image based on the received image data on the display device. Thereby, for example, the subject 200 can confirm the result of fundus photography using the main body portion 110a.

Furthermore, the subject terminal 120 can store the image data transmitted from the main body section 110a and received by the communication section 123 in a storage medium using the storage section 122. Furthermore, the subject terminal 120 can also read the image data stored in the storage medium using the storage unit 122 and further transmit it to an external device using the communication unit 123.

In the information processing unit B3, the automatic adjustment processing unit 130 automatically executes the processing related to fundus photography described using FIGS. 7 to 10. For example, in response to an operation by the subject 200 to instruct the UI 21 to start fundus imaging, a control signal instructing to start fundus imaging is passed from the device control unit 300 to the automatic adjustment processing unit 130. In response to this control signal, the automatic adjustment processing unit 130 starts processing from step S101 according to the flowchart of FIG.

That is, through the process of step S101, the device control unit 300 lights up the adjustment light source unit 41a in the annular light source 41 in response to an operation instructing the UI 21 to start imaging, and then lights up the adjustment light source unit 41a in the anterior eye observation unit 28, if necessary. Accordingly, the image sensor 7 and the development processing section 8 are controlled to obtain the initial alignment state and focus state. The device control unit 300 passes information indicating the initial alignment state and focus state to the automatic adjustment processing unit 130.

The automatic adjustment processing unit 130 determines the current alignment state based on the information acquired by the anterior eye observation unit 28 and the image data acquired by the image sensor 7, and calculates the amount of adjustment to the optimal alignment state. . The automatic adjustment processing section 130 sends information indicating the calculated adjustment amount to the optimal alignment state to the device control section 300, and feeds back the adjustment amount. The device control unit 300 that has received the feedback sends the adjustment amount to the drive mechanisms 24 to 26 to perform alignment adjustment.

After the alignment adjustment, the automatic adjustment processing unit 130 obtains the alignment state after the adjustment, and thereafter checks the alignment state and performs the adjustment amount until it is determined that the alignment state is appropriate, in other words, until the alignment adjustment is converged. Repeat calculation and adjustment mechanism control.

If the automatic adjustment processing unit 130 determines that the alignment adjustment has converged, the fundus imaging device 100c proceeds to focus adjustment processing (step S102 in FIG. 7) and imaging processing (step S104 in FIG. 7). In the focus adjustment process, the fundus imaging device 100c repeatedly performs focus adjustment feedback between the device control unit 300, the drive mechanism 27 that controls focus adjustment, and the automatic adjustment processing unit 130, similarly to the alignment adjustment process. Control takes place.

Here, the fundus imaging device 100c may include an indicator 131 on the main body portion 110a for assisting the subject 200 who performs imaging in operating the device.

The indicator 131 may present the internal state of the main body 110a, including the operation method of the fundus imaging device 100c and the alignment information obtained from the automatic adjustment processing unit 130, to the photographer (for example, the subject 200). The indicator 131 may present information to the photographer using at least one of visual information and audio information. The indicator 131 is not limited to this, and the indicator 131 may present information to the photographer using tactile information such as vibration. Further, the indicator 131 may present information to the photographer using a combination of these.

When the subject 200 operates the main body portion 110a and presents information as visual information using the indicator 131, the subject 200 confirms the indicator 131 with the eye that is not the subject of photography. In this case, when the subject 200 tries to look directly at the indicator 131, the line of sight of the subject's eye S also moves. Therefore, when presenting information as visual information, it is preferable to adopt a structure that does not require direct viewing of the indicator 131.

FIG. 19 is a schematic diagram showing a configuration example of the indicator 131 when visual information is used, which is applicable to the second embodiment. In the example of FIG. 19, the indicator 131a by the lighting device is placed on both side surfaces of the main body 110a, that is, on a surface parallel to the front direction of the face of the subject 200 when the subject 200 is correctly holding the main body 110a. It is set up in

The indicator 131a can use a light emitting element such as an LED (Light Emitting Diode). It is preferable that the indicator 131a is configured so that the emitted light is sufficiently diffused so that the subject 200 can confirm the light emission of the indicator 131a without looking directly at the indicator 131a. Further, the indicator 131a can selectively emit light in a plurality of colors, and may emit light in a color depending on the state of the fundus imaging device 100c. By doing so, the subject 200 can confirm the state of the fundus imaging device 100c from the color of the light emitted from the indicator 131a.

Not limited to this example, as further shown in FIG. An indicator 131b may be provided on the side surface. In this case, by installing a mirror or the like at a position sufficiently far from facing the subject 200, the subject 200 can confirm whether or not the indicator 131b emits light and the color of the light emitted through the mirror. .

(Specific example of alignment adjustment processing)
The alignment adjustment process according to the second embodiment will be described in more detail. In the second embodiment, automatic execution of the alignment adjustment is realized by feeding back the results of the processing of the angle of view adjustment, field deflection, and optical axis adjustment to the device control unit 300.

FIG. 20 is an example flowchart showing more specifically the alignment adjustment process according to the second embodiment. The process according to the flowchart of FIG. 20 corresponds to the process of step S101 in the flowchart of FIG.

In FIG. 20, in step S200, the fundus imaging device 100c causes the device control unit 300 to turn on the adjustment light source unit 41a. In the next step S201, the fundus imaging device 100c performs provisional imaging using the image sensor 7 under the control of the device control unit 300. However, the present invention is not limited to this, and in step S201, the anterior eye observation unit 28 may photograph the anterior eye segment. Image data acquired by photographing with the image sensor 7 or the anterior eye observation section 28 is passed to the automatic adjustment processing section 130 in the information processing section B3.

Note that here, it is assumed that the image sensor 7 or the anterior eye observation unit 28 captures a moving image. Shooting of moving images may be continued, for example, until the actual shooting is started.

In the next step S202, the fundus imaging device 100c uses the automatic adjustment processing unit 130 to detect the iris image of the eye S to be examined from the image data acquired by imaging with the image sensor 7 or the anterior eye observation unit 28, and detects the iris image of the eye S to be examined. The iris diameter is determined based on the iris image. That is, since it is known that individual differences in the diameter of the iris are small, it is possible to determine whether the current angle of view falls within the range based on the size of the photographed iris system.

In the next step S203, the automatic adjustment processing unit 130 determines whether the acquired iris diameter is an appropriate size. When the automatic adjustment processing unit 130 determines that the acquired iris diameter is not an appropriate size (step S203, "No"), the automatic adjustment processing unit 130 moves the process to step S204, and generates angle of view information based on the acquired iris diameter. is passed to the device control unit 300, and the viewing angle information is fed back.

The device control unit 300 controls, for example, the drive mechanism 24 based on the angle of view information passed from the automatic adjustment processing unit 130 to adjust the distance from the optical section B1 to the eye S to be examined. After step S204, the process returns to step S202.

On the other hand, when the automatic adjustment processing unit 130 determines that the acquired iris diameter is an appropriate size (step S203, "Yes"), the process moves to step S205.

The method of adjusting the angle of view is not limited to the method based on image data. For example, a distance measurement sensor or the like may be incorporated into the anterior eye observation unit 28 to directly measure the distance to the eye S to be examined. Alternatively, a projector 30 may be provided in the anterior eye observation unit 28 to project a predetermined marker onto the eye S to be examined. In this case, the automatic adjustment processing unit 130 determines the difference between the optical unit B1 and the anterior segment based on the size of the marker image on the image based on the image data acquired by the anterior eye observation unit 28 or the image sensor 7. The distance may also be calculated. The automatic adjustment processing unit 130 adjusts the angle of view based on these measured or calculated distances.

In step S205, the automatic adjustment processing unit 130 detects the pupil image of the eye S to be examined from the image data acquired by photographing with the imaging device 7 or the anterior eye observation unit 28, and acquires the position of the pupil. That is, depending on whether the center of the pupil of the eye S to be examined is imaged at a position sufficiently close to the center of the image sensor 7, the current state of the visual field deflection and the optical axis position can be determined.

In the next step S206, the automatic adjustment processing unit 130 determines whether the pupil position acquired in step S205 is an appropriate position. If the automatic adjustment processing unit 130 determines that the acquired pupil position is not an appropriate position, it moves the process to step S207, passes the position information indicating the acquired pupil position to the device control unit 300, and transfers the position information to the device control unit 300. Provide feedback.

The device control unit 300 adjusts, for example, the

drive mechanisms

25 and 26 based on the position information passed from the automatic adjustment processing unit 130, and adjusts the pupil position on the image captured by the image sensor 7. If the pupil image is formed at a position shifted by a predetermined amount or more with respect to the imaging center of the image sensor 7, the device control unit 300 re-executes the field of view deflection and optical axis adjustment in a direction to correct the amount of shift. do. After step S206, the process returns to step S205.

Note that in step S205 and step S206, if necessary, the drive mechanism 27 can be controlled to drive the optical element 5 for focus adjustment to focus the pupil of the eye S to be examined on the image sensor 7. .

Regarding optical axis adjustment, the condition can also be confirmed by the distorted shape of the imaged pupil. In the next step S208, the automatic adjustment processing unit 130 acquires the shape of the pupil image in the eye S to be examined from the image data acquired by photographing with the imaging device 7 or the anterior eye observation unit 28. That is, by detecting the distortion in the shape of the pupil image of the eye S to be examined, the current state of the optical axis position can be determined.

For example, referring to FIG. 11 described above, if the pupil including the principal ray A _f is captured directly in front of the imaging optical axis A _i of the image sensor 7, the pupil is imaged as a circular image. However, if the optical axis adjustment is insufficient and the pupil is photographed obliquely with respect to the imaging optical axis A _i , the pupil image on the image sensor 7 will be distorted in correlation to the tilt. It becomes an oval shape. Therefore, it becomes possible to perform feedback control of optical axis adjustment based on the shape of the pupil image.

The method of optical axis adjustment is not limited to the above method. For example, in the focus adjustment process (step S102 in FIG. 7) that performs fundus imaging, it is determined whether the macula is photographed near the center of the fundus image finally obtained by the image sensor 7, or whether it is within the image frame. It is possible to determine the optical axis based on whether or not the optic nerve head is accommodated in the optic nerve head.

After the process in step S208, the process moves to step S209. In step S209, the automatic adjustment processing unit 130 determines whether there is any distortion in the shape of the pupil image acquired in step S208 (for example, whether the ratio of the major axis to the minor axis of the pupil image is equal to or greater than a predetermined value). If the automatic adjustment processing unit 130 determines that the acquired pupil shape is distorted (step S209, "No"), the automatic adjustment processing unit 130 moves the process to step S210, and transmits the shape information indicating the acquired pupil shape to the device control unit. 300, and the shape information is fed back.

The device control unit 300 controls, for example, the drive mechanism 26 to drive the optical element 4 based on the shape information passed from the automatic adjustment processing unit 130, and irradiates the image sensor 7 from the eye S through the optical element 2. Adjust the angle of the light. After step S210, the process returns to step S208.

If the automatic adjustment processing unit 130 determines that there is no distortion in the acquired pupil shape (step S209, "Yes"), the fundus imaging device 100c ends the series of processes in the flowchart of FIG. Then, the fundus imaging device 100c moves the process to step S102 in the flowchart of FIG. 7, for example, and executes focus adjustment processing.

Note that a general autofocus function can be applied to the focus adjustment process. For example, many blood vessels run through the fundus of the eye, and it is possible to automatically adjust the focus using these blood vessels as indicators.

As described above, according to the second embodiment, alignment adjustment processing and focus adjustment can be performed by the subject 200, for example, simply performing a simple operation on the UI 21 provided on the main body 110a of the fundus imaging device 100c. Fundus photography including processing is automatically executed. It becomes possible to provide a fundus imaging device whose alignment is easy to adjust.

Furthermore, during alignment adjustment processing and focus adjustment processing, the adjustment light source section 41a illuminates the eye S to be examined using light with a wavelength outside the visible light range, and during actual photography, flash lighting is used. Therefore, there is no need to use mydriatic drugs, etc., and it is possible for non-medical personnel to perform imaging, and furthermore, it is possible to perform fundus imaging without a medical personnel present.

(4. Third embodiment)
Next, a third embodiment of the present disclosure will be described. The fundus imaging device according to the third embodiment is an example that allows operation from a remote location by a photographer who has specialized skills in fundus photography. In this case, since the photographer has specialized skills regarding fundus photography, it is assumed that the photographer himself/herself operates the equipment to set photography conditions, including alignment adjustment, as necessary. Therefore, in addition to fully automatic imaging within the fundus imaging device, it is necessary to add a mechanism that allows manual adjustment of the device while viewing the outputs of the image sensor 7 and the anterior eye observation unit 28.

FIG. 21 is a schematic diagram for explaining how the fundus imaging device according to the third embodiment is used.

In FIG. 21, a fundus imaging device 100d according to the third embodiment includes a main body 110b including an optical section B1 and an imaging processing section B2 (none of which are shown),

communication devices

401 and 402, and a photographer terminal 410. , and a display device 420. Furthermore, the

communication devices

401 and 402, the photographer terminal 410, and the display device 420 constitute an information processing section B3.

As the photographer terminal 410, for example, a general-purpose information processing device such as a personal computer, a tablet computer, or a smartphone can be applied. In this case, the photographer terminal 410 can be configured by installing an application program for executing fundus imaging processing according to the third embodiment into the information processing device. The present invention is not limited to this, and the photographer terminal 410 may be a terminal device dedicated to this fundus imaging device 100d.

The communication device 401 is provided, for example, at a location where the subject 200 uses the main body portion 110b. Further, the communication device 402 is provided, for example, at a location remote from the location where the main body portion 110b is used, and where the photographer 430 remotely operates the main body portion 110b. The

communication devices

401 and 402 are capable of communicating with each other via a network 400 such as the Internet.

The main body portion 110b and the communication device 401 are connected by the image communication line 10 and the control communication line 11. Image data acquired by the anterior eye observation section 28 and the image sensor 7 in the main body section 110b is output from the port 9 and passed to the communication device 401 via the image communication line 10. Further, for example, control information transmitted from the communication device 402 and received by the communication device 401 via the network 400 is inputted from the communication device 401 to the port 22 via the control communication line 11, and is passed to the main body section 110b.

The display device 420 and the photographer terminal 410 are used by the photographer 430. The photographer 430 is assumed to be someone who has specialized skills regarding fundus photography. The communication device 402 passes image data received from the communication device 401 via the network 400 to the display device 420 and the photographer terminal 410. For example, control information output by the photographer terminal 410 in response to an operation by the photographer 430 is transmitted to the network 400 by the communication device 402 and received by the communication device 401.

FIG. 22 is an example functional block diagram for explaining the functions of the fundus imaging device 100d according to the third embodiment. In FIG. 22, the configurations of the optical section B1 and the imaging processing section B2 are the same as those of the optical section B1 and the imaging processing section B2 in the fundus imaging apparatus 100 according to the first embodiment described using FIG. The explanation will be omitted.

In FIG. 22, the information processing unit B3 includes

communication devices

401 and 402 that are communicably connected via a network 400, a photographer terminal 410, and a display device 420. Further, the photographer terminal 410 includes a UI 411, a storage section 412, and an operation assistance section 413.

The communication device 402 passes the image data received from the communication device 401 to the display device 420 and the photographer terminal 410. In the photographer terminal 410, the UI 411 includes an input device that outputs a control signal according to an input operation by the photographer 430, and a display device that displays information such as images. Input devices can include buttons, toggle switches, keyboards, and pointing devices such as mice and touch panels. The input device is not limited to this, and may have other input means (voice input, etc.).

The storage unit 412 stores data in a storage medium included in the photographer terminal 410 and reads data stored in the storage medium. For example, the storage unit 412 stores the image data obtained by photographing the fundus, which is received by the communication device 402, in the storage medium. Furthermore, the storage unit 412 reads image data obtained by fundus photography stored in the storage medium. The read image data is supplied to, for example, the display device 420 and displayed as an image.

The operation assisting unit 413 has the same function as the automatic adjustment processing unit 130 described using, for example, FIG. A control signal for controlling alignment adjustment processing and focus adjustment processing in the main body portion 110b is generated. Further, the operation assisting unit 413 generates a control signal for controlling alignment adjustment processing and focus adjustment processing in the main body unit 110b in response to an operation on the UI 411 by the photographer 430.

Further, the operation assisting unit 413 may transmit control signals for controlling the image sensor 7, the developing processing unit 8, the anterior eye observation unit 28, and the annular light source 41, and set values of internal parameters, as necessary. . By transmitting control signals for controlling these parts and internal parameter setting values for each part, the operation assisting part 413 can adjust the appearance of the image displayed on the display device 420 and adjust the final fundus imaging device. The image of the output image data 100b can be adjusted.

In such a configuration, the main body section 110b performs the alignment adjustment process in step S101, the focus adjustment process in step S102, and the photographing process in step S104 in the flowchart of FIG. The image data obtained by photographing the anterior segment of the eye by the anterior eye observation unit 28 and the image data of the intraocular and fundus images obtained by photographing with the imaging device 7 are transmitted.

In the information processing section B3, an image based on the image data transmitted from the main body section 110b and received by the communication device 402 is displayed on the display device 420. The display device 420 may further display other auxiliary information (referred to as auxiliary information) regarding the image. The auxiliary information may be information indicating the focused state of the image, information indicating the light amount saturation state, or the like.

The operation assistance unit 413 can acquire assistance information based on, for example, image data transmitted from the main unit 110b and received by the communication device 402. The operation assistance unit 413 passes the acquired assistance information to the display device 420. The display device 420 may display the auxiliary information passed from the operation assistance unit 413 superimposed on the image data, or may display the auxiliary information in a window separate from the image data. Furthermore, the auxiliary information may be displayed on another display device different from the display device 420.

The display device 420 may display the auxiliary information as image information (for example, displaying the light intensity saturated area with diagonal lines on the image) or as text-based numerical information (for example, displaying the light intensity area with diagonal lines on the image). degree expressed as a percentage).

Based on the image and auxiliary information displayed on the display device 420, the photographer 430 checks the state of alignment adjustment and focus adjustment in the main body section 110b located at a remote location. Depending on the confirmation result, the photographer 430 operates the input device of the UI 411 on the photographer terminal 410 to control the main body 110b.

The photographer terminal 410 generates a control signal for controlling the operation of the main body 110b in response to the operation of the UI 411 by the photographer 430. The control signal generated here includes information regarding alignment adjustment control, focus adjustment control, imaging control, image processing control, and the like.

A control signal generated by the photographer terminal 410 is transmitted from the communication device 402 via the network 400 and received by the communication device 401. The communication device 401 inputs the received control information to the port 22 via the control communication line 11. Control information input to the port 22 is passed to the device control section 300. The device control unit 300 controls the drive mechanisms 24 to 27, the anterior eye observation unit 28, the image sensor 7, the development processing unit 8, etc. based on this control information, and executes alignment adjustment processing, focus adjustment processing, and imaging processing. . In this way, in the fundus imaging apparatus 100d according to the third embodiment, the main body 110b can be remotely controlled by the photographer 430 manually from the photographer's terminal 410.

Further, the photographer terminal 410 uses the main body 110b based on the image data acquired by photographing the anterior eye by the anterior eye observation unit 28 and the image data of the intraocular and fundus images acquired by photographing by the image sensor 7. The alignment adjustment process, focus adjustment process, and photographing process can be automatically executed.

That is, in the photographer terminal 410, the operation assisting section 413 calculates adjustment values for each of the alignment adjustment and the focus adjustment in the same manner as the automatic adjustment processing section 130 described in the above-mentioned second embodiment. The photographer terminal 410 sends each calculated adjustment value to the main body section 110b through communication using the

communication devices

401 and 402. This enables feedback control of alignment adjustment and focus adjustment.

Note that the operation assisting unit 413 can also individually control alignment adjustment, focus adjustment, and photographing processing in accordance with the operation of the photographer 430 on the UI 411.

As described above, according to the third embodiment, the photographer 430 performs alignment adjustment and focus adjustment for fundus imaging from a remote location where the subject 200 uses the main body 110b to perform fundus imaging. and can control the shooting process. This makes it possible to provide a fundus imaging device with easy alignment adjustment.

Further, according to the third embodiment, the operation assisting section 413 controls the image sensor 7, the development processing section 8, the anterior eye observation section 28, and the annular light source 41 in accordance with the operation of the photographer 430 on the UI 411. control signals and internal parameter settings can be generated and transmitted to the main body section 110b. This makes it possible to provide a fundus imaging device that can easily perform more detailed alignment adjustments from a remote location.

In addition, light with a wavelength outside the visible light range is used for illumination during alignment adjustment and focus adjustment, and a flash is turned on during the actual shooting to prevent constriction of the pupil of the subject's eye S due to glare etc. Is possible. Therefore, there is no need to use mydriatic drugs, and imaging can be performed remotely from a remote location without the presence of medical personnel.

Note that the effects described in this specification are merely examples and are not limiting, and other effects may also exist.

Note that the present technology can also have the following configuration.
(1)
a first optical section that is provided between an eye to be examined and an imaging section that images the fundus of the eye to be examined, and that changes a visual field direction of the imaging section with respect to the eye to be examined;
a second optical section that is provided between the first optical section and the imaging section and corrects the traveling direction of light emitted from the fundus and irradiated to the imaging section via the first optical section; and,
A fundus imaging device comprising:
(2)
The first optical section is
a first optical element made of any one of a concave mirror, a plane mirror, a lens, and a hologram optical element;
a first drive mechanism that controls the direction in which light is emitted by the first optical element;
including,
The fundus imaging device according to (1) above.
(3)
The second optical section is
a second optical element consisting of either a lens or a hologram optical element;
a second drive mechanism that controls the direction in which light is emitted by the second optical element;
including,
The fundus imaging device according to (1) or (2) above.
(4)
a third optical element into which the light emitted from the second optical section is incident;
a third drive mechanism that drives the third optical element to adjust the focus of the light irradiated to the imaging section via the second optical section;
a third optical section,
further comprising,
The fundus imaging device according to any one of (1) to (3) above.
(5)
a control unit that controls the first optical unit, the second optical unit, and the imaging by the imaging unit based on an image of the eye to be examined;
further comprising,
The fundus imaging device according to any one of (1) to (4) above.
(6)
an anterior ocular observation unit for observing the anterior ocular segment of the subject's eye;
Furthermore,
The control unit includes:
The fundus imaging device according to (5), wherein the first optical section and the second optical section are controlled based on the image acquired by observation by the anterior eye observation section.
(7)
The anterior eye observation part is
a first light source unit that irradiates the anterior segment with light having a wavelength in the visible light range;
a second light source unit that irradiates the anterior segment with light having a wavelength outside the visible light range;
including,
The fundus imaging device according to (6) above.
(8)
The anterior eye observation part is
When the visual field direction is changed by the first optical part and when the traveling direction of the light is corrected by the second optical part, the second light source part irradiating light and not irradiating light from the first light source unit;
The fundus imaging device according to (7) above.
(9)
The first light source section and the second light source section are
Having a concentric shape that shares a mutual center,
The fundus imaging device according to (7) or (8) above.
(10)
The anterior eye observation part is
a third light source unit that irradiates the anterior segment with light of a specific wavelength for performing fluorescence observation;
further including,
The fundus imaging device according to any one of (7) to (9) above.
(11)
The control unit includes:
controlling the imaging unit, the first optical unit, and the second optical unit based on the image captured by the imaging unit in response to a user operation;
The fundus imaging device according to any one of (5) to (10) above.
(12)
The control unit includes:
controlling the first optical unit and the second optical unit based on the position of the pupil of the eye to be examined in the image captured by the imaging unit;
The fundus imaging device according to (11) above.
(13)
The control unit includes:
controlling the first optical unit and the second optical unit based on the shape of the pupil of the eye to be examined in the image captured by the imaging unit;
The fundus imaging device according to (11) or (12) above.
(14)
a fourth optical section that changes the distance of the optical path from the imaging section to the eye to be examined;
Furthermore,
The control unit includes:
controlling the fourth optical section based on the size of the eye to be examined in the image;
The fundus imaging device according to any one of (5) to (13) above.
(15)
an attachment that allows the imaging unit to be attached and detached;
The fundus imaging device according to any one of (1) to (14) above, further comprising:
(16)
executed by the processor,
The fundus imaging device includes
a first optical section that is provided between an eye to be examined and an imaging section that images the fundus of the eye to be examined, and that changes a visual field direction of the imaging section with respect to the eye to be examined;
a second optical section that is provided between the first optical section and the imaging section and corrects the traveling direction of light that is emitted from the fundus and reaches the imaging section via the first optical section; ,
Imaging by the imaging unit;
a control step that controls according to user operations;
Fundus imaging methods, including:
(17)
According to the control step,
controlling the imaging unit, the first optical unit, and the second optical unit based on the image captured by the imaging unit in response to the user operation;
The fundus imaging method according to (16) above.
(18)
According to the control step,
controlling the first optical section and the second optical section based on the position of the pupil of the eye to be examined in the image;
The fundus imaging method according to (17) above.
(19)
According to the control step,
controlling the first optical section and the second optical section based on the shape of the pupil of the eye to be examined in the image;
The fundus imaging method according to (17) or (18) above.
(20)
The fundus imaging device includes:
further comprising a fourth optical section that changes the distance of the optical path from the imaging section to the eye to be examined,
According to the control step, further:
controlling the fourth optical section based on the size of the eye to be examined in the image;
The fundus imaging method according to any one of (17) to (19) above.

1 Mounting

section

2, 3, 4, 5, 6

Optical element

7, 31, 530 Image sensor 8

Development processing section

9, 22, 350 Port 10 Image communication line 11 Control communication line 21, 411 UI
23,300

Device control section

24, 25, 26, 27, 61b, 61b'

Drive mechanism

28, 28a, 28b, 28c Anterior eye observation section 30 Projector 41 Annular light source 60 Objective lens 71 Attachment 72 Imaging device 41a Adjustment light source Section 41b Photographing

light source section

100, 100a, 100b, 100c, 100d

Fundus imaging device

110a, 110b Main body section 120 Subject terminal 130 Automatic

adjustment processing section

131, 131a, 131b Indicator 200 Subject 351 Signal processing section 352 Display section 353 Input unit 400

Network

401, 402 Communication device 410 Photographer terminal 413 Operation assistance unit 420 Display device 430 Photographer B1 Optical unit B2 Imaging processing unit B3 Information processing unit S, 500 Eye to be examined

Claims

a first optical section that is provided between an eye to be examined and an imaging section that images the fundus of the eye to be examined, and that changes a visual field direction of the imaging section with respect to the eye to be examined;
a second optical section that is provided between the first optical section and the imaging section and corrects the traveling direction of light emitted from the fundus and irradiated to the imaging section via the first optical section; and,
A fundus imaging device comprising:
The first optical section is
a first optical element made of any one of a concave mirror, a plane mirror, a lens, and a hologram optical element;
a first drive mechanism that controls the direction in which light is emitted by the first optical element;
including,
The fundus imaging device according to claim 1.
The second optical section is
a second optical element consisting of either a lens or a hologram optical element;
a second drive mechanism that controls the direction in which light is emitted by the second optical element;
including,
The fundus imaging device according to claim 1.
a third optical element into which the light emitted from the second optical section is incident;
a third drive mechanism that drives the third optical element to adjust the focus of the light irradiated to the imaging section via the second optical section;
a third optical section,
further comprising,
The fundus imaging device according to claim 1.
a control unit that controls the first optical unit, the second optical unit, and the imaging by the imaging unit based on an image of the eye to be examined;
further comprising,
The fundus imaging device according to claim 1.
an anterior ocular observation unit for observing the anterior ocular segment of the subject's eye;
Furthermore,
The control unit includes:
The fundus imaging device according to claim 5, wherein the first optical section and the second optical section are controlled based on the image acquired by observation by the anterior eye observation section.
The anterior eye observation part is
a first light source unit that irradiates the anterior segment with light having a wavelength in the visible light range;
a second light source unit that irradiates the anterior segment with light having a wavelength outside the visible light range;
including,
The fundus imaging device according to claim 6.
The anterior eye observation part is
When the visual field direction is changed by the first optical part and when the traveling direction of the light is corrected by the second optical part, the second light source part irradiating light and not irradiating light from the first light source unit;
The fundus imaging device according to claim 7.
The first light source section and the second light source section are
Having a concentric shape that shares a mutual center,
The fundus imaging device according to claim 7.
The anterior eye observation part is
a third light source unit that irradiates the anterior segment with light of a specific wavelength for performing fluorescence observation;
further including,
The fundus imaging device according to claim 7.
The control unit includes:
controlling the imaging unit, the first optical unit, and the second optical unit based on the image captured by the imaging unit in response to a user operation;
The fundus imaging device according to claim 5.
The control unit includes:
controlling the first optical unit and the second optical unit based on the position of the pupil of the eye to be examined in the image captured by the imaging unit;
The fundus imaging device according to claim 11.
The control unit includes:
controlling the first optical unit and the second optical unit based on the shape of the pupil of the eye to be examined in the image captured by the imaging unit;
The fundus imaging device according to claim 11.
a fourth optical section that changes the distance of the optical path from the imaging section to the eye to be examined;
Furthermore,
The control unit includes:
controlling the fourth optical section based on the size of the eye to be examined in the image;
The fundus imaging device according to claim 5.
an attachment that allows the imaging unit to be attached and detached;
The fundus imaging device according to claim 1, further comprising:
executed by the processor,
The fundus imaging device includes
a first optical section that is provided between an eye to be examined and an imaging section that images the fundus of the eye to be examined, and that changes a visual field direction of the imaging section with respect to the eye to be examined;
a second optical section that is provided between the first optical section and the imaging section and corrects the traveling direction of light that is emitted from the fundus and reaches the imaging section via the first optical section; ,
Imaging by the imaging unit;
a control step that controls according to user operations;
Fundus imaging methods, including:
According to the control step,
controlling the imaging unit, the first optical unit, and the second optical unit based on the image captured by the imaging unit in response to the user operation;
The fundus imaging method according to claim 16.
According to the control step,
controlling the first optical section and the second optical section based on the position of the pupil of the eye to be examined in the image;
The fundus imaging method according to claim 17.
According to the control step,
controlling the first optical section and the second optical section based on the shape of the pupil of the eye to be examined in the image;
The fundus imaging method according to claim 17.
The fundus imaging device includes:
further comprising a fourth optical section that changes the distance of the optical path from the imaging section to the eye to be examined,
According to the control step, further:
controlling the fourth optical section based on the size of the eye to be examined in the image;
The fundus imaging method according to claim 17.