JP6507536B2 - Ophthalmic imaging apparatus and ophthalmologic imaging program - Google Patents

Description

The present disclosure, ophthalmologic photographing apparatus for photographing a subject's eye, and relates to an ophthalmic photographing program.

  As an ophthalmologic imaging apparatus for imaging a subject's eye, for example, an OCT apparatus for acquiring a tomographic image using an optical coherence tomography (OCT) using low coherent light is known (Patent Document 1) 1). The acquired tomographic image is transferred to a computer via a communication line, and analysis processing is performed. Also, as an ophthalmologic imaging apparatus, a fundus camera and SLO are known. Furthermore, a combined device of OCT and fundus camera has been proposed.

JP 2012-213489

  In the above technical field, for example, observation of an eye to be examined by a live image and good diagnosis and analysis based on a captured image are required. In addition, there is a certain limit to the amount of communication between the device body and the computer.

This indication makes it a technical subject to provide an ophthalmologic photographing device which can solve at least one of the conventional technology , and an ophthalmologic photographing program in view of the above-mentioned problem.

  In order to solve the above-mentioned subject, this indication is characterized by having the following composition.

(1) An ophthalmologic photographing apparatus for photographing an eye to be examined, and a first photographing optical system for acquiring a first image of the eye to be examined by photographing the eye to be examined using a first photographing method A first line for transmitting a first live image signal for forming a first live image, which is a live image of the first image, to a host computer, and a line different from the first line At least a second line for transmitting a signal from the ophthalmologic imaging apparatus to the host computer, and a third line for receiving a command signal from the host computer, the ophthalmologic imaging apparatus Data communication means for connecting the host computer for receiving the first image acquired by the first imaging optical system, and the host computer via the data communication means Data control means for controlling the data to be sent, said data control means, in parallel with a first transmission control for transmitting said first live image signal to said host computer via said first line, A first captured image signal for forming a first captured image which is a captured image of the first image, wherein the first captured image signal is transmitted to the host computer via the second line. Transmission control is performed.
(2) An ophthalmologic photographing program for use in an ophthalmologic photographing apparatus for photographing an eye to be examined, which is executed by a processor of the ophthalmologic photographing apparatus to photograph an eye to be examined using a first photographing method Transmitting to the host computer a first imaging step for acquiring a first image of the eye to be examined and a first live image signal for forming a first live image which is a live image of the first image A first line, the second line is a line different from the first line, and a second line for transmitting a signal from the ophthalmologic imaging apparatus to the host computer, and a command signal from the host computer At least using a third line for receiving, the ophthalmologic imaging apparatus, and a host computer for receiving the first image acquired in the first imaging step; A data communication step of connecting data, and a data control step of controlling data to be transmitted to the host computer in the data communication step, wherein the first live image signal is transmitted via the first line. A first capture image signal for forming a first capture image which is a capture image of the first image in parallel with the first transmission step of transmitting to the host computer, via the third line A second transmission step of transmitting a first captured image signal acquired using the imaging command signal as a trigger to the host computer via the second line, and causing the ophthalmologic imaging apparatus to execute I assume.

It is the schematic which shows the external appearance of the fundus imaging apparatus which concerns on a present Example. It is a figure which shows the optical system and control system of the fundus imaging apparatus which concern on a present Example. It is a figure which shows an example of the screen displayed on the display part which concerns on a present Example. It is a block diagram showing a control system concerning an example. It is a figure for demonstrating a communication means. It is an example when the anterior segment image imaged by the image pick-up element is displayed on a display part. It is a figure explaining alignment detection to a to-be-tested eye. It is a figure which shows an example of the imaging operation which concerns on an Example.

<Overview>
Hereinafter, the outline of the present embodiment will be described using the drawings. An ophthalmologic imaging apparatus (for example, the ophthalmologic imaging apparatus 1 shown in FIG. 1) includes a first imaging optical system (for example, the imaging optical system 30 shown in FIG. 2) and a data communication unit (for example, the USB port 78a shown in FIG. And a data control unit (for example, the control unit 70).

  The first imaging optical system may acquire the first image of the first subject's eye, for example, by imaging the subject's eye using the first imaging method.

  The data communication unit includes, for example, at least a first line, a second line, and a third line. The first line (for example, the fourth endpoint EP4 shown in FIG. 5) transmits, to the host computer, a first live image signal for forming a first live image which is a live image of the first image, for example. Do. The second line (for example, the third endpoint EP3) is, for example, a line different from the first line, and transmits a signal from the ophthalmologic imaging apparatus to the host computer (for example, the host computer 90). The second line may transmit a response signal to the host computer to the host computer. The third line (for example, the first endpoint EP1 in FIG. 5) receives, for example, a command signal from the host computer. Here, the line is not limited to a physical line, but indicates, for example, a path (path) of information. Therefore, even if it is physically one cable, multiple lines can virtually exist inside the cable.

  The data communication unit may connect, for example, the ophthalmologic imaging apparatus and a host computer that receives the first image acquired by the first imaging optical system of the ophthalmologic imaging apparatus. The data control unit may control, for example, data to be transmitted to the host computer via the data communication unit. The data control unit may perform, for example, the first transmission control and the second transmission control in parallel. Here, the first transmission control may be, for example, control for transmitting the first live image signal to the host computer via the first line. The second transmission control is, for example, control to transmit a first capture image signal acquired using an imaging command signal via the third line as a trigger to the host computer via the second line. It may be. Here, the first captured image signal is, for example, a signal for forming a first captured image which is a captured image of the first image. Thus, the ophthalmologic imaging apparatus can transmit the first captured image to the host computer while transmitting the live image to the host computer.

  The first photographing optical system may include an irradiation optical system and a light receiving optical system configured by the first photographing method. The first imaging optical system may be an infrared imaging optical system formed to acquire a front image by infrared illumination as a first imaging method. The infrared imaging optical system may be a scanning laser ophthalmoscope (SLO). Furthermore, the infrared imaging optical system may be an optical system that includes a two-dimensional imaging device and acquires a fundus front image or an anterior segment front image.

  The live image is, for example, an image obtained by imaging not intended for writing data to a storage medium for recording and storage. Alternatively, it is defined as a continuously captured real-time image.

  The first live image signal may be, for example, a first live image signal acquired by the first imaging optical system to form a live image of the first image. For example, the first live image signal may be generated based on a light receiving signal from a light receiving element (for example, the light receiving element 38) provided in the first imaging optical system in the ophthalmologic imaging apparatus main body.

  The first captured image signal may be, for example, a first captured image signal acquired by the first imaging optical system to form a captured image of the first image. For example, the first captured image signal may be generated based on a light reception signal from a light receiving element provided in the first photographing optical system in the ophthalmologic photographing apparatus main body.

  The host computer may be disposed at a position different from the imaging apparatus main body and connected via a communication line. As another position, a case where the apparatus main body and the host computer are juxtaposed, or a case where they are arranged in different rooms, etc. are assumed. The communication line may use USB standard, camera link standard or Gigabit Ethernet (registered trademark) standard. Multiple standards may be used together. In addition, in the connection between the host computer and the photographing apparatus main body, not only the USB terminal but also other connection terminals may be used. A plurality of types of connection terminals may be used. The data communication unit may be a wired communication unit or a wireless communication unit.

  The ophthalmologic imaging apparatus of the present embodiment may further include a second imaging optical system (for example, an interference optical system 200). The second imaging optical system may acquire a second image of the subject's eye by imaging the subject's eye using, for example, a second imaging method different from the first imaging method.

  The data communication unit may further include a fourth line for transmitting a second image signal for forming a second image to the host computer. In this case, the data control unit may perform the second transmission control in parallel with the first transmission control and may perform the third transmission control in parallel with the second transmission control. The third transmission control is, for example, transmission control for transmitting the second captured image signal to the host computer via the fourth line. Here, the second captured image signal is a second captured image signal for forming a second captured image which is a captured image of the second image, and the imaging command signal via the third line is It is an image signal acquired by triggering.

  This allows the second captured image to be associated with other images via the first captured image. In addition, the state of the subject's eye when the second captured image is obtained can be confirmed using the first captured image.

  The image may be generated by the ophthalmologic imaging apparatus main body, or may be generated by the host computer. For example, a tomographic image may be generated by the ophthalmologic imaging apparatus main body, or a tomographic image may be obtained by causing a host computer to process an interference signal.

  Note that as an example of different imaging methods, imaging optical systems having different imaging principles may be used. For example, one may be an imaging optical system that performs OCT imaging using interference, and the other may be an imaging optical system that performs camera imaging or confocal imaging.

  In addition, as an example in which the imaging methods are different, imaging optical systems in which imaging directions of captured images are different from each other may be used. For example, one may be an imaging optical system that obtains a tomographic image, and the other may be an imaging optical system that obtains a front image.

  Furthermore, as an example where imaging methods are different, the same optical system may be shared, and optical systems with different light receiving elements may be used. For example, it may be an optical system including one light receiving element (for example, light receiving element 38) that receives infrared light and the other one for receiving light (for example, light receiving element 35) that receives visible light. That is, the light of different wavelength bands may be received by different light receiving elements.

  Note that the second image signal may be acquired by the second imaging optical system to form, for example, a live image or a captured image of the second image. For example, the second image signal may be generated in the ophthalmologic imaging apparatus main body based on a light reception signal from a light receiving element provided in the second imaging optical system.

  The second imaging optical system may be an OCT optical system (for example, the interference optical system 200). Here, the OCT optical system is, for example, an interference optical system that detects an interference signal due to interference between the measurement light scanned by the scanning unit (for example, the scanning unit 108) and the reference light corresponding to the measurement light. It is. The OCT optical system includes a measurement light path for guiding light from the light source as measurement light to the eye to be examined, a reference light path for guiding light from the light source as reference light, and measurement light and reference emitted to the eye to be examined. A detector (e.g., a detector 120) for detecting interference with light may be provided, and a tomographic image of the eye to be inspected may be obtained based on a detection signal from the detector.

  The ophthalmologic imaging apparatus may further include an index projection optical system (for example, the focus index projection optical system 40, the light source 55, and the like) and an imaging control unit (for example, the control unit 70).

  The index projection optical system may, for example, project an index toward the subject's eye. For example, the imaging control unit may end the projection of the index by the index projection optical system before obtaining the first captured image signal. In this case, at least a portion of the index may be formed in the first live image, and at least a portion of the index may be erased in the first captured image. Here, the first live image is an image formed based on the first live image signal. Also, the first captured image is an image formed based on the first captured image signal.

  Thus, the ophthalmologic imaging apparatus can acquire the first captured image in which unnecessary light is reduced.

  The ophthalmologic imaging apparatus and the host computer may form an ophthalmologic imaging system. The ophthalmologic imaging system may include, for example, an image processing unit (for example, the control unit 70 or the CPU 91). The image processing unit may, for example, match the first captured image acquired simultaneously with the third captured image with the first captured image acquired simultaneously with the second captured image.

  This allows the second captured image and the third captured image to be correlated in position via the first captured image. That is, for example, even when the correspondence between the second captured image and the third captured image is difficult, the correspondence using the first captured image can be performed.

  The third captured image is an image different from the second captured image. For example, even if the second captured image is an image acquired by a third imaging optical system that images the eye using a third imaging method different from the first imaging method and the second imaging method. Good. In this case, a third imaging optical system (for example, a color fundus imaging optical system) is additionally provided in the ophthalmologic imaging apparatus main body.

  Alternatively, the third captured image may be an image acquired by the second imaging optical system and acquired at a timing different from that of the second captured image.

  The data control unit may divide the first captured image signal, and transmit the divided first captured image signal in the intervals of transmitting the response signal. Thus, the response signal from the ophthalmologic imaging apparatus can be transmitted smoothly, so that signal processing between the ophthalmologic imaging apparatus main body and the host computer can be smoothly performed.

  The data communication unit may be USB. In this case, signal contents to be communicated on the first line, the second line, and the third line may be set by the host computer and the driver of the ophthalmologic imaging apparatus.

  Note that, as the captured image, image processing may be performed on the captured image in the apparatus main body, and the captured image to which the image processing is added may be transmitted to the host computer. Also in the live image, the live image subjected to the image processing may be transmitted to the host computer.

  Further, the present invention is not limited to the case where a captured image is acquired with the imaging command signal as a trigger. For example, the apparatus main body may perform control to blink the alignment, and control to acquire only a captured image at a timing when the alignment index is erased in synchronization with the blinking. In this case, the captured image obtained may be transmitted to the host computer as needed. In addition, the device main body detects the determination result of the alignment state or the fixation state with respect to the anterior eye part of the subject eye according to the acquisition of the captured image, and the captured image at the timing when the alignment state or the fixation state is determined to be appropriate. A control may be performed to obtain only one at any time.

  Further, when transmitting the captured image to the host computer, the determination result of the alignment state or the fixation state of the eye to be examined with respect to the anterior eye part may be transmitted.

  Also, when image processing is performed in the host computer after the captured image is sent to the host computer, the captured image to which the image processing has been applied may be sent to the apparatus main body. In this case, layer analysis, three-dimensional graphic formation, an emphasis process, etc. can be considered as an image process with respect to the captured image of OCT. In addition, an image obtained by combining the OCT image with the color fundus image may be sent to the apparatus main body via the infrared fundus image.

<Example>
Hereinafter, an embodiment according to the present invention will be described based on the drawings. 1 to 10 are diagrams for explaining the configuration of the ophthalmologic imaging apparatus according to the present embodiment. In the present embodiment, the axial direction of the subject's eye (eye E) is described as Z direction, the horizontal direction as X direction, and the vertical direction as Y direction. The surface direction of the fundus may be considered as the XY direction.

  As shown in FIG. 1, the ophthalmologic imaging apparatus 1 of this embodiment mainly includes, for example, a base 4, an imaging unit 3, a face support unit 5, and an operation unit 74. The photographing unit 3 may store an optical system described later. The imaging unit 3 may be provided movably in the three-dimensional direction (XYZ) with respect to the eye E to be examined. The face support unit 5 may be fixed to the base 4 to support the subject's face.

  The imaging unit 3 may be moved relative to the eye E in the left-right direction, the up-down direction (Y direction), and the front-rear direction by the XYZ drive unit 6.

  The joystick 74 a is used as an operation member operated by the examiner to move the imaging unit 3 with respect to the eye E. Of course, it is not limited to the joystick 74a, and may be another operation member (for example, a touch panel, a track ball, etc.).

  For example, the operation unit 74 temporarily transmits an operation signal from the examiner to the control unit 70. In this case, the control unit 70 may send an operation signal to the personal computer 90 described later. For example, the personal computer 90 sends a control signal corresponding to the operation signal to the control unit 70. Then, for example, when the control unit receives the control signal, the control unit may perform various controls based on the control signal.

  For example, the movable stand 2 is moved relative to the subject's eye by the operation of the joystick 74a. Further, by rotating the rotation knob 74b, the XYZ drive unit 6 is driven to move the imaging unit 3 in the Y direction.

  For example, the display unit 75 may be provided in the imaging unit 3 (for example, on the side of the examiner). The display unit 75 may display, for example, a fundus oculi observation image, a fundus oculi taken image, an anterior segment observation image, and the like. Note that the display unit 75 may include a touch panel that is also used as the operation unit 74.

  The ophthalmologic photographing apparatus 1 of this embodiment is connected to a host computer (hereinafter may be abbreviated as HC) 90. For example, a display unit 95, an operation unit (a keyboard, a mouse or the like) 96, a control unit 70, a detector 120 described later, and the like may be connected to the HC 90.

<Optical system>
As shown in FIG. 2, the optical system of the present embodiment mainly includes an illumination optical system 10, an imaging optical system (front imaging optical system) 30, and an interference optical system (hereinafter also referred to as an OCT optical system) 200. The imaging optical system 30 is used as an eye fundus camera optical system for obtaining an infrared eye fundus image, a color eye fundus image, and the like by photographing the eye fundus (for example, a non-mydriasis state). The OCT optical system 200 non-invasively obtains a tomographic image of the fundus of an eye to be examined using a technique of light interference. Furthermore, the optical system may include a focus indicator projection optical system 40, an alignment indicator projection optical system 50, and an anterior eye observation optical system 60.

<Illumination optical system>
The illumination optical system 10 has, for example, an observation illumination optical system and a photographing illumination optical system. The photographing illumination optical system mainly includes a light source 14, a condenser lens 15, a ring slit 17, a relay lens 18, a mirror 19, a black dot plate 20, a relay lens 21, a perforated mirror 22, and an objective lens 25. The photographing light source 14 may be a flash lamp or the like. The black dot plate 20 has a black dot at the center.

  The observation illumination optical system mainly includes an optical system from the light source 11, the infrared filter 12, the condenser lens 13, the dichroic mirror 16, and the ring slit 17 to the objective lens 25. The light source 11 may be, for example, a halogen lamp. The infrared filter 12 transmits, for example, near infrared light having a wavelength of 750 nm or more. The die clock mirror 16 is disposed, for example, between the condenser lens 13 and the ring slit 17. The dichroic mirror 16 has, for example, a characteristic of reflecting the light from the light source 11 and transmitting the light from the photographing light source 14.

<Photographing optical system>
The imaging optical system 30 mainly includes, for example, an objective lens 25, an imaging diaphragm 31, a focusing lens 32, an imaging lens 33, and an imaging device 35. The photographing stop 31 is located in the vicinity of the aperture of the perforated mirror 22. The focusing lens 32 is movable in the optical axis direction. The imaging device 35 can be used, for example, for imaging having sensitivity in the visible range. The imaging diaphragm 31 is disposed, for example, at a position substantially conjugate with the pupil of the eye E with respect to the objective lens 25. The focusing lens 32 is moved in the optical axis direction by, for example, a moving mechanism 49 provided with a motor.

  Further, a dichroic mirror 37 having a characteristic of reflecting a part of infrared light and visible light and transmitting most of the visible light is disposed between the imaging lens 33 and the imaging device 35. In the reflection direction of the dichroic mirror 37, an imaging element 38 for observation having sensitivity in the infrared region is disposed. Note that instead of the dichroic mirror 37, a flip-up mirror may be used. The flip-up mirror, for example, is inserted into the optical path at the time of fundus observation and is retracted from the optical path at the time of fundus imaging.

  Note that, for example, an insertable / removable dichroic mirror (wavelength selective mirror) 24 as an optical path branching member is obliquely disposed between the objective lens 25 and the apertured mirror 22. The dichroic mirror 24 reflects, for example, the wavelength light of the OCT measurement light, and the wavelength light (center wavelength 940 nm) of the alignment index projection optical system 50 and the anterior eye illumination light source 58.

  The dichroic mirror 24 has, for example, a characteristic of transmitting a wavelength of 900 nm or less including the light source wavelength (center wavelength of 880 nm) of the wavelength light of the illumination for fundus observation. When imaging is performed by the imaging optical system 30, the dichroic mirror 24 is flipped up in conjunction with the insertion and removal mechanism 66, and is retracted out of the optical path. The insertion and removal mechanism 66 can be configured by a solenoid, a cam, and the like.

  Further, the optical path correction glass 28 is disposed on the image pickup device 35 side of the dichroic mirror 24 so as to be able to bounce up by driving of the insertion and removal mechanism 66. At the time of optical path insertion, the optical path correction glass 28 has a role of correcting the position of the optical axis L1 shifted by the dichroic mirror 24.

  A light flux emitted from the light source 11 for observation is converted to an infrared light flux by the infrared filter 12 and is reflected by the condenser lens 13 and the dichroic mirror 16 to illuminate the ring slit 17. The light transmitted through the ring slit 17 passes through the relay lens 18, the mirror 19, the black dot plate 20, and the relay lens 21 and reaches the perforated mirror 22. The light reflected by the apertured mirror 22 passes through the correction glass 28 and the dichroic mirror 24 and is converged once by the objective lens 25 in the vicinity of the pupil of the subject eye E, and then diffused to illuminate the fundus part of the subject eye.

  Reflected light from the fundus is transmitted through the objective lens 25, the dichroic mirror 24, the correction glass 28, the aperture of the apertured mirror 22, the imaging diaphragm 31, the focusing lens 32, the imaging lens 33, and the dichroic mirror 37. Image. The output of the imaging device 38 is input to the control unit 70, and the control unit 70 displays a fundus observation image of the eye to be examined which is imaged by the imaging device 38 on the display unit 75 (see FIG. 3).

  Further, the light flux emitted from the photographing light source 14 is transmitted through the dichroic mirror 16 through the condenser lens 15. Thereafter, the fundus is illuminated with visible light through the same optical path as the illumination light for fundus observation. Then, the reflected light from the fundus passes through the objective lens 25, the opening of the apertured mirror 22, the imaging diaphragm 31, the focusing lens 32, and the imaging lens 33, and forms an image on the imaging device 35.

<Focus index projection optical system>
The focus index projection optical system 40 mainly includes an infrared light source 41, a slit index plate 42, two deflection prisms 43, a projection lens 47, and a spot mirror 44 obliquely disposed in the light path of the illumination optical system 10. The two deflection prisms 43 are attached to the slit index plate 42. The spot mirror 44 is obliquely disposed in the light path of the illumination optical system 10. The spot mirror 44 is fixed to the tip of the lever 45. The spot mirror 44 is normally provided obliquely to the optical axis, but is retracted out of the optical path by rotation of the axis of the rotary solenoid 46 at a predetermined timing before photographing.

  The spot mirror 44 is disposed at a position conjugate to the fundus of the eye to be examined E. The light source 41, the slit index plate 42, the deflection prism 43, the projection lens 47, the spot mirror 44 and the lever 45 are moved in the optical axis direction by the moving mechanism 49 in conjunction with the focusing lens 32. The light beam of the slit index plate 42 of the focus index projection optical system 40 is reflected by the spot mirror 44 via the deflection prism 43 and the projection lens 47, and then the relay lens 21, the apertured mirror 22, the dichroic mirror 24, The light beam is projected onto the fundus of the eye E via the objective lens 25. When the fundus is not in focus, the index images S1 and S2 are projected onto the fundus in a state of being separated according to the displacement direction and the displacement amount (see FIG. 3). On the other hand, when the subject is in focus, the index images S1 and S2 are projected onto the fundus in a matched state. Then, the index images S1 and S2 are captured by the imaging device 38 together with the fundus image.

<Alignment index projection optical system>
The alignment index projection optical system 50 projects an alignment index luminous flux onto the eye E to be examined. In the alignment index projection optical system 50, as shown in the lower left dotted line in FIG. 2, a plurality of infrared light sources are arranged at intervals of 45 degrees on concentric circles centering on the photographing optical axis L1. The ophthalmologic photographing apparatus in the present embodiment mainly includes a first index projection optical system (0 degrees and 180) and a second index projection optical system.

  The first index projection optical system has an infrared light source 51 and a collimating lens 52. The second index projection optical system is disposed at a position different from the first index projection optical system, and has six infrared light sources 53. The infrared light sources 51 are arranged symmetrically with respect to a vertical plane passing through the photographing optical axis L1.

  In this case, the first index projection optical system projects an index at infinity from the left and right direction on the cornea of the eye E. The second index projection optical system is configured to project an index at a finite distance onto the cornea of the eye E from the up and down direction or an oblique direction. In the drawing of FIG. 2, for convenience, only the first index projection optical system (0 degrees and 180 degrees) and a part of the second index projection optical system (45 degrees and 135 degrees) are illustrated. .

Front eye observation optical system
An anterior segment observation (shooting) optical system 60 for imaging the anterior segment of the subject eye E has a dichroic mirror 61, an aperture 63, a relay lens 64, a two-dimensional imaging element (light receiving element: , And may be omitted as the imaging device 65) 65 mainly. The imaging device 65 has sensitivity in the infrared range. Further, the imaging element 65 also serves as an imaging means for detecting an alignment index, and the anterior eye illuminated by the anterior eye illumination light source 58 emitting infrared light and the alignment index are imaged. The anterior segment illuminated by the anterior segment illumination light source 58 is received by the imaging device 65 from the objective lens 25, the dichroic mirror 24 and the dichroic mirror 61 via the optical system of the relay lens 64. Further, the alignment light flux emitted from the light source of the alignment index projection optical system 50 is projected onto the cornea to be examined. The corneal reflection image is received (projected) by the imaging element 65 through the objective lens 25 to the relay lens 64.

  The output of the two-dimensional imaging device 65 is input to the control unit 70, and as shown in FIG. 3, the display unit 75 displays an anterior segment image captured by the two-dimensional imaging device 65. The anterior eye observation optical system 60 doubles as a detection optical system for detecting the alignment state of the apparatus main body with respect to the eye to be examined.

  Incidentally, infrared light sources (two in the present embodiment) for forming an optical alignment index (working dots W1) on the cornea of the subject's eye around the hole of the perforated mirror 22 are not limited to this. ) 55 are arranged. The light source 55 may be configured to guide infrared light to an optical fiber whose end face is disposed at a position near the perforated mirror 22. The corneal reflection light from the light source 55 is imaged on the imaging surface of the imaging element 38 when the working distance between the subject's eye E and the imaging unit 3 (apparatus main body) becomes appropriate. As a result, the examiner can finely adjust the alignment using the working dots formed by the light source 55 in a state where the fundus oculi image is displayed on the monitor 8.

<OCT optical system>
Return to FIG. The OCT optical system 200 has a device configuration of a so-called ophthalmic optical coherence tomography (OCT), and captures a tomographic image of the eye E. The OCT optical system 200 divides the light emitted from the measurement light source 102 into a measurement light and a reference light by a coupler (light splitter) 104. Then, the OCT optical system 200 guides the measurement light to the fundus oculi Ef of the eye E, and guides the reference light to the reference optical system 110. The measurement light passes through the collimator lens 123 and the focus lens 124 and reaches the scanning unit 108, and its reflection direction is changed by driving of two galvano mirrors, for example. Then, the measurement light reflected by the scanning unit 108 is reflected by the dichroic mirror 24 through the relay lens 109 and then condensed onto the fundus of the eye to be examined through the objective lens 25. After that, the detector (light receiving element) 120 is made to receive interference light resulting from the combination of the measurement light reflected by the fundus oculi Ef and the reference light.

  The detector 120 detects an interference state between the measurement light and the reference light. In the case of Fourier domain OCT, the spectral intensity of the interference light is detected by the detector 120, and a depth profile (A scan signal) in a predetermined range is acquired by Fourier transformation on the spectral intensity data. For example, Spectral-domain OCT (SD-OCT), Swept-source OCT (SS-OCT) can be mentioned. In the case of Spectral-domain OCT (SD-OCT), for example, a broadband light source is used as the light source 102, and a spectrometer (spectrometer) is used as the detector 120. In the case of swept-source OCT, for example, a wavelength-tunable light source is used as the light source 102, and a single photodiode is used as the detector 120 (balance detection may be performed). Moreover, Time-domain OCT (TD-OCT) may be used.

  The scanning unit 108 scans the light emitted from the measurement light source on the fundus of the eye to be examined. For example, the scanning unit 108 scans the measurement light two-dimensionally (XY direction (cross direction)) on the fundus. The scanning unit 108 is disposed at a position substantially conjugate to the pupil. The scanning unit 108 is, for example, two galvano mirrors, and the reflection angle thereof is arbitrarily adjusted by the drive unit 151.

  As a result, the light beam emitted from the light source 102 changes its reflection (traveling) direction, and is scanned in any direction on the fundus. Thus, the imaging position on the fundus oculi Ef is changed. The scanning unit 108 may be configured to deflect light. For example, in addition to a reflection mirror (galvano mirror, polygon mirror, resonant scanner), an acousto-optic element (AOM) or the like that changes the traveling (deflection) direction of light is used.

  The reference optical system 110 generates reference light that is combined with the reflected light acquired by the reflection of the measurement light at the fundus oculi Ef. The reference optical system 110 may be a Michelson type or a Mach-Zehnder type.

  The reference optical system 110 may change the optical path length difference between the measurement light and the reference light by moving the optical member in the reference light path. For example, the reference mirror is moved in the optical axis direction. The arrangement for changing the optical path length difference may be arranged in the measuring optical path of the measuring optical system.

  More specifically, the reference optical system 110 mainly includes, for example, a collimator lens 129, a reference mirror 131, and a reference mirror driving unit 150. The reference mirror driving unit 150 is disposed in the reference light path, and is configured to be movable in the optical axis direction so as to change the optical path length of the reference light. The light is reflected back to the coupler 104 by being reflected by the reference mirror 131 and directed to the detector 120. As another example, the reference optical system 110 is formed by transmission optical system (for example, an optical fiber) and is guided to the detector 120 by transmitting the light from the coupler 104 without returning it.

<Control unit>
Subsequently, the control system of this embodiment will be described with reference to FIG. As shown in FIG. 4, the control unit 70 of the present embodiment includes an imaging device 65 for anterior eye observation, an imaging device 38 for infrared fundus observation, a display unit 75, an operation unit 74, and a USB. The HUB 71, each light source (not shown), various actuators (not shown), etc. are connected. The HUB 71 is connected to the imaging device 35 built in the ophthalmologic imaging apparatus 1. Further, the HC 90 is connected to the HUB 71 by the USB signal line 76 via the USB ports 78a and 78b.

  The HC 90 includes a CPU 91 as a processor, an operation unit (for example, a mouse, a keyboard, and the like) 96, a memory (nonvolatile memory) 92 as a storage unit, and a display unit 95. The CPU 91 may control the ophthalmologic imaging apparatus 1. The memory 92 is a non-transitory storage medium capable of retaining stored contents even when the supply of power is shut off. For example, a hard disk drive, a flash ROM, a USB memory detachably attached to the HC 90, an external server, or the like may be used as the memory 92. The memory 92 stores an imaging control program for controlling imaging of a front image and a tomographic image by the apparatus main unit (ophthalmologic imaging apparatus) 1.

  The memory 92 also stores an ophthalmologic analysis program for using the HC 90 as an ophthalmologic analyzer. That is, the HC 90 may double as the ophthalmologic analyzer. The memory 92 also stores various information related to imaging, such as tomographic images (OCT data), three-dimensional tomographic images (three-dimensional OCT data), frontal images of the fundus, and imaging positions of tomographic images in a scanning line. Various operation instructions by the examiner are input to the operation unit 96.

  A detector (for example, a line CCD etc.) 120 for OCT imaging built in the ophthalmologic imaging apparatus 1 is connected to the HC 90 by a USB signal line 77 via the USB ports 79a and 79b. As described above, in the present embodiment, the ophthalmologic imaging apparatus 1 and the HC 90 are connected to each other by the two USB signal lines 76 and 77.

  Further, the control unit 70 may detect the alignment index from the anterior eye observation image 81 captured by the imaging device 65. The control unit 70 may detect the amount of alignment deviation of the ophthalmologic imaging apparatus 1 with respect to the subject's eye based on the imaging signal of the imaging device 65.

  Further, the control unit 70 may electronically form and display the reticle LT as the alignment reference at a predetermined position on the screen of the display unit 75 as shown in the anterior eye image observation screen in FIG. 4. In addition, the control unit 70 may control the display of the alignment index A1 so that the relative distance to the reticle LT is changed based on the detected alignment deviation amount.

  The control unit 70 displays the anterior eye observation image captured by the imaging device 65 and the fundus observation image captured by the imaging device 38 on the display unit 75 of the main body.

  In addition, the control unit 70 outputs a stream of the anterior eye observation image and the fundus observation image to the HC 90 via the HUB 71 and the USB 2.0 ports 78 a and 78 b. The HC 90 displays the streaming-outputted anterior segment observation image and the fundus oculi observation image on the display unit 95 of the HC 90, respectively. The anterior eye observation image and the fundus oculi observation image may be simultaneously displayed as a live image (for example, a live front image) on the display unit 95 (an anterior eye observation image 81 in FIG. 3, an FC front image 82).

On the other hand, photographing of a color fundus oculi image by the imaging device 35 is performed based on a trigger signal from the control unit 70. The color fundus image is also output to the control unit 70 and the HC 90 via the HUB 71 and the USB 2.0 ports 78a and 78b, and displayed on the display unit 95 or the like.
The HC 90 (more specifically, a processor (for example, a CPU) of the HC 90) generates a tomographic image 83 by performing arithmetic processing on the light reception signal from the detector 120.

  For example, in the case of Fourier domain OCT, the HC 90 processes spectral signals including interference signals at each wavelength output from the detector 120. The HC 90 processes the spectrum signal to obtain internal information of the eye to be examined (for example, data of the eye to be examined in the depth direction (depth information)). More specifically, the spectral signal (spectral data) is rewritten as a function of the wavelength λ and transformed to the function I (k) equally spaced with respect to the wavenumber k (= 2π / λ). The HC 90 obtains a signal distribution in the depth (Z) region by Fourier transforming a spectral signal in the wavenumber k space.

  Furthermore, the HC 90 may arrange internal information obtained at different positions by scanning of measurement light or the like to obtain information of the eye to be examined (for example, a tomographic image). The HC 90 stores the obtained result in the memory 92. The HC 90 may display the obtained result on the display unit 95.

  The ophthalmologic imaging apparatus 1 performs imaging with a scan pattern set in advance in response to a release signal from the HC 90. The HC 90 processes each shooting signal and outputs an image result onto the display unit 95 of the HC 90.

  At this time, the detector 120 outputs the detected detection signal to the HC 90. The HC 90 generates a tomographic image 83 from the output from the detector 120.

  The HC 90 transfers the generated tomographic image 83 to the ophthalmologic imaging apparatus 1 via the USB 2.0 ports 78 b and 78 a and the HUB 71. The control unit 70 displays the transferred tomographic image 83 on the display unit 75. The OCT front image may be generated by the HC 90 based on the output signal from the detector 120, and the OCT front image 84 may be displayed on the display unit 75 or the display unit 95.

The same applies to color fundus imaging described above. The results of color fundus imaging are not only input to the HC 90 but are also transferred to the main unit of the apparatus via the USB 2.0 ports 78b and 78a and the HUB 71, and the display of the ophthalmologic imaging apparatus 1 A color fundus image may be displayed on the unit 75.
<About communication means>
Next, communication means between the ophthalmologic photographing apparatus 1 and the HC 90 will be described with reference to FIG. The control unit 70 and the HC 90 of the present embodiment are connected by, for example, a USB signal line 76, which is a general-purpose interface standard, as communication means. For example, as shown in FIG. 5, the USB signal line 76 is composed of a plurality of end points EP. In the example of FIG. 5, for example, five end points EP from the zeroth end point EP0 to the fourth end point EP4 are provided. Data exchange is performed between the ophthalmologic imaging apparatus 1 and the HC 90 at the plurality of end points EP. Each of the ophthalmologic imaging apparatus 1 and the HC 90 is provided with a driver D, and each endpoint EP has a role determined by the driver D. Of the five end points EP, one is provided with a theoretical connection of communication called default pipe DP. In the present embodiment, the zeroth endpoint EP0 is the default pipe DP. The other four endpoints can be used as USB peripherals (peripheral devices), and are used to exchange data between the ophthalmic imaging apparatus 1 and the application AP of the HC 90. Among the four endpoints EP1 to EP4 that can be used as USB peripherals, for example, one is given a role of sending a control signal (for example, a command / attention) from the HC 90 to the ophthalmologic imaging apparatus 1, and in this embodiment, The endpoint EP1 is used. One is given a role of sending image data (for example, tomographic image 83) from the HC 90 to the ophthalmologic imaging apparatus 1, and in the present embodiment, the end point EP2 is used. One is given a role of sending a control signal (response / attention) from the ophthalmologic imaging apparatus 1 to the HC 90, and in the present embodiment, the end point EP3 is used. One is given a role of sending image data (an anterior segment observation image, a fundus observation image, a live image) from the ophthalmologic imaging device 1 to the HC 90, and in the present embodiment, an endpoint EP4 is used.

  The end points EP1 to EP4 on the side of the ophthalmologic imaging apparatus 1 are respectively connected to corresponding unshown buffers of the HC 90 via pipes (for example, communication lines) P1 to P4. As described above, since each endpoint EP has a role, the HC 90 uses the role information set by the driver D to determine what kind of signal is input from the buffer connected to each endpoint EP. I know. As described above, by giving a role to each endpoint EP and collectively transmitting and receiving the same type of signal through the same pipe P, signal processing can be smoothly performed.

<Observation screen on which the OCT front image and FC front image are displayed respectively>
An example of the control operation of the apparatus having the above configuration will be described. The control unit 70, for example, an anterior segment observation image from the imaging device 65, a fundus observation image from the imaging device 38 (hereinafter, FC front image), and an OCT tomographic image from HC 90 (hereinafter, tomographic image) The images may be combined and displayed on the screen of the display unit 95 as an observation screen. On the observation screen, as shown in FIG. 3, a live anterior segment observation image 81, a live FC front image 82, and a live tomographic image 83 (hereinafter also referred to as a live tomographic image) may be simultaneously displayed.

  FIG. 3 is a view showing an example of the observation screen according to the present embodiment. The HC 90 includes a first display area 300 in which a display related to imaging with the interference optical system 200 is integrated, and a second display area 400 in which a display related to imaging with the fundus camera optical system 100 is integrated. The display is divided and displayed on the display unit 95. In the following description, the observation screen on the display unit 95 is exemplified, but a similar observation screen may be displayed on the display unit 75 by the display control of the control unit 70.

  In the first display area 300, an OCT front display area (hereinafter, display area 310) 310, a scan position setting display (hereinafter, setting display) 320, an imaging condition display (hereinafter, condition display) 330, and a tomographic image A display area (hereinafter, display area) 340 and an optical path difference adjustment display 350 are formed.

  In the display area 310, an OCT front image 84 and a scan line (scan line) SL are displayed. The OCT front image (sometimes abbreviated as the front image 85) 84 is preferably a live image. The control unit 70 updates the front image 84 displayed in the display area 310 each time a new OCT front image is acquired. When displaying the OCT front image in the live image, the control unit 70 may display the front image 84 continuously in real time, or may display the front image every predetermined time (for example, 0.5 seconds). May be updated.

  At this time, the HC 90 may transmit a live image of the OCT front image 85 to the control unit 70 using the second endpoint EP2.

  The scanning line SL is a display for electronically indicating the scanning position (measurement position) on the OCT front image 84. The control unit 70 superimposes and displays the scanning line SL on the OCT front image 84. The display pattern of the scanning line SL corresponds to the scanning pattern by the scanning unit 108. For example, when the line scan is set, the scan line SL is displayed in a line. When the cross scan is set, the scan line SL is displayed in a cross shape. When set to map scan (raster scan), scan lines are displayed on a rectangle. The relationship between the display position of the scanning line SL and the scanning position by the scanning unit 108 is set in advance.

  The setting display 320 is a display for the examiner to set the scanning position of the OCT. The control unit 70 controls the scanning unit 108 based on, for example, the operation signal input via the setting display 320, and changes the scanning position on the fundus oculi Ef. Further, the control unit 70 changes the display position of the scanning line SL in conjunction with the change of the scanning position by the scanning unit 108.

  The setting display 320 of the present embodiment has a graphic for changing the scanning position in each of the upper, lower, left, and right directions, and a graphic for changing the scanning position in each of the rotational directions. The control unit 70 may change the scan position via a direct operation (for example, drag scan) on the scan line SL.

  The condition display 330 is a display area for indicating each photographing condition of the interference optical system 200. As the condition display 330, for example, a shooting mode, a scan width, a scan angle, a scan density, the number of additions, a shooting sensitivity, and the like are displayed. As the imaging mode, for example, a combination of an imaging region and a scanning pattern can be selected, and the selected imaging mode is displayed. FIG. 3 shows a case where a macular region is set as the imaging region and a line scan is set as the scanning pattern as the imaging mode. When each condition display displayed on the condition display 330 is operated, the imaging condition can be changed. For example, when the condition display corresponding to the scan width is operated, the scan width can be changed.

  In the display area 340, an OCT tomographic image (hereinafter, tomographic image) 83 and an image evaluation display 345 are displayed.

  The tomographic image 83 is preferably a live image. The control unit 70 updates the tomographic image 83 displayed on the display area 340 each time a new tomographic image is acquired. When the tomographic image in the live image is displayed, the HC 90 may continuously display the tomographic image 83 in real time, or update the tomographic image every predetermined time (for example, 0.5 seconds) You may do so.

  At this time, the HC 90 may transmit a live image of the OCT front image 85 to the control unit 70 using the second endpoint EP2.

  Here, when the scan line is changed as described above, the control unit 70 can display the tomographic image 83 corresponding to the changed scan position. When a scan pattern including a plurality of scan lines is set as the scan pattern, the control unit 70 may display a tomographic image corresponding to each scan line.

  The image evaluation display 345 is a display for evaluating whether the image quality of the tomographic image is good, and in the present embodiment, a 10-step evaluation is performed by a bar graph. The HC 90 analyzes the acquired tomographic image and evaluates the image based on the analysis result. The control unit 70 displays the analysis result transmitted from the HC 90 as the image evaluation display 345. If the result of the image evaluation display 345 is bad, it may be considered that the imaging sensitivity is increased or the position of the imaging unit 3 with respect to the patient's eye is adjusted using the anterior eye observation image 81.

  The optical path difference adjustment display 350 is a display area for adjusting the optical path length difference between the measurement light and the reference light. When the automatic adjustment display (AUTO Z) is operated, the control unit 70 controls the drive unit 150 to automatically adjust the optical path length difference so that the tomographic image of the fundus is acquired.

  When the manual adjustment display (arrow) is operated, the control unit 70 controls the drive unit 150 according to the operation direction and the operation amount (operation time) to adjust the optical path length difference. Thereby, the optical path length difference is finely adjusted by the manual operation of the examiner.

  Next, the second display area 400 will be described. In the second display area 400, an FC front display area 410, an anterior eye image display area 420, a photographing condition display (hereinafter referred to as a condition display) 430, and a pupil diameter determination display 440 are formed.

  In the display area 410, an FC front image 82, focus index images S1 and S2, and optical alignment index images W1 and W2 (optical working dots) are displayed. The FC front image (sometimes abbreviated as front image 82) 82 is preferably a live image. The control unit 70 updates the FC front image 82 displayed in the display area 410 each time a new FC front image is acquired. When displaying the FC front image 82 in the live image, the control unit 70 may display the FC front image 82 continuously in real time, or for every predetermined time (for example, 0.5 seconds). The front image 82 may be updated.

  At this time, the control unit 70 may transmit the live image of the FC front image 82 to the HC 90 using the fourth end point EP4.

  When alignment with the subject's eye is properly performed to some extent, on the front image 82, optical alignment indicators W1 and W2 by the corneal reflection light formed by the light source 55 appear. A light shielding area 415 is formed on the image pickup device 38 by shielding observation light by the lever 45 inserted in the light path of the illumination optical system 10, and the light is projected onto the fundus at the tip of the light shielding area 415 (on the optical axis). The optical focus indicator images S1 and S2 are formed.

  An anterior segment observation image 81 is displayed in the anterior segment image display area 420. The anterior segment observation image 81 is preferably a live image. The control unit 70 updates the anterior segment observation image 81 displayed on the display area 420 each time a new anterior segment observation image is acquired. When displaying the anterior eye observation image in the live image, the control unit 70 may display the anterior eye observation image 81 continuously for the apparatus main body 1 or for a predetermined time (for example, 0.5) The front image may be updated every second).

  The control unit 70 may send the live image of the anterior eye observation image 81 to the HC 90 via the fourth end point EP4 for data transmission.

  In the present embodiment, the anterior eye image display area 420 is displayed in a display area smaller than the FC front display area 410. Of course, it is not limited to this.

  The condition display 430 is a display area for showing each photographing condition of the fundus camera optical system 100. As the condition display 430, for example, the photographing light amount of the photographing light source 14, the diopter correction amount by the focusing lens 32, the presence or absence of selection of the small pupil photographing mode, the presence or absence of selection of the low light amount photographing mode, etc. can be considered. When each icon (or condition display) displayed in the condition display 430 is operated, the photographing condition can be changed. For example, when the icon corresponding to the imaging light amount is operated, the imaging light amount can be changed.

  The pupil diameter determination display 440 is a display for displaying whether or not the pupil diameter of the eye to be examined satisfies the required pupil diameter. Whether the required pupil diameter is satisfied or not is determined by image processing whether the pupil diameter in the anterior segment observation image satisfies a predetermined size. The control unit 70 changes the display state of the pupil diameter determination display 440 based on the determination result (described in detail later).

  The presentation position of the fixation target may be adjusted in any of the display area 340 and the display area 410. In this case, a mark indicating the presenting position of the fixation target is displayed on any of the front images, and the presenting position is changed by moving the mark on the monitor 75.

  When the control unit 70 does not acquire the OCT front image 84, the control unit 70 may display an image obtained by cutting out the corresponding portion of the FC front image 82 in the display area 310.

<Shooting procedure>
The operation of an apparatus using the above apparatus will be described below. The examiner causes the face support unit 5 to support the face of the subject. Then, the examiner instructs the subject to gaze at a fixation target not shown. In the initial stage, the dichroic mirror 24 is inserted in the optical path of the imaging optical system 30, and the anterior eye observation image 81 captured by the imaging device 65 is displayed on the display unit 75 and the display unit 95.

  As alignment adjustment in the vertical and horizontal directions, the examiner operates, for example, the joystick 74a to move the imaging unit 3 in the horizontal and vertical directions so that the anterior eye observation image 81 appears on the display unit 75 and the display unit 95. When the anterior segment observation image 81 appears on the display unit 75, eight index images (first alignment index images) Ma to Mh appear as shown in FIG. In this case, as an imaging range by the imaging device 65, a range in which the pupil of the anterior segment, the iris, and the eyelid are included at the alignment completion time is preferable.

<Alignment detection and automatic alignment in the XYZ directions>
When the alignment index images Ma to Mh are detected by the two-dimensional imaging device 65, the control unit 70 starts automatic alignment control. The control unit 70 detects an alignment deviation amount Δd of the imaging unit 3 with respect to the eye based on the imaging signal output from the two-dimensional imaging element 65. More specifically, the XY coordinates of the center of the ring shape formed by the index images Ma to Mh projected in a ring shape are detected as the approximate cornea center, and the alignment reference in the XY direction set on the imaging device 65 in advance. An amount of deviation Δd between the position O1 (for example, the intersection of the imaging surface of the imaging device 65 and the imaging optical axis L1) and the corneal center coordinates is obtained (see FIG. 7). The pupil center may be detected by image processing, and the misalignment may be detected by the amount of deviation between the coordinate position and the reference position O1.

  Then, the control unit 70 operates the automatic alignment by the drive control of the XYZ drive unit 6 such that the displacement amount Δd falls within the allowable range A of the alignment completion. Depending on whether the deviation amount Δd is within the alignment completion tolerance range A and the time continues for a fixed time (for example, 10 frames or 0.3 seconds of image processing) (whether the alignment condition A is satisfied) It is determined whether the alignment in the X and Y directions is appropriate or not.

  Further, the control unit 70 obtains the amount of alignment deviation in the Z direction by comparing the interval between the index images Ma and Me at infinity detected as described above and the interval between the index images Mh and Mf at finite distance. . In this case, when the imaging unit 3 shifts in the working distance direction, the control unit 70 hardly changes the interval between the above-mentioned infinity indices Ma and Me, but changes the image interval between the index images Mh and Mf. The amount of alignment deviation in the working distance direction with respect to the eye to be examined is determined using the characteristic of (1) (for details, see JP-A-6-46999).

  Further, the control unit 70 also obtains the deviation amount with respect to the alignment reference position in the Z direction also in the Z direction, and the XYZ driving unit 6 so that the deviation amount falls within the alignment allowable range where the alignment is completed. Activate automatic alignment by driving control of The propriety of the alignment in the Z direction is determined based on whether the displacement amount in the Z direction is within a tolerance for the completion of alignment for a certain period of time (whether the alignment condition is satisfied).

  If the alignment state in the X, Y, and Z directions satisfies the alignment completion condition by the alignment operation described above, the control unit 70 determines that the X, Y, and Z alignments match, and proceeds to the next step.

  Here, when the alignment deviation amount Δd in the XYZ directions falls within the allowable range A1, the drive of the drive unit 6 is stopped and an alignment completion signal is output. Even after completion of the alignment, the control unit 70 detects the displacement amount Δd as needed, and restarts the automatic alignment when the displacement amount Δd exceeds the allowable range A1. That is, the control unit 70 performs control (tracking) to cause the subject's eye to track the imaging unit 3 so that the deviation amount Δd satisfies the allowable range A1.

<Determination of pupil diameter>
After completion of the alignment, the control unit 70 starts to determine whether the pupil state of the eye to be examined is appropriate. In this case, the suitability of the pupil diameter is determined based on whether or not the pupil edge detected from the anterior segment image by the imaging device 65 is out of the predetermined pupil determination area. The size of the pupil determination area is set as a diameter (for example, a diameter of 4 mm) through which the fundus illumination light flux can pass based on the center of the image (the center of the photographing optical axis). For simplicity, four pupil edges detected in the left and right direction and the up and down direction with reference to the image center are used. If the point of the pupil edge is outside the pupil determination area, the illumination light amount at the time of photographing is sufficiently secured (for details, see Japanese Patent Application Laid-Open No. 2005-160549 by the present applicant). The determination on the appropriateness of the pupil diameter is continued until shooting is performed, and the determination result is displayed on the display unit 75 and the display unit 90.

<Detection of focus state / Auto focus>
When the alignment is completed as described above, a live image of the FC front image 82 captured by the imaging device 38 is displayed on the display unit. In addition, when the alignment using the imaging element 65 is completed, the control unit 70 performs autofocus on the fundus of the eye to be examined. For example, as shown in FIG. 3, on the FC front image 82 captured by the imaging device 38, focus index images S1 and S2 by the focus index projection optical system 40 are projected on the center of the fundus image. Here, the focus index images S1 and S2 are separated when they are not in focus, and coincide and projected when they are in focus. The control unit 70 detects the index images S1 and S2 by image processing, and obtains the separation information. Then, the control unit 70 controls the driving of the moving mechanism 49 based on the separation information of the index images S1 and S2, and moves the lens 32 so that the fundus is in focus.

<Optimization control>
When the alignment completion signal is output, the control unit 70 issues a trigger signal for starting optimization control, and starts the control operation of optimization. The control unit 70 performs optimization so that the fundus site desired by the examiner can be observed with high sensitivity and high resolution. In the present embodiment, optimization control is control of optical path length adjustment, focus adjustment, and adjustment of polarization state (polarizer adjustment). In optimization control, it is sufficient that a certain tolerance condition for the fundus can be met, and it is not necessary to adjust to the most appropriate state.

  In optimization control, the control unit 70 sets the positions of the reference mirror 131 and the focusing lens 124 to initial positions as control of initialization. After the initialization is completed, the control unit 70 moves the reference mirror 131 in one direction from the set initial position in a predetermined step to perform the first optical path length adjustment (first automatic optical path length adjustment). In addition, in parallel with the first optical path length adjustment, the control unit 70 controls focusing position information (for example, movement of the lens 32 with respect to the fundus of the eye to be examined) based on the focusing result of the fundus camera optical system with respect to the fundus of the eye to be examined. Get the amount). When the in-focus position information is acquired, the control unit 70 moves the focusing lens 124 to the in-focus position, and performs auto-focus adjustment (focus adjustment). The in-focus position may be any position at which the contrast of the tomographic image acceptable as the observation image can be acquired, and is not necessarily the optimum position of the in-focus state.

  Then, after completion of the focus adjustment, the control unit 70 again moves the reference mirror 131 in the optical axis direction to perform the second optical path length adjustment for readjustment of the optical path length (fine adjustment of the optical path length). After completion of the second optical path length adjustment, the control unit 70 drives the polarizer 133 for adjusting the polarization state of the reference light to adjust the polarization state of the measurement light (for details, see Japanese Patent Application No. 2012-56292).

  As described above, completion of the optimization control enables observation of the fundus site desired by the examiner with high sensitivity and high resolution. Then, the control unit 70 controls the drive of the scanning unit 108 to scan the measurement light on the fundus.

  Detection signals (spectral data) detected by the detector 120 are transmitted to the HC 90 via the USB ports 79a and 79b (see FIG. 4). The HC 90 receives the detection signal and generates a tomographic image 83 by performing arithmetic processing on the detection signal.

  When the HC 90 generates the tomographic image 83, it transmits the tomographic image 83 to the control unit 70 of the ophthalmologic imaging apparatus 1 via the USB 2.0 ports 78b and 78a and the HUB 71. The control unit 70 receives the tomographic image 83 from the HC 90 via the USB 2.0 ports 78 b and 78 a and the HUB 71, and displays the tomographic image 83 on the display unit 75. As shown in FIG. 3, the control unit 70 displays the anterior eye observation image 81, the FC front image 82, and the tomographic image 83 on the display unit 75.

  The examiner confirms the tomographic image 83 updated in real time, and adjusts the alignment in the Z direction. For example, the alignment may be adjusted so that the tomographic image 83 falls within the display frame.

Of course, the HC 90 may display the generated tomographic image 83 on the display unit 90. The HC 90 may display the generated tomographic image 83 on the display unit 95 in real time. At this time, the HC 90 may transmit the live image of the tomographic image 83 to the control unit 70 by the second end point.
Furthermore, the HC 90 may cause the display unit 95 to display the anterior segment observation image 81 and the FC front image 82 in real time in addition to the tomographic image 83.

  When alignment and image quality adjustment are completed, the control unit 70 controls the drive of the scanning unit 108 to scan the measurement light on the fundus in a predetermined direction, and a predetermined output signal is output from the detector 120 during scanning. A light reception signal corresponding to the scanning area of the image is acquired to form a tomographic image 83.

Return to FIG. The control unit 70 displays the anterior segment observation image 81, the FC front image 82, the tomographic image 83, and the scan line SL acquired by the anterior segment observation optical system 60 on the display unit 75. The scanning line SL is an index indicating the measurement position (acquisition position) of the tomographic image on the FC front image 82. The scan line SL is electrically displayed on the OCT front image 84 on the display unit 75.

  In the present embodiment, when the examiner performs the touch operation or the drag operation on the display unit 75, the setting of the imaging condition can be made. The examiner can specify an arbitrary position on the display unit 75 by a touch operation.

<Scan line setting>
When the tomographic image and the OCT front image 84 are displayed on the display unit 75, the examiner sets the position of the tomographic image that the examiner wants to capture from the OCT front image 84 on the display unit 75 observed in real time. Here, the examiner moves the scan line SL with respect to the OCT front image 84 to set the scan position (for example, the drag operation of the scan line SL, the operation of the setting display 320). When the line is set to be in the X direction, the tomographic image of the XZ plane is taken, and when the scanning line SL is set to be in the Y direction, the tomographic image of the YZ plane is taken. It has become. In addition, the scan line SL may be set to an arbitrary shape (for example, an oblique direction, a circle, or the like).

  In the present embodiment, the operation of the touch-panel-type display unit 75 provided in the ophthalmologic photographing apparatus 1 has been mainly described, but the present invention is not limited to this. Also by operating the joystick 74 a or various operation buttons provided in the operation unit 74 of the ophthalmologic photographing apparatus 1, the operation may be performed in the same manner as the display unit 75. Also in this case, for example, the operation signal from the operation unit 74 may be transmitted to the HC 90 via the control unit 70, and the HC 90 may transmit a control signal corresponding to the operation signal to the control unit 70.

When the scanning line SL is moved with respect to the OCT front image 84 by the examiner, the control unit 70 sets the scanning position as needed, and acquires the tomographic image of the scanning position corresponding to this. Then, the acquired tomographic image is displayed on the display screen of the display unit 75 as needed. Further, the control unit 70 changes the scanning position of the measurement light based on the operation signal output from the display unit 75, and displays the scanning line SL at the display position corresponding to the changed scanning position. Since the relationship between the display position of the scanning line SL (coordinate position on the display unit) and the scanning position of the measurement light by the scanning unit 108 is determined in advance, the control unit 70 determines the display position of the set scanning line SL. The two galvano mirrors of the scanning unit 108 are appropriately driven and controlled so that the measurement light is scanned with respect to the scanning range corresponding to.

  According to the above configuration, since the OCT front image 84 and the FC front image 82 are simultaneously displayed in different display areas, the examiner adjusts the scanning position using the OCT front image 84, Adjustment of the fixation lamp position, focus adjustment, polarization control and the like can be performed, and alignment adjustment, focus adjustment and the like can be performed using the FC front image 82.

  In this case, since the OCT front image 84 is a front image by light scanning, it is possible to confirm more detailed information than the FC front image (for example, it is easy to check the running state of the blood vessel and an abnormal part). Therefore, the adjustment of the scanning position can be properly performed.

  On the other hand, in the FC front image 82, flare may occur due to reflection from the eye to be examined. By moving the imaging unit 3 with respect to the eye to be examined so that the flare is reduced, the examiner can take a fundus front image with the flare reduced as a result. Alternatively, the examiner can perform alignment adjustment using the optical alignment index W1 · W2. Alternatively, the examiner can perform focus adjustment using the focus indicators S1 and S2.

  When only one of the OCT front image 84 and the FC front image 82 is displayed, it is difficult to perform the adjustment on the interference optical system 200 side and the adjustment on the FC optical system 100 side. In addition, there is a possibility that the optical alignment indicators W1 and W2 and the focus indicators S1 and S2 may be hidden by the scanning line. As a result, it is difficult to make both adjustments properly. On the other hand, in the present embodiment, since both the OCT front image 84 and the FC front image 82 are displayed, both adjustments can be suitably performed.

<Shooting operation>
As described above, when the imaging start switch 74c is operated by the examiner after setting of the imaging conditions is completed, an operation signal from the imaging switch 74c is input to the control unit 70. When receiving the operation signal, the control unit 70 outputs a release signal to the front imaging optical system 30 and the interference optical system 200, and starts imaging of the tomographic image 83 and the front image 82 of the eye to be examined. The control unit 70 may automatically start imaging when alignment adjustment, focus adjustment, and optimization of the ophthalmologic imaging apparatus 1 are completed. FIG. 8 is a flowchart for explaining the photographing operation. Hereinafter, with reference to FIG. 8, the imaging operation regarding the combo imaging mode in which color fundus imaging is performed after tomographic image imaging will be described.

  First, a flow of acquiring a tomographic image of an eye to be examined in the OCT imaging mode will be described. When the release signal is input, the control unit 70 acquires a captured image of the FC front image 82 as a first captured image before capturing the tomographic image 83.

  For example, the control unit 70 turns off the light source 55 so that the working dots W1 and W2 are not reflected in the FC front image 82. Thereafter, the control unit 70 acquires the FC front image 82 as a first captured image (first infrared fundus image) (S11). The acquired first captured image is stored in the memory 72.

  When the first captured image is acquired, the control unit 70 acquires a tomographic image 83 (S12). The control unit 70 acquires a tomographic image 83 by B scan based on the set scanning position. The control unit 70 drives the scanning unit 108 so as to obtain a tomographic image of the fundus oculi corresponding to the position of the scanning line SL based on the display position of the scanning line SL set on the OCT front image 84 and performs measurement. Let the light scan.

  The HC 90 generates a still image of the tomographic image 83 based on the detection signal from the detector 120. The HC 90 stores the tomographic image 83 in the memory 92.

  In addition, while acquiring a tomographic image, the anterior segment observation image (live anterior eye image) 81 and the FC front image (live fundus image) 82 are continuous by the anterior segment observation optical system 60 and the photographing optical system 30. And is transmitted to the HC 90 through the fourth endpoint. The HC 90 displays the received live anterior eye image 81 and live fundus image 82 on the display unit 95, and updates it as needed each time a new image is received. By this, it is possible to observe the movement, blink and the like of the eye E to be examined also at the time of OCT imaging.

  Subsequently, a flow of acquiring a color fundus image of an eye to be examined in the color fundus imaging mode will be described. The control unit 70 causes the imaging device 38 to acquire the FC front image 82 as a second first captured image (second infrared fundus image) before capturing a color fundus image. For example, the control unit 70 drives the rotary solenoid 46 to retract the spot mirror 44 out of the optical path, and then captures the first captured image. This can prevent the spot mirror 44 from being reflected in the first captured image.

  The control unit 70 acquires the FC front image 82 illuminated by the observation light source 11 and captured by the imaging device 38 as a still image (first captured image) (S13). The acquired first captured image is stored in the memory 72.

  When the second first captured image is acquired, the control unit 70 transmits the two first captured images stored in the memory 72 to the HC 90. At this time, the control unit 70 transmits the first captured image to the HC 90 using, for example, the third endpoint for command transmission. This is because on the HC 90 side, it is difficult to specify a desired image from the FC front image 82 received via the fourth endpoint EP4. For example, it is detected from the response signal received from the ophthalmologic photographing apparatus 1 whether the photographing state of the ophthalmologic photographing apparatus 1 is a state suitable for capture, and the live image received via the fourth endpoint at that timing is first It is conceivable to capture as a captured image. However, since it takes time to exchange signals for synchronization between the HC 90 and the ophthalmologic imaging apparatus 1, there is a possibility that the capture timing may be shifted.

  Therefore, by transmitting the first captured image to the host HC 90 via the third endpoint, the control unit 70 can properly store the first captured image in the HC 90 without complicating the process.

  In addition, when the data amount of the first captured image is large, the image data may be divided into some and transmitted. For example, divided image data may be transmitted between transmission of the response signal from the ophthalmologic imaging apparatus to the HC 90 via the third endpoint. By this, it is possible to transmit the first captured image while maintaining the synchronization state without interrupting the communication between the ophthalmologic imaging apparatus 1 and the HC 90.

  Subsequently, the control unit 70 shifts to a step of acquiring a color fundus image by the fundus camera optical system 100. The control unit 70 first turns off the internal fixation lamp not shown and the light source for illuminating the fundus (for example, the light source 11). Then, the control unit 70 drives the insertion and removal mechanism 66 to separate the dichroic mirror 24 from the light path and causes the photographing light source 14 to emit light.

  When the imaging light source 14 emits light, the fundus of the eye to be examined is irradiated with visible light. Reflected light from the fundus passes through the objective lens 25, the aperture of the apertured mirror 22, the imaging diaphragm 31, the focusing lens 32, the imaging lens 33 and the dichroic mirror 37, and forms an image on the two-dimensional light receiving element 35. The color fundus image photographed by the two-dimensional light receiving element 35 is received by the HC 90 and then stored in the memory 92.

  In the present embodiment, the configuration in which the second infrared fundus image and the color fundus image are automatically acquired after tomographic image acquisition has been described as an example, but the present invention is not limited to this. For example, after acquisition of a tomographic image, fine adjustment of alignment and focus by an examiner may be performed before acquisition of a second infrared fundus image and a color fundus image. For example, after tomographic image acquisition, the control unit 70 causes the display unit 75 to display an adjustment screen for performing fine adjustment of alignment and focus. While observing the FC front image 82 displayed on the display unit 75, the examiner performs fine adjustment of alignment and focus so that a color fundus image can be captured in a desired state. Then, when the examiner inputs the imaging start switch 74c, the imaging of the second infrared fundus image and the color fundus image may be performed. In this case, when the examiner inputs the imaging start switch 74c, the control unit 70 first acquires a second infrared fundus image. After acquiring the second infrared fundus image, the control unit 70 acquires a color fundus image.

  In this way, when acquisition of the tomographic image and acquisition of the color fundus image are completed, the control unit 70 performs matching processing of the tomographic image and the color fundus image to associate the positional relationship between the tomographic image and the color fundus image. . By correlating the tomographic image with the color fundus image, the examiner can confirm the acquisition position on the fundus corresponding to the acquired desired fundus tomographic image on the color fundus image.

  In the present embodiment, as the ophthalmologic imaging apparatus, the case of imaging the fundus of the eye to be examined is described as an example, but the invention is not limited to this. The technique of the present disclosure is also applicable to the case of imaging the anterior segment of the subject's eye.

  In the above description, the control unit 70 records the first captured image (for example, an infrared front image) in the memory 72. When the transmission of the first captured image to the host computer 90 fails, the control unit 70 may transmit the first captured image recorded in the memory 72 to the host computer 90 again. The same process may be performed on the second captured image (for example, an OCT image).

  The control unit 70 may further store the fundus oculi observation image captured by the light receiving element 38 in the memory 72 before the release signal is output. For example, all the captured images may be stored in the memory 72, or the images acquired before the release signal is output may be stored in the memory 72 by a predetermined capacity. In the latter case, an image exceeding a certain capacity may be deleted from the most recent image. Of course, the memory 72 may also store an image captured before a predetermined time has elapsed after the release signal is output.

  As described above, by taking an infrared fundus image, an image captured when the release signal is output is an image (for example, an image in which unnecessary light is reflected) which is unsuitable as the first captured image. Even if there is, it is possible to select an appropriate image taken before and after the output of the release signal and transmit it to the host computer.

  Furthermore, even before the release signal is output, the control unit 70 transmits it to the host computer whenever an appropriate image (for example, an image with less unnecessary light) is acquired as the first capture image. May be

  In the above description, although the first captured image is described as being captured one by one each at the time of OCT imaging and color fundus imaging, the present invention is not limited to this and any number of images may be captured.

<Transformation form>
Although the live image and the captured image are transmitted using different lines in the above embodiment, the present invention is not limited to this. For example, in an apparatus that transmits a live image and a captured image using the same line, the first captured image signal is divided, and the divided first captured image signal is transmitted while transmitting the live image. It is also good.

  Moreover, in the said embodiment, although the live image and the capture image were transmitted, it is not limited to this. For example, in parallel with the first transmission control of transmitting the first live image signal to the host computer via the first line, a flag signal for specifying a live image to be used as a captured image is used as the second line. A second transmission control may be performed to transmit to the host computer via the interface. The flag signal may be, for example, a flag for discriminating the live image acquired at the transmission timing of the trigger signal (release signal) from other images. That is, the flag signal may be generated based on the trigger signal. The specific live image may be an image in which the alignment index is erased. In this case, a flag signal indicating that the alignment index has been erased may be generated based on the control signal of the device body.

  The first transmission control and the second transmission control may be synchronous control or asynchronous control. In the case of asynchronous control, there is a possibility that the transmission timing of the flag signal and the transmission timing of a specific image in the live image may be shifted. In this case, the host computer may specify a live image to be used as a captured image in consideration of a shift in transmission timing.

1 Ophthalmologic photographing apparatus 70 control unit 71 HUB
74 Operation Unit 75 Display 76, 77 USB Signal Line 78a, 78b USB Port 79a, 79b USB Port 90 Computer 95 Display

Claims (4)

An ophthalmologic imaging apparatus for imaging an eye to be examined,
A first imaging optical system for acquiring a first image of the subject's eye by imaging the subject's eye using a first imaging method;
A first line for transmitting to a host computer a first live image signal for forming a first live image which is a live image of the first image, and the first line is a line different from the first line. At least a second line for transmitting a signal from the ophthalmologic imaging device to the host computer, and a third line for receiving a command signal from the host computer; Data communication means for connecting a host computer for receiving the first image acquired by the first imaging optical system;
Data control means for controlling data to be transmitted to the host computer via the data communication means;
The data control means
Parallel to a first transmission control for transmitting the first live image signal to the host computer via the first line,
A first captured image signal for forming a first captured image which is a captured image of the first image, wherein the first captured image signal is transmitted to the host computer via the second line. An ophthalmologic photographing apparatus characterized by performing transmission control of the above. The ophthalmologic photographing apparatus of claim 1 further includes
And a second imaging optical system for acquiring a second image of the subject's eye by imaging the subject's eye using a second imaging method different from the first imaging method.
The data communication means further includes a fourth line for transmitting a second image signal for forming the second image to a host computer.
The data control means
Along with performing the second transmission control in parallel with the first transmission control,
A second capture image signal for forming a second capture image, which is a capture image of the second image, in parallel with the first transmission control, and an imaging command signal via the third line An ophthalmologic photographing apparatus characterized by performing a third transmission control of transmitting a second captured image signal acquired by triggering the transmission to the host computer via the fourth line.   The ophthalmologic photographing apparatus according to claim 1 or 2, wherein the second line is a line for transmitting a response signal to the host computer to the host computer. An ophthalmologic imaging program for use in an ophthalmologic imaging apparatus for imaging an eye to be examined, comprising:
By being executed by the processor of the ophthalmologic imaging apparatus,
A first imaging step for acquiring a first image of the subject's eye by imaging the subject's eye using a first imaging method;
A first line for transmitting to a host computer a first live image signal for forming a first live image which is a live image of the first image, and the first line is a line different from the first line. The ophthalmologic imaging apparatus using at least a second line for transmitting a signal from the ophthalmologic imaging apparatus to the host computer and a third line for receiving a command signal from the host computer When the data communication step of connecting a host computer to accept the acquired first image in said first shooting step,
A data control step of controlling data to be transmitted to the host computer in the data communication step;
Parallel to the first transmission step of transmitting the first live image signal to the host computer via the first line,
A first capture image signal for forming a first capture image that is a capture image of the first image, the first capture image signal acquired using an imaging command signal via the third line as a trigger Transmitting to the host computer via the second line;
An ophthalmologic photographing program characterized by causing the ophthalmologic photographing device to execute the present invention.

Images