JP2020006182A - Imaging system and control method thereof - Google Patents

Abstract

To provide efficient and accurate interactive control for an imaging device.SOLUTION: Provided is an interactive control device for controlling imaging of an optical interference tomographic image of a specimen, in which the control is based on a state of an imaging device and a user's instruction to be input. An interactive control device 104 is connected to a display unit 105 configured to show a GUI to a user and a pointer device 107 configured to receive input of a user's instruction. A display control unit 1041 is configured to control the display unit 105. A control unit 1045 is configured to control capturing an image from the specimen. The control unit 1045 further controls a preparation status of the imaging device, and the function of the pointer device 107 changes based on the status of the imaging device.SELECTED DRAWING: Figure 1

Description

  The present disclosure relates to an imaging device connected to a pointer device that controls a virtual pointer on a displayed GUI, and more particularly, to an interactive control device for an imaging device that performs optical coherence tomography.

  2. Description of the Related Art In recent years, in the medical field, more specifically, in the field of ophthalmology, an imaging apparatus (hereinafter, also referred to as an OCT apparatus) has been used. Each of these apparatuses captures a tomographic image (hereinafter, also referred to as an optical coherence tomographic image) of a test object using optical coherence tomography (OCT) based on interference of low coherence light. The OCT apparatus can acquire a high-resolution tomographic image on the order of the light wavelength (micrometer) by utilizing the property of light. Generally, a position where the difference between the optical path length of the measurement light and the optical path length of the reference light is zero is called a coherence gate. In order to acquire a tomographic image having a high signal-to-noise (SN) ratio and display this tomographic image at an appropriate position on a monitor, it is essential to arrange a coherence gate at an appropriate position on the eye to be inspected. . Japanese Patent Application Laid-Open No. 2009-160190 discloses an OCT device capable of designating a position of a coherence gate by moving a cursor displayed on a monitor in order to facilitate designation of a position of the coherence gate by a user. Has been disclosed.

JP 2009-160190 A

  While measuring an eye to be examined, such as the fundus, movement, blinking, or random tremor of the object (ie, involuntary eye movement during fixation) is unavoidable. The time lag between the adjustment of a plurality of elements (adjustment of the focus, adjustment of the coherence gate, etc.) and the start of capturing the tomographic image may cause a tomographic image that does not comply with the adjusted measurement parameters to be acquired. .

  SUMMARY OF THE INVENTION It is an object of the present invention to provide an apparatus that can reduce the time required for a user's operation from the adjustment of a plurality of elements to the start of tomographic image capturing.

  According to some embodiments of the invention described below, an interactive control device is provided for the imaging device. The interactive control device is an interactive control device for an OCT imaging device connected to a pointer device configured to output two types of instruction signals, has a plurality of imaging states, and has a plurality of imaging states. An interactive control device in one state, the display control unit configured to display on a display unit a graphical user interface having an icon selected by a virtual pointer controlled by the pointer device; A detection unit configured to detect a first indication signal of a pointer device for selecting an icon below the virtual pointer, and to detect a second indication signal of the pointer device; In response to detecting the first indication signal, the first indication signal is detected. Instructing the OCT imaging apparatus to perform an operation of adjusting one element corresponding to the icon selected by the detected first instruction signal from the icons that can be selected in the imaging state when the OCT imaging apparatus is selected, and A control unit configured to change the shooting state to a next shooting state based on a shooting state when the second instruction signal is detected, in response to detection of the second instruction signal; Is provided.

  Further, the interactive control device is an interactive control device having a plurality of shooting states and being in one of the plurality of shooting states, and is an interactive control device for an OCT imaging device connected to a pointer device. A display control unit configured to display a graphical user interface on a display unit, output of a first instruction signal and a second instruction signal, and a position of a virtual pointer on the graphical user interface And a control unit, the control unit being triggered by the output of the first indication signal from the pointer device, the control unit being configured to detect the graphical user interface and the detection. The graphic card according to the position Executing a first control for instructing the OCT imaging apparatus to perform an operation for adjusting one element corresponding to an icon of a user interface, or triggered by output of the second instruction signal from the pointer device; The second control is executed to change the shooting state when the second instruction signal is detected to the next shooting state.

  According to the interactive control device, a specific operation of advancing the current imaging state of the imaging device to the next imaging state can be started in response to the second instruction signal from the pointer device.

1 is a side view of an imaging system according to an exemplary embodiment. 1 is a block diagram of an imaging system according to an exemplary embodiment. 1 is a diagram of an imaging optical system in an imaging device according to an exemplary embodiment. 5 is an example of an image captured by an OCT imaging device according to an exemplary embodiment. 9 is another example of an image taken by an OCT imaging device according to an exemplary embodiment. 9 is yet another example of an image captured by an OCT imaging device according to an exemplary embodiment. FIG. 3 is a diagram of a GUI displayed on a display unit according to the first exemplary embodiment. FIG. 4 is a diagram illustrating a change in a GUI according to a ready status, according to an exemplary embodiment. FIG. 9 is another diagram relating to a change in a GUI in response to a ready status, according to an exemplary embodiment. 5 is a flowchart of an operation of the interactive control device according to an exemplary embodiment. 5 is a flowchart of a control process of the interactive control device according to an exemplary embodiment. FIG. 9 is a diagram of a GUI displayed on a display unit according to another exemplary embodiment. FIG. 10 is a diagram of a GUI displayed on a display unit according to yet another example embodiment. FIG. 3 is a block diagram illustrating hardware of an interactive controller and software modules stored in a memory, according to an exemplary embodiment.

  FIG. 1 is a side view of an imaging system according to an exemplary embodiment. In the present embodiment, the imaging system includes the imaging device 100 that acquires an image of a subject using the imaging optical system 1011.

  The imaging device 100 is connected to an interactive control device 104 for controlling imaging using a graphical user interface (GUI) displayed on a display unit 105. The interactive control device 104 may be connected to a pointer device 107 that controls a virtual pointer displayed on the display unit 105. The GUI on the display unit may be used by the virtual pointer to adjust the plurality of optical elements of the imaging device 100 in preparation for obtaining an appropriate image of the subject. The pointer device 107 acquires the amount of movement of the pointer device or the position of the pointer device. The pointer device also includes two buttons for generating two different types of instruction signals output to the interactive control device.

  As shown in FIG. 1, the interactive control device 104 includes a display control unit 1041 configured to display a GUI having an icon selected by a virtual pointer controlled by the pointer device 107 on the display unit 105. And a click detection unit 1042 configured to detect a first indication signal of a pointer device for selecting an icon below the virtual pointer, and to detect a second indication signal of the pointer device 107. May be included.

  Further, the interactive control device, when detecting the first instruction signal and the status acquisition unit 1043 configured to acquire the preparation status of the imaging device 100, changes the icon selected by the detected first instruction signal to the icon. Accordingly, a control unit 1045 configured to instruct the imaging device 100 to perform a specific operation. Further, when detecting the second instruction signal, the control unit 1045 is configured to instruct the imaging device 100 to perform a specific operation according to the preparation status when the second instruction signal is detected. According to the embodiment, the interactive control device 104 provides a plurality of operation methods for controlling the imaging device 100.

  The specific operation may be, for example, the start of imaging. When the acquired status indicates that all adjustments regarding imaging have been completed, the interactive control device 100 instructs the start of imaging as a response to the detection of the second instruction signal.

  When detecting the second instruction signal, the control unit 1045 is configured not to instruct the OCT imaging apparatus to perform a specific operation according to an icon below the virtual pointer when the second instruction signal is detected. You may. The second instruction signal may supply an instruction based on the preparation status of the imaging device 100 to the imaging device, instead of an instruction based on the position of the virtual pointer. As a result, even if the pointer device is not moved to move the virtual pointer to a specific icon, a quick instruction by using the pointer device is realized.

  In one embodiment, the GUI displayed on the display unit 105 is used to move the focus lens of the imaging optical system 1011 in a unit of movement for each selection in order for the operator to manually and precisely adjust the focus lens. May be included. The icon may be selected by a first instruction signal corresponding to a first button of the pointer device 107. Further, the control unit may instruct the automatic focus adjustment according to the preparation status in response to the detection of the second instruction signal corresponding to the second button of the pointer device 107. Further, the GUI may include an icon for starting the automatic focus adjustment, which is selected by the first instruction signal corresponding to the first button of the pointer device 107.

  According to the present embodiment, there is provided an operation method in which the automatic adjustment is performed by simply clicking the second button without moving the pointer device 107. An operation method is provided in which the pointer device 107 is moved and a fine adjustment is manually performed by clicking the first button. In addition, an operation method of performing automatic adjustment by moving the pointer device 107 and clicking a second button is provided.

  The instruction output from the control unit 1045 is received by the drive unit 1034 of the imaging device 100. The driving unit 1034 controls a motor or a driving mechanism for each element adjusted for imaging, such as a focus lens of the imaging optical system 1011.

  The imaging device 100 may be an ophthalmic imaging device. As illustrated in FIG. 1, the imaging system according to the embodiment includes an optical coherence tomography (OCT) imaging apparatus that acquires a tomographic image of a fundus or an anterior segment of an eye to be examined. The OCT imaging apparatus according to the embodiment includes a scanning laser ophthalmoscope (SLO) forming unit 1032, an anterior segment image forming unit 1033, and an OCT image forming unit 1031.

  A general configuration of the ophthalmologic imaging apparatus 100 according to the exemplary embodiment will be described with reference to FIG. 1, which is a side view of the ophthalmologic imaging apparatus 100. The optical head 101 is a measurement optical system for acquiring an anterior segment image, a two-dimensional image and a tomographic image of the fundus of the eye. The optical head 101 can be moved with respect to the base unit 103 using a stage unit 102 (also called a moving unit). The stage unit 102 is moved in the X, Y, and Z directions in FIG. 1 by a motor or the like. The base unit 103 includes a spectroscope described below.

  The stage unit 102 may be an element adjusted to image the eye to be examined. The GUI displayed on the display unit 105 includes an icon for moving the optical head 101 in each of the x, Y, and Z directions. The GUI also includes an icon for instructing automatic anterior segment alignment. The automatic anterior segment alignment is performed to automatically adjust the position of the optical head 101 by using the anterior segment image of the subject's eye. The control unit 1045 controls the stage unit so that the anterior segment image of the subject's eye is captured at a specific appropriate position in the image area. In one embodiment, the icon for the X, Y, or Z movement is selected by clicking a first button, and the optical head 101 moves in response to the icon selection. When the second button is clicked when the preparation status of the imaging apparatus 100 is a state where the adjustment of the stage unit 102 has not been completed, the optical head 101 is automatically adjusted.

  The interactive control device 104, which also functions as a control unit for the stage unit 102, can form a tomographic image while controlling the stage unit 102. The hard disk 1040, which also functions as a storage unit for storing information about a subject, stores, for example, a program for capturing a tomographic image. The display control unit (not shown) causes the display unit 105 such as a monitor to display the acquired image and other images. The pointing device (instruction unit) 107 supplies an instruction to the interactive control device 104. More specifically, the pointing device 107 includes a mouse (also referred to as a pointing device). A chin rest 109 is provided to fix the lower jaw and forehead of the subject.

  The embodiment of the imaging apparatus 100 includes an OCT apparatus that captures a tomographic image (hereinafter, also referred to as an optical coherence tomographic image) of a test object by optical coherence tomography (OCT) using interference of low coherence light. Further, the imaging apparatus 100 is configured to capture an image of the cornea and iris of the eye 307 to be examined (anterior eye image). The imaging device 100 is configured to capture an image of the fundus of the eye to be inspected. The imaging device 100 according to the exemplary embodiment includes an optical head 101 and a stage unit 102. The optical head 101 includes a low coherence light source 301, an OCT XY scanner 334, a reference mirror 332-4, an OCT focus lens 335-5, a line sensor 382, an anterior ocular segment image forming unit 1033, and an anterior ocular segment image. It further includes a forming unit 1033 and an SLO image forming unit 1032. The low coherence light source 301 generates low coherence light that is split into measurement light and reference light. The measurement beam proceeds to the OCT focus lens 335-5, and is focused on the fundus of the eye to be examined. The measurement beam proceeds to the OCT XY scanner 334 to scan the fundus of the eye to be examined. The OCT XY scanner 334 includes two scanners (not shown) so that a plurality of B-scan tomographic images scanned by the high-speed scanner can be captured at various positions defined by the low-speed scanner. ing. As described above, the measurement light is projected on the eye to be examined, and the return light is combined with the reference light after being reflected by the reference mirror 332-4. When the moving distances of the measurement light and the reference light are the same, the combined light includes information on the tomographic image of the eye to be inspected. The combined light is sent to a line sensor 382, and as a result, the combined light is detected and decomposed into a plurality of spectral regions used to calculate a tomographic image of the fundus of the subject's eye.

  The anterior ocular segment image forming unit 1033 uses an IR light source, an IR camera, and a lens that focuses the IR camera on the anterior segment of the eye (cornea), thereby forming an anterior segment of the subject's eye (cornea and iris). Used to capture images.

  The SLO imaging unit 1032 is used to capture a 2D image of the fundus of the subject's eye by using an IR light source, an IR camera, and a lens used to focus the IR camera on the fundus of the eye. You. Also, it will be apparent to one skilled in the art that other embodiments of the SLO imaging unit 1032 may be implemented using an SLO (scanning laser ophthalmoscope).

  The interactive control device 104 according to the embodiment of the present invention will be described with reference to FIG. The interactive control device 104 may be connected to the pointer device 107 and the base unit 103 of the imaging device 100 via a wired or wireless connection.

  Further, the embodiment of the present invention includes the imaging device 100 having the function of the interactive control device as the interactive control unit. In addition, the present embodiment includes a device including an interactive control device and a pointer device as one independent device.

  The pointer device 107 includes a first button 1071, a second button 1072, and a position output unit 1073. Both the first button 1071 and the second button can be clicked by the operator, and the pointer device 107 can be moved on the upper surface of the table. The pointer device 107 has a laser light source and a detector facing a plane on which the pointer device is mounted. The processing unit of the pointer device 107 optically detects the movement of the pointer device 107. The position output unit 1073 outputs the detected movement information to the interactive control device 104 as position information. The movement information is output as a movement amount in the x direction and the y direction.

  The pointer device 107 may be any pointing device such as a mouse, a joystick, a trackball, or a keyboard, or a touch panel device 106 integrated with the display unit 106. In the present exemplary embodiment, a mouse having two buttons (left and right) and a wheel is used as a user input device. In one exemplary embodiment, pressing the right mouse button is referred to as right clicking, and pressing the left mouse button is referred to as left clicking. The pointer device 107 can recognize which button is pressed, and recognizes one temporary press (click) of the button and two temporary presses (double-click) of the button. Then, such information can be transmitted to the display control unit 1041. The pointer device 107 can also recognize when the wheel has been rotated and further, the pointer device 107 informs the display control unit 1041 how much the wheel has been rotated (in pulses). The pointer device 107 can also recognize when the mouse has been moved, and further, the pointer device 107 notifies the display control unit 1041 when the mouse has been moved and how much the mouse has been moved.

  Embodiments of the pointer device 107 include a mouse device having one button that outputs a first instruction signal by a single click and outputs a second instruction signal by a double click. Embodiments of the pointer device 107 also include a pointer device having a trackball that can be rotated by an operator's finger. The rotation of the trackball may be detected by a rotation encoder functioning as the position output unit 1073. Embodiments of the pointer device also include four buttons for moving the virtual pointer by a unit amount in each of the four directions, and two buttons for generating a first instruction signal and a second instruction signal. Includes a keyboard 251 with buttons.

  The first instruction signal, the second instruction signal, and the movement information are input to the interactive control device 100 via the interface unit of the pointer device 107. The interface unit may be a USB, PS / 2, Bluetooth, or other wired or wireless interface. The processing unit determines the types of information and generates an event for each type.

  The click detection unit 1042 monitors and detects an event indicating that the first signal or the instruction signal has been output from the pointer device 107 in response to the click of the first button 1071 or the second button 1072. . The click detection unit 1042 determines which instruction signal has been input, and transmits the result of the determination to the determination unit 204.

  The position detection unit 1043 monitors and detects an event indicating that movement information as position information for the virtual pointer has been output from the pointer device 107 in response to movement of the pointer device 107. The position detection unit 1043 updates the position of the current position of the virtual pointer on the display screen of the display unit 105 based on the current position information stored in the memory 202 and the movement information from the pointer device 107.

  The determination unit 204 determines information used to generate a signal for controlling the imaging device 100. When the first indication signal is detected, the determination unit 204 determines that the position information and the GUI data are used to generate a control signal for the imaging device 100. In another case where the second indication signal is detected, the determination unit 204 determines that the ready status is used to generate a control signal.

  Interpretation unit 205 determines which icon or GUI button is under the virtual pointer. The interpretation unit 205 acquires GUI data including the positions of icons, images, or buttons constituting the GUI. Further, the interpretation unit 205 acquires the updated position data of the virtual pointer. The interpretation unit 205 determines the icon, image, or button below the virtual pointer on the GUI displayed on the display unit 105.

  The status acquisition unit 1044 acquires the preparation status from the status monitoring unit 231 via another interface unit, for example, a universal serial bus (USB) port. The status monitoring unit 231 monitors the imaging device 100, updates the current preparation status, and stores the preparation status in the memory. The preparation status indicates that the adjustment of each of the elements of the imaging device 100 has been completed. In the OCT imaging apparatus, these elements are OCT imaging light for scanning the subject's eye, SLO imaging light, and a low coherence light source that emits anterior segment imaging light; an OCT scanner driver for scanning the subject's eye with the imaging light; A reference mirror for adjusting the optical path length (coherence gate), a focus lens for focusing the OCT imaging light and the SLO imaging light on the subject's eye, an OCT line sensor for detecting interference light, and reflection of the SLO imaging light An SLO imager that detects light, an anterior eye imager that detects reflected light of anterior ocular segment imaging light, and a stage unit 102 that aligns the subject's eye with the optical head 101 are included.

  In the OCT imaging apparatus of the present embodiment, each of the elements may be adjusted in a predetermined order stored in the memory. In one embodiment, first, the adjustment of the stage unit 102 is performed for alignment between the subject's eye and the optical head 101 (anterior eye alignment) using an anterior eye image from an anterior eye imager. You may. Next, adjustment of the SLO focus lens may be performed. In this state, by starting the driving of the SLO imager, the SLO imaging is started. Next, adjustment of the OCT focus lens may be performed. The position of the OCT focus lens can be associated with the position of the SLO focus lens using a look-up table stored in a memory. In this state, by starting the driving of the OCT scanner and the OCT imager, the OCT imaging (OCT preview) is started. Next, the position of the reference mirror may be adjusted for an appropriate coherence gate position. Since the OCT focus lens is appropriately arranged, when the reference mirror is appropriately adjusted, an OCT image of the eye to be inspected is appropriately acquired. Thus, all the elements are adjusted, and the OCT imaging apparatus is prepared for imaging (measuring) the eye to be inspected.

  When each of the elements is fully adjusted, the status monitoring unit 231 updates the ready status and stores this status in memory as the current status. The control unit 1045 generates a control signal for instructing adjustment of the elements of the imaging device 100 based on the information determined by the determination unit 204. The control signal is output to the drive unit 1034 via the USB port.

  The control unit 1045 instructs the adjustment of at least one element whose adjustment has not been completed based on the acquired preparation status in response to the instruction signal of the pointer device 107.

  For example, in a state where the anterior ocular segment alignment is not completed, when the second button 1072 is clicked, the control unit 1045 instructs the start of the anterior ocular segment alignment. In this state, the second button 1072 functions as a switch for triggering automatic anterior ocular segment alignment. Automatic anterior segment alignment may be performed based on the position of the pupil in the anterior segment image. The XYZ stage moves the optical head 101 in the X and Y directions to adjust the position to the center of the image, and moves the optical head 101 in the Z direction to adjust the size of the pupil to a specific size.

  When the OCT preview has not been started, the control unit 1045 instructs the start of the SLO and the SLO focus adjustment, the start of the coherence gate adjustment, and the start of the OCT imaging by clicking the second button. In this state, the second button 1072 functions as a switch for triggering automatic focus adjustment and automatic coherence gate adjustment. Automatic SLO focus adjustment may be performed based on pixel values or contrast of the SLO image. When the SLO focus lens is adjusted, the CPU of the OCT imaging apparatus reads a look-up table indicating the relationship between the position of the SLO focus lens and the position of the OCT focus lens. Then, the position of the OCT focus lens is adjusted.

  In a state where the adjustment of the coherence gate is completed (this means that the adjustment for imaging the eye to be inspected is completed), the control unit 1045 responds to the click of the second button to perform the OCT imaging ( Measurement). In other words, the control unit 1045 determines whether or not the OCT imaging apparatus is ready to image a subject based on the preparation status. When the control unit 1045 determines that the OCT imaging apparatus is ready, the control unit 1045 instructs the OCT imaging apparatus to start OCT imaging. In this state, the second button 1072 functions as a switch for triggering the start of imaging.

  According to this embodiment, an interactive control device is provided, the interactive control device instructs to capture an optical coherence tomographic image of a test object, and immediately after a capturing parameter is obtained from a user by a pointer device. Includes a control unit that can start capturing tomographic images.

  In other words, the control unit 1045 assigns at least one of the elements to the second button 1072 according to the preparation status of the imaging device 100. Further, the control unit 1045 is further configured to assign at least one of the elements to the first button 1071 according to the position of the virtual pointer on the graphical user interface.

  The control unit 1045 is triggered by the output of the first instruction signal from the pointer device 107, and instructs the OCT imaging apparatus to perform a specific operation according to the graphical user interface and the detected position. Execute Further, the control unit 1045 is triggered by the output of the second instruction signal from the pointer device 107, and instructs the OCT imaging apparatus to perform a specific operation according to the preparation status when the second instruction signal is detected. The second control is performed. The determination unit 204 determines whether to execute the first control or the second control according to the instruction signal output from the pointer device. As described above, when a plurality of instruction signals are output from the pointer device 107, the control unit 1045 instructs to adjust the plurality of elements continuously in the stored order.

  The drive unit 1034 includes a driver for moving the position of an element of the imaging device 100 or adjusting the state. Each of the drivers applies a voltage to a drive unit, such as a motor, to move or adjust the element by a specified amount. The drive unit 1034 of the OCT imaging apparatus includes a light source driver 232, an OCT scanner driver 233, a reference mirror driver 234, a focus driver 235, an OCT line sensor driver 236, an SLO imager driver 237, and an anterior eye imager driver 238. And an XYZ stage driver 239.

The display control unit 1041 displays the GUI image data stored in the memory 202 at a predetermined position on the display screen of the display unit 105 based on the GUI position data. Further, a cursor (virtual pointer) is displayed on the display screen to select an icon, button, or image included in the GUI image data. When the position information is output from the pointer device 107, the display control unit 1041 updates the display position of the cursor. The display control unit 1041 may change the cursor icon according to the position on the GUI or the preparation status acquired from the imaging device 100.
(Configuration of measuring optical system and spectroscope)
The configuration of the measurement optical system and the spectroscope in the ophthalmic imaging apparatus 100 according to the exemplary embodiment will be described below with reference to FIG.

  First, the internal configuration of the optical head 101 will be described. The objective lens 335-1 is arranged facing the eye 307 to be inspected. In the optical axis of the objective lens 335-1, the first dichroic mirror 332-1 and the second dichroic mirror 332-2 are connected to the optical path 351 of the OCT optical system, the fundus observation and the fixation lamp according to the wavelength range. The light is split into an optical path 352 for the observation and an optical path 353 for the observation of the anterior segment. Similarly, the third dichroic mirror 323 includes an optical path 354 toward a charge-coupled device (CCD: charge-coupled device) 346 for the fundus observation and an optical path toward the fixation lamp 391 according to the wavelength range. 352 are split. Optical head 101 further includes lenses 335-3 and 335-4. The lens 335-3 is driven by a motor (not shown) to adjust the focus of the fixation lamp.

  The CCD 346 has sensitivity to a wavelength of illumination light (not shown) provided for observing the fundus, specifically, a wavelength of about 780 nm. The fixation lamp 391 generates visible light in order to facilitate fixation of the eye 307 to be inspected. The optical system for observing the fundus may include, for example, an optical system such as a scanning laser ophthalmoscope (SLO). The optical path 353 is provided with a lens 335-2 and an infrared CCD 371 for observing an anterior segment. The CCD 371 has sensitivity to the wavelength of illumination light (not shown) provided for observing the anterior segment, specifically, a wavelength of about 970 nm. Further, an image splitting prism (not shown) is provided in the optical path 353, so that the distance from the optical head 101 to the subject's eye 307 in the Z direction can be obtained in an observation image of the anterior segment. It can be detected as an image.

  The optical path 351 forms the OCT optical system as described above, and is used for acquiring a tomographic image of the fundus of the eye 307 to be inspected. More specifically, the optical path 351 is used to acquire an interference signal for forming a tomographic image. The OCT XY scanner 334 scans the fundus with a light beam. The OCT XY scanner 334, shown as a mirror, performs scanning in two axial directions X and Y. The optical head 101 further includes an OCT focus lens 335-5 and a lens 335-6. The OCT focus lens 335-5 is provided with a motor (not shown) for performing focus adjustment for focusing a light beam emitted from the fiber 331-2 from the low coherent light source 301 on the fundus of the eye to be inspected 307. ). The fiber 331-2 is connected to the optical coupler 331. At the same time, thanks to the focus adjustment, light from the fundus of the subject's eye 307 forms a spot image and enters one end of the fiber 331-2.

  Hereinafter, the configurations of the optical path from the low coherent light source 301, the reference optical system, and the spectroscope will be described. Low-coherent light source 301, reference mirror 332-4, dispersion compensation glass 315, optical coupler 331, single mode optical fibers 131-1 to 331-4 connected to optical coupler 331 as an integral part of optical coupler 331, lens 335. 7, and the spectrometer 380 form a Michelson interferometer.

  The light beam emitted from the low coherent light source 301 passes through the optical fiber 331-1 and the optical coupler 331. In the optical coupler 331, the light beam is transmitted to the measurement beam traveling toward the optical fiber 331-2 and to the optical fiber 331-3. The reference beam is split into two. The measurement beam passes through the optical path of the above-described OCT optical system to illuminate the fundus of the eye to be inspected 307, which is the observation target. The measurement beam is reflected and scattered by the retina and follows the same optical path to the optical coupler 331. The reference beam passes through the optical fiber 331-3, the lens 335-7, and the dispersion compensation glass 315, and reaches the reference mirror 332-4 for reflection. A dispersion compensating glass 315 is inserted to compensate for the dispersion of the measurement beam and the reference beam. The reference beam follows the same optical path and returns to the optical coupler 331. The optical coupler 331 combines the measurement beam and the reference beam into interference light (also referred to as combined light). If the measurement beam and the reference beam have approximately the same optical path length, interference will occur. The reference mirror 332-4 is held by a motor and a driving mechanism (not shown) so as to be adjustable in the direction of the optical axis. Thereby, the optical path length of the reference beam can be adjusted so as to be equal to the optical path length of the measurement beam, which varies depending on the eye 307 to be inspected. The interference light is guided to the spectroscope 380 via the optical fiber 331-4.

  A polarization adjustment unit 339-1 for the measurement beam is provided in the optical fiber 331-2. A polarization adjustment unit 339-2 for the reference beam is provided in the optical fiber 331-3. Each of the polarization adjustment units 339-1 and 339-2 includes a portion formed as a loop-shaped path of the optical fibers 331-2 and 331-3. The polarization states of the measurement beam and the reference beam can be adjusted to each other by winding these loops so that the longitudinal direction of each fiber is centered, thereby twisting the fibers 331-2 and 331-3. it can. In the device according to the present exemplary embodiment, the polarization states of the measurement beam and the reference beam are adjusted and fixed in advance. The spectroscope 380 includes lenses 335-8 and 335-9, a diffraction grating 381, and a line sensor 382. The interference light emitted from the optical fiber 331-4 is collimated into approximately parallel light by the lens 335-8. Next, the parallel light is dispersed by the diffraction grating 381 to form an image at the line sensor 382 via the lens 335-3.

  Hereinafter, the low coherent light source 301 and its periphery will be described in more detail. The low coherent light source 301 is a super luminescent diode (SLD), that is, a general low coherence light source. The low coherent light source 301 has a center wavelength of 855 nm and a wavelength band of about 100 nm. The band that affects the resolution of the tomographic image acquired in the direction of the optical axis is an important parameter. In the present exemplary embodiment, the type of low coherent light source employed is SLD. However, any other type of low coherent light source, such as an amplified spontaneous emission (ASE) device, may be used as long as it can emit low coherence light. Since the human eye is the object to be measured, near-infrared light is suitable as the center wavelength. The center wavelength that affects the resolution of the tomographic image acquired in the transverse direction is preferably a short wavelength. For the above two reasons, the center wavelength is set to 855 nm.

  In the present exemplary embodiment, a Michelson interferometer is employed. However, a Mach-Zehnder interferometer may be used as well. When the difference between the light amounts of the measurement beam and the reference beam is relatively small, a Michelson interferometer provided with one splitting / combining unit is preferable to a Mach-Zehnder interferometer provided with a splitting unit and a combining unit separately. .

(Scanning laser ophthalmoscope)
The schematic overall configuration of the optical system of the SLO according to the present embodiment will be described with reference to FIG.

  The illumination beam emitted from the low coherent light source 345 is deflected by the prism 348 and scanned by the SLO XY scanner 347. The SLO XY scanner 347 is actually composed of two mirrors (X scan mirror 347-1 and Y scan mirror 347-2) arranged close to each other. Therefore, the SLO XY scanner 347 can raster-scan the fundus in a direction perpendicular to the optical axis.

  The focus position of the illumination beam may be adjusted by the SLO focus lens 341 and the lens 342. The SLO focus lens 342 may be driven by a motor to adjust the focus.

  After entering the eye to be examined, the illumination beam is reflected or scattered by the fundus, thereby returning as a return beam. The return beam enters prism 348 again, and the beam passing through prism 348 enters sensor 346. The sensor 346 converts the light intensity of the return beam at each measurement point on the fundus into a voltage, and supplies a signal indicating the voltage to the memory control / signal processing unit 304. The memory control / signal processing unit 304 uses the supplied signal to generate a fundus image which is a two-dimensional image. A part of the memory control / signal processing unit 304 cooperates with the above-described optical system and the sensor 346 to constitute a fundus imaging unit for taking a fundus image in this embodiment. Further, the memory control / signal processing unit 304 extracts, from the two-dimensional image, a region having a predetermined shape and size including characteristic points having characteristics such as a blood vessel intersection region or a branch region in the fundus as a template. Therefore, the template is image data of an area including a feature point. Here, the memory control / signal processing unit 304 has a function of configuring a template extraction unit for executing the aforementioned extraction of the template from the fundus image. The template matching is performed on the newly generated two-dimensional image by using the extracted template, and the movement amount of the eye to be inspected is calculated. Further, the memory control / signal processing unit 304 performs tracking according to the calculated movement amount.

  Further, the memory control / signal processing unit 304 includes a keyboard and a mouse (not shown), and supports external inputs. Further, the memory control / signal processing unit 304 controls start and end of fundus imaging. Further, the memory control / signal processing unit 304 may include a monitor (not shown) and display a fundus image of the eye to be examined and specific information. This allows the operator to observe the fundus in the image. Further, the template extracted by the memory control / signal processing unit 304 is recorded in the memory unit together with the input identification information of the eye to be examined. Specifically, the extracted template and the specific information specifying the inspected eye from which the fundus image from which the template was extracted were identified are associated with each other, and the memory control / signal processing unit 304 Is recorded in the memory unit by the memory control of.

  4A, 4B, and 4C are diagrams of a transaxial image 467 of the anterior segment, a transaxial image 427 of the fundus, and a longitudinal tomographic image 407 of the retina. These are all photographed by the OCT imaging apparatus. The anterior ocular segment image 467 is for aligning the subject's eye and the imaging optical system 1011 before the OCT measurement. The fundus image 427 is for determining the scan line position of OCT before measurement, and is for performing diagnosis after measurement. The tomographic image 407 is for confirming the scan line position before the measurement, and diagnosing the fundus after the measurement.

  The images 407, 427, and 467 are displayed on the display unit 105 as a GUI. The images 407, 427, and 467 are transmitted from the imaging device 100 to the interactive control device via an IEEE 1394 (so-called firewire) or camera link interface. In one embodiment, the connection line may be duplicated to extend the communication band. Thus, the time difference between the time of imaging and the time of displaying an image is reduced.

  The GUI displayed on the display unit 105 and the interaction between the operator and the interactive control device 104 will be described with reference to FIG.

  In the exemplary embodiment, the display control unit 1041 is configured to control the display of the GUI and the captured image on the display unit 105, and is also configured to process user instructions. I have. In addition, the display control unit 1041 includes a shooting state controller (not shown) configured to control a shooting state. The display control unit 1041 displays a mouse cursor on the display unit 105 based on an instruction acquired from the pointer device 107. Further, the display control unit 1041 can recognize the coordinates on the display unit 105 and specify the area of the display unit 105 where the cursor is located. When the anterior eye image is displayed on the display unit 105, the display control unit 1041 recognizes the position of the cursor in the anterior eye image. Similarly, the display control unit 1041 recognizes when the cursor is over any of the icons of the fundus image, the tomographic image, and the GUI. In the present exemplary embodiment, a mouse is used as the pointer device 107, and the display control unit 1041 moves and recognizes the position of the cursor on the display unit 105 according to the amount of movement of the mouse obtained from the pointer device 107. I do. Therefore, the display control unit 1041 recognizes the position of the cursor when the pointer device 107 recognizes the left click of the button or the rotation of the mouse wheel.

  The display control unit 1041 includes a shooting state machine that controls the current state of the control unit 1045. In the present exemplary embodiment, the states are an anterior ocular segment alignment state, an OCT preview state, and an OCT measurement state. The state changes according to an instruction input by the user.

  Each time the shooting state changes, the display control unit 1041 transmits the updated shooting state to the control unit 1045.

  In response to a user input obtained from the pointer device 107, the display control unit 1041 transmits imaging information (information necessary for generating imaging parameters) to the control unit 1045. The imaging parameter may be an OCT scan position, a focus adjustment, an XYZ stage position, or the like.

  The control unit 1045 is configured to control the imaging device 100. The control unit 1045 gives an instruction and imaging parameters necessary for imaging of the OCT tomographic image, the anterior ocular segment image, and the fundus image by the imaging device 100. In another aspect, the imaging control unit provides instructions regarding optical head position, OCT scan position and OCT focus, coherence gate position, and the like. The optical head position means a relative position between the optical head and the eye so that the OCT sampling bean can scan the fundus of the eye. The OCT scan position means the position of the fundus of the subject where the OCT is to be scanned. OCT focus means the focus of OCT such that the OCT tomographic image has sufficient contrast. The coherence gate position means a position where the difference between the optical path of the reference light and the optical path of the sampling light is zero.

  The control unit 1045 can be in one of the following imaging states: an anterior segment alignment state, an OCT preview state, or an OCT measurement state.

  The display unit 105 is configured to show a user (not shown) an image (anterior eye image, fundus image, and tomographic image) acquired from the GUI and the OCT image forming unit 1031. The layout of the GUI and the position of the image indicated by the display unit 105 are controlled by the display control unit 1041.

  The following processing steps are performed by the imaging apparatus according to the exemplary embodiment in order to perform anterior ocular segment alignment. Anterior segment alignment is adjusting the position of the optical head 102 by controlling the stage unit 102 to enable the projection of an OCT measurement beam onto the fundus of the eye. The processing flow will be described with reference to FIG. FIG. 5 shows an example of a GUI 500 displayed to the user by the display unit 105.

  The OCT image forming unit 1031 acquires an anterior eye image of the subject's eye from the OCT imaging unit, transmits the anterior eye image to the display control unit 1041, and the display control unit 1041 displays the image on the display unit 105. By doing so, the anterior eye part image 501 is shown to the user (not shown). The display control unit 1041 displays the XY stage icon 502 and the Z stage icon 503 on the display unit 105, and these icons are used to indicate the movement control of the stage unit 102. The pointer device 107 detects the movement of the mouse, and further detects whether the left or right button has been pressed (clicked). Next, the display control unit 1041 determines whether or not the user has moved the cursor over the icon and left-clicked the icon. The up arrow / down arrow of the XY stage icon 502 is for moving the Y stage up and down. The left arrow / right arrow of the XY stage icon 502 is for moving the X stage left and right. The left arrow / right arrow of the Z stage icon 503 is for moving the Z stage back and forth. When the display control unit 1041 detects that the user has left-clicked the icon, the display control unit 1041 transmits a corresponding command to the control unit 1045 to move the XYZ stage. Also, instead of using the icons, the user can control the movement of the stage unit 102 by left clicking on the anterior eye image or using the wheel when the cursor is over the anterior eye image. . When the user left-clicks on the anterior eye image, the display control unit 1041 calculates the amount of movement and sends it to the XYZ stage to bring the clicked position to the center of the anterior eye image.

  In one embodiment, the automatic anterior segment alignment may be started by analyzing the pupil of the subject's eye in the anterior segment image 501 in response to the selection of the alignment start icon 512.

  The following flow is executed by the imaging apparatus according to the exemplary embodiment in order to adjust the focus of the fundus image and the OCT tomographic image. The processing flow will be described with reference to FIG.

  The OCT image forming unit 1031 obtains a fundus image of the subject's eye from the OCT imaging unit, transmits the fundus image to the display control unit 1041, and the display control unit 1041 displays the image on the display unit 105. A fundus image 504 is shown to a user (not shown). Further, the display control unit 1041 displays a focus icon 505 on the display unit 105, and these icons are used to indicate movement control of the focus of the fundus camera. The pointer device 107 detects the movement of the mouse, and the display control unit 1041 determines whether the user has moved the cursor over the icon and left-clicked the icon. The left and right arrows on the focus icon 505 can move the fundus focus to a closer or more distant point. When the display control unit 1041 detects that the user left-clicks the icon, the display control unit 1041 transmits a corresponding command to the control unit 1045 in order to move the focus of the fundus camera. The user can change the focus position by observing the fundus image 504 and left-clicking the focus icon 505 as necessary to determine whether the image is in focus. Also, instead of using icons, the user may control the movement of the focus of the fundus camera by using the wheel when the cursor is over the anterior segment image. After each adjustment by the user, the value of the focus of the fundus camera is further provided to the OCT focus lens 335-5 to adjust the focus of the OCT measurement beam to the same point as the focus of the fundus camera.

  The following steps are executed by the exemplary imaging apparatus according to the present embodiment in order to adjust the position of the OCT reference mirror for coherence gate adjustment and to adjust the scan position of the OCT tomographic image. The processing flow will be described with reference to FIG.

  The OCT image forming unit 1031 acquires an OCT tomographic image of the subject's eye from the OCT imaging unit, transmits the OCT tomographic image to the display control unit 1041, and the display control unit 1041 displays the image on the display unit 105. Indicate a vertical tomographic image 506 and a horizontal tomographic image 507 to a user (not shown). The display control unit 1041 displays a coherence gate (CG) icon 508 on the display unit 105, and these icons are used to indicate the movement control of the reference mirror 332-4. The pointer device 107 detects the movement of the mouse, and the display control unit 1041 determines whether the user has moved the cursor over the icon and left-clicked the icon. The up / down arrows of the CG icon 508 allow the position of the OCT reference mirror to be moved such that the reference beam path can be longer or shorter than the measurement beam path. When detecting that the user left-clicks on the icon, the display control unit 1041 transmits a corresponding command to the control unit 1045 to move the position of the reference mirror. The user observes the vertical tomographic image 506 and the horizontal tomographic image 507 to determine whether the tomographic image of the fundus of the eye to be examined is in the image, and left-clicks the CG icon 508 as necessary. , The position of the reference mirror can be changed. Also, instead of using icons, the user may control the movement of the reference mirror by using the wheel when the cursor is over the anterior segment image.

  The display control unit 1041 detects whether the user has moved the cursor over the OCT scan position mark 509. When the user left-clicks on the OCT scan position mark 509 and drags it onto the fundus image 504, the display control unit 1041 calculates the position of the final position of the OCT scan position mark 509 on the fundus image 504. Next, the display control unit 1041 transmits these pieces of information to the control unit 1045, and the control unit 1045 converts information from the display control unit 1041 in order to control information for the OCT XY scanner 334. Next, the OCT XY scanner 334 moves the OCT scanner to execute scanning of the OCT tomographic image at the position of the fundus of the subject's eye, that is, according to the position of the OCT scan position mark 509 on the fundus image 504. Let it.

  The GUI displayed in one embodiment is shown in FIGS. 6A and 6B. In the GUI of FIG. 6A, when the anterior segment alignment has not been completed, the area displaying the fundus image 504 and the tomographic images 506 and 507 may be white, and the icons 505, 508, 510, and 511 It may be invalidated by the display control unit 1041. The anterior eye image 501, the icons 502 and 503, and the icon 512 may be enabled by the display control unit 1041. As a result, only the image or the icon related to the anterior ocular segment alignment is made valid, whereby the preparation status of the OCT imaging apparatus is notified to the operator.

  As shown in FIG. 6B, upon completion of the alignment, the areas of images 504, 506, and 607, all related to OCT preview imaging, and icons 505, 508, and 510 are changed to a valid state. Thereby, the operator is notified that the focus adjustment of the SLO imaging light and the OCT imaging light is necessary for the preview imaging.

  In this status, the area of the anterior segment image 501 and the icons 502 and 503 may still be valid. This is because the relative position between the subject's eye and the optical head 101 may be changed, and further alignment is required to perform appropriate imaging before starting the OCT measurement.

  The steps of the interactive control of the imaging device 100 according to one embodiment will be described with reference to the flowchart of FIG.

  In step S701, the imaging system 100 is initialized by each central processing unit (CPU) of the device. The control unit 1045 initializes the shooting state or the preparation status to the anterior ocular segment alignment state. In one embodiment, this initialization may be triggered by pressing a power switch of the imaging device 100 or the interactive control device 104. When a power switch of one device is pressed, a trigger signal for one device and the other device is generated, and both devices are initialized. This shortens the preparation time before starting medical imaging.

  In step S702, the display control unit 1041 displays a GUI as shown in FIG. 5 or 6A.

  In step S703, the click detection unit 1042 determines whether the click detection unit 1042 has detected a click on the second button 1072.

  In step S704 executed when the click of the second button 1072 is detected, the determination unit 204 outputs an instruction signal, and the status acquisition unit 1044 acquires current preparation status information from the imaging device 100. In one embodiment, the status acquisition unit 1044 continuously receives preparation status information from the imaging device 100 in response to a change in the current preparation status. The preparation status may be stored in the memory 202 or may be displayed by the display control unit 1041 in response to receiving the preparation status. Thereby, the current status of the preparation status is notified to the operator.

  In step S705, the control unit 1045 generates a signal for instructing to execute an operation step according to the status. Further details of this step will be described below with reference to FIG.

  In step S706, the click detection unit 1042 determines whether the click detection unit 1042 has detected a click on the first button 1071. In one embodiment, the order of the steps S703 and S706 may be interchangeable. Alternatively, step S703 and step S706 may be integrated into one step.

  In step S707, which is performed when a click on the first button 1071 is detected, the interpretation unit 205 determines based on the current position of the cursor and the GUI data 202 (both of which are stored in the memory 203). To determine the icon or image under the virtual pointer.

  In step S708, the control unit 1045 instructs to execute an operation step according to the position of the pointer displayed on the display unit 105 and the GUI data.

  In step S709, the CPU of the interactive control unit 104 determines whether a completion signal indicating completion of imaging of the subject's eye is detected. When a completion signal is detected according to the selection of the end icon 508, a process of imaging the eye to be inspected is detected. If no completion signal is detected, the process of step S703 is performed again. In one embodiment, the completion signal, the first instruction signal and the second instruction signal corresponding to the first button 1071 and the second button 1072 are continuous and parallel. The order of some of the steps may be changed.

  The process in step S705 will be described with reference to the flowchart in FIG. The following processing flow is executed by the exemplary imaging apparatus according to the present embodiment in order to control the transition of the shooting state. The processing flow will be described with reference to FIG. FIG. 5 is used as a reference to show an example of the GUI 500 during execution of the processing flow.

  In step S801, the process is initialized by the control unit 1045.

  In step S802, the control unit 1045 checks whether the imaging state is the anterior ocular segment alignment state. If the shooting state is different from the anterior ocular segment alignment state, the process proceeds to step S804. If the shooting state is the anterior ocular segment alignment state, the process proceeds to step S803.

  In step S803, this exemplary embodiment of the imaging device performs processing performed during the anterior segment alignment state. In the anterior segment alignment state, only the adjustment of the position of the optical head 101 by controlling the stage unit 102 is permitted as described above. During the anterior ocular segment alignment state, the control unit 1045 cannot instruct the photographing of a fundus image and cannot photograph an OCT image. In addition, the display control unit 1041 disables the icons related to the adjustment, thereby preventing the adjustment of the focus of the fundus image, the adjustment of the reference mirror position, and the adjustment of the scan position of the OCT tomographic image. In step S803, the preview start icon 510 is enabled, and the measurement start icon 511 is disabled. When the interpretation unit 205 detects that the preview start icon 510 has been left-clicked, the control unit 1045 changes the imaging state to the OCT preview state. Further, in step S803, when the click detection unit 1042 detects that the user has right-clicked the mouse while the cursor is on the GUI 500, the control unit 1045 changes the shooting state to the OCT preview state.

  In step S804, the control unit 1045 checks whether the imaging state is in the OCT preview state. If the shooting state is different from the preview state, the process proceeds to step S806. If the shooting state is the OCT preview state, the process proceeds to step S805.

  In step S805, this exemplary embodiment of the imaging device performs processing performed during the preview state. In the preview state, the adjustment of the position of the optical head 101 by controlling the stage unit 102 is permitted as described above. During the preview state, the control unit 1045 instructs to execute the photographing of the fundus image and the photographing of the OCT image. Further, as described above, the display control unit 1041 permits the adjustment of the focus of the fundus image, the adjustment of the position of the reference mirror, and the adjustment of the scan position of the OCT tomographic image by enabling the icons related to the adjustment. I do.

  In the preview state, the preview start icon 510 is changed to a preview stop icon (not shown), and the measurement start icon 511 is activated. When the interpretation unit 205 detects that the preview stop icon has been left-clicked, the control unit 1045 changes the shooting state to the anterior ocular segment alignment state. When the interpretation unit 205 detects that the measurement start icon 511 has been left-clicked, the control unit 1045 changes the imaging state to the OCT measurement state. Further, in step S805, when the click detection unit 1042 detects that the user has right-clicked the mouse while the cursor is on the GUI 500, the control unit 1045 changes the imaging state to the OCT measurement state.

  In another embodiment of the imaging device, in step S805, the display control unit 1045 instructs to execute automatic anterior segment alignment, automatic adjustment of the focus of the fundus image, and automatic adjustment of the position of the reference mirror. These automatic functions are executed immediately after the photographing state is changed to the OCT preview state.

  Automatic anterior segment alignment may be performed as follows. That is, the display control unit 1041 first obtains an anterior segment image of the subject's eye, and then acquires an image of the anterior segment image to recognize the position of the center of the pupil of the subject's eye in the anterior segment image. Execute the process. Next, the display control unit 1041 transmits the pupil position information to the control unit 1045. Next, the control unit 1045 calculates the amount of movement of the XY stage corresponding to the difference between the position of the pupil and the center of the anterior ocular segment image. The Z stage can be adjusted by analyzing the focus state of the anterior ocular segment image. Next, the control unit 1045 moves the Z stage so that the anterior ocular segment image becomes clear. Next, the amount calculated for the XYZ movement is transmitted to the stage unit 102, and the stage unit 102 moves the position of the optical head 101 accordingly.

  The automatic focusing of the fundus image may be performed as follows. That is, the display control unit 1041 first obtains a fundus image of the subject's eye, and then performs image processing on the image to calculate the contrast of the image. Next, the display control unit 1041 sends a command to the control unit 1045 to move the focal position of the SLO image forming unit 1032. After the movement, the display control unit 1041 acquires another fundus image of the eye to be inspected, and then calculates the contrast of this image. This cycle of "moving the focus and calculating the contrast of the fundus image" is performed until the contrast value is higher than a predetermined threshold. When this cycle is completed, the value information of the focus of the fundus image is transmitted to the OCT focus mechanism, and the position of the OCT focus is set accordingly.

  Automatic adjustment of the OCT reference mirror (coherence gate) may be performed as follows. That is, the display control unit 1041 first obtains an OCT tomographic image of the subject's eye, and then executes image processing of this image to check whether an image of the retina has been obtained. Next, the display control unit 1041 transmits a command to the control unit 1045 to move the position of the reference mirror of the reference mirror 332-4. After the movement, the display control unit 1041 acquires another OCT tomographic image of the subject's eye, and then checks whether or not an image of the retina has been acquired. This cycle of “moving the reference mirror and checking whether a retinal image has been acquired” is performed until a retinal image is acquired.

  The automatic function is executed in the order of anterior segment alignment, focus adjustment, and reference mirror position adjustment. In addition, these automatic functions may be executed an arbitrary number of times in step S805 when the display control unit 1041 detects an input from a user for executing these automatic functions.

  In step S806, the control unit 1045 checks whether the imaging state is in the OCT measurement state. If the imaging state is different from the OCT measurement state, the processing proceeds to step S808. If the imaging state is the OCT measurement state, the process proceeds to step S807.

  In step S807, this exemplary embodiment of the imaging device performs processing performed during the OCT measurement state. In the OCT measurement state, the control unit 1045 transmits a command to the imaging apparatus 100 in order to continuously scan the fundus region of the subject's eye and obtain a set of OCT tomographic images. When the imaging apparatus 100 completes the imaging of the OCT tomographic image, the control unit 1045 changes the imaging state to the anterior ocular segment alignment state.

  In the OCT measurement state, the display control unit 1041 adjusts the position of the optical head 101, adjusts the focus of the fundus image, adjusts the position of the reference mirror, and adjusts the scan position of the OCT tomographic image, as described above. Do not allow. In another exemplary embodiment, the control unit 1045 sends a command to the OCT scanner driver to change the scan position of the OCT tomogram for the purpose of compensating for fundus movement of the subject's eye.

  In the OCT measurement state, the preview stop icon is invalidated, and the measurement start icon 511 is changed to a measurement stop icon (not shown). When the interpretation unit 1042 detects that the measurement stop icon has been left-clicked using the mouse, the control unit 1045 changes the imaging state to the anterior ocular segment alignment state, and the control unit 1045 transmits the OCT tomographic image. A command is transmitted to the imaging device 100 to stop shooting. In another exemplary embodiment of the imaging device, in step S805, when the click detection unit 1042 detects that the user has right-clicked the mouse while the cursor is on the GUI 500, the control unit 1045 may perform the following operations. Then, the control unit 1045 changes the imaging state to the anterior ocular segment alignment state, and transmits a command to the imaging apparatus 100 to stop imaging of the OCT tomographic image.

  In step S808, the control unit 1045 checks whether the shooting state is the end state. When the interpretation unit 1042 detects a left click on the end CG icon 508 in any other shooting state, the control unit 1045 sets the shooting state to the end state. If the shooting state is the end state, the processing flow of this exemplary embodiment of the imaging device is completed. When the shooting state is different from the end state, the display control unit 1045 may show a message or notify an error.

  In another exemplary embodiment of the imaging device, a mouse with one button is used, a left click performed by a mouse with two buttons can be replaced with a single click, and a right click can be replaced with a double click. Can be replaced with a click.

  In another exemplary embodiment of the imaging device, instead of a left / right click of a mouse with two buttons, keys on a keyboard may be used as well.

  Hereinafter, another embodiment of the present invention will be described with reference to FIG. In the above exemplary embodiment, the processing performed after the detection of the right mouse click is changed depending on the state of the shooting state. According to this exemplary embodiment, the user does not need to move the cursor to the icon to change the shooting state. The user can move to the next shooting state very quickly just by clicking the right mouse button immediately after adjusting the anterior segment alignment, focus, or coherence gate.

  In the above exemplary embodiment, while the user can change the shooting state very quickly, the user also mistakenly uses the right-click to change the shooting state when he does not want to. Could be

  In this alternative exemplary embodiment, the display control unit 1041 provides some areas of the GUI 500 where a right mouse click is enabled or disabled.

  The functional block diagram relating to the present exemplary embodiment is substantially the same as the first exemplary embodiment, and thus the description is omitted.

  In this exemplary embodiment, the control unit 1045 may, for example, move the cursor over an anterior eye image 501, a fundus image 504, a vertical or horizontal tomographic image 506, an XY stage icon 502, and a Z stage icon 503. When the mouse is on the upper side, the right click of the mouse is not recognized in the area of the GUI where the left click is recognized. In other words, the control unit 1045 does not execute the change regarding the shooting state in the above situation.

  In another exemplary embodiment, the display control unit 1041 has provided some larger areas on the GUI 500 where a right mouse click is enabled or disabled. In FIG. 9, in this another exemplary embodiment, the control unit 1045 performs a right mouse click when the cursor is in an area of the GUI 500, such as areas 901-906, an interior area surrounded by a dotted line. Do not recognize In other words, the control unit 1045 does not change the shooting state when the cursor is in the internal area surrounded by the dotted line.

  In the present exemplary embodiment, the processing performed after the detection of the right mouse click is changed according to the state of the shooting state. However, the processing is performed when the cursor is within these areas in the GUI area. Since there is an area in which the right click is not accepted, the possibility that the user unintentionally changes the shooting state is reduced.

  Hereinafter, still another embodiment of the present invention will be described with reference to FIG. In the above exemplary embodiment above, the user can change the shooting state very quickly, but the user needs to use the left and right buttons of the mouse, or To perform the corresponding single-click or double-click. In another exemplary embodiment, the display control unit 1041 has added a pop-up icon near an area where the mouse may be used to adjust the OCT imaging.

  The functional block diagram related to the present exemplary embodiment is the same as that of the first exemplary embodiment, and thus the description is omitted.

  Referring to the GUI 500 shown in FIG. 10, in this exemplary embodiment, the display control unit 1041 has added a pop-up icon near an area where a left mouse click may be used. For example, when the cursor is on the anterior eye image 501, the pop-up icon 1009 is shown at a position near the anterior eye image 501. In another exemplary embodiment, pop-up icon 1009 may be shown in anterior eye image 501. The interpretation unit 1042 detects whether the mouse is clicked while the cursor is on the pop-up icon 1009. When the interpretation unit 1042 detects this mouse click, the control unit 1045 changes the shooting state to the next state, and further changes the function of the pop-up icon.

  In the above exemplary embodiment, the same mouse button can be used to adjust the capture of the OCT tomogram and also to change the state of the capture state.

  Another embodiment of the present invention will be described with reference to FIG. In this embodiment, the interactive control device 104 reads a program recorded in a memory device to execute the functions of the above-described embodiments, and executes the program by a computer (or a device such as a CPU or MPU) of a system or a device that executes the program. And the method, wherein the steps are performed by a computer of the system or apparatus, for example, by reading and executing a program stored in a memory device to perform the functions of the above-described embodiments. Depending on the method, it may be similarly realized.

  The interactive control device according to the present embodiment includes a central processing unit (CPU) 1101, a memory, a random access memory (RAM) 1103, a read-only memory 1104, and an interface unit for communication with the imaging device 100. (I / F) 1105, a universal serial bus port or PS / 2 port for connection with the pointer device 107, and a digital video interface 1107 for connection with the display unit 105, all of which are included. , Are connected by an internal bus 1108.

  The memory 1102 may store GUI data 1151 including GUI image data and GUI position data. Further, as described above, the memory may store a software program module in order to realize an embodiment of the present invention. The memory stores a click detection module 1152, a display control module 1153, a position acquisition module 1154, a determination module 1155, a status information acquisition module 1156, and a signal generation module for controlling the imaging device 100. It may be.

  The modules are read and executed by the CPU 1101 to execute the steps of the present embodiment, for example, the steps shown in FIGS. 7 and 8. Modules 1152 to 1157 may function as units 1042, 1041, 1043, and 205, 204, 1044, and 1045, respectively, as described with reference to FIG.

  An interface unit (I / F) 1105 includes two wired camera link interface units for transmitting a captured image to the interactive control device, and a control signal from the interactive control device and a preparation status signal from the imaging device. And a universal serial bus port. The I / F 1105 may include an interface unit for transmitting a signal for synchronous serial communication for transmitting and receiving a plurality of frames of an image.

  For this purpose, the program is provided to the computer via, for example, a network or from various types of recording media functioning as a memory device (for example, a computer-readable medium).

  While the invention has been described with reference to exemplary embodiments, it should be understood that the invention is not limited to the disclosed exemplary embodiments. The following claims should be most broadly construed to cover all modifications, equivalent structures, and functions.

REFERENCE SIGNS LIST 100 imaging device 101 optical head 102 stage unit 104 interactive control device 105 display unit 107 pointer device 1041 display control unit 1042 click detection unit 1043 position detection unit 1044 status acquisition unit 1045 control unit 204 determination unit 341 SLO focus lens 335-5 OCT focus Lens 332-4 Reference mirror

The present disclosure relates to an imaging system and a control method thereof .

An imaging system according to the present invention, which will be described below, includes an input unit configured to output a first instruction signal and a second instruction signal , has a plurality of photographing states, and includes one of the plurality of photographing states. an imaging system in the One state, based on the measuring light returning light applied to the subject, wherein the OCT imaging means for capturing a tomographic image of the subject, icons selected by the input means , and the the Viewing control means that displays on a display unit a graphical user interface having an icon operation is associated to adjust the elements of the imaging means, the signal output from said input means, said either a first indication signal, and the second indication signal and detection means that detect whether, when detecting the first indication signal, selected by the first instruction signal the detected Aiko The adjustment of one element in accordance with, the OCT instructs the imaging means, and, when detecting the second indication signal, based on the shooting condition when the second instruction signal is detected, said the shooting state, and a following to change to the shooting state control means.

The imaging system comprises an input means for outputting to the first indication signal and the second indication signal has a plurality of imaging conditions, an imaging system in one photographing states of the plurality of shooting conditions , based on the measurement light returning light applied to the subject, and the OCT imaging means for capturing a tomographic image of the subject, and Viewing the control unit that displays a graphical user interface on the display unit, the first detection of the output of the first indication signal and the second command signal, as well as detection that detect the selected icon on the graphical user interface when the output of the first instruction signal is detected and means, triggered by the output of said first indication signal from the previous SL input means, corresponding to said selected icon in the graphical user interface The operation for adjusting the one element, executes a first control to instruct the OCT imaging means, or triggered by the output of the second instruction signal from the pointer device, the second indication signal There photographing state when it is detected, Ru and a control means for executing a second control for changing to the next photographing condition.

According to this imaging system , a specific operation of advancing the current imaging state of the imaging system to the next imaging state can be started in response to the second instruction signal from the input unit .

Claims (5)

An interactive control device for an OCT imaging device connected to a pointer device configured to output two types of instruction signals, the device having a plurality of imaging states and being in one of the plurality of imaging states. An interactive control device,
A display control unit configured to display on a display unit a graphical user interface having an icon selected by a virtual pointer controlled by the pointer device;
A detection unit configured to detect a first indication signal of the pointer device for selecting an icon below the virtual pointer, and to detect a second indication signal of the pointer device;
In response to the detection of the first instruction signal, an icon corresponding to an icon selected by the detected first instruction signal from icons selectable in a shooting state when the first instruction signal is detected. An operation to adjust one element is instructed to the OCT imaging apparatus, and in response to the detection of the second instruction signal, based on a photographing state when the second instruction signal is detected. And a control unit configured to change the photographing state to the next photographing state. The imaging state includes at least an anterior ocular segment alignment state and an OCT preview state,
In the case where the photographing state is not completed in the anterior segment alignment state, the control unit may perform alignment when the second instruction signal is detected in response to the detection of the second instruction signal. Is configured to instruct the OCT imaging apparatus to perform an automatic alignment operation for automatically performing
The control unit changes the imaging state to the OCT preview state in response to detection of the second instruction signal when the alignment is completed in the imaging state in the anterior segment alignment state. It is configured,
The interactive control device according to claim 1, wherein: An interactive control device for an OCT imaging device having a plurality of imaging states and being in one of the plurality of imaging states, and connected to a pointer device,
A display control unit configured to display a graphical user interface on the display unit;
A detection unit configured to detect the output of the first instruction signal and the second instruction signal, and the position of the virtual pointer on the graphical user interface;
And a control unit,
The control unit comprises:
Triggered by the output of the first indication signal from the pointer device to adjust one element corresponding to the graphical user interface and an icon of the graphical user interface according to the detected position. Performing a first control for instructing the OCT imaging apparatus to perform an operation, or capturing an image when the second instruction signal is detected by being triggered by the output of the second instruction signal from the pointer device An interactive control device configured to execute a second control for changing a state to a next photographing state. A determination unit configured to determine whether to execute the first control or the second control in response to the first instruction signal or the second instruction signal output from the pointer device; The interactive control device according to claim 3, further comprising: A memory for storing an adjustment status indicating an adjustment state of each element of the OCT imaging apparatus;
The control unit, in response to the detection of the second instruction signal, when the imaging state is the OCT preview state and the OCT preview has not been started, an element whose adjustment has not been completed is stored in a memory in advance. The OCT imaging apparatus is instructed to make adjustments in the order stored, or when the imaging state is the OCT preview state and the OCT preview has been started, the OCT preview state is changed. 3. The interactive control device according to claim 2, wherein the OCT imaging device is changed to an OCT measurement state in which the OCT imaging device starts OCT imaging.

Images