JP6507528B2 - Ophthalmic device - Google Patents

Description

The present disclosure relates to an ophthalmic apparatus for obtaining ocular information of the eye.

  In order to remove unnecessary image information included in the light reception image obtained by imaging the subject's eye, an unnecessary area of the light reception image is subjected to an electronic masking process called an electronic mask to obtain a diagnostic image (composite image) An ophthalmologic apparatus is known (see, for example, Patent Document 1).

JP-A-9-206278

  However, even if electronic mask processing is performed with respect to the center of the received light image, the received light image in which the shooting optical axis is formed at a position (coordinates) different from the center of the image is uneven with respect to the shooting optical axis. An electronic mask is performed. For example, the composite image on one side with respect to the photographing optical axis may be masked in the unnecessary region, but the composite image in the other side may not be masked in the unnecessary region. In addition, when performing image processing or analysis on a composite image, there is a possibility that image processing or analysis asymmetric with respect to the imaging optical axis may be performed. In addition, simply by masking unnecessary areas of the received light image, comparison between photographed images taken by different ophthalmologic apparatuses, or even between the same ophthalmologic apparatus, comparison between photographed images taken using different optical systems There was a possibility that it could not be done suitably.

  The present disclosure makes it a technical subject to solve at least one subject of the prior art.

In order to solve the above-mentioned subject, the present invention is characterized by having the following composition.
(1) An ophthalmologic apparatus which combines a mask image with a received light image and outputs a composite image, an imaging unit for obtaining the received light image of the subject's eye with an imaging device via an optical system, and a center of the received light image And a mask combining means for combining the mask image with the received light image in consideration of the shift between the optical system of the optical system and the optical axis of the optical system, and the shift being taken into account. Storage means for storing information on coordinates for combining the mask image with the received light image as reference position information specific to each apparatus , the mask combining means using the reference position information to set the center of the mask image to the It is characterized in that the composite image is generated in which the displacement occurring at the time of the assembly is considered so as to be the optical axis .

It is an external appearance block diagram of an ophthalmologic apparatus. It is a schematic block diagram of the optical system and control system which are accommodated in an imaging | photography part. It is a flowchart explaining combination of a light receiving image and a mask image. It is explanatory drawing of a light reception image. It is explanatory drawing of a mask image. It is explanatory drawing of a synthetic | combination image. It is a figure used for description of the flowchart of FIG. It is a flowchart explaining the manufacturing method of an ophthalmologic apparatus. It is a figure of the chart which the jig | tool A uses. It is a figure of the manufacturing method of an ophthalmologic apparatus, and is explanatory drawing in which a fundus imaging optical system is related. It is a figure of the manufacturing method of an ophthalmologic apparatus, and is explanatory drawing in which a fundus imaging optical system is related. It is a figure of the manufacturing method of an ophthalmologic apparatus, and is explanatory drawing in which an OCT optical system is related. It is a figure of the manufacturing method of an ophthalmologic apparatus, and is explanatory drawing in which a fundus observation optical system is related.

  Hereinafter, exemplary embodiments of the present disclosure will be described with reference to the drawings. FIG. 1 is an external view of an ophthalmologic apparatus 100 according to the present embodiment. The ophthalmologic apparatus 100 includes a base 1, an XY sliding mechanism 2, a Y drive unit 6, an imaging unit 3, a monitor 8, an operation member 4, and a face support unit 5.

  The XY sliding mechanism 2 is movable in the left-right direction (X direction) and the front-rear direction (Z direction) with respect to the base 1 by the examiner operating the operation member 4. The Y drive unit 6 is movable in the vertical direction (Y direction) with respect to the base 1 by the examiner operating the rotation knob 4 a of the operation member 4. The imaging unit 3 accommodates an optical system including a fundus imaging optical system 10 described later. The monitor 8 is a display unit that displays the image information of the subject's eye E acquired by the imaging unit 3 and various settings of the ophthalmologic apparatus 100.

  The operation member 4 is an operation means for moving the imaging unit 3 in the XYZ directions with respect to the subject's eye E. The operation member 4 includes a rotation knob 4a and a photographing switch 4b. The operation member 4 is a rod-like member extending in the direction away from the XY sliding mechanism 2. The operation member 4 may be called a joystick. The rotation knob 4 a is provided on the side surface of the operation member 4. The photographing switch 4 b is provided at the upper end of the operation member 4. The face support unit 5 is fixed to the base 1 and supports the subject's face.

  FIG. 2 is a schematic configuration diagram of an optical system and a control system accommodated in the imaging unit 3. The imaging unit 3 includes a fundus imaging optical system 10 (first imaging optical system), a fundus observation optical system 20 (second imaging optical system), an anterior segment observation optical system 30 (third imaging optical system), and a fundus illumination optical system. 40 (first projection optical system), anterior eye illumination optical system 50 (second projection optical system), and OCT optical system 60.

  The fundus imaging optical system 10 is an optical system for imaging the fundus Er of the subject's eye E with a still image or a moving image. When the operation member 4 is operated to separate the imaging unit 3 and the subject's eye E by a distance larger than when imaging the fundus Er, the fundus imaging optical system 10 is used to front the subject's eye E. It is also possible to shoot the eye Ec. The fundus oculi observation optical system 20 is an optical system for imaging the fundus oculi Er of the subject's eye E with a moving image. The anterior eye observation optical system 30 is an optical system for imaging the anterior eye Ec of the subject's eye E as a moving image.

  The fundus illumination optical system 40 is an optical system for illuminating the fundus Er of the subject's eye E. The anterior eye illumination optical system 50 is an optical system for illuminating the anterior eye Ec of the subject's eye E. The OCT optical system 60 is an optical system for capturing at least a tomographic image of the fundus Er or the anterior segment Ec of the subject's eye E. The OCT optical system 60 is used as an example of an imaging unit that obtains a light receiving image of the subject's eye E with a light receiving element via the optical system. The OCT optical system 60 has an OCT unit 61, for example. The OCT unit 61 includes an interferometer that causes the measurement light from the OCT light source (which is irradiated to the eye to be examined) to interfere with the reference light, and a light receiving element for receiving the interference between the measurement light and the reference light (for example, a line sensor , APD etc.). The principle of the OCT unit 61 is not particularly limited, and may be SD-OCT, SS-OCT, or TD-OCT. The OCT unit 61 uses the optical axis L3. The OCT unit 61 shares the objective lens 11 with the fundus imaging optical system 10, the fundus observation optical system 20, and the anterior segment observation optical system 30.

  <Fundus imaging optical system> The fundus imaging optical system 10 is used as an example of an imaging unit that obtains a light reception image of the subject's eye E with the imaging element 16 via the optical system. The fundus imaging optical system 10 includes, for example, an objective lens 11, a perforated mirror 12, an imaging diaphragm 13, a focusing lens 14, an imaging lens 15, and an imaging element 16. The fundus imaging optical system 10 uses an optical axis L1. The objective lens 11 is disposed in front of the subject's eye E. The imaging diaphragm 13 is disposed at a position substantially conjugate to the pupil Ep of the subject's eye E via the objective lens 11. The focusing lens 14 is movable in the axial direction of an optical axis (an optical axis L1 and an optical axis L2 described later). The flip-up mirror 21 described later is an optical path branching member for sharing a part of the optical path between the fundus imaging optical system 10 and the fundus observation optical system 20. The flip-up mirror 21 is retracted from the optical path of the fundus imaging optical system 10 by the insertion and removal mechanism 321 when imaging is performed by the imaging element 16. The dichroic mirror 31 is retracted out of the optical path of the fundus imaging optical system 10 by the insertion and removal mechanism 331 at the time of imaging using the fundus imaging optical system 10.

  The imaging device 16 is a two-dimensional imaging device. The fundus imaging optical system 10 and the fundus illumination optical system 40 described later are used as an example of a color fundus imaging means for imaging the fundus Er of the subject's eye E with visible light. It is done. When assembling the ophthalmologic apparatus 100, the color fundus imaging means images the subject with a moving image and a still image, and when using the ophthalmologic apparatus 100, the color fundus imaging means images the subject eye E with a still image . A charge coupled device (CCD) image sensor, a complementary metal oxide semiconductor (CMOS) image sensor, or the like may be used as the image sensor 16, the image sensor 24, and the image sensor 36. The imaging device 16 is a single-plate image sensor. The imaging element 16 uses a Bayer-arranged color filter to perform color photographing. The light receiving element (light receiving means) used as the color imaging means is not limited to this, and may be, for example, a three-plate light receiving means using three image sensors.

  The imaging element 16 is also connected to a pre-image processing unit 312 that generates a light reception image. The pre-image processing unit 312 is also a computer that processes the output signal of the imaging device 16. The image pickup device 16 and the pre-image processing unit 312 are integrated to form a photographing camera unit 313. The photographing camera unit 313 is included in the inside of the ophthalmologic apparatus 100. A processor (computer) specialized for generating a two-dimensional image is used in the pre-image processing unit 312. By using a processor specialized for generating a two-dimensional image, the imaging camera unit 313 can generate a light reception image in a shorter time than the generation of the light reception image by the control unit 391. Therefore, the composite image can be presented to the examiner immediately after shooting. The signal processing until the light reception image is generated is performed by the pre-image processing unit 312, and the control unit 391 performs only the mask composition, thereby reducing the load of the signal processing of the control unit 391 Can be reduced. The photographing camera unit 313 has a non-volatile memory as a storage unit. In the storage means, the optical adjustment value of the photographing camera unit 313 is stored. A color adjustment coefficient or a gradation conversion coefficient can be considered as an example of the optical adjustment value. When the photographing camera unit 313 has storage means, for example, replacement of the photographing camera unit 313 becomes easy.

  <Fundus observation optical system> The fundus observation optical system 20 is used as an example of an imaging unit that obtains a light reception image of the subject's eye E with the imaging device 24 via the optical system. The fundus observation optical system 20 shares, for example, an optical system from the objective lens 11 to the imaging lens 15 with the fundus imaging optical system 10. The fundus oculi observation optical system 20 includes a flip-up mirror 21, a mirror 22, a lens 23, and an imaging element 24. The fundus oculi observation optical system 20 uses an optical axis L2. When imaging is performed by the imaging device 38, the flip-up mirror 21 is inserted into the optical path of the fundus imaging optical system 10 by the insertion and removal mechanism 321. The imaging device 24 is a two-dimensional imaging device having sensitivity to at least infrared light. The fundus oculi photographing optical system 10 and a fundus illumination optical system 40 to be described later constitute a monochrome observation and imaging means for imaging the fundus Er of the subject's eye E with infrared light. During observation using the fundus observation optical system 20, the dichroic mirror 31 is inserted into the optical path of the fundus observation optical system 20. The mirror 22 is a dichroic mirror and is an optical path combining member. The light source 73, the light shielding plate 72, and the lens 71 form fixation target presenting means for guiding the line of sight of the subject's eye E. The mirror 22 transmits visible light corresponding to the wavelength of the light source 73 and reflects infrared light corresponding to the wavelength received by the imaging device 24.

  Anterior Eye Observation Optical System The anterior eye observation optical system 30 is used as an example of an imaging unit that obtains a light reception image of the subject's eye E with the imaging device 36 via the optical system. The anterior eye observation optical system 30 includes, for example, a dichroic mirror 31, a field lens 32, a dichroic mirror 33, a stop 34, a relay lens 35, and an imaging element 36. The anterior eye observation optical system 30 uses an optical axis L4. The dichroic mirror 31 reflects the light corresponding to the wavelength of the light source 51 received by the imaging element 36 and the light corresponding to the wavelengths projected and received by the OCT unit 61. The dichroic mirror 31 is connected to the insertion and removal mechanism 331. At the time of observation using the fundus observation optical system 20, the dichroic mirror 31 is inserted in the light path of the fundus observation optical system 20. The anterior eye observation optical system 30 and the anterior eye illumination optical system 50 form an anterior eye observation means for imaging the anterior eye Ec of the subject's eye E with infrared light. The dichroic mirror 33 is an optical path combining means. The dichroic mirror 33 reflects light corresponding to the wavelength of the light source 51 received by the imaging element 36 (reflected light of the subject's eye E), and light having a wavelength corresponding to light projected and received by the OCT unit 61 To Penetrate. The anterior eye illumination optical system 50 includes a light source 51. The light source 51 emits infrared light.

  <Fundus illumination optical system> The fundus illumination optical system 40 shares an optical system from the objective lens 11 to the perforated mirror 12 at least between the fundus imaging optical system 10 and the fundus observation optical system 20. The fundus illumination optical system 40 includes, for example, a relay lens 42, a black point plate 43, a mirror 44, a relay lens 45, a ring slit 46, and a dichroic prism 47. The black dot plate 43 has a black dot at the center. The light emitted from the light source 49 or the light source 83 is once imaged in a ring shape at the pupil Ep of the subject eye E by the ring slit 46. The light focused on the pupil Ep illuminates the fundus Er of the subject's eye E. The dichroic prism 47 combines the optical path for visible light projection (for color imaging) and the optical path for infrared light projection (for infrared observation). The fundus illumination optical system 40 includes a condenser lens 48 and a light source 49 as an optical path for visible light projection. The fundus illumination optical system 40 includes a condenser lens 81, an infrared filter 82, and a light source 83 as an optical path for projecting infrared light. A flash lamp or a light emitting diode (LED) may be used as the light source 49. A halogen lamp or an LED may be used as the light source 83. The infrared filter 82 may transmit near infrared light having a wavelength of 750 nm or more.

  Control System The pre-image processing unit 312, the imaging device 24, and the imaging device 36 are connected to the control unit 391. The monitor 8 is connected to the control unit 391. The control unit 391 controls the display content to be displayed on the monitor 8. In the present embodiment, the control unit 391 and the monitor 8 are used as display means. The control unit 391 is a display control unit. The control unit 391 includes a moving mechanism 311 for moving the focusing lens 14, an inserting and removing mechanism 331 for inserting and removing the dichroic mirror 31, an inserting and removing mechanism 321 for inserting and removing the bounce mirror 21, an output signal of the rotation knob 4a, and a photographing switch An output signal 4 b, a switch unit 392 having various switches, a memory 393 as a storage unit, an OCT unit 61, each light source and the like are connected. The control unit 391 has a computer function. The control unit 391 performs various controls of the ophthalmologic apparatus 100 and image processing. Programs related to various controls executed by the control unit 391 are stored in the memory 393. The memory 393 is used as an example of a storage unit. The memory 393 is a storage medium readable by the control unit 391 (computer) storing a program for causing a computer to execute the control method of the ophthalmologic apparatus 100.

  In the ophthalmologic apparatus 100, the pre-image processing unit 312 generates a light reception image, and the control unit 391 generates a composite image. The pre-image processing unit 312 is used as an example of a first image processing unit that performs signal processing using an output signal of the imaging device 16. The control unit 391 is used as an example of a second image processing unit that performs signal processing using an output signal of the first image processing unit. Here, the ophthalmologic apparatus 100 includes a configuration (mask combining unit) for combining the mask image with the received light image in consideration of the shift between the center of the received light image and the photographing optical axis. For example, the first image processing Means, second image processing means, and storage means (memory 393) are used (details will be described later). In the mask composition, the first image processing means and the second image processing means may be the same unit. For example, the photographing camera unit 313 may have a first image processing unit and a second image processing unit. A CPU (microprocessor), a DSP (digital signal processor), or a PLD (programmable logic device) may be used for the pre-image processing unit 312 or the control unit 391.

  The operation of the ophthalmologic apparatus 100 having the above-described configuration will be described. The examiner positions the subject's eye E in front of the objective lens 11 and performs alignment for photographing the fundus Er. First, the examiner performs rough alignment using the anterior eye observation optical system 30 while confirming the observation image (moving image) of the subject displayed on the monitor 8. After rough alignment is performed, precise alignment is performed using the fundus observation optical system 20. At the time of alignment, the observation image of the subject's eye E is displayed on the monitor 8 in black and white (achromatic color). The observation of the subject's eye E is performed with infrared light to suppress miosis of the subject's eye E.

  The examiner presses the imaging switch 4b when the alignment for imaging the fundus oculi Er is completed. When detecting that the photographing switch 4b is pressed, the control unit 391 turns on the light source 49. The light emitted from the light source 49 is projected onto the subject's eye E via the fundus illumination optical system 40. The projected light illuminates the fundus Er of the subject's eye E with visible light. The visible light reflected by the fundus Er is imaged on the imaging device 16 through the fundus imaging optical system 10. The pre-image processing unit 312 generates a light reception image (two-dimensional image) using the output signal of the imaging device 16. The light receiving image is a color image having chromatic color information. The pre-image processing unit 312 outputs the generated light reception image to the control unit 391. The control unit 391 performs masking processing on the received light image input from the pre-image processing unit 312 to generate a composite image (captured image). The control unit 391 displays (outputs) the composite image on the monitor 8.

  The control unit 391 may store (output) the composite image in the memory 393 according to the operation of the switch unit 392 operated by the examiner. The control unit 391 may print (output) the composite image using a printing unit such as a printer. The control unit 391 may transfer (output) the composite image to a PC (personal computer) connected to the ophthalmologic apparatus 100. The PC may display (output) the transferred composite image on the display means.

  FIG. 3 is a flowchart of signal processing performed by the ophthalmologic apparatus 100 of the present embodiment. The control unit 391 inputs a light reception image from the photographing camera unit 313 in step S101. Subsequently, in step S102, the control unit 391 reads mask image data stored in advance from the memory 393. Subsequently, in step S103, the control unit 391 generates a composite image obtained by combining the light reception image and the mask image. Subsequently, in step S104, the control unit 391 causes the monitor 8 to display (output) the composite image.

  Subsequently, signal processing (image processing) performed in step S103 of FIG. 3 will be described using FIGS. FIG. 4 is a diagram for explaining a light reception image. FIG. 5 is a diagram for explaining a mask image. FIG. 6 is a diagram for explaining a composite image. FIG. 7 is a diagram showing how a composite image is generated by the processing of the flowchart of FIG. 3.

  First, the received light image will be described with reference to FIG. The light reception image is a two-dimensional image (planar image) generated using the effective pixel area of the imaging device 16. The light reception image has a width Wa of 4000 pixels in the X direction (horizontal direction) and a height Ha of 3000 pixels in the Y direction (vertical direction). Each pixel of the received light image is composed of 8-bit (256 gradations) R / G / B data. The light reception image is a color still image, and is an image with an aspect ratio of 4: 3 (rectangle). The position (coordinates) indicated by PCa in FIG. 4 is the center position PCa that is the center of the received light image. The position (coordinates) indicated by PAa in FIG. 4 is an optical axis position PAa corresponding to the photographing optical axis of the received light image. Note that the position corresponding to the imaging optical axis is a position where the optical axis L1 of the fundus imaging optical system 10 passes on the imaging surface of the imaging element 16.

  The optical axis position PAa of the light reception image is located at a position separated from the center position PCa of the light reception image. More specifically, the optical axis position PAa is located at a position separated by Δx1 pixels in the X direction and Δy1 pixels in the y direction from the central position PCa of the light reception image. When manufacturing the ophthalmologic apparatus 100, it is preferable to assemble the imaging device 16 so that the center position PCa of the received light image and the optical axis position PAa coincide with each other. However, in order to match the center position PCa of the received light image with the optical axis position PAa, expensive parts and a precise assembly jig may be required. There may also be a need for a skilled assembly worker who can make precise adjustments. In addition, for example, when the imaging device 16 or the like breaks down at the use site of the ophthalmologic apparatus 100, an expensive repair cost may be required. Therefore, in the assembling process of the image pickup device 16, it is preferable to allow the separation between the center position PCa of the light reception image and the optical axis position PAa. For example, it is conceivable to provide an allowable width with reference to the center position PCa or the optical axis position PAa, and assemble the imaging element 16 into the imaging unit 3.

  The light reception image is composed of a region DTr and a region DTa. The area DTr is information originating in the outside (for example, an eye to be examined) of the ophthalmologic apparatus 100 captured by the imaging device 16. The area DTa is information resulting from the internal structure of the ophthalmologic apparatus 100 captured by the imaging device 16 (for example, an optical system accommodated in the imaging unit 3). In the light reception image, a region DTr is disposed at the central portion, and a region DTa is disposed around the region DTr. The region DTr includes imaging information of the fundus Er of the subject's eye E. Depending on the alignment state of the subject's eye E and the imaging unit 3 or the structure of the eyeball of the subject's eye E, the region DTr may include imaging information of an eye site different from that of the fundus Er. The component members of the imaging unit 3 are brightly captured in the out-of-focus state (in a blurred state) at a position that is the boundary between the area DTr and the area DTa. As the region DTr is farther away from the optical axis position PAa, information reflected by the illumination light at a site different from the fundus Er of the subject's eye E is likely to be reflected. Information reflected by a site different from the fundus Er (for example, the cornea or the lens) is considered as unnecessary reflection and may be called flare. In the vicinity of the boundary between the area DTr and the area DTa, the imaging performance of the fundus imaging optical system 10 is sharply reduced. When the imaging performance is rapidly reduced, an image of the fundus oculi Er of the subject's eye E is significantly distorted and is likely to be captured near the boundary between the area DTr and the area DTa.

  The mask image is described with reference to FIG. The mask image is configured such that the width Wb in the X direction (horizontal direction) is 3000 pixels, and the height Hb in the Y direction (longitudinal direction) is 3000 pixels. The mask image is a two-dimensional image (planar image) in which each pixel is composed of 8-bit (256 gradations) R / G / B data. The mask image is a square image with an aspect ratio of 1: 1. An area indicated by DTb in FIG. 5 is a transmission area DTb in which information (data) of the light reception image is prioritized when generating a composite image. On the other hand, an area indicated by DTmsk in FIG. 5 is a mask area DTmsk in which information (data) of the mask image is prioritized when generating a composite image. The transmissive region DTb is circular. A mask region DTmsk is disposed around the transmissive region DTb. The mask image is a mask pattern in the shape of an aperture mask. The circular transmission region DTb has a diameter (= Wm = Hm) of 2850 pixels. The center of the transmissive region DTb is the same position as the central position PCb of the mask image. In the mask image, a section of the mask area DTmsk of at least 75 pixels or more is formed on the outer periphery of the transmissive area DTb (see Wc and Hc in FIG. 5). Each pixel constituting the mask area DTmsk is 8-bit (256 gradations) R / G / B data which is achromatic and dark. The size (area) of the transmission area DTb is smaller than the area DTr of the light reception image. When the size (area) of the transmission area DTb is smaller than the size (area) smaller than the area DTr of the light reception image, it is possible to perform the masking process on the unnecessary image area of the light reception image. That is, the relationship is width Wr> width Wm and height Hr> height Hm (see FIGS. 4 and 5). The size of the transmission region DTb is determined by design data of the ophthalmologic apparatus 100, a copy experiment of the ophthalmologic apparatus 100, or the like. If the imaging magnification changes at the position of the focusing lens 14 due to the characteristics of the fundus imaging optical system 10, the control unit 391 may change the size of the transmissive region DTb according to the position of the focusing lens 14.

  The composite image will be described with reference to FIG. The composite image is configured such that the width Wc in the X direction (horizontal direction) is 3000 pixels, and the height Hc in the Y direction (longitudinal direction) is 3000 pixels. Each pixel is composed of 8-bit (256 gradations) R / G / B data. The composite image is a two-dimensional image (planar image). The composite image is a color image. The size (area) of the composite image is the same size as the mask image. The composite image is a square image with an aspect ratio of 1: 1. The position (coordinates) indicated by PCc in FIG. 6 is the center position PCc of the composite image. Note that the meaning of the position (coordinates) indicated by PAa in FIG. 6 and the area indicated by the area DTr and the area DTmsk is the same as that in FIGS. 4 and 5. The composite image is composed of a region DTr and a mask region DTmsk. The area DTr is image information of the fundus Er of the subject's eye E. The mask area DTmsk is located around the area DTr. The parameters of the light reception image, the mask image, and the composite image of the present embodiment are merely examples.

Next, the state of generating a composite image will be described using FIG. When generating a composite image, for example, the pre-image processing unit 312 and the control unit 391 are used to store in advance information on coordinates for combining the mask image with the received light image as the memory 393 as the storage unit. The information on the coordinates is used to generate the composite image so that the center of the mask image is the optical axis.
More specifically, in FIG. 7, the upper left of each image is coordinate (0, 0), and the lower right is coordinate (2999, 2999) or coordinate (3999, 2999). Further, the upper left coordinate (0, 0) of each image is set as the origin coordinate. In the mask image of FIG. 7A, the position (coordinates) indicated by PCb is the center position PCb of the mask image. Hereinafter, the coordinates of the center position PCb of the mask image will be described as (m0, n0). In the light reception image of FIG. 7B, the position indicated by PCa is the center position PCa of the light reception image. Hereinafter, the coordinates of the center position PCa of the light reception image will be described as (u0, v0). In the light reception image of FIG. 7B, the position indicated by PAa is an optical axis position PAa at which the photographing optical axis of the light reception image is formed. Hereinafter, the coordinates of the optical axis position PAa of the light reception image will be described as (u1, v1).

  In the light reception image, the coordinates (u1, v1) of the optical axis position PAa are shifted by Δx1 pixels in the X direction and Δy1 pixels in the y direction from the coordinates (u0, v0) of the center position PCa. That is, in the light reception image, the photographing optical axis is positioned at a position slightly offset to the upper right from the center of the light reception image. The coordinates at which the shooting optical axis of the received light image is located are stored in advance in the memory 393. The control unit 391 reads out information on the optical axis position PAa of the received light image from the memory 393 in advance before performing the masking process described with reference to FIG. 7.

  First, the control unit 391 analyzes data of coordinates (0, 0) that is the origin of the mask image read from the memory 393. If it is determined that the data is to be subjected to the masking process, the data of the mask image is not rewritten (the pixel becomes achromatic and dark data in the composite image). Subsequently, data of coordinates (0, 1) adjacent to one pixel in the X direction from the origin is analyzed in the same manner as processing of the origin. Thereafter, the control unit 391 continues the same analysis up to the pixel at the right end (X direction end) of the mask image. In addition, the process in the case of not the data which shows masking is mentioned later. When the analysis of the coordinates (0, 2999) at the right end is completed, the control unit 391 shifts each pixel in the Y direction by one pixel, and analyzes each pixel of the mask image sequentially from the left end to the right end. That is, the control unit 391 analyzes coordinates (2999, 1) from coordinates (0, 1) of the mask image. Thus, the control unit 391 analyzes each pixel of the coordinates (0, 0) of the mask image to the coordinates (2999, 2999) while shifting in the X direction and the Y direction. Whether or not the pixel is to be masked may be determined according to the tone value of each pixel constituting the mask image.

  Subsequently, processing in the case where the control unit 391 analyzes data that is not masking will be described. For example, when the control unit 391 analyzes the pixel as unmasked data at coordinate P1 described as P1, the control unit 391 reads data from coordinate P2 described as P2 of the received light image, and the read data is a pixel of coordinate P1 of the mask image Overwrite By such control, synthesis of the light reception image and the mask image is performed. The control unit 391 performs combining processing in consideration of the photographing optical axis using the information on the optical axis position PAa read from the memory 393. More specifically, in the mask image, the distance and orientation from the center position PCb of the pixel (for example, P1) to be subjected to the target masking process and the distance and orientation from the optical axis position PAa of the pixel (for example, P2) to be read from the light reception image Control to be the same.

  Using the light reception image in which the optical axis position PAa is formed at a coordinate displaced by Δx0 in the X direction from the central position PCb and Δy0 in the −Y direction, Δx1 in the −X direction from the central position PCb of the mask image and Δy1 in the −Y direction When combining is performed on pixels at shifted coordinates, the data of the coordinates (u0 + Δx0−Δx1, v0−Δy0−Δy1) of the received light image are read out, and the coordinates (m0−Δx1, n0−Δy1) of the mask image described above are obtained. Overwrite data. The coordinates of the optical axis position PAa are (u0 + Δx0, v0−Δy0), and the coordinates of the center position PCb of the mask image are (m0−Δx1, n0−Δy1). By performing such signal processing, a composite image obtained by combining the light reception image and the mask image is generated in consideration of the photographing optical axis of the light reception image (see FIG. 7C).

  The generated composite image is an image in which the center position PCc of the composite image and the optical axis position PAa coincide with each other (see FIG. 7C). The generated composite image is an image obtained by masking an unnecessary area from the area DTr of the received light image with the optical axis position PAa of the received light image as a center. The composite image is an image in which unnecessary information included in the received light image is reduced, the imaging optical axis is positioned at the center of the mask, and the imaging optical axis is positioned at the center of the composite image.

  Then, the manufacturing method of the ophthalmologic apparatus 100 of this embodiment is demonstrated using the flowchart shown in FIG. 8, and FIGS. 9-13. In this description, the manufacturing part of the ophthalmologic apparatus 100 in which the optical axis of the composite image or the photographed image is involved will be described. In step 201, the assembling worker assembles the jig A in front of the objective lens 11 (a position where the subject eye E is disposed in FIG. 2). The jig A is assembled to the support base constituting the imaging unit 3 with sufficient accuracy. The jig A according to the present embodiment has a lens and a chart, and the chart 500 is placed at a position conjugate with the fundus Er of the subject's eye E (that is, a position optically nearly infinite). It will be. In the chart 500 of the present embodiment, as shown in FIG. 9, a cross-shaped symbol is drawn. The optical axis of the jig A passes a position (optical axis position PAa) where two line segments forming a cross shape drawn on the chart 500 intersect. Subsequently, in step 202, the assembling operator connects each unit so that the photographing camera unit 313 and the control unit 391 can communicate. The assembling operator operates the switch unit 392 to display the moving image captured by the imaging camera unit 313 on the monitor 8. At this time, the focusing lens 14 is positioned at a predetermined position on the fundus imaging optical system 10 (a position where the imaging device 16 and the chart 500 have a conjugate relationship).

  Subsequently, in step 203, the assembling worker assembles the imaging camera unit 313 into the imaging unit 3 and adjusts the position of the imaging camera unit 313 with respect to the optical axis L1 of the fundus imaging optical system 10. In other words, the assembly worker moves and adjusts the imaging element 16 on the plane orthogonal to the optical axis L1. A cross-shaped electronic chart Ga is superimposed on the received light image and the received light image and displayed on the monitor 8 (see FIG. 10A). When the photographing camera unit 313 captures an image of the chart 500 of the jig A, an image Ma of the chart 500 of the jig A is displayed on the monitor 8. The position indicated by PCa in FIG. 10A is the center position PCa of the received light image. The position indicated by PD in the same figure is an intersection position PD of two line segments that form the cross shape of the electronic chart Ga.

  Subsequently, in step S204, the assembling operator operates the switch portion 392 to superimpose the electronic chart Ga on the optical axis position PAa of the image Ma of the chart 500 of the jig A. More specifically, by operating the switch portion 392, the electronic chart Ga superimposed on the light reception image is relatively changed (moved) in the vertical and horizontal directions. The assembly worker operates the switch portion 392 so that the optical axis position PAa of the image Ma and the intersection position PD of the electronic chart Ga overlap. When the assembling worker superimposes the optical axis position PAa and the intersection position PD as shown in FIG. 10 (b), the assembling operator operates the switch portion 392 to obtain information on coordinates corresponding to the optical axis position PAa in the received light image. It is stored in the memory 393 (storage means) of the device 100. The control unit 391 stores information on the coordinates corresponding to the optical axis position PAa in the light reception image in the memory 393 as information on the reference position, which is used when combining the light reception image and the mask image. Subsequently, in step S205, the assembling operator presses the imaging switch 4b to perform imaging of a still image using the fundus imaging optical system 10. When the operation is performed, the control unit 391 combines the light reception image and the mask image using the information on the reference position stored in the memory 393 to generate a combined image. The assembly worker confirms the composite image displayed on the monitor 8 (see FIG. 11). The operation of storing the information on the reference position PBa (information on the coordinates corresponding to the optical axis position PAa in the light reception image) in the ophthalmologic apparatus 100 is completed by the operations from step S201 to step S205 described above.

  Subsequently, the OCT unit 61 is adjusted. In step S206, the assembling operator replaces the jig A mounted in step 201 with the jig B. Similar to the jig A, the jig B is disposed in front of the objective lens 11 (a position at which the subject eye E is disposed in FIG. 2). The jig B has a lens and a target. In the jig B, a target having a structure different from that of the chart 500 of the jig A is formed at a position conjugate with the fundus Er. In step S207, the assembly operator operates the switch unit 392 to display the moving image captured by the imaging camera unit 313 on the monitor 8. The light reception image captured by the photographing camera unit 313 and the electronic chart Gb are displayed on the monitor 8. The electronic chart Gb is a cross-shaped pattern, and the electronic chart Gb is superimposed on the light reception image. The electronic chart Gb is drawn so that the intersection of the two line segments that make up the electronic chart Gb is located at the position where the optical axis of the received light image captured by the photographing camera unit 313 is formed (FIG. 12 (a)) reference). An image Mb of the target of the jig B captured by the photographing camera unit 313 is reflected on the monitor 8.

  Subsequently, in step S208, the assembling worker places the target portion of the jig B such that the intersection point (reference position PBa) of the electronic chart Gb displayed on the monitor 8 and the intersection position PAd of the image Mb of the target overlap. The position is adjusted by moving on a plane orthogonal to the optical axis L1. In addition, position adjustment of the target of the jig | tool B is performed as a preparatory work for adjusting the assembly position of the line sensor mentioned later. As shown in FIG. 12B, when the intersection point (reference position PBa) of the electronic chart Gb overlaps the intersection position PAd of the image Mb of the target of the jig B, the adjustment of the target position of the jig B is completed. Subsequently, in step S 209, the assembly operator operates the switch unit 392 to display an OCT tomographic image on the monitor 8. Subsequently, in step S210, the assembly worker adjusts the position of the line sensor of the OCT unit 61. More specifically, the assembly worker moves the line sensor on the plane orthogonal to the optical axis L3 so that the OCT image is displayed on the monitor 8 in a predetermined pattern while watching the monitor 8. In the description, the OCT tomographic image is omitted. The position adjustment of the line sensor of the OCT unit 61 is completed by the operations from step S206 to step S210 described above. The position adjustment of the line sensor of the OCT unit 61 is performed using the information on the reference position PBa stored in step S201 to step S205, whereby a captured image obtained using the fundus imaging optical system 10 and the OCT optical system 60 are obtained. It is easy to obtain the correlation with the captured image acquired using

  Subsequently, in step S211, the assembling worker operates the switch unit 392 to display the light reception image (moving image) of the image pickup device 24 on the monitor 8. The jig B used in steps S206 to S210 described above is used as it is. The monitor 8 displays a light reception image captured by the imaging device 24 and an electronic chart Gc superimposed on the light reception image (see FIG. 13A). When the image pickup element 24 picks up the target of the jig B, the image Mb of the target of the jig B is reflected in the received light image. Further, the electronic chart Gc is a cross-shaped symbol, and is drawn so that an intersection of two line segments forming the cross shape coincides with the center position PCa of the received light image.

  Subsequently, in step S212, the assembly worker moves the imaging device 24 on the plane orthogonal to the optical axis L2 to adjust the position of the imaging device 24. More specifically, the assembling operator adjusts the position of the imaging element 24 so that the central position PCa and the intersecting position PAd of the image Mb of the target of the jig B coincide with each other (see FIG. 13B). The position adjustment of the image sensor 24 is completed by the operations of step S211 and step S212 described above. As in the operations performed in steps S201 to S206, information on the intersection position PAd is stored in the ophthalmologic apparatus 100, and the light reception image and the mask image are combined in consideration of the photographing optical axis of the fundus observation optical system 20. May be

  A composite image of the light reception image and the mask image is generated in consideration of the optical axis of the light reception image by the adjustment of steps S201 to S212 and the image synthesis shown in the flowchart of FIG. The position adjustment of the image sensor 24 used in the fundus oculi observation optical system 20 and the line sensor used in the OCT optical system 60 is performed using information on the optical axis position PAa. The ophthalmologic apparatus 100 maintaining correlation with the optical axes of a plurality of optical systems using the objective lens 11 can be manufactured using information on the optical axis position PAa. In the ophthalmologic apparatus 100 in which the optical path from the objective lens 11 to the subject's eye E is shared by a plurality of types of optical systems, the adjustment is performed with the optical axes of the respective optical systems being correlated. A correlation can be obtained with the optical axis characteristics of the image. Therefore, the examiner can promptly diagnose the subject's eye E without losing the relevance of the respective images obtained by imaging the same subject's eye E with different optical systems.

  In this embodiment, a mask image is analyzed, and a composition method (masking method) is used in which data of a received light image is embedded in the transmission region DTb in consideration of the optical axis of the received light image. The composition method is not limited to this. The synthesis of the light reception image and the mask image may be performed in consideration of the optical axis of the light reception image. As an example, after the light reception image and the mask image are once combined, a combination method of cutting out in a predetermined size may be used. In addition, the mask may be drawn on the received light image in consideration of the optical axis of the received light image. Also, table data related to masking may be stored in storage means possessed by the pre-image processing unit 312. In this case, when the pre-image processing unit 312 inputs the output signal of the imaging device 16 (before forming the two-dimensional image), masking is sequentially performed on the data input from the imaging device 16 using the table data described above. It is also good. By using such a method, it is possible to generate a composite image in the same time as generating a light reception image. Further, the ophthalmologic apparatus 100 may only store the light reception image and the data regarding the optical axis position PAa in association with each other. Information associated and stored may be transferred to a device (filing PC) different from the ophthalmologic apparatus 100, and a composite image may be generated by the device different from the ophthalmologic apparatus 100.

  It is possible that the optical axis position PAa may be displaced in conjunction with the movement of the focusing lens 14 due to the play of the mechanism or the tolerance of the parts constituting the optical system. Information on a plurality of optical axis positions PAa corresponding to the position of the focusing lens 14 may be stored in the storage means. The control unit 391 may generate a composite image using the information of the optical axis position PAa corresponding to the position of the focusing lens 14 stored in the storage unit.

<Operation and effect>
As described above, the ophthalmologic apparatus 100 according to the present embodiment acquires the light reception image of the subject's eye E with the imaging device 16 through the fundus imaging optical system 10, and the center (center position PCa) of the light reception image and the fundus imaging The mask image can be synthesized with the received light image in consideration of the deviation from the optical axis (optical axis position PAa) of the optical system 10. According to this aspect, for example, it is possible to obtain a composite image in which unnecessary image information included in the received light image is suitably reduced. As an example, the time spent by the examiner in determining unnecessary image information can be reduced, and diagnosis can be performed promptly.

  Further, in the ophthalmologic apparatus 100 according to the present embodiment, reference position information based on the optical axis position of the light reception image for combining the mask image with the light reception image as information on coordinates for combining the mask image with the light reception image. It is memorized. The reference position information is reference position information for combining the mask image with the received light image in consideration of the deviation between the center of the received light image (center position PCa) and the optical axis (optical axis position PAa) of the fundus imaging optical system 10. For example, position coordinates of the optical axis on the light reception image are stored as reference position information. Furthermore, a composite image is generated using the reference position information so that the center (center position PCb) of the mask image is on the optical axis (optical axis position PAa). According to this aspect, for example, it is possible to obtain a composite image in which unnecessary image information included in the received light image is suitably reduced. As an example, even if unnecessary image information is superimposed on a light reception image at a pair of target positions with respect to the optical axis, unnecessary image information does not remain only at one side, and unnecessary image information is reduced in a balanced manner. be able to. Further, image processing such as distortion correction can be easily performed on the composite image with high accuracy.

  Further, the ophthalmologic apparatus 100 according to the present embodiment generates a composite image so that the center of the composite image is the center of the mask image (center position PCb). Such an aspect facilitates the handling of the composite image. As one example, the deviation of the layout of the region where the eye information is displayed by each image is reduced, and it becomes easy to align and compare the synthesized images.

  In the mask image of the ophthalmologic apparatus 100 of this embodiment, a mask pattern in the shape of an aperture mask in which a non-mask area (transmission area DTb) is disposed at the center and a mask area (mask area DTmsk) is disposed at the periphery. It is assumed. According to this aspect, for example, the imaging angle of view of the optical system can be effectively utilized, and unnecessary image areas included in the light reception image can be suitably masked.

  The ophthalmologic apparatus 100 further includes a focusing lens 14 movable in the optical axis direction in the fundus imaging optical system 10, and the mask combining unit uses operation information of the focusing lens 14 and the reference position information described above. Thus, a composite image may be generated. According to this aspect, for example, the position at which the mask image is synthesized with the light reception image can be changed according to the position of the focusing lens 14, and unnecessary image information can be suitably reduced.

  Although the present embodiment has been described using the ophthalmologic apparatus 100 for imaging the fundus Er of the subject's eye E, the present invention is not limited to this. You may apply to the ophthalmologic apparatus which acquires the eye image of the test subject's eye E at least. As an example, the present invention can be applied to an eye refractive power measurement apparatus (for example, trans-illumination image photography) that measures the eye refractive power by observing the anterior segment Ec of the subject's eye E. In addition, the present invention may be applied to a slit lamp microscope (slit lamp) that mainly emits slit-like light to image an anterior segment or the like of the subject's eye E.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is shown not by the above description but by the scope of claims, and is intended to include all modifications within the scope of claims and equivalents thereof.

3 imaging unit 8 monitor 11 objective lens 16 imaging device 312 pre-image processing unit 313 imaging camera unit 391 control unit 393 memory

Claims (2)

An ophthalmologic apparatus that combines a mask image with a received light image and outputs a combined image,
Imaging means for obtaining the light reception image of the subject's eye with an imaging device via an optical system;
A mask combining unit that combines the mask image with the received light image in consideration of the shift between the center of the received light image and the optical axis of the optical system, which occurs individually when assembling the ophthalmologic apparatus ;
Storage means for storing information on coordinates for combining the mask image with the received light image in consideration of the deviation as reference position information specific to the apparatus ;
An ophthalmologic apparatus , wherein the mask composition unit uses the reference position information to generate the composite image in which a shift occurring at the time of the assembly is considered so that the center of the mask image is the optical axis . An ophthalmologic apparatus according to claim 1, wherein
An ophthalmologic apparatus, wherein the mask compositing unit generates the composite image such that the center of the composite image is at the center of the mask image.

Images