JP5629482B2 - Imaging apparatus, imaging method, and program - Google Patents

Description

  The present invention relates to an imaging apparatus, an imaging method, and a program. In particular, the present invention relates to an imaging device such as a fundus camera, an imaging method, and a program that can capture an eye image to be examined used in an ophthalmic clinic or the like.

  Conventionally, in a fundus camera, stereo imaging or panoramic imaging is performed in which the relative position between the fundus camera and the eye to be examined is changed to photograph the eye to be examined from various positions. First, in order to shoot a stereo image, in addition to the method of shooting using an ophthalmologic photographic apparatus having a stereo image shooting function, the user manually shoots two fundus images that are decentered sequentially left and right. There is known a method of registering a pair (see Patent Document 1). In panoramic imaging, the user manually captures multiple fundus images while changing the shooting position, such as center, center right, and upper right, and saves them as a set. Techniques for creating images are known.

  On the other hand, a technique for obtaining an image effective for diagnosis while reducing the burden on the patient by generating a plurality of images in one shooting is known (see Patent Document 2).

Japanese Patent Laid-Open No. 10-248811 JP 2003-52639 A

  However, when the function of generating a plurality of images in one shooting is enabled, when a user manually decenters sequentially to obtain a stereo image and saves them as a pair, two images without parallax are paired. There is a problem that registration may occur and stereoscopic viewing may not be possible during interpretation. In addition, when panoramic imaging is performed in the same state, there is a problem that when a doctor creates a panoramic image at the time of interpretation, a correct panoramic image may not be created using an image stored in a set.

  In view of the above problems, an object of the present invention is to provide an ophthalmologic photographing apparatus capable of photographing and registering correct stereo images and panoramic images.

An imaging apparatus according to the present invention that achieves the above-described object,
An imaging apparatus that performs stereo imaging of the fundus of a subject's eye,
Determining means for determining whether the mode for generating a color image and a red-free image by one imaging by the imaging means is valid or invalid;
Generating means for generating a color image and a red-free image from one imaging by the imaging means when the determining means determines that the mode is valid;
Registration means for pair-registering two images captured by the imaging means as stereo images,
The front Symbol registration means, two color images generated based on the imaging two times, characterized in Rukoto is paired registered by the imaging means.

  According to the present invention, a correct stereo image and panorama image can be captured and registered when performing stereo imaging and panorama imaging in a state where a function of generating a plurality of images by one shooting is enabled. Therefore, the confusion at the time of a doctor's interpretation can be prevented.

The functional block diagram of an imaging device. 5 is a flowchart showing a stereo imaging procedure according to the first embodiment. The figure which shows the display of the monitor for observation image display at the time of the stereo imaging which concerns on 1st Embodiment. The figure which shows the display of the monitor for the captured image display at the time of the stereo imaging which concerns on 1st Embodiment. The flowchart which shows the stereo imaging procedure which concerns on 2nd Embodiment. The flowchart which shows the stereo imaging procedure which concerns on 3rd Embodiment. The flowchart which shows the stereo imaging procedure which concerns on 4th Embodiment. The figure which shows the display of the monitor for a picked-up image display at the time of the stereo imaging which concerns on 3rd Embodiment.

(First embodiment)
A functional configuration diagram of the fundus imaging apparatus of the present invention will be described with reference to FIG. The fundus illumination light source 101 is a light source such as a halogen lamp or a strobe light. The objective lens 102 is an objective lens that faces the eye E from the fundus illumination light source 101. On the optical path leading to the objective lens 102, a lens 103 and a perforated mirror 104 conjugate with the anterior eye portion of the eye E to be examined are arranged. In addition, an imaging lens 105 and an imaging unit 106 are arranged on the optical path 100 behind the perforated mirror 104. Also, a pair of LED light sources 107L and 107R for alignment and optical fibers 108L and 108R are disposed in the vicinity of the hole portion of the perforated mirror 104. The tip ends of the optical fibers 108L and 108R are arranged perpendicular to the paper surface on both sides of the optical path 100 of the opening of the perforated mirror 104, and serve as two secondary light sources. The output of the imaging unit 106 is connected to a memory 110, an observation image display monitor 111, and a captured image display monitor 112. The image generation unit 109 is connected to the memory 110 and the image generation mode setting unit 114. The output of the image generation unit 109 is connected to the storage unit 113.

  The light beam from the fundus illumination light source 101 passes through the lens 103, the perforated mirror 104, and the objective lens 102, and illuminates the fundus R of the eye E to be examined. Then, the reflected light from the fundus R passes through the objective lens 102, the perforated mirror 104, and the imaging lens 105, and forms an image as a fundus image R ′ on the imaging device of the imaging unit 106. The imaging unit 106 is illuminated with a halogen lamp or the like at the time of observation position alignment, and displays a fundus image R ′ of a moving image on the observation image display monitor 111.

  The same imaging unit 106 is used for shooting with a strobe. Since the fundus image R ′ of the captured still image (captured image) is immediately displayed on the captured image display monitor 112, the examiner can confirm in a short time whether or not the image has been successfully captured.

  The imaging unit 106 outputs left and right eye information, imaging information such as the amount of imaging light, and the captured fundus image R ′ to the memory 110. The image and the imaging information are associated and stored in the storage unit 113. The image generation mode setting unit 114 can set “valid” for generating a plurality of images in one shooting, or “invalid” for not generating. In the effective setting, the number of images to be generated and the image processing used for generation are set. When the setting is valid, the image generation unit 109 performs the set image processing on the image read from the memory 110, generates the set number of images, and stores the images in the storage unit 113. .

  The above-described configuration is a method of performing observation and photographing with a single imaging unit, but an imaging unit may be provided separately for observation and photographing. Observation may be performed with an optical viewfinder. Moreover, although the structure which produces | generates several images by image processing with respect to the output of one imaging part was shown, even if it is the structure which produces | generates several images by one imaging | photography using several imaging parts. Good.

  In this configuration, the flow when storing images captured by performing stereo imaging and panoramic imaging will be described below.

  With reference to FIG. 2, a flowchart of a procedure for performing stereo imaging according to the first embodiment will be described. In step S201, a stereo imaging start button (not shown) is pressed. In step S202, the setting of the image generation mode setting unit 14 is confirmed. That is, it is determined whether or not a mode for generating a plurality of images in one shooting is valid. If it is valid (step S202; YES), the process proceeds to step S203. In step S203, processing for prohibiting the start of stereo imaging is performed. At this time, the reason why the stereo imaging is prohibited may be presented to the examiner. And it returns to the state before stereo start. On the other hand, when the image generation mode is invalid (step S202; NO), the process proceeds to step S204. In step S204, stereo imaging is started. In step S205, a first stereo image is taken. In step S206, a second stereo image is taken. In step S207, the stereo image shooting is terminated. In step S208, the captured images are registered as a pair as a stereo image. And it returns after that.

  Next, the stereo photographing method from step S204 to step S208 will be described in detail. The light beams from the LED light sources 107L and 107R are guided to the end faces located on both sides of the optical path 100 of the opening of the perforated mirror 104 through the optical fibers 108L and 108R, respectively. And it projects on the cornea of the eye E through the objective lens 102 as a secondary light source. Then, the cornea reflection images 107L ′ and 107R ′ by these secondary light sources are displayed together with the fundus image R ′ on the observation image display monitor 111 as shown in FIG. The observation image display monitor 111 displays an alignment mark A and a frame line S indicating a stereo imaging range. When stereo imaging is started, the LED light source 107R blinks, and the cornea reflection image 107R 'by the optical fiber 108R also blinks. Use an unillustrated joystick or the like to shift the imaging device left and right, align the blinking cornea reflection image 107R ′ with the alignment mark A, and then press the unillustrated photographing switch to shoot with a strobe light source. Do. The captured image information is temporarily stored in the memory 110. Then, as shown in FIG. 4, it is displayed as a still image RR 'on the right side of the captured image display monitor 112, and the examiner can confirm that the image is well taken in the stereo imaging mode.

  On the captured image display monitor 112, a screen for confirming a stereo captured image is displayed as shown in FIG. 4, and a capturing side instruction display 421 is displayed on the right side at the start of stereo imaging.

  In step S205, when shooting in the right direction is completed, the still image RR ′ is displayed on the right side of the captured image display monitor 112, and at the same time, the shooting side instruction display 421 shifts to the left side. The LED light source 107L blinks. In step S206, when the blinking cornea reflection image 107L 'is photographed in alignment with the alignment mark A, the left and right images RL' and RR 'are displayed on the photographed image display monitor 112. If the imaging result is satisfactory, the stereo imaging end button 423 is pressed in step S207. In step S208, both images RL 'and RR' are stored in the storage unit 113 as stereo images. If the photographing result is not good, the examiner moves the photographing side instruction display 421 on the photographed image display monitor 112 to the side where the photographing is desired using the photographing side instruction unit 422 such as a mouse. Then, photographing is performed again.

  The LED light sources 107L and 107R for alignment may be turned on by turning off the light source that is not used and continuously or blinking the light source that is used. If one of them is blinked or turned off, there is an effect that it is difficult to mistake the left and right during stereo imaging.

(Second Embodiment)
With reference to FIG. 5, a flowchart of a procedure for performing stereo imaging according to the second embodiment will be described. In step S501, a stereo imaging start button (not shown) is pressed. In step S <b> 502, the setting of the image generation mode setting unit 114 is stored in the storage unit 113. In step S503, it is determined whether the image generation mode is valid. If it is valid (step S503; YES), the process proceeds to step S504. In step S504, the image generation mode is disabled and the process proceeds to step S505. At this time, the examiner may be informed that the mode for generating a plurality of images in one shooting is invalid. On the other hand, if invalid (step S503; NO), the process proceeds directly to step S505.

  In step S506, the first stereo image is taken. In step S507, a second stereo image is taken. When the second stereo image is captured, the examiner confirms the captured image on the captured image display monitor 112. If the imaging result is good, in step S508, the examiner presses the stereo imaging end button 423 to end the stereo imaging mode. In step S509, the image displayed on the captured image display monitor 112 is stored in the storage unit 113 as a stereo image. In step S510, the setting of the image generation mode before the start of stereo imaging is read from the storage unit 113. If the image generation mode is valid (step S510; YES), the process proceeds to step S511. In step S511, the current image generation mode setting is validated and the process returns. On the other hand, if the image generation mode is invalid (step S510; NO), the process returns.

(Third embodiment)
With reference to FIG. 6, a flowchart of a procedure for performing stereo imaging according to the third embodiment will be described. In step S601, a stereo imaging start button (not shown) is pressed. In step S602, stereo imaging is started. In step S603, the imaging device is shifted leftward using a joystick (not shown), and the blinking cornea reflection image 107R ′ is aligned with the alignment mark A. Thereafter, a photographing switch (not shown) is pressed to perform photographing with a strobe light source. The captured video signal is temporarily stored in the memory 110. Since the image is displayed on the captured image display monitor 112, the examiner can confirm that the image is well taken in the stereo imaging mode. In addition, you may perform the determination process demonstrated with reference to FIG. 2 or FIG. 5 between step 601 and step 602. FIG.

  If the image generation mode setting unit 114 is enabled to generate a total of two color images and a digital red free image in one shooting operation, for example, the image generation unit 109 stores the information from the memory 110 in step S604. A color image is read out and designated image processing is performed. When image processing is performed and a digital red free image (generated image) is generated, the image is stored in the storage unit 113. A digital red free image (generated image) generated by performing image processing on the color image is stored in the storage unit 113.

  Next, in step S604, photographing from the left direction is performed. If the photographing result is good, the stereo imaging end button 423 is pressed in step S605 to end the stereo imaging. When the stereo imaging is completed, only a color image is registered as a pair of stereo images from the four captured images. The reason for registering only a color image as a stereo image is that if a color image is stored, a digital red free image can be manually generated by the image generation unit 109 as necessary when the image is read.

  First, it is determined whether or not one or more sets of four images captured in step S606 are registered as stereo images. If not registered (step S606; NO), the process proceeds to step S607. In step S607, an arbitrary image RFL is selected from the captured four images. In step S608, it is determined from the imaging information associated with the image whether or not the selected image RFL is a color image. If it is a color image (step S608; YES), the process proceeds to step S609. If it is not a color image (step S608; NO), the process returns to step S607. Next, it is assumed that the image CL is selected in step S607. In step S608, if the image CL selected in step S607 is now a color image (step S608; YES), the image RFR is selected in step S609. In step S610, it is determined whether the image CL and the image RFR satisfy the stereo establishment condition.

  Here, whether or not the stereo establishment condition is satisfied is determined based on the imaging information as to whether or not two images are established as a stereo image. The imaging information includes, for example, information indicating the position of the imaging device when imaged by the imaging device, information indicating whether the captured fundus is the right eye or the left eye, whether the image is a color image or a digital red free image, etc. Information indicating the type of image. Since the degree of parallax between the two images can be determined from the information indicating the position of the imaging device, it is possible to determine whether the two images are formed as a stereo image based on the information indicating the imaging position. Furthermore, it may be possible to determine which eye is the fundus in order to avoid pair registration of the left eye image and the right eye image. Also, pair registration is only possible if the image types are the same, for example, color images, digital red free images, etc., and information indicating the image type when the mode for generating multiple types of images is valid Is also required. If only the same eye (for example, the left eye) is imaged and a plurality of types of images are not generated by one imaging, only the information indicating the position of the imaging device is captured as two imaging images. It can be determined whether or not it is established. If the condition is not satisfied (step S610; NO), the process returns to step S609. In step S609, the next image CR is selected. Thereafter, in step S610 again, the stereo establishment condition is determined. When the image CL and the image CR satisfy the conditions (step S610; YES), the process proceeds to step S611. Then, it is stored in the storage unit 113 as a stereo image. Since one set of images taken in step S606 is registered as stereo images, at least one set of stereo images can be registered by stereo imaging.

(Fourth embodiment)
With reference to FIG. 7, a flowchart of a procedure for performing stereo imaging according to the fourth embodiment will be described. In step S701, a stereo imaging start button (not shown) is pressed. In step S702, stereo imaging is started. In step S <b> 703, the captured image information is temporarily stored in the memory 110. The captured image information is displayed as a still image CRR ′ on the upper right side of the captured image display monitor 112 shown in FIG. 8, so that the examiner can confirm that the image is well captured in the stereo imaging mode. In addition, you may perform the determination process demonstrated with reference to FIG. 2 or FIG. 5 between step 701 and step 702. FIG.

  According to the setting of the image generation mode setting unit 114, the image generation unit 109 generates a total of two images, a color image and a digital red free image, in one shooting. The generated digital red free image is stored in the storage unit 113. Since the still image RRR 'is displayed on the lower right side of the photographed image display monitor 112, the examiner can confirm the photographing of the digital red free image.

  Next, when photographing from the left direction is performed in step S704, images CRL 'and CRR' are further displayed on the left side of the photographed image display monitor 112. As a result, the images CRL ′ and CRR ′ and RRL ′ and RRR ′ are displayed on the captured image display monitor 112. In step S205, if the shooting result is good, the stereo imaging end button 23 'is pressed to end the stereo imaging.

  When the stereo imaging is completed, a process of registering the four captured images as a correct stereo image is performed as follows. First, in step S706, it is determined whether or not there are four captured images that are not registered as pairs. If it exists (step S706; YES), the process proceeds to step S707. In step S707, an image RRL 'is selected from arbitrary images not registered as a pair. In step S708, an image CRL 'is selected from arbitrary images not registered as a pair. In step S709, whether or not the image RRL ′ and the image CRL ′ satisfy the stereo establishment condition based on the imaging information associated with the image, for example, whether both the image RRL ′ and the image CRL ′ are color images or not. Determine whether. If the stereo establishment condition is not satisfied (step S709; NO), the process returns to step S708. Similarly, for example, the image RRR 'is selected. Thereafter, in step S709, the stereo establishment condition is determined again. When the image RRL ′ and the image RRR ′ satisfy the stereo establishment condition (step S709; YES), the process proceeds to step S710. In step S710, the image RRL 'and the image RRR' are stored in the storage unit 113 as a stereo image. Thereafter, the process returns to step S706. Thereafter, the same procedure is performed again from step S706, and the left and right images CRL 'and image CRR' are also stored in the storage unit 113 as stereo images. As a result, the four shot images can be registered as two sets of stereo images.

  In the present embodiment, four fundus images are displayed as shown in FIG. 8, but only one set of arbitrary fundus images may be displayed as shown in FIG. Further, when displaying thumbnails of captured images, if the thumbnails are displayed in an order such that registered pairs of images are adjacent to each other, the examiner can select one set to be interpreted from a plurality of stereo images without error.

(Fifth embodiment)
The above is a case where stereo imaging is selected. However, when a panorama imaging button (not shown) is pressed in step S201 in FIG. 2, step S501 in FIG. 5, step S601 in FIG. 6, and step S701 in FIG. Transition to imaging. In this panoramic imaging, the number of images necessary for panoramic imaging is taken while moving the position of an external fixation lamp (not shown). Then, it is stored as a panoramic image in the storage unit 113 as a set. A panoramic image is generated using these images during interpretation. The process of panoramic imaging corresponds to the number of shots that was two in stereo imaging being increased to the number necessary for constructing a panoramic image and shooting corresponding to that. Therefore, the flow is the same as the flow charts of FIGS. 2, 5, 6, and 7.

(Other embodiments)
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.

Claims (9)

An imaging apparatus that performs stereo imaging of the fundus of a subject's eye,
Determining means for determining whether the mode for generating a color image and a red-free image by one imaging by the imaging means is valid or invalid;
Generating means for generating a color image and a red-free image from one imaging by the imaging means when the determining means determines that the mode is valid;
Registration means for pair-registering two images captured by the imaging means as stereo images,
Before SL The registration means, imaging the two color images generated based on the imaging twice by the imaging means, characterized in Rukoto is paired registration device. An imaging apparatus that performs stereo imaging of the fundus of a subject's eye,
Determination means for determining whether a mode for generating a plurality of images in one imaging by the imaging means is valid or invalid;
Generating means for generating a plurality of images from a single imaging by the imaging means when the determination means determines that the mode is valid;
Registration means for pair-registering two images captured by the imaging means as stereo images,
When it is determined by the determination means that the mode is valid and when imaging for the registration means is started, the imaging is started by the imaging means after setting the mode to invalid. An imaging apparatus characterized by that.   The mode is set when the mode is set to invalid, and the mode is set to be valid after two images captured by the imaging unit are registered as a stereo image by the registration unit. 2. The imaging device according to 2. An imaging method for imaging the fundus of a subject's eye in stereo,
A determination step for determining whether the mode for generating a color image and a red-free image in one imaging by the imaging step is valid or invalid;
A generating step of generating a color image and a red-free image from one imaging by the imaging step when the generating unit determines that the mode is valid by the determining step;
A registration unit comprising: a registration step of registering a pair of two images captured in the imaging step as a stereo image;
Prior Symbol registration process, the imaging method of two color images generated based on the imaging twice by the imaging process is characterized Rukoto the pairs registered. An imaging device for panoramic imaging of the fundus of an eye to be examined,
Determination means for determining whether a mode for generating a plurality of images in one imaging by the imaging means is valid or invalid;
Generating means for generating a plurality of images from a single imaging by the imaging means when the determination means determines that the mode is valid;
Registration means for registering a plurality of images picked up by the image pickup means as panoramic images,
An imaging apparatus characterized by prohibiting imaging by the imaging unit for the registration unit when the determination unit determines that the mode is valid. An imaging device for panoramic imaging of the fundus of an eye to be examined,
Determination means for determining whether a mode for generating a plurality of images in one imaging by the imaging means is valid or invalid;
Generating means for generating a plurality of images from a single imaging by the imaging means when the determination means determines that the mode is valid;
Registration means for registering a plurality of images picked up by the image pickup means as panoramic images,
When it is determined by the determination means that the mode is valid and when imaging for the registration means is started, the imaging is started by the imaging means after setting the mode to invalid. An imaging apparatus characterized by that. A case of disabled the mode, according to claim 6 in which a plurality of images captured by the imaging unit by the registration means after being registered as a panoramic image, characterized in that it enabled the mode The imaging device described in 1. An imaging method for panoramic imaging of the fundus of a subject eye,
A determination step in which the determination unit determines whether the mode for generating a plurality of images in one imaging by the imaging step is valid or invalid;
A generating step of generating a plurality of images from one imaging by the imaging step when the generating unit determines that the mode is valid by the determining step;
A registration unit that registers a plurality of images captured in the imaging step as panoramic images;
An imaging method characterized by prohibiting imaging in the imaging process for the registration process when the determination process determines that the mode is valid. A program for causing a computer to execute the imaging method according to claim 4 or 8 .

Images