JP2011045549A - Ophthalmologic photographing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an ophthalmologic photographing system which displays two appropriate images stereoscopically. <P>SOLUTION: When a user selects an optional image F1, the system decides whether an image selected at S10 forms a stereoscopic pair with an image stored in an image storing means. When a stored optional image F2 forms a stereoscopic pair with the image F1, the image F2 is determined to be a candidate image. When the stored optional image does not form a stereoscopic pair, the image F2 is determined to be a stereoscopic pair candidate image when patient information, photographing mode, right and left eye information, and the position of a fixation lamp agree respectively with those of the selected image at S20-S23 and also when the length of a right and left base line of an objective lens is within an optional range at S24. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an ophthalmologic photographing system for performing stereo display of an optometric image.

  Conventionally, it has been required to grasp the three-dimensional shape of the fundus for diagnosis of the fundus, and two images with left and right parallax are displayed side by side and observed, so that the nipple depression on the fundus can be viewed in stereo. Diagnosis method to see is performed. In order to obtain an image for stereo display, in addition to a technique of photographing using an ophthalmologic photographing apparatus having a stereo photographing function, there is a technique in which a user manually photographs with parallax as in Patent Document 1.

Japanese Patent Laid-Open No. 10-201715

  However, two images obtained using the stereo shooting function are registered as a stereo pair, but pair information is not registered in the manually shot image. For this reason, two appropriate images are not always displayed at the time of display, and there is a problem that it leads to misdiagnosis.

  An object of the present invention is to provide an ophthalmologic photographing system capable of solving the above-described problems and selecting two appropriate images to display an optometric image in stereo.

  In order to achieve the above object, an ophthalmologic imaging system according to the present invention includes an imaging unit that images an eye to be examined, an image storage unit that stores the captured image, imaging information output from the imaging unit, and the captured image. Image information storage means for storing images in association with each other, stereo display means for stereo display using two stereo pair images, and image selection for selecting a stereo pair candidate image from a plurality of images for an arbitrary image photographed by the photographing means Means, an image selection assisting means for prompting selection of an appropriate image when the image selecting means selects an image, and stereo pair information adding means for adding stereo pair information of an arbitrary image to the photographing information storage means. It is characterized by having.

  The ophthalmic imaging system according to the present invention stores an imaging unit that images the eye to be examined, an image storage unit that stores the captured image, imaging information output from the imaging unit, and the captured image in association with each other. Shooting information storage means, stereo display means for displaying two images in stereo, image search means for searching for an image from a plurality of images shot by the shooting means, and stereo pair information of the arbitrary image as the shooting information Stereo pair information adding means to be added to the storage means is provided.

  According to the ophthalmologic photographing system according to the present invention, since a stereo display can be performed with an appropriate stereo pair image of an optometric image, misdiagnosis can be prevented.

  In addition, when the reliability is given to the stereo pair candidate image. The examiner can easily select an image.

1 is a block circuit configuration diagram of Embodiment 1. FIG. It is a flowchart figure of the essential conditions of a stereo determination algorithm. It is a flowchart figure of the optional conditions of a stereo determination algorithm. It is explanatory drawing of image selection assistance control. It is a flowchart figure of candidate reliability determination of the stereo determination algorithm of Example 2. It is explanatory drawing of image selection assistance control. FIG. 6 is a block circuit configuration diagram of Embodiment 3. It is explanatory drawing of an image search function. It is explanatory drawing of a stereo pair information addition function.

  The present invention will be described in detail based on the embodiments shown in the drawings.

  FIG. 1 shows a block circuit configuration diagram of the ophthalmic imaging system according to the first embodiment. The output of the ophthalmologic photographing apparatus 1 typified by a fundus camera is connected in parallel to the image storage unit 2 and the photographing information storage unit 3, and the output of the image storage unit 2 is an image selection control unit 4 and an image selection assist control unit 7. Are connected in parallel, and the output of the image selection control unit 4 is connected to the stereo image display unit 5. The output of the photographing information storage unit 3 is connected in parallel to the stereo pair information adding unit 6 and the image selection assist control unit 7, and the output of the image selection assist control unit 7 is connected to the image selection control unit 4.

  When imaging of the eye to be examined is performed by the ophthalmologic imaging apparatus 1, the image of the eye to be examined and its imaging information are associated and stored in the image storage unit 2 and the imaging information storage unit 3. The image storage unit 2 and the photographing information storage unit 3 may be a volatile storage device or a non-volatile storage device.

  FIG. 2 is a flowchart of a stereo pair establishment determination algorithm, and determines whether an arbitrary image F2 stored in the image storage unit 2 is a stereo pair candidate image of the arbitrary image F1 selected by the user. If the images F1 and F2 are not a stereo pair in step S10, the process proceeds to step S20. If it is a stereo pair, the process proceeds to step S30, and a stereo pair candidate image is set. In steps S20 to S23, it is checked whether the patient information, the left and right eye information, the imaging mode, and the fixation lamp position stored in the imaging information storage unit 3 of the images F1 and F2 match. Proceed to S24.

  In step S24, it is checked from the position information of the objective lenses of the images F1 and F2 whether or not stereo shooting is performed by moving a base unit (not shown) of the ophthalmologic photographing apparatus 1 in the horizontal direction. If the base line length d indicating the difference between the left and right positions in the horizontal direction of the objective lens is in the range of d1 ≦ d ≦ d2 with respect to the arbitrary values d1 and d2, the process proceeds to step S30, and the image F2 is converted into a stereo pair for the image F1. It is determined that the image is a candidate image. In step S24, when the base line length d is within the range and the information on the vertical and vertical directions of the objective lens position information of the images F1 and F2 match, the process may proceed to step S30.

  If even one does not match in Steps S20 to S23, or if the baseline length d is out of range in Step S24, the process proceeds to Step S31, and it is determined that the image F2 is not a stereo pair candidate image for the image F1.

  FIG. 3 is a flowchart of optional conditions that are not necessarily required for the stereo establishment determination algorithm, and is used to narrow down candidates when there are a large number of images determined as stereo pair candidate images in the flowchart of FIG. . If it is determined in step 40 that the image is a stereo pair candidate image, the process proceeds to step S50. If it is not a stereo pair candidate image, the determination ends. In steps S50 to S53, it is checked whether the inspection information, the image size, the zoom ratio, and the shooting angle of view of the images F1 and F2 match each other. If they match, the process proceeds to step S54.

  In step S54, it is checked from the shooting time information of the images F1 and F2 whether or not the two images F1 and F2 have been subjected to stereo shooting in a series of sequences. If the difference t between the photographing times of the two images F1 and F2 is in the range of t1 ≦ t ≦ t2 with respect to the arbitrary values t1 and t2, the process proceeds to step S60, and the stereo pair candidate image for the image F1 is processed. It is determined that If even one does not match in steps S50 to S53, or if the difference t in photographing time is out of range in step S54, the process proceeds to step S61, and it is determined that the image F2 is not a stereo pair candidate image.

  FIG. 4 shows an example of an image selection method for performing appropriate stereo display in the first embodiment. The image selection control unit 4 displays a plurality of images stored in the image storage unit 2 as thumbnails. When the user selects the image F1 from the thumbnails, the image selection assist control unit 7 selects all the images on the thumbnails other than F1. Identify stereo pair images. The image selection assist control unit 7 assists the image F2 determined as the stereo pair candidate image by the stereo establishment determination algorithm of FIG. 3 by changing the frame color of each image displayed on the thumbnail to a color different from the other images. I do. Since the user selects an appropriate image and performs a stereo display depending on the assist-displayed color, a stereo display with an inappropriate image can be prevented.

  FIG. 5 is a flowchart of a stereo establishment determination algorithm according to the second embodiment. How suitable is an arbitrary image F2 stored in the image storage unit 2 as a stereo pair candidate image for the arbitrary image F1 selected by the user. The reliability of whether or not

  First, if the images F1 and F2 are a stereo pair in step S70, it is determined in step S80 that the image F2 has been registered as a stereo pair, and if not, the process proceeds to step S90. When the process proceeds to step S80, the image F2 may be determined to have the highest reliability as a stereo pair candidate image.

  In steps S90 to S93, it is checked whether the patient information, the left and right eye information, the imaging mode, and the fixation lamp position of the images F1 and F2 match each other. If they match, the process proceeds to step S94. In step S94, it is checked from the position information of the objective lens of the images F1 and F2 whether the base portion of the ophthalmologic photographing apparatus 1 is moved in the horizontal direction and the stereo photographing is performed. That is, if the baseline length d indicating the difference between the horizontal positions of the objective lens of the ophthalmologic photographing apparatus 1 is in the range of d1 ≦ d ≦ d2, the process proceeds to step S100. At this time, when the base line length d is within the range and the information on the vertical and vertical directions of the objective lens position information of the images F1 and F2 is the same, the process may proceed to step S100.

  If even one does not match in steps S90 to S93, or if the base line length d is out of range in step S94, the process proceeds to step S81, where the reliability of the image F1 as the stereo pair candidate image is low and the stereo pair is not established. judge.

  Finally, in steps S100 to S103, it is checked whether the inspection information, the image size, the zoom ratio, and the angle of view of the images F1 and F2 match each other. If they match, the process proceeds to step S104. In step S104, it is checked from the shooting time information of the images F1 and F2 whether stereo shooting of two images has been performed in a series of sequences. If the difference t in photographing time is within the range of t1 ≦ t ≦ t2, the process proceeds to step S82, and it is determined that the reliability of the image F2 as a stereo pair candidate image is high. If even one does not match in steps S100 to S103, or if the difference in shooting time is out of range in step S104, the process proceeds to step S83, and the reliability of the image F2 as a stereo pair candidate image is determined to be medium.

  In the above-described determination, the stereo establishment reliability can be quantified by weighting the number of items satisfying the condition, the essential condition, or the optional condition.

  FIG. 6 shows an example of an image selection method for performing appropriate stereo display. The image selection control unit 4 displays the images stored in the image storage unit 2 as thumbnails. When the user selects the image F11 from the thumbnails, the image selection assist control unit 7 displays all the images on the thumbnails other than the image F11. The stereo establishment reliability for the image F11 is determined. When it is determined in this determination of stereo establishment reliability that the reliability of the image F21 has been registered as a pair, the image selection assist control unit 7 sets the image F21 to the selected state, and the user presses the stereo display button 10. A stereo image is displayed on the stereo image display unit 5.

  At this time, the image selection assist control unit 7 may select the image F21 and perform a control of pressing the stereo display button 10 to display the images F1 and F2 in stereo. In the determination of the stereo establishment reliability described above, when the image F21 has a high reliability as a stereo pair candidate image and the image F31 has a medium reliability, each of the images F21 and F31 displayed on the thumbnail is displayed. It is preferable to display in a state where the frame color is different from that of other images.

  The image selection assist control unit 7 assists in making a difference in the displayed color, such as adding a dark color to the high-reliability image F21 and a light color to the medium-reliability image F31 according to the reliability by the color of the frame line. Display. Since the user selects an appropriate image and performs stereo display depending on the displayed color, it is possible to prevent an inappropriate image from being displayed in stereo.

  FIG. 7 is a block circuit configuration diagram of the ophthalmologic imaging system according to the third embodiment, and an image search control unit 8 is provided instead of the image selection assist control unit 7 in the configuration diagram of FIG.

  FIG. 8 shows an example of a stereo pair search for performing appropriate stereo display in the third embodiment. The image selection control unit 4 displays the images stored in the image storage unit 2 as thumbnails. When the user selects the image F101 from the thumbnails, the image search control unit 8 searches for the other image of the stereo pair. The search is performed for all images other than the thumbnail-displayed image F101. At this time, the search target may be performed for all images stored in the image storage unit 2 or a subset thereof.

  First, the image search control unit 8 determines whether an arbitrary image Fx to be searched is a stereo pair candidate image of the image F101 selected by the user according to the procedure of the algorithm of FIG. When there are a plurality of stereo pair candidate images, the reliability of the stereo pair candidate image is determined by the procedure of the algorithm of FIG. 5 of the second embodiment, and the image determined to have the highest reliability is used as the search result. You can also.

  In addition, when there are a plurality of images determined to have the same reliability as stereo pair candidate images, the image search control unit 8 examines the shooting time information and determines the image having the latest shooting time as a series of stereo images. It is good also as a search result made into the image which the user judged appropriate by imaging | photography.

  When an image F102 of a pair image with respect to the image F101 is obtained as a search result, the image search control unit 8 puts the image F102 into a selected state. When the user presses the stereo display button 10, the stereo images of the images F <b> 101 and F <b> 102 are displayed on the stereo image display unit 5. At this time, the image search control unit 8 may automatically display the images F <b> 101 and F <b> 102 by selecting the image F <b> 102 and automatically pressing the stereo display button 10.

  When the user performs stereo display in the first to third embodiments, a stereo display screen is displayed. FIG. 9 shows a stereo display screen of the stereo image display unit 5 for displaying two images. A stereo pair information addition button 21 and a stereo pair information deletion button 22 constituting the stereo pair information addition unit 6 are provided.

When the stereo display screen is opened, if the two images being displayed are not stereo pairs, the delete button 22 is disabled and the add button 21 is enabled. In the case of a stereo pair, the delete button 22 is enabled and the add button 21 is disabled to prevent user operation errors.
When the user presses the add button 21, information that the two images being displayed are a stereo pair is stored in the photographing information storage unit 3. When the user presses the delete button 22, it is possible to register an appropriate stereo pair image by deleting the stereo pair information held by the two displayed images from the shooting information storage unit 3. Can be prevented from being displayed in stereo.

  The stereo pair information may overlap. For example, when the images F1 ′ and F2 ′ are stereo pairs and the images F2 ′ and F3 ′ are also pairs, the image F2 ′ has overlapping pair information. Become. It should be noted that by duplication of the pair information, it is possible to register a stereoscopic method such as a parallel method or a crossing method, or pair information corresponding to individual differences of users to be observed.

DESCRIPTION OF SYMBOLS 1 Ophthalmic imaging device 2 Image memory | storage part 3 Shooting information memory | storage part 4 Image selection control part 5 Stereo image display part 6 Stereo pair information addition part 7 Image selection assist control part 8 Image search control part 10 Stereo display button 21 Stereo pair information addition button 22 Delete stereo pair information button

Claims (10)

  Imaging means for imaging the eye to be inspected, image storage means for storing the captured image, imaging information output from the imaging means and imaging information storage means for storing the captured image in association with each other, and two stereo pairs Stereo display means for displaying images in stereo, image selection means for selecting a stereo pair candidate image from a plurality of images for an arbitrary image taken by the photographing means, and appropriate for selecting an image by the image selection means An ophthalmologic photographing system comprising: an image selection assisting means for prompting selection of an image; and stereo pair information adding means for adding stereo pair information of an arbitrary image to the photographing information storage means.   When the user selects an arbitrary image with the image selection means, and there is a plurality of stereo pair information in the selected image, the image selection assist means displays an assist display so that the user can select the stereo pair candidate image. The ophthalmic imaging system according to claim 1, wherein the ophthalmic imaging system is performed.   When the user selects an arbitrary image with the image selection unit, the selected image and the image storage unit are stored in the patient information, the imaging mode, the left and right eye information, and the fixation lamp position, respectively, and the objective lens If the left and right baseline lengths are in an arbitrary range, it is determined that a stereo pair has been established and the stereo pair candidate images are present. If there are many stereo pair candidate images, inspection information, image size, change The candidate image is narrowed down by checking whether the magnification and the field angle of view are the same and the difference in the shooting time is within an arbitrary range, and the image selection assist means performs an assist display so that the user can select. The ophthalmologic imaging system according to claim 1.   The stereo pair establishment determination determines the reliability of stereo establishment by combining conditions, and the image selection assisting means displays according to the reliability when performing the assist display. The described ophthalmic imaging system.   An imaging unit for imaging the eye to be examined, an image storage unit for storing the captured image, an imaging information storage unit for storing the imaging information output from the imaging unit in association with the captured image, and two images Stereo display means for performing stereo display, image search means for searching for an image from a plurality of images taken by the photographing means, and stereo pair information adding means for adding stereo pair information of the arbitrary image to the photographing information storage means An ophthalmologic photographing system characterized by comprising:   When the user selects an arbitrary image by the image selection means, the image search means uses the pair image as a search result when the selected image has the stereo pair information, and establishes a stereo pair when there is no stereo pair information. 6. The ophthalmologic imaging system according to claim 5, wherein a stereo pair candidate image is searched by the determination.   When the user selects an arbitrary image by the image selection means, the image search means searches for an image established as a stereo pair with the selected image from the images stored in the image storage means, It is determined that the stereo pair is established when the patient information, the imaging mode, the left and right eye information, and the fixation lamp position of the image match, and the left and right baseline lengths of the objective lens are within an arbitrary range. If there are many stereo pair candidate images, and the inspection information, image size, zoom ratio, and shooting angle of view match, and the difference in shooting time is within an arbitrary range The ophthalmic imaging system according to claim 5, wherein the stereo pair candidate image is used as a narrowing search result.   8. The ophthalmologic imaging system according to claim 7, wherein the image search means uses a last captured image as a search result when a plurality of stereo pair candidate images exist in the search.   6. The ophthalmologic imaging system according to claim 1 or 5, wherein the stereo pair information adding means can add the stereo pair information.   The ophthalmologic photographing system according to claim 9, wherein the stereo pair information adding unit has the stereo pair information in which images overlap.

Images