CN112971705A - Eye movement compensation image stabilizing device applied to eye fundus imaging instrument - Google Patents
Eye movement compensation image stabilizing device applied to eye fundus imaging instrument Download PDFInfo
- Publication number
- CN112971705A CN112971705A CN202110294051.XA CN202110294051A CN112971705A CN 112971705 A CN112971705 A CN 112971705A CN 202110294051 A CN202110294051 A CN 202110294051A CN 112971705 A CN112971705 A CN 112971705A
- Authority
- CN
- China
- Prior art keywords
- image stabilization
- hyperspectral
- eye movement
- image
- eye
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/12—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/14—Arrangements specially adapted for eye photography
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Medical Informatics (AREA)
- Animal Behavior & Ethology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Ophthalmology & Optometry (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Eye Examination Apparatus (AREA)
Abstract
The invention discloses an eye movement compensation image stabilizing device applied to an eye fundus imaging instrument, which comprises: the system comprises a hyperspectral image acquisition unit, a scanning image stabilization module and an image processing system, wherein the hyperspectral image acquisition unit acquires single-frame hyperspectral sampled data from eyeground, and the image processing system performs hyperspectral row information homogenization correction on the single-frame hyperspectral sampled data to obtain an expanded image; and matching the expanded images corresponding to the single-frame hyperspectral sampled data, extracting eye movement information according to a matching result, and sending the eye movement information to a scanning image stabilization module for eye movement compensation image stabilization. The invention can realize precision superior to pixel level by utilizing image matching, not only can compensate the eye movement of the detected human eye, but also has higher image stabilization quality and can obtain more stable images, thereby improving the fundus imaging quality.
Description
Technical Field
The invention relates to the technical field of fundus imaging, in particular to an eye movement compensation image stabilizing device applied to a fundus imaging instrument.
Background
The human eye is an important visual organ and fundus imaging is often used to provide a diagnosis of fundus disease or certain systemic diseases. The human eye has eye movement, namely physiological fundus vibration, and the vibration can cause fundus imaging image blurring, reduce imaging quality and influence the diagnosis capability of diseases.
Most of eye movement compensation image stabilization technologies used by the existing eye fundus imaging equipment irradiate the eye fundus by using a beacon light source, focus the beacon light source on the eye fundus to form a light spot, monitor the movement of the light spot, calculate the eye movement amplitude and direction in real time according to the light spot displacement, and accordingly adjust the light path direction to perform eye movement compensation. Because the human eyes have aberration, the facula has a certain diffusion range on the eyeground, and the calculation precision of the facula displacement is reduced, so that the eye movement compensation precision is reduced, and the imaging quality is limited finally. In addition, the beacon light source increases the complexity of the light path; the images of the fundus region covered by the beacon light spots cannot collect effective information, and the improvement of the performance of the motion compensation image stabilization technology is restrained.
Disclosure of Invention
The invention aims to overcome the defects of an eye movement compensation image stabilization technology in the existing eye fundus imaging instrument, and provides an eye movement compensation image stabilization device applied to the eye fundus imaging instrument.
In order to solve the problems, the invention adopts the following technical scheme:
an eye movement compensation image stabilization device applied to an eye fundus imaging instrument comprises a hyperspectral image acquisition unit, a scanning image stabilization module and an image processing system, wherein the eye fundus imaging instrument comprises a scanning image stabilization module front light path, a scanning image stabilization module rear light path and a light splitting module;
the hyperspectral image acquisition unit receives light beams which are reflected by eyes of a detected person and contain fundus image information and pass through a front light path of the scanning image stabilization module, a rear light path of the scanning image stabilization module and the light splitting module, images the bottoms of the eyes, acquires single-frame hyperspectral sampled data, and sends the single-frame hyperspectral sampled data to the image processing system in real time, wherein the single-frame hyperspectral sampled data comprises a plurality of line images, and the line images correspond to images formed by the fundus of the detected eyes under different spectral bands;
the image processing system is used for performing hyperspectral row information homogenization correction on the received single-frame hyperspectral sampled data to obtain corresponding expanded images, matching the expanded images corresponding to the single-frame hyperspectral sampled data, extracting eye movement information according to a matching result and sending the eye movement information to the scanning image stabilizing module;
and the scanning image stabilization module performs eye movement compensation image stabilization according to the eye movement information.
Compared with the prior art, the invention has the following beneficial effects:
the invention provides an eye movement compensation image stabilization device applied to an eye fundus imaging instrument. Because the image matching can realize the precision superior to the pixel level, compared with the facula method of which the position precision is inferior to the pixel level, the invention not only can compensate the eye movement of the detected human eyes, but also has higher image stabilization quality, and can obtain more stable images, thereby improving the fundus imaging quality. Meanwhile, a beacon light path does not need to be specially designed for the hyperspectral image acquisition unit and the image processing system, and fundus facula is not generated, so that the method has remarkable advantages in the aspects of light path complexity, image information comprehensiveness and the like.
Drawings
Fig. 1 is a schematic structural diagram of an eye movement compensation image stabilization device applied to an eye fundus imaging instrument according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating an image processing system performing image processing on a single frame of hyperspectral sampled data according to an embodiment of the present invention.
Detailed Description
The technical solution of the present invention will be described in detail with reference to the accompanying drawings and preferred embodiments.
In one embodiment, as shown in fig. 1, the invention provides an eye movement compensation image stabilization device applied to a fundus imaging instrument, and the device comprises a hyperspectral image acquisition unit 1, a scanning image stabilization module 2 and an image processing system 3. The eye movement compensation image stabilization device of the embodiment is applied to an eye fundus imaging instrument, the eye fundus imaging instrument comprises a scanning image stabilization module front light path 5, a scanning image stabilization module rear light path 6 and a light splitting module 7, the scanning image stabilization module 2 is located between the scanning image stabilization module front light path 5 and the scanning image stabilization module rear light path 6, the hyperspectral image acquisition unit 1 is located behind the light splitting module 7, and the image processing system 3 is respectively connected with the hyperspectral image acquisition unit 1 and the scanning image stabilization module 2.
A light beam containing fundus image information reflected by a detected human eye 4 finally reaches the hyperspectral image acquisition unit 1 after passing through the scanning image stabilization module front light path 5, the scanning image stabilization module 2, the scanning image stabilization module rear light path 6 and the light splitting module 7, the hyperspectral image acquisition unit 1 receives the light beam, images the eye fundus and acquires single-frame hyperspectral sampling data, wherein the single-frame hyperspectral sampling data is a single-frame fundus image acquired by the hyperspectral image acquisition unit 1, the single-frame hyperspectral sampling data comprises a plurality of line images, the plurality of line images correspond to images formed by the fundus of the detected human eye 4 under different spectral bands, namely the image content of each line image is the same, and only the spectral bands are different. The hyperspectral image acquisition unit 1 sends acquired single-frame hyperspectral sampling data to the image processing system 3 in real time. The hyperspectral image acquisition unit 1 may be an imaging module of a fundus imaging apparatus or an imaging module added for performing an eye movement compensation image stabilization function, and is generally in the form of, but not limited to, a CCD sensor or a CMOS sensor.
The image processing system 3 is used for performing image processing on the received single-frame hyperspectral sampled data, extracting eye movement information, and then sending the extracted eye movement information to the scanning image stabilization module 2. Specifically, as shown in fig. 2, the image processing process of the image processing system 3 includes the steps of:
step 31: and carrying out hyperspectral row information homogenization correction on the single-frame hyperspectral sampled data to obtain a corresponding expanded image.
The hyperspectral row information uniformization correction of the single-frame hyperspectral sampled data refers to brightness correction of different row images of the single-frame hyperspectral sampled data. Since the reflectivity of the fundus region is different for different spectral bands, the overall brightness of each line image corresponding to the different spectral bands is also different. According to the reflectivity relation between the fundus region and the spectrum band, the integral brightness of each line of images can be subjected to homogenization correction to obtain fundus images with basically uniform brightness, and then the unfolded images corresponding to the single-frame hyperspectral sampling data can be obtained. In the prior art, various algorithms can realize uniform correction of brightness, and are not described herein again, and any algorithm for correcting an image according to the method of the present invention in the context of the application of the present invention is within the scope of the present invention. Besides the correction measures, the image preprocessing measures required for implementing the measures are also within the scope of the invention.
Step 32: and matching the expanded images corresponding to the single-frame hyperspectral sampled data.
In hyperspectral fundus imaging, the morphological characteristics of the fundus are reserved in each spectral band, and the obtained spread image after the hyperspectral line information is uniformized and corrected can be used as characteristic information for image matching, so that two or more spread images can be subjected to image matching according to the characteristic information, and the accuracy of image matching can be improved due to the adoption of different spectral band imaging. In the prior art, various algorithms can realize image matching, and are not described herein again, and all algorithms for matching images according to the method of the present invention in the application context of the present invention are within the protection scope of the present invention. In addition, in addition to the matching measures described in the present invention, image preprocessing measures such as, but not limited to, correcting distortion, adjusting image contrast, etc. required for implementing the measures described in the present invention are also within the scope of the present invention.
Step 33: and extracting eye movement information according to the matching result.
After the expanded images are matched in step 32, eye movement information is extracted according to the matching result, that is, the eye movement offset during sampling of each frame of image is calculated according to the image displacement information in the matching error and the optical path structure information, so that the eye movement information for the scanning image stabilization module 2 to perform eye movement compensation image stabilization is obtained.
The image processing system 3 in this embodiment represents a hardware implementation body that performs digital image processing measures such as hyperspectral row information normalization correction, expansion image matching, eye movement information extraction, and the like on a single frame of hyperspectral sampled data provided by the hyperspectral image acquisition unit 1. Usually, these digital image processing measures are completed by a special computer, the hyperspectral image acquisition unit 1 sends data to the computer to complete the above digital image processing measures, and finally, eye movement information is output to the scanning image stabilization module 2 to perform eye movement compensation image stabilization, and at this time, the special computer is the expression form of the image processing system 3.
The scanning image stabilization module 2 adjusts the swinging angle according to the eye movement information, thereby realizing the eye movement compensation image stabilization. Alternatively, the scanning image-stabilizing module 2 may be an optical path deflecting mechanism of the fundus imaging apparatus, and is generally, but not limited to, a plane mirror capable of rapidly swinging in one-dimensional or two-dimensional directions.
Further, the scanning image stabilization module front optical path 5 in the present embodiment includes, but is not limited to, optical path components required by fundus imaging instruments such as a focusing mechanism, a myopia compensation mechanism, etc., which are located in front of the scanning image stabilization module 2.
Further, the post-scan image stabilization module optical path 6 in this embodiment includes, but is not limited to, optical path components required by fundus imaging equipment, such as an adaptive aberration correction optical path, to be located behind the scan image stabilization module 2.
Further, the scanning image stabilization module front optical path 5 and the scanning image stabilization module rear optical path 6 in this embodiment further include other required optical path components such as fundus illumination, an adaptive aberration measurement optical path, and the like. These optical path components are common to various fundus imaging apparatuses, and can be applied to the eye movement compensation image stabilization device applied to the fundus imaging apparatus of the present invention. The invention also discloses a method for applying the eye movement compensation image stabilization device to the eye fundus imaging instrument in various eye fundus instruments.
The invention provides an eye movement compensation image stabilization device applied to an eye fundus imaging instrument. Because the image matching can realize the precision superior to the pixel level, compared with the facula method of which the position precision is inferior to the pixel level, the invention not only can compensate the eye movement of the detected human eyes, but also has higher image stabilization quality, and can obtain more stable images, thereby improving the fundus imaging quality. Meanwhile, a beacon light path does not need to be specially designed for the hyperspectral image acquisition unit and the image processing system, and fundus facula is not generated, so that the method has remarkable advantages in the aspects of light path complexity, image information comprehensiveness and the like.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (5)
1. The utility model provides an eye movement compensation image stabilization device for eye ground imaging instrument which characterized in that: the eyeground imaging instrument comprises a hyperspectral image acquisition unit (1), a scanning image stabilization module (2) and an image processing system (3), wherein the eyeground imaging instrument comprises a scanning image stabilization module front light path (5), a scanning image stabilization module rear light path (6) and a light splitting module (7), the scanning image stabilization module (2) is positioned between the scanning image stabilization module front light path (5) and the scanning image stabilization module rear light path (6), the hyperspectral image acquisition unit (1) is positioned behind the light splitting module (7), and the image processing system (3) is respectively connected with the hyperspectral image acquisition unit (1) and the scanning image stabilization module (2);
the hyperspectral image acquisition unit (1) receives light beams which are reflected by a detected human eye (4) and pass through the scanning image stabilization module front light path (5), the scanning image stabilization module (2), the scanning image stabilization module rear light path (6) and the light splitting module (7) and contain fundus image information, images the fundus, acquires single-frame hyperspectral sampling data and sends the single-frame hyperspectral sampling data to the image processing system (3) in real time, the single-frame hyperspectral sampling data comprise a plurality of line images, and the line images correspond to images formed by the fundus of the detected human eye (4) under different spectral bands;
the image processing system (3) is used for performing hyperspectral row information homogenization correction on the received single-frame hyperspectral sampled data to obtain corresponding expanded images, matching the expanded images corresponding to the single-frame hyperspectral sampled data, extracting eye movement information according to a matching result, and sending the eye movement information to the scanning image stabilizing module (2);
and the scanning image stabilization module (2) performs eye movement compensation image stabilization according to the eye movement information.
2. The eye movement compensation image stabilization device applied to a fundus imaging instrument according to claim 1, wherein:
the hyperspectral image acquisition unit (1) is a CCD sensor or a CMOS sensor.
3. The eye movement compensation image stabilization device applied to the fundus imaging instrument according to claim 1 or 2, wherein:
the scanning image stabilization module is a plane mirror capable of rapidly swinging in one-dimensional or two-dimensional directions.
4. The eye movement compensation image stabilization device applied to the fundus imaging instrument according to claim 1 or 2, wherein:
and the front light path (5) of the scanning image stabilizing module comprises a focusing mechanism and a myopia compensation mechanism.
5. The eye movement compensation image stabilization device applied to the fundus imaging instrument according to claim 1 or 2, wherein:
the scanning image stabilization module rear light path (6) comprises an adaptive aberration correction light path.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110294051.XA CN112971705A (en) | 2021-03-19 | 2021-03-19 | Eye movement compensation image stabilizing device applied to eye fundus imaging instrument |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110294051.XA CN112971705A (en) | 2021-03-19 | 2021-03-19 | Eye movement compensation image stabilizing device applied to eye fundus imaging instrument |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112971705A true CN112971705A (en) | 2021-06-18 |
Family
ID=76333348
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110294051.XA Pending CN112971705A (en) | 2021-03-19 | 2021-03-19 | Eye movement compensation image stabilizing device applied to eye fundus imaging instrument |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112971705A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010259543A (en) * | 2009-04-30 | 2010-11-18 | Nidek Co Ltd | Fundus photographing device |
| CN205625890U (en) * | 2016-03-29 | 2016-10-12 | 孙明斋 | High spectrum eye ground imaging system |
| CN107224267A (en) * | 2017-06-12 | 2017-10-03 | 中国科学院西安光学精密机械研究所 | Fundus hyperspectral imaging device |
| CN109924942A (en) * | 2019-04-25 | 2019-06-25 | 南京博视医疗科技有限公司 | A kind of photorefractive crystals method and system based on Line-scanning Image Acquisition System |
| CN110301886A (en) * | 2019-06-28 | 2019-10-08 | 南京博视医疗科技有限公司 | A kind of optical system and its implementation of real-time closed-loop control fundus camera |
| CN111528792A (en) * | 2020-05-12 | 2020-08-14 | 宁波蓝明信息科技有限公司 | Rapid hyperspectral fundus imaging method based on spectral information compression and recovery |
-
2021
- 2021-03-19 CN CN202110294051.XA patent/CN112971705A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010259543A (en) * | 2009-04-30 | 2010-11-18 | Nidek Co Ltd | Fundus photographing device |
| CN205625890U (en) * | 2016-03-29 | 2016-10-12 | 孙明斋 | High spectrum eye ground imaging system |
| CN107224267A (en) * | 2017-06-12 | 2017-10-03 | 中国科学院西安光学精密机械研究所 | Fundus hyperspectral imaging device |
| CN109924942A (en) * | 2019-04-25 | 2019-06-25 | 南京博视医疗科技有限公司 | A kind of photorefractive crystals method and system based on Line-scanning Image Acquisition System |
| CN110301886A (en) * | 2019-06-28 | 2019-10-08 | 南京博视医疗科技有限公司 | A kind of optical system and its implementation of real-time closed-loop control fundus camera |
| CN111528792A (en) * | 2020-05-12 | 2020-08-14 | 宁波蓝明信息科技有限公司 | Rapid hyperspectral fundus imaging method based on spectral information compression and recovery |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105453133B (en) | Image processing apparatus and method, eye fundus image processing unit, image capturing method and eye fundus image filming apparatus and method | |
| US20120133888A1 (en) | scanning ophthalmoscopes | |
| EP2314986A1 (en) | Optical tomographic image generation method and optical tomographic image generation apparatus | |
| JPWO2012026597A1 (en) | Image processing apparatus and method | |
| JP6909109B2 (en) | Information processing equipment, information processing methods, and programs | |
| US9775515B2 (en) | System and method for multi-scale closed-loop eye tracking with real-time image montaging | |
| JP2017006424A (en) | Image generation apparatus and image generation method | |
| US7549745B2 (en) | Apparatus and method for correcting for aberrations in a lens system | |
| US20210290050A1 (en) | Ocular fundus image processing apparatus | |
| CN112971705A (en) | Eye movement compensation image stabilizing device applied to eye fundus imaging instrument | |
| CN110063714B (en) | Optical coherence tomography device | |
| CN115737272A (en) | Calibration method and device of laser treatment system | |
| US11426072B2 (en) | Ophthalmic scanning system and method | |
| JP6798096B2 (en) | Fundus photography device | |
| WO2021038847A1 (en) | Image processing method, image processing device, and program | |
| JP2021153786A (en) | Image processing device, image processing method and program | |
| JP2021079013A (en) | Medical image processing device, processing method for medical image processing device and program | |
| WO2021246291A1 (en) | Oct data processing device and oct data processing program | |
| CN112971699B (en) | Two-stage image stabilizing device applied to eye movement compensation of eye fundus imaging instrument | |
| CN110558943A (en) | optical imaging method, related device and system | |
| CN114748086B (en) | CT scanning method and system, electronic device and computer readable storage medium | |
| JP2017086807A (en) | Image acquisition device and driving method of the same, and program | |
| JP2022057576A (en) | Fundus image processing program and fundus imaging apparatus | |
| JP6833455B2 (en) | Ophthalmologic imaging equipment and its control method, ophthalmologic imaging system, and programs | |
| JP2021186465A (en) | Fundus image processing program and fundus imaging apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20210618 |