CN108324242A - A kind of multispectral fundus imaging device and method based on intelligent terminal - Google Patents

A kind of multispectral fundus imaging device and method based on intelligent terminal Download PDF

Info

Publication number
CN108324242A
CN108324242A CN201711498933.8A CN201711498933A CN108324242A CN 108324242 A CN108324242 A CN 108324242A CN 201711498933 A CN201711498933 A CN 201711498933A CN 108324242 A CN108324242 A CN 108324242A
Authority
CN
China
Prior art keywords
intelligent terminal
multispectral
image
imaging device
lens
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201711498933.8A
Other languages
Chinese (zh)
Other versions
CN108324242B (en
Inventor
陈硕
李洪涛
何阳子
张立
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Northeastern University China
Original Assignee
Northeastern University China
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Northeastern University China filed Critical Northeastern University China
Priority to CN201711498933.8A priority Critical patent/CN108324242B/en
Publication of CN108324242A publication Critical patent/CN108324242A/en
Application granted granted Critical
Publication of CN108324242B publication Critical patent/CN108324242B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/14Arrangements specially adapted for eye photography
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/12Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes

Abstract

The present invention relates to medical treatment & health fields, disclose a kind of multispectral fundus imaging device and method based on intelligent terminal.Device includes lighting module, eye fundus image acquisition module and data processing module;The flash lamp LED that lighting module is carried by intelligent terminal provides the illumination of retina through different optical filters, and eye fundus image acquisition module is to obtain image using intelligent terminal camera.Coloured image in a collected wavelength range under specific wavelength completes the acquisition of eyeground multispectral image after the rebuilding spectrum of rgb value to spectral value.Collected eyeground multispectral image passes through data processing module, can be uploaded to internet high in the clouds, and result is fed back to intelligent terminal after progress artificial intelligence diagnosis beyond the clouds.Promote the convenience of multispectral eyeground imaging system;Reduce equipment cost;Promote medical information, realize the diagnostic accuracy near or above doctor, be conducive to that patient is assisted to carry out self interrogation, improves working efficiency and make the reasonable disposition of medical resource.

Description

A kind of multispectral fundus imaging device and method based on intelligent terminal
Technical field
The present invention relates to medical treatment & health fields, and in particular to a kind of multispectral fundus imaging device based on intelligent terminal and Method.
Background technology
With the promotion of living standards of the people and the arrival of countries population's aging, movement is healthy, family, personal just The formula care medicine of taking is more universal.And human eye retina is that have one of observed object of important clinical significance.It is regarded by observation The variation of nethike embrane, it can be achieved that a variety of diseases such as fundus oculi disease even cardiovascular and cerebrovascular diagnosis.
Because it is different by the depth on eyeground and by the absorption of different material difference not share the same light, it can pass through and select suitable wave Long light obtains eyeground different level image and more abundant biomedical information.However, existing multispectral eyeground Imaging system majority uses complex and bulky structure, and the portability of equipment is poor and of high cost, usually only a small number of Grade A hospital be equipped with this equipment.And for home-bound patient, this inspection is time-consuming and laborious, while expensive price makes It obtains the detection methods to be difficult to promote, undoubtedly so that this test mode can not make vast general patient be benefited.
The major defect of the prior art:
(1) existing multispectral eyeground imaging system volume is larger and more heavy, and portability is poor.
(2) existing multispectral eyeground imaging system equipment cost is higher.Its expensive equipment cost leads to examining for patient Disconnected cost is higher, and is unfavorable for popularization of the equipment in middle and small hospital.
(3) existing multispectral eyeground imaging system equipment opening is low, is unfavorable for the people based on internet and big data Work intelligent diagnostics.
Invention content
For above disadvantage, the present invention designs a set of multispectral fundus imaging device and method based on intelligent terminal, By being attached on intelligent terminal after integrating light path, the acquisition for eyeground multispectral image is realized.Meanwhile utilizing intelligent end The internet function at end realizes tele-medicine and the artificial intelligence diagnosis based on big data and deep learning.
To achieve the above object, the specific technical solution of the present invention is:
A kind of multispectral fundus imaging device based on intelligent terminal, including lighting module, eye fundus image acquisition module and Data processing module;Wherein, lighting module includes the intelligent terminal LED light coaxially set gradually from inside to outside along intelligent terminal Source, lens A, the optical filter on optical filter runner, diffusion sheet, linear polarizer A and speculum;Eye fundus image acquisition module includes Intelligent terminal camera, lens B, light splitting piece, linear polarizer B and the lens coaxially set gradually from inside to outside along intelligent terminal C;Lighting module is parallel with the axis of eye fundus image acquisition module;Meanwhile reflective mirror is placed with linear polarizer A in 45° angle degree, Reflective mirror is parallel to light splitting piece, and the light for LED light source to be emitted converges to light splitting piece by lighting module by reflective mirror, Retina is focused on using lens B;Data processing module is used to that retina multispectral image to be sent to cloud using internet It holds and feeds back to intelligent terminal after obtaining diagnostic result by artificial intelligence diagnosis' method based on deep learning.
Further, be uniformly distributed along the circumference the optical filters of different specified wavelengths on the optical filter runner.
Further, the intelligent terminal LED light source of the lighting module is located at the focal point of lens A, is used for point light source It is changed into directional light.
Further, the intelligent terminal camera is located at lens C focal points, and linear polarizer A and linear polarizer B Polarization direction be mutually perpendicular to, for eliminating the reflected light generated by mirror-reflection.
A kind of method of above-mentioned multispectral fundus imaging device based on intelligent terminal, includes the following steps:
The multispectral fundus imaging device is fitted to as peripheral hardware part on all kinds of intelligent terminals, each optics by step 1 Component parameters are adjusted according to the actual demand of shooting eyeground area size, rotating filtering piece runner, pass through the specified wave of difference Long length filter acquires multiple color images;
Step 2 realizes the reconstruction of multispectral image by rebuilding spectrum algorithm;
Gray scale is converted to by multiple coloured images under light sources with different wavelengths are collected based on image registration and ant-shaking algorithm Image, then pass through formula:
Ical(λ)=Iorigin(λ)*wc(λ)
Complete the conversion of spectral value in rgb value to spectrum picture in coloured image;Wherein Ical(λ) is indicated in af at wavelength lambda Calibration intensity, Iorigin(λ) indicates its green strength, wc(λ) indicates the weight coefficient under respective wavelength;Wherein weight factor wc The computational methods of (λ) are:Prepare one piece of standard white plate to obtain in the light projection to blank of the different wave length of intelligent terminal not The mean intensity of blank under co-wavelength finds out the mean intensity under maximum value and difference divided by each wavelength, obtains corresponding wavelength Under weight factor wc(λ);
Step 3 after eyeground multispectral image is passed to internet high in the clouds, is based on big data and depth by data processing module Degree learns the relational model of established multispectral image and fundus oculi disease, realizes artificial intelligence diagnosis, and diagnostic result is fed back Return intelligent terminal.
Beneficial effects of the present invention are that the multispectral fundus imaging device and method based on intelligent terminal has following Advantage:
1) convenience of multispectral eyeground imaging system is promoted;
2) equipment cost is reduced, and avoids high maintenance and staff training expense;
3) promote medical information.Eyeground multispectral image will realize networked interactive by mobile phone, promote medical information one Body, and then realize tele-medicine and internet+medical treatment, be conducive to the raising of the medical diagnosis level of remote districts.
4) artificial intelligence diagnosis based on big data and internet have, it can be achieved that diagnostic accuracy near or above doctor Self interrogation is carried out conducive to auxiliary patient, improves the working efficiency of doctor and the reasonable disposition of medical resource.
Description of the drawings
Fig. 1 is the light path design figure of the present invention;
In figure:1LED light sources;2 lens A;3 optical filter runners;4 diffusion sheets;5 linear polarizer A;6 speculums;7 human eyes;8 Lens B;9 light splitting pieces;10 linear polarizer B;11 lens C;12 intelligent terminal cameras.
Specific implementation mode
It elaborates below in conjunction with the accompanying drawings to the specific implementation of the present invention.
Embodiment 1
The light path design of the present invention is as shown in Figure 1, it can be achieved that Mobile multi-spectrum is imaged.Mainly by a set of lighting module and Eye fundus image acquisition module forms.Wherein lighting module, as light source, light passes through the flash lamp LED carried by intelligent terminal Lens A is converted to directional light, passes through optical filter screening different on optical filter runner later and generates the light for selecting wavelength.Then, The speculum and spectroscope that the light of specific wavelength is placed by diffusion sheet, linear polarizer A and 45° angle degree, using lens B Focus on retina.Retinal images are put through lens B, spectroscope, linear polarizer B and lens C by the light of retinal reflex Greatly and it is imaged on intelligent terminal camera.Wherein, linear polarizer A is combined with linear polarizer B for eliminating by minute surface Reflect the reflected light generated.
Based on above-mentioned apparatus, plurality of pictures progress image registration algorithm stabilization processing is acquired in a wavelength range, is obtained The image arrived carries out conversion of the RGB color image to gray level image first, then following equation is used to carry out rebuilding spectrum:
I (λ)=I0(λ)*w(λ)
Wherein I (λ) indicates the calibration intensity in af at wavelength lambda, I0(λ) indicates that its green strength, w (λ) are indicated in corresponding wave Weight coefficient under long, computational methods are:Prepare one piece of standard white plate, by the light projection of the different wave length of intelligent terminal in vain On plate, detection obtains the mean intensity of blank under different wave length, finds out maximum value therein and respectively divided by under each wavelength Mean intensity obtains the weight factor w (λ) under corresponding wavelength.After being passed to high in the clouds via internet, it is based on big data and depth The relational model of established eyeground multispectral image and fundus oculi disease is practised, realizes artificial intelligence diagnosis, and diagnostic result is fed back Return intelligent terminal.

Claims (6)

1. a kind of multispectral fundus imaging device based on intelligent terminal, which is characterized in that adopted including lighting module, eye fundus image Collect module and data processing module;Wherein, lighting module includes the intelligently end coaxially set gradually from inside to outside along intelligent terminal Hold LED light source, lens A, the optical filter on optical filter runner, diffusion sheet, linear polarizer A and speculum;Eye fundus image acquires Module includes intelligent terminal camera, lens B, light splitting piece, the linear polarization coaxially set gradually from inside to outside along intelligent terminal Piece B and lens C;Lighting module is parallel with the axis of eye fundus image acquisition module;Meanwhile reflective mirror and linear polarizer A are in 45 ° Angle is placed, and reflective mirror is parallel to light splitting piece, and the light for LED light source to be emitted is converged to by lighting module by reflective mirror On light splitting piece, retina is focused on using lens B;Data processing module is used to utilize internet by retina multispectral image It is sent to high in the clouds and feeds back to intelligent terminal after obtaining diagnostic result by artificial intelligence diagnosis' method based on deep learning.
2. a kind of multispectral fundus imaging device based on intelligent terminal according to claim 1, which is characterized in that described Optical filter runner on be uniformly distributed along the circumference the optical filters of different specified wavelengths.
3. a kind of multispectral fundus imaging device based on intelligent terminal according to claim 1 or 2, which is characterized in that The intelligent terminal LED light source of the lighting module is located at the focal point of lens A, for point light source to be changed into directional light.
4. a kind of multispectral fundus imaging device based on intelligent terminal according to claim 1 or 2, which is characterized in that The intelligent terminal camera is located at lens C focal points, and the polarization direction of linear polarizer A and linear polarizer B is mutually hung down Directly, it is used to eliminate the reflected light generated by mirror-reflection.
5. a kind of multispectral fundus imaging device based on intelligent terminal according to claim 3, which is characterized in that described Intelligent terminal camera is located at lens C focal points, and linear polarizer A and the polarization direction of linear polarizer B are mutually perpendicular to, and uses In the reflected light that elimination is generated by mirror-reflection.
6. the method for any multispectral fundus imaging devices based on intelligent terminal of claim 1-5, which is characterized in that packet Include following steps:
The multispectral fundus imaging device is fitted to as peripheral hardware part on all kinds of intelligent terminals, each optical element by step 1 Parameter is adjusted according to the actual demand of shooting eyeground area size, and rotating filtering piece runner is filtered by different specified wavelengths Mating plate acquires multiple color images;
Step 2 realizes the reconstruction of multispectral image by rebuilding spectrum algorithm;
Gray level image is converted to by multiple coloured images under light sources with different wavelengths are collected based on image registration and ant-shaking algorithm, Pass through formula again:
Ical(λ)=Iorigin(λ)*wc(λ)
Complete the conversion of spectral value in rgb value to spectrum picture in coloured image;Wherein Ical(λ) indicates the calibration in af at wavelength lambda Intensity, Iorigin(λ) indicates its green strength, wc(λ) indicates the weight coefficient under respective wavelength;Wherein weight factor wc(λ) Computational methods be:Prepare one piece of standard white plate and obtains different waves by the light projection to blank of the different wave length of intelligent terminal The mean intensity of long lower blank, finds out the mean intensity under maximum value and difference divided by each wavelength, obtains under corresponding wavelength Weight factor wc(λ);
Step 3 after eyeground multispectral image is passed to internet high in the clouds, is based on big data and depth by data processing module The relational model of established multispectral image and fundus oculi disease is practised, realizes artificial intelligence diagnosis, and diagnostic result is fed back into intelligence It can terminal.
CN201711498933.8A 2017-12-28 2017-12-28 A kind of multispectral fundus imaging device and method based on intelligent terminal Active CN108324242B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711498933.8A CN108324242B (en) 2017-12-28 2017-12-28 A kind of multispectral fundus imaging device and method based on intelligent terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711498933.8A CN108324242B (en) 2017-12-28 2017-12-28 A kind of multispectral fundus imaging device and method based on intelligent terminal

Publications (2)

Publication Number Publication Date
CN108324242A true CN108324242A (en) 2018-07-27
CN108324242B CN108324242B (en) 2019-08-09

Family

ID=62924932

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711498933.8A Active CN108324242B (en) 2017-12-28 2017-12-28 A kind of multispectral fundus imaging device and method based on intelligent terminal

Country Status (1)

Country Link
CN (1) CN108324242B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109833025A (en) * 2019-03-29 2019-06-04 广州视源电子科技股份有限公司 A kind of method for detecting abnormality of retina, device, equipment and storage medium
CN110025287A (en) * 2019-04-02 2019-07-19 深圳盛达同泽科技有限公司 The lighting device of multispectral fundus imaging and multispectral fundus imaging equipment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104083145A (en) * 2014-07-15 2014-10-08 温州雷蒙光电科技有限公司 Fundus camera
CN204542052U (en) * 2015-04-09 2015-08-12 重庆速魄光学仪器设计室 For the handset type constructional device of fundus imaging

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104083145A (en) * 2014-07-15 2014-10-08 温州雷蒙光电科技有限公司 Fundus camera
CN204542052U (en) * 2015-04-09 2015-08-12 重庆速魄光学仪器设计室 For the handset type constructional device of fundus imaging

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109833025A (en) * 2019-03-29 2019-06-04 广州视源电子科技股份有限公司 A kind of method for detecting abnormality of retina, device, equipment and storage medium
CN110025287A (en) * 2019-04-02 2019-07-19 深圳盛达同泽科技有限公司 The lighting device of multispectral fundus imaging and multispectral fundus imaging equipment
CN110025287B (en) * 2019-04-02 2024-02-20 深圳盛达同泽科技有限公司 Multispectral fundus imaging illumination device and multispectral fundus imaging equipment

Also Published As

Publication number Publication date
CN108324242B (en) 2019-08-09

Similar Documents

Publication Publication Date Title
US10542885B2 (en) Retinal cellscope apparatus
EP3785602B1 (en) Multi-spectral fundus imaging system and method using dynamic visual stimulation
US20210259625A1 (en) Apparatus for visualization of tissue
US20170079741A1 (en) Scanning projection apparatus, projection method, surgery support system, and scanning apparatus
CN104688179A (en) Mobile phone photo taking accessory for taking medical photos
US20140350379A1 (en) System and method for imaging a patient user's body part
CN110742579A (en) System and method for optical detection of skin diseases
JP2000139846A (en) Method and device for creating diagnostic data in degree of wound to skin tissue of patient
CN103815869A (en) Handheld type fundus camera
CN105640507A (en) High definition dermatopathology analyzer and imaging method thereof
CN106999045A (en) Organic image filming apparatus and program
CN108324242B (en) A kind of multispectral fundus imaging device and method based on intelligent terminal
Alterini et al. Fast visible and extended near-infrared multispectral fundus camera
CN204207717U (en) Endoscope's illumination spectra selecting arrangement and ultraphotic spectrum endoscopic imaging system
WO2016061754A1 (en) Handheld molecular imaging navigation system
CN106859589B (en) A kind of cataract screening portable digital slit-lamp
CN205514543U (en) Fine definition skin pathologic analysis appearance
CN104887179A (en) Visual handheld fundus camera without display screen
CN107854116A (en) A kind of oral soft tissue metabolism monitoring system and method
Di Cecilia et al. A hyperspectral imaging system for the evaluation of the human iris spectral reflectance
CN206261606U (en) A kind of external nasopharyngeal cavity vena systemica blood oxygen saturation imaging device
CN204618188U (en) A kind of mobile phone camera accessory for taking medical photo
CN203987984U (en) A kind of hand-held fundus camera
US20200257185A1 (en) Motion stabilized laser speckle imaging
CN104352216B (en) Endoscope's illumination spectra selecting arrangement and ultraphotic spectrum endoscopic imaging system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant