CN110236482B - Integrated eye and brain visual function imaging system - Google Patents
Integrated eye and brain visual function imaging system Download PDFInfo
- Publication number
- CN110236482B CN110236482B CN201910471543.4A CN201910471543A CN110236482B CN 110236482 B CN110236482 B CN 110236482B CN 201910471543 A CN201910471543 A CN 201910471543A CN 110236482 B CN110236482 B CN 110236482B
- Authority
- CN
- China
- Prior art keywords
- visual
- imaging
- brain
- eye
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 101
- 210000004556 brain Anatomy 0.000 title claims abstract description 47
- 230000004382 visual function Effects 0.000 title claims abstract description 8
- 230000000007 visual effect Effects 0.000 claims abstract description 79
- 210000001747 pupil Anatomy 0.000 claims abstract description 34
- 210000001525 retina Anatomy 0.000 claims abstract description 32
- 230000004438 eyesight Effects 0.000 claims abstract description 27
- 230000017531 blood circulation Effects 0.000 claims abstract description 26
- 210000003710 cerebral cortex Anatomy 0.000 claims abstract description 24
- 238000012545 processing Methods 0.000 claims abstract description 18
- 238000004458 analytical method Methods 0.000 claims abstract description 15
- 238000005516 engineering process Methods 0.000 claims abstract description 7
- 238000001228 spectrum Methods 0.000 claims abstract description 7
- 238000009792 diffusion process Methods 0.000 claims abstract description 3
- 239000000523 sample Substances 0.000 claims description 18
- 230000003727 cerebral blood flow Effects 0.000 claims description 6
- 239000013307 optical fiber Substances 0.000 claims description 5
- 230000003925 brain function Effects 0.000 claims description 4
- 230000003595 spectral effect Effects 0.000 claims description 3
- 238000013139 quantization Methods 0.000 claims 1
- 210000005036 nerve Anatomy 0.000 abstract description 15
- 238000000034 method Methods 0.000 abstract description 11
- 210000000857 visual cortex Anatomy 0.000 abstract description 10
- 238000011160 research Methods 0.000 abstract description 7
- 230000007246 mechanism Effects 0.000 abstract description 3
- 230000033228 biological regulation Effects 0.000 abstract description 2
- 238000010191 image analysis Methods 0.000 abstract description 2
- 238000011158 quantitative evaluation Methods 0.000 abstract description 2
- 230000004044 response Effects 0.000 abstract description 2
- 230000001360 synchronised effect Effects 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 18
- 201000010099 disease Diseases 0.000 description 8
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 8
- 238000002599 functional magnetic resonance imaging Methods 0.000 description 8
- 230000008035 nerve activity Effects 0.000 description 8
- 230000001537 neural effect Effects 0.000 description 7
- 210000005013 brain tissue Anatomy 0.000 description 6
- 238000005259 measurement Methods 0.000 description 6
- 238000012014 optical coherence tomography Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 230000002207 retinal effect Effects 0.000 description 6
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 5
- 238000001514 detection method Methods 0.000 description 5
- 229910052760 oxygen Inorganic materials 0.000 description 5
- 239000001301 oxygen Substances 0.000 description 5
- 230000011218 segmentation Effects 0.000 description 5
- 239000008280 blood Substances 0.000 description 4
- 210000004369 blood Anatomy 0.000 description 4
- 230000008344 brain blood flow Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 208000010412 Glaucoma Diseases 0.000 description 3
- 238000007621 cluster analysis Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 239000000306 component Substances 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000006698 induction Effects 0.000 description 3
- 238000007917 intracranial administration Methods 0.000 description 3
- 230000008904 neural response Effects 0.000 description 3
- 238000002610 neuroimaging Methods 0.000 description 3
- 210000001328 optic nerve Anatomy 0.000 description 3
- 230000002123 temporal effect Effects 0.000 description 3
- 208000002177 Cataract Diseases 0.000 description 2
- 102000001554 Hemoglobins Human genes 0.000 description 2
- 108010054147 Hemoglobins Proteins 0.000 description 2
- 206010020772 Hypertension Diseases 0.000 description 2
- 206010025421 Macule Diseases 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 210000001175 cerebrospinal fluid Anatomy 0.000 description 2
- 238000000701 chemical imaging Methods 0.000 description 2
- 239000008358 core component Substances 0.000 description 2
- 206010012601 diabetes mellitus Diseases 0.000 description 2
- 239000003814 drug Substances 0.000 description 2
- 238000013399 early diagnosis Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 208000030533 eye disease Diseases 0.000 description 2
- 230000004424 eye movement Effects 0.000 description 2
- 210000004884 grey matter Anatomy 0.000 description 2
- 238000001727 in vivo Methods 0.000 description 2
- 238000002329 infrared spectrum Methods 0.000 description 2
- 210000004126 nerve fiber Anatomy 0.000 description 2
- 210000000944 nerve tissue Anatomy 0.000 description 2
- 230000001179 pupillary effect Effects 0.000 description 2
- 210000004761 scalp Anatomy 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000000638 stimulation Effects 0.000 description 2
- 230000009885 systemic effect Effects 0.000 description 2
- 210000001519 tissue Anatomy 0.000 description 2
- 238000003325 tomography Methods 0.000 description 2
- 210000004885 white matter Anatomy 0.000 description 2
- 206010012689 Diabetic retinopathy Diseases 0.000 description 1
- 238000004497 NIR spectroscopy Methods 0.000 description 1
- 206010030113 Oedema Diseases 0.000 description 1
- 208000002367 Retinal Perforations Diseases 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 206010064930 age-related macular degeneration Diseases 0.000 description 1
- 230000007177 brain activity Effects 0.000 description 1
- 210000001638 cerebellum Anatomy 0.000 description 1
- 230000002490 cerebral effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 230000001054 cortical effect Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 210000001061 forehead Anatomy 0.000 description 1
- 238000010230 functional analysis Methods 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000003902 lesion Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000008338 local blood flow Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 208000002780 macular degeneration Diseases 0.000 description 1
- 208000029233 macular holes Diseases 0.000 description 1
- 238000002595 magnetic resonance imaging Methods 0.000 description 1
- 230000002503 metabolic effect Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000000047 product Substances 0.000 description 1
- 230000004256 retinal image Effects 0.000 description 1
- 210000001116 retinal neuron Anatomy 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 210000003625 skull Anatomy 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 230000002792 vascular Effects 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/102—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for optical coherence tomography [OCT]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/12—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes
- A61B3/1225—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes using coherent radiation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/12—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes
- A61B3/1225—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes using coherent radiation
- A61B3/1233—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes using coherent radiation for measuring blood flow, e.g. at the retina
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/14—Arrangements specially adapted for eye photography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0033—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room
- A61B5/004—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room adapted for image acquisition of a particular organ or body part
- A61B5/0042—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room adapted for image acquisition of a particular organ or body part for the brain
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0075—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/6802—Sensor mounted on worn items
- A61B5/6803—Head-worn items, e.g. helmets, masks, headphones or goggles
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2576/00—Medical imaging apparatus involving image processing or analysis
- A61B2576/02—Medical imaging apparatus involving image processing or analysis specially adapted for a particular organ or body part
- A61B2576/026—Medical imaging apparatus involving image processing or analysis specially adapted for a particular organ or body part for the brain
Abstract
The invention discloses an integrated eye and brain visual function imaging system, which comprises: a visual stimulus presentation device that presents pictures and videos containing a plurality of stimulus-induced paradigms; an ocular vision imaging device, which is a multi-spectrum-based retina and pupil imaging device; the brain visual imaging device is visual cerebral cortex blood flow signal imaging device based on near-red diffusion correlation spectrum technology; the collaborative workstation comprises an imaging acquisition control module and an image analysis module, and is used for cooperatively controlling eye vision imaging equipment and brain vision imaging equipment, and processing and analyzing acquired multispectral retina, pupil images and vision cerebral cortex blood flow images. The system can realize synchronous recording of eye retina, pupil and brain visual cortex nerve function response, performs joint analysis on the visual physiological signals with multiple modes and multiple parameters, and provides a method for visual information coding and decoding, visual reconstruction mechanism research, visual nerve regulation and control quantitative evaluation damage positioning and the like.
Description
Technical Field
The invention relates to the technical field of medical imaging, in particular to an integrated eye and brain vision function imaging system.
Background
Because of the importance of visual function, research into the function of visual nerves at home and abroad has been a hotspot. In brain visual nerve function imaging, commonly used devices are functional magnetic resonance imaging (fMRI), electroencephalogram (EEG), near infrared brain function imaging (fNIRS). The principle of fMRI is to measure changes in blood oxygen levels induced by neuronal activity using dynamic magnetic resonance imaging. fMRI can be used to realize the research of functional localization, color recognition, visual processing and the like of cerebral cortex related to human visual system, however, the time resolution of fMRI is lower, and instantaneous brain nerve activity change cannot be measured. EEG can detect electrical signals generated by brain nerve activity, but EEG measures electrical signals of the head surface, and EEG signals of a measurement space deviate from real intracranial brain nerve electrical signals to a certain extent because the electrical conduction of the brain nerve activity can be influenced by skull tissues, so that the accurate positioning of brain activity can be realized by combining functional magnetic resonance imaging. fmirs is a very beneficial supplement to existing fMRI, EEG techniques, a functional near infrared brain imaging system that evaluates changes in the oxygenated and deoxygenated hemoglobin components of the cerebral cortex by safe near infrared light, but because fmirs measures slowly changing blood oxygen metabolic activity, it is still not possible to accurately record neural activity processes.
In the field of imaging ocular visual nerve functions, common devices include Optical Coherence Tomography (OCT), ophthalmoscopes, and pupillary devices. OCT is a non-contact, high resolution tomographic and biomicroscopic imaging apparatus that can be used for in vivo viewing, axial tomography, and measurement of posterior segment structures of the eye (including retina, retinal nerve fiber layer, macula, and optic disc), and is particularly useful as a diagnostic apparatus to aid in the detection and management of eye diseases. The ophthalmoscope is mainly used for fundus retina imaging, can be used for checking common cataract, glaucoma and other ophthalmic diseases, can be used for early diagnosing hypertension, diabetes and other systemic diseases, and is a popular object for clinical medicine and modern scientific research. Pupil instruments are used mainly in the fields of pupil light reflection, pupil conduction block, eye shake measurement, eye movement tracking, etc., and in addition, they are also precisely aligned core components of various ophthalmic instruments. However, these devices are only used for static eye imaging, do not continuously and dynamically image the eye, and do not quantitatively measure the neural circuit with complete pupil light reflection.
In summary, at present, an imaging device is used for imaging the visual nerve function, or a plurality of imaging devices are used for imaging the visual nerve function in a time-sharing and subsection mode, and analysis is performed on the basis of the imaging device. Wherein the monitoring of retinal neuron activity is most often based on invasive or ex vivo measurements; however, many of the current researches on fundus are directed at obvious lesions of retina and peripheral vascular structures, and detection means for the neural activity of living fundus are not yet available. However, vision processing is a dynamic neural response from the retina of the eye to the visual cortex of the brain, and the simple combination of existing devices does not provide instantaneous, dynamic functional imaging of the dynamic neural response of the retina of the eye and the visual cortex of the brain. The technology can provide a method for simultaneously carrying out living imaging on the functions of the retina of the eye and the visual cortex of the brain, develops equipment which can be simultaneously used for synchronous function imaging of the retina and the visual cortex, provides a new method for researching clinical problems such as visual reconstruction mechanism, quantitative evaluation of visual nerve regulation, visual damage positioning and the like, and has important scientific research value and clinical application value.
Disclosure of Invention
The invention mainly solves the technical problem that the current simple combination of the existing equipment can not carry out instantaneous and dynamic functional imaging on the dynamic neural response of the retina of the eye and the visual cortex of the brain.
In order to solve the technical problems, the invention adopts the following technical scheme: there is provided an integrated ocular brain visual function imaging system, the system comprising:
a visual stimulus presentation device that is a picture and video presentation device that contains multiple stimulus-induced paradigms;
the eye vision imaging device is based on multispectral eye retina and pupil image acquisition;
the brain visual imaging device is used for acquiring visual cerebral cortex blood flow signals based on a near infrared diffusion correlation spectrum technology;
the collaborative workstation comprises an imaging acquisition control module and an image analysis module, and is used for cooperatively controlling the eye vision imaging equipment and the brain vision imaging equipment, and carrying out data processing on the acquired multispectral eye images and the vision cerebral cortex blood flow signals.
Preferably, the visual stimulus presentation device comprises pictures and videos of various stimulus-induced paradigms and maintains temporal consistency with the ocular imaging device and the brain imaging device.
Preferably, the eye vision imaging device comprises a multispectral light source module, an image signal acquisition and control module, an image acquisition module and a multispectral light source control module.
Preferably, the image acquisition module comprises a collimating lens, a hollow reflecting mirror, a first converging lens, a second converging lens, a pupil camera and a retina camera; the light emitted by the multispectral light source module is collimated by the collimating lens, reflected by the hollow reflecting mirror and then transmitted by the first converging lens to irradiate the pupil and retina of the human eye; light reflected by the pupil enters the pupil camera, light reflected by the retina transmits the first converging lens, then passes through the middle part of the hollow reflecting mirror and transmits the second converging lens, and the light reaches the retina camera.
Preferably, the multispectral light source control module comprises a multispectral control unit, a one-key acquisition unit and an ambient light control unit.
Preferably, the visual stimulus presentation device comprises a left stimulus display module and a right stimulus display module.
Preferably, the brain vision imaging device comprises a brain blood flow number acquisition module and a data processing module, wherein the brain blood flow number acquisition module comprises a plurality of light sources and a plurality of probes, the light sources and the probes form a brain blood flow signal acquisition channel, and the data processing module is used for processing signals acquired by the brain blood flow signal acquisition module to obtain quantitative indexes of the vision brain cortex blood flow signals.
Preferably, the cerebral blood flow signal acquisition module is an image acquisition cap, and the plurality of light sources and the plurality of probes are distributed on the image acquisition cap in a surrounding manner.
Preferably, the light source is a near infrared laser light source; the light sources include 4 and the probes include 16. The 4 light sources and the 16 probes form 20 electroencephalogram signal acquisition channels.
Preferably, the probe comprises a near infrared laser, a single photon detector and a single mode/multimode optical fiber.
Preferably, the collaborative workstation comprises an imaging acquisition control module and a visual imaging analysis module, wherein the imaging acquisition control module is used for cooperatively controlling the eye imaging equipment and the brain visual imaging equipment, and the visual imaging analysis module extracts brain functional imaging spatial characteristics through functional magnetic resonance images and performs multi-mode spectral clustering analysis by combining the multispectral eye images and the visual cerebral cortex blood flow signals.
The beneficial effects of the invention are as follows: compared with the prior art, the invention provides more comprehensive and rich visual nerve function detection information by utilizing the integrated nerve function imaging system and utilizing the medical optical technology to collect the visual nerve activity signals of eyes and brain; meanwhile, the dynamic multispectral imaging technology based on eye optic nerve activity and the visual cortex electroencephalogram imaging technology based on near infrared spectrum can realize living body imaging; the multi-spectral eye image and visual cerebral cortex blood flow signals which are collected integrally are subjected to polymorphic spectrum cluster analysis and image reconstruction by the aid of the collaborative workstation, and accordingly more accurate disease analysis can be provided.
Drawings
FIG. 1 is a schematic diagram of an embodiment of an integrated ocular and cerebral visual function imaging system of the present invention;
FIG. 2 is a schematic diagram of the ocular vision imaging device of FIG. 1;
FIG. 3 is a schematic view of the optical path structure of the image acquisition module in FIG. 2;
FIG. 4 is a schematic diagram of the structure of the brain vision imaging device of FIG. 1;
FIG. 5 is a schematic view of the configuration of the workstation of FIG. 1;
fig. 6 is a schematic flow chart of an algorithm for extracting brain functional imaging spatial features from functional magnetic resonance images by the visual imaging analysis module in fig. 4.
Detailed Description
In order to enable those skilled in the art to better understand the technical solutions provided by the present invention, the following describes in detail an integrated eye and brain vision function imaging system provided by the present invention with reference to the accompanying drawings and the detailed description.
Referring to fig. 1, an embodiment of an integrated eye-brain visual function imaging system of the present invention includes a visual stimulus presentation device 10, an eye visual imaging device 11, a brain visual imaging device 12, and a co-workstation 13.
In particular, pictures and videos of various stimulus-induced paradigms are included within visual stimulus presentation device 10 and remain in temporal consistency with the eye imaging device and brain imaging device. The visual stimulus presentation device 10 comprises a left stimulus display module and a right stimulus display module. For providing visual stimuli to the left and right eyes of the user, respectively, pupil images are acquired by the pupil camera 1145 in the ocular vision imaging device 11.
The ocular vision imaging device 11 is a multispectral ocular image acquisition based on dynamic visual stimuli. The eye vision imaging device is used for collecting pupil images and retina images of human eyes.
Current devices for imaging ocular optic nerve function mainly include OCT, ophthalmoscope, and pupillary instrument. OCT is a non-contact, high resolution tomographic and biomicroscopic imaging apparatus. It is useful for in vivo viewing, axial tomography, and measurement of posterior segment structures of the eye (including retina, retinal nerve fiber layer, macula, and optic disc), and is particularly useful as a diagnostic device to aid in the detection and management of eye diseases including, but not limited to, macular holes, cystoid edema, diabetic retinopathy, age-related macular degeneration, and glaucoma. The device mainly uses the difference of absorption of oxygen-containing/deoxidized hemoglobin contained in different tissues of the fundus to different spectrums to accurately image the different tissues. OCT-based multispectral imaging techniques may be helpful in measuring ocular fundus neural activity, as neuronal activity may cause local blood flow/blood oxygen changes. The ophthalmoscope is mainly used for fundus retina imaging, can be used for checking common cataract, glaucoma and other ophthalmic diseases, can be used for early diagnosing hypertension, diabetes and other systemic diseases, and is a popular object for clinical medicine and modern scientific research. Pupil instruments are used mainly in the fields of pupil light reflection, pupil conduction block, eye shake measurement, eye movement tracking, etc., and in addition, they are also precisely aligned core components of various ophthalmic instruments. However, these devices are only used for static eye imaging, do not continuously and dynamically image the eye, and do not quantitatively measure the neural circuit with complete pupil light reflection.
In order to solve the problem, the invention creatively proposes a multispectral eye vision imaging device 11, which can monitor eye retina optic nerve activities such as blood oxygen saturation and the like by utilizing different spectrums to cause optical property changes so as to realize dynamic fundus and pupil function imaging.
The brain visual imaging device 12 is visual cortical blood flow signal acquisition based on near infrared spectroscopy. The visual cortex blood flow signal may be selected as the visual cortex blood flow signal. The stimulation of the near infrared spectrum is used to monitor cerebral cortex blood flow.
The eye vision imaging device 11 can be in an eye cover type, the brain vision imaging device 12 can be in a forehead type or a hat type, and the two devices are integrated into a whole, so that the volume can be reduced, and the portable device is convenient to carry.
And the cooperative workstation 13 is used for cooperatively controlling the ocular visual imaging device 11 and the ocular visual imaging device 12 and processing the acquired multispectral ocular image and the visual cerebral cortex blood flow signals.
The co-workstation 13 is based on different study objectives, and needs to take into account various stimulus induction paradigms and induction presentation modes, and maintain the temporal consistency of stimulus and imaging. The cooperative workstation 13 processes the composite optical nerve activity signal including the multispectral eye image and the visual cerebral cortex blood flow signal, so that the cooperative light source 1211 control, data acquisition, data transmission, data processing and other functions need to be completed, and the coordination of the multi-mode and multi-channel functional components of the eye visual imaging device 11 and the eye visual imaging device 12 is a cooperative pivot of the whole system. The cooperative workstation 13 is also responsible for the positioning, registering, fusing and other data processing tasks of fundus, pupil and visual cortex blood flow signals, and complex functional analysis, recording and storage tasks.
Through the mode, the integrated eye and brain nerve function imaging can be realized, meanwhile, the collected multispectral eye images (retina images and pupil images) and the visual cerebral cortex blood flow signals can provide more comprehensive and rich visual nerve function detection information, and the reliability and timeliness of early diagnosis of diseases can be remarkably improved based on spatial registration and a specific algorithm.
Referring to fig. 2, the ocular vision imaging device 11 includes a multispectral light source module 113, an image signal acquisition and control module 111, an image acquisition module 114, and a multispectral light source control module 112.
Referring to fig. 3, the image capturing module includes a collimating lens 1141, a hollow mirror 1142, a first converging lens 1143, a second converging lens 1144, a pupil camera 1145 and a retina camera 1146; the light emitted by the multispectral light source module is collimated by the collimating lens 1141, reflected by the hollow reflecting mirror 1142, and then transmitted through the first converging lens 1143 to irradiate the pupil and retina of the human eye; light reflected by the pupil enters the pupil camera 1145, and light reflected by the retina transmits the first converging lens 1143, then passes through the middle part of the hollow reflector 1142 and then transmits the second converging lens 1144, so as to reach the retina camera 1146. The collimating lens 1141, the hollow mirror 1142, the first converging lens 1143, and the second converging lens 1144 may be integrally disposed within the optical lens. A slit is provided in the middle of the hollow mirror 1142 for the passage of the retinal reflected light. Pupil images of the human eye are acquired by a pupil camera 1145 and retinal images are acquired by a retinal camera 1146.
The multispectral light source control module 111 may further include a multispectral control unit, a one-key acquisition unit, and an ambient light control unit, where the multispectral control unit controls to emit monochromatic laser light with different wavelengths. The one-key acquisition unit acquires images by one key, and the ambient light control unit is used for controlling ambient background light.
In another embodiment of the present invention, the ocular visual imaging device 11 may further comprise a display device, which may be selected as a liquid crystal screen, capable of facilitating display and observation of the captured image.
The eye vision imaging device 11 can request the cooperative workstation 13 to read the acquisition result, and the data communication between the eye vision imaging device 11 and the cooperative workstation 13 adopts a USB and PCI-E transmission mode based on a bus.
As shown in fig. 4, the brain visual imaging device 12 includes an electroencephalogram signal acquisition module 121 and a data processing module 122, the electroencephalogram signal acquisition module 121 includes a plurality of light sources 1211 and a plurality of probes 1212, the plurality of light sources 1211 and the plurality of probes 1212 form an electroencephalogram signal acquisition channel, and the data processing module 122 is configured to process signals acquired by the electroencephalogram signal acquisition module 121 to obtain visual cerebral cortex blood flow signals. Wherein the light source 1211 is a near infrared light source.
The electroencephalogram signal collection module 121 is an image collection cap, a plurality of light sources 1211 and a plurality of probes 1212 are distributed on the image collection cap in a surrounding mode, the plurality of light sources 1211 can be 4 light sources 1211, the plurality of probes 1212 can be 16 probes 1212,4 light sources 1211 and 16 probes 1212 form 20 electroencephalogram signal collection channels.
Each light source 1211 is preferably a near infrared laser light source. Alternatively, a near infrared LED light source.
The probe 1212 includes a near infrared laser, a single photon detector, and a single mode/multimode optical fiber. The high-speed and accurate acquisition of cerebral cortex blood flow signal data can be realized under the irradiation of coherent laser, and the optical fiber can be selected from single-mode optical fibers.
As shown in fig. 5, the collaborative workstation 13 includes an imaging acquisition control module 131 and a visual imaging analysis module 132, where the imaging acquisition control module 131 is configured to cooperatively control the eye imaging system and the eye visual imaging apparatus 12, and the visual imaging analysis module 132 extracts brain function imaging spatial features by selecting functional magnetic resonance imaging from a video library, and performs multi-mode spectral clustering analysis in combination with multispectral eye images and visual cerebral cortex blood flow signals.
The imaging acquisition control module 131 can be used for realizing the integrated control of the imaging acquisition system of the visual nerve functions of eyes and brain, so that multi-mode eye images and brain electric signals can be obtained, and the images and signals reflect the nerve activity condition of retina and brain cortex under the induction of visual stimulus. Because the dynamic multispectral eye image and the near infrared visual cerebral cortex blood flow signal are respectively acquired at different positions, in order to construct a three-dimensional visual conduction model, the visual cerebral cortex blood flow signal and the dynamic multispectral eye image are required to be subjected to multi-mode cluster analysis.
Through multi-mode cluster analysis, the correlation among multi-mode information can be deeply excavated, and a reference basis is provided for discussing and deducing visual and brain science mechanisms of the visual nerve function.
Specifically, as shown in fig. 6, the visual imaging analysis module 132 is first used to select a functional magnetic resonance image from the video library, and three layers of segmentation is performed on the functional magnetic resonance image to form a brain tissue image and a scalp extracranial intracranial image. Performing cerebellum removal on a brain tissue image to form a brain tissue image, performing brain tissue segmentation on the brain tissue image to form gray matter, white matter and cerebrospinal fluid images, performing brain region segmentation on the brain tissue image to form a functional brain region image, and performing surface reconstruction and brain region segmentation on the gray matter, white matter, cerebrospinal fluid images and the functional brain region image to form a cerebral cortex surface image; after eye segmentation is carried out on the scalp extracranial intracranial image, the brain region reconstruction image is formed by combining the brain cortex surface image, and the extraction of brain function imaging spatial features is completed.
And then based on a specific visual experimental paradigm, determining the local receptive field of the retinal nerve tissue by examining the position and brightness degree of stimulation presentation, further establishing a receptive field layer model between the retinal nerve tissue and the multispectral eye image and the visual cerebral cortex blood flow signal according to the multispectral eye image and the visual cerebral cortex blood flow signal which are synchronously acquired, and further examining the sensitivity degree of different visual features in human brain visual processing according to the model, so as to construct a quantifiable stimulation-nerve response model.
Early diagnosis and rapid identification of diseases can be realized by constructing model analysis, and reliability of disease diagnosis is improved.
In the embodiments provided in the present invention, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical functional division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment.
In addition, each functional unit in each embodiment of the present invention may be integrated in one processing unit, each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing description is only of embodiments of the present invention, and is not intended to limit the scope of the invention, and all equivalent structures or equivalent processes using the descriptions and the drawings of the present invention or directly or indirectly applied to other related technical fields are included in the scope of the present invention.
Claims (8)
1. An integrated ocular brain visual function imaging system, the system comprising:
a visual stimulus presentation device that is a picture and video presentation device that contains multiple stimulus-induced paradigms;
the eye vision imaging device is based on multispectral eye retina and pupil image acquisition;
the brain visual imaging device is used for acquiring visual cerebral cortex blood flow signals based on a near infrared diffusion correlation spectrum technology;
the collaborative workstation comprises an imaging acquisition control module and a visual imaging analysis module, wherein the imaging acquisition control module is used for cooperatively controlling the eye visual imaging equipment and the brain visual imaging equipment, processing the acquired multispectral eye image and the visual cerebral cortex blood flow signal data, extracting brain function imaging spatial characteristics through a functional magnetic resonance image by the visual imaging analysis module, and carrying out multi-mode spectral clustering analysis by combining the multispectral eye retina and pupil image and the visual cerebral cortex blood flow signal;
the eye vision imaging device comprises a multispectral light source module, an image signal acquisition and control module, an image acquisition module and a multispectral light source control module.
2. The system of claim 1, wherein the image acquisition module comprises a collimating lens, a hollow mirror, a first converging lens, a second converging lens, a pupil camera, and a retina camera; the light emitted by the multispectral light source module is collimated by the collimating lens, reflected by the hollow reflecting mirror and then transmitted by the first converging lens to irradiate the pupil and retina of the human eye; light reflected by the pupil enters the pupil camera, light reflected by the retina transmits the first converging lens, then passes through the middle part of the hollow reflecting mirror and transmits the second converging lens, and the light reaches the retina camera.
3. The system of claim 2, wherein the multi-spectral light source control module comprises a multi-spectral control unit, a one-touch acquisition unit, and an ambient light control unit.
4. The system of claim 1, wherein the visual stimulus presentation device comprises a left stimulus display module and a right stimulus display module.
5. The system of claim 1, wherein the brain visual imaging device comprises a cerebral blood flow signal acquisition module and a data processing module, the cerebral blood flow signal acquisition module comprises a plurality of light sources and a plurality of probes, the plurality of light sources and the plurality of probes form a cerebral blood flow signal acquisition channel, and the data processing module is used for processing signals acquired by the cerebral blood flow signal acquisition module to obtain quantization indexes of the visual cerebral cortex blood flow signals.
6. The system of claim 5, wherein the cerebral blood flow signal acquisition module is an image acquisition cap, and the plurality of light sources and the plurality of probes are circumferentially distributed on the image acquisition cap.
7. The system of claim 6, wherein the light source is a near infrared laser light source; the light sources include 4 and the probes include 16.
8. The system of claim 7, wherein the probe comprises a near infrared laser, a single photon detector, and a single mode/multimode optical fiber.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910471543.4A CN110236482B (en) | 2019-05-31 | 2019-05-31 | Integrated eye and brain visual function imaging system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910471543.4A CN110236482B (en) | 2019-05-31 | 2019-05-31 | Integrated eye and brain visual function imaging system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110236482A CN110236482A (en) | 2019-09-17 |
| CN110236482B true CN110236482B (en) | 2024-03-22 |
Family
ID=67885767
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910471543.4A Active CN110236482B (en) | 2019-05-31 | 2019-05-31 | Integrated eye and brain visual function imaging system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110236482B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110812707B (en) * | 2019-11-25 | 2021-05-18 | 北京师范大学 | Brain imaging and light nerve regulation and control integrated device |
| CN112641450B (en) * | 2020-12-28 | 2023-05-23 | 中国人民解放军战略支援部队信息工程大学 | Time-varying brain network reconstruction method for dynamic video target detection |
| CN112674752A (en) * | 2020-12-30 | 2021-04-20 | 深圳市联影高端医疗装备创新研究院 | Functional magnetic resonance imaging method, device, equipment and storage medium |
| CN113406663B (en) * | 2021-06-17 | 2024-03-12 | 王高 | Visual imaging system and method based on P300 and associated imaging |
| CN114601430B (en) * | 2022-03-23 | 2024-02-20 | 浙江大学 | Cortex function connection positioning device based on near infrared light stimulation |
| CN116186502B (en) * | 2023-04-27 | 2023-07-07 | 华南理工大学 | Multi-mode visual nerve function detection method and system thereof |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008086412A (en) * | 2006-09-29 | 2008-04-17 | Hamamatsu Kagaku Gijutsu Kenkyu Shinkokai | Retina image data acquisition/display device and retina image data acquisition/displaying method |
| JP2010233978A (en) * | 2009-03-31 | 2010-10-21 | Nidek Co Ltd | Visual performance inspection device |
| CN102499635A (en) * | 2011-10-26 | 2012-06-20 | 中国科学院光电技术研究所 | Line scanning-based fundus retina multispectral imaging system and method |
| CN102657515A (en) * | 2012-05-10 | 2012-09-12 | 中国科学院长春光学精密机械与物理研究所 | Alignment light path device applied to retinal imaging system |
| CN205625890U (en) * | 2016-03-29 | 2016-10-12 | 孙明斋 | High spectrum eye ground imaging system |
| CN108670192A (en) * | 2018-04-21 | 2018-10-19 | 重庆贝奥新视野医疗设备有限公司 | A kind of multispectral eyeground imaging system and method for dynamic vision stimulation |
| CN108882875A (en) * | 2015-12-14 | 2018-11-23 | 奥托-冯-格里克-马格德堡大学 | Equipment for neural blood vessel stimulation |
| CN109431457A (en) * | 2018-12-21 | 2019-03-08 | 合肥奥比斯科技有限公司 | Multispectral eyeground imaging system |
| CN211704590U (en) * | 2019-05-31 | 2020-10-20 | 中国科学院苏州生物医学工程技术研究所 | Integrated eye and brain visual function imaging system |
-
2019
- 2019-05-31 CN CN201910471543.4A patent/CN110236482B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008086412A (en) * | 2006-09-29 | 2008-04-17 | Hamamatsu Kagaku Gijutsu Kenkyu Shinkokai | Retina image data acquisition/display device and retina image data acquisition/displaying method |
| JP2010233978A (en) * | 2009-03-31 | 2010-10-21 | Nidek Co Ltd | Visual performance inspection device |
| CN102499635A (en) * | 2011-10-26 | 2012-06-20 | 中国科学院光电技术研究所 | Line scanning-based fundus retina multispectral imaging system and method |
| CN102657515A (en) * | 2012-05-10 | 2012-09-12 | 中国科学院长春光学精密机械与物理研究所 | Alignment light path device applied to retinal imaging system |
| CN108882875A (en) * | 2015-12-14 | 2018-11-23 | 奥托-冯-格里克-马格德堡大学 | Equipment for neural blood vessel stimulation |
| CN205625890U (en) * | 2016-03-29 | 2016-10-12 | 孙明斋 | High spectrum eye ground imaging system |
| CN108670192A (en) * | 2018-04-21 | 2018-10-19 | 重庆贝奥新视野医疗设备有限公司 | A kind of multispectral eyeground imaging system and method for dynamic vision stimulation |
| CN109431457A (en) * | 2018-12-21 | 2019-03-08 | 合肥奥比斯科技有限公司 | Multispectral eyeground imaging system |
| CN211704590U (en) * | 2019-05-31 | 2020-10-20 | 中国科学院苏州生物医学工程技术研究所 | Integrated eye and brain visual function imaging system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110236482A (en) | 2019-09-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110236482B (en) | Integrated eye and brain visual function imaging system | |
| Dunn et al. | Dynamic imaging of cerebral blood flow using laser speckle | |
| CN104434038B (en) | Acquired skin data processing method, device and system | |
| Nelson et al. | Special report: noninvasive multi-parameter functional optical imaging of the eye | |
| Gratton et al. | Fast and localized event-related optical signals (EROS) in the human occipital cortex: comparisons with the visual evoked potential and fMRI | |
| US20180098702A1 (en) | Functional optical coherent imaging | |
| EP1494579B1 (en) | Characterization of moving objects in a stationary background | |
| US20050094099A1 (en) | Apparatus and method for diagnosis of optically identifiable ophthalmic conditions | |
| US20080021331A1 (en) | Characterization of moving objects in a stationary background | |
| Morone et al. | Review of functional and clinical relevance of intrinsic signal optical imaging in human brain mapping | |
| Ayaz et al. | Assessment of cognitive neural correlates for a functional near infrared-based brain computer interface system | |
| CN211704590U (en) | Integrated eye and brain visual function imaging system | |
| EP0471725A1 (en) | Device for monitoring body functions. | |
| Xu et al. | Classification of autism spectrum disorder based on sample entropy of spontaneous functional near infra-red spectroscopy signal | |
| Landa et al. | Initial report of quantification of retinal blood flow velocity in normal human subjects using the Retinal Functional Imager (RFI) | |
| Grinvald et al. | High-resolution functional optical imaging: from the neocortex to the eye | |
| JP5147949B2 (en) | Biological light measurement device | |
| Yao et al. | Exploring the impact of 3D movie watching on the brain source activities and energy consumption by ESI and fNIRS | |
| US11210784B2 (en) | Systems and methods for imaging disease biomarkers | |
| Gratton et al. | Fast optical signals: Principles, methods, and experimental results | |
| Nowara et al. | Seeing beneath the skin with computational photography | |
| Mohtasebi et al. | Detection of low-frequency oscillations in neonatal piglets with speckle contrast diffuse correlation tomography | |
| Nourhashemi et al. | Preictal neuronal and vascular activity precedes the onset of childhood absence seizure: direct current potential shifts and their correlation with hemodynamic activity | |
| Florea et al. | Computer vision for cognition: An eye focused perspective | |
| Rudolph et al. | Scanning laser ophthalmoscope-evoked multifocal ERG (SLO-mfERG) in patients with macular holes and normal individuals |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |