CN103479449A - Brain imaging outside sensing system and method for acquired blind people - Google Patents

Brain imaging outside sensing system and method for acquired blind people Download PDF

Info

Publication number
CN103479449A
CN103479449A CN201310424624.1A CN201310424624A CN103479449A CN 103479449 A CN103479449 A CN 103479449A CN 201310424624 A CN201310424624 A CN 201310424624A CN 103479449 A CN103479449 A CN 103479449A
Authority
CN
China
Prior art keywords
signal
image
digital
brain
current
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310424624.1A
Other languages
Chinese (zh)
Other versions
CN103479449B (en
Inventor
聂泽东
樊建平
罗德军
段长江
戴荣新
杜雷雷
王磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Institute of Advanced Technology of CAS
Original Assignee
Shenzhen Institute of Advanced Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Institute of Advanced Technology of CAS filed Critical Shenzhen Institute of Advanced Technology of CAS
Priority to CN201310424624.1A priority Critical patent/CN103479449B/en
Publication of CN103479449A publication Critical patent/CN103479449A/en
Application granted granted Critical
Publication of CN103479449B publication Critical patent/CN103479449B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention relates to a brain imaging outside sensing method for acquired blind people. The method includes: acquiring an outside image signal; converting the outside image signal into an electric signal; converting the electric signal into a digital signal through A/D (analog to digital) conversion and removing redundant noise; performing DSP (digital signal processor) processing on the digital signal to obtain a required brain imaging signal; converting the required brain imaging signal into an analog signal through D/A (digital to analog) conversion; generating current of corresponding intensity according the intensity of the analog signal, releasing the current to stimulate optic nerves of cerebral cortex directly to allow the optic nerves to generate a electric signal corresponding to the stimulating current and transmitting among nerve cells, and by an optic never center, controlling the signal in the nerve cells to reconstruct the image in the brain. The invention further relates to a brain imaging outside sensing system for the acquired blind people.

Description

Acquired blindness human brain marine origin is as the system and method in the perception external world
Technical field
The present invention relates to the system and method for a kind of acquired blindness human brain marine origin as the perception external world.
Background technology
The blind person, have dividing of congenital blind person and posteriority blind person.Eyes, the window of our soul, be easy to suffer various damages in present day society, produces various ophthalmics.Most people are eyes weakened (as myopia), but also have the sub-fraction people, are the vision permanent damage.This part population is exactly blind person posteriority.For blind person posteriority, because he had the experience of vision, exist visual concept.Although he can not obtain external information by visual pathway, but as long as in his brain, vision part (retina, optic nerve and visual centre control system) is also normal, his coloured sensation still under certain strong impulse, still can perceive extraneous environment.
The sensation that we mankind are all and consciousness are all come in neural control.When we are subject to certain when excitation, can produce one and encourage suitable signal to transmit between neuron.Neuron (having another name called neurocyte) is the ultimate unit that forms the nervous system 26S Proteasome Structure and Function.Neuron is the cell with long synapse (aixs cylinder), and it consists of cyton and cell process.On long aixs cylinder, cover has one deck sheath, forms nerve fiber, and the tiny branch of its end is called teleneuron.Cyton is arranged in brain, spinal cord and neuroganglion, and cell process may extend in each Organ and tissue of whole body.When we are subject to extraneous stimulation, will between corresponding neuron, form stimulus signal, stimulus signal is transformed into the signal of telecommunication.Mode by action potential on neuron is carried out conducting electrical signals, by synapse, is contacted, and has gap between synapse.When electrical signal conduction, to teleneuron, synapse discharges certain chemical substance, and this chemical substance, through diffusion, passed gap, produces the new signal of telecommunication on next neuron.Like this, go down, just realized the transmission of signal between neuron always.
The external image reconstruction of blind person at brain of having realized, but its implementation complexity, professional running software need to be arranged, to carry at any time a computer with it, lack portability, and the prompting of voice need to be arranged, for being difficult to distinguish in noisy environment, enable image reconstruction, also do not provide the size of image information.
Summary of the invention
In view of this, be necessary to provide the system and method for a kind of acquired blindness human brain marine origin as the perception external world.
The invention provides the system of a kind of acquired blindness human brain marine origin as the perception external world, this system comprises image acquisition equipment, imageing sensor, modular converter, signal processing module and the nerve signal transport module of mutual electric connection, and wherein: described image acquisition equipment is for obtaining the external image signal; Described imageing sensor is for changing the above-mentioned external image signal obtained into the signal of telecommunication; Described modular converter is for by above-said current signal, to carry out the A/D analog digital conversion be digital signal and remove unnecessary noise; Described signal processing module is for above-mentioned digital signal is carried out to the DSP processing, to obtain the brain imaging signal needed; Described modular converter is also analogue signal for above-mentioned brain imaging signal is carried out to the D/A digital-to-analogue conversion; Described nerve signal transport module produces the electric current of respective intensities for the intensity according to analogue signal after the D/A digital-to-analogue conversion, release current directly stimulates corticocerebral optic nerve, make optic nerve produce a signal of telecommunication suitable with stimulating current and transmit between neuron, finally the signal in this neuron is realized image reconstruction under the control of optic nerve maincenter in brain.
Wherein, described image acquisition equipment can be pinprick formula video camera or photographic head.
Described imageing sensor can be cmos image sensor or ccd image sensor.
Described DSP is treated to image algorithm and processes.
Described image algorithm is processed and is included but not limited to, image is cut apart, figure image intensifying, figure filtering, pattern recognition.
The invention provides the method for a kind of acquired blindness human brain marine origin as the perception external world, the method comprises the steps: to obtain the external image signal; Change the above-mentioned external image signal obtained into the signal of telecommunication; By above-said current signal, to carry out the A/D analog digital conversion be digital signal and remove unnecessary noise; Above-mentioned digital signal is carried out to the DSP processing, to obtain the brain imaging signal needed; It is analogue signal that above-mentioned brain imaging signal is carried out to the D/A digital-to-analogue conversion; Reach the electric current that produces respective intensities according to the intensity of analogue signal after the D/A digital-to-analogue conversion, release current directly stimulates corticocerebral optic nerve, make optic nerve produce a signal of telecommunication suitable with stimulating current and transmit between neuron, finally the signal in this neuron is realized image reconstruction under the control of optic nerve maincenter in brain.
Wherein, described DSP is treated to the image algorithm processing.
Described image algorithm is processed and is included but not limited to, image is cut apart, figure image intensifying, figure filtering, pattern recognition.
Acquired blindness human brain marine origin provided by the present invention is as the system and method in the perception external world, and implementation is simple, portable good, is not subject to the impact of noisy external environment, allows this class blind person also can the perception external world under the help that there is no the stranger.
The accompanying drawing explanation
Fig. 1 is the hardware structure figure of acquired blindness human brain marine origin of the present invention as the system preferred embodiment in the perception external world.
Fig. 2 is the operation process chart of acquired blindness human brain marine origin of the present invention as the method preferred embodiment in the perception external world.
The specific embodiment
Below in conjunction with drawings and the specific embodiments, the present invention is further detailed explanation.
Consulting shown in Fig. 1, is the hardware structure figure of acquired blindness human brain marine origin of the present invention as the system preferred embodiment in the perception external world.This system comprises image acquisition equipment, imageing sensor, modular converter, signal processing module and the nerve signal transport module of mutual electric connection.
Described image acquisition equipment is for obtaining the external image signal.Described image acquisition equipment can adopt pinprick formula video camera or photographic head commonly used.
Described imageing sensor is for changing the above-mentioned external image signal obtained into the signal of telecommunication.Described imageing sensor can be cmos image sensor or ccd image sensor.
Described modular converter is for above-said current signal is carried out to the A/D analog digital conversion, and being about to above-said current signal is digital signal by original analog signal conversion.Then described modular converter, also for described digital signal is removed to unnecessary noise, improves signal quality.
Described signal processing module is used for receiving the analog-to-digital digital signal of above-mentioned A/D, and above-mentioned digital signal is carried out to DSP(Digital Signal processor, Digital Signal Processing) process, to obtain the brain imaging signal needed.Particularly, described signal processing module carries out the image algorithm processing by above-mentioned digital signal.Described image algorithm is processed and is included but not limited to, image is cut apart, figure image intensifying, figure filtering, pattern recognition.For example, the signal of the pre-defined different amplitudes of described signal processing module: the signal of large tree is A, the signal in river is B, the signal of human body is C, initial external image signal is through the processing of above-mentioned steps S401, S402, S403, in step S404, signal processing module produces corresponding signal according to pattern recognition, take again described pattern recognition to produce corresponding signal and predefined signal is compared, just can determine initial external image signal is the signal of which kind of object, thereby different extraneous things is distinguished and come completely.
Described modular converter also, for carrying out the D/A digital-to-analogue conversion through the brain imaging signal obtained, is about to above-mentioned brain imaging signal and is converted to analogue signal by original digital signal.This analogue signal, for controlling external device and cerebral cortex interface, is controlled the size of stimulating current.
Described nerve signal transport module is for the intensity according to analogue signal after the D/A digital-to-analogue conversion, produce the electric current of respective intensities, the electric current discharged directly stimulates corticocerebral optic nerve, make optic nerve produce a signal of telecommunication suitable with stimulating current transmits between neuron, signal in final this neuron under the control of optic nerve maincenter, image reconstruction in brain.Particularly, described nerve signal transport module is external device and cerebral cortex interface section, this nerve signal transport module can adopt the framework mode of glasses, allow electric discharge device directly contact the skin of auricle back, electric discharge stimulates cerebral cortex, and corticocerebral optic nerve is received this signal, reaches visual centre, reach image and set up, the purpose of sensing external environment.
Consulting shown in Fig. 2, is the operation process chart of acquired blindness human brain marine origin of the present invention as the method preferred embodiment in the perception external world.
Step S401, image acquisition equipment obtains the external image signal.Described image acquisition equipment can adopt pinprick formula video camera or photographic head commonly used.
Step S402, imageing sensor changes the above-mentioned external image signal obtained into the signal of telecommunication.Described imageing sensor can be cmos image sensor or ccd image sensor.
Step S403, modular converter carries out the A/D analog digital conversion by above-said current signal, and being about to above-said current signal is digital signal by original analog signal conversion.Then described modular converter is removed unnecessary noise by described digital signal, improves signal quality.
Step S404, signal processing module receives the analog-to-digital digital signal of above-mentioned A/D, and above-mentioned digital signal is carried out to DSP(Digital Signal processor, Digital Signal Processing) process, to obtain the brain imaging signal needed.Particularly, described signal processing module carries out the image algorithm processing by above-mentioned digital signal.Described image algorithm is processed and is included but not limited to, image is cut apart, figure image intensifying, figure filtering, pattern recognition.For example, the signal of the pre-defined different amplitudes of described signal processing module: the signal of large tree is A, the signal in river is B, the signal of human body is C, initial external image signal is through the processing of above-mentioned steps S401, S402, S403, in step S404, signal processing module produces corresponding signal according to pattern recognition, take again described pattern recognition to produce corresponding signal and predefined signal is compared, just can determine initial external image signal is the signal of which kind of object, thereby different extraneous things is distinguished and come completely.
Step S405, modular converter carries out the D/A digital-to-analogue conversion by the brain imaging signal obtained, and is about to above-mentioned brain imaging signal and is converted to analogue signal by original digital signal.This analogue signal, for controlling external device and cerebral cortex interface, is controlled the size of stimulating current.
Step S406, the nerve signal transport module is according to the intensity of analogue signal after the D/A digital-to-analogue conversion, produce the electric current of respective intensities, the electric current discharged directly stimulates corticocerebral optic nerve, make optic nerve produce a signal of telecommunication suitable with stimulating current transmits between neuron, signal in final this neuron under the control of optic nerve maincenter, image reconstruction in brain.Particularly, described nerve signal transport module is external device and cerebral cortex interface section, this nerve signal transport module can adopt the framework mode of glasses, allow electric discharge device directly contact the skin of auricle back, electric discharge stimulates cerebral cortex, and corticocerebral optic nerve is received this signal, reaches visual centre, reach image and set up, the purpose of sensing external environment.
Although the present invention is described with reference to current better embodiment; but those skilled in the art will be understood that; above-mentioned better embodiment only is used for illustrating the present invention; not be used for limiting protection scope of the present invention; any within the spirit and principles in the present invention scope; any modification of doing, equivalence replacement, improvement etc., within all should being included in the scope of the present invention.

Claims (8)

1. an acquired blindness human brain marine origin, as the system in the perception external world, is characterized in that, this system comprises image acquisition equipment, imageing sensor, modular converter, signal processing module and the nerve signal transport module of mutual electric connection, wherein:
Described image acquisition equipment is for obtaining the external image signal;
Described imageing sensor is for changing the above-mentioned external image signal obtained into the signal of telecommunication;
Described modular converter is for by above-said current signal, to carry out the A/D analog digital conversion be digital signal and remove unnecessary noise;
Described signal processing module is for above-mentioned digital signal is carried out to the DSP processing, to obtain the brain imaging signal needed;
Described modular converter is also analogue signal for above-mentioned brain imaging signal is carried out to the D/A digital-to-analogue conversion;
Described nerve signal transport module produces the electric current of respective intensities for the intensity according to analogue signal after the D/A digital-to-analogue conversion, release current directly stimulates corticocerebral optic nerve, make optic nerve produce a signal of telecommunication suitable with stimulating current and transmit between neuron, finally the signal in this neuron is realized image reconstruction under the control of optic nerve maincenter in brain.
2. the system as claimed in claim 1, is characterized in that, described image acquisition equipment can be pinprick formula video camera or photographic head.
3. system as claimed in claim 1 or 2, is characterized in that, described imageing sensor can be cmos image sensor or ccd image sensor.
4. the system as claimed in claim 1, is characterized in that, described DSP is treated to image algorithm and processes.
5. system as claimed in claim 4, is characterized in that, described image algorithm is processed and included but not limited to, image is cut apart, figure image intensifying, figure filtering, pattern recognition.
6. an acquired blindness human brain marine origin, as the method in the perception external world, is characterized in that, the method comprises the steps:
Obtain the external image signal;
Change the above-mentioned external image signal obtained into the signal of telecommunication;
By above-said current signal, to carry out the A/D analog digital conversion be digital signal and remove unnecessary noise;
Above-mentioned digital signal is carried out to the DSP processing, to obtain the brain imaging signal needed;
It is analogue signal that above-mentioned brain imaging signal is carried out to the D/A digital-to-analogue conversion; And
Produce the electric current of respective intensities according to the intensity of analogue signal after the D/A digital-to-analogue conversion, release current directly stimulates corticocerebral optic nerve, make optic nerve produce a signal of telecommunication suitable with stimulating current and transmit between neuron, finally the signal in this neuron is realized image reconstruction under the control of optic nerve maincenter in brain.
7. method as claimed in claim 6, is characterized in that, described DSP is treated to image algorithm and processes.
8. method as claimed in claim 7, is characterized in that, described image algorithm is processed and included but not limited to, image is cut apart, figure image intensifying, figure filtering, pattern recognition.
CN201310424624.1A 2013-09-17 2013-09-17 Acquired blindness human brain marine origin is as the system and method in the perception external world Active CN103479449B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310424624.1A CN103479449B (en) 2013-09-17 2013-09-17 Acquired blindness human brain marine origin is as the system and method in the perception external world

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310424624.1A CN103479449B (en) 2013-09-17 2013-09-17 Acquired blindness human brain marine origin is as the system and method in the perception external world

Publications (2)

Publication Number Publication Date
CN103479449A true CN103479449A (en) 2014-01-01
CN103479449B CN103479449B (en) 2016-02-24

Family

ID=49820281

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310424624.1A Active CN103479449B (en) 2013-09-17 2013-09-17 Acquired blindness human brain marine origin is as the system and method in the perception external world

Country Status (1)

Country Link
CN (1) CN103479449B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104065388A (en) * 2014-07-09 2014-09-24 李永飞 Human brain broadcasting station
CN108805092A (en) * 2018-06-15 2018-11-13 郑州布恩科技有限公司 Coloured image method for reconstructing based on local field potentials phase nonlinear mappings characteristics
CN109620539A (en) * 2018-10-31 2019-04-16 北京大学 A kind of device and method that visual information is directly inputted to brain visual cortex
WO2021102733A1 (en) * 2019-11-27 2021-06-03 深圳先进技术研究院 Visual prosthesis apparatus and system, control method and related device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020090132A1 (en) * 2000-11-06 2002-07-11 Boncyk Wayne C. Image capture and identification system and process
CN1461227A (en) * 2000-11-16 2003-12-10 波利瓦洛尔公司 Body electronic implant and artificial vision system thereof
US20040236389A1 (en) * 2003-05-01 2004-11-25 Wolfgang Fink Method and system for training a visual prosthesis
CN1868555A (en) * 2006-04-13 2006-11-29 上海交通大学 Implanted type programmable nervus stimulator
CN1916576A (en) * 2005-08-17 2007-02-21 凌阳科技股份有限公司 Color detector, color identification device and method for identifing colors
CN101411920A (en) * 2008-11-27 2009-04-22 上海交通大学 Multichannel micro-current stimulator in vitro

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020090132A1 (en) * 2000-11-06 2002-07-11 Boncyk Wayne C. Image capture and identification system and process
CN1461227A (en) * 2000-11-16 2003-12-10 波利瓦洛尔公司 Body electronic implant and artificial vision system thereof
US20040236389A1 (en) * 2003-05-01 2004-11-25 Wolfgang Fink Method and system for training a visual prosthesis
CN1916576A (en) * 2005-08-17 2007-02-21 凌阳科技股份有限公司 Color detector, color identification device and method for identifing colors
CN1868555A (en) * 2006-04-13 2006-11-29 上海交通大学 Implanted type programmable nervus stimulator
CN101411920A (en) * 2008-11-27 2009-04-22 上海交通大学 Multichannel micro-current stimulator in vitro

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104065388A (en) * 2014-07-09 2014-09-24 李永飞 Human brain broadcasting station
CN108805092A (en) * 2018-06-15 2018-11-13 郑州布恩科技有限公司 Coloured image method for reconstructing based on local field potentials phase nonlinear mappings characteristics
CN109620539A (en) * 2018-10-31 2019-04-16 北京大学 A kind of device and method that visual information is directly inputted to brain visual cortex
WO2021102733A1 (en) * 2019-11-27 2021-06-03 深圳先进技术研究院 Visual prosthesis apparatus and system, control method and related device

Also Published As

Publication number Publication date
CN103479449B (en) 2016-02-24

Similar Documents

Publication Publication Date Title
CN103845137B (en) Based on the robot control method of stable state vision inducting brain-machine interface
US9517345B2 (en) Neuroprosthetic stimulation
WO2013116161A1 (en) System and methods for closed-loop cochlear implant
CN103479449B (en) Acquired blindness human brain marine origin is as the system and method in the perception external world
CN105147281A (en) Portable stimulating, awaking and evaluating system for disturbance of consciousness
US10863911B2 (en) Detecting neuronal action potentials using a convolutive compound action potential model
CN112617863B (en) Hybrid online computer-computer interface method for identifying lateral direction of left and right foot movement intention
Sarma et al. Pre-processing and feature extraction techniques for EEGBCI applications-a review of recent research
WO2015085127A1 (en) Detecting neuronal action potentials using a sparse signal representation
CN107510555B (en) Wheelchair electroencephalogram control device and control method
CN114712706A (en) Electroencephalogram-based fatigue intervention system and device
CN109766751A (en) Stable state vision inducting brain electricity personal identification method and system based on Frequency Domain Coding
CN109567936A (en) A kind of brain machine interface system and implementation method paid attention to based on the sense of hearing with multifocal electro physiology
Toledo-Peral et al. sEMG signal acquisition strategy towards hand FES control
CN113359991A (en) Intelligent brain-controlled mechanical arm auxiliary feeding system and method for disabled people
CN110051351B (en) Tooth biting signal acquisition method and control method and device of electronic equipment
CN105812970B (en) External electronic ear device and artificial ear implantation device
CN113407026B (en) Brain-computer interface system and method for enhancing hairless zone brain electric response intensity
Nguyen et al. A wireless assistive device for visually-impaired persons using tongue electrotactile system
Pan et al. The effects of classification method and electrode configuration on EEG-based silent speech classification
Mezzina et al. Near-brain computation: embedding P300-based BCIs at EEG headset level
Tang et al. Extraction of control signals from a mixture of source activity in the peripheral nerve
WO2023126756A1 (en) User-preferred adaptive noise reduction
US20230191129A1 (en) Auditory neural interface device
Melnikov et al. Analysis of Coding Strategies in Cochlear Implant Systems

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant