CN109620539A - A kind of device and method that visual information is directly inputted to brain visual cortex - Google Patents
A kind of device and method that visual information is directly inputted to brain visual cortex Download PDFInfo
- Publication number
- CN109620539A CN109620539A CN201811285019.XA CN201811285019A CN109620539A CN 109620539 A CN109620539 A CN 109620539A CN 201811285019 A CN201811285019 A CN 201811285019A CN 109620539 A CN109620539 A CN 109620539A
- Authority
- CN
- China
- Prior art keywords
- visual
- visual information
- information
- array
- directly inputted
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F9/00—Methods or devices for treatment of the eyes; Devices for putting-in contact lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
- A61F9/08—Devices or methods enabling eye-patients to replace direct visual perception by another kind of perception
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N1/00—Electrotherapy; Circuits therefor
- A61N1/02—Details
- A61N1/04—Electrodes
- A61N1/05—Electrodes for implantation or insertion into the body, e.g. heart electrode
- A61N1/0526—Head electrodes
- A61N1/0529—Electrodes for brain stimulation
- A61N1/0531—Brain cortex electrodes
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Veterinary Medicine (AREA)
- Neurology (AREA)
- Public Health (AREA)
- Life Sciences & Earth Sciences (AREA)
- Animal Behavior & Ethology (AREA)
- Neurosurgery (AREA)
- Heart & Thoracic Surgery (AREA)
- Engineering & Computer Science (AREA)
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
- Ophthalmology & Optometry (AREA)
- Psychology (AREA)
- Cardiology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Vascular Medicine (AREA)
Abstract
The present invention discloses a kind of device that visual information is directly inputted to brain visual cortex, it include: a pattern recognition device, outside human body, the pattern recognition device includes a camera, a code oscillator, for the camera for absorbing external image information, which is used to for the image information absorbed being encoded into the visual information of corresponding electro photoluminescence array format；One flexible device, it is implanted in skull on visual cortex meninx, the electrod-array that the visual information can be converted to electro photoluminescence array format is provided on the flexible device, corresponding electrode group is caused to generate electric signal according to the visual information, generate electro photoluminescence array, the excitement of the corresponding neural primitive encoding of stimulation, forms vision.Invention additionally discloses a kind of methods that visual information is directly inputted to brain visual cortex.
Description
Technical field
The present invention relates to artificial vision's technical field, specially a kind of programmable array electrical devices and one kind are based on
The method of the device, to directly input visual information to brain visual cortex.
Background technique
According to the data of the World Health Organization, there are 39,000,000 blind persons in the whole world, refers to that the congenital or vision day after tomorrow has barrier
The blindness crowd hindered.Dysopia even lacks the quality of life for having seriously affected patient, loses especially for those posteriorities
Bright patient.In order to improve the quality of life of blind person, a large amount of artificial vision's device has been developed at present, can be divided mainly into two
Class: one kind is attempt to restore the technology of visual performance, such as retina prosthese；Another kind of is vision alternate device, and vision is believed
Breath is by other means as tactile or the sense of hearing pass to patient.Blind man's stick and braille are exactly relatively early and more current use occur to compare
The popular vision alternate device with the tactilely-perceptible external world, in recent ten years, more external informations can be converted by gradually developing
Novel artificial vision replacement system.
First kind artificial vision's device, i.e. retina prosthese, resolution ratio is lower, is far below 1000.Second class vision is replaced
It is more then to carry out haptic stimulus in tongue, back or waist for equipment, has reached the purpose for inputting extraneous visual information,
But this can seriously affect patient linguistic function and some basic daily life functions of such as bending over, and this category information is to believe indirectly
Breath will increase information recognition time, extends the reaction time, influences reaction speed.
Summary of the invention
In order to overcome the above-mentioned deficiency of existing artificial vision's technology, the present invention, which provides, a kind of to be directly inputted to visual information
The device and method of brain visual cortex can allow blindness patient directly " seeing " to form real vision to external information.
The technical solution adopted by the present invention to solve the technical problems is:
A kind of device that visual information is directly inputted to brain visual cortex, comprising:
One pattern recognition device is located at outside human body, which includes a camera, encoded signal generation
Device, the camera is for absorbing external image information, and the code oscillator is for the image information absorbed to be encoded into
The visual information of corresponding electro photoluminescence array format；
One flexible device is implanted in skull on visual cortex meninx, and the vision can be believed by being provided on the flexible device
Breath is converted to the electrod-array of electro photoluminescence array format, causes corresponding electrode group to generate electric signal according to the visual information,
Electro photoluminescence array is generated, the excitement of corresponding neural primitive encoding is stimulated, forms vision.
Further, described image identification device is connect with the flexible device by wired or wireless mode, if adopting
With wirelessly connecting, then described image identification device include by the Vision information processing at wireless signal and issue one
Wireless signal processing, the flexible device includes the wireless signal receiver for receiving the wireless signal.
Further, the flexible device and visual cortex shape are coincide, and on the one hand enable flexible device fine with visual cortex
Ground is attached onto, and on the other hand can be covered larger range of visual cortex area as much as possible, be improved the validity of imaging.
Further, the flexible device is manufactured by 3D printing technique.
Further, the flexible device top electrode pixelated array point range are as follows: 1 × 1~100 × 100.
Further, the frequency of stimulation of the flexible device top electrode array are as follows: 0.01~1000Hz.
A method of visual information is directly inputted to brain visual cortex, comprising the following steps:
External image information is identified by the pattern recognition device being located at outside human body, which is encoded into accordingly
Electro photoluminescence array format visual information, which is sent to positioned at the flexible device in skull on visual cortex meninx
Part；
The flexible device, according to the visual information, causes corresponding electrode group to generate telecommunications by its electrod-array
Number, the excitement for stimulating corresponding neural primitive encoding at electro photoluminescence array is generated, vision is formed.
Further, described image information includes profile, gray scale, color.
Further, the electric signal include signal with or without, signal strength, signal frequency.
Further, the intensity or frequency of the electro photoluminescence generated by the electrod-array edited on the flexible device, make
Visual area generates the feeling of gray scale or colour.
Extraneous visual information is pierced with electricity with two-dimensional encoded form presence in visual cortex the present invention is based on visual information
The method for swashing array is directly inputted to visual cortex, generates it using voltage or electric current stimulating visual cortex neuron excited, is formed
Real vision, achievees the effect that artificial vision.
Compared with other existing artificial vision techniques, heretofore described flexible device can be pasted with visual cortex perfection
It closes, the profile and fidelity of the visual pattern of formation are more preferable.In addition, the present invention can make patient generate true visual experience,
Without converting by tactile, the enough reaction time is reserved to patient.
Detailed description of the invention
Fig. 1 is that the implant site comparison of apparatus of the present invention in traditional artificial visual information input unit and embodiment is illustrated
Figure.
Fig. 2 is that the personalized of apparatus of the present invention in embodiment is close to meninx 3D flexible electrode array schematic diagram.
Fig. 3 is the overall construction and position view of apparatus of the present invention in embodiment.
Fig. 4 A~4C is that electrod-array corresponds to neuron arrays area in visual cortex and directly inputs visual information two dimensional code
Schematic diagram；
Wherein, Fig. 4 A is electrod-array partial schematic diagram, shows that a planar rectangular excitation figure, exciting electrode unit are used
Black indicates that non-exciting electrode is indicated with white；Fig. 4 B is that exciting electrode covering visual cortex corresponds to neuron two dimension cell space network
Position view；Fig. 4 C be excited electrode electromagnetic pulse stimulation and activate excitedly pericaryon (being designated as black) illustrate
Figure.
Fig. 5 A~5B is that electrod-array two dimensional image formation visual cortex corresponds to excitor nerve member two-dimensional network diagram intention；
Wherein, Fig. 5 A is the signal of artificial vision's Information Compression pattern；Fig. 5 B is by repetition training in vision cortex shape
At strong link excitor nerve member cell space pattern schematic diagram.
Specific embodiment
To enable features described above and advantage of the invention to be clearer and more comprehensible, special embodiment below, and institute's attached drawing is cooperated to make
Detailed description are as follows.
The present embodiment discloses a kind of device that visual information is directly inputted to brain visual cortex, including flexible device and figure
As identification device, in such a way that the two is wirelessly connected for, wherein pattern recognition device includes that a camera, an encoded signal are sent out
Raw device and a wireless signal processor, the position of each element are very different with traditional artificial vision's message input device, are passed
Artificial vision's message input device of system is located at human eye, and the present invention is good according to everyone visual cortex structure personalized customization
It after personalized flexible device, is implanted into outside visual cortex meninx, is fitted closely with meninx, complete device implantation and prepare, and
Pattern recognition device is located at outside brain, after wherein wireless signal processor can be affixed on brain, as shown in FIG. 1 to 3.
By the pattern recognition device recognition target image of peripheral hardware, and by each frame image information (mainly profile, ash
Degree, color etc.) be converted into the corresponding electrical signal form of array electrode (with or without, signal strength, signal frequency etc.) send to it is soft
Electrod-array on property device.Each frame image can generate specific electro photoluminescence array, be applied to the corresponding positions of visual cortex meninx
It sets, stimulates neuronal excitation below, to generate image.
For example, it is desired to which the image of a rectangle frame, which is inputed to patient, forms image.When pattern recognition device is by rectangle
After image is converted into corresponding electro photoluminescence array, corresponding electrode will receive the letter that code oscillator transmits on flexible device
Number instruction, generate electric impulse signal, as shown in Figure 4 A, wherein black electrodes are the electrode for receiving order, other white electrodes
It is the electrode for not receiving order.On flexible device corresponding electrode issue can excite after electric impulse signal below one or more
Neuron (is determined) by the density of base part neuron, is made its excitement, is generated vision imaging, as shown in Fig. 4 B~4C, wherein
Fig. 4 B is that exciting electrode covering visual cortex corresponds to neuron two dimension cell space network site schematic diagram, and Fig. 4 C is the electrode electromagnetism that is excited
Impulse stimulation and activate excitedly pericaryon (being designated as black) schematic diagram.
Through repetition training after a period of time, brain can obtain the corresponding relationship of image and meaning, be really achieved artificial view
The purpose of feel, as shown in Fig. 5 A~5B, wherein Fig. 5 A is the signal of artificial vision's Information Compression pattern, and Fig. 5 B is by instructing repeatedly
Practice the strong link excitor nerve member cell space pattern schematic diagram formed in vision cortex.
The above embodiments are merely illustrative of the technical solutions of the present invention rather than is limited, the ordinary skill of this field
Personnel can be with modification or equivalent replacement of the technical solution of the present invention are made, without departing from the spirit and scope of the present invention, this
The protection scope of invention should be subject to described in claims.
Claims (10)
1. a kind of device that visual information is directly inputted to brain visual cortex characterized by comprising
One pattern recognition device, the pattern recognition device include a camera, a code oscillator, and the camera is for taking the photograph
External image information is taken, which is used to the image information absorbed being encoded into corresponding electro photoluminescence array shape
The visual information of formula；
One flexible device is provided with the electrode array that the visual information can be converted to electro photoluminescence array format on the flexible device
Column cause corresponding electrode group to generate electric signal, generate electro photoluminescence array, corresponding neuron is stimulated to compile according to the visual information
The excitement of code forms vision.
2. a kind of device that visual information is directly inputted to brain visual cortex as described in claim 1, which is characterized in that institute
It states pattern recognition device and is connect with the flexible device by wired or wireless mode, according to wirelessly connecting, then
Described image identification device includes handling the Vision information processing at wireless signal and a wireless signal of sending, described soft
Property device includes the wireless signal receiver for receiving the wireless signal.
3. a kind of device that visual information is directly inputted to brain visual cortex as described in claim 1, which is characterized in that institute
It states flexible device and visual cortex shape is coincide.
4. a kind of device that visual information is directly inputted to brain visual cortex as claimed in claim 3, which is characterized in that institute
Flexible device is stated to manufacture by 3D printing technique.
5. a kind of device that visual information is directly inputted to brain visual cortex as described in claim 1, which is characterized in that institute
State flexible device top electrode pixelated array point range are as follows: 1 × 1~100 × 100.
6. a kind of device that visual information is directly inputted to brain visual cortex as described in claim 1, which is characterized in that institute
State the frequency of stimulation of flexible device top electrode array are as follows: 0.01~1000Hz.
7. a kind of method that visual information is directly inputted to brain visual cortex, which comprises the following steps:
External image information is identified by the pattern recognition device being located at outside human body, which is encoded into corresponding electricity
The visual information for stimulating array format, which is sent to positioned at the flexible device in skull on visual cortex meninx；
The flexible device, according to the visual information, causes corresponding electrode group to generate electric signal by its electrod-array, produces
Electro photoluminescence array is generated, the excitement of corresponding neural primitive encoding is stimulated, forms vision.
8. a kind of method that visual information is directly inputted to brain visual cortex as claimed in claim 7, which is characterized in that institute
Stating image information includes profile, gray scale, color.
9. a kind of method that visual information is directly inputted to brain visual cortex as claimed in claim 7, which is characterized in that institute
State electric signal include signal with or without, signal strength, signal frequency.
10. a kind of method that visual information is directly inputted to brain visual cortex as claimed in claim 7, which is characterized in that
By the intensity or frequency of the electro photoluminescence that the electrod-array edited on the flexible device generates, make visual area generate gray scale or
Colored feeling.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811285019.XA CN109620539A (en) | 2018-10-31 | 2018-10-31 | A kind of device and method that visual information is directly inputted to brain visual cortex |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811285019.XA CN109620539A (en) | 2018-10-31 | 2018-10-31 | A kind of device and method that visual information is directly inputted to brain visual cortex |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109620539A true CN109620539A (en) | 2019-04-16 |
Family
ID=66066993
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811285019.XA Pending CN109620539A (en) | 2018-10-31 | 2018-10-31 | A kind of device and method that visual information is directly inputted to brain visual cortex |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109620539A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112807129A (en) * | 2021-01-15 | 2021-05-18 | 首都医科大学附属北京同仁医院 | Vision bionic system and use method thereof |
| CN114625254A (en) * | 2022-03-17 | 2022-06-14 | 天津大学 | Touch display platform based on STM32 and flexible array type electrical stimulation device |
| CN114949618A (en) * | 2022-05-19 | 2022-08-30 | 中国科学院半导体研究所 | Photoelectric integrated module for nerve regulation |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101879348A (en) * | 2010-06-18 | 2010-11-10 | 中国人民解放军第三军医大学第一附属医院 | Visual function restoration system based on external electrical stimulation by endocranium |
| CN102544052A (en) * | 2012-03-08 | 2012-07-04 | 中国科学院深圳先进技术研究院 | Flexible intracranial cortex microelectrode chip, and preparation method and packaging method and packaging structure thereof |
| CN103479449A (en) * | 2013-09-17 | 2014-01-01 | 深圳先进技术研究院 | Brain imaging outside sensing system and method for acquired blind people |
| CN104330440A (en) * | 2014-10-27 | 2015-02-04 | 中国科学院半导体研究所 | Implanted type flexible sensor based on organic transistor and preparation method |
| CN104352303A (en) * | 2014-10-30 | 2015-02-18 | 北京大学 | Equipment and method for forming artificial vision by electrical stimulation |
| CN106073771A (en) * | 2016-06-29 | 2016-11-09 | 中国科学院上海微系统与信息技术研究所 | A kind of customizable various dimensions high density flexible brain electrode and preparation method thereof |
| CN106236377A (en) * | 2016-09-12 | 2016-12-21 | 北京大学 | SCNS is utilized to form the equipment of artificial vision |
| CN106599816A (en) * | 2016-12-06 | 2017-04-26 | 中国科学院深圳先进技术研究院 | Image recognition method and device based on artificial retina |
| CN107638176A (en) * | 2017-09-08 | 2018-01-30 | 浙江大学 | A kind of application of hydrogel in the electrode for preparing detection electrocorticogram |
-
2018
- 2018-10-31 CN CN201811285019.XA patent/CN109620539A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101879348A (en) * | 2010-06-18 | 2010-11-10 | 中国人民解放军第三军医大学第一附属医院 | Visual function restoration system based on external electrical stimulation by endocranium |
| CN102544052A (en) * | 2012-03-08 | 2012-07-04 | 中国科学院深圳先进技术研究院 | Flexible intracranial cortex microelectrode chip, and preparation method and packaging method and packaging structure thereof |
| CN103479449A (en) * | 2013-09-17 | 2014-01-01 | 深圳先进技术研究院 | Brain imaging outside sensing system and method for acquired blind people |
| CN104330440A (en) * | 2014-10-27 | 2015-02-04 | 中国科学院半导体研究所 | Implanted type flexible sensor based on organic transistor and preparation method |
| CN104352303A (en) * | 2014-10-30 | 2015-02-18 | 北京大学 | Equipment and method for forming artificial vision by electrical stimulation |
| CN106073771A (en) * | 2016-06-29 | 2016-11-09 | 中国科学院上海微系统与信息技术研究所 | A kind of customizable various dimensions high density flexible brain electrode and preparation method thereof |
| CN106236377A (en) * | 2016-09-12 | 2016-12-21 | 北京大学 | SCNS is utilized to form the equipment of artificial vision |
| CN106599816A (en) * | 2016-12-06 | 2017-04-26 | 中国科学院深圳先进技术研究院 | Image recognition method and device based on artificial retina |
| CN107638176A (en) * | 2017-09-08 | 2018-01-30 | 浙江大学 | A kind of application of hydrogel in the electrode for preparing detection electrocorticogram |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112807129A (en) * | 2021-01-15 | 2021-05-18 | 首都医科大学附属北京同仁医院 | Vision bionic system and use method thereof |
| CN114625254A (en) * | 2022-03-17 | 2022-06-14 | 天津大学 | Touch display platform based on STM32 and flexible array type electrical stimulation device |
| CN114949618A (en) * | 2022-05-19 | 2022-08-30 | 中国科学院半导体研究所 | Photoelectric integrated module for nerve regulation |
| CN114949618B (en) * | 2022-05-19 | 2023-02-21 | 中国科学院半导体研究所 | Photoelectric integrated module for nerve regulation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP1061874B2 (en) | Visual prosthesis | |
| CN109620539A (en) | A kind of device and method that visual information is directly inputted to brain visual cortex | |
| JP2004521673A (en) | In-vivo electronic implant and its artificial vision system | |
| CN103732287A (en) | Method and device for controlling a device for aiding vision | |
| Piedade et al. | Visual neuroprosthesis: a non invasive system for stimulating the cortex | |
| Palanker et al. | Restoring sight with retinal prostheses | |
| CN106236377A (en) | SCNS is utilized to form the equipment of artificial vision | |
| US20080161915A1 (en) | System for creating visual images | |
| CN109152919A (en) | Activated retinal implantation material | |
| Banerjee et al. | Bionic eye-a review | |
| CN110300562A (en) | Use the sense organ alternative system of asynchronous haptic stimulus | |
| Gandhi et al. | Sensory Vision Substitution using Tactile Stimulation | |
| CN218352743U (en) | Visual prosthesis external member, system thereof and visual prosthesis system | |
| CN116440409B (en) | Human retina cell stimulation equipment and method based on infrared light excitation | |
| Moritz Jr | Evaluation of electrical tongue stimulation for communication of audio information to the brain | |
| Lauritzen et al. | Reading visual braille with a retinal prosthesis | |
| Moraru et al. | On how to achieve visual sensory substitution | |
| Srivastava et al. | FPGA based visual prosthesis device for testing visual perception on non human primates | |
| Code | Bionic eyes: Treatments for blindness target the retina and the brain | |
| Moraru et al. | SEEING WITHOUT EYES: VISUAL SENSORY SUBSTITUTION. | |
| Abu-Faraj et al. | A prototype retinal prosthesis for visual stimulation | |
| Luján Villarreal | Toward pixel-wise vision in epiretinal visual prosthesis | |
| Viola et al. | A neuroprosthesis for restoring sight | |
| Second Sight Medical Products | Retinal prosthesis system: a revolutionary advancement for the severely visually impaired | |
| Alotaibi | Artificial Vision-Visual Prosthesis |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190416 |
|
| RJ01 | Rejection of invention patent application after publication |