CN114053582A - Visual enhancement method, device and system based on flexible electrode probe - Google Patents
Visual enhancement method, device and system based on flexible electrode probe Download PDFInfo
- Publication number
- CN114053582A CN114053582A CN202111323374.3A CN202111323374A CN114053582A CN 114053582 A CN114053582 A CN 114053582A CN 202111323374 A CN202111323374 A CN 202111323374A CN 114053582 A CN114053582 A CN 114053582A
- Authority
- CN
- China
- Prior art keywords
- candidate position
- electrode
- candidate
- code
- displayed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N1/00—Electrotherapy; Circuits therefor
- A61N1/18—Applying electric currents by contact electrodes
- A61N1/32—Applying electric currents by contact electrodes alternating or intermittent currents
- A61N1/36—Applying electric currents by contact electrodes alternating or intermittent currents for stimulation
- A61N1/36046—Applying electric currents by contact electrodes alternating or intermittent currents for stimulation of the eye
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N1/00—Electrotherapy; Circuits therefor
- A61N1/18—Applying electric currents by contact electrodes
- A61N1/32—Applying electric currents by contact electrodes alternating or intermittent currents
- A61N1/36—Applying electric currents by contact electrodes alternating or intermittent currents for stimulation
- A61N1/3605—Implantable neurostimulators for stimulating central or peripheral nerve system
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N1/00—Electrotherapy; Circuits therefor
- A61N1/18—Applying electric currents by contact electrodes
- A61N1/32—Applying electric currents by contact electrodes alternating or intermittent currents
- A61N1/36—Applying electric currents by contact electrodes alternating or intermittent currents for stimulation
- A61N1/3605—Implantable neurostimulators for stimulating central or peripheral nerve system
- A61N1/36128—Control systems
- A61N1/36135—Control systems using physiological parameters
- A61N1/36139—Control systems using physiological parameters with automatic adjustment
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N1/00—Electrotherapy; Circuits therefor
- A61N1/18—Applying electric currents by contact electrodes
- A61N1/32—Applying electric currents by contact electrodes alternating or intermittent currents
- A61N1/36—Applying electric currents by contact electrodes alternating or intermittent currents for stimulation
- A61N1/3605—Implantable neurostimulators for stimulating central or peripheral nerve system
- A61N1/36128—Control systems
- A61N1/36146—Control systems specified by the stimulation parameters
- A61N1/3615—Intensity
Abstract
The visual enhancement method comprises the steps of obtaining information to be displayed, determining a candidate position set from a region to be stimulated based on the information to be displayed, implanting a flexible electrode probe into the region to be stimulated, controlling an electrical stimulation unit to stimulate each candidate position in the candidate position set, and obtaining an electroencephalogram signal corresponding to each candidate position; the electroencephalogram signals are signals obtained by stimulating the neurons corresponding to each candidate position, and target display information is determined according to the electroencephalogram signals corresponding to each candidate position and the information to be displayed. Based on the method and the device, regulation and control in the artificial visual display can be realized, and the closed-loop reading and writing effects can be achieved.
Description
Technical Field
The invention relates to the technical field of visual nerves, in particular to a visual enhancement method, device and system based on a flexible electrode probe.
Background
For the visually impaired, effective visual functions can greatly improve their independence and quality of life in social activities. Visual cortex prosthesis is an effective visual enhancement technology, and artificial vision is created by micro-electrical stimulation of visual cortex without performing visual processing through eyes or optic nerves. Therefore, the visual cortex prosthesis can be applied to the recovery of the visual loss of the blind people who have injured or degenerated retina, eyes or optic nerves but have intact visual cortex in the future.
Disclosure of Invention
The embodiment of the application provides a visual enhancement method, a device and a system based on a flexible electrode probe, which can realize regulation and control in artificial visual display and achieve the effect of closed-loop reading and writing.
The embodiment of the application provides a visual enhancement method based on a flexible electrode probe, which comprises the following steps:
acquiring information to be displayed;
determining a candidate position set from the region to be stimulated based on the information to be displayed; a flexible electrode probe is implanted in the area to be stimulated;
controlling an electrical stimulation unit to stimulate each candidate position in the candidate position set to obtain an electroencephalogram signal corresponding to each candidate position; the electroencephalogram signal is a signal obtained by stimulating a neuron corresponding to each candidate position;
and determining target display information according to the electroencephalogram signal corresponding to each candidate position and the information to be displayed.
Further, determining target display information according to the electroencephalogram signal corresponding to each candidate position and the information to be displayed, and the method comprises the following steps:
determining candidate display information according to the electroencephalogram signal corresponding to each candidate position;
and if the candidate display information is matched with the information to be displayed, determining the candidate display information as target display information.
Further, the flexible electrode probe has a plurality of channels, each of the plurality of channels including a plurality of electrode sites;
before stimulation processing is performed on each candidate position in the candidate position set, the method further includes:
coding a plurality of electrode sites of each channel to obtain an electrode coding subset; each electrode code in the electrode code subset corresponds to each electrode site in the plurality of electrode sites one to one, and the electrode code is a code at a candidate position corresponding to a channel to which the corresponding electrode site belongs.
Further, performing stimulation processing on each candidate position in the candidate position set to obtain an electroencephalogram signal corresponding to each candidate position, including:
determining a target electrode code from each electrode code subset to obtain a target electrode code set;
and applying current to the electrode site corresponding to each target electrode code in the target electrode code set, and performing stimulation processing on the candidate position corresponding to each target electrode code to obtain the electroencephalogram signal corresponding to each candidate position.
Accordingly, the present application provides a vision enhancement device based on a flexible electrode probe, including:
the acquisition module is used for acquiring information to be displayed;
the device comprises a first determination module, a second determination module and a display module, wherein the first determination module is used for determining a candidate position set from a region to be stimulated based on information to be displayed; a flexible electrode probe is implanted in the area to be stimulated;
the stimulation module is used for controlling the electrical stimulation unit to stimulate each candidate position in the candidate position set to acquire an electroencephalogram signal corresponding to each candidate position; the electroencephalogram signal is a signal obtained by stimulating a neuron corresponding to each candidate position;
and the second determining module is used for determining target display information according to the electroencephalogram signal corresponding to each candidate position and the information to be displayed.
Further, the second determining module includes:
the first determining submodule is used for determining candidate display information according to the electroencephalogram signal corresponding to each candidate position;
and the second determining submodule is used for determining the candidate display information as the target display information if the candidate display information is matched with the information to be displayed.
Further, the flexible electrode probe has a plurality of channels, each of the plurality of channels including a plurality of electrode sites;
the device still includes:
an encoding module for, prior to stimulation processing for each candidate location in the set of candidate locations,
coding a plurality of electrode sites of each channel to obtain an electrode coding subset; each electrode code in the electrode code subset corresponds to each electrode site in the plurality of electrode sites one to one, and the electrode code is a code at a candidate position corresponding to a channel to which the corresponding electrode site belongs.
Further, a stimulation module comprising:
the third determining submodule is used for determining a target electrode code from each electrode code subset to obtain a target electrode code set;
and the processing submodule is used for applying current to the electrode site corresponding to each target electrode code in the target electrode code set, performing stimulation processing on the candidate position corresponding to each target electrode code and acquiring the electroencephalogram signal corresponding to each candidate position.
Accordingly, embodiments of the present application provide an enhanced vision system based on a flexible electrode probe, including:
the processor is used for acquiring information to be displayed;
determining a candidate position set from the region to be stimulated based on the information to be displayed; a flexible electrode probe is implanted in the area to be stimulated;
controlling an electrical stimulation unit to stimulate each candidate position in the candidate position set to obtain an electroencephalogram signal corresponding to each candidate position; the electroencephalogram signal is a signal obtained by stimulating a neuron corresponding to each candidate position;
determining target display information according to the electroencephalogram signal corresponding to each candidate position and the information to be displayed;
the electrical stimulation unit is used for performing stimulation processing on each candidate position in the candidate position set so as to enable a neuron corresponding to each candidate position to be stimulated to generate an electroencephalogram signal;
and the electroencephalogram signal acquisition unit is used for acquiring the electroencephalogram signal corresponding to each candidate position and sending the electroencephalogram signal to the processor.
Accordingly, an embodiment of the present application further provides an electronic device, which includes a processor and a memory, where at least one instruction, at least one program, a set of codes, or a set of instructions is stored in the memory, and the at least one instruction, the at least one program, the set of codes, or the set of instructions is loaded and executed by the processor to implement the above-mentioned flexible electrode probe-based vision enhancement method.
Accordingly, embodiments of the present application also provide a computer-readable storage medium, in which at least one instruction, at least one program, a code set, or a set of instructions is stored, and the at least one instruction, the at least one program, the code set, or the set of instructions is loaded and executed by a processor to implement the above-mentioned flexible electrode probe-based vision enhancement method.
The embodiment of the application has the following beneficial effects:
the visual enhancement method comprises the steps of obtaining information to be displayed, determining a candidate position set from a region to be stimulated based on the information to be displayed, implanting a flexible electrode probe into the region to be stimulated, controlling an electrical stimulation unit to stimulate each candidate position in the candidate position set, and obtaining an electroencephalogram signal corresponding to each candidate position; the electroencephalogram signals are signals obtained by stimulating the neurons corresponding to each candidate position, and target display information is determined according to the electroencephalogram signals corresponding to each candidate position and the information to be displayed. Based on the method and the device, regulation and control in the artificial visual display can be realized, and the closed-loop reading and writing effects can be achieved.
Drawings
In order to more clearly illustrate the technical solutions and advantages of the embodiments of the present application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a schematic diagram of an application environment provided by an embodiment of the present application;
FIG. 2 is a schematic flow chart of a method for enhancing vision based on a flexible electrode probe according to an embodiment of the present disclosure;
FIG. 3 is a schematic diagram of a flexible electrode probe provided in an embodiment of the present application;
fig. 4 is a schematic diagram of information to be displayed according to an embodiment of the present application;
FIG. 5 is a schematic structural diagram of a vision enhancement device based on a flexible electrode probe according to an embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of a vision enhancement system based on a flexible electrode probe according to an embodiment of the present application.
Detailed Description
To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings. It should be apparent that the described embodiment is only one embodiment of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
An "embodiment" as referred to herein relates to a particular feature, structure, or characteristic that may be included in at least one implementation of the present application. In the description of the embodiments of the present application, it should be understood that the terms "upper", "lower", "top", "bottom", and the like refer to orientations or positional relationships based on those shown in the drawings, and are used for convenience in describing the present application and simplifying the description, but do not indicate or imply that the device/system or element referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus should not be construed as limiting the present application. The terms "first", "second" and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first", "second" and "third" may explicitly or implicitly include one or more of the features. Moreover, the terms "first," "second," and "third," etc. are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in other sequences than described or illustrated herein. Furthermore, the terms "comprising" and "having," as well as any variations thereof, are intended to cover non-exclusive inclusions.
Referring to fig. 1, a schematic diagram of an application environment provided in the embodiment of the present application is shown, including a processor 101, an electrical stimulation unit 103, and an electroencephalogram signal acquisition unit 105. The processor 101 may be connected to the electrical stimulation unit 103 through a wired link or a wireless link, and the processor 101 may be connected to the electroencephalogram signal acquisition unit 105 through a wired link or a wireless link. The processor can acquire information to be displayed, determine a candidate position set from a region to be stimulated based on the information to be displayed, implant a flexible electrode probe into the region to be stimulated, control the electrical stimulation unit 103 to stimulate each candidate position in the candidate position set, and acquire electroencephalograms corresponding to each candidate position based on the electroencephalogram signal acquisition unit 105; the electroencephalogram signals are signals obtained by stimulating the neurons corresponding to each candidate position, and target display information is determined according to the electroencephalogram signals corresponding to each candidate position and the information to be displayed.
While a specific embodiment of a method for enhancing vision based on a flexible electrode probe according to the present application is described below, fig. 2 is a schematic flow chart of a method for enhancing vision based on a flexible electrode probe according to an embodiment of the present application, and the present specification provides the method operation steps as shown in the embodiment or the flow chart, but more or fewer operation steps can be included based on conventional or non-inventive labor. The order of steps recited in the embodiments is only one of many possible orders of execution and does not represent the only order of execution, and in actual execution, the steps may be performed sequentially or in parallel as in the embodiments or methods shown in the figures (e.g., in the context of parallel processors or multi-threaded processing). Specifically, as shown in fig. 2, the method includes:
s201: and acquiring information to be displayed.
In the embodiment of the application, the processor may acquire information to be displayed, where the information to be displayed may be triggered by a user based on a display interface of the processor, or may be input based on an input device adapted to the processing. In an alternative embodiment, the information to be displayed may be numbers, letters, or other information such as characters, and the description is not limited in detail.
In an alternative embodiment, the information to be displayed obtained by the processor may be the letter "a".
S203: determining a candidate position set from the region to be stimulated based on the information to be displayed; the area to be stimulated is implanted with a flexible electrode probe.
In the present embodiment, the cerebral cortex of the subject may have a plurality of regions, such as a motor region M1, a visual region V1, an auditory region H1, and the like. In the embodiment of the application, a flexible electrode probe can be implanted in the visual area of the cerebral cortex of a subject, namely the area to be stimulated, and optionally a flexible electrode probe of 81 channels can be implanted in the visual area V1.
Fig. 3 is a schematic diagram of a flexible electrode probe provided in an embodiment of the present application, where the flexible electrode probe may include a plurality of channels, and each channel may include a plurality of electrode sites. As shown in fig. 3, the channel 300 may include a first electrode site 301 and a second electrode site 302. Because the cerebral cortex of the subject is curved, when the flexible electrode probe is implanted into the cerebral cortex of the subject, each channel in a plurality of channels corresponds to different areas of the visual cortex from the top view of the head of the subject, but the coordinates of a plurality of electrode sites on the same channel in a coordinate system corresponding to the cerebral cortex are consistent, namely the plurality of electrode sites on the same channel correspond to the same area of the visual cortex. Assume that the first electrode site 301 corresponds to (2,1,0) in the spatial coordinate system, and the second electrode site 302 corresponds to (2,1, -1) in the spatial coordinate system, but both electrode sites correspond to (2,1) in the coordinate system corresponding to the cerebral cortex. However, from the front view of the head of the subject, the plurality of electrode sites on the same channel are not at the same height, i.e., the positions in the electrode site array are different, and it is assumed that the first electrode site 301 corresponds to the position (6,2) in the electrode site array and the second electrode site 302 corresponds to the position (11,2) in the electrode site array.
In this embodiment of the present application, a plurality of electrode sites of each channel may be encoded to obtain an electrode encoding subset, where each electrode encoding in the electrode encoding subset corresponds to each electrode site in the plurality of electrode sites one to one, and an electrode encoding is an encoding at a candidate position corresponding to a channel to which the corresponding electrode site belongs. The code m corresponding to each electrode site has a one-to-one correspondence relationship with the position of the corresponding electrode site in the electrode array, i.e., f (m) → (x, y). For example, the first electrode site 301 and the second electrode site may be encoded to obtain a code m of 1 corresponding to the first electrode site, a code m of 2 corresponding to the second electrode site, that is, a code 1 corresponding to position (6,2), and a code 2 corresponding to position (11, 2).
In an alternative embodiment, after obtaining the information to be displayed, the processor may determine a candidate position set from the region to be stimulated based on the information to be displayed, that is, determine a candidate position set corresponding to the information to be displayed "a" from a plurality of positions corresponding to the visual cortex.
In the embodiment of the application, a 1024-channel flexible electrode probe can be implanted in the moving area M1, and the subject can be trained and the related brain electrical signals can be recorded. The method includes that electroencephalogram signals of a subject when the subject performs a certain function are recorded, the mind is decoded in a processor to obtain the motor intention of the subject, and then the intention is translated into computer instructions through the processor to be used for regulating and controlling point stimulation signals and realizing regulation and control of artificial visual display contents. It may also be used as information to be displayed.
S205: controlling an electrical stimulation unit to stimulate each candidate position in the candidate position set to obtain an electroencephalogram signal corresponding to each candidate position; the electroencephalogram signal is a signal obtained by stimulating the neuron corresponding to each candidate position.
In the embodiment of the application, the processor can determine the target electrode codes from each electrode code subset to obtain a target electrode code set, and further apply current to the electrode sites corresponding to each target electrode code in the target electrode code set, so as to stimulate the candidate positions corresponding to each target electrode code and obtain the electroencephalogram signals corresponding to each candidate position.
In a specific implementation manner, the processor may determine a channel corresponding to each candidate position in the candidate position set, and select a code corresponding to at least one electrode site from the channel corresponding to each candidate position as a target electrode code to obtain a target electrode code set, and then perform stimulation processing on the electrode site corresponding to each target electrode code in the target electrode code set by using the electrical stimulation unit to stimulate neurons corresponding to the candidate position, so that bright/dark artificial light sensation is generated at a characteristic position of a visual space of the subject, and an electroencephalogram signal is obtained. For example, after implanting the flexible electrode probe in the visual area V1, the information to be displayed may be displayed on a display device adapted to the processor, and a display array corresponding to the information to be displayed, such as the display array corresponding to the information to be displayed "a" described above, is determined, fig. 4 is a schematic diagram of information to be displayed provided in the embodiment of the present application, where the information to be displayed corresponds to the positions (1,5), (2,4), (3,4), (4,3), (5,3), (6,2), (7,2), (8,1), (9,1), (2,6), (3,6), (4,7), (5,7), (6,8), (7,8), (8,9), (9,9), (5,4), (5,5), (5,6) in the display array, and the processor may determine the target electrode code based on the positions, and obtaining a target electrode code set, namely determining a target electrode code to obtain the target electrode code set on the assumption that the display array is consistent with the electrode site array.
In a specific embodiment, the processor may obtain a target electrode coding set, and further may perform decoding processing on the target electrode coding set to obtain a corresponding electrode site to be stimulated.
S207: and determining target display information according to the electroencephalogram signal corresponding to each candidate position and the information to be displayed.
In the embodiment of the application, the processor can determine the candidate display information according to the electroencephalogram signal corresponding to each candidate position, further can judge whether the candidate display information is matched with the information to be displayed, and can determine the candidate display information as the target display information if the candidate display information is judged to be matched with the information to be displayed.
If the candidate display information is judged not to be matched with the information to be displayed, the target electrode codes can be re-determined from each electrode code subset to obtain a new target electrode code set, further, the candidate positions corresponding to the target electrode codes can be stimulated based on the electrical stimulation unit, the electroencephalogram signals corresponding to the candidate positions are obtained based on the electroencephalogram signal acquisition unit, and further, the target display information can be determined according to the electroencephalogram signals corresponding to the candidate positions and the information to be displayed.
By adopting the visual enhancement method based on the flexible electrode probe provided by the embodiment of the application, the regulation and control in the manual visual display can be realized, and the closed-loop reading and writing effects can be achieved.
Fig. 5 is a schematic structural diagram of a visual enhancement device based on a flexible electrode probe provided in an embodiment of the present application, and as shown in fig. 5, the visual enhancement device may include:
the obtaining module 501 may be configured to obtain information to be displayed;
the first determination module 503 may be configured to determine a set of candidate locations from the area to be stimulated based on the information to be displayed; a flexible electrode probe is implanted in the area to be stimulated;
the stimulation module 505 may be configured to control an electrical stimulation unit to perform stimulation processing on each candidate position in the candidate position set, and acquire an electroencephalogram signal corresponding to each candidate position; the electroencephalogram signal is a signal obtained by stimulating a neuron corresponding to each candidate position;
the second determining module 507 may be configured to determine target display information according to the electroencephalogram signal corresponding to each candidate location and the information to be displayed.
In this embodiment of the application, the second determining module 507 may include:
the first determining submodule is used for determining candidate display information according to the electroencephalogram signal corresponding to each candidate position;
and the second determining submodule is used for determining the candidate display information as the target display information if the candidate display information is matched with the information to be displayed.
In an embodiment of the present application, a flexible electrode probe has a plurality of channels, each of the plurality of channels including a plurality of electrode sites;
the apparatus may further comprise:
an encoding module for, prior to stimulation processing for each candidate location in the set of candidate locations,
coding a plurality of electrode sites of each channel to obtain an electrode coding subset; each electrode code in the electrode code subset corresponds to each electrode site in the plurality of electrode sites one to one, and the electrode code is a code at a candidate position corresponding to a channel to which the corresponding electrode site belongs.
In the embodiment of the present application, the stimulation module 505 may include:
the third determining submodule is used for determining a target electrode code from each electrode code subset to obtain a target electrode code set;
and the processing submodule is used for applying current to the electrode site corresponding to each target electrode code in the target electrode code set, performing stimulation processing on the candidate position corresponding to each target electrode code and acquiring the electroencephalogram signal corresponding to each candidate position.
The device and method embodiments in the embodiments of the present application are based on the same application concept.
By adopting the visual enhancement device based on the flexible electrode probe provided by the embodiment of the application, the regulation and control in the manual visual display can be realized, and the closed-loop reading and writing effects can be achieved.
Fig. 6 is a schematic structural diagram of a vision enhancement system based on a flexible electrode probe provided in an embodiment of the present application, and as shown in fig. 6, the apparatus may include:
the processor 601 is configured to obtain information to be displayed;
determining a candidate position set from the region to be stimulated based on the information to be displayed; a flexible electrode probe is implanted in the area to be stimulated;
controlling an electrical stimulation unit to stimulate each candidate position in the candidate position set to obtain an electroencephalogram signal corresponding to each candidate position; the electroencephalogram signal is a signal obtained by stimulating a neuron corresponding to each candidate position;
determining target display information according to the electroencephalogram signal corresponding to each candidate position and the information to be displayed;
the electrical stimulation unit 603 is configured to perform stimulation processing on each candidate position in the candidate position set, so that a neuron corresponding to each candidate position is stimulated to generate an electroencephalogram signal;
the electroencephalogram signal acquisition unit 605 is configured to acquire an electroencephalogram signal corresponding to each candidate position, and send the electroencephalogram signal to the processor.
The system and method embodiments in the embodiments of the present application are based on the same application concept.
By adopting the visual enhancement device based on the flexible electrode probe provided by the embodiment of the application, the regulation and control in the manual visual display can be realized, and the closed-loop reading and writing effects can be achieved.
An electronic device according to an embodiment of the present application may be disposed in the server to store at least one instruction, at least one program, a set of codes, or a set of instructions related to implementing a flexible electrode probe-based vision enhancement method in the method embodiment, where the at least one instruction, the at least one program, the set of codes, or the set of instructions is loaded into the memory and executed to implement the flexible electrode probe-based vision enhancement method described above.
The present application further provides a storage medium, which may be disposed in a server to store at least one instruction, at least one program, a set of codes, or a set of instructions related to implementing a method for enhancing vision based on a flexible electrode probe in the method embodiments, where the at least one instruction, the at least one program, the set of codes, or the set of instructions is loaded and executed by the processor to implement the method for enhancing vision based on a flexible electrode probe.
Optionally, in this embodiment, the storage medium may be located in at least one network server of a plurality of network servers of a computer network. Optionally, in this embodiment, the storage medium may include, but is not limited to, a storage medium including: various media that can store program codes, such as a usb disk, a Read-only Memory (ROM), a removable hard disk, a magnetic disk, or an optical disk.
As can be seen from the embodiments of the method, the apparatus, the system, the electronic device or the storage medium for enhancing vision based on the flexible electrode probe provided by the present application, the method in the present application includes acquiring information to be displayed, determining a candidate position set from a region to be stimulated based on the information to be displayed, implanting the flexible electrode probe into the region to be stimulated, controlling an electrical stimulation unit to perform stimulation processing on each candidate position in the candidate position set, and acquiring an electroencephalogram signal corresponding to each candidate position; the electroencephalogram signals are signals obtained by stimulating the neurons corresponding to each candidate position, and target display information is determined according to the electroencephalogram signals corresponding to each candidate position and the information to be displayed. Based on the method and the device, regulation and control in the artificial visual display can be realized, and the closed-loop reading and writing effects can be achieved.
In the present invention, unless otherwise expressly stated or limited, the terms "connected" and "connected" are to be construed broadly, e.g., as meaning either a fixed connection or a removable connection, or an integral part; can be mechanically or electrically connected; either directly or indirectly through intervening media, either internally or in any other relationship. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
It should be noted that: the foregoing sequence of the embodiments of the present application is for description only and does not represent the superiority and inferiority of the embodiments, and the specific embodiments are described in the specification, and other embodiments are also within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in the order of execution in different embodiments and achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown or connected to enable the desired results to be achieved, and in some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
All the embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment is described with emphasis on differences from other embodiments. In particular, for the embodiments of the apparatus and system, since they are based on embodiments similar to the method embodiments, the description is relatively simple, and for the relevant points, reference may be made to some descriptions of the method embodiments.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.
Claims (11)
1. A visual enhancement method based on a flexible electrode probe is characterized by comprising the following steps:
acquiring information to be displayed;
determining a candidate position set from the region to be stimulated based on the information to be displayed; a flexible electrode probe is implanted in the region to be stimulated;
controlling an electrical stimulation unit to perform stimulation processing on each candidate position in the candidate position set to acquire an electroencephalogram signal corresponding to each candidate position; the electroencephalogram signal is a signal obtained by stimulating the neuron corresponding to each candidate position;
and determining target display information according to the electroencephalogram signal corresponding to each candidate position and the information to be displayed.
2. The method according to claim 1, wherein the determining target display information according to the electroencephalogram signal corresponding to each candidate position and the information to be displayed comprises:
determining candidate display information according to the electroencephalogram signal corresponding to each candidate position;
and if the candidate display information is matched with the information to be displayed, determining the candidate display information as the target display information.
3. The method of any of claims 1-2, wherein the flexible electrode probe has a plurality of channels, each of the plurality of channels comprising a plurality of electrode sites;
before the stimulation processing is performed on each candidate position in the candidate position set, the method further includes:
coding the plurality of electrode sites of each channel to obtain an electrode coding subset; each electrode code in the electrode code subset corresponds to each electrode site in the plurality of electrode sites one to one, and the electrode code is a code at a candidate position corresponding to a channel to which the corresponding electrode site belongs.
4. The method of claim 3, wherein the performing stimulation processing on each candidate position in the candidate position set to obtain a brain electrical signal corresponding to each candidate position comprises:
determining a target electrode code from each electrode code subset to obtain a target electrode code set;
and applying current to the electrode site corresponding to each target electrode code in the target electrode code set, and performing stimulation processing on the candidate position corresponding to each target electrode code to obtain an electroencephalogram signal corresponding to each candidate position.
5. A visual enhancement device based on a flexible electrode probe, comprising:
the acquisition module is used for acquiring information to be displayed;
a first determination module, configured to determine a candidate position set from a region to be stimulated based on the information to be displayed; a flexible electrode probe is implanted in the region to be stimulated;
the stimulation module is used for controlling an electrical stimulation unit to stimulate each candidate position in the candidate position set to acquire an electroencephalogram signal corresponding to each candidate position; the electroencephalogram signal is a signal obtained by stimulating the neuron corresponding to each candidate position;
and the second determining module is used for determining target display information according to the electroencephalogram signal corresponding to each candidate position and the information to be displayed.
6. The apparatus of claim 1,
the second determining module includes:
the first determining submodule is used for determining candidate display information according to the electroencephalogram signal corresponding to each candidate position;
and the second determining submodule is used for determining the candidate display information as the target display information if the candidate display information is matched with the information to be displayed.
7. The device of any of claims 5-6, wherein the flexible electrode probe has a plurality of channels, each of the plurality of channels comprising a plurality of electrode sites;
the device further comprises:
an encoding module for, prior to said stimulating each candidate location of said set of candidate locations,
coding the plurality of electrode sites of each channel to obtain an electrode coding subset; each electrode code in the electrode code subset corresponds to each electrode site in the plurality of electrode sites one to one, and the electrode code is a code at a candidate position corresponding to a channel to which the corresponding electrode site belongs.
8. The apparatus of claim 7, wherein the stimulation module comprises:
the third determining submodule is used for determining a target electrode code from each electrode code subset to obtain a target electrode code set;
and the processing submodule is used for applying current to the electrode site corresponding to each target electrode code in the target electrode code set, performing stimulation processing on the candidate position corresponding to each target electrode code and acquiring the electroencephalogram corresponding to each candidate position.
9. A flexible electrode probe-based vision enhancement system, comprising:
the processor is used for acquiring information to be displayed;
determining a candidate position set from the region to be stimulated based on the information to be displayed; a flexible electrode probe is implanted in the region to be stimulated;
controlling an electrical stimulation unit to perform stimulation processing on each candidate position in the candidate position set to acquire an electroencephalogram signal corresponding to each candidate position; the electroencephalogram signal is a signal obtained by stimulating the neuron corresponding to each candidate position;
determining target display information according to the electroencephalogram signal corresponding to each candidate position and the information to be displayed;
the electrical stimulation unit is used for performing stimulation processing on each candidate position in the candidate position set so as to enable a neuron corresponding to each candidate position to be stimulated to generate the electroencephalogram signal;
and the electroencephalogram signal acquisition unit is used for acquiring the electroencephalogram signal corresponding to each candidate position and sending the electroencephalogram signal to the processor.
10. An electronic device comprising a processor and a memory, wherein the memory has stored therein at least one instruction, at least one program, a set of codes, or a set of instructions, which is loaded and executed by the processor to implement the flexible electrode probe-based vision enhancement method of any one of claims 1-4.
11. A computer readable storage medium having stored therein at least one instruction, at least one program, a set of codes, or a set of instructions, which is loaded and executed by a processor to implement the flexible electrode probe based vision enhancement method of any one of claims 1-4.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111323374.3A CN114053582A (en) | 2021-11-09 | 2021-11-09 | Visual enhancement method, device and system based on flexible electrode probe |
| PCT/CN2022/126867 WO2023082972A1 (en) | 2021-11-09 | 2022-10-23 | Visual enhancement method, apparatus and system based on flexible electrode probe |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111323374.3A CN114053582A (en) | 2021-11-09 | 2021-11-09 | Visual enhancement method, device and system based on flexible electrode probe |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114053582A true CN114053582A (en) | 2022-02-18 |
Family
ID=80274489
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111323374.3A Pending CN114053582A (en) | 2021-11-09 | 2021-11-09 | Visual enhancement method, device and system based on flexible electrode probe |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114053582A (en) |
| WO (1) | WO2023082972A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115568858A (en) * | 2022-09-07 | 2023-01-06 | 上海脑虎科技有限公司 | Neural electrode device and method for preparing neural electrode device |
| WO2023082972A1 (en) * | 2021-11-09 | 2023-05-19 | 上海脑虎科技有限公司 | Visual enhancement method, apparatus and system based on flexible electrode probe |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101879348A (en) * | 2010-06-18 | 2010-11-10 | 中国人民解放军第三军医大学第一附属医院 | Visual function restoration system based on external electrical stimulation by endocranium |
| CN106236377A (en) * | 2016-09-12 | 2016-12-21 | 北京大学 | SCNS is utilized to form the equipment of artificial vision |
| US11235152B2 (en) * | 2018-03-05 | 2022-02-01 | Baylor College Of Medicine | Systems and methods of conveying a visual image to a person fitted with a visual prosthesis |
| CN112843467A (en) * | 2019-11-27 | 2021-05-28 | 深圳市中科先见医疗科技有限公司 | Visual prosthesis device, system, control method thereof and storage medium |
| CN112870562B (en) * | 2021-01-06 | 2022-05-17 | 上海交通大学 | Implanted piezoelectric MEMS ultrasonic transducer and preparation method thereof |
| CN114053582A (en) * | 2021-11-09 | 2022-02-18 | 上海脑虎科技有限公司 | Visual enhancement method, device and system based on flexible electrode probe |
-
2021
- 2021-11-09 CN CN202111323374.3A patent/CN114053582A/en active Pending
-
2022
- 2022-10-23 WO PCT/CN2022/126867 patent/WO2023082972A1/en unknown
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023082972A1 (en) * | 2021-11-09 | 2023-05-19 | 上海脑虎科技有限公司 | Visual enhancement method, apparatus and system based on flexible electrode probe |
| CN115568858A (en) * | 2022-09-07 | 2023-01-06 | 上海脑虎科技有限公司 | Neural electrode device and method for preparing neural electrode device |
| CN115568858B (en) * | 2022-09-07 | 2023-07-11 | 上海脑虎科技有限公司 | Neural electrode device and method for preparing same |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023082972A1 (en) | 2023-05-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Chen et al. | Simulating prosthetic vision: I. Visual models of phosphenes | |
| CN114053582A (en) | Visual enhancement method, device and system based on flexible electrode probe | |
| Troyk et al. | A model for intracortical visual prosthesis research | |
| Sliwinska et al. | Transcranial magnetic stimulation for investigating causal brain-behavioral relationships and their time course | |
| EP1970877A1 (en) | Electric tactile display | |
| Chen et al. | Simulating prosthetic vision: II. Measuring functional capacity | |
| CN112545517A (en) | Attention training method and terminal | |
| Bourkiza et al. | Visual acuity of simulated thalamic visual prostheses in normally sighted humans | |
| CN108469896A (en) | A kind of brain-computer interface hybrid coding normal form method based on asymmetric brain electrical feature | |
| Lu et al. | Recognition of objects in simulated irregular phosphene maps for an epiretinal prosthesis | |
| Killian et al. | Perceptual learning in a non-human primate model of artificial vision | |
| Buffoni et al. | Image processing strategies dedicated to visual cortical stimulators: a survey | |
| Ekanayake et al. | Real-time decoding of covert attention in higher-order visual areas | |
| Morillas et al. | A design framework to model retinas | |
| Aydin et al. | Region based Brain Computer Interface for a home control application | |
| van der Grinten et al. | Towards biologically plausible phosphene simulation for the differentiable optimization of visual cortical prostheses | |
| Piña-Ramirez et al. | Scenario screen: A dynamic and context dependent P300 stimulator screen aimed at wheelchair navigation control | |
| CN116088686A (en) | Electroencephalogram tracing motor imagery brain-computer interface training method and system | |
| CN112433617B (en) | Two-person cooperative P300-BCI target decision making system and method | |
| CN108319367A (en) | A kind of brain-machine interface method | |
| Boyle et al. | Challenges in digital imaging for artificial human vision | |
| US11235152B2 (en) | Systems and methods of conveying a visual image to a person fitted with a visual prosthesis | |
| CN113805704A (en) | Vision treatment method and system based on VR technology | |
| WO2016134271A1 (en) | Systems and methods for selective memory enhancement and/or disruption | |
| KR20210090757A (en) | Device for providing stimulation, method for training perception and computer program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |