No title
Method for acquiring and processing artificial eye image
Technical Field
The invention relates to the technical field of artificial eyes, in particular to a method for acquiring and processing images of artificial eyes.
Background
For permanent ocular pathology caused by retinal disease, drug treatment regimens have been ineffective, and implantation of retinal prostheses partially restores vision by direct electrical stimulation of the retinal ganglion. The principle of the implant device is composed of an external micro camera, a communication system and a microcomputer. Firstly, a patient captures a scene through an external camera, then the scene is sent to an artificial retina on the surface of an eyeball of the patient through a communication system after image processing is carried out on the scene through a computer, and the scene is converted into an electric pulse signal. The electrodes on the artificial retina then stimulate the optic nerve of the retina, continuing to transmit signals along the optic nerve to the brain. These pulse signals can "trick" the brain into thinking that the patient's eyes are still working properly. Eventually, the patient can "see" the outside world as a regular person and distinguish between light and darkness, thereby restoring vision.
When a person is excited, stressed and unconscious, the frequency of brain waves is obviously different between 1 and 40 Hz and is further divided into α, β, delta and theta waves according to different frequencies, when the person is highly concentrated under certain pressure, the frequency of brain waves is between 12 and 38 Hz, the wave band is called β wave which is brain wave in the ' consciousness ' level, when the person is in a state of relaxation, the frequency of brain waves is reduced to 8 to 12 Hz which is called α wave, when the person is in a state of sleep, the frequency of brain waves is further reduced and is divided into theta waves (4 to 8 Hz) and delta waves (0.5 to 4) which are reflected in the ' consciousness ' and the ' consciousness ' state of the person, and the brain waves are developed into emotional wave which can change along with the ' emotional fluctuation.
Currently, most of the artificial eyes in the prior art (for example, patent CN105028982A) convert optical signals into pulse rate, and apply electric pulses to the retina of human eyes to achieve vision recovery. However, the existing retinal prostheses only solve the problem of visibility of the patient, but do not solve the problem of good visibility of the patient due to visual tracking.
Therefore, in order to solve the problem of visual tracking, a method of artificial eye image acquisition and processing is required.
Disclosure of Invention
The invention aims to provide a method for acquiring and processing an image of an artificial eye, which comprises the following steps:
a) collecting human brain waves, performing brain wave control training on the human brain waves, and setting a threshold value of a control parameter according to a brain wave control training result;
b) collecting human body brain wave instruction signals, collecting image signals in a human eye visual scene, and controlling and processing the image signals according to the human body brain wave instruction signals and the threshold values of the control parameters, wherein the control comprises movement control of the image signals in different directions and tremor processing of the image signals;
c) the processed image signal is transmitted to the retinal prosthesis and returned to the brain.
Preferably, the image signal is subjected to control processing by an image control processing system.
Preferably, the movement control of the image signal in different directions comprises image up and down movement, left and right movement, amplification, reduction, image output closing and image brightness control.
Preferably, the trembling processing of the image signal is to tremble the image up and down and left and right at 30-150 Hz.
Preferably, the human brain waves and the human brain wave command signals are collected through a brain wave control system.
Preferably, the image signal is acquired by a digital image signal input system.
Preferably, the brain wave control training includes concentration, relaxation, and blink control training.
Preferably, the control parameters of the brain wave control training result include α and β wave parameter values, and an eSense concentration degree and an eSense relaxation degree parameter value.
Preferably, the thresholds include an eSense looseness threshold, an eSense concentration threshold, an β wave threshold, and a α wave eye closure threshold.
Preferably, the retinal prostheses are one or two.
The method for collecting and processing the artificial eye image provided by the invention has the advantages that the brain wave of a human body is controlled and trained, the threshold value of the control parameter is set, the image signal is controlled and processed through the brain wave command signal of the human body and the threshold value of the control parameter, the difference between the scene which the patient wants to see and the scene which the patient actually sees is reduced, the problem of visual following is well solved, and the effect that the scene which the human eye wants to see is consistent with the scene which the human eye actually sees is achieved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
Drawings
Further objects, features and advantages of the present invention will become apparent from the following description of embodiments of the invention, with reference to the accompanying drawings, in which:
FIG. 1 is a system block diagram schematically illustrating a method for image acquisition and processing of an artificial eye according to the present invention;
FIG. 2 is a block flow diagram illustrating the process of image acquisition and processing of an artificial eye of the present invention;
fig. 3a to 3c show schematic diagrams of controlling an image signal according to the present invention.
Detailed Description
The objects and functions of the present invention and methods for accomplishing the same will be apparent by reference to the exemplary embodiments. However, the present invention is not limited to the exemplary embodiments disclosed below; it can be implemented in different forms. The nature of the description is merely to assist those skilled in the relevant art in a comprehensive understanding of the specific details of the invention.
Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the drawings, the same reference numerals denote the same or similar parts, or the same or similar steps, unless otherwise specified.
In order to make the content of the invention more clearly described, the control parameters of the brain wave signals need to be explained, and the brain wave control parameters α wave parameters, β wave parameters, eSense concentration parameters and eSense relaxation parameters are strengthened through brain wave control training according to the frequency of the brain wave, so that when the patient generates the frequency of the related brain wave, the image signals are accurately controlled and processed, wherein the eSense concentration parameters indicate the intensity of the mental 'concentration' level or 'attention' level of the user, the range of the parameter values is 0 to 100, the eSense relaxation tables indicate the mental 'flatness' level or 'relaxation' level of the user, the range of the parameter values is 0 to 100, and the invention is embodied in the 'left-looking' and 'right-looking' of the patient.
Referring to fig. 1, a system structure diagram of the method for collecting and processing an image of an artificial eye according to the present invention includes a retinal prosthesis 101, a digital image signal input system 104, a brain wave control system 103, and an image control processing system 102, wherein the system structure diagram includes a retinal prosthesis 101, a digital image signal input system 104, a brain wave control system 103, and an image control processing system 102
The digital image signal input system 104 and human eyes are positioned on the same parallel straight line and used for replacing the human eyes to acquire image signals in a scene;
the brain wave control system 103 is disposed on the head of the human body, controls and trains the brain waves, collects the brain waves of the human body and/or collects command signals of the brain waves of the human body, and sets the threshold values of the control parameters according to the brain wave control training results.
And the image control processing system 102 is configured to receive the human brain wave instruction signal, the threshold of the control parameter, and the image signal acquired by the digital image signal input system 104, and control and process the image signal according to the human brain wave instruction signal and the threshold of the control parameter, including movement control of the image signal in different directions and tremor processing of the image signal.
And the retina prosthesis is used for receiving the processed image signal and returning the processed image signal to the brain of the human body.
The digital image signal input system 104 transmits the image signal collected in the visual-eye scene and the brain wave command signal collected by the brain wave control system 103 to the image control processing system 102 for image control and processing. The image control processing system 102 transmits the processed image to the retina prosthesis, and the retina prosthesis feeds back a signal to the human brain to realize the vision recovery of the patient.
According to the invention, the image signal is controlled and processed by the artificial eye image acquisition and processing system in the embodiment, so that the image signal acquired by the digital image signal input system 104 follows the human brain wave instruction signal. As shown in fig. 2, the flow chart of the artificial eye image collecting and processing process of the present invention is that the artificial eye image collecting and processing system provided by the present invention recovers the vision of a patient, and specifically, the process of collecting and processing the artificial eye image comprises the following steps:
the attention, relaxation, and blink control training is only explained for clarity of the contents of the present invention, but is not limited to the contents, concentration, relaxation, and blink control training is performed in the brain of the patient (although the eyes of the patient are damaged, the attention, relaxation, blink, and the like may still be performed in the brain of the patient), the brain wave signals of the combination of the attention, relaxation, blink, and the like are enhanced through the patient control training, the brain wave control system 103 acquires the control parameters in the brain wave signals of the human body after the control training (i.e., the values of the brain wave signals of the combination of the attention, relaxation, blink, and the combination of the related actions of the patient), sets the threshold values of the control parameters, in the present embodiment, the control parameters through the control training result include α, β wave parameter values and eSense, eSense relaxation parameter values, the threshold values of the eSense relaxation, and the eye relaxation threshold values, the eSense relaxation threshold values include eSense relaxation threshold values, the eSense relaxation threshold values include eSense, eSense relaxation threshold values, eSense relaxation threshold values, and the eye relaxation threshold values are set as the eSense threshold values 3680, the eSense wave threshold values are set as the eSense wave threshold values, eSense, ese.
S102, collecting image signals in a visual eye scene, wherein according to the embodiment of the invention, the digital image signal input system 102 comprises a 3D digital camera, and the image signals in the scene are obtained through the 3D digital camera. In some embodiments, it may be an optimal image pickup apparatus that can be thought of by those skilled in the art, and is not limited to the 3D digital camera in the present embodiment.
S103, collecting human brain wave command signals, wherein the collection of the human brain wave command signals is still carried out through the brain wave control system 103 according to the invention. The brain wave command signal of the human body is a brain wave signal generated by action idea when a patient needs to observe different visual-eye scenes. For example, when a patient wants to see an upper scene, a human brain wave signal generated in the brain controls the upward direction of the human eyes.
The image signal in the visual-eye scene acquired in step S102 is transmitted to the image control processing system 102 together with the human brain wave instruction signal acquired in step S103 for image signal control and processing. For specific implementation, the signal transmission process adopts wired transmission or wireless transmission.
S104, controlling and processing image signals, wherein the image control processing system 102 receives the human body brain wave command signals, the threshold values of the control parameters and the image signals collected by the digital image signal input system 104, and controls and processes the image signals according to the human body brain wave command signals and the threshold values of the control parameters, including movement control of the image signals in different directions and tremor processing of the image signals. Specifically, the movement control of the image signal in different directions includes image up and down movement, left and right movement, enlargement, reduction, image output off, and image brightness control.
As shown in fig. 3a to 3c, the image signal is controlled according to the present invention, when the human brain wave command signal does not perform any conscious action as shown in fig. 3a, the middle area a of the image 201 captured by the digital image signal input system 104 is aligned with the retinal prosthesis 101, which preferably includes a central depressed retinal base, and receives the processed image signal through the central depressed area.
As shown in fig. 3b, when the eSense relaxation parameter is higher than the set eSense relaxation threshold (threshold 80) in the human brain wave command signal received by the image control processing system 102, and the blink signal is accompanied in the human brain wave command signal, the video image is moved down, and the foveal region of the retinal prosthesis is aligned with the image C region. The retinal prosthesis receives a light signal that moves up, which corresponds to the eye looking up.
As shown in fig. 3c, when the eSense relaxation parameter is lower than the set eSense relaxation threshold (threshold 80) in the human brain wave command signal received by the image control processing system 102 and the blink signal is accompanied in the human brain wave command signal, the video image is shifted upward, and the foveal region of the retinal prosthesis is aligned with the image B region. The optical signal received by the retinal prosthesis is shifted down, corresponding to the eye looking down.
When the β wave index is higher than the set β wave threshold value (threshold value 24) in the human brain wave command signals received by the image control processing system 102 and the blink signals are accompanied in the human brain wave command signals, the video image is shifted to the left, and the optical signals received by the retinal prosthesis are shifted to the right, which is equivalent to the eyes looking to the right.
When the β wave index is lower than the set β wave threshold value (threshold value 24) in the human brain wave command signals received by the image control processing system 102 and the blink signals are accompanied in the human brain wave command signals, the video image is shifted to the right, and the optical signals received by the retinal prosthesis are shifted to the left, which is equivalent to the eyes looking to the left.
When the eSense concentration parameter is higher than the set eSense concentration threshold (threshold 80) in the human brain wave command signal received by the image control processing system 102 and a blink signal is accompanied in the human brain wave command signal, the video image is enlarged, and the resolution of the optical signal received by the retinal prosthesis is improved, which corresponds to that the eyes see away.
When the eSense concentration parameter is lower than the set eSense concentration threshold (threshold 80) in the human brain wave command signal received by the image control processing system 102 and the blink signal is accompanied by the human brain wave command signal, the video image is reduced, and the resolution of the optical signal received by the retinal prosthesis is reduced, which corresponds to the case where the eyes see near.
When the α wave parameter in the human brain wave command signal received by the image control processing system 102 is higher than the set α wave eye-closing threshold value and is accompanied by a blink signal, the video image output signal is closed or a black screen signal is output, and the retinal prosthesis cannot receive external light stimulation, which is equivalent to eye closing.
In this embodiment, when the image control processing system 102 receives the human brain wave command signal, the video image output signal is gradually dimmed by the continuous blink signal (2 or more blink signals per second) until the preset minimum brightness is reached. If continuous blinking signals exist at the time of the lowest brightness, the video image output signal is gradually lightened until the preset highest brightness is reached.
In order to clearly explain the control and processing of the image signals by the brain wave command signals of the present invention, the image control method corresponding to different brain wave command signals shown in table 1 is used for explanation.
TABLE 1 image control modes corresponding to different brain wave command signals
User wishes |
Human brain wave command signal |
Image control method |
Looking upwards |
Blink + eSense relaxation parameter |
Image downshifting |
Looking down |
Blink + eSense relaxation parameter |
The image is moved upwards |
Look to the left |
Blink + β waves |
Image shift to the right |
Look to the right |
Blink + β waves |
Image shift to the left |
Overlook |
Blink + eSense concentration parameter |
Image enlargement processing |
Near view |
Blink + eSense concentration parameter |
Image magnification restoration |
Eye closure |
Blink + α waves |
Image output off or output black screen |
Dim field of view in too bright place |
Continuous blinking |
Image brightness reduction |
Adjusting the field of vision in too dark |
Continuous blinking |
Image brightness increase |
According to the invention, in the embodiment, the tremor processing of the image signal is carried out while the movement of the image signal in different directions is controlled, the image is subjected to vertical tremor, horizontal tremor and left-right tremor of 30-150 Hz, the conditions of tremor, drift and eye jump of human eyes are more closely simulated, the inadaptability of visual recovery is eliminated, and the reality of visual recovery is increased.
And S105, feeding back the image signal by the retina prosthesis, receiving the processed image signal by the retina prosthesis, and returning the processed image signal to the brain of the human body. Preferably, the number of retinal prostheses is two in the present embodiment, so as to enhance the 3D visual effect.
The artificial eye image acquisition and processing system provided by the invention has the advantages that the brain wave of a human body is controlled and trained, the threshold value of the control parameter is set, the image signal is controlled and processed through the brain wave command signal of the human body and the threshold value of the control parameter, the difference between a scene which a patient wants to see and a scene which the patient actually sees is reduced, the problem of visual following is well solved, and the effect that the scene which the human eye wants to see is consistent with the scene which the human eye actually sees is achieved.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.