CN113786203A - Head motion and electroencephalogram signal composite acquisition device, method and system - Google Patents
Head motion and electroencephalogram signal composite acquisition device, method and system Download PDFInfo
- Publication number
- CN113786203A CN113786203A CN202110871072.3A CN202110871072A CN113786203A CN 113786203 A CN113786203 A CN 113786203A CN 202110871072 A CN202110871072 A CN 202110871072A CN 113786203 A CN113786203 A CN 113786203A
- Authority
- CN
- China
- Prior art keywords
- motion
- acquisition
- head
- signal
- electroencephalogram
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique
- A61B5/1127—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique using markers
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/25—Bioelectric electrodes therefor
- A61B5/251—Means for maintaining electrode contact with the body
- A61B5/256—Wearable electrodes, e.g. having straps or bands
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/389—Electromyography [EMG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/398—Electrooculography [EOG], e.g. detecting nystagmus; Electroretinography [ERG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/6802—Sensor mounted on worn items
- A61B5/6803—Head-worn items, e.g. helmets, masks, headphones or goggles
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7203—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal
Abstract
The invention provides a device, a method and a system for composite acquisition of head movements and electroencephalogram signals, wherein the method comprises the following steps: setting sampling time and sampling interval of a single-lead electroencephalogram collector, and collecting an electroencephalogram collecting signal through the single-lead electroencephalogram collector; preprocessing the electroencephalogram acquisition signal to obtain an electroencephalogram signal of a user; and acquiring a head action signal of the user according to the action acquisition signal acquired by the action catcher. The invention simplifies the complexity of the equipment, reduces the cost of the equipment and increases the portability of the equipment; meanwhile, a single-lead electroencephalogram acquisition scheme is adopted, so that unnecessary electroencephalogram electrodes are saved, and an electrode fixing mode is simplified; in addition, when the device is used, the conductive paste does not need to be additionally coated, the use difficulty and the cost are further reduced, and a more portable acquisition device and a more portable acquisition method are provided.
Description
Technical Field
The invention relates to the technical field of composite signal acquisition, in particular to a device, a method and a system for composite acquisition of head movements and electroencephalogram signals.
Background
Neurodevelopmental disorders are behavioral and cognitive disorders that occur during development and involve significant difficulties in obtaining and performing specific mental, motor, language or social functions. Many of the mental and behavioral disorders that occur during development present behavioral and cognitive deficits (e.g., schizophrenia, bipolar disorder), but only disorders whose core is characterized by neurological developmental activity can be incorporated into this group. The etiology of neurodevelopmental disorders is complex and in many cases ambiguous.
In international classification of diseases ICD-11, neurodevelopmental disorders include the following diseases:
6A00 intellectual development disturbance;
6A01 developmental speech or language disorder;
6a02 autism spectrum disorder;
6A03 developmental learning disorder;
6A04 developmental movement coordination disorder;
6A05 attention deficit hyperactivity disorder;
6A06 carved plate dyskinesia;
8a05.0 primary tic or tic disorder;
6E60 secondary neurodevelopmental syndrome;
6A0Y other specific neurodevelopmental disorders;
6A0Z neurodevelopmental disorder, not identified.
Currently, neuropsychological tests in the diagnosis of neurodevelopmental disorders generally employ methods such as Continuous Procedure Test (CPT), attention variable Test (TOVA), reaction/non-reaction task (Go/NoGo), wisconsin card classification (WCST), and similar pattern Matching (MFFT). In fact, besides the neuropsychological test results, the physiological and behavioral characteristics of the patient under a specific situation (which can be a paradigm of stimulating, detecting/intervening tasks, or even a daily learning and living task) also have a good promoting effect on the accurate detection and timely intervention of the neurodevelopmental disorder.
In the tests and daily situations, the characteristics of the head movement and the brain electricity of the testee also have evaluation values, but are limited by the defects of high use requirement, low integration level, electromagnetic interference and the like of the existing detection equipment, and the acquisition of the characteristics of the head movement and the brain electricity needs to be realized respectively by depending on a plurality of sets of equipment, so that the neurodevelopmental patients cannot monitor the physiological and behavioral characteristics in real time in the home environment, the school environment or the training intervention institution environment.
Disclosure of Invention
The invention provides a device, a method and a system for composite acquisition of head movements and electroencephalogram signals, which are used for solving the defects of high use requirement, low integration level and electromagnetic interference in the prior art and realizing portable and accurate composite acquisition of the head movements and the electroencephalogram signals.
The invention provides a composite acquisition device for head movements and electroencephalogram signals, which comprises a wearable main body, a movement capturing mark, a single-lead electroencephalogram collector, a movement catcher and a processing unit, wherein the wearable main body is provided with a plurality of sensors;
the motion capture mark and the single-lead electroencephalogram collector are both arranged on the wearable main body;
the single-lead brain electricity collector is in communication connection with the processing unit;
the motion capturer is communicatively coupled to the processing unit.
According to the composite acquisition device for the head movement and the electroencephalogram signals, the wearable main body comprises a forehead position; the single-lead brain electric collector is arranged at the forehead position.
According to the composite acquisition device for the head movement and the electroencephalogram signals, at least 3 movement capturing marks are arranged on the wearable main body.
According to the composite acquisition device for the head movement and the electroencephalogram signals, the movement catcher comprises an optical acquisition device; the motion capture markers comprise optical marker points;
the optical marker point is disposed at a forehead position of the wearable body.
According to the composite acquisition device for the head movement and the electroencephalogram signals, the optical acquisition equipment comprises infrared light acquisition equipment and/or visible light acquisition equipment.
According to the composite acquisition device for the head movement and the electroencephalogram signals, provided by the invention, the infrared light acquisition equipment comprises an infrared emission unit, and the optical mark point comprises an infrared reflection unit; alternatively, the optical marker point comprises an infrared emission unit.
According to the composite acquisition device for the head motion and the electroencephalogram signals, the motion capture marker comprises a sound wave generator, and the motion catcher comprises a sound wave receiver; alternatively, the motion capture markers comprise acoustic receivers and the motion capturer comprises an acoustic generator.
According to the composite acquisition device for the head action and the electroencephalogram signals, the action capture mark comprises an electromagnetic sensor; the motion capturer comprises an electromagnetic generator; alternatively, the motion capture marker comprises an electromagnetic generator and the motion capturer comprises an electromagnetic sensor.
According to the composite acquisition device for the head action and the electroencephalogram signals, the action capture mark comprises an inertial sensor; the motion capturer is integrated in the processing unit and is in communication with the inertial sensor.
The invention also provides a method for compound acquisition of head movement and electroencephalogram signals, which utilizes the device for compound acquisition of head movement and electroencephalogram signals and comprises the following steps:
setting sampling time and sampling interval of a single-lead electroencephalogram collector, and collecting an electroencephalogram collecting signal through the single-lead electroencephalogram collector;
preprocessing the electroencephalogram acquisition signal to obtain an electroencephalogram signal of a user;
acquiring a head action signal of a user according to an action acquisition signal acquired by the action catcher;
the preprocessing comprises any one or any combination of more of background noise removal, outlier removal, electromyographic signal removal, ocular electrical signal removal and filtering.
According to the composite acquisition method of the head motion and the electroencephalogram signals, provided by the invention, the motion acquisition signals comprise any one or any combination of time-by-time positions of a plurality of motion capture marks, time-by-time relative positions of a plurality of motion capture marks and visible light signals of the head motion of a user.
According to the composite acquisition method of the head motion and the electroencephalogram signals, the step of acquiring the head motion signals of the user according to the motion capture marker signals acquired by the motion capture device comprises the following steps:
obtaining a first head action signal according to the time-by-time positions of the plurality of motion capture marks and/or the time-by-time relative positions of the plurality of motion capture marks acquired by the infrared light acquisition equipment;
acquiring a second head action signal according to the visible light signal of the head action of the user acquired by the visible light acquisition equipment;
and obtaining a head action signal of the user according to the first head action signal and the second head action signal.
The invention also provides a composite acquisition system of the head action and the electroencephalogram signal, which comprises an action acquisition module and an electroencephalogram acquisition module;
the brain electricity collection module can:
setting sampling time and sampling interval of a single-lead electroencephalogram collector, and collecting an electroencephalogram collecting signal through the single-lead electroencephalogram collector;
preprocessing the electroencephalogram acquisition signal to obtain an electroencephalogram signal of a user;
the motion acquisition module can acquire a signal according to the motion acquired by the motion catcher to acquire a head motion signal of the user;
the preprocessing comprises any one or any combination of more of background noise removal, outlier removal, electromyographic signal removal, ocular electrical signal removal and filtering.
The invention also provides electronic equipment which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the processor executes the program to realize the steps of any one of the head motion and electroencephalogram signal composite acquisition methods.
The present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the method for complex acquisition of head movements and brain electrical signals as described in any one of the above.
According to the device, the method and the system for compound acquisition of the head action and the electroencephalogram signal, provided by the invention, aiming at the requirements of acquiring various physiological and behavior characteristics of a patient under a specific situation in the process of detecting or intervening neurodevelopmental disorder, the electroencephalogram acquisition device and the action capture marker are integrated into the same wearable device, so that the complexity of the device is simplified, the cost of the device is reduced, the electromagnetic compatibility is improved, and the portability of the device is enhanced.
Meanwhile, aiming at the characteristics of partial electroencephalogram signals of the neurodevelopmental dysfunction, namely the characteristics that the correlation between the forehead electroencephalogram and the neurodevelopmental dysfunction is larger and the correlation between the electroencephalogram signals of the rest brain areas and the neurodevelopmental dysfunction is insufficient, the invention adopts a single-lead electroencephalogram acquisition scheme, saves a plurality of unnecessary electroencephalogram electrodes and simplifies the electrode and mark point fixing mode.
In addition, due to the arrangement of the single-lead electroencephalogram collector, when the composite collecting device for head action and electroencephalogram signals provided by the invention is used, the conductive paste does not need to be coated additionally, the use difficulty and cost are further reduced, and a more portable collecting device and method are provided.
Drawings
In order to more clearly illustrate the technical solutions of the present invention or the prior art, the drawings needed for the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
FIG. 1 is a schematic structural diagram of a wearable part in a composite acquisition device for head movement and electroencephalogram signals, provided by the invention;
FIG. 2 is a second schematic structural diagram of a wearable part in the composite acquisition device for head movement and electroencephalogram signals provided by the present invention;
FIG. 3 is a schematic flow chart of a method for complex acquisition of head movement and electroencephalogram signals provided by the present invention;
fig. 4 is a schematic structural diagram of an electronic device provided in the present invention.
Reference numerals:
1: a wearable body; 2: a single-lead brain electricity collector; 3: a motion capture marker;
410: a processor; 420: a communication interface; 430: a memory;
440: a communication bus.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The head movement and brain electrical signal composite acquisition device of the present invention will be described with reference to fig. 1.
As shown in fig. 1, an embodiment of the present invention provides a composite acquisition device for head movements and electroencephalogram signals, including a wearable main body 1, a motion capture mark 3, a single-lead electroencephalogram collector 2, a motion capturer, and a processing unit;
the motion capture mark 3 and the single-lead electroencephalogram collector 2 are both arranged on the wearable main body 1;
the single-lead brain electric collector 2 is in communication connection with the processing unit;
the motion capturer is communicatively coupled to the processing unit.
In this embodiment, the wearable body 1 is made of an elastic material, so that the wearable body 1 can be tightly fitted on the head of the patient. In some other alternatives, the wearable body 1 may be made of a hard material matching the physical size of the patient's head or a flexible material with removable buttons (such as nylon buttons, magnetic buttons, adhesive buttons, etc.).
In this embodiment, the motion capture mark 3 and the single lead brain electric collector 2 are both disposed at the forehead position of the wearable main body 1, that is, when the wearable device 1 is worn by the patient, the motion capture mark 3 and the single lead brain electric collector 2 are both disposed at the forehead position of the patient.
Further, this embodiment sets up single lead brain electricity collector 2 in wearable equipment 1's inboard, motion capture mark 3 sets up in wearable equipment's the outside, and when wearable equipment 1 was worn to the patient promptly, single lead brain electricity collector 2 and patient's forehead direct contact, motion capture mark 3 can be along with patient's head motion removal and gather by the motion catcher.
In this embodiment, at least 3 motion capture markers 3 are provided on the wearable body 1. Since at least 3 motion capture markers 3 are provided, the motion capture device of the present embodiment may directly acquire the three-dimensional positions of the motion capture markers 3 to obtain the head motion signals, or may acquire the relative positions of a plurality of motion capture markers 3 to obtain the head motion signals in combination with the capture view angle of the motion capture device.
The scheme of obtaining the head motion signal by using the relative positions of the motion capture markers 3 and the capture view angle of the motion capture device is beneficial to further simplify the structural arrangement of the motion capture markers 3, namely the motion capture markers 3 can capture the head motion without transmitting signals.
In this embodiment, the single-lead brain electric collector 2 at least comprises a recording electrode and a reference electrode, and a grounding electrode can be independently arranged if necessary; for the scheme without separately arranging the grounding electrode, the reference electrode simultaneously plays two functions of grounding and reference.
The single-lead brain electric collector 2 defined in the embodiment is arranged at the forehead of a patient, and can be a scheme that a recording electrode is arranged at the forehead of the patient, and a reference electrode and/or a grounding electrode is arranged at the mastoid or the earlobe of the patient.
A typical motion capture marker 3 arrangement is shown in fig. 1, i.e. by three separate motion capture markers 3 arranged on the wearable body 1, with all projections of the motion capture markers 3 on the wearable body 1.
Fig. 2 shows another possible way of arranging the motion capture markers 3, i.e. by certain corners of a certain geometry as motion capture markers 3 arranged on the wearable body 1, and the projection of the motion capture markers 3 may not be completely on the wearable body 1.
The beneficial effect of this embodiment lies in:
in the embodiment, aiming at the requirements of acquiring various physiological and behavior characteristics of a patient under specific stimulation in the neural developmental disorder detection and intervention process, the electroencephalogram acquirer and the motion capture marker are integrated in the same wearable device, so that the complexity of the device is simplified, the cost of the device is reduced, and the portability of the device is improved.
In addition, because in this embodiment, the collection equipment of brain electrical signal, single lead brain electricity collector 2 sets up in patient's forehead department, has saved the step of paining of conductive paste naturally, and single lead brain electricity collector 2 of direct and forehead contact can not produce the not good problem of electrode and brain skin conductive contact that leads to because barriers such as hair among the traditional approach.
According to any of the embodiments described above, in this embodiment:
the motion capturer comprises an optical acquisition device; the motion capture markers 3 comprise optical marker points;
the optical marker point is provided at the forehead position of the wearable body 1.
The embodiment realizes head motion capture based on optical acquisition, that is, relative positions among a plurality of optical mark points are acquired through an optical acquisition device (in actual acquisition, a geometric shape formed by connecting the plurality of optical mark points can be used as an acquired signal, and the geometric shape is equivalent to the projection of the optical mark points), and a head motion capture result is obtained by combining the acquisition view angle of the optical acquisition device. In this arrangement, the optical marking point is essentially a light-reflecting structure, which in a preferred embodiment can be realized by a light-reflecting coating.
Further, this embodiment can also realize the promotion of head motion capture precision through the collection of infrared and two visible wave bands respectively, promptly:
the optical collection device includes an infrared light collection device and a visible light collection device.
The infrared light collection device comprises an infrared emission unit, and the optical mark point comprises an infrared reflection unit.
On the basis of the setting, the visible light collecting equipment collects visible light signals, the visible light signals comprise time-by-time images of the head movements of the patient and time-by-time images of the optical mark points, and a first result of the head movements can be comprehensively and integrally given;
or the infrared light signal is collected by the infrared light collecting device, and under the intentional setting of the optical mark points, the infrared light signal can focus the relative position between the optical mark points and the displacement of each optical mark point, and a second result of head motion capture is given.
After the first result and the second result are matched and calibrated, the accuracy of head motion capture can be effectively improved.
The beneficial effect of this embodiment lies in:
in this embodiment, visible light collection equipment and infrared light collection equipment can be integrated on same camera, and on this basis, the device of this embodiment only needs 1 to two cameras can realize the head action of relative accuracy and catches, and this has important meaning to the reduction of device cost and the promotion of portability.
Meanwhile, a conventional motion capture camera (or other capturing devices), especially a head motion capture camera, is often disposed at a set position above the head of a patient to capture head motion at a specific depression angle to obtain more details of the head motion. This arrangement requires the camera to be mounted at a predetermined position, and in this embodiment, the motion capture markers 3 are arranged on the forehead portion, so that the camera (or other capturing device) can be placed at any position (such as on the table in front of the patient) to capture the head motion without losing the details of the motion.
According to any of the above embodiments, there is provided in the present embodiment a device structure of three kinds of motion capture sections that are not optical;
motion capture for the first device is based on acoustic wave implementation:
the motion capture markers 3 comprise acoustic generators and the motion capturer comprises an acoustic receiver; alternatively, the motion capture markers 3 comprise acoustic receivers and the motion capturers comprise acoustic generators.
Motion capture by the second device is realized based on electromagnetic waves:
the motion capture markers 3 comprise electromagnetic sensors; the motion capturer comprises an electromagnetic generator; alternatively, the motion capture markers 3 comprise an electromagnetic generator and the motion capturer comprises an electromagnetic sensor.
Motion capture for the third device is based on inertial sensors:
the motion capture markers 3 comprise inertial sensors; the motion capturer is integrated in the processing unit and is in communication with the inertial sensor.
The beneficial effect of this embodiment lies in:
in the embodiment, aiming at the requirements of acquiring various physiological and behavior characteristics of a patient under specific stimulation in the neural developmental disorder detection and intervention process, the electroencephalogram acquirer and the motion capture marker are integrated in the same wearable device, so that the complexity of the device is simplified, the cost of the device is reduced, and the portability of the device is improved.
The method for acquiring the head movement and the electroencephalogram signals in a combined manner provided by the invention is described below, and the method for acquiring the head movement and the electroencephalogram signals in a combined manner described below and the device for acquiring the head movement and the electroencephalogram signals in a combined manner described above can be referred to in a corresponding manner.
As shown in fig. 3, an embodiment of the present invention further provides a method for acquiring a head movement and a brain electrical signal in a complex manner, where the apparatus for acquiring a head movement and a brain electrical signal in a complex manner according to any of the embodiments includes:
the preprocessing comprises any one or any combination of more of background noise removal, outlier removal, electromyographic signal removal, ocular electrical signal removal and filtering.
In this embodiment, the head motion signal may be obtained by directly acquiring the three-dimensional position of the motion capture marker 3, or may be obtained by acquiring the relative position between a plurality of motion capture markers 3 and combining the capture view angle of the motion capture device.
The scheme of obtaining the head motion signal by using the relative positions of the motion capture markers 3 and the capture view angle of the motion capture device is beneficial to further simplify the structural arrangement of the motion capture markers 3, namely the motion capture markers 3 can capture the head motion without transmitting signals.
The beneficial effect of this embodiment lies in:
in the embodiment, aiming at the requirements of acquiring various physiological and behavior characteristics of a patient under specific stimulation in the neural developmental disorder detection and intervention process, the electroencephalogram acquirer and the motion capture marker are integrated in the same wearable device, so that the complexity of the device is simplified, the cost of the device is reduced, and the portability of the device is improved.
According to any of the embodiments described above, in this embodiment:
the motion capture signal comprises any one or any combination of time-by-time positions of the plurality of motion capture markers, time-by-time relative positions of the plurality of motion capture markers, and a visible light signal of the head motion of the user.
The step of obtaining the head motion signal of the user according to the motion capture mark signal acquired by the motion capture device comprises:
obtaining a first head action signal according to the time-by-time positions of the plurality of motion capture marks and/or the time-by-time relative positions of the plurality of motion capture marks acquired by the infrared light acquisition equipment;
acquiring a second head action signal according to the visible light signal of the head action of the user acquired by the visible light acquisition equipment;
and obtaining a head action signal of the user according to the first head action signal and the second head action signal.
In the embodiment, the visible light acquisition equipment acquires visible light signals, the visible light signals comprise time-by-time images of the head movements of the patient and time-by-time images of the optical mark points, and a first capturing result of the head movements can be comprehensively and integrally given; the infrared light signal is collected by the infrared light collecting device, and under the intentional arrangement of the optical mark points, the infrared light signal can focus the relative position between the optical mark points and the displacement of each optical mark point, and a second result of head motion capture is given.
After the first result and the second result are matched and calibrated, the accuracy of head motion capture can be effectively improved.
In fact, the acquisition device provided according to any of the above embodiments can provide three signal sources for head motion capture, namely visible light signal based on visible markers, infrared signal based on infrared markers, and Markless (marker-free point) signal independent of markers. The final calibration of the head motion capture can be based on any combination of these three signals.
The beneficial effect of this embodiment lies in:
on the basis of the method of the embodiment, the visible light acquisition equipment and the infrared light acquisition equipment can be integrated on the same camera, and on the basis, the device of the embodiment can realize relatively accurate head motion capture only by 1 to two cameras, so that the device has important significance for reducing the cost of the device and improving the portability.
Meanwhile, a conventional motion capture camera (or other capturing devices), especially a head motion capture camera, is often disposed at a set position above the head of a patient to capture head motion at a specific depression angle to obtain more details of the head motion. This arrangement requires the camera to be mounted at a predetermined position, and in this embodiment, the motion capture markers 3 are arranged on the forehead portion, so that the camera (or other capturing device) can be placed at any position (such as on the table in front of the patient) to capture the head motion without losing the details of the motion.
In addition, when the embodiment and any of the embodiments are applied to ADHD, i.e., attention deficit and hyperactivity disorder patients, the following advantages can be further brought:
aiming at the characteristics of EEG signals of ADHD, namely the characteristics that the correlation between the forehead EEG and the ADHD is larger and the correlation between the brain signals of the rest brain areas and the ADHD is insufficient, a single-lead EEG acquisition scheme is adopted, so that unnecessary multiple EEG electrodes are omitted, and the electrode and mark point fixing mode is simplified.
The embodiment of the invention also provides a composite acquisition system of the head action and the electroencephalogram signal, which comprises an action acquisition module and an electroencephalogram acquisition module;
the brain electricity collection module can:
setting sampling time and sampling interval of a single-lead electroencephalogram collector, and collecting an electroencephalogram collecting signal through the single-lead electroencephalogram collector;
preprocessing the electroencephalogram acquisition signal to obtain an electroencephalogram signal of a user;
the motion acquisition module can acquire a signal according to the motion acquired by the motion catcher to acquire a head motion signal of the user;
the preprocessing comprises any one or any combination of more of background noise removal, outlier removal, electromyographic signal removal, ocular electrical signal removal and filtering.
The beneficial effect of this embodiment lies in:
in the embodiment, aiming at the requirements of acquiring various physiological and behavior characteristics of a patient under specific stimulation in the neural developmental disorder detection and intervention process, the electroencephalogram acquirer and the motion capture marker are integrated in the same wearable device, so that the complexity of the device is simplified, the cost of the device is reduced, and the portability of the device is improved.
Fig. 3 illustrates a physical structure diagram of an electronic device, which may include, as shown in fig. 4: a processor (processor)410, a communication Interface 420, a memory (memory)430 and a communication bus 440, wherein the processor 410, the communication Interface 420 and the memory 430 are communicated with each other via the communication bus 440. The processor 410 may invoke logic instructions in the memory 430 to perform a method of complex acquisition of head motion and brain electrical signals, the method comprising: setting sampling time and sampling interval of a single-lead electroencephalogram collector, and collecting an electroencephalogram collecting signal through the single-lead electroencephalogram collector; preprocessing the electroencephalogram acquisition signal to obtain an electroencephalogram signal of a user; and acquiring a head action signal of the user according to the action acquisition signal acquired by the action catcher.
In addition, the logic instructions in the memory 430 may be implemented in the form of software functional units and stored in a computer readable storage medium when the software functional units are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In another aspect, the present invention also provides a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions which, when executed by a computer, enable the computer to perform the method for complex acquisition of head motion and brain electrical signals provided by the above methods, the method comprising: setting sampling time and sampling interval of a single-lead electroencephalogram collector, and collecting an electroencephalogram collecting signal through the single-lead electroencephalogram collector; preprocessing the electroencephalogram acquisition signal to obtain an electroencephalogram signal of a user; and acquiring a head action signal of the user according to the action acquisition signal acquired by the action catcher.
In yet another aspect, the present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program, which when executed by a processor, is implemented to perform the above-provided method for complex acquisition of head motion and brain electrical signals, the method comprising: setting sampling time and sampling interval of a single-lead electroencephalogram collector, and collecting an electroencephalogram collecting signal through the single-lead electroencephalogram collector; preprocessing the electroencephalogram acquisition signal to obtain an electroencephalogram signal of a user; and acquiring a head action signal of the user according to the action acquisition signal acquired by the action catcher.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (16)
1. A composite acquisition device for head motion and electroencephalogram signals is characterized by comprising a wearable main body, a motion capture mark, a single-lead electroencephalogram acquisition device, a motion capture device and a processing unit;
the motion capture mark and the single-lead electroencephalogram collector are both arranged on the wearable main body;
the single-lead brain electricity collector is in communication connection with the processing unit;
the motion capturer is communicatively coupled to the processing unit.
2. The device for complex acquisition of head movements and brain electrical signals according to claim 1, characterized in that said wearable body comprises a forehead position; the single-lead brain electric collector is arranged at the forehead position.
3. The device for complex acquisition of head movements and electroencephalogram signals according to claim 1, wherein at least 3 motion capture markers are arranged on the wearable body.
4. The device for complex acquisition of head movements and brain electrical signals according to any one of claims 1 to 3, characterized in that said motion capturer comprises an optical acquisition device; the motion capture markers comprise optical marker points;
the optical marker point is disposed at a forehead position of the wearable body.
5. The apparatus for complex acquisition of head motion and brain electrical signals according to claim 4, wherein said optical acquisition device comprises an infrared light acquisition device and/or a visible light acquisition device.
6. The device for complex acquisition of head movements and brain electrical signals according to claim 5, wherein said infrared light acquisition means comprises an infrared emission unit and said optical marker points comprise an infrared reflection unit; alternatively, the optical marker point comprises an infrared emission unit.
7. The device for complex acquisition of head movements and brain electrical signals according to any one of claims 1 to 3, characterized in that said motion capture markers comprise a sound generator, said motion capturer comprises a sound receiver; alternatively, the motion capture markers comprise acoustic receivers and the motion capturer comprises an acoustic generator.
8. The device for complex acquisition of head movements and brain electrical signals according to any one of claims 1 to 3, characterized in that said motion capture markers comprise electromagnetic sensors; the motion capturer comprises an electromagnetic generator; alternatively, the motion capture marker comprises an electromagnetic generator and the motion capturer comprises an electromagnetic sensor.
9. The device for complex acquisition of head movements and brain electrical signals according to any one of claims 1 to 3, characterized in that said motion capture markers comprise inertial sensors; the motion capturer is integrated in the processing unit and is in communication with the inertial sensor.
10. A method for complex acquisition of head motion and brain electrical signals, characterized in that the complex acquisition device of head motion and brain electrical signals according to any one of claims 1 to 9 is used, comprising:
setting sampling time and sampling interval of a single-lead electroencephalogram collector, and collecting an electroencephalogram collecting signal through the single-lead electroencephalogram collector;
preprocessing the electroencephalogram acquisition signal to obtain an electroencephalogram signal of a user;
acquiring a head action signal of a user according to an action acquisition signal acquired by the action catcher;
the preprocessing comprises any one or any combination of more of background noise removal, outlier removal, electromyographic signal removal, ocular electrical signal removal and filtering.
11. The method for complex acquisition of head motion and brain electrical signals according to claim 10, wherein said motion acquisition signal comprises any one or any combination of time-by-time positions of a plurality of motion capture markers, time-by-time relative positions of a plurality of motion capture markers, and visible light signals of head motion of the user by using the complex acquisition device of head motion and brain electrical signals of claim 5 or 6.
12. The method for complex acquisition of head motion and brain electrical signals according to claim 11, wherein said step of acquiring the head motion signal of the user from the motion acquisition signal acquired by the motion capture device comprises:
acquiring a pitch angle, a yaw angle, a roll angle and a three-dimensional space coordinate of a head mass point according to a motion acquisition signal acquired by a motion catcher, and taking the pitch angle, the yaw angle, the roll angle and the three-dimensional space coordinate as a head motion signal of a user; the head mass point is any point of the set user head.
13. The method for complex acquisition of head motion and brain electrical signals according to claim 11, wherein said step of obtaining the user's head motion signal from the motion capture marker signal acquired by the motion capture device comprises:
obtaining a first head action signal according to the time-by-time positions of the plurality of motion capture marks and/or the time-by-time relative positions of the plurality of motion capture marks acquired by the infrared light acquisition equipment;
acquiring a second head action signal according to the visible light signal of the head action of the user acquired by the visible light acquisition equipment;
and obtaining a head action signal of the user according to the first head action signal and the second head action signal.
14. A compound acquisition system of head motion and electroencephalogram signals is characterized by comprising a motion acquisition module and an electroencephalogram acquisition module;
the brain electricity collection module can:
setting sampling time and sampling interval of a single-lead electroencephalogram collector, and collecting an electroencephalogram collecting signal through the single-lead electroencephalogram collector;
preprocessing the electroencephalogram acquisition signal to obtain an electroencephalogram signal of a user;
the motion acquisition module can acquire a signal according to the motion acquired by the motion catcher to acquire a head motion signal of the user;
the preprocessing comprises any one or any combination of more of background noise removal, outlier removal, electromyographic signal removal, ocular electrical signal removal and filtering.
15. An electronic device comprising a memory, a processor and a computer program stored on said memory and executable on said processor, characterized in that said processor implements the steps of the method for complex acquisition of head movements and brain electrical signals according to any one of claims 10 to 13 when executing said program.
16. A non-transitory computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the steps of the method for complex acquisition of head motion and brain electrical signals according to any one of claims 10 to 13.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110871072.3A CN113786203A (en) | 2021-07-30 | 2021-07-30 | Head motion and electroencephalogram signal composite acquisition device, method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110871072.3A CN113786203A (en) | 2021-07-30 | 2021-07-30 | Head motion and electroencephalogram signal composite acquisition device, method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113786203A true CN113786203A (en) | 2021-12-14 |
Family
ID=79181451
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110871072.3A Pending CN113786203A (en) | 2021-07-30 | 2021-07-30 | Head motion and electroencephalogram signal composite acquisition device, method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113786203A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20160036393A (en) * | 2014-09-25 | 2016-04-04 | 하이브모션 주식회사 | headset for measuring EEG signal and measuring method using the same |
| CN105496407A (en) * | 2016-01-17 | 2016-04-20 | 仲佳 | Reminding device and method thereof |
| CN106691441A (en) * | 2016-12-22 | 2017-05-24 | 蓝色传感（北京）科技有限公司 | Attention training system based on brain electricity and movement state feedback and method thereof |
| CN109528208A (en) * | 2018-11-08 | 2019-03-29 | 北京诺亦腾科技有限公司 | A kind of optics mixes motion capture system with inertia |
| CN112245756A (en) * | 2020-10-16 | 2021-01-22 | 郑州大学 | Attention training method based on single-channel electroencephalogram |
-
2021
- 2021-07-30 CN CN202110871072.3A patent/CN113786203A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20160036393A (en) * | 2014-09-25 | 2016-04-04 | 하이브모션 주식회사 | headset for measuring EEG signal and measuring method using the same |
| CN105496407A (en) * | 2016-01-17 | 2016-04-20 | 仲佳 | Reminding device and method thereof |
| CN106691441A (en) * | 2016-12-22 | 2017-05-24 | 蓝色传感（北京）科技有限公司 | Attention training system based on brain electricity and movement state feedback and method thereof |
| CN109528208A (en) * | 2018-11-08 | 2019-03-29 | 北京诺亦腾科技有限公司 | A kind of optics mixes motion capture system with inertia |
| CN112245756A (en) * | 2020-10-16 | 2021-01-22 | 郑州大学 | Attention training method based on single-channel electroencephalogram |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Tong et al. | Quantitative EEG analysis methods and clinical applications | |
| Toro et al. | Is the use of a low-cost sEMG sensor valid to measure muscle fatigue? | |
| Rieiro et al. | Validation of electroencephalographic recordings obtained with a consumer-grade, single dry electrode, low-cost device: A comparative study | |
| US20200038653A1 (en) | Multimodal closed-loop brain-computer interface and peripheral stimulation for neuro-rehabilitation | |
| Villegas et al. | Arm-ECG wireless sensor system for wearable long-term surveillance of heart arrhythmias | |
| Sidikova et al. | Vital sign monitoring in car seats based on electrocardiography, ballistocardiography and seismocardiography: A review | |
| Lanata et al. | A novel algorithm for movement artifact removal in ecg signals acquired from wearable systems applied to horses | |
| Pun et al. | Brain-computer interaction research at the Computer Vision and Multimedia Laboratory, University of Geneva | |
| CN110710978A (en) | Multi-mode immersive synchronous acquisition system based on eye movement tracking-brain function activity detection | |
| Pereira et al. | Biometric recognition: A systematic review on electrocardiogram data acquisition methods | |
| Zambrana-Vinaroz et al. | Validation of continuous monitoring system for epileptic users in outpatient settings | |
| CN103040524A (en) | Device and method for reducing interference of physiological activities to medical imaging or measuring results | |
| CN114259243A (en) | Multi-mode human body parameter synchronous acquisition system and method | |
| US20210255706A1 (en) | Brain-machine interface based intention determination device and method using virtual environment | |
| CN113546395A (en) | Intelligent exercise training system and training method | |
| CN113786203A (en) | Head motion and electroencephalogram signal composite acquisition device, method and system | |
| CN111671421A (en) | Electroencephalogram-based children demand sensing method | |
| CN115933873A (en) | Method and system for controlling three-dimensional scene construction based on cognitive load | |
| CN115349872A (en) | Brain cognitive mechanism research method for airplane identification under infrared background based on electroencephalogram | |
| CN113951897A (en) | Multi-mode resting electroencephalogram data interference elimination and marking method and device | |
| Zhang et al. | Robust EOG-based saccade recognition using multi-channel blind source deconvolution | |
| CN108537200B (en) | Apparatus and method for selectively collecting electroencephalographic data through motion recognition | |
| CN211094132U (en) | Multi-mode immersive synchronous acquisition system based on eye movement tracking-brain function activities | |
| Gruden et al. | Physiological measurements for determining driver's state and behavior | |
| Gaho et al. | Brain mapping of cortical epileptogenic zones and their EEG source localization |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20230823 Address after: 401329 3rd Floor, Building 1, No. 53 Fengsheng Road, Jinfeng Town, High tech Zone, Jiulongpo District, Chongqing Applicant after: Chongqing Jinsaixing Medical Technology Co.,Ltd. Address before: 201318 floor 3, No. 1, Lane 100, Banxia Road, Pudong New Area, Shanghai Applicant before: Shanghai saizeng Medical Technology Co.,Ltd. |