CN116138758A - First visual angle audio-visual and biological signal acquisition device - Google Patents

First visual angle audio-visual and biological signal acquisition device Download PDF

Info

Publication number
CN116138758A
CN116138758A CN202310204829.2A CN202310204829A CN116138758A CN 116138758 A CN116138758 A CN 116138758A CN 202310204829 A CN202310204829 A CN 202310204829A CN 116138758 A CN116138758 A CN 116138758A
Authority
CN
China
Prior art keywords
visual
signal acquisition
biological signal
module
audio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310204829.2A
Other languages
Chinese (zh)
Inventor
蔡震宇
李洪新
卢中兴
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Dison Digital Entertainment Technology Co ltd
Original Assignee
Beijing Dison Digital Entertainment Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Dison Digital Entertainment Technology Co ltd filed Critical Beijing Dison Digital Entertainment Technology Co ltd
Priority to CN202310204829.2A priority Critical patent/CN116138758A/en
Publication of CN116138758A publication Critical patent/CN116138758A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024Detecting, measuring or recording pulse rate or heart rate
    • A61B5/02416Detecting, measuring or recording pulse rate or heart rate using photoplethysmograph signals, e.g. generated by infrared radiation
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/25Bioelectric electrodes therefor
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/25Bioelectric electrodes therefor
    • A61B5/279Bioelectric electrodes therefor specially adapted for particular uses
    • A61B5/291Bioelectric electrodes therefor specially adapted for particular uses for electroencephalography [EEG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/25Bioelectric electrodes therefor
    • A61B5/279Bioelectric electrodes therefor specially adapted for particular uses
    • A61B5/296Bioelectric electrodes therefor specially adapted for particular uses for electromyography [EMG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/25Bioelectric electrodes therefor
    • A61B5/279Bioelectric electrodes therefor specially adapted for particular uses
    • A61B5/297Bioelectric electrodes therefor specially adapted for particular uses for electrooculography [EOG]: for electroretinography [ERG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/389Electromyography [EMG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/398Electrooculography [EOG], e.g. detecting nystagmus; Electroretinography [ERG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/48Other medical applications
    • A61B5/4803Speech analysis specially adapted for diagnostic purposes
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02EREDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
    • Y02E60/00Enabling technologies; Technologies with a potential or indirect contribution to GHG emissions mitigation
    • Y02E60/10Energy storage using batteries

Abstract

The invention provides a first visual angle audio-visual and biological signal acquisition device, which belongs to the technical field of human biological signal acquisition and comprises the following components: the first visual angle audio-visual acquisition module acquires the first visual angle image information and the first visual angle audio-visual information of a user, and the biological signal acquisition module acquires the biological signal of the user; the data collection module is used for preprocessing biological signals and transmitting the image information of the first visual angle, the audio information of the first visual angle and the preprocessed biological signals; the battery and the charging and discharging module supply power to the biological signal acquisition module, the first visual angle audio-visual acquisition module and the data collection module. The invention has no complicated installation and debugging steps, reduces the limitation of the acquisition process, improves the number of data samples, and reduces larger errors caused by fewer samples; the method can be used for analyzing the induction factors of the biological signal change of the user by combining the audio-visual acquisition of the first visual angle, and provides a new reference angle for data analysis.

Description

First visual angle audio-visual and biological signal acquisition device
Technical Field
The invention relates to the technical field of human body biological signal acquisition, in particular to a first visual angle audio-visual and biological signal acquisition device.
Background
Bioelectric signals are important indexes of physiological parameters of human bodies, and are widely applied in the fields of psychological research, intelligent medical treatment and the like. Common bioelectric signals are mainly: electroencephalogram (EEG), electromyogram (EMG), electrooculogram (EOG), PPG, etc., the potentials of these biological signals are recorded and converted into electroencephalogram, electromyogram, electrooculogram, photoplethysmogram, etc.
At present, the biological signal acquisition technology has the following problems: the biological signal acquisition equipment has stronger professionality, requires professional personnel to perform more complex operation, and has lower acquisition efficiency and fewer data samples; when the biological signal analysis is carried out, only fluctuation of the biological signal can be observed, the reason of the biological signal change of the user cannot be explored, the biological signal data analysis is not accurate enough, and larger errors are generated.
Disclosure of Invention
The invention aims to provide a first visual angle audio-visual and biological signal acquisition device so as to solve at least one technical problem in the background technology.
In order to achieve the above purpose, the present invention adopts the following technical scheme:
the invention provides a first visual angle audio-visual and biological signal acquisition device, which comprises:
the system comprises a first visual angle audio-visual acquisition module, a data collection module, a biological signal acquisition module, a battery and a charging and discharging module;
the first visual angle audio-visual acquisition module is used for acquiring image information of a first visual angle of a user and audio information of the first visual angle;
the biological signal acquisition module is used for acquiring biological signals of a user, including brain electrical signals, electromyographic signals, eye electrical signals, skin electrical signals and PPG signals;
the data collection module is used for preprocessing biological signals and transmitting the image information of the first visual angle, the audio information of the first visual angle and the preprocessed biological signals;
the battery and the charge-discharge module are used for supplying power to the biological signal acquisition module, the first visual angle audio-visual acquisition module and the data collection module.
Preferably, the first visual angle audio-visual acquisition module comprises a camera module and a microphone module, the camera module is provided with a sliding rail on a shell fixed layer of the biological signal acquisition module, two cameras are adjusted through the sliding rail to simulate a first visual angle, content to be observed is recorded, and the first visual angle image information of a user is simulated and acquired more truly; the microphone module comprises a microphone and an adjusting plate, wherein the adjusting plate is arranged on a shell fixing layer of the biological signal acquisition module and is arranged at a corresponding position of left and right ears of a user and used for acquiring audio information of a first visual angle of the user.
Preferably, the battery and the charging and discharging module comprise a battery module, a charging interface and an external charging wire; the battery module is used for supplying power to the biological signal acquisition module, the first visual angle audio-visual acquisition module and the data collection module.
Preferably, the data collection module comprises a data preprocessing unit and a data transmission unit; the data preprocessing unit is used for collecting and processing the biological signals; the data transmission unit performs wired transmission with the biological signal acquisition module and the first visual angle audio-visual acquisition module; the data transmission unit transmits the first visual angle image information, the first visual angle audio information and the preprocessed biological signals to the corresponding computer control end through wireless transmission.
Preferably, the biological signal acquisition module comprises a facial biological signal acquisition device and a scalp biological signal acquisition device; the facial biological characteristic signal acquisition device comprises a flexible sublayer, a circuit board sublayer, an electromagnetic shielding sublayer and a shell fixing layer.
Preferably, the flexible sub-layer is made of a flexible material, and is provided with a plurality of through holes, the flexible material can be bent to a proper radian when contacting with the face of a user, and the electrodes of the circuit board sub-layer can pass through the through holes to finely adjust the positions of the electrodes.
Preferably, the circuit board sub-layer comprises an electrode sensor and an optical sensor; the electrode sensor is used for collecting brain electrical signals, muscle electrical signals, eye electrical signals and skin electrical signals of a user; the optical sensor acquires the PPG signal of the user through photoplethysmography.
Preferably, the electrode sensor includes: an electrode comprising a surface made of a metallic conductive material, the surface being contactable with a user's face through a through-hole of the flexible sublayer, and a substrate for connecting the conductive surface to a circuit board as part of a conductive path for the conductive surface to collect a biological signal; the circuit board is a flexible circuit board that can deform to accommodate the facial structure of the user when the user wears the device.
Preferably, the electromagnetic shielding sub-layer is used for shielding external electromagnetic interference; the shell fixing layer is an equipment shell and is used for fixing the flexibility sublayer, the circuit board sublayer and the electromagnetic shielding sublayer.
Preferably, the scalp biological characteristic signal acquisition device is a microneedle electrode, scalp biological characteristic signal acquisition is carried out through the microneedle electrode, signals are integrated into a central control board (namely a circuit board), and the microneedle electrode is connected with the facial biological characteristic signal acquisition device.
The invention has the beneficial effects that: the method has the advantages that complicated installation and debugging steps are avoided in the use process, and data acquisition can be performed without professional staff and professional sites; the wireless connection can be selected for power supply and transmission, so that the equipment is more convenient, the limit of the acquisition process is reduced, the number of data samples is increased, and larger errors caused by fewer samples are reduced; the method can be used for analyzing the induction factors of the biological signal change of the user by combining the audio-visual acquisition of the first visual angle, and provides a new reference angle for data analysis.
Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic diagram of a connection structure of a first visual angle audio-visual and biological signal acquisition device according to an embodiment of the invention.
Fig. 2 is an exploded view of a facial biological characteristic signal acquisition device of a biological signal acquisition module in a first visual angle audio-visual and biological signal acquisition device according to an embodiment of the present invention.
Wherein: 21-a flexible sublayer; 211-through holes; 22-circuit board sub-layer; 221-electrode sensor; 23-electromagnetic shielding sub-layer; 24-a housing fixing layer; 241-microphone module; 242-camera module.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements throughout or elements having like or similar functionality. The embodiments described below by way of the drawings are exemplary only and should not be construed as limiting the invention.
It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.
It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless expressly stated otherwise, as understood by those skilled in the art. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, and/or groups thereof.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, the different embodiments or examples described in this specification and the features of the different embodiments or examples may be combined and combined by those skilled in the art without contradiction.
In the description of this specification, the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In the description of the present invention, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.
In the description of the present specification, the terms "center," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like indicate an orientation or positional relationship based on that shown in the drawings, merely for convenience of description and to simplify the description, and do not indicate or imply that the devices or elements referred to must have a specific orientation, be configured and operated in a specific orientation, and thus should not be construed as limiting the present technology.
The terms "mounted," "connected," and "disposed" are to be construed broadly, and may be, for example, fixedly connected, disposed, detachably connected, or integrally connected, disposed, unless otherwise specifically defined and limited. The specific meaning of the above terms in the present technology can be understood by those of ordinary skill in the art according to the specific circumstances.
In order that the invention may be readily understood, a further description of the invention will be rendered by reference to specific embodiments that are illustrated in the appended drawings and are not to be construed as limiting embodiments of the invention.
It will be appreciated by those skilled in the art that the drawings are merely schematic representations of examples and that the elements of the drawings are not necessarily required to practice the invention.
Example 1
In this embodiment 1, a first viewing angle audio-visual and biological signal acquisition device is provided, including: the system comprises a first visual angle audio-visual acquisition module, a data collection module, a biological signal acquisition module, a battery and a charging and discharging module; the first visual angle audio-visual acquisition module is used for acquiring image information of a first visual angle of a user and audio information of the first visual angle; the biological signal acquisition module is used for acquiring biological signals of a user, including brain electrical signals, electromyographic signals, eye electrical signals, skin electrical signals and PPG signals; the data collection module is used for preprocessing biological signals and transmitting the image information of the first visual angle, the audio information of the first visual angle and the preprocessed biological signals; the battery and the charge-discharge module are used for supplying power to the biological signal acquisition module, the first visual angle audio-visual acquisition module and the data collection module.
The first visual angle audio-visual acquisition module comprises a camera module 242 and a microphone module 241, wherein the camera module 242 is provided with a sliding rail on a shell fixing layer 24 of the biological signal acquisition module, a sliding block is arranged on the sliding rail in a sliding manner, the camera module is fixed on the sliding block, a strip-shaped limiting hole along the length direction of the sliding rail is formed in the side wall of the sliding rail, a tightening bolt is arranged in the limiting hole, when the sliding block slides to a proper position, the tightening bolt is screwed, the end part of the tightening bolt abuts against the sliding block, the position of the tightening bolt is fixed, two cameras are adjusted to simulate a first visual angle through the sliding rail, the content to be observed is recorded, and the first visual angle image information of a user is simulated and acquired more truly; the microphone module 241 includes a microphone and an adjusting plate, and the adjusting plate is mounted on the housing fixing layer 24 of the biological signal acquisition module, and is provided at a corresponding position of the left ear and the right ear of the user, for obtaining audio information of the first visual angle of the user.
The battery and the charging and discharging module comprise a battery module, a charging interface and an external charging wire; the battery module is used for supplying power to the biological signal acquisition module, the first visual angle audio-visual acquisition module and the data collection module.
The data collection module comprises a data preprocessing unit and a data transmission unit; the data preprocessing unit is used for collecting and processing the biological signals; the data transmission unit performs wired transmission with the biological signal acquisition module and the first visual angle audio-visual acquisition module; the data transmission unit transmits the first visual angle image information, the first visual angle audio information and the preprocessed biological signals to the corresponding computer control end through wireless transmission.
The biological signal acquisition module comprises a facial biological characteristic signal acquisition device and a scalp biological characteristic signal acquisition device; the facial biological characteristic signal acquisition device comprises a flexible sublayer 21, a circuit board sublayer 22, an electromagnetic shielding sublayer 23 and a shell fixing layer 24. The flexible sub-layer 21 is made of a flexible material, and is provided with a plurality of through holes 211, the flexible material can be bent to a proper radian when contacting with the face of a user, and the electrodes of the electrode sensor 221 on the circuit board sub-layer 22 can pass through the through holes 211 to finely adjust the positions of the electrodes.
The circuit board sub-layer 22 includes an electrode sensor 221 and an optical sensor; the electrode sensor 221 is used for collecting brain electrical signals, muscle electrical signals, eye electrical signals and skin electrical signals of a user; the optical sensor acquires the PPG signal of the user through photoplethysmography.
The electrode sensor 221 includes: an electrode comprising a surface made of a metallic conductive material, the surface being contactable with a user's face through a through hole 211 of the flexible sublayer 21, and a substrate for connecting the conductive surface and a circuit board as part of a conductive path for the conductive surface to collect a biological signal; the circuit board is a flexible circuit board that can deform to accommodate the facial structure of the user when the user wears the device. The electrode sensors are independent units, and different biological signals are acquired by using different electrode sensors. After the signals collected by the electrode sensor and the optical sensor are integrated into a central control board (namely a circuit board), the signals can be transmitted to a corresponding computer control end through a transmission line.
The electromagnetic shielding sub-layer 23 is used for shielding external electromagnetic interference; the housing fixing layer 24 is a device housing, and is used for fixing the flexible sublayer 21, the circuit board sublayer 22 and the electromagnetic shielding sublayer 23. The scalp biological characteristic signal acquisition device is a microneedle electrode, scalp biological characteristic signal acquisition is carried out through the microneedle electrode, signals are integrated into a central control board (namely a circuit board), and the microneedle electrode is connected with the facial biological characteristic signal acquisition device.
Example 2
In this embodiment 2, there is provided an apparatus for capturing audio-visual and biological signals at a first viewing angle, the apparatus including: the system comprises a first visual angle audio-visual acquisition module, a data collection module, a battery, a charging and discharging module and a biological signal acquisition module;
the first visual angle audio-visual acquisition module comprises a camera module 242 and a microphone module 241, the camera module 242 is provided with a sliding rail on the shell fixed layer 24 of the biological signal acquisition module, the two cameras are adjusted through the sliding rail to simulate a first visual angle, the content to be observed is recorded, and the first visual angle image information of a user is simulated and acquired more truly; the microphone module 241 includes a microphone and an adjusting plate, and the adjusting plate is mounted on the housing fixing layer 24 of the biological signal acquisition module and is provided at a corresponding position of the left ear and the right ear of the user, so as to obtain audio information of a first visual angle of the user;
the data collection module comprises pretreatment of biological signals, and wired and wireless transmission of the processed biological signals and audio-visual information of a first visual angle;
further, the data collection module comprises a data preprocessing unit and a data transmission unit; the data preprocessing unit is used for collecting and processing biological signals such as brain electrical signals (EEG), electromyographic signals (EMG), electrooculographic signals (EOG), skin electrical signals (EDA) and the like; the data transmission unit comprises wired transmission and wireless transmission, the equipment is provided with transmission lines at the circuit board sublayer 22 of the biological signal acquisition module and the module unit of the first visual angle audio-visual acquisition module, and can acquire transmission line data by using an external data line; or wireless transmission equipment such as Bluetooth, WIFI and the like is adopted to transmit the biological signals subjected to pretreatment and the audio and image information acquired by the first visual angle audio and video acquisition module to the corresponding computer control end.
The battery and charge-discharge module is configured to supply power to the circuit board sublayer 22 in the biological signal acquisition module, the camera module 242 and the microphone module 241 in the first visual angle audio-visual acquisition module, and the data collection module;
the battery and the charging and discharging module comprise a battery module, a charging interface and an external charging wire;
the battery module consists of two chargeable and dischargeable high-power batteries, and can supply power for the camera module 242, the microphone module 241, the preprocessing unit and the data transmission unit of data in the data collection module, and the circuit board sub-layer and the scalp biological characteristic signal collection device in the biological signal collection module;
the charging interface is an adaptable common type-C charging line interface for charging the battery module or directly supplying power to the equipment, so that the equipment can be used under the condition of whether the battery exists or not;
the biological signal acquisition module is used for completing acquisition of biological signals such as brain electrical signals (EEG), electromyographic signals (EMG), electrooculogram signals (EOG), skin electrical signals (EDA) and PPG signals of a user through a multi-layer panel;
the biological signal acquisition module comprises a facial biological characteristic signal acquisition device and a scalp biological characteristic signal acquisition device; the facial biological characteristic signal acquisition device comprises a flexible sublayer 21, a circuit board sublayer 22, an electromagnetic shielding sublayer 23 and a shell fixing layer 24; the flexible sub-layer 21 is a porous sub-layer made of a flexible material that can be bent to a proper curvature when in direct contact with the face of the user, and the porous design allows the electrodes of the circuit board sub-layer 22 to pass through the through holes 211 to fine-tune the electrode positions.
The circuit board sub-layer 22 includes an electrode sensor 221 and an optical sensor. The electrode sensor 221 is used for collecting bioelectric signals such as brain electrical signals (EEG), electromyographic signals (EMG), electrooculographic signals (EOG), and skin electrical signals (EDA) of the user; the optical sensor acquires a photoplethysmography (PPG) signal of a user by PPG. Each of the sensors comprises an electrode comprising a surface made of a metallic conductive material, which surface is in direct contact with the face of the user through the through-holes 211 of the flexible sublayer 21, and a substrate for connecting the conductive surface with a circuit board as part of a conductive path for the conductive surface to collect biological signals; the circuit board is a flexible circuit board, and can be easily deformed to adapt to the facial structure of a user when the user wears the device, so that signal data are more accurate;
the electromagnetic shielding sub-layer 23 is used for avoiding the influence of other electromagnetic interference on the acquisition of biological signals; the shell fixing layer 24 is an equipment shell and is used for fixing the flexibility sublayer 21, the circuit board sublayer 22 and the electromagnetic shielding sublayer 23;
the scalp biological characteristic signal acquisition device is connected with the facial biological characteristic signal acquisition device. The scalp biological characteristic signal acquisition device uses the most commonly used microneedle electrode technology to manufacture an array structure on the surface of materials such as silicon materials, metals, polymers and the like, and can penetrate through the hair of a user to contact the scalp of the user. A design of 8 acquisition points is employed to obtain accurate signal data.
Example 3
As shown in fig. 1, the embodiment 3 provides a device for collecting audio-visual and biological signals at a first viewing angle, which includes a battery, a charge-discharge module, a biological signal collecting module, a first viewing angle audio-visual acquiring module and a data collecting module;
a battery and charge-discharge module providing power to a device, comprising: the battery module is used for supplying power to other modules of the equipment, and when the electric quantity of the battery module is insufficient, the charging interface can be externally connected with the type-C interface charging wire to charge the battery module or directly supply power to the equipment;
the biological signal acquisition module is used for acquiring biological signals such as brain electrical signals (EEG), electromyographic signals (EMG), electrooculographic signals (EOG), skin electrical signals (EDA), PPG signals and the like of a user; the facial biological characteristic signal acquisition device is divided into four layers: a flexible sublayer 21, a circuit board sublayer 22, an electromagnetic shielding sublayer 23, and a housing fixing layer 24; the flexible sublayer 21 is in direct contact with the skin of a user, and the position of the electrode can be finely adjusted by adopting a porous design so as to adapt to different bone structures of the user; the circuit board sub-layer 22 is a flexible circuit board and comprises a plurality of sensors, each sensor comprises an electrode made of metal conductive materials, the electrode penetrates out of a through hole 211 of the flexible sub-layer 21 to be in contact with the skin of a user, collected data are transmitted back to the circuit board, and the collected data are transmitted to the data collecting module by the circuit board sub-layer 22 to perform pretreatment on biological signals; the electromagnetic shielding sub-layer 23 is used for avoiding the influence of other electromagnetic interference on biological signal data acquisition; the shell fixing layer 24 is a shell of the equipment, and the flexibility sublayer 21, the circuit board sublayer 22 and the electromagnetic shielding sublayer 23 are fixed on the shell of the equipment, so that the skeleton structure of a user can be better attached when the tightness of the equipment is regulated, and the acquired data is more accurate;
the first visual angle audio-visual acquisition module comprises a camera module 242 and a microphone module 241, the camera module 242 is arranged on the shell fixed layer 24 and is used for acquiring first visual angle image information of a user, the shell fixed layer 24 adopts the design of a sliding rail, and two cameras are adjusted through the sliding rail to simulate a first visual angle; the microphone module 241 is used for acquiring audio information of a first visual angle of a user and is arranged at corresponding positions of left and right ears of the user; the image and audio information obtained by the camera module 242 and the microphone module 241 are transmitted to the data collection module through a transmission line, and can be transmitted in a wired manner through an external data line or transmitted to a computer control end through wireless transmission equipment;
the data collection module comprises a data preprocessing unit and a data transmission unit, and the data acquired by the biological signal acquisition module is transmitted to the data preprocessing unit through the transmission line of the circuit board sublayer 22. The data transmission unit comprises two forms of wired transmission and wireless transmission, the wired transmission comprises a transmission line and a data line interface, and the preprocessed biological signals and the information acquired by the first visual angle audio-visual can be connected to a computer control end through an external data line for data transmission, or wireless transmission equipment is adopted for wireless form transmission such as Bluetooth, WIFI and the like.
In summary, the first visual angle audio-visual and biological signal acquisition device according to the embodiment of the present invention has no complicated installation and debugging steps in the use process, and can perform data acquisition without professional personnel and professional sites. The wireless connection can be selected for power supply and transmission, so that the device is more convenient, the limit of the acquisition process is reduced, the number of data samples is increased, and larger errors caused by fewer samples are reduced. The method and the device can be used for analyzing the induction factors of the biological signal change of the user by combining the audio-visual acquisition of the first visual angle, and provide a new reference angle for data analysis.
While the foregoing description of the embodiments of the present invention has been presented in conjunction with the drawings, it should be understood that it is not intended to limit the scope of the invention, but rather, it should be understood that various changes and modifications could be made by one skilled in the art without the need for inventive faculty, which would fall within the scope of the invention.

Claims (10)

1. A first viewing angle audio-visual and biological signal acquisition device, comprising:
the system comprises a first visual angle audio-visual acquisition module, a data collection module, a biological signal acquisition module, a battery and a charging and discharging module;
the first visual angle audio-visual acquisition module is used for acquiring image information of a first visual angle of a user and audio information of the first visual angle;
the biological signal acquisition module is used for acquiring biological signals of a user, including brain electrical signals, electromyographic signals, eye electrical signals, skin electrical signals and PPG signals;
the data collection module is used for preprocessing biological signals and transmitting the image information of the first visual angle, the audio information of the first visual angle and the preprocessed biological signals;
the battery and the charge-discharge module are used for supplying power to the biological signal acquisition module, the first visual angle audio-visual acquisition module and the data collection module.
2. The first visual angle audio-visual and biological signal acquisition device according to claim 1, wherein the first visual angle audio-visual acquisition module comprises a camera module (242) and a microphone module (241), the camera module (242) is provided with a sliding rail on a shell fixing layer (24) of the biological signal acquisition module, and the two cameras are adjusted to simulate the first visual angle through the sliding rail; the microphone module (241) comprises a microphone and an adjusting plate, wherein the adjusting plate is arranged on a shell fixing layer (24) of the biological signal acquisition module and is arranged at a corresponding position of left and right ears of a user and used for acquiring audio information of a first visual angle of the user.
3. The first visual angle audio-visual and biological signal acquisition device according to claim 2, wherein the battery and the charge-discharge module comprise a battery module, a charging interface and an external charging wire; the battery module is used for supplying power to the biological signal acquisition module, the first visual angle audio-visual acquisition module and the data collection module.
4. The first viewing angle audio-visual and biological signal acquisition device according to claim 1, wherein the data collection module comprises a data preprocessing unit and a data transmission unit; the data preprocessing unit is used for collecting and processing the biological signals; the data transmission unit performs wired transmission with the biological signal acquisition module and the first visual angle audio-visual acquisition module; the data transmission unit transmits the first visual angle image information, the first visual angle audio information and the preprocessed biological signals to the corresponding computer control end through wireless transmission.
5. The first viewing angle audio-visual and biological signal acquisition device of claim 1, wherein the biological signal acquisition module comprises a facial biological signal acquisition device and a scalp biological signal acquisition device; the facial biological characteristic signal acquisition device comprises a flexible sublayer (21), a circuit board sublayer (22), an electromagnetic shielding sublayer (23) and a shell fixing layer (24).
6. The first viewing angle audio-visual and biological signal acquisition device according to claim 5, wherein the flexible sub-layer (21) is made of a flexible material, and is provided with a plurality of through holes (211), the flexible material can be bent to an appropriate arc when contacting the face of the user, and the electrodes of the circuit board sub-layer (22) can pass through the through holes (211) to finely adjust the positions of the electrodes.
7. The first viewing angle audio-visual and biological signal acquisition device according to claim 6, characterized in that the circuit board sub-layer (22) comprises an electrode sensor (221) and an optical sensor; the electrode sensor (221) is used for collecting brain electrical signals, muscle electrical signals, eye electrical signals and skin electrical signals of a user; the optical sensor acquires the PPG signal of the user through photoplethysmography.
8. The first viewing angle audio-visual and biological signal acquisition device according to claim 7, wherein the electrode sensor (221) comprises: an electrode comprising a surface made of a metallic conductive material, said surface being contactable with a user's face through a through hole (211) of said flexible sublayer (21), and a substrate for connecting the conductive surface with a circuit board as part of a conductive path for the conductive surface to collect biological signals; the circuit board is a flexible circuit board that can deform to accommodate the facial structure of the user when the user wears the device.
9. The first viewing angle audio-visual and biological signal acquisition device according to claim 8, wherein the electromagnetic shielding sub-layer (23) is configured to shield external electromagnetic interference; the shell fixing layer (24) is a device shell and is used for fixing the flexible sublayer (21), the circuit board sublayer (22) and the electromagnetic shielding sublayer (23).
10. The first viewing angle audio-visual and biological signal acquisition device according to claim 9, wherein the scalp biological signal acquisition device is a microneedle electrode through which scalp biological signal acquisition is performed; the microneedle electrode is connected with the facial biological characteristic signal acquisition device.
CN202310204829.2A 2023-03-06 2023-03-06 First visual angle audio-visual and biological signal acquisition device Pending CN116138758A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310204829.2A CN116138758A (en) 2023-03-06 2023-03-06 First visual angle audio-visual and biological signal acquisition device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310204829.2A CN116138758A (en) 2023-03-06 2023-03-06 First visual angle audio-visual and biological signal acquisition device

Publications (1)

Publication Number Publication Date
CN116138758A true CN116138758A (en) 2023-05-23

Family

ID=86354375

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310204829.2A Pending CN116138758A (en) 2023-03-06 2023-03-06 First visual angle audio-visual and biological signal acquisition device

Country Status (1)

Country Link
CN (1) CN116138758A (en)

Similar Documents

Publication Publication Date Title
US20210030298A1 (en) Systems and methods to gather and analyze electroencephalographic data
CN106913330B (en) Wearable wireless 12-channel electrocardiogram system
US20180242916A1 (en) Electroencephalogram monitoring system and method of use of the same
US20050107716A1 (en) Methods and apparatus for positioning and retrieving information from a plurality of brain activity sensors
WO2007071180A1 (en) Wearable, wireless and distributed physiological signal monitoring system
Chen et al. Novel flexible material-based unobtrusive and wearable body sensor networks for vital sign monitoring
US20210022636A1 (en) Bio-signal detecting headband
CN113274038B (en) Lip-shaped sensor device combining myoelectricity and pressure signals
EP1364614B1 (en) Voltage measuring device comprising fixing member, electrode and transmitter
Paul et al. A versatile in-ear biosensing system for continuous brain and health monitoring
CN116138758A (en) First visual angle audio-visual and biological signal acquisition device
CN218391071U (en) Miniaturized wireless bluetooth bioelectricity and inertia monitor
CN208822801U (en) One kind carrying out psychological assistant diagnosis system based on brain wave
CN110101366A (en) A kind of sleep monitor system
CN206809273U (en) Electrode assembly and Polysomnography system
CN115444435A (en) Occlusion movement condition monitoring and analyzing system based on high-density myoelectricity acquisition array
CN212465975U (en) Multi-mode nerve intensive care system
CN112022110A (en) Multi-mode nerve intensive care system
CN111920398A (en) Composite human body physiological electric signal detection head ring
CN111904409A (en) Flexible sensor for electrocardio monitoring and hydrogel flexible electrocardio monitor
WO2018211429A1 (en) Modular device for recording and processing of the electrophysiological activity
CN216257128U (en) Wearable head belt type occlusion motion condition monitoring device
Erickson et al. Open-source 128-channel bioamplifier module for ambulatory monitoring of gastrointestinal electrical activity
CN110584653A (en) Multi-electric acquisition, analysis and feedback system based on wearable equipment
CN219578893U (en) Epidermis sensor and human body electric signal acquisition system based on laser-induced graphene

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination