CN207912695U - A kind of multi-modal physiology and behavioral data merge acquisition system - Google Patents
A kind of multi-modal physiology and behavioral data merge acquisition system Download PDFInfo
- Publication number
- CN207912695U CN207912695U CN201720738585.6U CN201720738585U CN207912695U CN 207912695 U CN207912695 U CN 207912695U CN 201720738585 U CN201720738585 U CN 201720738585U CN 207912695 U CN207912695 U CN 207912695U
- Authority
- CN
- China
- Prior art keywords
- data
- acquisition
- module
- behavioral
- physiological
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
The utility model discloses a kind of multi-modal physiology and behavioral data to merge acquisition system, including background processor, data acquisition unit and data display unit, background processor is integrated in a computer, the data acquired for receiving data acquisition unit, data acquisition unit includes physiological acquisition module, behavior acquisition module and environment acquisition module, background processor includes data memory module, tfi module and data analysis module, data memory module realizes data connection with physiological acquisition module and behavior acquisition module, collected physiological data and behavioral data data for receiving；Tfi module is used to sequentially in time store the collected physiological data of institute and behavioral data in data memory module；Data analysis module be used for in data memory module physiological data and behavioral data data analyze, obtain analysis result online.The utility model by collected different modalities physiology and behavioral data synchronous transfer to same background processor in, fusion directly is synchronized to gathered data, greatly reduces the cost of system equipment, help to improve data fusion analysis accuracy rate.
Description
Technical field
The utility model belongs to experimental psychology and Physiological Psychology field of measuring technique, and in particular to a kind of multi-modal physiology
With behavioral data fusion acquisition, analysis, visual system.
Background technology
There are many manifestation modes for the psychology and emotional state of people, such as language, expression, action and various physiological signals.
Single physiology or behavioral parameters or its characteristic index is difficult psychology and the emotional state variation for accurately reflecting people, therefore, base
Psychology, man-machine friendship it have been applied to more and more widely in multi-modal physiology and the data fusion acquisition technique of behavioural information
Mutually, the fields such as artificial intelligence.
Currently, when the physiology and behavioral data of acquisition subject, need to use multiple data acquisition equipments to different
Physiology and behavioral data synchronize acquisition.Since each data acquisition equipment all has the acquisition of independent data and stores system
System, the collected data of institute are recorded respectively in oneself corresponding computer storage unit, then the number to respectively acquiring respectively
According to being analyzed, finally by after each data analysis feature or index import data fusion reponse system in merge again
Analysis.Since different data acquisition equipments is required for independent acquisition and storage system, the data modality of acquisition is more, input
System equipment cost it is bigger.In addition, may be interfered with each other between the data of different modalities, the fusion in initial data is needed
It is handled accordingly in gatherer process, and traditional data acquisition equipment can not achieve the fusion acquisition of data, it therefore, can shadow
Ring the accuracy to subject's psychology and emotional state analysis.Finally, many data acquisition equipments do not support the online of data
Analysis, therefore online analysis result can not be provided based on the data acquired in real time.
Utility model content
Therefore, the utility model is in order to solve not realizing the same of data in same equipment between available data collecting device
Step acquisition and the technical issues of convergence analysis, for this purpose, the utility model provides a kind of multi-modal physiology and behavioral data merges
Acquisition system.
Used technical solution is as follows：
A kind of multi-modal physiology and behavioral data merge acquisition system, and the system comprises background processors and data to acquire
Unit, the background processor are integrated in a computer, the data acquired for receiving the data acquisition unit, institute
Stating data acquisition unit includes:
Physiological acquisition module is connect with the background processor, for acquire subject complete test assignment during institute
The neuro-physiological data of generation；
Behavior acquisition module is connect with the background processor, for acquiring subject during completing test assignment
Generated behavioral data data；
The background processor includes data memory module, tfi module and data analysis module, and the data store mould
Block realizes data connection with the physiological acquisition module and behavior acquisition module, collected physiological data and row for receiving
For data information；The tfi module is used to storing and arriving institute the collected physiological data of institute and behavioral data sequentially in time
In the data memory module stated；The data analysis module is used for the physiological data and behavior number in the data memory module
It is analyzed according to data, obtains analysis result online.
The data memory module is equipped with multiple data storage areas, and the data memory module is to the data acquisition unit
In the collected data of various data acquisition modules institute carry out classification storage, the data analysis module carries out each data same
Walk on-line analysis.
The system also includes data display units, are connect with the background processor, for externally showing the number
According to the acquired original data of collecting unit and the on-line analysis result of the background processor.
The data acquisition unit further includes environment acquisition module, for acquiring subject's residing external environment in test
Data realize data connection with the background processor.
The physiological acquisition module includes brain electric data collecting equipment, electrocardio-data collection equipment, skin electric data collecting
In equipment, blood pressure data collecting device, breath data collecting device, temperature data collecting device and myoelectricity data acquisition equipment
It is a kind of and several.
The behavior acquisition module is video capture device, facial expression, eye movement and voice for recording subject
Behavioral data.
Be equipped with multiple data acquisition units in the system, multiple data acquisition units respectively with same institute
It states background processor and realizes data transmission.
The behavior acquisition module realizes number by wireless with the background processor respectively with the physiological acquisition module
According to transmission.
Multiple data display units, the data display unit and the data acquisition unit are equipped in the system
It connects one to one.
The data display unit is video display apparatus.
Technical solutions of the utility model have the following advantages that：
A. the utility model is provided with background processor and data acquisition unit in acquisition system, in data acquisition unit
Physiological acquisition module and behavior acquisition module form data connection, physiological acquisition module and row with same background processor respectively
Physiology and behavioral data for the collected subject of acquisition module are transmitted directly to the storage mould of the data in background processor
Block greatly reduces the cost of data collecting system.
B. multi-modal data is realized the acquisition on same time shaft by the utility model by tfi module, and passes through number
Analysis is synchronized to all collected data according to analysis module, improves the efficiency of data fusion analysis；Importantly,
A variety of electricity physiological signals will produce noise jamming between each other during synchronous acquisition；The utility model melts initial data
It closes in gatherer process using the data preprocessing methods such as dry, standardization and normalization are removed, the noise between data can be effectively removed
Interference improves the accuracy to subject's psychology and emotional state analysis.
C. the collected data of each data acquisition equipment institute classify whole by the utility model in data memory module
Reason and synchronous storage.Subject wears a variety of data acquisition equipments simultaneously, and the collected data of institute can be straight wirelessly
It connects and is transferred to same background processor and synchronizes analyzing processing, the data of all acquisitions are directly stored in same data storage mould
In block, the efficiency of multi-modal data storage and management is improved.
D. the utility model analyzes multi-modal data by data analysis module in real time, and is shown and set by video
When standby externally display acquired original data, on-line analysis result, the gatherer process of multi-modal data and subject test
Test environment residing for it, facilitates that main examiner person is comprehensive, full-time journey record test process, and the later stage is contributed to make subject
More comprehensive, objective interpretation of result.
Description of the drawings
It, below will be right in order to illustrate more clearly of specific embodiment of the present invention or technical solution in the prior art
Specific implementation mode or attached drawing needed to be used in the description of the prior art are briefly described, it should be apparent that, it is described below
In attached drawing be that some embodiments of the utility model are not paying creativeness for those of ordinary skill in the art
Under the premise of labour, other drawings may also be obtained based on these drawings.
Fig. 1 is provided the structural schematic diagram of fusion acquisition system by the utility model；
Fig. 2 is provided the schematic diagram of fusion acquisition system by the utility model；
Fig. 3 is provided the data fusion acquisition transmission block diagram of multiple data acquisition units by the utility model.
In figure：
1- background processors；2- data acquisition units；3- physiological acquisition modules；4- behavior acquisition modules；5- environment acquires
Module；6- data display units；7- Video codings end；8- video decoding ends.
Specific implementation mode
The technical solution of the utility model is clearly and completely described below in conjunction with attached drawing, it is clear that described
Embodiment is the utility model a part of the embodiment, instead of all the embodiments.Based on the embodiments of the present invention, originally
The every other embodiment that field those of ordinary skill is obtained without making creative work, belongs to this practicality
Novel protected range.
As depicted in figs. 1 and 2, the utility model provides a kind of multi-modal physiology and behavioral data fusion acquisition system,
Including background processor 1 and data acquisition unit 2, background processor 1 is integrated in a PC computer, is adopted for receiving data
The data that collection unit 2 is acquired, data acquisition unit 2 therein include physiological acquisition module 3 and behavior acquisition module 4, wherein
Physiological acquisition module 3 and behavior acquisition module 4 connect with same background processor, physiological acquisition module is for acquiring subject
Complete test assignment generated neuro-physiological data in the process；
Behavior acquisition module is for acquiring subject's generated behavioral data data during completing test assignment.
As shown in Fig. 2, background processor 3 therein includes data memory module, tfi module and data analysis module, number
Realize data connection according to memory module and physiological acquisition module and behavior acquisition module, background processor can by bluetooth,
WiFi or other radio network gateway transmission modules receive the collected physiological data of institute and behavioral data data；Tfi module will be adopted
The physiological data and behavioral data collected stores in data memory module sequentially in time, makes all data in the same time
Under axis；Data analysis module therein be used for in data memory module physiological data and behavioral data data analyze,
Obtain analysis result online.
The utility model by being arranged background processor and data acquisition unit in systems, the life in data acquisition unit
It manages acquisition module and behavior acquisition module and forms data connection with same background processor respectively, physiological acquisition module is adopted with behavior
Collection module collected subject physiology and behavioral data data are directly read by the SDK in each equipment by background process
Data memory module in device makes system become easier, greatly reduces the cost of acquisition system, improves data fusion point
The efficiency of analysis, the fusion acquisition for initial data can also effectively remove interference between data, improve to subject's psychology and
The accuracy of emotional state analysis, the utility model synchronize analysis to all collected data, online to generate analysis knot
Fruit, the comprehensive test analysis that subject accurately can be objectively completed for the later stage lay the first stone.
It is highly preferred that being equipped with multiple data storage areas in data memory module, data memory module acquires data single
The collected data of various data acquisition modules institute in member carry out classification storage, for example obtain the brain electricity number of subject successively
According to, skin electricity data and behavioral data, data analysis module point can be passed through by three kinds of data storages in various positions in this way
It is other that three kinds of data are analyzed, it can also be by carrying out convergence analysis to above-mentioned three kinds of data.To realize by one
Background processor obtain in real time it is multi-modal under gathered data, analysis is synchronized to gathered data in real time, obtains analysis online
As a result.
Main examination side personnel more can intuitively find out to the data acquisition of a certain subject for convenience, also set in systems
Have data display unit, connect with background processor, for external display data collecting unit acquired original data and after
The on-line analysis result of platform processor.Here data display unit is video display apparatus, test, acquisition in relation to subject
Data and on-line analysis result are presented to main examination side by corresponding video display apparatus respectively.
It is highly preferred that further including environment acquisition module in data acquisition unit, for acquiring subject in test when institute
Locate external environment data, with the background processor realize data connection, the later stage to subject carry out task test and appraisal when, just
In to more comprehensive, the objective interpretation of result of subject's progress.
Physiological acquisition module mentioned in the utility model includes that brain electric data collecting equipment, electrocardio-data collection are set
Standby, skin pricktest data acquisition equipment, blood pressure data collecting device, breath data collecting device, temperature data collecting device and flesh
It is a kind of and several in electric data collecting equipment.Different types of collecting device can be used to carry out data acquisition simultaneously, also may be used
To be chosen according to mission requirements, therein a certain or certain several carries out wearing use.When carrying out data acquisition, due to a variety of
Electricity physiological signal will produce noise jamming between each other during synchronous acquisition, and the utility model is adopted in the fusion of initial data
Using the data preprocessing methods such as dry, standardization and normalization are removed during collection, the noise jamming between data can be effectively removed,
Improve the accuracy to subject's psychology and emotional state analysis.
Behavior acquisition module therein is video capture device, facial expression, eye movement and voice for recording subject
Behavioral data, and be transferred to background processor and analyzed.
As shown in figure 3, multiple data acquisition units and corresponding multiple data can be arranged in the utility model in systems
Display unit, multiple data acquisition units and multiple data display units realize data transmission with same background processor respectively,
Storage and Synchronization Analysis are carried out to the gathered data of each data acquisition unit respectively, number can be carried out at the same time to multiple subjects
According to acquisition, the storage and analysis of data can be synchronously completed by a background processor equipment, then passes through corresponding video
Display equipment externally show the acquired original data of each subject, on-line analysis result, multi-modal data gatherer process with
And test environment etc. of subject when testing residing for it, synchronously complete the on-line analysis to several subjects.
Most preferably, can in different rooms using corresponding data acquisition unit to different subjects into line number
According to acquisition, as shown in figs. 1 and 3, video display apparatus is in be arranged in a one-to-one correspondence with data acquisition unit.Data acquisition each in this way
Unit corresponds to a subject, and data acquisition situation is carried out externally by corresponding video decoding end 7 by data display unit 5
Publication contributes to main examination side to carry out video observation to different subjects simultaneously.
Certainly, data fusion acquisition system provided by the utility model is used to not only the choosing in the special post of some industries
It pulls out, regularly data can also be carried out to the staff in a certain post and are acquired, ensure that the safety of this post work is carried out；
It is also applied for carrying out the elderly or children the acquisition of cognition data, energy is comprehensive, accurately makes the state of mind of subject
Analysis test and appraisal.
Obviously, the above embodiments are merely examples for clarifying the description, and does not limit the embodiments.It is right
For those of ordinary skill in the art, can also make on the basis of the above description it is other it is various forms of variation or
It changes.There is no necessity and possibility to exhaust all the enbodiments.And it is extended from this it is obvious variation or
Among the protection domain that variation is created still in the utility model.
Claims (10)
1. a kind of multi-modal physiology and behavioral data merge acquisition system, which is characterized in that the system comprises background processors
And data acquisition unit, the background processor are integrated in a computer, are adopted for receiving the data acquisition unit
The data of collection, the data acquisition unit include:
Physiological acquisition module is connect with the background processor, produced by acquiring subject's completion test assignment in the process
Neuro-physiological data；
Behavior acquisition module is connect with the background processor, is produced during completing test assignment for acquiring subject
Raw behavioral data data；
The background processor includes data memory module, tfi module and data analysis module, the data memory module with
The physiological acquisition module and behavior acquisition module realize data connection, collected physiological data and behavior number for receiving
According to data；The tfi module be used for by institute collected physiological data and behavioral data sequentially in time store arrive it is described
In data memory module；The data analysis module is used for the physiological data and behavioral data money in the data memory module
Material is analyzed, and obtains analysis result online.
2. multi-modal physiology according to claim 1 and behavioral data merge acquisition system, which is characterized in that the data
Memory module is equipped with multiple data storage areas, and the data memory module acquires the various data in the data acquisition unit
The collected data of module institute carry out classification storage, and the data analysis module synchronizes on-line analysis to each data.
3. multi-modal physiology according to claim 2 and behavioral data merge acquisition system, which is characterized in that the system
Further include data display unit, connect with the background processor, for externally showing the original of the data acquisition unit
The on-line analysis result of gathered data and the background processor.
4. multi-modal physiology according to claim 3 and behavioral data merge acquisition system, which is characterized in that the data
Collecting unit further includes environment acquisition module, for acquiring subject's residing external environment data in test, after described
Platform processor realizes data connection.
5. multi-modal physiology according to claim 1 and behavioral data merge acquisition system, which is characterized in that the physiology
Acquisition module includes brain electric data collecting equipment, electrocardio-data collection equipment, skin pricktest data acquisition equipment, blood pressure data acquisition
Equipment, breath data collecting device, temperature data collecting device and one kind in myoelectricity data acquisition equipment and several.
6. multi-modal physiology according to claim 1 and behavioral data merge acquisition system, which is characterized in that the row
It is video capture device for acquisition module, for recording the facial expression of subject, the behavioral data of eye movement and voice.
7. multi-modal physiology according to claim 3 or 4 and behavioral data merge acquisition system, which is characterized in that described
Be equipped with multiple data acquisition units in system, multiple data acquisition units respectively with the same background processor
Realize data transmission.
8. multi-modal physiology according to claim 7 and behavioral data merge acquisition system, which is characterized in that the behavior
Acquisition module realizes data transmission by wireless with the background processor respectively with the physiological acquisition module.
9. multi-modal physiology according to claim 8 and behavioral data merge acquisition system, which is characterized in that the system
In be equipped with multiple data display units, the data display unit connects one to one with the data acquisition unit.
10. multi-modal physiology according to claim 9 and behavioral data merge acquisition system, which is characterized in that the number
It is video display apparatus according to display unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201720738585.6U CN207912695U (en) | 2017-06-22 | 2017-06-22 | A kind of multi-modal physiology and behavioral data merge acquisition system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201720738585.6U CN207912695U (en) | 2017-06-22 | 2017-06-22 | A kind of multi-modal physiology and behavioral data merge acquisition system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN207912695U true CN207912695U (en) | 2018-09-28 |
Family
ID=63611445
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201720738585.6U Active CN207912695U (en) | 2017-06-22 | 2017-06-22 | A kind of multi-modal physiology and behavioral data merge acquisition system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN207912695U (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107137096A (en) * | 2017-06-22 | 2017-09-08 | 中国科学院心理研究所 | A kind of multi-modal physiology and behavioral data merge acquisition system |
-
2017
- 2017-06-22 CN CN201720738585.6U patent/CN207912695U/en active Active
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107137096A (en) * | 2017-06-22 | 2017-09-08 | 中国科学院心理研究所 | A kind of multi-modal physiology and behavioral data merge acquisition system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107137096A (en) | A kind of multi-modal physiology and behavioral data merge acquisition system | |
| CN103584919B (en) | Multi-modal bio signal synchronous detecting system and method | |
| EP2698112B1 (en) | Real-time stress determination of an individual | |
| CN103006195A (en) | Non-contact vital sign data monitoring system and non-contact vital sign data monitoring method on basis of image processing | |
| CN103315753A (en) | Portable sentiment analyzer and sentiment analysis method | |
| CN109124655A (en) | State of mind analysis method, device, equipment, computer media and multifunctional chair | |
| US20210022636A1 (en) | Bio-signal detecting headband | |
| CN103294192A (en) | LED lamp switch control device and control method thereof based on motor imagery | |
| CN205181379U (en) | Bowel sound monitoring management system | |
| Majumder et al. | A real-time cardiac monitoring using a multisensory smart IoT system | |
| RU2657966C2 (en) | Device and method for remote wireless diagnostics of the functional state of the cardiovascular system of human on the basis of motor activity and photoplethysmography | |
| CN207912695U (en) | A kind of multi-modal physiology and behavioral data merge acquisition system | |
| CN203408054U (en) | Multi-channel psychological analyzer based on Linux real-time operating system | |
| CN104809440A (en) | Abnormal sight stop recognizing and reminding method and device | |
| Yu et al. | Intelligent wearable system with motion and emotion recognition based on digital twin technology | |
| CN115421597B (en) | Brain-computer interface control method and system based on double-brain coupling characteristics | |
| CN108742548A (en) | A kind of visualization Traditional Chinese medicinal wrist drawing system and device | |
| CN112932508B (en) | Finger activity recognition system based on arm electromyography network | |
| CN204759445U (en) | Unusual eyeball pivoted discernment and reminding device | |
| CN114903445A (en) | Intelligent monitoring and early warning system for cardiovascular and cerebrovascular diseases | |
| Shabnam et al. | IoT based health monitoring using smart devices for medical emergency services | |
| CN110232976B (en) | Behavior identification method based on waist and shoulder surface myoelectricity measurement | |
| CN104809439A (en) | Abnormal nictation recognizing and reminding method and device | |
| CN110781719A (en) | Non-contact and contact cooperative mental state intelligent monitoring system | |
| GB2605121A (en) | An electronics module for a wearable articel, a systemm, and a method of activation of an electronics module for a wearable article |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220505 Address after: Room 208, second floor, building 13, yard 53, Yanqi street, Yanqi Economic Development Zone, Huairou District, Beijing Patentee after: Beijing Zhongke Xinyan Technology Co.,Ltd. Address before: 100101 Institute of psychology, Chinese Academy of Sciences, No.16 lincui Road, Chaoyang District, Beijing Patentee before: INSTITUTE OF PSYCHOLOGY, CHINESE ACADEMY OF SCIENCES |
|
| TR01 | Transfer of patent right |