CN211633314U - Signal acquisition device for emotion recognition - Google Patents
Signal acquisition device for emotion recognition Download PDFInfo
- Publication number
- CN211633314U CN211633314U CN202020188452.8U CN202020188452U CN211633314U CN 211633314 U CN211633314 U CN 211633314U CN 202020188452 U CN202020188452 U CN 202020188452U CN 211633314 U CN211633314 U CN 211633314U
- Authority
- CN
- China
- Prior art keywords
- acquisition device
- processing module
- signal
- signal processing
- electroencephalogram
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The utility model relates to a signal acquisition device for emotion recognition. The output end of an eye movement instrument of the signal acquisition device is connected with the input end of an eye movement signal processing module, and the output end of the eye movement signal processing module is connected with the first input end of a computer; the output end of the electroencephalogram acquisition device is connected with the input end of the electroencephalogram signal processing module, and the output end of the electroencephalogram signal processing module is connected with the second input end of the computer; the output end of the skin electric signal processing module is connected with the third input end of the computer; the output end of the image acquisition equipment is connected with the fourth input end of the computer; the image acquisition equipment is used for acquiring a facial image of a user; the computer is used for synchronously receiving the eye movement signal, the brain electrical signal, the skin electrical signal and the face image. The utility model discloses can improve signal acquisition's the degree of accuracy and reality.
Description
Technical Field
The utility model relates to a signal acquisition field especially relates to a signal acquisition device for emotion recognition.
Background
With the development of artificial intelligence, the emotional interaction between a machine and a human becomes more and more important, the precondition of the emotional interaction is the acquisition of emotional signals and the emotional recognition, but the acquisition of accurate emotional signals is the basis for accurately performing the emotional recognition. At present, signals for emotion recognition are mainly physiological signals and behavior signals, wherein the physiological signals comprise electroencephalogram signals, skin electric signals, nuclear magnetic signals and the like, and the behavior signals mainly comprise facial expressions, voice, body postures and the like. The two types of signals have the advantages and the disadvantages respectively, the physiological signals are real and reliable, but the signals are in the body and are difficult to acquire complete signals. The behavioral signals are easy to collect but easy to disguise and hide. Therefore, in order to improve the accuracy of emotion recognition, many studies have been made on emotion recognition using a multimodal signal. For example, Koelstra and Patras fuse facial expressions and electroencephalogram signals for emotion recognition. Xu et al studied the influence of human body movement on emotion recognition by using physiological signals such as electroencephalogram, electrodermal, and electromyogram. However, the existing behavior data (such as facial expressions and voices) are extremely easy to disguise due to the strong subjectivity of the testers, so that real data are not easy to collect, and the existing physiological signals are weak due to the existence in the body, so that complete signals are difficult to collect.
SUMMERY OF THE UTILITY MODEL
The utility model aims at providing a signal acquisition device for emotion recognition to improve signal acquisition's the degree of accuracy and truth.
In order to achieve the above object, the utility model provides a following scheme:
a signal acquisition device for emotion recognition, comprising: the system comprises an eye tracker, an electroencephalogram acquisition device, a skin electricity acquisition device, an image acquisition device, an eye movement signal processing module, an electroencephalogram signal processing module, a skin electric signal processing module and a computer;
the output end of the eye tracker is connected with the input end of the eye movement signal processing module, and the output end of the eye movement signal processing module is connected with the first input end of the computer; the eye tracker is used for collecting eye movement signals of a user;
the output end of the electroencephalogram acquisition device is connected with the input end of the electroencephalogram signal processing module, and the output end of the electroencephalogram signal processing module is connected with the second input end of the computer; the electroencephalogram acquisition device is used for acquiring electroencephalogram signals of a user;
the output end of the skin electric signal processing module is connected with the third input end of the computer; the skin electricity acquisition device is used for acquiring skin electric signals of a user;
the output end of the image acquisition equipment is connected with the fourth input end of the computer; the image acquisition equipment is used for acquiring a facial image of a user;
the computer is used for synchronously receiving the eye movement signal, the brain electrical signal, the skin electrical signal and the facial image.
Optionally, the eye movement signal collected by the eye movement instrument is a pupil diameter signal.
Optionally, the eye tracker is mounted below a display screen of the computer through an adsorption mounting bracket; the eye tracker is a Tobii X3-120 type telemetering screen type eye tracker, and the sampling rate is 120 Hz.
Optionally, the eye movement signal processing module processes the eye movement signal collected by the eye movement instrument through a DEA series band-pass filter of the TDK.
Optionally, the electroencephalogram acquisition device is a Neuroscan-type 32-lead electroencephalogram electrode cap, and the sampling frequency is 512 HZ.
Optionally, the electroencephalogram signal processing module is Neuroscan SynAmps type electroencephalogram amplifier equipment.
Optionally, the skin electricity collecting device is an HKR-11C skin resistance sensor of the Huake department.
Optionally, the skin electrical signal processing module includes a microcontroller and an a/D converter, and the skin electrical signal processing module is configured to perform a/D conversion on the skin electrical signal acquired by the skin electrical acquisition device.
Optionally, the image acquisition device is a camera device, and the image acquisition device is connected to the computer through a USB interface.
According to the utility model provides a concrete embodiment, the utility model discloses a following technological effect:
the utility model discloses introduce the eye and move the appearance and gather the eye and move the signal, when the emotion changes, corresponding change will take place for the pupil diameter of participant, and pupil data is difficult for disguising and easily gathers, can more true effectual reaction participant's emotional state. Meanwhile, electroencephalogram signals, skin electric signals and facial expression information are synchronously acquired by combining the electroencephalogram acquisition device, the skin electric acquisition device and the camera, physiological and behavior data are fused, the emotional states of the participants are acquired from multiple aspects, so that the accuracy and the truth of signal acquisition are improved, the limitation of later emotion recognition process caused by single data is avoided, and the accuracy of subsequent emotion recognition is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without inventive labor.
FIG. 1 is a schematic structural diagram of a signal acquisition device for emotion recognition according to the present invention;
fig. 2 is a schematic diagram of the signal acquisition device for emotion recognition in use.
Detailed Description
The technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments in the present invention, all other embodiments obtained by a person skilled in the art without creative work belong to the protection scope of the present invention.
In order to make the above objects, features and advantages of the present invention more comprehensible, the present invention is described in detail with reference to the accompanying drawings and the detailed description.
Fig. 1 is the utility model discloses a signal acquisition device's for emotion recognition structural schematic diagram, as shown in fig. 1, the utility model discloses a signal acquisition device includes: the system comprises an eye movement instrument 1, an electroencephalogram acquisition device 2, a skin electricity acquisition device 3, an image acquisition device 4, an eye movement signal processing module 5, an electroencephalogram signal processing module 6, a skin electricity signal processing module 7 and a computer 8.
The output end of the eye tracker 1 is connected with the input end of the eye movement signal processing module 5, and the output end of the eye movement signal processing module 5 is connected with the first input end of the computer 8. The eye tracker 1 is used for collecting eye movement signals of a user. As a specific example, the eye tracker can adopt a Tobii X3-120 type telemetering screen type eye tracker, the sampling rate is 120Hz, the size is 324X 20X 17mm, the weight is 118g, the head moving range is 50cm X40 cm in width, the operation adjustable distance is 50-90 cm, and the eye tracker has the advantages of small volume, light weight, large head moving range and large operation adjustability. Fig. 2 is a schematic diagram of the signal acquisition device for emotion recognition in use. As shown in fig. 2, the eye tracker 1 is mounted on the lower position of the display screen of the computer 8 through the adsorption mounting bracket, so that the eyes can be automatically collected in real time, and the efficiency of eye tracking research is improved. The signals collected by the eye tracker 1 include raw signals such as eye position data, time data, pupil diameter data, and the like. The eye movement signal processing module 5 firstly reads the original data collected by the eye movement instrument 1, then separates out pupil diameter signals according to the read data labels, further filters noise signals of the pupil diameter signals by using a filter, and finally outputs the pupil diameter signals through the eye movement signal processing module 5 and transmits the pupil diameter signals to the computer 8. As a specific example, the eye movement signal processing module 5 may employ a DEA series band pass filter of TDK.
The output end of the electroencephalogram acquisition device 2 is connected with the input end of the electroencephalogram signal processing module 6, and the output end of the electroencephalogram signal processing module 6 is connected with the second input end of the computer 8. The electroencephalogram acquisition device 2 is used for acquiring electroencephalogram signals of a user. As a specific embodiment, the electroencephalogram acquisition device 2 can use a 32-lead electroencephalogram electrode cap of Neuroscan, the sampling frequency is 512HZ, the electrode is made of Ag/AgCl, the electrode is fixed on the elastic cap based on an international 10-20 system, and the electroencephalogram acquisition device is very suitable for measuring signals with weak signals and low frequency, such as electroencephalogram. The brain electrode cap is connected to the input end of the analog signal of the brain electrical signal processing module 6 through a lead according to the corresponding electrode position. The EEG signal processing module 6 can adopt Neuroscan SynAmps EEG amplifier equipment, can carry out signal amplification and impedance detection, can carry out 16-bit A/D conversion and digital isolation simultaneously, and finally the EEG signal processing module 6 outputs the processed EEG signal and transmits the EEG signal to the computer 8.
The output end of the skin electricity acquisition device 3 is connected with the input end of the skin electric signal processing module 7, and the output end of the skin electric signal processing module 7 is connected with the third input end of the computer 8. The skin electricity collecting device 3 is used for collecting skin electric signals of a user. As a specific embodiment, the skin electricity acquisition device 3 can adopt a HKR-11C skin resistance sensor of the Huake, the sensor adopts an external current excitation mode to measure the resistance change signal of the skin of the human body, the sensor adopts a precise operational amplifier to output high-precision physical quantity skin resistance change data, and the skin electricity acquisition device has the characteristics of small volume, convenient measurement and the like. In use, as shown in fig. 2, one end of the skin electricity collecting device 3 is sleeved on the index finger and the middle finger of the left hand of the user to collect the skin electric signals of the finger tip, and the other end is connected to the analog signal input end of the skin electric signal processing module 7. The skin electric signal processing module 7 is used for performing a/D conversion on the skin electric signal, converting the analog signal into a digital signal which can be recognized by the computer 8, and transmitting the digital signal to the computer 8. As a specific example, the cutaneous electrical signal processing module 7 may employ a device in which a P87LPC767FD low power microcontroller is integrated with a 4 byte OTP 8 bit a/D converter.
The output end of the image acquisition device 4 is connected with the fourth input end of the computer 8. The image capturing device 4 is used to capture a facial image of a user. As a specific example, the image capturing device 4 may employ a camera containing 800 ten thousand physical pixels of a sony chip, which is UVC-compatible drive-free and connectable to the computer 8 through a USB interface. The resolution is 4k, the frame rate is 1080P30, the frame picture is synchronous without delay, 3D digital noise reduction is adopted, and the method has the characteristics of high resolution, high frame rate, low noise, automatic focusing and the like.
The computer 8 is used for synchronously receiving the eye movement signal, the brain electrical signal, the skin electrical signal and the facial image, so as to finish the collection of the emotion signals of the user.
Adopt the utility model discloses a signal acquisition device can provide accurate signal for follow-up emotion recognition, emotion analysis, and many-sided judgement participant's emotional state avoids the later stage emotion recognition limitation of single data, improves follow-up emotion recognition's exactness.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
The principle and the implementation of the present invention are explained herein by using specific examples, and the above description of the embodiments is only used to help understand the method and the core idea of the present invention; meanwhile, for the general technical personnel in the field, according to the idea of the present invention, there are changes in the concrete implementation and the application scope. In summary, the content of the present specification should not be construed as a limitation of the present invention.
Claims (9)
1. A signal acquisition device for emotion recognition, comprising: the system comprises an eye tracker, an electroencephalogram acquisition device, a skin electricity acquisition device, an image acquisition device, an eye movement signal processing module, an electroencephalogram signal processing module, a skin electric signal processing module and a computer;
the output end of the eye tracker is connected with the input end of the eye movement signal processing module, and the output end of the eye movement signal processing module is connected with the first input end of the computer; the eye tracker is used for collecting eye movement signals of a user;
the output end of the electroencephalogram acquisition device is connected with the input end of the electroencephalogram signal processing module, and the output end of the electroencephalogram signal processing module is connected with the second input end of the computer; the electroencephalogram acquisition device is used for acquiring electroencephalogram signals of a user;
the output end of the skin electric signal processing module is connected with the third input end of the computer; the skin electricity acquisition device is used for acquiring skin electric signals of a user;
the output end of the image acquisition equipment is connected with the fourth input end of the computer; the image acquisition equipment is used for acquiring a facial image of a user;
the computer is used for synchronously receiving the eye movement signal, the brain electrical signal, the skin electrical signal and the facial image.
2. The signal acquisition device for emotion recognition according to claim 1, wherein the eye movement signal acquired by the eye tracker is a pupil diameter signal.
3. The signal acquisition device for emotion recognition according to claim 1, wherein the eye tracker is mounted at a position below a display screen of the computer by a suction-type mounting bracket; the eye tracker is a Tobii X3-120 type telemetering screen type eye tracker, and the sampling rate is 120 Hz.
4. The signal acquisition device for emotion recognition according to claim 1, wherein the eye movement signal processing module processes the eye movement signal acquired by the eye tracker through a DEA series band pass filter of TDK.
5. The signal acquisition device for emotion recognition according to claim 1, wherein the electroencephalogram acquisition device is a Neuroscan type 32-lead electroencephalogram electrode cap, and the sampling frequency is 512 HZ.
6. The signal acquisition device for emotion recognition according to claim 1, wherein said electroencephalogram signal processing module is a Neuroscan SynAmps type electroencephalogram amplifier device.
7. The signal acquisition device for emotion recognition according to claim 1, wherein the electrodermal acquisition device is a HKR-11C skin resistance sensor of the chinese family.
8. The signal acquisition device for emotion recognition according to claim 1, wherein the skin electric signal processing module comprises a microcontroller and an A/D converter, and the skin electric signal processing module is used for A/D converting the skin electric signal acquired by the skin electric signal acquisition device.
9. The signal acquisition device for emotion recognition according to claim 1, wherein the image acquisition apparatus is a camera device, and the image acquisition apparatus is connected to the computer through a USB interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202020188452.8U CN211633314U (en) | 2020-02-20 | 2020-02-20 | Signal acquisition device for emotion recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202020188452.8U CN211633314U (en) | 2020-02-20 | 2020-02-20 | Signal acquisition device for emotion recognition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN211633314U true CN211633314U (en) | 2020-10-09 |
Family
ID=72684805
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202020188452.8U Active CN211633314U (en) | 2020-02-20 | 2020-02-20 | Signal acquisition device for emotion recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN211633314U (en) |
-
2020
- 2020-02-20 CN CN202020188452.8U patent/CN211633314U/en active Active
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109730701B (en) | Emotion data acquisition method and device | |
| CN103006195B (en) | Non-contact vital sign data monitoring system and non-contact vital sign data monitoring method on basis of image processing | |
| CN105769173B (en) | A kind of cardioelectric monitor system with electrocardiosignal noise removal function | |
| CN111553307A (en) | Gesture recognition system fusing bioelectrical impedance information and myoelectric information | |
| CN103315753A (en) | Portable sentiment analyzer and sentiment analysis method | |
| CN101352336A (en) | Long time dynamic cardiac electric recording apparatus an with sport information acquisition | |
| CN104850231A (en) | Man-machine interface system based on fusion of surface electromyography (EMG) and myocrismus signals | |
| CN109717866A (en) | A kind of disturbance of consciousness diagnostic method based on EEG signals | |
| CN101879062B (en) | Surface electromyograph, surface electromyography module and measuring method | |
| CN211633314U (en) | Signal acquisition device for emotion recognition | |
| CN208511016U (en) | A kind of vital sign comprehensive detection analysis system | |
| CN100348151C (en) | Electroencephalogram signal amplifier for portable event related brain potentiometer | |
| CN207037600U (en) | A kind of Sign Language Recognition translates armlet | |
| CN210348066U (en) | Portable glasses intelligence wearing equipment | |
| CN2753290Y (en) | Event-related potential instrument for collecting human neurobiological electric signal | |
| CN202636935U (en) | Brainwave detector with voice prompt module | |
| CN110751060B (en) | Portable motion mode real-time identification system based on multi-source signals | |
| KR20190103626A (en) | A portable ECG electrode and an ECG measurement system for small animals | |
| CN202136338U (en) | Electronic interactive sand table device | |
| CN1771883A (en) | Brain wave signal measuring system with mobile communication terminal | |
| CN1778272A (en) | Portable event related potentiometer | |
| CN105310648A (en) | Sleep meter for monitoring sleep state of human body in real time | |
| CN207867530U (en) | Signal processing apparatus and system | |
| CN201200408Y (en) | Lie detector with function for detecting brain electricity | |
| CN110232976B (en) | Behavior identification method based on waist and shoulder surface myoelectricity measurement |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |