CN113349779A - Portable psychological test robot and implementation method thereof - Google Patents
Portable psychological test robot and implementation method thereof Download PDFInfo
- Publication number
- CN113349779A CN113349779A CN202110620732.0A CN202110620732A CN113349779A CN 113349779 A CN113349779 A CN 113349779A CN 202110620732 A CN202110620732 A CN 202110620732A CN 113349779 A CN113349779 A CN 113349779A
- Authority
- CN
- China
- Prior art keywords
- tested person
- real time
- question
- person
- tested
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 67
- 238000000034 method Methods 0.000 title claims description 43
- 230000006461 physiological response Effects 0.000 claims abstract description 35
- 230000007246 mechanism Effects 0.000 claims abstract description 31
- 230000008921 facial expression Effects 0.000 claims abstract description 28
- 230000014509 gene expression Effects 0.000 claims abstract description 16
- 230000004044 response Effects 0.000 claims description 44
- 230000003304 psychophysiological effect Effects 0.000 claims description 40
- 230000008569 process Effects 0.000 claims description 21
- 239000008280 blood Substances 0.000 claims description 15
- 210000004369 blood Anatomy 0.000 claims description 15
- 239000000126 substance Substances 0.000 claims description 13
- 238000004458 analytical method Methods 0.000 claims description 12
- 230000003340 mental effect Effects 0.000 claims description 9
- 230000008859 change Effects 0.000 claims description 5
- 230000002159 abnormal effect Effects 0.000 claims description 3
- 230000017531 blood circulation Effects 0.000 claims description 3
- 230000003993 interaction Effects 0.000 claims description 3
- 230000006870 function Effects 0.000 abstract description 5
- 230000036772 blood pressure Effects 0.000 description 5
- 238000001514 detection method Methods 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 210000001015 abdomen Anatomy 0.000 description 2
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 2
- 230000001149 cognitive effect Effects 0.000 description 2
- 239000012141 concentrate Substances 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- 238000012905 input function Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 229910052760 oxygen Inorganic materials 0.000 description 2
- 239000001301 oxygen Substances 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 239000011449 brick Substances 0.000 description 1
- 230000019771 cognition Effects 0.000 description 1
- 238000011840 criminal investigation Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 230000002996 emotional effect Effects 0.000 description 1
- 230000006996 mental state Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008560 physiological behavior Effects 0.000 description 1
- 238000004445 quantitative analysis Methods 0.000 description 1
- 230000011514 reflex Effects 0.000 description 1
- 230000000241 respiratory effect Effects 0.000 description 1
- 230000029058 respiratory gaseous exchange Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Psychiatry (AREA)
- Engineering & Computer Science (AREA)
- Educational Technology (AREA)
- Biomedical Technology (AREA)
- Hospice & Palliative Care (AREA)
- Psychology (AREA)
- Social Psychology (AREA)
- Physics & Mathematics (AREA)
- Child & Adolescent Psychology (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Developmental Disabilities (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The invention provides a portable psychological test robot, which comprises a psychological tester, a sensor combination mechanism, a video acquisition device and an audio acquisition device, wherein the psychological tester is connected with the sensor combination mechanism; after the fingers of the person to be tested are fixed, the sensor combination mechanism collects a plurality of physiological response data of the person to be tested when the organism is stimulated in real time; the video acquisition equipment captures the physical motion condition and the facial expression of the detected person in real time; the audio acquisition equipment captures the sound of the tested person in real time; the psychological tester plays the tested person one by one through voice according to the pre-compiled questions and the corresponding list sequence thereof, receives real-time voice, physical movement conditions, facial expressions and a plurality of physiological response data when the tested person answers each question so as to judge whether the question answers of the tested person are qualified or not and judge the psychological and physiological response rate when all the question answers are qualified, and verifies the utterance expression of the tested person. By implementing the invention, the functions of the existing psychological tester can be conveniently realized and the problems can be solved.
Description
Technical Field
The invention relates to the technical field of robots and artificial intelligence, in particular to a portable psychological test robot and an implementation method thereof.
Background
The lie detection is not to detect the lie itself, but to deduce whether the person to be detected has emotional and cognitive response abnormalities in the response of some questions through measuring various physiological behavior response indexes. In china, the formal name for lie detection is "psychological test", which is implemented by multiple psychological testers.
The multichannel psychological tester is also called as a multi-lead physiological recorder, and the working process of the multichannel psychological tester is specifically as follows: the method comprises the steps that a tester firstly connects various sensors including skin electricity, respiration, blood oxygen saturation, blood pressure and the like to a tested person, then talks before testing so as to enable the tested person to enter a preparation state, then calls a pre-programmed test question to start questioning, and observes behavior and physiological reaction of the tested person in the questioning process. The compiled titles are all related to the investigated case (event). After the tested person hears the question, a short positive or negative answer can be selected, for example, "yes", "no" or "unclear" or "unknown", the tested person can carefully observe and analyze the physiological response data after the tested person answers, the process is mostly ten seconds, the physiological signal of the tested person is stable or returns to a relatively calm level, and the next question is continuously asked. Meanwhile, in the process of questioning, certain questions need to be questioned repeatedly (for example, three rounds may be performed before and after), and each round of questions is rested for a few minutes midway, so that the total time of the process can reach more than two hours. Thus, by nature, current multichannel psychological testers are "physiological monitoring" devices.
However, the existing multi-channel psychological testers have many requirements in use, such as: (1) the sensor connection is complicated and the operation requires experience, resulting in a long time for the operation. For example, various sensor leads need to be connected before formal testing. Wherein, the skin electric channel is generally connected to the finger pulp of two fingers by two wires connected with the electrode patch; the respiratory channel is mainly provided with two pressure sensing belts which are respectively connected with the chest and the abdomen of the person to be detected; the blood pressure channel is measured by a pressure sensor tied on the arm or the finger abdomen of the tested person; blood oxygen and heart rate are measured by clamping a finger with a clamp and measuring the blood volume of the finger through the reflected signal of light. Assuming that brain event related potentials exist as test parameters, a multi-lead electroencephalogram cap needs to be worn. (2) The whole process needs professional participation, the specialty is strong, the accuracy of the psychological test technology is guaranteed, and meanwhile the use and popularization of the psychological test technology are seriously affected. For example, the number of professional testers full of the country is small (no more than three hundred people according to incomplete statistics), and the full lie detection process requires the full-time testers to perform question making, sensor connection, pre-test talking, formal application and test and data analysis according to cases, so that the whole work is long and tedious, and the test burden of the full-time testers is too heavy and the efficiency is too low. (3) The test process and result judgment are highly subjective. For example, the main lie detection process is to sequentially inquire according to a fixed subject sequence and record the answers and physiological responses of the person to be detected (recorded by the fact that the tester operates the lie detector), but the testing process and data analysis have obvious personal styles due to different styles of different testers, and the physical and mental states, concepts and prejudices of the testers influence the objectivity and accuracy of the test.
Therefore, there is a need for a portable robot for psychological tests, which can conveniently implement the functions of the existing multi-channel psychological test apparatus and solve the above-mentioned problems.
Disclosure of Invention
The technical problem to be solved by the embodiment of the invention is to provide a portable psychological test robot and an implementation method thereof, which can conveniently implement the functions of the existing multi-channel psychological test instrument and solve the existing problems.
In order to conveniently realize the functions of the conventional multi-channel psychological test instrument and solve the technical problems, the embodiment of the invention provides a portable psychological test robot which comprises a psychological test instrument, a sensor combination mechanism, a video acquisition device and an audio acquisition device, wherein the sensor combination mechanism, the video acquisition device and the audio acquisition device are respectively connected with the psychological test instrument; wherein the content of the first and second substances,
the sensor combination mechanism is formed by a plurality of sensors integrated in the same device and is used for collecting a plurality of physiological response data of the tested person when the organism of the tested person is stimulated in real time after the fingers of the tested person are fixed;
the video acquisition equipment is used for capturing the physical motion condition and the facial expression of the detected person in real time;
the audio acquisition equipment is used for capturing the sound of the tested person in real time;
the psychological tester is used for playing the tested person one by one through voice according to the pre-compiled questions and the corresponding list sequence thereof, receiving the sound captured in real time by the audio acquisition equipment, the body motion condition and the facial expression captured in real time by the video acquisition equipment and a plurality of physiological response data captured in real time by the sensor combination mechanism when the tested person answers each question, so as to judge whether each question answer of the tested person is qualified or not and judge the psychological response rate of the tested person when all the question answers are qualified, and further verifying the utterance expression of the tested person according to the psychological response rate.
The psychological tester comprises a question playing module, a question testing and analyzing module and a comprehensive analyzing module; wherein the content of the first and second substances,
the question playing module is used for playing the questions and the corresponding list sequence thereof one by one through voice according to the pre-programmed questions and the corresponding list sequence;
the question testing and analyzing module is used for receiving the sound captured by the audio acquisition equipment in real time, the physical motion condition and the facial expression captured by the video acquisition equipment in real time and a plurality of physiological response data collected by the sensor combination mechanism in real time when the tested person answers each question so as to judge whether each question answer of the tested person is qualified or not and judge the psychophysiological response rate of the tested person when all the question answers are qualified;
and the comprehensive analysis module is used for verifying the utterance expression of the tested person according to the psychophysiological response rate.
The question test analysis module comprises a data receiving submodule, a question reply judging submodule and a psychophysiological reaction rate calculating submodule; wherein the content of the first and second substances,
the data receiving submodule is used for receiving the sound captured by the audio acquisition equipment in real time, the physical motion condition and the facial expression captured by the video acquisition equipment in real time and a plurality of physiological response data captured by the sensor combination mechanism in real time when the tested person answers each question;
the question answer judging submodule is used for judging whether each question answer of the tested person is qualified or not by using a voice recognition technology; if the answer of each question of the tested person is judged to be a positive answer or a negative answer, the answer of each question of the tested person is determined to be qualified, and marking is carried out; if the tested person is judged to be other explanations except positive and negative answers when each question is answered, prompting the tested person to answer only positive or negative, and marking the tested person until the answer of the tested person is changed into positive or negative answer;
and the psychophysiological response rate calculating submodule is used for scoring a plurality of physiological response data acquired by the sensor combination mechanism in real time by combining the body motion condition and the facial expression captured by the video acquisition equipment in real time when all the answers of the tested personnel are qualified, so as to obtain the psychophysiological response rate.
The comprehensive analysis module comprises a lie-confirmation submodule and an un-lie-confirmation submodule; wherein the content of the first and second substances,
the lie-identifying submodule is used for identifying that the utterance expression of the detected person is abnormal if the psychophysiological response rate is greater than a preset threshold value;
and the non-lying identification submodule is used for identifying that the utterance expression of the detected person is normal if the psychophysiological response rate is smaller than the preset threshold value.
The psychological tester is also provided with a display module connected with the psychological tester; wherein the content of the first and second substances,
the display module can be integrated with the psychological tester or designed separately, and is used for displaying a human-computer interaction interface and realizing the pre-input and compilation of questions and list sequences thereof.
Wherein the plurality of sensors integrated in the sensor assembly mechanism comprise a galvanic skin sensor and a blood volume sensor; wherein the content of the first and second substances,
the skin electric sensor is used for acquiring skin resistance or current value of skin electric conduction change of a tested person body when the tested person body is stimulated in real time;
the blood volume sensor is used for acquiring blood flow changes of a tested person in a testing process in real time and calculating heart rate changes.
The video acquisition equipment is a camera; the audio acquisition device is a microphone.
The embodiment of the invention also provides a method for realizing the portable psychological test robot, which is realized on the portable psychological test robot, and the method comprises the following steps:
after the finger of the person to be detected is fixed, the sensor combination mechanism collects a plurality of physiological response data of the person to be detected when the organism is stimulated in real time;
the video acquisition equipment captures the physical motion condition and the facial expression of the detected person in real time;
the audio acquisition equipment captures the sound of the tested person in real time;
the psychological tester plays the tested person one by one through voice according to the pre-compiled questions and the corresponding list sequence thereof, receives the sound captured in real time by the audio acquisition equipment, the physical motion condition and the facial expression captured in real time by the video acquisition equipment and a plurality of physiological response data captured in real time by the sensor combination mechanism when the tested person answers each question so as to judge whether each question answer of the tested person is qualified or not and judge the psychophysiological response rate of the tested person when all the question answers are qualified, and further verifies the expression of the tested person according to the psychophysiological response rate.
Wherein the physiological response data includes a skin resistance value and a blood volume.
Wherein the method further comprises:
and on the psychological tester, questions and corresponding list sequences are compiled in advance.
The embodiment of the invention has the following beneficial effects:
1. on one hand, the invention concentrates all important contact sensors (such as a skin electric sensor and a blood volume sensor) in the same device and can be used in a 'plug-and-play' mode by fixing the finger position of a person to be detected; on the other hand, the non-contact video acquisition equipment and the non-contact audio acquisition equipment are adopted to respectively acquire visual and sound signals (such as the physical movement condition, facial expression and sound of the detected person), so that the operation is very simple, the 'constrained feeling' of the detected person can be reduced to the maximum extent, and the operation is more friendly;
2. the invention integrates the analysis of connection, question editing (such as pre-edited questions and corresponding list sequence), test (such as voice one by one played by the tested person, and judging whether each question answer of the tested person is qualified or not and the psychophysiological response rate of the tested person when all the question answers are qualified) and final result (such as determining whether the tested person lies or not according to the psychophysiological response rate) into a set of standardized flow, so that a user can quickly and easily master and apply to an actual scene, the working intensity of the tested person can be effectively and obviously reduced, and the test accuracy can be ensured to the maximum extent. The methods are all derived from the kernel of the robot for deep learning, and the expert experience is effectively converted into an intelligent method;
3. the testing process of the invention can be automatically realized by using a computer in principle, and can even be replaced in the whole process, so that a great amount of time and energy of testers can be saved, and the influence of subjective factors of the testers can be avoided, thereby reducing subjective participation in the aspects of operation and interpretation as much as possible through a standardized process, and ensuring the reliability and effectiveness of the test.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is within the scope of the present invention for those skilled in the art to obtain other drawings based on the drawings without inventive exercise.
Fig. 1 is a schematic structural diagram of a portable psychological test robot according to an embodiment of the present invention;
FIG. 2 is a schematic view of a configuration of the central test meter of FIG. 1;
FIG. 3 is another schematic structural view of the central test meter of FIG. 1;
fig. 4 is a flowchart of a method for implementing the portable mental test robot according to the embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail with reference to the accompanying drawings.
As shown in fig. 1, a portable psychological test robot proposed in the embodiment of the present invention includes a psychological tester 4, a sensor combination mechanism 1, a video capture device 2, and an audio capture device 3, which are respectively connected to the psychological tester 4; wherein the content of the first and second substances,
the sensor combination mechanism 1 is formed by a plurality of sensors (including but not limited to a skin electric sensor and a blood volume sensor) integrated in the same device and is used for acquiring a plurality of physiological response data of the tested person when the tested person body is stimulated in real time after the tested person finger is fixed; the physiological response data includes, but is not limited to, skin resistance values and blood volume. For example, a skin electric sensor collects the skin resistance value or the current value of the skin electric conduction change when the body of a tested person is stimulated in real time; the blood volume sensor collects the blood flow change of a tested person in the testing process in real time and can calculate the heart rate change, such as blood volume;
the video acquisition equipment 2 is a camera and is used for capturing the physical motion condition and the facial expression of the detected person in real time;
the audio acquisition equipment 3 is a microphone and is used for capturing the sound of the tested person in real time;
the psychological tester 4 is used for playing the tested person one by one through voice according to the pre-compiled questions and the corresponding list sequence thereof, receiving the sound captured in real time by the audio acquisition equipment 3, the body motion condition and the facial expression captured in real time by the video acquisition equipment 2 and a plurality of physiological response data captured in real time by the sensor combination mechanism 1 when the tested person answers each question, so as to judge whether each question answer of the tested person is qualified or not and judge the psychophysiological response rate of the tested person when all the question answers are qualified, and further verifying the utterance expression of the tested person according to the psychophysiological response rate.
It should be noted that the pre-programmed questions can be designed according to the actual situation, and may include key questions, accompanying questions, etc.
In the embodiment of the present invention, as shown in fig. 2, the psychological tester 4 includes a question playing module 41, a question testing and analyzing module 42, and a comprehensive analyzing module 43; wherein the content of the first and second substances,
the question playing module 41 is used for playing the questions and the corresponding list sequence one by one through voice according to the pre-compiled questions and the corresponding list sequence;
the question test analysis module 42 is used for receiving the sound captured by the audio acquisition device 3 in real time, the physical motion condition and the facial expression captured by the video acquisition device 2 in real time and a plurality of physiological response data captured by the sensor combination mechanism 1 in real time when the tested person answers each question so as to judge whether each question answer of the tested person is qualified or not and the psychophysiological response rate of the tested person when all the question answers are qualified;
the question test analysis module 42 further includes a data receiving sub-module, a question reply judging sub-module and a psychophysiological reaction rate calculating sub-module; the data receiving submodule is used for receiving the sound captured by the audio acquisition equipment 3 in real time, the physical motion condition and the facial expression captured by the video acquisition equipment 2 in real time and a plurality of physiological response data captured by the sensor combination mechanism 1 in real time when the tested person answers each question; the question answer judging submodule is used for judging whether each question answer of the tested personnel is qualified or not by using a voice recognition technology; if the answer of each question of the tested person is judged to be a positive answer or a negative answer, the answer of each question of the tested person is determined to be qualified, and marking is carried out; if the tested person is judged to be other explanations except positive and negative answers when each question is answered, prompting the tested person to answer only positive or negative, and marking the tested person until the answer of the tested person is changed into positive or negative answer; and the psychophysiological response rate calculating submodule is used for scoring a plurality of physiological response data acquired by the sensor combination mechanism 1 in real time by combining the physical motion condition and the facial expression captured by the video acquisition equipment 2 in real time when all the answers of the tested personnel are qualified, so as to obtain the psychophysiological response rate.
And the comprehensive analysis module 43 is used for verifying the utterance expression of the detected person according to the psychophysiological response rate.
Wherein, the comprehensive analysis module 43 further comprises a lie-identifying submodule and a non-lie-identifying submodule; a lie-identifying submodule, configured to identify that the utterance expression of the detected person is abnormal, i.e., "lie", if the psychophysiological response rate is greater than a preset threshold (e.g., 50%); and the non-lying identification submodule is used for identifying that the detected person utters and expressions are normal if the psychophysiological response rate is less than a preset threshold (such as 50%), namely 'non-lying'.
In the embodiment of the present invention, the psychological tester 4 is further provided with a display module 44 connected with the psychological tester 4; the display module 44 may be integrated with the psychological tester 4 or separately designed to display a human-computer interface, and to implement the pre-input and compilation of questions and their listing sequence.
It is understood that, when the display module 44 is integrated with the psychological tester 4 (as shown in fig. 2), the display module 44 may be a touch-type liquid crystal display, and implements data display and touch-type data input functions. When the display module 44 is designed separately from the psychological tester 4 (as shown in fig. 3), the display module 44 may be a mobile phone, a tablet computer, or the like, and the data display and touch data input functions are realized in a wireless manner (such as bluetooth, WIFI, or the like).
The portable psychological test robot in the embodiment of the invention has the working principle that firstly, a skin electric sensor, a blood pressure sensor and a heart rate sensor which are integrated in the same device are fixed by fingers of a tested person, the skin resistance value, the blood pressure and the heart rate of the tested person when the organism of the tested person is stimulated are prepared to be collected in real time, and a video acquisition device 2 and an audio acquisition device 3 are started to prepare to capture the body motion condition, the facial expression and the sound of the tested person in real time.
Next, the psychological tester 4 is turned on, and the psychological tester 4 performs a human-computer interaction interface through the display module 44 (e.g., an integrated liquid crystal display or a separate mobile phone) in advance, and inputs and compiles questions and a list order thereof. Various cases are distinguished by taking criminal investigation scenes as an example, and specifically, the problems are compiled in two ways: firstly, a template is directly called, and a user can modify keywords on the basis of the template; secondly, matching keywords, such as a murder used in a certain killer scheme, inputting the keywords such as bricks, popping up the matched keywords by the system to provide choices, and automatically matching the choices through a knowledge graph of a background.
Then, the psychological tester 4 plays the voices one by one (which can be connected to the computer and present the text version on the computer during the playing process) according to the pre-programmed questions and list sequence based on the paradigm of CIT or CQT to prevent the repeated inquiry due to the unclear hearing. When the inquiry of a certain question item is finished, collecting the answer (audio) of the tested person, judging the answer by using a voice recognition technology, determining whether the answer is a positive answer or a negative answer, and if the answer is the positive answer or the negative answer, recording the answer information of the tested person and marking; if the answer is positive or negative, the prompt only needs to answer yes or no, until the tested person answers positive or negative, and the test is finished and then explained.
Then, the psychological tester 4 monitors and manages the actions of the tested person according to the body motion condition and the facial expression captured by the video acquisition device 2 in real time in the testing process, so as to effectively perform quantitative analysis. Since the physiological response data collected by the sensor combination mechanism 1 in real time are influenced by the body movement of the person to be detected and cannot reflect the emotion and cognition changes well, the cooperation of the physiological response data and the physiological response data is beneficial to more accurately detecting lie. For example, when the tested person has large amplitude body movement, the tested person waits for 5 seconds, and if the skin electricity is restored to a calm state, the next question can be asked continuously. Meanwhile, the psychological tester 4 automatically records the starting question-asking time, the question-asking ending time, the starting answer time, the answer ending time and the answer content of a tested person of a certain question item, and synchronously positions the time stamp in the physiological signal for recording.
Finally, when the tested person answers all questions to be qualified, the psychological tester 4 scores the questions according to the physical motion condition and the facial expression of the tested person and by matching with a plurality of physiological response data of the tested person to obtain the psychophysiological response rate, and determines that the tested person does not pass the questions, namely lies, when the psychophysiological response rate is judged to be more than 50%; otherwise, if the psychological and physiological response rate is judged to be less than 50%, the detected person is determined to pass and not lie.
For example, a frequently used hidden information test CIT can be adopted by using a Lykkens scoring rule
Comparing skin electric peak values of a group of questions, sorting from large to small, obtaining 2 scores for peak (max), obtaining 1 score for peak (second), and finally adding three rounds of total scores, wherein sorting from large to small is that the suspicion rate is from large to small. In a set of CIT problem tests, if there is a maximum psychophysiological response on the target problem, then there is said to be a "corresponding" (at least two-pass maximum) cognitive psychophysiological response on the target problem;
the correspondence rate C is (A/B) X100%
A: the number of "corresponding" (at least two-pass maximum) target questions in the question group;
b: total number of target questions
Example (c): if a is 3 and B is 5, the correspondence ratio C is (3/5) × 100% is 60%.
In the CIT test, if:
the psychophysiological response rate C is less than 50%, and the conclusion is that: passing;
the psychophysiological response rate C is 50%, the conclusion is that: no conclusion is made;
the psychophysiological reaction rate C is more than 50%, and the conclusion is that: do not pass.
As shown in fig. 4, in an embodiment of the present invention, an implementation method of a portable psychological test robot is provided, where the implementation method is implemented on the test robot, and the method includes the following steps:
step S1, the sensor combination mechanism collects a plurality of physiological response data of the tested person when the organism is stimulated in real time after the fingers of the tested person are fixed;
s2, capturing the body motion condition and the facial expression of the detected person in real time by the video acquisition equipment;
step S3, the audio acquisition equipment captures the sound of the tested person in real time;
step S4, the psychological tester plays the tested person one by voice according to the pre-compiled questions and the corresponding list sequence, and receives the sound captured by the audio collecting device in real time, the physical movement status and facial expression captured by the video collecting device in real time, and the physiological response data collected by the sensor combining mechanism in real time when the tested person answers each question, so as to determine whether each question answer of the tested person is qualified and the psychophysiological response rate of the tested person when all the question answers are qualified, and further verifies the expression of the tested person according to the psychophysiological response rate.
Wherein the physiological response data includes a skin resistance value and a blood volume.
Wherein the method further comprises:
and on the psychological tester, questions and corresponding list sequences are compiled in advance.
The embodiment of the invention has the following beneficial effects:
1. on one hand, the invention concentrates all important contact sensors (such as a skin electric sensor, a blood pressure sensor and a heart rate sensor) in the same device and can be used in a 'plug-and-play' mode by fixing the finger position of a person to be tested; on the other hand, the non-contact video acquisition equipment and the non-contact audio acquisition equipment are adopted to respectively acquire visual and sound signals (such as the physical movement condition, facial expression and sound of the detected person), so that the operation is very simple, the 'constrained feeling' of the detected person can be reduced to the maximum extent, and the operation is more friendly;
2. the invention integrates the analysis of connection, question editing (such as pre-edited questions and corresponding list sequence), test (such as voice one by one played by the tested person, and judging whether each question answer of the tested person is qualified or not and the psychophysiological response rate of the tested person when all the question answers are qualified) and final result (such as determining whether the tested person lies or not according to the psychophysiological response rate) into a set of standardized flow, so that a user can quickly and easily master and apply to an actual scene, the working intensity of the tested person can be effectively and obviously reduced, and the test accuracy can be ensured to the maximum extent. The methods are all derived from the kernel of the robot for deep learning, and the expert experience is effectively converted into an intelligent method;
3. the testing process of the invention can be realized by computer assistance in principle, and can even be replaced in the whole process, thus saving a great amount of time and energy of testers, and avoiding the influence of subjective factors of the testers, thereby reducing subjective participation in operation and interpretation as much as possible through a standardized process, and ensuring the reliability and effectiveness of the test.
It should be noted that, in the above system embodiment, each included unit is only divided according to functional logic, but is not limited to the above division as long as the corresponding function can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
It will be understood by those skilled in the art that all or part of the steps in the method for implementing the above embodiments may be implemented by relevant hardware instructed by a program, and the program may be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc.
While the invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not to be limited to the disclosed embodiment, but on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.
Claims (10)
1. A portable psychological test robot is characterized by comprising a psychological tester, and a sensor combination mechanism, a video acquisition device and an audio acquisition device which are respectively connected with the psychological tester; the sensor combination mechanism is formed by a plurality of sensors integrated in the same device and is used for collecting a plurality of physiological response data of the tested person when the body of the tested person is stimulated in real time after the fingers of the tested person are fixed;
the video acquisition equipment is used for capturing the physical motion condition and the facial expression of the detected person in real time;
the audio acquisition equipment is used for capturing the sound of the tested person in real time;
the psychological tester is used for playing the tested person one by one through voice according to the pre-compiled questions and the corresponding list sequence thereof, receiving the sound captured in real time by the audio acquisition equipment, the body motion condition and the facial expression captured in real time by the video acquisition equipment and a plurality of physiological response data captured in real time by the sensor combination mechanism when the tested person answers each question, so as to judge whether each question answer of the tested person is qualified or not and judge the psychological response rate of the tested person when all the question answers are qualified, and further verifying the utterance expression of the tested person according to the psychological response rate.
2. The portable mental test robot of claim 1, wherein said mental tester includes a question playing module, a question testing and analyzing module, and a comprehensive analyzing module; wherein the content of the first and second substances,
the question playing module is used for playing the tested personnel one by one through the voice synthesized by the machine according to the pre-programmed questions and the corresponding list sequence;
the question testing and analyzing module is used for receiving the sound captured by the audio acquisition equipment in real time, the physical motion condition and the facial expression captured by the video acquisition equipment in real time and a plurality of physiological response data collected by the sensor combination mechanism in real time when the tested person answers each question so as to judge whether each question answer of the tested person is qualified or not and judge the psychophysiological response rate of the tested person when all the question answers are qualified;
and the comprehensive analysis module is used for verifying the utterance expression of the tested person according to the psychophysiological response rate.
3. The portable psychological test robot according to claim 2, wherein said question test analysis module includes a data receiving sub-module, a question response judging sub-module and a psychophysiological reaction rate calculating sub-module; wherein the content of the first and second substances,
the data receiving submodule is used for receiving the sound captured by the audio acquisition equipment in real time, the physical motion condition and the facial expression captured by the video acquisition equipment in real time and a plurality of physiological response data captured by the sensor combination mechanism in real time when the tested person answers each question;
the question answer judging submodule is used for judging whether each question answer of the tested person is qualified or not by using a voice recognition technology; if the answer of each question of the tested person is judged to be a positive answer or a negative answer, the answer of each question of the tested person is determined to be qualified, and marking is carried out; if the tested person is judged to be other explanations except positive and negative answers when each question is answered, prompting the tested person to answer only positive or negative, and marking the tested person until the answer of the tested person is changed into positive or negative answer;
and the psychophysiological response rate calculating submodule is used for scoring a plurality of physiological response data acquired by the sensor combination mechanism in real time by combining the body motion condition and the facial expression captured by the video acquisition equipment in real time when all the answers of the tested personnel are qualified, so as to obtain the psychophysiological response rate.
4. The portable psychometric robot of claim 2, wherein the comprehensive analysis module includes a lie-asserted submodule and a non-lie-asserted submodule; wherein the content of the first and second substances,
the lie-identifying submodule is used for identifying that the utterance expression of the detected person is abnormal if the psychophysiological response rate is greater than a preset threshold value;
and the non-lying identification submodule is used for identifying that the utterance expression of the detected person is normal if the psychophysiological response rate is smaller than the preset threshold value.
5. The portable mental test robot of claim 2, wherein said mental tester further comprises a display module connected to said mental tester; wherein the content of the first and second substances,
the display module can be integrated with the psychological tester or designed separately, and is used for displaying a human-computer interaction interface and realizing the pre-input and compilation of questions and list sequences thereof.
6. The portable psychometric robot of claim 1, wherein the plurality of sensors integrated in the sensor assembly mechanism includes a galvanic skin sensor and a blood volume sensor; wherein the content of the first and second substances,
the skin electric sensor is used for acquiring the skin resistance value or the current value of the skin electric conduction change of the tested person when the tested person body is stimulated in real time;
the blood volume sensor is used for acquiring blood flow changes of a tested person in a testing process in real time and calculating heart rate changes.
7. The portable mental test robot of claim 1, wherein said video capture device is a camera; the audio acquisition device is a microphone.
8. A portable mental test robot implementation method, implemented on a portable mental test robot according to any of claims 1-7, comprising the steps of:
after the finger of the person to be detected is fixed, the sensor combination mechanism collects a plurality of physiological response data of the person to be detected when the organism is stimulated in real time;
the video acquisition equipment captures the physical motion condition and the facial expression of the detected person in real time;
the audio acquisition equipment captures the sound of the tested person in real time;
the psychological tester plays the tested person one by one through voice according to the pre-compiled questions and the corresponding list sequence thereof, receives the sound captured in real time by the audio acquisition equipment, the physical motion condition and the facial expression captured in real time by the video acquisition equipment and a plurality of physiological response data captured in real time by the sensor combination mechanism when the tested person answers each question so as to judge whether each question answer of the tested person is qualified or not and judge the psychophysiological response rate of the tested person when all the question answers are qualified, and further verifies the expression of the tested person according to the psychophysiological response rate.
9. The method of claim 8, wherein the physiological response data comprises skin resistance values and blood volume.
10. The method of claim 8, wherein the method further comprises:
and on the psychological tester, questions and corresponding list sequences are compiled in advance.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110620732.0A CN113349779A (en) | 2021-06-03 | 2021-06-03 | Portable psychological test robot and implementation method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110620732.0A CN113349779A (en) | 2021-06-03 | 2021-06-03 | Portable psychological test robot and implementation method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113349779A true CN113349779A (en) | 2021-09-07 |
Family
ID=77531931
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110620732.0A Pending CN113349779A (en) | 2021-06-03 | 2021-06-03 | Portable psychological test robot and implementation method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113349779A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101455569A (en) * | 2008-12-31 | 2009-06-17 | 沈政浩 | Psychology physiology signal multi time window acquisition analysis system and lie detection method |
| CN105011949A (en) * | 2014-04-25 | 2015-11-04 | 蔡雷 | Automatic testing method and apparatus |
| CN105105738A (en) * | 2015-09-30 | 2015-12-02 | 宇龙计算机通信科技(深圳)有限公司 | Information processing method and device and electronic device |
| CN105160318A (en) * | 2015-08-31 | 2015-12-16 | 北京旷视科技有限公司 | Facial expression based lie detection method and system |
| CN111195132A (en) * | 2020-01-10 | 2020-05-26 | 高兴华 | Non-contact lie detection and emotion recognition method, device and system |
| CN111507124A (en) * | 2019-01-30 | 2020-08-07 | 北京入思技术有限公司 | Non-contact video lie detection method and system based on deep learning |
| CN111714140A (en) * | 2020-06-05 | 2020-09-29 | 京东数字科技控股有限公司 | Method, device, system and storage medium for acquiring response information of detected lie person |
-
2021
- 2021-06-03 CN CN202110620732.0A patent/CN113349779A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101455569A (en) * | 2008-12-31 | 2009-06-17 | 沈政浩 | Psychology physiology signal multi time window acquisition analysis system and lie detection method |
| CN105011949A (en) * | 2014-04-25 | 2015-11-04 | 蔡雷 | Automatic testing method and apparatus |
| CN105160318A (en) * | 2015-08-31 | 2015-12-16 | 北京旷视科技有限公司 | Facial expression based lie detection method and system |
| CN105105738A (en) * | 2015-09-30 | 2015-12-02 | 宇龙计算机通信科技(深圳)有限公司 | Information processing method and device and electronic device |
| CN111507124A (en) * | 2019-01-30 | 2020-08-07 | 北京入思技术有限公司 | Non-contact video lie detection method and system based on deep learning |
| CN111195132A (en) * | 2020-01-10 | 2020-05-26 | 高兴华 | Non-contact lie detection and emotion recognition method, device and system |
| CN111714140A (en) * | 2020-06-05 | 2020-09-29 | 京东数字科技控股有限公司 | Method, device, system and storage medium for acquiring response information of detected lie person |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Chaouachi et al. | Affect and mental engagement: Towards adaptability for intelligent | |
| US20080045805A1 (en) | Method and System of Indicating a Condition of an Individual | |
| CN111326253A (en) | Method for evaluating multi-modal emotional cognitive ability of patients with autism spectrum disorder | |
| CN109222888B (en) | Method for judging reliability of psychological test based on eye movement technology | |
| AU2017263802B8 (en) | A user interface for navigating through physiological data | |
| US4941477A (en) | Method and apparatus for detection of deception | |
| US12004861B2 (en) | System and method to analyze waveforms for electromyography testing | |
| CN110811647A (en) | Multi-channel hidden lie detection method based on ballistocardiogram signal | |
| CN110876611A (en) | Remote evaluation method for neurocognitive disorder of old people | |
| CN114334123A (en) | Cognition assessment system suitable for mild cognitive impairment rapid detection | |
| CN105011949B (en) | A kind of method and device of automatic test | |
| CN111265226A (en) | System and method for detecting psychological stress management ability | |
| CN115299947A (en) | Psychological scale confidence evaluation method and system based on multi-modal physiological data | |
| CN111714089B (en) | Drug addiction evaluation system based on multi-stimulus short video event related potential | |
| JP5119726B2 (en) | Biological measuring device | |
| CN113349779A (en) | Portable psychological test robot and implementation method thereof | |
| RU184210U1 (en) | AUTOMATED DEVICE FOR MONITORING AND EVALUATING THE STATE OF THE MONITORED SUBJECT | |
| CN109431499B (en) | Botanic person home care auxiliary system and auxiliary method | |
| JPH07376A (en) | Cough recording system | |
| Gajšek et al. | Multi-modal emotional database: AvID | |
| CN113729708B (en) | Lie judgment method based on eye movement technology | |
| CN107736889B (en) | Detection method of human body coordination detection device | |
| JP2020014611A (en) | Psychogenic non-epileptic fit detection device and method | |
| CN208985716U (en) | A kind of automatic acquisition equipment of tcm clinical practice case | |
| KR20210157229A (en) | Apparatus and method for examining psychology based on artificial intelligence |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220113 Address after: 325000 room 105, building 1 and 2, East head, No. 1, Shengjin Road, Shuangyu street, Lucheng District, Wenzhou City, Zhejiang Province Applicant after: Wenzhou Jieling Jingxin Technology Co.,Ltd. Address before: 325000 teaching staff collective household of Wenzhou University, Chashan street, Ouhai District, Wenzhou City, Zhejiang Province Applicant before: Yan Wenjing |
|
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20210907 |