JP5150902B2 - Biological behavior response analysis system - Google Patents

Description

  The present invention relates to a biological behavior reaction analysis system for use in counseling based on communication between two persons in a one-to-one educational human relationship such as a subject-tester, and is particularly suitable for counseling and counselor education. The present invention relates to a biological behavior reaction analysis system.

  Similar to the one-to-one educational relationship described above, the client (person with the problem to be solved) and counselor, patient and doctor (or nurse), client and psychotherapist, client And psychiatrists, clients and case workers, students and teachers, students and instructors in corporate education, parents and children. These examples are different in structure and implementation method, but human relations of assistance aiming to solve the problem through communication between the two (eg, “sympathy”, “acceptance”, “sensitivity”) The inventor of the present application has confirmed through many years of research that there is a commonality in the point of trying to establish an attitude such as “attitude to engage with the other party”. In this way, it is very significant to obtain objective data on the relationship between the client and the counselor, that is, counseling, which is one of the human relationships of assistance desired in a wide range of fields.

  Here, the concept of counseling will be described in detail. Although there are various theories regarding the definition of counseling, it is generally expressed as shown in FIG. In other words, the areas adjacent to counseling include school psychology and psychotherapy (sometimes confused), and psychiatry is the area adjacent to psychotherapy. is there. The theoretical background of counseling is in the area of counseling psychology, whose objectives are education, human development, and mental health prevention. On the other hand, what forms the theoretical background of psychotherapy is the clinical psychology domain, and its objectives are humanity modification, mental health prevention and treatment. Therefore, both have overlapping parts. In general, counseling targets so-called healthy people, and psychotherapy targets so-called non-healthy people and contact points between them, but it also covers people who tend to be neurotic or borderline in counseling. The educational tendency increases as it goes to the left in the figure, and the therapeutic tendency increases as it goes to the right in the figure.

  By the way, the inventor of the present application has accumulated various studies and experiments on counseling from the above viewpoint. However, the counseling system at that time was trying to obtain objective data on counseling by measuring individual biological responses such as client's heart rate and GSR (Galvanic Skin Response) and analyzing them. However, there is a disadvantage in that the relationship between a plurality of biological reactions and the relationship between the psychological-physiological classification information of both the client and the counselor cannot be obtained. Therefore, the inventor of the present application can first perform a comprehensive and objective analysis on counseling based on data on a plurality of biological reactions and psychological-physiological classification information on both the client and the counselor. A system was invented and a patent was obtained for this (see Patent Document 1).

  The biological behavior reaction analysis system according to this patent invention includes first and second GSR sensors and first and second heart rate sensors for detecting GSR and heart rate which are biological responses of the subject and the tester, and those subjects. And a biological behavior monitoring device that monitors and records image information and voice information related to the examiner's biological behavior, and “joy”, “angry”, “subject” of the subject based on the image information and voice information output from the biological behavior monitoring device. Psychology-physiological classification information such as “Easy”, “Embarrassed”, “Surprise”, “Anxiety”, “Smooth”, “Unsmooth”, etc., as well as “Involved”, “Not concerned”, “Direct view”, “ First and second reaction keys for the observer to input psychological-physiological classification information such as “upper line of sight”, “bottom line of sight”, “open question”, “closed question”, etc. ,That A computer that inputs and synchronizes the GSR and heart rate of the subject and the tester and psychology-physiological classification information and outputs the information to the screen of the output device, and the GSR and the tester and the tester that the computer outputs Counseling analysis can be performed using heartbeats and psychological-physiological classification information synchronized with them.

Japanese Patent No. 2505290

Journal of the Institute of Electronics, Information and Communication Engineers, Journal of the Institute of Electronics, Information and Communication Engineers, A J88-A (8), PP.994-100120050801, written by Kei Matsushita and Yasuhiro Nakagawa, “Kansei Information Analysis by Optical Topography (Human Communication)”

  The inventor of the present application has further studied the biological behavior reaction analysis system for which the above-mentioned patent has been obtained, and found that there is room for improvement in the following points. That is, in the previous biological behavior reaction analysis system, after attaching electrodes to the test subject's and tester's fingers during GSR detection, the gain (amplification) of the GSR signal is adjusted appropriately, and the test subject and tester are There is a possibility that the biological response of the subject and the tester cannot be obtained with high accuracy if the gain adjustment is inappropriate or at least one of the test subject and the tester is not at rest. was there. If the biological reactions of the subject and the tester cannot be obtained with high accuracy, there is a possibility that more accurate analysis of counseling may be inconvenient.

  In the previous biological behavior reaction analysis system, the first and second responses for inputting the psychological-physiological classification information of the subject and the tester based on the image information and the voice information output from the biological behavior monitoring device. Since each key only inputs the presence / absence of psychological / physiological classification information for each type of classification information by turning the switch on / off, the degree of the subject's emotion and the degree to which the examiner's question is concerned The psychological-physiological classification information of the subject and the examiner may not be obtained with high accuracy. If the psychological / physiological classification information of the subject and the examiner cannot be obtained with high accuracy, there is a possibility that more accurate analysis of counseling may be inconvenient.

  Furthermore, in the previous biological behavior reaction analysis system, two observers operate the first and second reaction keys based on the image information and the voice information output from the biological behavior monitoring device, respectively, and the subjects and the testers. Although psychology-physiological classification information is input, it is not always easy to accurately read the subject's emotion from image information and audio information, so the subject's psychology-physiological classification information cannot be obtained with high accuracy. There was a possibility. It was also speculated that more accurate counseling analysis would be possible if the examiner's emotions were identified at the same time as the subject's emotions. On the other hand, in recent years, the near-infrared rays are irradiated to multiple places on the human head to receive the reflected light from the brain surface, and the reflected light level changes minutely due to the blood flow change on the brain surface due to the activity of the prefrontal cortex of the brain A technique for detecting human emotions in a non-invasive and real-time manner using optical topography (registered trademark) that captures images is known (see Non-Patent Document 1).

  Therefore, it is an object of the present invention to provide a biological behavior reaction analysis system that enables more accurate analysis of counseling by improving the above-described points.

The biological behavior reaction analysis system according to the first aspect of the present invention, as shown in the conceptual diagram of FIG.
A biological behavior reaction analysis system for use in counseling based on communication between a subject and an examiner,
A first GSR sensor and a second GSR sensor for detecting a GSR and a heart rate of a subject and a tester, respectively, and a first heart rate sensor and a second heart rate sensor;
A biological behavior monitoring device that monitors and records image information and audio information related to the biological behavior of the subject and the tester;
First and second reaction keys for inputting psychological-physiological classification information of the subject and the tester based on the image information and the audio information output from the biological behavior monitoring device;
The first and second GSR sensors and the first and second cardiac pulse sensors are connected to the first and second reaction keys, and the GSR and the heart of the subject and the tester are connected. Information processing for synchronizing the pulse and the psychological-physiological classification information, and outputting the GSR and the heart pulse and the psychological-physiological classification information of the subject and the tester in a synchronized manner An output device;
With
In the biological behavior response analysis system capable of performing counseling analysis based on the synchronized output of the GSR and the heartbeat of the subject and the tester and the psychological-physiological classification information,
The information processing output device
Each GSR signal of the first and second GSR sensor and a predetermined time detection as a preliminary measure, its GSR signal, the maximum value detected by the preliminary measurement initial predetermined stimulus and subsequent detection during the preliminary measurement and gain confirmation means for confirming that the gain of the GSR signal is correct by the difference between the minimum value is a predetermined or higher,
Based on the fact that the respective GSR signals of the first and second GSR sensors continue for a predetermined time at a value equal to or less than a predetermined ratio during a subsequent preliminary measurement with respect to the maximum value detected by the predetermined stimulus, and A resting state confirmation means for confirming that the tester is in a resting state;
Have
The main measurement is started when it is confirmed in the preliminary measurement stage that the GSR gain is appropriate and the subject and the tester are in a resting state.

Moreover, as shown in the conceptual diagram of FIG. 2, the biological behavior reaction analysis system of the second aspect of the present invention is
A biological behavior reaction analysis system for use in counseling based on communication between a subject and an examiner,
A first GSR sensor and a second GSR sensor for detecting a GSR and a heart rate of a subject and a tester, respectively, and a first heart rate sensor and a second heart rate sensor;
A biological behavior monitoring device that monitors and records image information and audio information related to the biological behavior of the subject and the tester;
First and second reaction keys for inputting psychological-physiological classification information of the subject and the tester based on the image information and the audio information output from the biological behavior monitoring device;
The first and second GSR sensors and the first and second cardiac pulse sensors are connected to the first and second reaction keys, and the GSR and the heart of the subject and the tester are connected. Information processing for synchronizing the pulse and the psychological-physiological classification information, and outputting the GSR and the heart pulse and the psychological-physiological classification information of the subject and the tester in a synchronized manner An output device;
With
In the biological behavior response analysis system capable of performing counseling analysis based on the synchronized output of the GSR and the heartbeat of the subject and the tester and the psychological-physiological classification information,
The first and second reaction keys are
Output means for outputting the signal by changing the signal in a plurality of stages or continuously;
Resetting means for returning the output means to a non-operation state;
Have
The output means is operated to input the degree of psychological-physiological classification information of the subject and the tester in a plurality of stages or continuously.

And the biological behavior reaction analysis system of the 3rd aspect of this invention is shown in the conceptual diagram of FIG.
A biological behavior reaction analysis system for use in counseling based on communication between a subject and an examiner,
A first GSR sensor and a second GSR sensor for detecting a GSR and a heart rate of a subject and a tester, respectively, and a first heart rate sensor and a second heart rate sensor;
A biological behavior monitoring device that monitors and records image information and audio information related to the biological behavior of the subject and the tester;
First and second reaction keys for inputting psychological-physiological classification information of the subject and the tester based on the image information and the audio information output from the biological behavior monitoring device;
The first and second GSR sensors and the first and second cardiac pulse sensors are connected to the first and second reaction keys, and the GSR and the heart of the subject and the tester are connected. Information processing for synchronizing the pulse and the psychological-physiological classification information, and outputting the GSR and the heart pulse and the psychological-physiological classification information of the subject and the tester in a synchronized manner An output device;
With
In the biological behavior response analysis system capable of performing counseling analysis based on the synchronized output of the GSR and the heartbeat of the subject and the tester and the psychological-physiological classification information,
At least one of the subject and the tester receives at least one of the heads of the test subject and the tester by receiving near-infrared rays to receive reflected light from the brain surface, and based on a minute change in the reflected light level. NIRS brain measurement device that measures one emotion,
The information processing output device connects the NIRS brain measurement device in addition to the first and second GSR sensors, the first and second heart rate sensors, and the first and second reaction keys. Synchronizing the GSR and the heart rate and the psychological-physiological classification information of the subject and the tester, and further synchronizing the GSR and the heart rate and psychological-physiological classification information with the subject and the test. A process of synchronizing emotion information of at least one of the examinee, the GSR and the heartbeat of the subject and the examiner, the psychological-physiological classification information, and the emotion of at least one of the subject and the examiner. Output information in a synchronized manner,
Counseling analysis based on the synchronized output of the subject and the tester's GSR and the heartbeat and the psychology-physiological classification information and the emotional information of at least one of the subject and the tester. It is characterized in that it can be performed.

And in the present invention, in the first embodiment, it is also possible to combine one or all or of the second and third embodiments.

  In the biological behavior reaction analysis system according to the first to third aspects of the present invention, the subject and the tester communicate with each other (mainly depending on language, but also including non-language such as body language). And the second GSR sensor and the heart rate sensor detect the GSR and heart rate of the subject and the tester's GSR and heart rate, respectively, and input them to the information processing output device. First and second reaction keys operated by an observer who monitors and records image information and audio information related to biological behavior and receives image information and audio information output from the biological behavior monitoring device are the biological behavior monitoring device. Psychology-Physiology of subject's joy, anger, comfort, embarrassment, surprise, anxiety, smooth, unsmooth, etc. based on image information and audio information output from Classification concerning the information and the test person, not involved, direct view, Munejo line-of-sight, chest under line-of-sight, open questions, psychology of questions, which was closed - to enter the physiological classification information to the information processing output device. An information processing output device connected to the first and second GSR sensors, the heart pulse sensor, and the first and second reaction keys is used to input the GSR and pulse of the subject and the tester, and psychology-physiological The processing for synchronizing the classification information is performed, and the GSR and heartbeat and psychological-physiological classification information of the subject and the tester are output in a synchronized form.

  Therefore, according to the biological behavior reaction analysis system of the first to third aspects of the present invention, in the output information of the information processing output device, the GSR of the subject, the peak value of the heartbeat, and the psychology-physiological classification information of the subject The GSR of the examiner, the peak value of the heartbeat and the psychology-physiological classification information of the tester are synchronized, and the psychology-physiological classification information of the subject and the psychology-physiological classification information of the tester are synchronized. Therefore, counseling analysis can be performed comprehensively and objectively based on this output information. Further, by feeding back the output information to the subject and / or the tester, a great effect can be obtained particularly in counselor education.

Further, in the biological behavior reaction analysis system according to the first aspect of the present invention, the gain confirmation means includes a maximum value detected by a predetermined stimulus at the beginning of the preliminary measurement of GSR within a predetermined time during the preliminary measurement. each GSR gains of the first and second GSR sensor (amplification degree) is confirmed to be appropriate by the difference between the subsequent detected minimum value in the preliminary measurement is a predetermined or more, is resting state confirmation means, the GSR within the predetermined time during the preliminary measurement based on each of the GSR of the first and second GSR sensor, given later with respect to the maximum value of the maximum value detected by the predetermined stimulus Confirm that subject and tester are at rest by GSR below the percentage for a given time . When it Ru confirmed the that and subjects and testers gain GSR at the stage of preliminary measurement is proper is resting state, the information processing output device starts the measurement.

  Therefore, according to the biological behavior reaction analysis system of the first aspect of the present invention, the GSR can be measured while appropriately adjusting the gain of the GSR signal and the subject and the tester are in a resting state. In addition, the biological reaction of the examiner can be obtained with high accuracy, and thus more accurate analysis of counseling can be made possible.

Further, in the biological behavior reaction analysis system according to the second aspect of the present invention, the output means of the first and second reaction keys operated by the observer outputs a plurality of psychological-physiological classification information signals. output stage or by continuously changing, resetting means thereof the first and second reaction keys, psychology - the output of the image information and audio information from completed or the biological activity monitoring apparatus physiological classification information When the output means is returned to the non-operating state at the end, etc., the first and second reaction keys input the degree of psychological-physiological classification information of the subject and the tester in a plurality of steps or continuously. To do.

  Therefore, according to the biological behavior reaction analysis system of the second aspect of the present invention, since at least one of the degree of emotion of the subject and the degree of the question of the examiner can be input, the psychology-physiology of the subject and the examiner. Classification information can be obtained with high accuracy, and thus more accurate analysis of counseling can be made possible.

In the biological behavior reaction analysis system according to the third aspect of the present invention, an NIRS (Near Infra-Red Spectroscopy) brain measuring device, that is, an optical topography device, is provided for at least one of the subject and the tester. Near-infrared rays are radiated to multiple locations on the head to receive the reflected light from the brain surface, measure the emotion of at least one of the subject and the tester based on minute changes in the reflected light level, and the information processing output device In addition to the first and second GSR sensors and the first and second heart rate sensors and the first and second reaction keys, the optical topography device is connected to the subject and the tester's GSR and heart rate. And psychological-physiological classification information, and the emotional information of at least one of the subject and the examiner is included in the GSR and heart rate and psychological-physiological classification information. And the subject's and tester's GSR and heartbeat and psychology-physiological classification information and the subject's and tester's emotion information are output in a synchronized manner, Counseling analysis can be performed based on synchronized output of subject and tester's GSR and heart rate and psychological-physiological classification information and emotional information of at least one of the subject and tester.

  Therefore, according to the biological behavior reaction analysis system of the third aspect of the present invention, the observer cannot accurately read the emotion of the subject or the tester from the image information and the voice information, or the subject or the tester's emotion. Even if you have missed reading emotions, you can obtain the subject's psychology-physiological classification information with high accuracy by referring to the emotion information obtained with the optical topography device, and thus more accurate analysis of counseling Can be made possible.

It is a conceptual diagram which shows the structure of the 1st aspect of the biological behavior reaction-analysis system of this invention. It is a conceptual diagram which shows the structure of the 2nd aspect of the biological behavior reaction-analysis system of this invention. It is a conceptual diagram which shows the structure of the 3rd aspect of the biological behavior reaction-analysis system of this invention. It is a block diagram which shows the structure of one Example of the biological activity reaction analysis system of this invention based on all the said 1st thru | or 3rd aspects. It is a circuit diagram which shows the GSR measurement circuit of the biological behavior reaction analysis system of the said Example. (A) is an external appearance perspective view which shows the reaction key of the biological behavior reaction analysis system of the said Example, (b) and (c) are the top views and side surfaces which show the structure of one of the some keys FIG. It is a flowchart which shows the measurement program which the personal computer of the biological behavior reaction analysis system of the said Example runs. It is a flowchart which shows the preparation program performed by the preliminary measurement in the said measurement program. It is explanatory drawing which shows the example of the image which the personal computer of the biological behavior reaction analysis system of the said Example displays on a display screen. (A) And (b) is explanatory drawing which shows the measurement data of the client and the counselor in the said image, respectively. It is explanatory drawing which shows the position of the academic field of counseling.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 4 is a block diagram showing the configuration of an embodiment of the biological behavior reaction analysis system of the present invention based on all the first to third aspects of the biological behavior response analysis system of the present invention described above. In the figure, reference numeral 10 denotes a client as a subject, 11 denotes a counselor as a tester, and 12 and 13 denote observers, respectively.

In the biological behavior reaction analysis system of this embodiment, a GSR sensor 14 and a heartbeat sensor 15 for detecting a biological reaction are attached to the client 10 and the counselor 11, respectively. The GSR sensor 14 measures the current skin reaction (GSR) of the client and the counselor, and applies a minute voltage (for example, 10 mv) to the electrodes attached to both fingers (for example, the index finger and the ring finger), and the The skin resistance value is measured and GSR is obtained based on the change. The heart rate sensor 15 measures the heart rate (heart rate) of the client and the counselor, and detects the heart rate pulse for each beat by an optical sensor attached to both fingers (for example, the middle finger). The GSR and heartbeat data detected by these sensors 14 and 15 are sent to a personal computer (hereinafter referred to as “personal computer”) 20 as an information processing output device via an adjuster 16 and an analog-digital (A / D) converter 18. Is input. In general, these sensors 14,
15 and a video camera 21 to be described later are arranged in a room where the client 10 and the counselor 11 are located, for example, in a counseling room 22.

  The adjuster 16 receives the data from the sensors 14 and 15 and the data from the reaction key 30 (to be described later) and outputs the data as analog data to the A / D converter 18 as well as red each time a heartbeat pulse is detected. It has a monitor function to blink the LED lamp. The A / D converter 18 has a function of converting analog data from the regulator 16 into digital data and outputting the digital data to the personal computer 20. Note that GSR may change over time due to changes in measurement conditions. In this case, zero set (make sure that the GSR measurement value stabilizes near zero) is performed. The adjuster 16 is provided with two meters (for the client 10 and the counselor 11) for monitoring the GSR measurement value. With this meter and auto balance described later, as shown below, the GSR adjustment can be performed by the adjuster 16 alone by the necessary minimum operations of a built-in gain switch and unillustrated variable resistor for zero setting.

  By the way, since the GSR measurement cannot be performed unless the reference voltage determined based on the skin resistance value R0 is within the reference value range, it is necessary to adjust the reference voltage so that it falls within the reference value range. This is an automatic adjustment that is not performed manually. FIG. 5 is a circuit diagram showing a GSR measurement circuit of the biological behavior reaction analysis system of this embodiment. In this circuit, the autobalance first determines the skin resistance R0 of the client 10 (or counselor 11) from the GSR sensor 14. If the reference voltage V2 determined based on the reading and the skin resistance R0 is outside the range of the reference value, the reference voltage V2 is increased or decreased. The reference voltage V2 is increased or decreased by increasing or decreasing the base current of the transistor Tr until the reference voltage V2 falls within the reference value range. Once the reference voltage V2 falls within the reference value range, the GSR is determined based on the skin resistance R0. Output a signal.

  Here, the measurement principle of GSR will be explained. As shown in FIG. 5, the GSR measurement circuit places the GSR sensor 14 at the connection point of the resistor R1 to which the voltage + V is applied and the collector of the transistor Tr and the signal output capacitor C. Connect, ground the emitter of Tr via resistor R2, connect the base of Tr to the output terminal of operational amplifier OP1, apply voltage V0 to the non-inverting input terminal of operational amplifier OP1, and connect the inverting input terminal of operational amplifier OP1 to Tr In this GSR measurement circuit, for example, when the skin resistance R0 increases, the Tr emitter voltage V2 decreases, and the input voltage of the operational amplifier OP1 is correspondingly reduced. A voltage corresponding to the increase in (V0-V2) is fed back to the base of the Tr, and the emitter voltage V2 becomes a set value (value before decreasing). Since the collector voltage V1 of Tr changes at this time, the GSR signal is output from the capacitor C in accordance with the change of the collector voltage V1.

  This GSR measurement circuit further connects the capacitor C to the resistor R3 and enables the connection point between the capacitor C and the resistor R3 to be grounded via the zero-set switch S1, and the resistor R3 is connected to the inverting input terminal of the operational amplifier OP2. Is connected, the intermediate terminal of the variable resistor VR1 for zero set with voltage ± V2 applied at both ends is connected through the resistor R4, and the output terminal of the operational amplifier OP2 is connected by feedback through the resistor R5. The non-inverting input terminal of OP1 is grounded, the output terminal of the operational amplifier OP2 is connected to the inverting input terminal of the operational amplifier OP3 via the resistor R6, and the output terminal of the operational amplifier OP3 is connected to the resistor R7 selected by the gain selector switch S2. A feedback circuit is connected via any of R10, and an amplifier circuit configured by grounding the non-inverting input terminal of the operational amplifier OP3 is provided. In this amplifier circuit, a capacitor is provided. The GSR signal output from C is zero-set and amplified by the operational amplifier OP2, and further amplified while adjusting the gain by the operational amplifier OP3, and is output from the output terminal of the operational amplifier OP3.

  The GSR signal is output within the range of plus or minus 5V, and normally stabilizes near 0V when the client (or counselor) is at rest (the meter hardly swings from the center 0V position), but when it is not near 0V With the zero set switch S1 turned on and the connection point between the capacitor C and the resistor R3 grounded, the zero set variable resistor VR1 is adjusted to near 0V, then the zero set switch S1 is turned off and the connection point Since the amplitude of the GSR measurement value fluctuates depending on the room temperature, skin temperature, etc., the amplifier circuit that makes the shake of the meter an appropriate amplitude prior to the above adjustment. The gain (gain) is selected by the gain selector switch S2. Once GSR adjustment is performed by these operations, it is not necessary to readjust during GSR measurement unless there is a particularly large GSR fluctuation.

  The video camera 21 monitors the situation in which the client 10 and the counselor 11 are actually counseling with images and sounds, and is connected to a digital video disk (DVD) recorder 24 via the personal computer 20 to display the images. Record signal and audio signal to DVD. The personal computer 20 has, for example, a liquid crystal display-type display screen 20a, and displays an image signal and an audio signal indicating the current counseling status from the video camera 21, or a counseling status recorded before the DVD recorder 24 plays from the DVD. In response to the image signal and the audio signal shown, the counseling state is displayed on the display screen 20a and the counseling sound is output from a speaker (not shown).

The observer 12 and the observer 13 generally monitor the display at a place different from the counseling room 22 and listen to the voice to perform an input operation of the slide reaction key 30. The slide-type reaction key 30 is an input device for inputting one of psychological-physiological classification (category) information based on the image and sound indicating the situation during the counseling.
13 are each operated by hand.

As shown in FIG. 6A, the slide-type reaction key 30 has eight slide switches 30a numbered 0 to 7, each consisting of a slide-type variable resistor as output means. Different psychological-physiological classification information (categories) are assigned to the slide switches 30a of numbers 0 to 7 of the reaction keys 30 for the use and the counselor 11, respectively. For example, in response key 30 for client 10, number 0 (not smooth), number 1 (smooth), number 2 (uneasy), number 3 (joy), number 4 (easy), number Assign 5 (anger), 6 (embarrassed), 7 (surprise), and the response key 30 for the counselor 11 is 0 (related: listening), 1 (not related). Assign number 2 (direct view), number 3 (line-of-sight chest), number 4 (line-of-line chest), number 5 (open question), and number 6 (closed question) (counselor) Number 7 for 11 is missing). These categories are called “micro counseling” (Allen
Based on the dialogue technique described in E Ivey, Fukuhara et al., Kawashima Shoten, November 1985, p8), it was created with the inventor's ingenuity. Thereby, the actions of the client 10 and the counselor 11 can be classified physiologically and psychologically.

  In addition, as shown in FIGS. 6B and 6C, this slide-type reaction key 30 has a wire 30c in which one end is connected to the slide knob 30b of each of the eight slide switches 30a. The wire drum 30d is wound around a drum 30d and rotated by a mainspring spring 30e made of a leaf spring, and a rubber friction roller 30g made of, for example, rubber is used by a reset lever 30f as a reset means common to the eight slide switches 30a. Supports the wire drum 30d so that it can be slidably contacted and separated and provided with rotational resistance, and the reset lever 30f is always urged by a coil spring 30h so that the friction roller 30g is slidably contacted to the wire drum 30d. As a result, the wire 30c is wound around the wire drum 30d as the slide knob 30b of each slide switch 30a is moved. Or unwound from beam 30d, but the wire drum 30d is given a rotational resistance in sliding contact with the friction roller 30g, the slide knob 30b may be stopped at any position.

  Therefore, according to the biological behavior reaction analysis system of this embodiment, the observers 12 and 13 slide the slide knob 30b of the slide switch 30a with their fingers, so that the slide-type reaction key 30 has an arbitrary level (about). Psychological-physiological classification information such as strong / light anxiety, strong / light surprise, strong / light listening, strong / light defocusing, etc. can be output, enabling more accurate analysis of counseling. Then, when the category input is completed and the next category input is performed, if the observers 12 and 13 operate the reset lever 30f to separate the friction roller 30g from the wire drum 30d, the mainspring spring 30e urges the rotation. The wire drum 30d thus wound winds the wire 30c and automatically returns the slide knob 30b of each slide switch 30a to the initial position.

  Furthermore, in the biological behavior reaction analysis system of this embodiment, a near-infrared sensor 31 for emotion detection is mounted on the heads of the client 10 and the counselor 11, respectively. This near-infrared sensor 31 is a net-like device with a plurality of near-infrared light emitters and a plurality of near-infrared light receivers arranged in a matrix. When the device is attached to the head, it emits near-infrared light on the scalp. And near-infrared light receivers are arranged in a matrix, the head is irradiated with near-infrared light from the light emitter, and the reflected light from the surface of the brain is received by the light receiver. It captures minute changes in the level of reflected light due to changes in blood flow on the surface and outputs it as an electrical signal. The output signal of this near-infrared sensor 31 is an optical topography (registered trademark) device 32 (for example, a product of Hitachi Medical Corporation). The optical topography device 32 maps the region where the blood flow change of the brain surface has occurred in the prefrontal area of the brain from the output signal of the near infrared sensor 31, and the brain surface obtained in advance by experiment Analyzed by comparing with the relationship between the flow change part and emotion, at least four types of emotions of client 10 and counselor 11, “anger”, “joy”, “sadness” and “relax”, It can be detected non-invasively in real time and output to the personal computer 20 as data. For example, when you feel a strong anger (discomfort), the blood flow in the ventral side of the left and right prefrontal cortex increases and a strong joy (pleasure) ) Has been found to increase blood flow on the dorsal side of the left prefrontal cortex (see Non-Patent Document 1).

  The personal computer 20 includes a printer (not shown) in addition to the display screen 20a. Based on each input data, the personal computer 20 executes a previously stored measurement program shown in FIG. 7 to analyze the behavior of the client 10 and the counselor 11. Support. Prior to the execution of this measurement program, check and adjust the operation of each sensor, video camera, etc. (for example, check the GSR measurement value in the adjuster 16 or adjust the video camera 21 to obtain a favorable image) On the other hand, orientation is performed on the client 10 to remove the client 10's anxiety about counseling using this system and to ask the client 10 for cooperation not to move his fingers more than necessary. Keep it (if you move your finger, it affects GSR and heart rate measurements). Since the adjuster 16 has two channels A and B, in the following description, the A channel (A-ch) is assigned to the client 10 and the B channel (B-ch) is assigned to the counselor 11.

  In the measurement program of FIG. 7, although not shown, the personal computer 20 first displays “setting”, “measurement”, “graph display”, “raw data display”, “data storage”, “data reproduction” on the display screen 20a. , A menu screen having each button of “END” is displayed. Here, when “Setting” is selected and entered, measurement conditions are set. When “Measurement” is selected and entered, measurement is performed according to the measurement conditions, and “Graph Display” is selected and entered. The data obtained by the measurement is displayed in a graph, and if there is an instruction, the graph is printed. When “raw data display” is selected and entered, the data obtained in the measurement is displayed in a list. In addition, if there is an instruction, the list is printed, and when `` Save data '' is selected and entered, data other than the image and sound obtained by measurement is saved in the hard disk drive device built in the personal computer 20, When "Data playback" is selected and entered, the saved data can be read to display graphs and raw data, and when "Exit" is selected and entered, this program is terminated. .

  When the measurer selects and inputs “setting” on the menu screen, the personal computer 20 displays the setting screen on the display screen 20a, and the measurer displays the measurement time (for example, 10 minutes, 15 minutes, Select from 20 minutes, 25 minutes, 30 minutes, and 60 minutes) and sampling time (for example, select from 20 msec, 50 msec, 100 msec, and 200 msec), and select GSR and heart rate measurement as data to be displayed on the display screen 20a. In step S1 and step S2, those settings and selection results are input, and in step S3, the client 10 and the counselor 11 from the sensors 14, 15 are superimposed on the image from the video camera 21 on the display screen 20a. A measurement screen displaying each data in a graph is displayed, and then the DVD recorder 24 is operated by the measurer to display an image signal and an audio signal indicating the counseling status. , To start recording on the DVD (the recording), proceed to the preliminary measurement of the step S4.

  In this preliminary measurement, the personal computer 20 prepares for the main measurement by executing the preliminarily stored preparation program shown in FIG. In this preparation program, first, in step S21, the personal computer 20 displays on the display screen 20a the GSR-A signal that is the data from the GSR sensor 14 of the client 10 and the GSR-A that is the data from the GSR sensor 14 of the counselor 11. A message instructing the adjustment of the gain and auto-zero with the B signal is presented, so that the measurer first adjusts the gain of the GSR-A signal and the GSR-B signal with the gain selector switch S2 in the adjuster 16. While adjusting to the level (scale 2), the zero set switch S1 and the zero set variable resistor VR1 adjust the auto zero of the GSR-A signal and the GSR-B signal as described above.

  Next, in step S22, the personal computer 20 starts preliminary measurement, reads the data of the client 10 and the counselor 11 from the sensors 14 and 15 via the adjuster 16, and then starts the preliminary measurement in the next step S23. Collect 30 seconds of data. In this 30-second period, the measurer first gives a predetermined stimulus (for example, a buzzer sound) to the counselor 11 and the client 10, and then the counselor 11 performs a normal conversation (for example, a conversation about life) with the client 10. Thus, after a peak (maximum value) once occurs in the GSR-A signal and the GSR-B signal, a certain amount of change is continued. Thereafter, in the next step S24, the personal computer 20 determines whether or not the difference between the maximum value and the minimum value is 0.1 V or less for each of the collected GSR-A signal and GSR-B signal, and at least one of the signals If the difference between the maximum and minimum values is 0.1V or less, in step S25, the channel of the signal is displayed on the display screen 20a and "There is no GSR response. Please adjust the gain." In step S26, a message “Do you want to continue the preliminary measurement?” Is displayed on the display screen 20a. If the measurer enters “Yes”, the process proceeds to step S27. If you enter “No”, you will return to the menu screen. On the other hand, the measurer gives the above stimulation to the counselor 11 and the client 10 again, and adjusts the gain so that the peak of the GSR signal at that time is 1 V or more and close to 1 v.

  On the other hand, if the difference between the maximum value and the minimum value of both the GSR-A signal and the GSR-B signal exceeds 0.1 V in step S24, the personal computer 20 next determines that the GSR-A signal is in step S27. For both the signal and the GSR-B signal, it is determined whether or not 30% or less of the maximum value continues for 10 seconds, and if at least one of the signals does not continue for 10 seconds, then in step S28 It is determined whether or not 5 minutes have elapsed, and if 5 minutes have not elapsed, the process returns to step S27 to continue the determination. If 5 minutes have elapsed, “preliminary measurement” is displayed on the display screen 20a in step S26. The message “Do you want to continue?” Is presented, and if the measurer inputs “Yes”, the process returns to step S27 to continue the determination, and if the measurer enters “No”, the menu screen is returned to. In step S27, if both the GSR-A signal and the GSR-B signal continue to be 30% or less for 10 seconds based on the maximum value, both the client 10 and the counselor 11 are in a resting state. Therefore, the preliminary measurement is finished and the process proceeds to the main measurement.

  Therefore, according to the biological behavior reaction analysis system of this embodiment that executes this preparatory program, the GSR signal gain is appropriately adjusted before the main measurement and the GSR is kept in a state where the client 10 and the counselor 11 are in a resting state. Therefore, it is possible to obtain the biological responses of the client 10 and the counselor 11 with high accuracy, and thus to enable more accurate analysis of counseling.

Returning to the measurement program of FIG. 7, when the preliminary measurement in step S4 is completed, the main measurement is performed in step S5. In the first measurement, the counselor 11 interacts with the client 10 based on the counseling method within the previously set measurement time. During that time, the personal computer 20 displays the measurement screen on the display screen 20a. On the measurement screen, superimposed on the images of the client 10 and the counselor 11 from the video camera 21, and the sensor 14,
Each data of the client 10 and the counselor 11 from 15 is recorded as a temporary file while being displayed in a graph in real time under the same time axis (aligning the display position with respect to the elapsed time during counseling). During this first measurement, the optical topography device 32 also detects the emotions of the client 10 and the counselor 11 in real time and outputs them as data to the personal computer 20. Sensor 14,
Although the data from 15 are recorded together under the same time axis, they are not displayed on the measurement screen. When the first actual measurement is completed, the measurer ends the recording of the DVD recorder 24 and sets and inputs a file name. In step S6, the personal computer 20 assigns the file name and adds the file name. Data is stored in the aforementioned hard disk drive.

  Next, in step S7, the personal computer 20 determines whether or not the data input from the slide-type reaction key 30 has been completed.If the data has not been completed, the personal computer 20 proceeds to step S8 and displays “Slide-type” on the display screen 20a. The data input from the reaction key 30 has not been completed. ", And when the measurer selects to include the reaction key in the screen display on the setting screen described above, the personal computer 20 will execute step S9. Then, the data stored from the sensors 14 and 15 and the optical topography device 32 previously stored are read from the hard disk drive device, and then in step S10, the measurer operates the DVD recorder 24 and records the counseling status previously recorded from the DVD. When the displayed image signal and audio signal are reproduced, the image and sound indicating the counseling status are measured on the display screen 20a together with the elapsed time. The surface is displayed superimposed with the data of the sensors 14, 15 of the read data.

  In the display state of this measurement screen, the second measurement of step S5 is performed. In this second measurement, among the two observers 12 and 13, the observer 12 is a sliding reaction for the client 10. With the key 30, the observer 13 has the slide-type reaction key 30 for the counselor 11, and observes the images and sounds of the client 10 and the counselor 11 displayed on the measurement screen, respectively. When a client 10 shows psychological-physiological classification information (category) such as (not smooth), (smooth), (anxiety), and (joy) during counseling, a slide corresponding to the classification information (category) The switch 30a is slid by a distance corresponding to the degree (level) of the classification information, and the observer 13 is in charge of the counselor 11 during the counseling (related: listening), (not related), (direct view), (line-of-sight chest) Etc. When the psychology-physiological classification information (category) is indicated, the slide switch 30a corresponding to the classification information (category) is slid by a distance corresponding to the degree (level) of the classification information. The personal computer 20 then outputs the output data of the slide type reaction key 30 from the sensors 14 and 15 and the optical topography device 32 that have read the above data (for example, “anger” in number 0, “joy” in number 1, and number 2) “Puzzle”, “Relax” is assigned to number 3) The graph is displayed in real time on the measurement screen under the same time axis, and recorded together as a temporary file. In step S7, the temporary file data is stored in the hard disk drive.

  Thus, when the data input from the slide reaction key 30 is completed in step S7, the personal computer 20 reads the data stored in the hard disk drive device in step S11 in accordance with the instruction from the menu screen described above. When the measurer or the like operates the DVD recorder 24 to reproduce the image signal and the audio signal indicating the counseling situation recorded earlier from the DVD, for example, as shown in FIG. 9, the image and the sound indicating the counseling situation are passed. Along with the time, the read GSR data, heartbeat data, reaction key data, and optical topography data are superimposed on the measurement screen on the display screen 20a and displayed on the measurement screen. In FIG. 9, the horizontal axis indicates the passage of time, and the vertical axis indicates the level of each data.

  The GSR and heartbeat of each of the client 10 and counselor 11 displayed on this measurement screen and the psychological-physiological classification and emotional synchronized data of the images of the interaction between the client 10 and the counselor 11 By studying together with the voice, it is possible to objectively and accurately analyze various counseling techniques used by the counselor 11 during counseling and the response of the client 11 to these techniques.

  The operation of the counseling analysis using the biological behavior reaction analyzer of the above embodiment will be described using the example of measurement data shown in FIG. In this example of counseling, client 10 is a graduate student, counselor 11 is a university professor, and counselor 11 is based on the basic listening skills of micro-counseling, Q1: “A little bit about me about your future career hopes. Talk to me (open personal questions) ”, Q2:“ What kind of activities do people do in this kind of profession? (Open non-personal questions) ”, Q3:“ You Does anyone know who is doing this kind of work (closed personal question) ”, Q4:“ Does a person need college graduate training to do this kind of work? ” Closed non-personal questions) ”, Q5:“ What type of challenges do you face when performing this type of profession? (Open personal questions) ”, Q6:“ Graduate School You expect to face this kind of challenge (Closed personal questions), Q7: “Does other graduate students face this kind of challenge? (Closed non-personal questions)”, Q8: “Other graduate students Asks, “How do you face these challenges? (Open non-personal questions),” and client 10 answers each of them. The sliding response key 30 can be used at any level for the three psychological-physiological classifications, both positive (CH0), passive (CH1), and neutral (CH2), for both clients and counselors. Output.

  First, looking at the client 10 side, regarding question Q1, GSR shows a peak value, and the heartbeat also changes finely, while the response key shows information (weak and aggressive), and optical topography is ( It shows a vague interest in the future occupation. As for Question Q2, GSR shows a peak value, but the heart rate is changing slowly, while the reaction key shows information (weak and aggressive), and optical topography shows emotion (confused). Therefore, it seems that the concrete activity is not conceived and is confused. For Question Q3, GSR shows a peak value, heartbeats also change significantly, while the response key shows information (weak and passive), and optical topography shows no particular emotions. The emotions seem to be kept plain, although they responded to questions. Regarding Question Q4, GSR shows a peak value, heartbeats also change finely, while reaction key shows (strongly positive) information, and optical topography shows (joy) emotion From this, it seems that they are taking a positive view of their current situation.

  Furthermore, as for Question Q5, the GSR and heart rate have hardly changed, while the response key shows (weak and neutral) information and the optical topography shows (confused) emotions, It seems to me that it is a little confusing because I cannot think of specific issues. For Question Q6, GSR shows a peak value, heartbeats also change significantly, while response key shows (strongly negative) information, and optical topography shows no emotion, The emotions seem to be kept plain, although they responded to questions. For question Q7, neither the GSR nor the heartbeat changed very much, while the reaction key showed information (weak and aggressive to weak and passive change) and optical topography showed (confused) emotion It seems that they are somewhat confused although they are interested in other students. And for Question Q8, the GSR shows a peak value, and the heartbeat also changes greatly, while the reaction key shows (strongly positive) information, and the optical topography shows a feeling of (joy) From this, it seems that they have a positive feeling to remember the appropriate response of other students.

  Next, when looking at the counselor 11 side, regarding question Q1, the GSR shows some change, but the heartbeat does not change much, while the response key shows information (weak and positive), and the optical topography is particularly He seems to have asked the question gently because he did not show his emotions. For question Q2, the GSR shows some change, but the heartbeat has changed little, while the reaction key shows (weak and passive) information, and the optical topography shows (confused) feelings Therefore, it seems that it was a quality aspect without showing much interest in the state of the client 10. For question Q3, the GSR shows a peak value, but the heartbeat remains almost unchanged, while the response key shows (strongly positive) information, and the optical topography shows an emotion of (joy) It seems that the question was asked with interest. Regarding Question Q4, the GSR has hardly changed, the heartbeat has not changed much, while the response key shows (weak and positive) information, and the optical topography shows (joy) feelings Therefore, it seems that the client's reaction to the question is satisfied.

  Furthermore, as for Question Q5, the GSR and heart rate have hardly changed, while the reaction key indicates (weak and positive) and the optical topography indicates (confused) emotions, It seems to have asked a light question. As for Q6, neither the GSR nor the heart rate changed, while the response key showed information (weak and aggressive) and the optical topography showed emotion (confused). It seems that he felt it was not accurate. Regarding Question Q7, the GSR changes gently and the heart rate also changes finely, while the response key indicates (weak and aggressive) and the optical topography indicates (joy) emotion Therefore, it seems that it is good to change the topic. And for Question Q8, the GSR has changed finely, the heartbeat has changed greatly, while the response key shows (strongly positive) information, and the optical topography shows the feeling of (joy) From this, it seems that he is satisfied with the positive emotions of client 10.

  In this way, by analyzing the psychological-physiological classification information focusing on the biological response data of the counselor 11 and the client 10, the emotional information obtained by optical topography is used as a supplementary reference. According to the biological behavior reaction analysis system, counseling analysis can be performed comprehensively, objectively, and accurately, eliminating subjective (experience, judgment, etc.) as much as possible, and accumulating the obtained objective data From the analysis, the counseling can sufficiently support that the psychological-physiological classification information of the client and the counselor is synchronized with the biological response of the client and the counselor.

  It should be noted that, when solving client problems, two-way communication between the counselor and the client in an attitude of engaging with the other party is considered desirable in any counseling as a basic attitude in counseling. The system of the embodiment is not limited to so-called professional counseling that is clearly in the relationship of assistance, but also in training for the promotion and improvement of the above-mentioned communication that is established in various relationships such as daily conversation situations. Can also have a great effect.

  Furthermore, the analysis results obtained as described above are used as voice or character data, and on the display screen 20a on the measurement screen, the image and voice indicating the above-mentioned counseling status, the read GSR data, heartbeat data, and response key data And topography data with the same time axis graph, and show (feed back) to the client and / or counselor, giving the client a higher level of self-insight and self-awareness The counselor can help and provide more effective counselor education by accurately understanding their counseling skills.

  Although the present invention has been described based on the illustrated example, the present invention is not limited to the above-described example, and can be appropriately changed within the scope of the claims. For example, there is no input means for the reaction key. Instead of a slide switch composed of a variable resistor in a stage, a slide switch that switches and outputs resistance values in a plurality of stages may be used, and in that case, the reset means may be a spring that constantly urges the switch to return to the home position. Further, the personal computer may record image information and audio information using another medium, for example, an internal or external memory element or a hard disk drive device instead of using the DVD recorder.

  Thus, according to the biological behavior reaction analysis system of the present invention, the GSR of the subject, the peak value of the heartbeat and the psychology-physiological classification information of the subject are synchronized, and the GSR of the tester, the peak value of the heartbeat and the tester's peak value are synchronized. Psychology-physiological classification information is synchronized, and the subject's psychology-physiological classification information and the tester's psychology-physiological classification information are synchronized and output information is synchronized. Can be done automatically. Further, by feeding back the output information to the subject and / or the tester, a great effect can be obtained particularly in counselor education.

  In addition, according to the biological behavior reaction analysis system of the first aspect of the present invention, the biological reactions of the subject and the tester can be obtained with high accuracy, and the biological behavior reaction analysis system of the second aspect of the present invention. According to the above, the psychological-physiological classification information of the subject and the tester can be obtained with high accuracy, and according to the biological behavior reaction analysis system of the third aspect of the present invention, the psychology-physiological of the subject Since the classification information can be obtained with high accuracy, it is possible to analyze the course of counseling and the results more accurately.

10 Client
11 Counselor
12,13 observer
14 GSR sensor
15 Heart rate sensor
16 Regulator
18 A / D converter
20 Personal computer
20a display screen
20b measurement program
21 camcorder
22 Counseling room
24 DVD recorder
30 Sliding reaction key
30a Slide switch
30b Slide knob
30c wire
30d wire drum
30e Mainspring
30f Reset lever
30g friction roller
30h coil spring
31 Near infrared sensor
32 Optical topography equipment

Claims (3)

A biological behavior reaction analysis system for use in counseling based on communication between a subject and an examiner,
A first GSR sensor and a second GSR sensor for detecting a GSR and a heart rate of a subject and a tester, respectively, and a first heart rate sensor and a second heart rate sensor;
A biological behavior monitoring device that monitors and records image information and audio information related to the biological behavior of the subject and the tester;
First and second reaction keys for inputting psychological-physiological classification information of the subject and the tester based on the image information and the audio information output from the biological behavior monitoring device;
The first and second GSR sensors and the first and second cardiac pulse sensors are connected to the first and second reaction keys, and the GSR and the heart of the subject and the tester are connected. Information processing for synchronizing the pulse and the psychological-physiological classification information, and outputting the GSR and the heart pulse and the psychological-physiological classification information of the subject and the tester in a synchronized manner An output device;
With
In the biological behavior response analysis system capable of performing counseling analysis based on the synchronized output of the GSR and the heartbeat of the subject and the tester and the psychological-physiological classification information,
The information processing output device
Each GSR signal of the first and second GSR sensor and a predetermined time detection as a preliminary measure, its GSR signal, the maximum value detected by the preliminary measurement initial predetermined stimulus and subsequent detection during the preliminary measurement Gain confirmation means for confirming that the gain of the GSR signal is appropriate when the difference from the minimum value is greater than or equal to a predetermined value;
Based on the fact that the respective GSR signals of the first and second GSR sensors continue for a predetermined time at a value equal to or less than a predetermined ratio during a subsequent preliminary measurement with respect to the maximum value detected by the predetermined stimulus, and A resting state confirmation means for confirming that the tester is in a resting state;
Have
The biological behavior reaction analysis system, wherein the main measurement is started when it is confirmed that the gain of the GSR is appropriate in the preliminary measurement stage and the subject and the tester are in a resting state. The first and second reaction keys are:
Output means for outputting the signal by changing the signal in a plurality of stages or continuously;
Resetting means for returning the output means to a non-operation state;
Have
The biological behavior reaction analysis system according to claim 1, wherein the output means is operated to input the degree of psychological-physiological classification information of the subject and the tester in a plurality of stages or continuously. At least one of the subject and the tester receives at least one of the heads of the test subject and the tester by receiving near-infrared rays to receive reflected light from the brain surface, and based on a minute change in the reflected light level. NIRS brain measurement device that measures one emotion,
The information processing output device connects the NIRS brain measurement device in addition to the first and second GSR sensors, the first and second cardiac pulse sensors, and the first and second reaction keys. Synchronizing the GSR and the heart rate and the psychological-physiological classification information of the subject and the tester, and further synchronizing the GSR and the heart rate and psychological-physiological classification information with the subject and the test. A process of synchronizing emotion information of at least one of the examinee, the GSR and the heartbeat of the subject and the examiner, the psychological-physiological classification information, and the emotion of at least one of the subject and the examiner. Output information in a synchronized manner,
Counseling analysis based on the synchronized output of the subject and the tester's GSR and the heartbeat and the psychology-physiological classification information and the emotional information of at least one of the subject and the tester. The biological behavior reaction analysis system according to claim 1 or 2, characterized in that it can be performed.

Images