JP7003883B2 - A system for assessing the degree of similarity in psychological states between audiences - Google Patents

Description

The present invention relates to a system for analyzing a human psychological state in communication, and more particularly, an audience movement in one-way or one-way communication such as a lecture, a speech, a conference, and video viewing. It relates to a system that analyzes the psychological state of the audience based on the degree of empathy for communication.

Information related to human psychological states such as human empathy or antipathy related to various forms of communication is useful when considering marketing strategies such as advertising policies in the market. Therefore, various techniques for measuring or analyzing the psychological state of human beings for grasping the psychological state of human beings in communication have been proposed. For example, in Patent Document 1, data labeled by an external observer (who watched the video) whether or not each interlocutor sympathizes with the behavior of the interlocutor detected from the video of a plurality of interlocutors is used. As learning data, a model parameter that represents the correlation between the interlocutor's behavior and the psychological state (sympathetic / not sympathetic) is learned, and the model parameter is used to detect the interlocutor's behavior from any video. A device for estimating the psychological state of an interlocutor based on this has been proposed. Further, in Patent Document 2, data created by interpreting and labeling a psychological state in which a plurality of observers interpret and label a psychological state such as sympathy / antipathy / neither of them of at least one person in a certain image and a plurality of observers. A device has been proposed for estimating how each observer interprets a person's psychological state using data representing each individual characteristic as learning data.

JP-A-2014-102606 Japanese Patent Application Laid-Open No. 2015-322333

By the way, in communication (hereinafter referred to as "one-way communication") in which an audience (a group of listeners) listens to information emitted by a specific person (speaker) such as a lecture, a speech, a conference, and video viewing. The information about the individual psychological state of the listener caused by the information emitted by the speaker, that is, whether or not the speaker sympathizes with the information emitted by the speaker, reflects the individual tastes and tastes of the listener. It is useful when deciding a policy or strategy (marketing strategy, etc.) in the provision of products and services, solicitation, advertising, and publicity. When using the information on the psychological state of the audience in such one-way communication, not only the information on the psychological state of each listener can be referred to individually, but also the degree of similarity of the psychological state among the listeners can be referred to. If possible, it will be possible to perform analysis such as grouping the audience based on the degree of similarity in their psychological states, and it is expected that useful information will be obtained when deciding marketing strategies as described above. In addition, even for individual listeners, the degree of similarity in psychological states among listeners makes it possible to grasp who in the audience has similar hobbies and tastes. It will be useful information (for example, it will be useful information in individual referral services, etc.). Thus, it would be useful to have a system that can refer to the degree of similarity in psychological states between listeners in one-way communication. At that time, it is preferable that the degree of similarity of the psychological states is presented in such a way that it is only objectively or subjectively and in an easy-to-understand manner, and the reliability thereof is higher.

Thus, one object of the present invention is to provide a system capable of presenting a similar degree of psychological state between listeners in one-way communication.

According to the present invention, the above-mentioned problem is a system for assessing and presenting the degree of similarity of psychological states between the plurality of listeners in one-way communication in which the information provided by the speaker is listened to by the plurality of listeners. There,
A body movement amount measuring means for measuring a body movement amount numerically expressing the magnitude of each body movement of the listener having a correlation with each psychological state of the plurality of listeners, and a body movement amount measuring means.
A body movement feature amount extracting means for extracting a body movement feature amount having a correlation with the psychological state from the measured body movement amount for each of the listeners.
A body movement similarity calculation means for calculating the body movement similarity, which numerically expresses the degree of similarity of the body movement feature amounts among the listeners, and the body movement similarity calculation means.
An empathy acquisition means for acquiring empathy that numerically expresses the degree of empathy of each of the plurality of listeners with respect to the information provided by the speaker, which is determined by each of the plurality of listeners.
An empathy similarity calculation means for calculating the empathy similarity, which numerically expresses the degree of similarity of the empathy among the listeners.
Psychological state similarity evaluation means for evaluating the degree of similarity of psychological states among the plurality of listeners based on the physical movement similarity and the sympathy similarity, and each of the plurality of listeners. It is achieved by a system including a display means for displaying the degree of similarity of the psychological state.

In the above configuration of the present invention, "one-way communication" means, as already mentioned, an audience, that is, information emitted by a specific person ("speaker") such as a lecture, a speech, a conference, and a video viewing. It is a form of communication that a group of listeners (listeners) listen to. The "speaker" is a person who provides information that can be recognized by the listener's audiovisual (for example, voice talk, music, image, video, video, etc.) regardless of the form, and is not necessarily in front of the audience. It should be understood that it does not have to appear in. In this system, the listener's "psychological state" is a psychological state that occurs in response to the information provided by the speaker, more specifically, a state of empathy for the information provided by the speaker. , A state with antipathy or a state of indifference (a state without empathy or antipathy). "Psychological state similarity between listeners" is an index of how similar, that is, close to, the psychological states of any two of the audience are, and will be explained later. As such, it will be expressed in various formats.

Further, in the above configuration, the "body movement" that correlates with the psychological state of the listener is a movement in the head or other body parts such as nodding and swinging the neck, and is a "body movement". "Size" refers to the amount of displacement of such a body part. In the embodiment, the "body movement amount expressing the magnitude of the body movement numerically" may be the displacement acceleration, the displacement amount, etc. of the head of each listener, and the "body movement amount measuring means". "" Means, for example, an acceleration sensor that is attached to the head of an individual listener and measures the acceleration of displacement of the head, or a head in a video image of the head of an individual listener taken by a video camera. It may be an image processing means for measuring the displacement amount of the above. The "body movement feature amount" may be an arbitrary numerical quantity having a correlation with the psychological state extracted from the body movement amount measured by each listener, and may be, for example, the number of nods per unit time. The standard deviation of the displacement acceleration of the head in a unit time can be used as a "body movement feature quantity". As described above, the "body movement similarity" is a numerical value expressing the degree of similarity of the body movement features between the listeners, and all of the two listeners in the audience. It may be calculated for each combination (the number of combinations of two people in the audience may be calculated as "body movement similarity"). The physical movement similarity may be any numerical value as long as it is a value that can express the degree of similarity of the physical movements of the two listeners, and specifically, the time series of the physical movement feature amount. It may be a cosine similarity calculated from data, a correlation coefficient, a cross-correlation function value, a Hamming distance, or the like. Such physical movement similarity is an index calculated based on objective measurement of physical movement, and the higher the degree of similarity between the physical movement features of the two listeners represented by the physical movement similarity, the higher the degree of similarity. It can be estimated that the psychological states of the two persons measured by an objective method are similar or close to each other.

Further, in the above configuration, the listener's "degree of empathy" is from a state in which he / she is very sympathetic to the information provided by the speaker to a state in which he / she does not sympathize at all (or a state in which he / she feels antipathy). The "empathy" is a numerical value of the "degree of empathy". The "degree of empathy" or "empathy" of each listener is determined by each listener and is given to the "empathy acquisition means" by each listener. Specifically, the "degree of empathy" may be quantified as "empathy" by the VAS (Visual Analog Scale) method, the Likert scale method, or the like. Specifically, the "empathy acquisition means" is the input of any device (computer terminal, tablet terminal, smartphone, mobile terminal, etc.) in which each listener can input his / her own "degree of empathy" or "empathy". A device that collects and determines the empathy of each listener, or each listener's "degree of empathy" described on a questionnaire or a site on the Internet (for example, the comment section of SNS). It may be a device that collects "empathy" or "empathy" and determines the empathy of each listener. The information given by the listener to the empathy acquisition means is a verbal expression of the "degree of empathy" (in this case, the "degree of empathy" mechanically or humanly in the empathy acquisition means. To determine the "empathy"), each listener may have the "empathy" by quantifying his or her own "degree of empathy". Further, in the above configuration, the "empathy similarity" is a value that numerically expresses the degree of similarity of empathy among listeners as described above, and is two of the audience. It may be calculated for each of all combinations of listeners (the number of combinations of two people in the audience may be calculated as "empathy similarity"). Specifically, the empathy similarity may be any numerical value as long as it is a value that can express the degree of similarity of the empathy of the two listeners, and in the embodiment, the empathy similarity is The larger the difference in sympathy between the two listeners, or the smaller the difference, the larger the value may be. Such empathy similarity is an index calculated based on the subjective judgment of the listener, and the higher the degree of similarity of the empathy similarity of the two listeners represented by the empathy similarity, the more subjective the method. It can be estimated that the psychological states of the two persons determined in 1 are similar or close to each other.

Then, in the above system, the "psychological state similarity evaluation means" refers to the physical movement similarity and the empathy similarity among the listeners as described above, and each of the listeners. Evaluate the degree of similarity of psychological states in. The degree of similarity in psychological states may be expressed in any format as long as the degree of similarity in psychological states among listeners can be grasped. As described in the section of later embodiments, the degree of similarity of psychological states is divided into multiple stages such as high, low, potential high, and potential low, depending on, for example, physical movement similarity and empathy similarity. It may be classified, or it may be expressed by a numerical value that changes according to the degree of similarity between body movements and the degree of empathy. In the embodiment, the degree of similarity in psychological states between listeners is expressed as "relationship between listeners".

In the above-mentioned system of the present invention, the evaluation result of the degree of similarity of psychological states is displayed on the display of any display means, for example, a computer terminal, a tablet terminal, a smartphone, a mobile terminal, or printed on paper by a printer. It is displayed as being done.

In the operation of the system according to the present invention described above, when performing one-way communication, each listener is equipped with a sensor for detecting body movement so that each listener's body movement can be detected. A video camera is arranged so that each listener's physical movement can be observed. The listeners do not have to be gathered at one venue and may be in different places (each listener receives information from the speaker at different times and in different places). It is also good.). The information heard by the audience may be provided in any format. (It may be in the form of a lecture, speech, or performance from the stage, or it may be provided by video or audio, or by distribution.) In addition, an input means for inputting the degree of empathy or the empathy to the empathy acquisition means is distributed to each of the listeners. Then, during the provision of information by one-way communication, the detection of each body movement of the listener and the collection of the degree of empathy or the empathy are executed, and the detected body movement and the collected degree of empathy or the collected sympathy are performed. From the empathy, the body movement similarity and the empathy similarity are calculated as described above, and based on these values, how similar the listeners' psychological states to the information provided by the speaker are between the listeners. Whether it is or not will be evaluated among individual listeners. In addition, the degree of empathy or the collection of empathy, the calculation of the degree of similarity between body movements and the degree of empathy, the evaluation of the degree of similarity of psychological states between listeners, and the display of the evaluation results are performed while one-way communication is being performed. It may be executed or it may be executed after the end of one-way communication. According to this configuration, it becomes possible to presume and understand which listeners have similar hobbies and tastes to each other and which listeners have conflicting tastes in the audience, and also for one-way communication. Estimate and understand who is the type of person who has similar hobbies and tastes to the audience (without having to communicate with each other individually, such as exchanging opinions). It is also possible.

In the above system, regarding the listener's physical movement and / or the degree of empathy by the listener's self-judgment, the amount of physical movement and / or the degree of empathy is measured by a plurality of methods, and the degree of similarity between them is measured. And assessing the degree of similarity of psychological states between listeners may be performed with reference to three or more similarities, and it is understood that such cases also belong to the scope of the present invention. Should be.

Thus, according to the configuration of the system for assessing the degree of similarity of psychological states between the audiences of the present invention (the system for assessing the degree of similarity of psychological states between audiences), as described above, between listeners in one-way communication. The degree of similarity of the psychological state of is presented in an easy-to-understand manner without direct communication between the listeners. In the embodiment, the degree of similarity in psychological state between listeners is simply evaluated by computer processing after collecting the degree of physical movement and empathy from each listener. In addition, the degree of similarity in psychological states among listeners can be grasped. Further, in particular, in the system of the present invention, it is based on a value determined based on an objective measurement of body movement similarity based on the listener's body movement and the degree of empathy by the listener's self-judgment. The degree of similarity of psychological states between listeners, that is, the relationship between listeners, is used in an integrated manner by using a numerical value of sympathy similarity, which is different from the value determined by individual listeners based on subjective judgment. Since it is designed to evaluate sex, it is more accurate or more precise than the case of evaluating the degree of similarity of psychological states by a single degree of similarity, and it is not too objective and too subjective. It is hoped that the degree of similarity in psychological states among listeners can be determined without. The evaluation result of the degree of similarity of psychological states between listeners in the one-way communication obtained by the system of the present invention can be used as useful information in the determination of marketing strategy and the like and the individual referral service as described above. It is expected to become.

Other objects and advantages of the invention will be apparent by the following description of preferred embodiments of the invention.

FIG. 1 is a diagram showing an outline of one configuration of an embodiment of the inter-audience relationship assessment system (a system for assessing the degree of similarity of psychological states between audiences) of the present invention. FIG. 2A is a diagram showing the inter-audience relationship evaluation process in the embodiment of the system of the present invention in the form of a flowchart. FIG. 2B shows the relationship between the two listeners (degree of psychological state) with reference to the head movement similarity and the empathy similarity of the two listeners in step 8 of FIG. 2A. ) Is shown in the form of a flowchart. FIG. 3A shows an example of the measured value of the accelerometer mounted on the listener's head in one-way communication. 3 (B) and 3 (C) show an example of the head movement feature amount of each listener extracted from the measured value of the acceleration sensor of FIG. 3 (A). (B) is the presence or absence of nodding every second, and (C) is the standard deviation of the acceleration every second. FIG. 3D shows an example of head movement similarity between two listeners. The numerical value is the cosine similarity (60-dimensional vector cosine similarity) of the two parties over 60 seconds of the standard deviation of the acceleration calculated every second. FIG. 4A is a diagram illustrating a process of quantifying the degree of empathy of a listener in one-way communication to obtain empathy, and FIG. 4B shows an example of expression of empathy. ing. FIG. 4C shows an example of the degree of empathy similarity between two listeners. 5 (A) and 5 (B) show an example of displaying the evaluation result of the relationship between listeners. FIG. 6 shows the head movement similarity (left), empathy similarity (right), and relationship evaluation results (bottom) actually obtained between the two listeners in the listener in one-way communication. An example is shown.

1 ... Audience relationship evaluation system 10 ... Data processing device 12 ... Display 14 ... Mobile terminal (smartphone, etc.)
16 ... Storage device S ... Accelerometer T ... Empathy input device A1, A2, A3, A4 ... Listener P ... Speaker

Hereinafter, the present invention will be described in detail with reference to preferred embodiments with reference to the accompanying figures. In the figure, the same reference numerals indicate the same parts.

The "inter-audience relationship assessment system 1" for assessing the degree of similarity of psychological states between audiences according to one of the preferred embodiments of the present invention with reference to the configuration diagram 1 of the system is one-way communication, that is, a speaker. In the form of communication in which the audience (group of listeners) A1, A2, ... It is used to grasp the degree of similarity between listeners (relationship between listeners) regarding the psychological state that occurs.

In the present embodiment, the one-way communication specifically means information that can be recognized by the listener's audiovisual (for example, voice) such as lectures, speeches, conferences, screenings, performances (concerts, plays, etc.), and online distribution. (Speech, music, image, video, video, etc.) may be a form of communication emitted by the speaker P. The speaker P is a general term for persons who provide the above information, and the speaker P may or may not appear in front of the audiences A1, A2, .... Further, in the present embodiment, in the one-way communication, even if the audiences A1, A2, ... Are gathered at one venue and receive information at the same time, the listeners A1, A2, ... Are individually. Information may be provided at different locations or at different times. For example, the one-way communication may be in a form in which each listener A1, A2, ... Is provided with information through online distribution using a personal computer terminal, a tablet terminal, a smartphone or the like. In the illustrated example, the number of listeners is four, but in the present embodiment, the number of listeners may be any number as long as there are a plurality of listeners.

In the configuration of the system 1, specifically, a physical movement having a correlation with the psychological state in each of the listeners A1, A2, ..., Which receives information from the speaker P, for example, the head of the speaker P. A body movement amount measuring means for numerically measuring the movement (gesture) of the part is provided. The body movement amount measuring means may be, for example, an acceleration sensor S attached to the heads of the listeners A1, A2, ... As shown in the figure to detect the acceleration of the head movement, or another head. Any type of sensor (gyro sensor, geomagnetic sensor, etc.) may be used as long as it can detect the movement of the part. Alternatively, as another embodiment, the body movement amount measuring means obtains the heads of the listeners A1, A2, ... From the moving images of the heads of the listeners A1, A2, ... It may be an image processing device (not shown) that measures the amount of displacement of the head. The output from each of the body movement amount measuring means (sensor S or image processing device) of the listeners A1, A2, ... Is received by the receiver Rs of the data processing device 10 described later, and data processing is performed. It will be used for processing in the device. The transmission of the body movement amount or the head movement amount from the body movement amount measuring means to the receiver Rs may be performed by any form of wired communication method or wireless communication method. In the following description, the case where the "body movement" is the "head movement" will be described, but the same applies to the movements of other body parts (limbs, shoulder movements, etc.). It should be understood that it belongs to the scope of the present invention.

Further, in the configuration of the system 1, the listeners A1, A2, ... Are the psychological states that the listeners themselves judge for the information provided by the one-way communication, and more specifically, the listeners themselves. Means are prepared to determine and obtain a "degree of empathy" for the information provided. As already mentioned in the "Summary of Invention" section, the listener's "degree of empathy" is from a state of being very sympathetic to the information provided by the speaker to a state of not sympathizing at all (or). It is the stage of the psychological state until the state of feeling antipathy), and it is quantified to express empathy. As a means for acquiring the "degree of sympathy", specifically, as one form, as shown in the figure, listeners A1, A2, ..., Computer terminals, tablet terminals, smartphones, mobile terminals, etc. A terminal device T of any form is provided in which the listener himself can input the "degree of sympathy" or "sympathy", and the input to the terminal device T is performed by the receiver Rt of the data processing device 10 described later. Each is accepted and used for processing in the data processing device 10. The transmission of the degree of sympathy or the sympathy from the terminal device T to the receptor Rt may be performed by any form of wired communication method or wireless communication method. Alternatively, as another aspect of the means for acquiring the "degree of empathy", a form (questionnaire form) for filling in the "degree of empathy" or "empathy" is distributed to the listeners, and one-way communication is being carried out or. After the implementation, the form is collected, the entries on the form of each listener are collected, and the "degree of empathy" or "sympathy" of each listener is input to the receiver Rt of the data processing device 10. You may be. Further, each listener's "degree of empathy" or "empathy" refers to the writing on the site (for example, the comment section of SNS) on the Internet (mechanically or humanly). The listener's "degree of empathy" or "empathy" may be determined and the results may be input to the receiver Rt of the data processing device 10.

Then, as shown in FIG. 1, in the system of the present embodiment, the data processing device 10 is in a psychological state for the information emitted by the speaker P by using the input to the receptors Rs and Rt. Perform an assessment of the relationships between listeners (degree of similarity between listeners). Specifically, the data processing device 10 is a receptor Rs that receives the amount of body movement of each listener, typically the amount of movement of the head, and a receptor that receives the degree or sensitivity of empathy of each listener. Head movement feature amount calculation unit, receptor that extracts or calculates head movement feature amount (body movement feature amount) that correlates with the psychological state of each listener from the head movement amount acquired by Rt and receptor Rs. Empathy calculation unit that calculates the empathy of each listener from the degree of empathy of each listener acquired by Rt (If the empathy from each listener is obtained by the receptor Rt, the value remains as it is. It is confirmed.), The head movement similarity calculation unit that calculates the head movement similarity between listeners from the head movement feature amount of each listener, and the sympathy similarity between listeners from the sympathy of each listener. The empathy similarity calculation unit that calculates the degree, the degree of similarity of the psychological state between listeners from the head movement similarity and the empathy similarity, that is, the audience relationship evaluation that evaluates the relationship between listeners. It includes a section and a result output section that outputs the evaluation result of the relationship between the audience. The data processing device 10 may typically be a computer device, and in a normal manner, a CPU, a storage device, and an input / output device (I / O) connected to each other by a bidirectional common bus (not shown). O) is equipped, and the operation of each part of the device is achieved by executing a program in the CPU. The operation of each part in the device will be described in the following description of "operation of the system". Then, the evaluation result of the inter-audience relationship of the data processing device 10 may be transmitted from the result output unit to the display 12 or the mobile terminal 14 of an arbitrary terminal device, displayed, or printed on paper, or may be printed on paper. The rating result may be transmitted to and recorded in any storage device 16.

System operation In one- way communication, in general, the stronger the listener's tendency to perform head movements such as nodding and aizuchi or other synchronized body movements synchronized with the information provided, the more provided. It has been reported that the degree of satisfaction with the information provided is high. However, the inside of a person is also diverse, and there are many cases in which he does not sympathize at all despite showing a strong nod, and vice versa. On the other hand, when the listener self-determines the degree of empathy and declares it, he / she may declare that he / she sympathizes even though he / she does not actually sympathize with it, or vice versa. In this system, when grasping the degree of similarity of psychological states between audiences, the degree of similarity of psychological states between audiences (head movement similarity) is calculated from the amount of head movement features based on objective measurement, and is subjective. The degree of similarity in psychological states between the audience (sympathy similarity) is calculated from the empathy based on the general declaration, and the audience is integrated and more precise by referring to the head movement similarity and the empathy similarity. Attempts are made to assess the degree of similarity between the psychological states. In the processing of the system of the present embodiment, as shown in FIG. 2 (A), specifically, (a) from the measured value of the head movement of each listener in one-way communication. Extraction of head movement features that correlate with psychological state (steps 1 and 2), (b) Calculation of head movement similarity between listeners (steps 3 and 4), (c) Self-judgment of each listener Collection of empathy indicating the degree of empathy by (step 5), (d) calculation of empathy similarity between listeners (steps 6 and 7), (e) evaluation of relationships between listeners (step 8), (F) Presentation, display or output (step 9) of the evaluation result is executed. Hereinafter, each processing operation will be described with reference to the drawings.

(A) Measurement of head movement of each listener and extraction of head movement feature amount (steps 1 and 2)
As already mentioned, the measurement of the head movement of each listener is the measurement of the acceleration in the head displacement by the acceleration sensor S attached to the head of each listener, or each listener in the image of the video camera. It is performed for each listener by measuring the displacement of the image of the head of the head (step 1). For example, the head displacement acceleration of each listener measured by the acceleration sensor S is measured in time series as illustrated in FIG. 3A. When other sensors are used, even when the displacement amount of the head of each listener in the video camera image is measured, the measured value is obtained in chronological order although the unit of the measured value is different. Thus, when the time-series data of the head movement amount of each listener is obtained, the head movement feature amount having a correlation with each psychological state of the listener is the time-series data in the head movement feature amount calculation unit. Is calculated as (step 2). Specifically, the head movement feature amount is the number of nods per unit time (Fig. 3 (B)), the standard deviation of the displacement acceleration of the head in a unit time (Fig. 3 (C)), and the like. It may be (the unit time may be set according to the fit, for example, 1 second).

(B) Calculation of head movement similarity between listeners (steps 3 and 4)
When the head movement feature amount of each listener is calculated, the head movement similarity indicating the degree of similarity of the head movement between the listeners is calculated (head movement similarity calculation unit). The head movement similarity is calculated using the head movement features of the two audiences for all combinations of the two audiences in the audience (step 4). As already mentioned, it is presumed that the more the head movement or other physical movement is synchronized with the provided information, the greater the degree of satisfaction and empathy for the provided information. However, it is presumed that the psychological states of the two listeners are so similar that the timings of the head movements or body movements such as nodding and empathy are similar or the same. .. Thus, as the head movement similarity, any numerical value capable of measuring the degree of similarity in the timing of such head movement or body movement may be adopted. Specifically, the head motion similarity may be the cosine similarity of the time-series data of the head motion features of the two listeners, the correlation coefficient, the cross-correlation function value, the Hamming distance, and the like. It should be noted that the head movement similarity is usually calculated so that the higher the degree of similarity between the listeners in the head movement, the larger the value, but the head movement similarity is not limited to this. Then, as illustrated in FIG. 3D, the head movement similarity is calculated for each of the combinations of the two audiences in the audience. The illustrated example is the cosine similarity of the time-series data of the standard deviation values of the head accelerations of the two parties (the standard deviation values of the head accelerations per second over 60 seconds were used as the components of the 60-dimensional vector. ).

(C) Collection of empathy indicating the degree of empathy by self-judgment of each listener (step 5)
Apart from the above steps 1 to 4, the collection of empathy representing the degree of empathy of each listener is performed. As already described, the degree or sympathy of each listener's self-judgment is collected through the input to the terminal device T distributed by each listener or the description on the form or the like. Specifically, the degree of sympathy of each listener is any of the states from the state of not sympathizing with the information provided by the speaker P to the state of sympathizing with the information provided by the speaker P, as schematically shown in FIG. 4 (A). Each listener decides whether or not he / she is in the stage, decides and inputs it, or describes it in the wording. Then, the degree of empathy of the input or description is quantified as empathy as schematically depicted in FIG. 4 (B). Typically, the empathy may be determined by setting the non-empathy state to 0, the empathy state to 100, and the like so that the stronger the degree of empathy, the higher the empathy (empathy is the empathy). The lower the value, the lower the value may be set.) The quantification from the degree of sympathy to the sympathy may be performed by the VAS (Visual Analog Scale) method, the Likert scale method, or the like. When each listener expresses the degree of empathy in words or inputs at the position on the scale bar as illustrated in FIG. 4 (A), the empathy calculation unit determines the degree of empathy by the machine. It is quantified as empathy. Further, when each listener inputs the sympathy to the terminal device or the like, the sympathy calculation unit may execute a process of confirming the numerical value, or the sympathy calculation unit may be omitted.

(D) Calculation of empathy similarity between listeners (steps 6 and 7)
When the empathy of each listener is collected, the empathy similarity indicating the degree of similarity of the empathy between the listeners is calculated (empathy similarity calculation unit). Empathy similarity is calculated using the empathy of two audiences for all combinations of two audiences in the audience (step 7). The degree of empathy similarity is usually calculated so that the higher the degree of similarity of empathy between listeners, the larger the value, but the degree of empathy similarity is not limited to this. As an example, for example, empathy similarity is
Empathy similarity = 100- [Difference in empathy between two listeners]
(In this case, the higher the degree of similarity of empathy, the higher the degree of empathy similarity). Then, as illustrated in FIG. 4C, the empathy similarity is calculated for each of the combinations of the two audiences in the audience.

(E) Assessment of relationships between listeners (step 8)
When the head movement similarity and the empathy similarity between listeners are calculated, the relationship between listeners, that is, between listeners, is referred to by the inter-listener relationship evaluation unit with reference to these values. A rating of a similar degree of psychological state is performed. In such an evaluation, various evaluations may be made depending on the combination of the degree of similarity of the psychological states represented by the head movement similarity and the empathy similarity. Specifically, for example, when both the head movement similarity and the empathy similarity are calculated so that the larger the degree of similarity, the larger the value, the relationship with a certain listener Ai, Aj. As illustrated in FIG. 2B, whether or not the head movement similarity Vsij between the listeners Ai and Aj is larger than the threshold value Ths, and whether the listeners Ai and Aj are evaluated. The relationship between the listeners Ai and Aj may be evaluated separately depending on whether or not the empathy similarity Vtij between them is larger than the threshold value Tht. In the illustrated example, it is rated as follows.
(I) In the case of Vsij> Ths and Vtij> Tht 1: High relationship-Psychological states are similar in both objective and subjective judgments. Have a relationship. There is a high possibility that the pair can communicate smoothly.
(Ii) In the case of Vsij ≤ Ths and Vtij ≤ Tht 2: Low relationship-Relationship because the psychological states are dissimilar in both objective and subjective judgments. Is estimated to be low.
(Iii) In the case of Vsij ≤ Ths and Vtij> Tht 3: Potential high relationship-Psychological state is similar only by subjective judgment. .. There is a possibility that the pair can communicate smoothly.
(Iv) In the case of Vsij> Ths and Vtij≤Tht 4: Potential low relationship-Psychological states are dissimilar only by subjective judgment. Similar movement patterns are performed, but the way of expressing emotions is different.
The above rating may be performed on all combinations of two listeners in the audience. Thus, by referring to the degree of psychological state similarity between listeners obtained through multiple processes of head movement similarity and empathy similarity, the degree of psychological state similarity between listeners is evaluated more closely. It becomes possible to do.

(F) Presentation, display or output of rating results (step 9)
Thus, when the relationship between the audience is evaluated as described above, the result is displayed in various formats on the display 12, the mobile terminal 14, the paper medium (not shown), or the like of any terminal device. Alternatively, it is stored in the storage device 16. In one form of result display, the relationships between the audience may be visualized in tabular form, as illustrated in FIG. 5 (A). Alternatively, as schematically shown in FIG. 5B, the relationship between the audience may be visualized in the form of a network diagram in such a manner that the type of relationship can be grasped between the listeners.

In the above process, the measurement of the amount of head movement (step 1) is executed during the execution of the one-way communication, while the other processes are performed either during the implementation of the one-way communication or after the execution. It may be practiced and it should be understood that it falls within the scope of the invention in any case.

FIG. 6 shows the results when the head movement similarity and the empathy similarity are calculated and the inter-listener relationship is evaluated when there are four listeners during a certain one-way communication by this system. Is shown. In the figure, the numerical values indicate the degree of head motion similarity and the degree of empathy similarity between listeners, respectively. As shown in the figure, according to this system, the relationship between listeners can be evaluated in more detail based on the judgment result of the psychological state of the listener by both objective and subjective methods in one-way communication. ..

Although the above description is made in relation to the embodiments of the present invention, many modifications and modifications can be easily made by those skilled in the art, and the present invention is limited to the embodiments exemplified above. It will be apparent that, without limitation, it applies to various devices without departing from the concept of the present invention.

Claims (1)

It is a system that evaluates and presents the degree of similarity of psychological states among the plurality of listeners in one-way communication in which a plurality of listeners listen to the information provided by the speaker.
A body movement amount measuring means for measuring a body movement amount numerically expressing the magnitude of each body movement of the listener having a correlation with each psychological state of the plurality of listeners, and a body movement amount measuring means.
A body movement feature amount extracting means for extracting a body movement feature amount having a correlation with the psychological state from the measured body movement amount for each of the listeners.
A body movement similarity calculation means for calculating the body movement similarity, which numerically expresses the degree of similarity of the body movement feature amounts among the listeners, and the body movement similarity calculation means.
An empathy acquisition means for acquiring empathy that numerically expresses the degree of empathy of each of the plurality of listeners with respect to the information provided by the speaker, which is determined by each of the plurality of listeners.
An empathy similarity calculation means for calculating the empathy similarity, which numerically expresses the degree of similarity of the empathy among the listeners.
Psychological state similarity evaluation means for evaluating the degree of similarity of psychological states among the plurality of listeners based on the physical movement similarity and the sympathy similarity, and each of the plurality of listeners. A system including a display means for displaying the degree of similarity of the psychological state.

Images