WO2019146767A1

WO2019146767A1 - Emotional analysis system

Info

Publication number: WO2019146767A1
Application number: PCT/JP2019/002570
Authority: WO
Inventors: 久和正岡
Original assignee: 久和正岡
Priority date: 2018-01-26
Filing date: 2019-01-25
Publication date: 2019-08-01
Also published as: JP2021052812A

Abstract

Provided is an emotional analysis system that analyzes the emotions of a subject and then performs a notification concerning the emotions. The emotional analysis system (10) comprises a detection unit (11) that detects the heart rate and temperature of the subject. The emotional analysis system (10) comprises an acquisition unit (12) that acquires the heart rate and temperature detected by the detection unit (11), and analyzes the emotions of the subject. The emotional analysis system (10) comprises a notification unit (13) that categorizes the emotions obtained as a result of the analysis by the acquisition unit (12) into a plurality of categories, and performs a notification concerning the emotions. The notification unit (13) comprises a display unit. The emotions are categorized into a plurality of categories. The plurality of emotions are allocated a plurality of different colors. The notification unit (13) uses the display unit to display the colors corresponding to the emotions.

Description

Emotion analysis system

Cross-reference to related applications

This application is based on Japanese Patent Application No. 2018-11827 filed on January 26, 2018, the contents of which are incorporated herein by reference.

The present disclosure relates to a system for analyzing a subject's emotions.

Patent Document 1 and Patent Document 2 disclose techniques for estimating a subject's emotion.

JP, 2017-86992, A JP, 2012-059107, A

The purpose of this disclosure is to provide an emotion analysis system that analyzes and reports the subject's emotions. Another object of the present disclosure is to provide an emotion analysis system that intuitively reports subject's emotions in a form that can be understood by anyone. Yet another object of the present disclosure is to provide an emotion analysis system that supports the improvement of the subject's emotions. Another object of the present disclosure is to provide an emotion analysis system that modifies a subsequent improvement based on the subject's emotion and the change in emotion after the improvement of the emotion provided for the emotion. It is.

In order to solve the above problems, the present disclosure includes the following configurations.

A detection unit for detecting the heart rate and body temperature of the subject, an acquisition unit for acquiring the heart rate and body temperature detected by the detection unit and analyzing the emotion of the subject, and the emotion analyzed by the acquisition unit Emotion analysis system provided with a notification unit for giving notification.

In the emotion analysis system, the notification unit classifies the emotions analyzed by the acquisition unit into a plurality of categories, and uses the classified emotions as visual information including at least one of color, numbers, characters, symbols, pictures, and patterns. At least one of a display unit to be displayed, a sound output unit outputting by auditory information including at least one of sound, voice, and music, or a tactile sensation output unit outputting by tactile information including vibration, shape, and surface roughness Equipped with

In the emotion analysis system, the notification unit notifies an improvement measure for improving the emotion analyzed by the acquisition unit.

In the emotion analysis system, the notification unit notifies a maintenance measure for maintaining the emotion analyzed by the acquisition unit.

In the emotion analysis system described above, the acquisition unit analyzes the subject's emotion based on the Russell circle, and the notification unit determines from the left half side the right half when it is determined that the discomfort area is the left half of the Russell circle. And output at least one of visual information, auditory information, and tactile information that changes the subject's emotion to the pleasure area of the subject.

In the emotion analysis system, the acquisition unit analyzes the subject's emotion based on the Russell circle, and the notification unit is visual information or auditory information that changes the subject's emotion toward the radial center of the Russell circle. Output at least one of dynamic information and tactile information.

The notification unit outputs a message prompting a change from the subject's current action to a different action when improving the feeling, and / or directly to the subject when maintaining the feeling or An emotion analysis system that outputs messages that give awards indirectly.

A detection unit for detecting a subject's heart rate and body temperature, and a heart rate, in an emotion analysis system having a wearable terminal worn by the subject and a portable terminal that transmits / receives electronic signals and data to / from the terminal wirelessly or by wire. An acquisition unit for acquiring the body temperature and analyzing the emotion, and a display unit for displaying the analyzed emotion are provided. The wearable terminal includes the detection unit and the display unit, and the portable terminal includes the acquisition unit and the display unit The emotion analysis system further includes a communication unit on which the wearable terminal and the portable terminal communicate by either wireless communication or wired communication.

The portable terminal is provided with a plurality of verbal messages representing emotions, and among the messages, ones according to the emotion are automatically visually displayed on the display unit of the wearable terminal and the portable terminal, And / or an emotion analysis system including a sound output unit that outputs a message by voice.

The subject can input a subject message of a reply or a reply from the terminal in response to the message displayed on either the wearable terminal or the portable terminal, or both, and another separated display means. An emotion analysis system comprising: a conversation providing unit which enables the portable terminal to send a reply to the subject message.

It is a figure which shows the basic composition of an emotion analysis system. It is a Russell circle that analyzes emotions from the subject's heart rate and skin temperature. It is a flowchart which shows the basic function of an emotion analysis system. It is a flowchart which shows an emotion analysis method. It is a block diagram of a 1st embodiment. It is a block diagram of 2nd Embodiment. It is a figure showing an example of a wearing type terminal or a portable terminal, and its display part. It is a figure which shows the example of a wearable terminal, a portable terminal, and its connection. It is a block diagram of 9th Embodiment.

Hereinafter, embodiments of the present disclosure will be described based on the drawings. In the following embodiments, parts that are the same as or equivalent to each other will be described with the same reference numerals.

First Embodiment
The emotion analysis system according to the first embodiment will be described with reference to FIGS. 1 to 5.

The basic configuration of the emotion analysis system is shown in FIG. Here, although the emotion analysis system functioning as an emotion analysis improvement system is shown, a configuration without the function may be employed. As shown in FIG. 1, the emotion analysis system 10 (EANA) includes a detection unit 11 (DET), an acquisition unit 12 (ACC), and a notification unit 13 (NOT).

The detection unit 11 for detecting the heart rate and the body temperature of the subject can be provided by the wearable terminal 1a worn on the subject or the wearable measurement instrument 1b worn on the subject. The wearable terminal 1a can be provided, for example, by a detachable watch-type terminal. The wearable measuring instrument 1b can be provided, for example, by a terminal taped to the skin, or an implant implanted subcutaneously. The detection unit 11 accumulates the subject's heart rate and body temperature over a fixed period of time. Such data storage is realized by a non-transitional tangible memory device.

The acquisition unit 12 can be provided by a so-called computer system. The computer systems can be arranged centrally or decentrally. The acquisition unit 12 can be provided, for example, on the wearable terminal 1a worn on the subject. In addition, the acquisition unit 12 can be provided on the wearable terminal 1a and various

terminal devices

2a, 2b, and 3a (see FIGS. 6 and 9) disclosed in the embodiments described later. The acquisition unit 12 may be provided in a device different from the subsequent notification unit 13. In addition, one or more acquisition units 12 may be provided for one subject. The acquisition unit 12 can be provided in a terminal device available to the user.

The notification unit 13 classifies and reports the emotions analyzed by the acquisition unit 12 into a plurality. The notification unit 13 can be provided in the wearable terminal 1a. In addition, the notification unit 13 can be provided to the wearable terminal 1a and various

terminal devices

2a, 2b, and 3a disclosed in the embodiments described later. One or more notification units 13 may be provided for one subject. The notification unit 13 can be provided in a terminal device available to the user.

The notification unit 13 can include a display unit that displays classified emotions using visual information including at least one of color, numbers, characters, symbols, pictures, and patterns. The notification unit 13 can include a sound output unit that outputs classified emotions as auditory information including at least one of sound, voice, and music. The notification unit 13 can include a tactile sensation output unit that outputs classified emotions as tactile information including vibration, shape, and surface roughness. The notification unit 13 can include at least one of a display unit, a sound output unit, and a tactile sensation output unit.

The notification unit 13 preferably includes at least a display unit. Furthermore, in this embodiment, it is desirable to provide a display that can assign different emotions to different colors and display emotions in color in order to intuitively intelligibly convey emotions. Furthermore, the notification unit 13 may notify of an improvement measure for improving the emotion analyzed by the acquisition unit 12. The notification unit 13 may provide a message for supporting improvement in the subject's emotion by the display unit, the sound output unit, or the tactile sensation output unit.

This embodiment, as shown in FIG. 5, has a wearable terminal 1a provided with a display unit 1c for displaying the analyzed emotion. In addition, the detection unit 11 may be worn apart from the wearable terminal 1a as the wearable measurement device 1b and apart from the wearable terminal 1a and worn on the skin of the subject's body, for example, the heart. In this case, the wearable terminal 1a and the wearable measurement device 1b can be connected by any communication means, for example, wireless communication, so that heart rate and body temperature data can be transmitted and received mutually. The communication means is provided by the communication unit 1d provided in the wearable terminal 1a and the communication unit 1e provided in the wearable measurement instrument 1b.

The emotion analysis method is performed, for example, as follows. The wearable terminal 1 a or the wearable measurement device 1 b functions as the detection unit 11. The detection unit 11 measures the heart rate and the skin temperature of the subject. The acquisition unit 12 analyzes the subject's emotion based on the chart of FIG. 2 from the measured heart rate and skin temperature. In this embodiment, analysis is performed by the computer system of the wearable terminal 1a.

The notification unit 13 displays the emotion analyzed by the acquisition unit 12 on the display unit 1 c of the wearable terminal 1 a. The display unit 1c may be a light emitter such as an LED, or may be a screen using liquid crystal or the like. An aspect of the display is a number, a symbol, a character or the like indicating an emotion with a color corresponding to the emotion as a basic element.

The wearable terminal 1a also has a tactile sensation output unit provided by a motor called a vibrator. When the subject's emotion enters the caution zone and the danger zone shown in FIG. 2, the notification unit 13 of the wearable terminal 1a vibrates in small steps in each pattern to intuitively indicate to the subject the transition to the caution zone and the danger zone. Also has the ability to

In the caution zone, the color of emotion in the area is continuously turned on by the notification unit 13, and when it enters the danger zone, it is blinked and displayed intermittently. By doing this, the subject can objectively know his / her own emotion by himself, and a person who looks at the informing unit 13 such as a supporter of the subject can know the subject's emotion.

Here, the wearable type refers to a type in which data such as heart rate and body temperature can be detected without the intention of measurement while the subject's body is constantly touched.

<Basic configuration of system>
As described above, the emotion analysis system 10 (EANA) includes the detection unit 11 (DET), the acquisition unit 12 (ACC), and the notification unit 13 (NOT). The detection unit 11 measures the heartbeat and the temperature of the subject 31 (EXP). The acquisition unit 12 is analyzed by a Russell circle calculation unit 14 (CAL) that calculates coordinates on the Russell circle, and an analysis unit 15 (ANA) that analyzes emotions using the coordinates on the Russell circle as main elements. And a notification data generation unit 16 (CRE) that generates notification data from the selected emotion. The notification data generation unit 16 generates notification data for notifying the analyzed emotion in a color that is easy for anyone to understand.

The emotion analysis system also includes an advice generation unit 17 (ADV) for functioning as an emotion analysis improvement system. The advice generation unit 17 generates a visual or audio message to improve emotions. That is, the advice generation unit 17 generates a message that is effective to move the current coordinates on the Russell's ring close to the origin of the ring radial direction. If there is a current coordinate in the annoyance area of the left half of the torus, then generate a message that is validated to move it to the side of the pleasure area of the torn right half. These messages inform the subject's feelings at that time and encourage them to take some other action, such as the following. "Now I feel like I'm unstable." "Let's go away from where you are, take three deep breaths." "Let's stop what you are doing and take three deep breaths."

Further, when the current coordinates on the Russell's ring are in the right area of the right half of the ring, the advice generation unit 17 maintains the state in that area, and further, a direction closer to the origin in the ring radial direction. Generate a message that is validated for transfer to These messages inform the subject's emotions at that time, acknowledge the emotion maintenance efforts so far, and encourage their continuation. For example: "I have been feeling calm for over two hours so far." "This is the third longest record of maintaining your emotions. We have achieved great results." "How about taking your favorite treat? "Let's take three deep breaths to keep this feeling as long as possible."

As a result, the notification unit 13 not only indicates the analyzed emotion of the subject 31 but also notifies a message. Moreover, this message includes an action change message and / or a reward message. Additionally, the message may additionally include a recommendation action message.

In order to improve the analyzed emotion, the notification unit 13 outputs an action change message prompting a change from the current action of the subject 31 to another different action. The action change message is given to the subject 31 directly or indirectly. The action change message may be given to the supporter 32. The supporter 32 having received the action change message can work on the subject 31 to change the action of the subject 31.

In order to maintain the analyzed emotion, the notification unit 13 outputs a reward message that directly or indirectly gives a reward to the subject 31. The reward message may be given directly to the subject 31. Further, the reward message may be given to the supporter 32. In this case, a reward may be given to the subject 31 from the supporter 32. The award includes at least one of a word that compliments the subject 31, a favorite item that the subject 31 likes, an article that the subject 31 likes, an image, and the like.

When improving the emotion, the notification unit 13 may output a recommended action message indicating an action of the subject 31 effective to improve the feeling. Moreover, the alerting | reporting part 13 may output the recommendation action message which shows the test subject's 31 action effective in order to maintain an emotion, when maintaining an emotion. The recommended action message is exemplified by, for example, "deep breathing".

The messages are preset and stored in the storage device. For example, a plurality of messages for returning anger's emotions to calm emotions are stored in advance. For example, the advice generation unit 17 generates a message so as to increase the strength in order according to the strength data set in advance for each message. The advice generation unit 17 uses the data calculated by the Russell circle calculation unit 14 to generate a message. The advice generation unit 17 uses the notification unit 13 to notify a user of a subject including the subject and the supporter.

Furthermore, this emotion analysis system comprises a learning unit 18 (LEA). The learning unit 18 evaluates the effect (effect) of the generated old message based on the feedback information, and changes the subsequently generated new message. The change of the message based on such feedback information is called learning control. The change or change of the message is performed by selecting a previously stored message. The change or change of the message is given by, for example, a change of the end word strength. The change or change of the message may be implemented by the additional storage of a new message obtained by data integration with another emotion analysis system and the use of the new message. Alternatively, the change or change of the message may be implemented by storing a new message obtained by data integration with another emotion analysis system and switching to the new message.

One piece of feedback information can be obtained from changes in the coordinates of the most recent emotion on the Russell circle after the old message. The effectiveness of the old message is evaluated depending on whether the change from the old coordinate to the new coordinate is the approach to the target coordinate or the separation from the target coordinate. In order to obtain feedback information, the learning unit 18 obtains coordinate information from the Russell circular calculation unit 14. One piece of feedback information is obtained from the subject's declaration, ie, input to the system. One piece of feedback information is obtained by a declaration from the supporter 32 (SUP), that is, an input to the system. By making the declaration from the supporter 32 one of feedback information, objective learning becomes possible. The declaration from the user including the subject 31 or the supporter 32 is input from the teaching unit 19 (TEA) to the learning unit 18.

By providing such a learning control function, the emotion improvement function by providing a message can be adapted to the individuality of the subject. Specifically, the message is adjusted so that emotion can be more easily improved. Also, by providing such a learning control function, the message is adjusted so that the desired change in emotion occurs.

A part or the whole of the notification unit 13 may be provided by artificial intelligence 20 (ATI). The emotion analysis system provides analysis of emotions, selection and display of messages, and transmission and reception of messages by a server system equipped with an artificial intelligence 20. This server system may be placed in independent hardware or may be placed on the cloud. The history information including the message provided from the artificial intelligence 20 to the subject 31 and the feedback information corresponding to the message are all recorded in the artificial intelligence 20. As a result, the effect of the message maintaining the emotion in the safe zone, or the effect of the message returning the emotion in the attention zone or the danger zone to the safe zone is automatically accumulated. As a result, a message having a high effect of maintaining the subject's emotion in a good state and a message having a high effect of changing the subject's emotion to a good area are learned. Artificial intelligence is set to increase the frequency with which these high-effect messages are played back. Also, the artificial intelligence 20 itself creates a message by these learnings.

The artificial intelligence 20 integrates learning data of a plurality of emotion analysis systems 21 (EANAS) regarding a plurality of subjects 33 (EXPA). The answer from the artificial intelligence to a certain subject is selected from learning data collected for a specific subject 33 and learning data collected from other subjects. This will make the more relevant linguistic messages faster to create and send.

The artificial intelligence 20 includes an environment detection unit 22 (EDET) that detects an environment in which the subject 31 is placed. The environment detection unit 22 detects information of the environment in which the subject 31 is placed. The environmental information includes at least one of date and time, temperature, humidity, barometric pressure, ambient noise level and sound quality, ambient people, and ambient brightness. The artificial intelligence 20 providing the learning unit 18 relates the change in coordinates, that is, the change in emotion, to the environment by monitoring the change in coordinates on the Russell's circle and the environment. Thereby, the change in emotion is predicted from the change in environment, and the predicted change in emotion is notified to the subject. As a result, it is possible to prevent excessive swings of emotions in advance. Furthermore, artificial intelligence 20 may automatically generate a new message by correlating the change of emotion with the change of environment.

<Method to analyze emotions>
The idea of analyzing emotion using the subject's biological information, here heart rate HR and body temperature BT, is shown in FIG. First, each normal value is calculated as a normal value STD from the data of heart rate and body temperature detected from the subject. The numerical value of the state in which the subject is at rest may be used as a normal value, for example, if it is the body temperature, the numerical value at the time of awakening may be used. Also, the maximum and minimum values of the subject's heart rate and body temperature are measured.

The maximum and minimum values are the maximum and minimum heart rate or temperature in the daily life of the subject. For example, it refers to the maximum or minimum value recorded during daily measurements. These numerical values are regarded as temporary maximum and minimum values, and from the next day, if there is a value exceeding these temporary maximum and temporary minimum values, the previous maximum value or minimum value is updated. If there is no value exceeding, use the maximum and minimum values up to the previous day without updating. The normal value and the maximum and minimum values may be given as initial values. Then, from the following equation, the ratio of the current measurement value to the maximum value and the minimum value can be obtained for each of the heart rate and the temperature based on the normal value.

If the measured value is above the normal value,
(Measured value-normal value) / (maximum value-normal value) / 100 (%) (Equation 1)
If the measured value is less than the normal value,
(Measured value-normal value) / (minimum value-normal value) / 100 (%) (Equation 2)

The proportions thus determined are plotted on a graph with the heart rate on the vertical axis and the body temperature on the horizontal axis. Furthermore, the graph is superimposed on Russell's ring model. According to Russell's circle model, human emotions are (1) awakening ARS, (2) pain DST, (3) sadness MIS, (4) depressive DEP, (5) sleepiness SLP, (6) satisfied CNT, (7 ) 8 types of pleasure PLS, (8) excitement EXC. These emotions are arranged in 45-degree steps on a circle: 0 degrees: pleasure, 45 degrees: excitement, 90 degrees: awakening, 135 degrees: pain, 180 degrees: sadness, 225 degrees: melancholy, 270 degrees: sleepiness, 315 degrees: Satisfied.

Also, it is known from psychology research that human body temperature rises in a state of pleasant emotion and falls in a state of discomfort (eg sadness). It is known from biological research that human heart rate rises in awake state and falls in sleepy state. Therefore, the relationship between human emotion, heart rate and body temperature can be arranged as shown in FIG. Assign each axis of emotion +22.5 degrees to -22.5 degrees or 45 degrees wide. Then, it is determined that the area where the plotted place is applicable is the subject's emotion at that time. The zero point on the axis indicates that both the heart rate and the body temperature are normal values.

The position of the plot on the toric model indicates one of eight emotions. Therefore, in this embodiment, the emotion of the subject is analyzed as one of a plurality of categories based on the intersection of the subject's heart rate and body temperature on Russell's ring model.

In addition, the radius of the disk is divided, for example, into three in accordance with the ratio of heart rate and body temperature measurements to the maximum value MAX and the minimum value MIN. That is, for example, 0% to 25% is a safety zone STB, 25% to 70% is a caution zone CAT, and 70% or more is a danger zone WAR. The division ratio and the number of divisions may be changed to, for example, four divisions according to the subject's psychological physical condition.

Assign eight colors to the eight emotions analyzed. For example, pain is red, sadness is orange, depression is purple, sleepiness is yellow, satisfaction is blue, pleasure is green, excitement is pink, arousal is light blue (light blue). Alternatively, each emotion may be assigned a number, and the category may be displayed as a percentage (for example, 65%). However, the safe zone is displayed in the color of "pleasure" regardless of emotion.

<Basic functions of emotion analysis system>
FIG. 3 shows a flow of processing S161 for analyzing and improving emotions. In step S162, the emotion analysis system detects biological information of the subject, such as heart rate, body temperature, blood oxygen concentration, and facial expression. In step S163, the emotion analysis system analyzes the subject's emotion using the detected biological information. In step S164, the emotion analysis system determines whether the analyzed emotion is bad or good. Judgment here is judged based on the coordinate which the test subject's living body information on a Russell circle shows. The emotion analysis system notifies in step S165 or step S167 that the subject can recognize his or her own objective emotion.

If the analyzed emotion is a bad emotion such as anger or sadness, the emotion analysis system provides a message to improve the emotion into a good emotion in step S166. That is, if the subject's emotion is shown in the left half of the Russell's circle, a message is provided to move the subject's emotion to the right in the Russell's circle.

The emotion analysis system provides a message to the subject to maintain a good emotion in step S168 if the analyzed emotion is a good emotion such as pleasure or satisfaction. That is, if the subject's emotion is shown in the right half area of the Russell circle, a message is provided to maintain the subject's emotion in the right half area of the Russell circle.

The provided message can be said to be a positive response to subjects who are not merely informed. The notification in step S165 or step S167 and the provision of the message in step S166 or step S168 are performed by the notification unit 13.

<Flow chart of emotion analysis>
FIG. 4 shows the process from S162 to S167 in more detail. First, in step S151, the system inputs the subject's heart rate and body temperature. The system accumulates heart rate and body temperature in step S152. In step S153, the system calculates the above-described normal value and the maximum and minimum values. The system analyzes the subject's current emotion from the heart rate and the temperature in step S154.

The system reports the subject's emotion in step S155. In step S156, the system identifies a color pre-assigned to the current emotion. The system displays the specified color on the notification unit 13 in step S157.

At this time, the notification unit 13 may display not only the color of the analyzed emotion but also Russell's ring model. Furthermore, the notification unit 13 may display a plot based on the subject's heart rate and body temperature. Specifically, the notification unit 13 displays a Russell ring model as a line drawing, displays a plot as a point, and further displays a color indicating an emotion at that time as a background color. In step S158, the system selects and switches between continuous lighting and blinking lighting of the background color according to the plot position on Russell's ring model. Processing for such an emotion analysis method is repeatedly performed.

According to the emotion analysis system, the subject 31 can objectively grasp his / her emotion and the degree thereof. In particular, anyone can intuitively grasp emotions by the color of the notification unit 13. Therefore, when the subject 31 is ASD (Autism Spectrum Disorder), it is possible to objectively recognize changes in one's emotions. In a notable case, the subject 31 can take an action to objectively recognize changes in his / her emotions before the emotions become difficult to control, and to prevent the emotions from becoming difficult to control. When the subject 31 is a typical developing person, it can be dealt with before his or her degree of stress rises. As a result, the emotion analysis system can reduce the psychological and mental burden on the subject 31 in daily life. In this way, the emotion analysis system analyzes emotions, displays them objectively by visual information including color, and makes the subject 31 or the supporter 32 recognize. Furthermore, the emotion analysis system not only informs the analyzed emotions, but causes the subjects 31 and the supporter 32 to recognize the deterioration of the emotions.

Furthermore, the emotion analysis system not only makes the emotions recognized but also provides additional information to maintain good emotions and / or additional information to improve the deteriorated emotions. The provision of the additional information may store a plurality of additional information in advance in a storage medium such as a semiconductor memory, and select and reproduce the plurality of additional information stored. Also, the additional information may be learned in actual use. Also, additional information may be added by the user. Also, the additional information may be added via the network such as the Internet or selected on the network.

The additional information is provided as information that can be understood by the user, such as text and voice. In addition, the additional information may be in the form of an aid to draw the user's attention. The additional information may include, for example, text and / or voice presented with a pictorial image such as a cartoon character that is subject to the subject's 31 attention. A pictorial image such as a cartoon character can draw the attention of the subject 31 even when the subject's 31 emotion is getting worse.

In addition, when the subject 31 is a low-aged person such as a primary school student of ASD or a patient with dementia, the supporter 32 can also grasp the emotion of the subject 31. The supporter 32 includes a guardian of the subject 31, a helper of the subject 31, or an employee of a support organization. Therefore, it is possible to provide effective support and assistance that are in line with the feelings of the subject 31 and that are not wasted.

Second Embodiment
A second embodiment is shown in FIG. The second embodiment includes, in addition to the first embodiment, a portable terminal 2a such as a smartphone or a tablet. The wearable terminal 1a, the wearable measuring instrument 1b, and the portable terminal 2a are connected by any communication means, for example, wireless communication, and can transmit and receive heart rate and body temperature data to each other.

An example of the wearable terminal 1a or the portable terminal and its display unit 1c is shown in FIG. For example, a circular portion 1c1 is present at the top of the display unit 1c, and the analyzed emotion is displayed in color here. Below the circular portion 1c1, there are message fields 1c2 and 1c3 which become portions for displaying verbal messages. A message to the subject for the purpose of feeling improvement or feeling maintenance is displayed in the subject-oriented message column 1c2. The input message of the reaction from the subject to it is displayed in 1c3. Further, the circular portion 1c1 may display the Russell's ring model of FIG. 2 to which a heart rate and a temperature index are added.

Further, FIG. 8 shows an example in which the detection unit 11 and the display unit 1c are mounted on the wearable terminal 1a in the second embodiment.

An example in which the wearable terminal 1a and the portable terminal 2a are connected by the wired communication means 41 is also shown in FIG. The wired communication means is, for example, a USB cable.

In addition to the operation example of the first embodiment, one example of the operation is to analyze the subject's emotion also with the portable terminal 2a. The heart rate and skin temperature of the subject are measured by the wearable terminal 1a or the wearable measurement device 1b. From the measured heart rate and skin temperature, the emotion of the subject is analyzed by the portable terminal 2a based on the concept of FIG. The analyzed emotion is displayed on both the portable terminal 2a and the wearable terminal 1a, or one of these display units.

Yet another operation example is to use another device 2b such as a screen of a personal computer or a television monitor instead of the portable terminal 2a or in addition to the portable terminal 2a. The emotion analyzed by the portable terminal 2a is also displayed on another device 2b such as a screen of a personal computer or a television monitor. This enables the supporters around the subject to confirm the subject's emotions.

Third Embodiment
In the third embodiment, in the second embodiment, the color of the subject's emotion displayed on the portable terminal 2a or another device 2b such as a screen of a personal computer or a television monitor is red, orange, purple, yellow, Blue, light blue (light blue), pink, including green.

Fourth Embodiment
In the fourth embodiment, in the second embodiment or the third embodiment, the emotion of the present subject is displayed on the wearable terminal 1a, the portable terminal 2a, or another device 2b such as a screen of a personal computer or a television monitor. It displays messages in the indicated language. In addition, the portable terminal 2a is provided with an audio output unit, and has a function of outputting a language message as an audio. For example, if the emotion of the subject analyzed is "pain, 50%", a message such as "Now you are experiencing moderate pain" is displayed. A plurality of these messages are stored in advance in the portable terminal 2a, and an appropriate one is automatically selected and transmitted in the portable terminal 2a according to the analyzed emotion. These messages may be displayed differently each time at fixed time intervals, for example, every 10 minutes. In addition to the language message, a picture message may be displayed. Also, the language message may be transmitted to the subject by voice through the voice output unit.

Fifth Embodiment
In addition to the fourth embodiment, when it is determined that the subject's emotion is in the safe zone, a message is provided to prompt an action to maintain the state. The message includes a language message or a picture message. The message is displayed on the wearable terminal 1a, the portable terminal 2a, or another device 2b such as a screen of a personal computer or a television monitor.

Sixth Embodiment
In addition to the fourth embodiment, when it is determined that the subject's emotion is in the attention zone or the danger zone, a message for returning the emotion to the safe zone is provided. The message includes a language message or a picture message. The message is displayed on the wearable terminal 1a, the portable terminal 2a, or another device 2b such as a screen of a personal computer or a television monitor. For example, if the subject's emotion was analyzed as "pain, 50%", "It's about time to take action to get rid of the pain. A message such as These messages may be displayed differently each time at certain time intervals until the subject's emotions enter the safe zone.

At this time, the system continuously obtains heart rate and body temperature and continuously judges emotions, thereby quantifying whether the displayed message has an effect on the improvement of the subject's emotions, and to what extent. Can be measured. By repeating this cycle of measurement → emotion analysis → message display → measurement → emotion analysis → next message display, the system memorizes the displayed message and its effect, and then the message with higher emotion improvement effect is better It can be displayed in a short time. This will be called "learning" in this embodiment.

In this embodiment, the notification unit 13 notifies of an improvement measure for improving the emotion analyzed by the acquisition unit 12. Not only the emotions are displayed, but the improvement measures are informed. This allows the user including the subject and / or the supporter to improve the subject's emotions.

Seventh Embodiment
In the fourth, fifth and sixth embodiments, the wording of the message can be selected and changed, or the character to which the message is transmitted can be selected and changed according to the preference of the subject. For example, for children, adults, elderly people, men, women, close friendliness, elder tone, grandson tone, servant tone, teacher tone, etc. The conditions of these messages are stored in advance in the notification unit 13. The user selects the tone of the message, for example, by the operation unit of the portable terminal 2a.

Eighth Embodiment
In the seventh embodiment, a message displayed on the display unit of the wearable terminal 1a, the display unit of the portable terminal 2a, or the screen of a personal computer or another device 2b (separate display means) such as a television monitor On the other hand, the subject can input the subject message of the reply and the answer. In order to input a subject's message, the wearable terminal 1a worn by the subject or the portable terminal 2a carried by the subject has a voice input function or a text input function. The voice input function can be provided, for example, by a microphone and a voice recognition device. Text input functionality can be provided by the keyboard. Furthermore, the portable terminal 2a can further send a message (reply) to the subject message. The portable terminal 2a has a conversation providing unit for generating a reply to the subject message. The conversation providing unit provides a reply in which the subject feels as if he or she is in conversation with a human. The conversation providing unit can use a variety of devices, from bot devices that only select one of a plurality of prepared responses, to a device called artificial intelligence, according to the degree of conversation provided by itself. It is. This causes the subject to send and receive messages as if they were in conversation with a human being. Furthermore, the conversation providing unit may be a communication line communicably connecting the subject and the operator.

The ninth embodiment
A ninth embodiment is shown in FIG. The analysis of emotions, the selection of messages and the display in the second to eighth embodiments are performed by the server system 3a equipped with artificial intelligence. This server system may be located in independent hardware, but may be located on the cloud.

All interactions between the subject and the artificial intelligence with the subject's message are recorded in the artificial intelligence. From the relationship between the message and the subject's message, the effect of maintaining calm emotions or the effect of returning emotions in the attention zone or danger zone to the safe zone is automatically evaluated and accumulated.

By making artificial intelligence exchange the message between the subject and artificial intelligence with the subject's message, the artificial intelligence learns the message of the appropriate length, the degree of abstraction, the expression, the wording to the individual subject. , To allow artificial intelligence to create messages.

Tenth Embodiment
In this embodiment, in the ninth embodiment, artificial intelligence learning data for a plurality of subjects is integrated. The training data is collected via a network and made available as a set of data available to a particular subject. In addition to the data set prepared by subjecting artificial intelligence to reinforcement learning etc. for the subject, the answer to a subject is selected as artificial intelligence from among learning data collected from a plurality of other subjects. The use of the emotion analysis system by a plurality of subjects, the integration of the plurality of learning data, and the action of utilizing the integrated learning data for a specific subject are included. This makes it possible to create and send more appropriate linguistic messages faster.

(Other embodiments)
The present disclosure has been described based on the above-described embodiment, but is not limited to the embodiment, and includes various modifications and variations within the equivalent range. In addition, various combinations and forms, and further, other combinations and forms including only one element, or more or less than these elements are also within the scope and the scope of the present disclosure.

Claims

Detection unit that detects heart rate and temperature of the subject,
An acquisition unit that acquires a heart rate and a body temperature detected by the detection unit and analyzes an emotion of the subject;
An emotion analysis system comprising: a notification unit that notifies the user of the emotion analyzed by the acquisition unit.
The notification unit classifies the emotions analyzed by the acquisition unit into a plurality of groups, and displays the classified emotions using visual information including at least one of color, numbers, characters, symbols, pictures, and patterns. A sound output unit that outputs sound based on auditory information including at least one of sound, voice, and music, or a tactile sense output unit that outputs tactile information that includes vibration, shape, and surface roughness; The emotion analysis system described in 1.
The emotion analysis system according to claim 1, wherein the notification unit notifies an improvement measure for improving the emotion analyzed by the acquisition unit.
The emotion analysis system according to any one of claims 1 to 3, wherein the notification unit notifies a maintenance measure for maintaining the emotion analyzed by the acquisition unit.
The acquisition unit analyzes the subject's emotion based on a Russell circle,
When the informing unit is determined to be an unpleasant area which is the left half of the Russell's circle, visual information or auditory information, or the like, which changes the subject's emotion from the left half to the right area The emotion analysis system according to any one of claims 1 to 4, which outputs at least one of tactile information.
The acquisition unit analyzes the subject's emotion based on a Russell circle,
The notification unit outputs at least one of visual information, auditory information, and tactile information that changes the subject's emotion toward the radial center of the Russell's ring. Emotion analysis system described in one.
The notification unit outputs a message prompting a change to another different action from the current action of the subject when improving the feeling, and / or when maintaining the feeling. The emotion analysis system according to any one of claims 1 to 6, which outputs a message for giving a reward directly or indirectly to a subject.
Wearable terminal that the subject wears,
A portable terminal that transmits and receives electronic signals and data wirelessly or wiredly with the terminal,
Detection unit that detects heart rate and temperature of the subject,
An acquisition unit for acquiring heart rate and body temperature and analyzing emotions;
It has a display unit that displays the analyzed emotions,
Mounting the detection unit and the display unit on the wearable terminal;
The portable terminal includes the acquisition unit and the display unit, and
The emotion analysis system in which the wearable terminal and the portable terminal are equipped with a communication unit that communicates either with the wireless communication or the wired communication.
The portable terminal includes a plurality of verbal messages representing emotions,
The visual display of the wearable terminal and the display unit of the portable terminal according to the subject's emotion among the messages is automatically displayed and / or,
The emotion analysis system according to claim 8, further comprising: a sound output unit that outputs the message by voice.
The subject can input a subject message of a reply or a reply from the terminal to the message displayed on either the wearable terminal or the portable terminal, or both of them, and another separated display means It has become
The emotion analysis system according to claim 9, further comprising a conversation provision unit that allows the portable terminal to further send a reply to the subject message.