WO2022113380A1 - Emotion assessment system, emotion assessment method, and program - Google Patents

Emotion assessment system, emotion assessment method, and program Download PDF

Info

Publication number
WO2022113380A1
WO2022113380A1 PCT/JP2021/004907 JP2021004907W WO2022113380A1 WO 2022113380 A1 WO2022113380 A1 WO 2022113380A1 JP 2021004907 W JP2021004907 W JP 2021004907W WO 2022113380 A1 WO2022113380 A1 WO 2022113380A1
Authority
WO
WIPO (PCT)
Prior art keywords
value
emotion
user
determination
unit
Prior art date
Application number
PCT/JP2021/004907
Other languages
French (fr)
Japanese (ja)
Inventor
達雄 三舩
秀孝 箱田
紗也華 冨増
拓真 末武
侑未 世羅
咲 丸山
Original Assignee
パナソニックＩｐマネジメント株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニックＩｐマネジメント株式会社 filed Critical パナソニックＩｐマネジメント株式会社
Publication of WO2022113380A1 publication Critical patent/WO2022113380A1/en

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state

Definitions

  • the present disclosure generally relates to an emotion determination system, an emotion determination method and a program, and more particularly to an emotion determination system, an emotion determination method and a program for determining a user's emotion.
  • Patent Document 1 a system for determining user stress (emotion) is known (see, for example, Patent Document 1).
  • Patent Document 1 describes a technique for estimating the psychological state of a viewer (user) using a single biometric information sensor. More specifically, in Patent Document 1, the psychological state of the subject and its intensity are estimated from the measured values of the signals of a plurality of biological information and their initial values or standard values.
  • the present disclosure has been made in view of the above problems, and an object of the present disclosure is to provide an emotion determination system, an emotion determination method, and a program capable of determining a user's emotion more accurately.
  • the emotion determination system includes an acquisition unit and a determination unit.
  • the acquisition unit acquires an index value related to the user's emotion.
  • the determination unit weights the index value and determines the emotion of the user based on the weighted index value.
  • the emotion determination method includes an acquisition step and a determination step.
  • the acquisition step acquires an index value related to the user's emotion.
  • the index value is weighted, and the emotion of the user is determined based on the weighted index value.
  • the program according to one aspect of the present disclosure is a program for causing a computer to execute the emotion determination method.
  • FIG. 1 is a block diagram illustrating a configuration of an emotion determination system according to an embodiment.
  • FIG. 2 is a two-dimensional psychological model using comfort and arousal as indexes.
  • FIG. 3 is a flow chart illustrating the operation of the same emotion determination system.
  • FIG. 4 is a flow chart illustrating the operation of the determination process performed by the emotion determination system of the above.
  • the emotion determination system 1 determines the user's emotions.
  • the emotion determination device 10 as the emotion determination system 1 includes an acquisition unit 172 and a determination unit 173.
  • the acquisition unit 172 acquires an index value related to the user's emotion.
  • the determination unit 173 weights the index value acquired by the acquisition unit 172, and determines the user's emotion based on the weighted index value.
  • the emotion determination device 10 further includes a notification unit 174.
  • the notification unit 174 notifies the user of the determination result (user's emotion) of the determination unit 173.
  • the emotion determination device 10 is configured to be able to communicate with the sensor 20 and the camera 30.
  • the sensor 20 detects, for example, the vital value of the user.
  • the vital value includes, for example, at least one of the user's heart rate, heart rate variability coefficient, and autonomic nerve activity. That is, the sensor 20 detects at least one of the user's heart rate, heart rate variability coefficient, and autonomic nerve activity.
  • the autonomic nerve activity includes at least one of the parasympathetic nerve activity (HF) and the exchange nerve activity (LF / HF).
  • the camera 30 captures the user's face.
  • the emotion determination device 10 analyzes the user's facial expression using the image (face image) of the user's face taken by the camera 30.
  • the index value is a value obtained from at least one of the response result of the questionnaire to the user, the vital value of the user, and the facial expression analysis result for the user.
  • the emotion determination device 10 acquires each of the questionnaire response result, the user's vital value, and the facial expression analysis result for the user as index values.
  • a two-dimensional psychological model (for example, Russell's annulus model) using comfort and arousal as indexes is used as a model for expressing the emotions of the subject (see FIG. 2).
  • the X-axis indicates the degree of comfort and the Y-axis indicates the degree of arousal.
  • the comfort level of the X-axis is "positive" in the positive region of the X-axis and "negative” in the negative region of the X-axis.
  • the comfort level increases as the level (absolute value) in the positive region of the X-axis increases, and the comfort level decreases as the level (absolute value) in the negative region of the X-axis increases.
  • the positive region on the Y-axis is "high tension” and the negative region on the Y-axis is "low tension”.
  • the arousal degree increases as the level (absolute value) in the positive region of the Y-axis increases, and the arousal degree decreases as the level (absolute value) in the negative region of the Y-axis increases.
  • the user's emotions are classified according to the quadrant of the two-dimensional model. If it is the first quadrant Z1, it indicates that the emotion is a passion. If it is the second quadrant Z2, it indicates that the emotion is an impulse. If it is the third quadrant Z3, it indicates that the emotion is empty. If it is the fourth quadrant Z4, it indicates that the emotion is calm.
  • the determination unit 173 determines which of the above four quadrants the user's emotion is included in based on the weighted index value.
  • the index value includes a value on the Y-axis and a value on the X-axis. That is, the index value includes a first value indicating the degree of positiveness of the user and a second value indicating the degree of arousal (degree of tension) of the user.
  • the determination unit 173 weights each of the first value and the second value, and determines the user's emotion based on the weighted first value and the two-dimensional coordinates represented by the second value. ..
  • the emotion determination device 10 includes a communication unit 11, a storage unit 12, a display unit 13, an operation unit 14, a first input unit 15, a second input unit 16, and a control unit 17.
  • the emotion determination device 10 includes, for example, a microcomputer having a processor and a memory.
  • the computer system functions as the control unit 17 when the processor executes an appropriate program. That is, the control unit 17 is realized by a computer system having a processor and a memory.
  • the program may be pre-recorded in a memory, may be recorded through a telecommunication line such as the Internet, or may be recorded and provided on a non-temporary recording medium such as a memory card.
  • the communication unit 11 has a communication interface for communicating with an external device, for example, a device that controls a user's emotion using a determination result.
  • the communication unit 11 wirelessly communicates with an external device.
  • the communication unit 11 may perform wired communication with an external device.
  • the storage unit 12 is a semiconductor memory such as a ROM (ReadOnlyMemory), a RAM (RandomAccessMemory), or an EEPROM (ElectricallyErasableProgrammableReadOnlyMemory).
  • the storage unit 12 is not limited to the semiconductor memory, but may be a hard disk drive or the like.
  • the storage unit 12 may be provided in a device different from the emotion determination device 10, or may be provided in a server, cloud, or the like connected to the emotion determination device 10 via a network.
  • the storage unit 12 stores information (for example, a questionnaire) used for determining the user's emotions.
  • the display unit 13 has a thin display such as a liquid crystal display or an organic EL (Organic ElectroLuminescence Display: OELD).
  • the display unit 13 displays the determination result about the user's emotion.
  • the operation unit 14 accepts the user's operation.
  • the operation unit 14 receives the answer to the questionnaire.
  • the operation unit 14 outputs the received answer to the control unit 17.
  • the first input unit 15 is configured to be able to communicate with the sensor 20.
  • the first input unit 15 receives the user's vital value detected by the sensor 20 from the sensor 20.
  • the second input unit 16 is configured to be able to communicate with the camera 30.
  • the second input unit 16 receives the face image taken by the camera 30 from the camera 30.
  • control unit 17 has an analysis unit 171, an acquisition unit 172, a determination unit 173, and a notification unit 174.
  • the analysis unit 171 analyzes the facial expression of the user included in the face image based on the face image acquired by the second input unit 16.
  • the acquisition unit 172 acquires an index value related to the user's emotions.
  • the acquisition unit 172 acquires each of the questionnaire response result, the user's vital value, and the facial expression analysis result for the user. For example, the acquisition unit 172 acquires the answer result of the questionnaire from the operation unit 14. The acquisition unit 172 acquires the detection result (user's vital value) of the sensor 20 from the sensor 20 via the first input unit 15. The acquisition unit 172 acquires the facial expression analysis result for the user by the analysis unit 171 from the analysis unit 171.
  • the acquisition unit 172 Based on the response results of the questionnaire, the acquisition unit 172 has a first positive value (first value) indicating the comfort level (user positive degree) on the X axis of the two-dimensional psychological model shown in FIG. 2, and an arousal on the Y axis.
  • the first tension value (second value) indicating the degree (the degree of tension of the user) is acquired.
  • the acquisition unit 172 acquires a set including the first positive value and the first tension value, which is obtained based on the answer result of the questionnaire, as an index value (hereinafter, referred to as "first index value"). For example, for each of the plurality of questions included in the questionnaire, a plurality of answers to which scores are associated with each are associated. Based on the scores associated with the user's answers to each of the plurality of questions, the acquisition unit 172 sets the total score regarding the degree of positiveness as the first positive value and the total score regarding the degree of tension as the first tension value. ..
  • the acquisition unit 172 acquires a second positive value (first value) indicating the degree of positiveness of the user and a second tension value (second value) indicating the degree of tension of the user based on the vital value of the user. ..
  • the acquisition unit 172 acquires a set including the second positive value and the second tension value obtained based on the vital value as an index value (hereinafter, referred to as “second index value”).
  • second index value an index value
  • the acquisition unit 172 acquires the difference between the vital value detected by the sensor 20 and the general average value of the vital values as a score related to the user's vitals.
  • the acquisition unit 172 uses the acquired vital scores as the second positive value and the second tension value.
  • the acquisition unit 172 acquires a third positive value (first value) indicating the degree of positiveness of the user and a third tension value (second value) indicating the degree of tension of the user. do.
  • the acquisition unit 172 acquires a set including the third positive value and the third tension value, which is obtained based on the facial expression analysis result, as an index value (hereinafter, referred to as “third index value”).
  • a score is assigned to each facial expression. Specifically, scores are assigned to each of an angry facial expression, a sad facial expression, a surprised facial expression, a happy facial expression, and no expression (natural facial expression).
  • the acquisition unit 172 acquires a score regarding the facial expression corresponding to the corresponding facial expression of the user among angry facial expression, sad facial expression, surprised facial expression, happy facial expression, and no facial expression.
  • the acquisition unit 172 sets the score regarding the acquired facial expression as the third positive value and the third tension value.
  • the determination unit 173 weights the index value acquired by the acquisition unit 172, and determines the user's emotion based on the weighted index value.
  • the determination unit 173 weights each of the first value and the second value included in the index value, and based on the two-dimensional coordinates represented by the weighted first value and second value, the user Judge emotions.
  • the determination unit 173 performs normalization processing on each of the first index value, the second index value, and the third index value. Specifically, the determination unit 173 normalizes each of the first value and the second value so as to fall within a predetermined range, and the normalized first value and the second value, respectively. Is weighted.
  • the determination unit 173 is set to fall within a predetermined range for each of the first value (first positive value) and the second value (first tension value) included in the first index value. Perform normalization.
  • the determination unit 173 weights the first positive value by multiplying the normalized first positive value by a predetermined first weighting coefficient.
  • the determination unit 173 weights the first tension value by multiplying the normalized first tension value by a predetermined second weighting coefficient.
  • the determination unit 173 normalizes each of the first value (second positive value) and the second value (second tension value) included in the second index value so as to fall within a predetermined range.
  • the determination unit 173 weights the second positive value by multiplying the normalized second positive value by a predetermined third weighting coefficient.
  • the determination unit 173 weights the second tension value by multiplying the normalized second tension value by a predetermined fourth weighting coefficient.
  • the determination unit 173 normalizes each of the first value (third positive value) and the second value (third tension value) included in the third index value so as to fall within a predetermined range.
  • the determination unit 173 weights the third positive value by multiplying the normalized third positive value by a predetermined fifth weighting coefficient.
  • the determination unit 173 weights the third tension value by multiplying the normalized third tension value by a predetermined sixth weighting coefficient.
  • the determination unit 173 determines the emotion of the user based on the two-dimensional coordinates represented by the weighted first value and the second value. Specifically, the determination unit 173 calculates the total value (first total value) of the first positive value, the second positive value, and the third positive value, each of which is weighted. The determination unit 173 calculates a total value (second total value) of the first tension value, the second tension value, and the third tension value, each of which is weighted. The determination unit 173 specifies whether the two-dimensional coordinates represented by the first total value and the second total value are included in any of the four quadrants in the two-dimensional psychological model shown in FIG. The determination unit 173 determines the emotion corresponding to the specified quadrant as the user's emotion.
  • the notification unit 174 notifies the user of the determination result by the determination unit 173.
  • the notification unit 174 causes the display unit 13 to display the determination result (user's emotion).
  • the notification unit 174 may notify the user of the determination result by voice.
  • the notification unit 174 may notify the information terminal owned by the user via the network.
  • the information terminal is a smartphone, a tablet terminal, or the like. Further, the notification unit 174 may transmit to an external device via the communication unit 11.
  • the acquisition unit 172 acquires the index value (step S1).
  • the acquisition unit 172 acquires a set including the first positive value (first value) and the first tension value (second value) as the first index value based on the response result of the questionnaire.
  • the acquisition unit 172 acquires a set including the second positive value (first value) and the second tension value (second value) as the second index value based on the vital value of the user.
  • the acquisition unit 172 acquires a set including the third positive value (first value) and the third tension value (second value) as the third index value based on the facial expression analysis result for the user.
  • the determination unit 173 performs a determination process for determining the user's emotions (step S2). The details of the determination process will be described later.
  • the notification unit 174 performs a notification process for notifying the user of the determination result by the determination unit 173 (step S3).
  • the notification unit 174 causes the display unit 13 to display the determination result (user's emotion).
  • the determination unit 173 performs normalization processing (step S11).
  • the determination unit 173 normalizes each of the first value (first positive value) and the second value (first tension value) included in the first index value so as to fall within a predetermined range.
  • the determination unit 173 normalizes each of the first value (second positive value) and the second value (second tension value) included in the second index value so as to fall within a predetermined range.
  • the determination unit 173 normalizes each of the first value (third positive value) and the second value (third tension value) included in the third index value so as to fall within a predetermined range.
  • the determination unit 173 performs weighting processing (step S12).
  • the determination unit 173 weights the first tension value by multiplying the normalized first positive value by the first weighting coefficient and the normalized first tension value by the second weighting coefficient.
  • the determination unit 173 weights the second tension value by multiplying the normalized second positive value by the third weighting coefficient and the normalized second tension value by the fourth weighting coefficient.
  • the determination unit 173 weights the third tension value by multiplying the normalized third positive value by the fifth weighting coefficient and the normalized third tension value by the sixth weighting coefficient.
  • the determination unit 173 determines the user's emotions (step S13).
  • the determination unit 173 calculates the first total value of the first positive value, the second positive value, and the third positive value, each of which is weighted.
  • the determination unit 173 calculates the second total value of the first tension value, the second tension value, and the third tension value, each of which is weighted.
  • the determination unit 173 specifies whether the two-dimensional coordinates represented by the first total value and the second total value are included in any of the four quadrants in the two-dimensional psychological model shown in FIG.
  • the determination unit 173 determines the emotion corresponding to the specified quadrant as the user's emotion.
  • the score of the user's degree of positiveness based on the answer to the questionnaire is 9 points (first positive value), and the score of the degree of tension of the user is 6 points (first tension value). Furthermore, the range in which the user's positive degree score based on the answers to the questionnaire can be obtained is 3 to 15 points. In addition, the range in which the user's positive degree score based on the answers to the questionnaire can be obtained is also set to 3 to 15 points.
  • the sensor 20 detects the user's heart rate as the user's vital value.
  • the heart rate of the user detected by the sensor 20 is 70.
  • the general average value is 80.
  • the acquisition unit 172 acquires the difference "-10" between the user's heart rate "70” and the general average value "80" as the second positive value and the second tension value regarding the user's vitals.
  • the range in which the difference can be taken is -50 to 50.
  • the score assigned to each of an angry facial expression, a sad facial expression, a surprised facial expression, a happy facial expression, and no expression (natural facial expression) is -0.5, -0.8, 0.2, 0.3, It is set to 0.4.
  • the range of scores that can be obtained as a result of facial expression analysis is -1 to 1.
  • the analysis unit 171 analyzes that the user's facial expression is a sad facial expression as a result of the user's facial expression analysis.
  • the acquisition unit 172 acquires the score “ ⁇ 0.8” corresponding to the sad facial expression as the third positive value and the third tension value regarding the user's facial expression.
  • each of the first weighting coefficient and the second weighting coefficient is set to 0.2.
  • the third weighting factor is 0.1 and the fourth weighting factor is 1.0.
  • the fifth weighting factor is 1.0 and the sixth weighting factor is 0.1.
  • the determination unit 173 normalizes each of the first positive value "9” and the first tension value "6" in the normalization process. Since the range of points that can be scored is 3 to 15, each of the first positive value "9” and the first tension value "6" is normalized so as to fall within a predetermined range (-1 to 1). Then, the first positive value after normalization becomes "0", and the first tension value after normalization becomes "-0.5".
  • the determination unit 173 normalizes each of the second positive value "-10" and the second tension value "-10" in the normalization process. Since the range in which the difference can be taken is -50 to 50, each of the user's second positive value "-10" and second tension value "-10" is within a predetermined range (-1 to 1). When the normalization is performed in this way, both the second positive value after normalization and the second tension value after normalization become "-0.2".
  • the determination unit 173 normalizes each of the third positive value "-0.8” and the third tension value "0.8” in the normalization process. Normalization is performed by normalizing each of the user's third positive value "-0.8” and third tension value "-0.8” so as to fall within a predetermined range (-1 to 1). Both the latter third positive value and the third tension value are "-0.8".
  • the determination unit 173 sets the first weighting factor “0.2” for the first positive value “0” after normalization and the second weight for the first tension value “ ⁇ 0.5” after normalization. Multiply the coefficient "0.2” respectively. As a result, the weighted first positive value is "0" and the first tension value is "-0.1".
  • the determination unit 173 sets the third weighting factor "0.1" to the second positive value "-0.2” after normalization and the second tension value "-0.2” after normalization.
  • the fourth weighting factor "1.0” is multiplied by each.
  • the weighted second positive value is "-0.02" and the second tension value is "-0.2".
  • the determination unit 173 sets the fifth weighting factor "1.0" to the third positive value "-0.8” after normalization and the third tension value "-0.8” after normalization.
  • the second weighting factor "0.1” is multiplied by each.
  • the weighted third positive value is "-0.8” and the third tension value is "-0.08".
  • the determination unit 173 calculates the first total value using the weighted first positive value, the weighted second positive value, and the weighted third positive value. Since the weighted first positive value, the weighted second positive value, and the weighted third positive value are "0", "-0.02", and "-0.8", respectively, the first total value. Is -0.82.
  • the determination unit 173 calculates the second total value using the weighted first tension value, the weighted second tension value, and the weighted third tension value.
  • the weighted first tension value, the weighted second tension value, and the weighted third tension value are "-0.1", “-0.2", and "-0.08", respectively. 2
  • the total value is -0.38.
  • the two-dimensional coordinates consisting of the first total value and the second total value are in the two-dimensional psychological model shown in FIG. Identify which of the four quadrants is included.
  • the determination unit 173 determines the emotion corresponding to the specified quadrant as the user's emotion.
  • the determination unit 173 determines that the user's emotions are empty.
  • the emotion determination system 1 includes an acquisition unit 172 and a determination unit 173.
  • the acquisition unit 172 acquires an index value related to the user's emotion.
  • the determination unit 173 weights the index value and determines the user's emotion based on the weighted index value.
  • the emotion determination system 1 determines the user's emotion based on the weighted index value, so that the user's emotion can be determined more accurately.
  • the determination unit 173 normalizes each of the first value and the second value included in the index value so as to fall within a predetermined range, and is normalized first. Weighting is performed for each of the value and the second value.
  • values with different index criteria can be handled with the same index. Therefore, the user's emotion can be determined more accurately.
  • the emotion determination device 10 is configured to determine the emotion of the user by using both the positive degree and the tension degree, but is not limited to this configuration.
  • the emotion determination device 10 may determine the user's emotion using only one of the positive degree and the tension degree.
  • the emotion determination device 10 determines whether the user's emotion is positive or negative based on the above-mentioned first total value. Specifically, the emotion determination device 10 determines that the user's emotion is positive when the first total value is 0 or more, and when the first total value is less than 0, the user's emotion is determined. Emotions are judged to be negative.
  • the emotion determination device 10 determines whether the user's emotion is high tension or low tension based on the above-mentioned second total value. Specifically, the emotion determination device 10 determines that the user's emotion is high tension when the second total value is 0 or more, and the user when the second total value is less than 0. It is judged that the emotion of is low tension.
  • the facial expression of the user may change while the camera 30 is taking a picture.
  • the analysis unit 171 may obtain a plurality of facial expression analysis results.
  • the acquisition unit 172 sets the maximum value among the plurality of scores corresponding to the plurality of facial expression analysis results as the representative value, and normalizes the representative value. And may be used for weighting processing. That is, the acquisition unit 172 may determine the emotion of the user by using the representative value as the index value.
  • any one of the average value, the median value, and the minimum value of the plurality of scores corresponding to the plurality of facial expression analysis results may be used as the representative value.
  • the emotion determination device 10 is configured to use a value based on the answer to the questionnaire, a value based on the vital value, and a value based on the facial expression analysis result as the index value, but the present invention is not limited to this configuration.
  • the emotion determination device 10 may use one of a value based on the answer to the questionnaire, a value based on the vital value, and a facial expression analysis result as an index value. Alternatively, the emotion determination device 10 may use two of the value based on the answer to the questionnaire, the value based on the vital value, and the facial expression analysis result as the index value.
  • the emotion determination device 10 may be configured to use at least one of a value based on the answer to the questionnaire, a value based on the vital value, and a facial expression analysis result as an index value.
  • the determination unit 173 of the emotion determination device 10 is configured to normalize the index value, but is not limited to this configuration.
  • the determination unit 173 does not have to normalize the index value. That is, it is not essential for the determination unit 173 to normalize the index value. In other words, the determination unit may be configured to at least weight the index value.
  • the determination unit 173 uses the index value (first positive value, first tension value, second positive value, second tension value, third positive value) acquired by the acquisition unit 172. And the third tension value) are weighted.
  • the above embodiment is only one of the various embodiments of the present disclosure.
  • the above embodiment can be variously modified according to the design and the like as long as the object of the present disclosure can be achieved.
  • the same function as the emotion determination system 1 may be embodied by an emotion determination method, a computer program, a non-temporary recording medium on which the program is recorded, or the like.
  • the emotion determination method of the emotion determination system 1 includes an acquisition step and a determination step.
  • the acquisition step acquires an index value related to the user's emotion.
  • the determination step weights the index value and determines the user's emotion based on the weighted index value.
  • the program according to one aspect is a program for making a computer system function as the emotion determination method of the emotion determination system 1 or the emotion determination system 1 described above.
  • the executing body of the emotion determination system 1 or the emotion determination method of the emotion determination system 1 in the present disclosure includes a computer system.
  • the computer system has a processor and memory as hardware.
  • the processor executes the program recorded in the memory of the computer system, the function as the execution subject of the emotion determination system 1 or the emotion determination method of the emotion determination system 1 in the present disclosure is realized.
  • the program may be pre-recorded in the memory of the computer system, but may be provided through a telecommunication line. Further, the program may be recorded and provided on a non-temporary recording medium such as a memory card, an optical disk, or a hard disk drive that can be read by a computer system.
  • the processor of a computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large scale integrated circuit (LSI).
  • the integrated circuit such as IC or LSI referred to here has a different name depending on the degree of integration, and includes an integrated circuit called a system LSI, VLSI (Very Large Scale Integration), or ULSI (Ultra Large Scale Integration).
  • an FPGA Field-Programmable Gate Array
  • a plurality of electronic circuits may be integrated on one chip, or may be distributed on a plurality of chips.
  • a plurality of chips may be integrated in one device, or may be distributed in a plurality of devices.
  • the emotion determination system 1 it is not an essential configuration for the emotion determination system 1 that a plurality of functions in the emotion determination system 1 are integrated in one housing, and the components of the emotion determination system 1 are dispersed in a plurality of housings. It may be provided. Further, at least a part of the functions of the emotion determination system 1 may be realized by a cloud (cloud computing) or the like.
  • the emotion determination system (1) of the first aspect includes an acquisition unit (172) and a determination unit (173).
  • the acquisition unit (172) acquires an index value related to the user's emotion.
  • the determination unit (173) weights the index value and determines the user's emotion based on the weighted index value.
  • the emotion determination system (1) determines the user's emotion based on the weighted index value, so that the user's emotion can be determined more accurately.
  • the index value includes a first value indicating the degree of positiveness of the user and a second value indicating the degree of tension of the user.
  • the determination unit (173) weights each of the first value and the second value, and determines the user's emotion based on the two-dimensional coordinates represented by the weighted first value and the second value. do.
  • the user's emotions can be determined using a two-dimensional psychological model.
  • the determination unit (173) normalizes each of the first value and the second value so as to fall within a predetermined range. And weighting is performed for each of the normalized first value and the second value.
  • values with different index criteria can be handled with the same index. Therefore, the user's emotion can be determined more accurately.
  • the index value is a result of a questionnaire to the user, a vital value of the user, and a facial expression analysis result to the user. It is a value obtained from at least one.
  • the user's emotion can be determined using the value obtained from at least one of the response result of the questionnaire to the user, the vital value of the user, and the facial expression analysis result for the user.
  • the vital value includes at least one of the user's heart rate, heart rate variability coefficient, and autonomic nervous activity.
  • the user's emotion can be determined using at least one of the user's heart rate, heart rate variability coefficient, and autonomic nervous activity.
  • the facial expression analysis result is represented by the emotion value which is the maximum value among the emotion values obtained by quantifying the emotions in the user's facial expression.
  • the determination unit (173) determines the user's emotion using the representative value.
  • the user's emotion can be determined using the representative value.
  • the emotion determination method of the seventh aspect includes an acquisition step and a determination step.
  • the acquisition step acquires an index value related to the user's emotion.
  • the determination step weights the index value and determines the user's emotion based on the weighted index value.
  • the user's emotion can be determined more accurately.
  • the program of the eighth aspect is a program for causing a computer to execute the emotion determination method of the seventh aspect.

Abstract

Provided are an emotion assessment system, an emotion assessment method, and a program with which it is possible to more accurately assess the emotion of a user. The emotion assessment system (1) is provided with an acquisition unit (172) and an assessment unit (173). The acquisition unit (172) acquires an indicator value relating to the emotion of the user. The assessment unit (173) performs weighting of the indicator value, and assesses the emotion of the user on the basis of the weighted indicator value.

Description

感情判定システム、感情判定方法及びプログラムEmotion judgment system, emotion judgment method and program
　本開示は、一般に感情判定システム、感情判定方法及びプログラムに関し、より詳細にはユーザの感情を判定する感情判定システム、感情判定方法及びプログラムに関する。 The present disclosure generally relates to an emotion determination system, an emotion determination method and a program, and more particularly to an emotion determination system, an emotion determination method and a program for determining a user's emotion.
　従来、ユーザのストレス（感情）を判定するシステムが知られている（例えば、特許文献１参照）。 Conventionally, a system for determining user stress (emotion) is known (see, for example, Patent Document 1).
　特許文献１では、単一の生体情報センサにより視聴者（ユーザ）の心理状態を推定する技術が記載されている。より詳細には、特許文献１では、複数の生体情報の信号の測定値と、その初期値あるいは標準値とから対象者の心理状態およびその強度を推定する。 Patent Document 1 describes a technique for estimating the psychological state of a viewer (user) using a single biometric information sensor. More specifically, in Patent Document 1, the psychological state of the subject and its intensity are estimated from the measured values of the signals of a plurality of biological information and their initial values or standard values.
特開２０００－２３７１４６号公報Japanese Unexamined Patent Publication No. 2000-237146
　ユーザの心理状態（感情）の判定について、より精度を高めたいとの要望がある。 There is a request to improve the accuracy of the judgment of the user's psychological state (emotion).
　本開示は上記課題に鑑みてなされ、より精度よくユーザの感情を判定することができる感情判定システム、感情判定方法及びプログラムを提供することを目的とする。 The present disclosure has been made in view of the above problems, and an object of the present disclosure is to provide an emotion determination system, an emotion determination method, and a program capable of determining a user's emotion more accurately.
　本開示の一態様に係る感情判定システムは、取得部と、判定部と、を備える。前記取得部は、ユーザの感情に関する指標値を取得する。前記判定部は、前記指標値に対して重み付けを行い、重み付けされた前記指標値を基に、前記ユーザの感情を判定する。 The emotion determination system according to one aspect of the present disclosure includes an acquisition unit and a determination unit. The acquisition unit acquires an index value related to the user's emotion. The determination unit weights the index value and determines the emotion of the user based on the weighted index value.
　本開示の一態様に係る感情判定方法は、取得ステップと、判定ステップと、を含む。前記取得ステップは、ユーザの感情に関する指標値を取得する。前記判定ステップは、前記指標値に対して重み付けを行い、重み付けされた前記指標値を基に、前記ユーザの感情を判定する。 The emotion determination method according to one aspect of the present disclosure includes an acquisition step and a determination step. The acquisition step acquires an index value related to the user's emotion. In the determination step, the index value is weighted, and the emotion of the user is determined based on the weighted index value.
　本開示の一態様に係るプログラムは、コンピュータに、前記感情判定方法を実行させるためのプログラムである。 The program according to one aspect of the present disclosure is a program for causing a computer to execute the emotion determination method.
図１は、一実施形態に係る感情判定システムの構成を説明するブロック図である。FIG. 1 is a block diagram illustrating a configuration of an emotion determination system according to an embodiment. 図２は、快適度及び覚醒度を指標とした２次元心理モデルである。FIG. 2 is a two-dimensional psychological model using comfort and arousal as indexes. 図３は、同上の感情判定システムの動作を説明する流れ図である。FIG. 3 is a flow chart illustrating the operation of the same emotion determination system. 図４は、同上の感情判定システムが行う判定処理の動作を説明する流れ図である。FIG. 4 is a flow chart illustrating the operation of the determination process performed by the emotion determination system of the above.
　以下に説明する実施形態及び変形例は、本開示の一例に過ぎず、本開示は、実施形態及び変形例に限定されない。以下の実施形態及び変形例以外であっても、本開示に係る技術的思想を逸脱しない範囲であれば、設計等に応じて種々の変更が可能である。 The embodiments and modifications described below are merely examples of the present disclosure, and the present disclosure is not limited to the embodiments and modifications. Other than the following embodiments and modifications, various changes can be made according to the design and the like as long as they do not deviate from the technical idea of the present disclosure.
　（実施形態）
　以下、本実施形態に係る感情判定システム１について、図１～図４を用いて説明する。 (Embodiment)
Hereinafter, the emotion determination system 1 according to the present embodiment will be described with reference to FIGS. 1 to 4.
　（１）概要
　感情判定システム１は、ユーザの感情を判定する。 (1) Overview The emotion determination system 1 determines the user's emotions.
　本実施形態に係る感情判定システム１としての感情判定装置１０は、図１に示すように、取得部１７２と、判定部１７３と、を備える。取得部１７２は、ユーザの感情に関する指標値を取得する。判定部１７３は、取得部１７２が取得した指標値に対して重み付けを行い、重み付けされた指標値を基に、ユーザの感情を判定する。 As shown in FIG. 1, the emotion determination device 10 as the emotion determination system 1 according to the present embodiment includes an acquisition unit 172 and a determination unit 173. The acquisition unit 172 acquires an index value related to the user's emotion. The determination unit 173 weights the index value acquired by the acquisition unit 172, and determines the user's emotion based on the weighted index value.
　感情判定装置１０は、通知部１７４を、更に備える。通知部１７４は、判定部１７３の判定結果（ユーザの感情）をユーザに通知する。 The emotion determination device 10 further includes a notification unit 174. The notification unit 174 notifies the user of the determination result (user's emotion) of the determination unit 173.
　本実施形態では、感情判定装置１０は、センサ２０及びカメラ３０と通信可能に構成されている。センサ２０は、例えばユーザのバイタル値を検出する。バイタル値は、例えばユーザの心拍数、心拍変動係数、及び自律神経活性度のうち少なくとも１つを含む。すなわち、センサ２０は、ユーザの心拍数、心拍変動係数、及び自律神経活性度のうち少なくとも１つを検出する。自律神経活性度は、副交感神経活動量（ＨＦ）、及び交換神経の活性度（ＬＦ／ＨＦ）のうち少なくとも一方を含む。 In the present embodiment, the emotion determination device 10 is configured to be able to communicate with the sensor 20 and the camera 30. The sensor 20 detects, for example, the vital value of the user. The vital value includes, for example, at least one of the user's heart rate, heart rate variability coefficient, and autonomic nerve activity. That is, the sensor 20 detects at least one of the user's heart rate, heart rate variability coefficient, and autonomic nerve activity. The autonomic nerve activity includes at least one of the parasympathetic nerve activity (HF) and the exchange nerve activity (LF / HF).
　カメラ３０は、ユーザの顔を撮影する。感情判定装置１０は、カメラ３０が撮影したユーザの顔の画像（顔画像）を用いて、ユーザの表情解析を行う。 The camera 30 captures the user's face. The emotion determination device 10 analyzes the user's facial expression using the image (face image) of the user's face taken by the camera 30.
　指標値は、ユーザへのアンケートの回答結果、ユーザのバイタル値、及びユーザに対する表情解析結果のうち少なくとも１つから得られる値である。本実施形態では、感情判定装置１０は、アンケートの回答結果、ユーザのバイタル値、及びユーザに対する表情解析結果のそれぞれを指標値として取得する。 The index value is a value obtained from at least one of the response result of the questionnaire to the user, the vital value of the user, and the facial expression analysis result for the user. In the present embodiment, the emotion determination device 10 acquires each of the questionnaire response result, the user's vital value, and the facial expression analysis result for the user as index values.
　本実施形態では、対象者の感情を表すモデルとして、快適度及び覚醒度を指標とした２次元心理モデル（例えばラッセルの円環モデル）を用いる（図２参照）。図２に示す２次元心理モデルでは、Ｘ軸が快適度を示し、Ｙ軸が覚醒度を示している。Ｘ軸の快適度は、Ｘ軸の正領域が「ポジティブ」であり、Ｘ軸の負領域が「ネガティブ」である。快適度は、Ｘ軸の正領域でのレベル（絶対値）が大きくなるほど快適度が増加し、Ｘ軸の負領域でのレベル（絶対値）が大きくなるほど快適度が減少する。Ｙ軸の覚醒度は、Ｙ軸の正領域が「テンションが高」であり、Ｙ軸の負領域が「テンションが低」である。覚醒度は、Ｙ軸の正領域でのレベル（絶対値）が大きくなるほど覚醒度が増加し、Ｙ軸の負領域でのレベル（絶対値）が大きくなるほど覚醒度が減少する。ユーザの感情（心理状態）は、２次元モデルの象限によって種類が区分けされる。第１象限Ｚ１であれば、感情が、情熱であることを示す。第２象限Ｚ２であれば、感情が、衝動であることを示す。第３象限Ｚ３であれば、感情が、空虚であることを示す。第４象限Ｚ４であれば、感情が、平穏であることを示す。 In this embodiment, a two-dimensional psychological model (for example, Russell's annulus model) using comfort and arousal as indexes is used as a model for expressing the emotions of the subject (see FIG. 2). In the two-dimensional psychological model shown in FIG. 2, the X-axis indicates the degree of comfort and the Y-axis indicates the degree of arousal. The comfort level of the X-axis is "positive" in the positive region of the X-axis and "negative" in the negative region of the X-axis. The comfort level increases as the level (absolute value) in the positive region of the X-axis increases, and the comfort level decreases as the level (absolute value) in the negative region of the X-axis increases. Regarding the degree of arousal on the Y-axis, the positive region on the Y-axis is "high tension" and the negative region on the Y-axis is "low tension". As for the arousal degree, the arousal degree increases as the level (absolute value) in the positive region of the Y-axis increases, and the arousal degree decreases as the level (absolute value) in the negative region of the Y-axis increases. The user's emotions (psychological states) are classified according to the quadrant of the two-dimensional model. If it is the first quadrant Z1, it indicates that the emotion is a passion. If it is the second quadrant Z2, it indicates that the emotion is an impulse. If it is the third quadrant Z3, it indicates that the emotion is empty. If it is the fourth quadrant Z4, it indicates that the emotion is calm.
　判定部１７３は、重み付けされた指標値を基に、ユーザの感情が上記４象限のうちいずれの象限に含まれるかを判定する。本実施形態では、指標値は、Ｙ軸の値、及びＸ軸の値を含む。すなわち、指標値は、ユーザのポジティブ度合を表す第１値と、ユーザの覚醒度（緊張度合）を表す第２値と、を含む。判定部１７３は、第１値及び第２値とのそれぞれに対して重み付けを行い、重み付けされた第１値及び前記第２値で表される２次元座標を基に、ユーザの感情を判定する。 The determination unit 173 determines which of the above four quadrants the user's emotion is included in based on the weighted index value. In the present embodiment, the index value includes a value on the Y-axis and a value on the X-axis. That is, the index value includes a first value indicating the degree of positiveness of the user and a second value indicating the degree of arousal (degree of tension) of the user. The determination unit 173 weights each of the first value and the second value, and determines the user's emotion based on the weighted first value and the two-dimensional coordinates represented by the second value. ..
　（２）構成
　ここでは、感情判定装置１０の構成について、説明する。 (2) Configuration Here, the configuration of the emotion determination device 10 will be described.
　感情判定装置１０は、図１に示すように、通信部１１、記憶部１２、表示部１３、操作部１４、第１入力部１５、第２入力部１６及び制御部１７を備える。 As shown in FIG. 1, the emotion determination device 10 includes a communication unit 11, a storage unit 12, a display unit 13, an operation unit 14, a first input unit 15, a second input unit 16, and a control unit 17.
　感情判定装置１０は、例えば、プロセッサ及びメモリを有するマイクロコンピュータを備えている。プロセッサが適宜のプログラムを実行することにより、コンピュータシステムが制御部１７として機能する。つまり、制御部１７は、プロセッサ及びメモリを有するコンピュータシステムで実現されている。プログラムは、メモリに予め記録されていてもよいし、インターネット等の電気通信回線を通じて、又はメモリカード等の非一時的な記録媒体に記録されて提供されてもよい。 The emotion determination device 10 includes, for example, a microcomputer having a processor and a memory. The computer system functions as the control unit 17 when the processor executes an appropriate program. That is, the control unit 17 is realized by a computer system having a processor and a memory. The program may be pre-recorded in a memory, may be recorded through a telecommunication line such as the Internet, or may be recorded and provided on a non-temporary recording medium such as a memory card.
　通信部１１は、外部の装置、例えば判定結果を用いてユーザの感情を制御する装置と通信を行うための通信インタフェースを有している。通信部１１は、外部の装置と無線による通信を行う。なお、通信部１１は、外部の装置と有線による通信を行ってもよい。 The communication unit 11 has a communication interface for communicating with an external device, for example, a device that controls a user's emotion using a determination result. The communication unit 11 wirelessly communicates with an external device. The communication unit 11 may perform wired communication with an external device.
　記憶部１２は、ＲＯＭ（Read Only Memory）、ＲＡＭ（Random Access Memory）、又はＥＥＰＲＯＭ（Electrically Erasable Programmable Read Only Memory）等の半導体メモリである。なお、記憶部１２は、半導体メモリに限らず、ハードディスクドライブ等であってもよい。なお、記憶部１２は、感情判定装置１０とは別の装置に設けられていてもよいし、感情判定装置１０とネットワークを介して接続されたサーバ、クラウド等に設けられていてもよい。 The storage unit 12 is a semiconductor memory such as a ROM (ReadOnlyMemory), a RAM (RandomAccessMemory), or an EEPROM (ElectricallyErasableProgrammableReadOnlyMemory). The storage unit 12 is not limited to the semiconductor memory, but may be a hard disk drive or the like. The storage unit 12 may be provided in a device different from the emotion determination device 10, or may be provided in a server, cloud, or the like connected to the emotion determination device 10 via a network.
　記憶部１２は、ユーザの感情の判定に用いる情報（例えば、アンケート）を記憶している。 The storage unit 12 stores information (for example, a questionnaire) used for determining the user's emotions.
　表示部１３は、例えば液晶ディスプレイ、有機ＥＬ（Organic Electro Luminescence Display：OELD）等の薄型ディスプレイを有している。表示部１３は、ユーザの感情についての判定結果を表示する。 The display unit 13 has a thin display such as a liquid crystal display or an organic EL (Organic ElectroLuminescence Display: OELD). The display unit 13 displays the determination result about the user's emotion.
　操作部１４は、ユーザの操作を受け付ける。操作部１４は、アンケートの回答を受け付ける。操作部１４は、受け付けた回答を制御部１７に出力する。 The operation unit 14 accepts the user's operation. The operation unit 14 receives the answer to the questionnaire. The operation unit 14 outputs the received answer to the control unit 17.
　第１入力部１５は、センサ２０と通信可能に構成されている。第１入力部１５は、センサ２０が検出したユーザのバイタル値を、センサ２０から受け付ける。 The first input unit 15 is configured to be able to communicate with the sensor 20. The first input unit 15 receives the user's vital value detected by the sensor 20 from the sensor 20.
　第２入力部１６は、カメラ３０と通信可能に構成されている。第２入力部１６は、カメラ３０が撮影した顔画像を、カメラ３０から受け付ける。 The second input unit 16 is configured to be able to communicate with the camera 30. The second input unit 16 receives the face image taken by the camera 30 from the camera 30.
　制御部１７は、図１に示すように、解析部１７１、取得部１７２、判定部１７３及び通知部１７４を有している。 As shown in FIG. 1, the control unit 17 has an analysis unit 171, an acquisition unit 172, a determination unit 173, and a notification unit 174.
　解析部１７１は、第２入力部１６が取得した顔画像を基に、顔画像に含まれるユーザの表情解析を行う。 The analysis unit 171 analyzes the facial expression of the user included in the face image based on the face image acquired by the second input unit 16.
　取得部１７２は、ユーザの感情に関する指標値を取得する。 The acquisition unit 172 acquires an index value related to the user's emotions.
　取得部１７２は、アンケートの回答結果、ユーザのバイタル値、及びユーザに対する表情解析結果のそれぞれを取得する。例えば、取得部１７２は、操作部１４から、アンケートの回答結果を取得する。取得部１７２は、センサ２０の検出結果（ユーザのバイタル値）を、第１入力部１５を介してセンサ２０から取得する。取得部１７２は、解析部１７１のよるユーザに対する表情解析結果を解析部１７１から取得する。 The acquisition unit 172 acquires each of the questionnaire response result, the user's vital value, and the facial expression analysis result for the user. For example, the acquisition unit 172 acquires the answer result of the questionnaire from the operation unit 14. The acquisition unit 172 acquires the detection result (user's vital value) of the sensor 20 from the sensor 20 via the first input unit 15. The acquisition unit 172 acquires the facial expression analysis result for the user by the analysis unit 171 from the analysis unit 171.
　取得部１７２は、アンケートの回答結果を基に、図２に示す２次元心理モデルのＸ軸における快適度（ユーザのポジティブ度合）を表す第１ポジティブ値（第１値）、及びＹ軸における覚醒度（ユーザの緊張度合）を表す第１緊張値（第２値）を、それぞれ取得する。取得部１７２は、アンケートの回答結果を基に得られた、第１ポジティブ値と第１緊張値とを含む組を指標値（以下、「第１指標値」という）として取得する。例えば、アンケートに含まれる複数の問のそれぞれに対して、各々に得点が対応付けられた複数の回答を対応付けておく。取得部１７２は、複数の問のそれぞれに対するユーザの回答に対応付けられた得点を基に、ポジティブ度合に関する得点の合計を第１ポジティブ値とし、緊張度合に関する得点の合計を第１緊張値とする。 Based on the response results of the questionnaire, the acquisition unit 172 has a first positive value (first value) indicating the comfort level (user positive degree) on the X axis of the two-dimensional psychological model shown in FIG. 2, and an arousal on the Y axis. The first tension value (second value) indicating the degree (the degree of tension of the user) is acquired. The acquisition unit 172 acquires a set including the first positive value and the first tension value, which is obtained based on the answer result of the questionnaire, as an index value (hereinafter, referred to as "first index value"). For example, for each of the plurality of questions included in the questionnaire, a plurality of answers to which scores are associated with each are associated. Based on the scores associated with the user's answers to each of the plurality of questions, the acquisition unit 172 sets the total score regarding the degree of positiveness as the first positive value and the total score regarding the degree of tension as the first tension value. ..
　取得部１７２は、ユーザのバイタル値を基に、ユーザのポジティブ度合を表す第２ポジティブ値（第１値）、及びユーザの緊張度合を表す第２緊張値（第２値）を、それぞれ取得する。取得部１７２は、バイタル値を基に得られた、第２ポジティブ値と第２緊張値とを含む組を指標値（以下、「第２指標値」という）として取得する。例えば、取得部１７２は、センサ２０が検出したバイタル値と、バイタル値の一般平均値との差分を、ユーザのバイタルに関する得点として取得する。取得部１７２は、取得したバイタルに関する得点を、第２ポジティブ値及び第２緊張値とする。 The acquisition unit 172 acquires a second positive value (first value) indicating the degree of positiveness of the user and a second tension value (second value) indicating the degree of tension of the user based on the vital value of the user. .. The acquisition unit 172 acquires a set including the second positive value and the second tension value obtained based on the vital value as an index value (hereinafter, referred to as “second index value”). For example, the acquisition unit 172 acquires the difference between the vital value detected by the sensor 20 and the general average value of the vital values as a score related to the user's vitals. The acquisition unit 172 uses the acquired vital scores as the second positive value and the second tension value.
　取得部１７２は、ユーザに対する表情解析結果を基に、ユーザのポジティブ度合を表す第３ポジティブ値（第１値）、及びユーザの緊張度合を表す第３緊張値（第２値）を、それぞれ取得する。取得部１７２は、表情解析結果を基に得られた、第３ポジティブ値と第３緊張値とを含む組を指標値（以下、「第３指標値」という）として取得する。例えば、顔の表情ごとに、得点が割り当てられている。具体的には、怒った表情、悲しい表情、驚いた表情、うれしい表情、無表情（ナチュラルな表情）のそれぞれに対して、得点が割り当てられている。取得部１７２は、ユーザに対する表情解析結果を基に、怒った表情、悲しい表情、驚いた表情、うれしい表情、無表情のうちユーザの対応する表情に応じた表情に関する得点を取得する。取得部１７２は、取得した表情に関する得点を、第３ポジティブ値及び第３緊張値とする。 Based on the facial expression analysis result for the user, the acquisition unit 172 acquires a third positive value (first value) indicating the degree of positiveness of the user and a third tension value (second value) indicating the degree of tension of the user. do. The acquisition unit 172 acquires a set including the third positive value and the third tension value, which is obtained based on the facial expression analysis result, as an index value (hereinafter, referred to as “third index value”). For example, a score is assigned to each facial expression. Specifically, scores are assigned to each of an angry facial expression, a sad facial expression, a surprised facial expression, a happy facial expression, and no expression (natural facial expression). Based on the facial expression analysis result for the user, the acquisition unit 172 acquires a score regarding the facial expression corresponding to the corresponding facial expression of the user among angry facial expression, sad facial expression, surprised facial expression, happy facial expression, and no facial expression. The acquisition unit 172 sets the score regarding the acquired facial expression as the third positive value and the third tension value.
　判定部１７３は、取得部１７２が取得した指標値に対して重み付けを行い、重み付けされた指標値を基に、ユーザの感情を判定する。判定部１７３は、指標値に含まれる第１値及び第２値とのそれぞれに対して重み付けを行い、重み付けされた第１値及び第２値で表される２次元座標を基に、ユーザの感情を判定する。 The determination unit 173 weights the index value acquired by the acquisition unit 172, and determines the user's emotion based on the weighted index value. The determination unit 173 weights each of the first value and the second value included in the index value, and based on the two-dimensional coordinates represented by the weighted first value and second value, the user Judge emotions.
　以下、判定部１７３の詳細な機能について説明する。 Hereinafter, the detailed functions of the determination unit 173 will be described.
　判定部１７３は、第１指標値、第２指標値及び第３指標値の各々に対して、正規化処理を行う。具体的には、判定部１７３は、第１値及び第２値とのそれぞれに対して、所定の範囲に収まるように正規化を行い、正規化された第１値及び第２値とのそれぞれに対して重み付けを行う。 The determination unit 173 performs normalization processing on each of the first index value, the second index value, and the third index value. Specifically, the determination unit 173 normalizes each of the first value and the second value so as to fall within a predetermined range, and the normalized first value and the second value, respectively. Is weighted.
　より詳細には、判定部１７３は、第１指標値に含まれる第１値（第１ポジティブ値）、及び第２値（第１緊張値）のそれぞれに対して、所定の範囲に収まるように正規化を行う。判定部１７３は、正規化された第１ポジティブ値に予め定められた第１重み係数を乗算することで、第１ポジティブ値に対して重み付けを行う。判定部１７３は、正規化された第１緊張値に予め定められた第２重み係数を乗算することで、第１緊張値に対して重み付けを行う。 More specifically, the determination unit 173 is set to fall within a predetermined range for each of the first value (first positive value) and the second value (first tension value) included in the first index value. Perform normalization. The determination unit 173 weights the first positive value by multiplying the normalized first positive value by a predetermined first weighting coefficient. The determination unit 173 weights the first tension value by multiplying the normalized first tension value by a predetermined second weighting coefficient.
　判定部１７３は、第２指標値に含まれる第１値（第２ポジティブ値）、及び第２値（第２緊張値）のそれぞれに対して、所定の範囲に収まるように正規化を行う。判定部１７３は、正規化された第２ポジティブ値に予め定められた第３重み係数を乗算することで、第２ポジティブ値に対して重み付けを行う。判定部１７３は、正規化された第２緊張値に予め定められた第４重み係数を乗算することで、第２緊張値に対して重み付けを行う。 The determination unit 173 normalizes each of the first value (second positive value) and the second value (second tension value) included in the second index value so as to fall within a predetermined range. The determination unit 173 weights the second positive value by multiplying the normalized second positive value by a predetermined third weighting coefficient. The determination unit 173 weights the second tension value by multiplying the normalized second tension value by a predetermined fourth weighting coefficient.
　判定部１７３は、第３指標値に含まれる第１値（第３ポジティブ値）、及び第２値（第３緊張値）のそれぞれに対して、所定の範囲に収まるように正規化を行う。判定部１７３は、正規化された第３ポジティブ値に予め定められた第５重み係数を乗算することで、第３ポジティブ値に対して重み付けを行う。判定部１７３は、正規化された第３緊張値に予め定められた第６重み係数を乗算することで、第３緊張値に対して重み付けを行う。 The determination unit 173 normalizes each of the first value (third positive value) and the second value (third tension value) included in the third index value so as to fall within a predetermined range. The determination unit 173 weights the third positive value by multiplying the normalized third positive value by a predetermined fifth weighting coefficient. The determination unit 173 weights the third tension value by multiplying the normalized third tension value by a predetermined sixth weighting coefficient.
　判定部１７３は、重み付けされた第１値及び第２値で表される２次元座標を基に、ユーザの感情を判定する。具体的には、判定部１７３は、各々が重み付けされた第１ポジティブ値、第２ポジティブ値及び第３ポジティブ値の合計値（第１合計値）を算出する。判定部１７３は、各々が重み付けされた第１緊張値、第２緊張値及び第３緊張値の合計値（第２合計値）を算出する。判定部１７３は、第１合計値及び第２合計値で表される２次元座標が、図２で示す２次元心理モデルにおける４象限のうちいずれかの象限に含まれるかを特定する。判定部１７３は、特定した象限に対応する感情を、ユーザの感情として判定する。 The determination unit 173 determines the emotion of the user based on the two-dimensional coordinates represented by the weighted first value and the second value. Specifically, the determination unit 173 calculates the total value (first total value) of the first positive value, the second positive value, and the third positive value, each of which is weighted. The determination unit 173 calculates a total value (second total value) of the first tension value, the second tension value, and the third tension value, each of which is weighted. The determination unit 173 specifies whether the two-dimensional coordinates represented by the first total value and the second total value are included in any of the four quadrants in the two-dimensional psychological model shown in FIG. The determination unit 173 determines the emotion corresponding to the specified quadrant as the user's emotion.
　通知部１７４は、判定部１７３による判定結果を、ユーザに通知する。例えば、通知部１７４は、判定結果（ユーザの感情）を表示部１３に表示させる。なお、通知部１７４は、判定結果を音声よりユーザに通知してもよい。または、通知部１７４は、ネットワークを介してユーザが所有する情報端末に通知してもよい。ここで、情報端末は、スマートフォン、タブレット端末等である。さらに、通知部１７４は、通信部１１を介して、外部の装置に送信してもよい。 The notification unit 174 notifies the user of the determination result by the determination unit 173. For example, the notification unit 174 causes the display unit 13 to display the determination result (user's emotion). The notification unit 174 may notify the user of the determination result by voice. Alternatively, the notification unit 174 may notify the information terminal owned by the user via the network. Here, the information terminal is a smartphone, a tablet terminal, or the like. Further, the notification unit 174 may transmit to an external device via the communication unit 11.
　（３）動作
　（３．１）全体動作
　ここでは、感情判定装置１０の全体動作について、図３を用いて説明する。 (3) Operation (3.1) Overall operation Here, the overall operation of the emotion determination device 10 will be described with reference to FIG.
　取得部１７２は、指標値を取得する（ステップＳ１）。取得部１７２は、アンケートの回答結果を基に、第１ポジティブ値（第１値）及び第１緊張値（第２値）を含む組を第１指標値として取得する。取得部１７２は、ユーザのバイタル値を基に、第２ポジティブ値（第１値）及び第２緊張値（第２値）を含む組を第２指標値として取得する。取得部１７２は、ユーザに対する表情解析結果を基に、第３ポジティブ値（第１値）及び第３緊張値（第２値）を含む組を第３指標値として取得する。 The acquisition unit 172 acquires the index value (step S1). The acquisition unit 172 acquires a set including the first positive value (first value) and the first tension value (second value) as the first index value based on the response result of the questionnaire. The acquisition unit 172 acquires a set including the second positive value (first value) and the second tension value (second value) as the second index value based on the vital value of the user. The acquisition unit 172 acquires a set including the third positive value (first value) and the third tension value (second value) as the third index value based on the facial expression analysis result for the user.
　判定部１７３は、ユーザの感情を判定する判定処理を行う（ステップＳ２）。判定処理の詳細については、後述する。 The determination unit 173 performs a determination process for determining the user's emotions (step S2). The details of the determination process will be described later.
　通知部１７４は、判定部１７３による判定結果をユーザに通知する通知処理を行う（ステップＳ３）。例えば、通知部１７４は、判定結果（ユーザの感情）を表示部１３に表示させる。 The notification unit 174 performs a notification process for notifying the user of the determination result by the determination unit 173 (step S3). For example, the notification unit 174 causes the display unit 13 to display the determination result (user's emotion).
　（３．２）判定処理
　ここでは、判定処理の詳細について、図４を用いて説明する。 (3.2) Judgment processing Here, the details of the determination processing will be described with reference to FIG.
　判定部１７３は、正規化処理を行う（ステップＳ１１）。判定部１７３は、第１指標値に含まれる第１値（第１ポジティブ値）、及び第２値（第１緊張値）のそれぞれに対して、所定の範囲に収まるように正規化を行う。判定部１７３は、第２指標値に含まれる第１値（第２ポジティブ値）、及び第２値（第２緊張値）のそれぞれに対して、所定の範囲に収まるように正規化を行う。判定部１７３は、第３指標値に含まれる第１値（第３ポジティブ値）、及び第２値（第３緊張値）のそれぞれに対して、所定の範囲に収まるように正規化を行う。 The determination unit 173 performs normalization processing (step S11). The determination unit 173 normalizes each of the first value (first positive value) and the second value (first tension value) included in the first index value so as to fall within a predetermined range. The determination unit 173 normalizes each of the first value (second positive value) and the second value (second tension value) included in the second index value so as to fall within a predetermined range. The determination unit 173 normalizes each of the first value (third positive value) and the second value (third tension value) included in the third index value so as to fall within a predetermined range.
　判定部１７３は、重み付け処理を行う（ステップＳ１２）。判定部１７３は、正規化された第１ポジティブ値に第１重み係数を、正規化された第１緊張値に第２重み係数を乗算することで、第１緊張値に対して重み付けを行う。判定部１７３は、正規化された第２ポジティブ値に第３重み係数を、正規化された第２緊張値に第４重み係数を乗算することで、第２緊張値に対して重み付けを行う。判定部１７３は、正規化された第３ポジティブ値に第５重み係数を、正規化された第３緊張値に第６重み係数を乗算することで、第３緊張値に対して重み付けを行う。 The determination unit 173 performs weighting processing (step S12). The determination unit 173 weights the first tension value by multiplying the normalized first positive value by the first weighting coefficient and the normalized first tension value by the second weighting coefficient. The determination unit 173 weights the second tension value by multiplying the normalized second positive value by the third weighting coefficient and the normalized second tension value by the fourth weighting coefficient. The determination unit 173 weights the third tension value by multiplying the normalized third positive value by the fifth weighting coefficient and the normalized third tension value by the sixth weighting coefficient.
　判定部１７３は、ユーザの感情を判定する（ステップＳ１３）。判定部１７３は、各々が重み付けされた第１ポジティブ値、第２ポジティブ値及び第３ポジティブ値の第１合計値を算出する。判定部１７３は、各々が重み付けされた第１緊張値、第２緊張値及び第３緊張値の第２合計値を算出する。判定部１７３は、第１合計値及び第２合計値で表される２次元座標が、図２で示す２次元心理モデルにおける４象限のうちいずれかの象限に含まれるかを特定する。判定部１７３は、特定した象限に対応する感情を、ユーザの感情として判定する。 The determination unit 173 determines the user's emotions (step S13). The determination unit 173 calculates the first total value of the first positive value, the second positive value, and the third positive value, each of which is weighted. The determination unit 173 calculates the second total value of the first tension value, the second tension value, and the third tension value, each of which is weighted. The determination unit 173 specifies whether the two-dimensional coordinates represented by the first total value and the second total value are included in any of the four quadrants in the two-dimensional psychological model shown in FIG. The determination unit 173 determines the emotion corresponding to the specified quadrant as the user's emotion.
　（４）具体例
　ここでは、具体例を用いて感情判定装置１０が行うユーザの感情の判定について、説明する。 (4) Specific Example Here, the determination of the user's emotion performed by the emotion determination device 10 will be described using a specific example.
　ここでは、アンケートの回答に基づくユーザのポジティブ度合の得点は９点（第１ポジティブ値）、ユーザの緊張度合の得点は６点（第１緊張値）とする。さらに、アンケートの回答に基づくユーザのポジティブ度合の得点がとり得る範囲は３～１５点とする。また、アンケートの回答に基づくユーザのポジティブ度合の得点がとり得る範囲も３～１５点とする。 Here, the score of the user's degree of positiveness based on the answer to the questionnaire is 9 points (first positive value), and the score of the degree of tension of the user is 6 points (first tension value). Furthermore, the range in which the user's positive degree score based on the answers to the questionnaire can be obtained is 3 to 15 points. In addition, the range in which the user's positive degree score based on the answers to the questionnaire can be obtained is also set to 3 to 15 points.
　また、センサ２０は、ユーザのバイタル値としてユーザの心拍数を検出する。ここでは、センサ２０が検出したユーザの心拍数を７０とする。さらに、一般平均値を８０とする。この場合、取得部１７２は、ユーザの心拍数“７０”と、一般平均値“８０”との差分“－１０”を、ユーザのバイタルに関する第２ポジティブ値及び第２緊張値として取得する。なお、ここでは、差分がとり得る範囲は－５０～５０とする。 Further, the sensor 20 detects the user's heart rate as the user's vital value. Here, the heart rate of the user detected by the sensor 20 is 70. Further, the general average value is 80. In this case, the acquisition unit 172 acquires the difference "-10" between the user's heart rate "70" and the general average value "80" as the second positive value and the second tension value regarding the user's vitals. Here, the range in which the difference can be taken is -50 to 50.
　怒った表情、悲しい表情、驚いた表情、うれしい表情、無表情（ナチュラルな表情）のそれぞれに対して、割り当てられる得点を、－０．５、－０．８、０．２、０．３、０．４とする。なお、表情解析結果としてとり得る得点の範囲は－１～１とする。ここでは、解析部１７１は、ユーザの表情解析の結果として、ユーザの表情は悲しい表情であると解析したとする。取得部１７２は、悲しい表情に対応する得点“－０．８”をユーザの表情に関する第３ポジティブ値及び第３緊張値として取得する。 The score assigned to each of an angry facial expression, a sad facial expression, a surprised facial expression, a happy facial expression, and no expression (natural facial expression) is -0.5, -0.8, 0.2, 0.3, It is set to 0.4. The range of scores that can be obtained as a result of facial expression analysis is -1 to 1. Here, it is assumed that the analysis unit 171 analyzes that the user's facial expression is a sad facial expression as a result of the user's facial expression analysis. The acquisition unit 172 acquires the score “−0.8” corresponding to the sad facial expression as the third positive value and the third tension value regarding the user's facial expression.
　さらに、第１重み係数及び第２重み係数のそれぞれを０．２とする。第３重み係数を０．１、第４重み係数を１．０とする。第５重み係数を１．０、第６重み係数を０．１とする。 Further, each of the first weighting coefficient and the second weighting coefficient is set to 0.2. The third weighting factor is 0.1 and the fourth weighting factor is 1.0. The fifth weighting factor is 1.0 and the sixth weighting factor is 0.1.
　なお、上記各数値は一例であり、これらの数値に限定する趣旨ではない。 Note that each of the above figures is an example and is not intended to be limited to these figures.
　判定部１７３は、正規化処理において、第１ポジティブ値“９”、第１緊張値“６”のそれぞれを正規化する。得点のとり得る範囲が３～１５点であるので、第１ポジティブ値“９”、第１緊張値“６”のそれぞれを、所定の範囲（－１～１）の範囲に収まるように正規化を行うと、正規化後の第１ポジティブ値は“０”、正規化後の第１緊張値は“－０．５”となる。 The determination unit 173 normalizes each of the first positive value "9" and the first tension value "6" in the normalization process. Since the range of points that can be scored is 3 to 15, each of the first positive value "9" and the first tension value "6" is normalized so as to fall within a predetermined range (-1 to 1). Then, the first positive value after normalization becomes "0", and the first tension value after normalization becomes "-0.5".
　判定部１７３は、正規化処理において、第２ポジティブ値“－１０”及び第２緊張値“－１０”のそれぞれを正規化する。差分のとり得る範囲が－５０～５０であるので、ユーザの第２ポジティブ値“－１０”、第２緊張値“－１０”のそれぞれを、所定の範囲（－１～１）の範囲に収まるように正規化を行うと、正規化後の第２ポジティブ値及び正規化後の第２緊張値の双方とも“－０．２”となる。 The determination unit 173 normalizes each of the second positive value "-10" and the second tension value "-10" in the normalization process. Since the range in which the difference can be taken is -50 to 50, each of the user's second positive value "-10" and second tension value "-10" is within a predetermined range (-1 to 1). When the normalization is performed in this way, both the second positive value after normalization and the second tension value after normalization become "-0.2".
　判定部１７３は、正規化処理において、第３ポジティブ値“－０．８”及び第３緊張値“０．８”のそれぞれを正規化する。ユーザの第３ポジティブ値“－０．８”、第３緊張値“－０．８”のそれぞれを、所定の範囲（－１～１）の範囲に収まるように正規化を行うと、正規化後の第３ポジティブ値及び第３緊張値の双方とも“－０．８”となる。 The determination unit 173 normalizes each of the third positive value "-0.8" and the third tension value "0.8" in the normalization process. Normalization is performed by normalizing each of the user's third positive value "-0.8" and third tension value "-0.8" so as to fall within a predetermined range (-1 to 1). Both the latter third positive value and the third tension value are "-0.8".
　判定部１７３は、重み付け処理において、正規化後の第１ポジティブ値“０”に第１重み係数“０．２”を、正規化後の第１緊張値“－０．５”に第２重み係数“０．２”を、それぞれ乗算する。その結果、重み付けされた第１ポジティブ値は“０”、第１緊張値は“－０．１”となる。 In the weighting process, the determination unit 173 sets the first weighting factor “0.2” for the first positive value “0” after normalization and the second weight for the first tension value “−0.5” after normalization. Multiply the coefficient "0.2" respectively. As a result, the weighted first positive value is "0" and the first tension value is "-0.1".
　判定部１７３は、重み付け処理において、正規化後の第２ポジティブ値“－０．２”に第３重み係数“０．１”を、正規化後の第２緊張値“－０．２”に第４重み係数“１．０”を、それぞれ乗算する。その結果、重み付けされた第２ポジティブ値は“－０．０２”、第２緊張値は“－０．２”となる。 In the weighting process, the determination unit 173 sets the third weighting factor "0.1" to the second positive value "-0.2" after normalization and the second tension value "-0.2" after normalization. The fourth weighting factor "1.0" is multiplied by each. As a result, the weighted second positive value is "-0.02" and the second tension value is "-0.2".
　判定部１７３は、重み付け処理において、正規化後の第３ポジティブ値“－０．８”に第５重み係数“１．０”を、正規化後の第３緊張値“－０．８”に第２重み係数“０．１”を、それぞれ乗算する。その結果、重み付けされた第３ポジティブ値は“－０．８”、第３緊張値は“－０．０８”となる。 In the weighting process, the determination unit 173 sets the fifth weighting factor "1.0" to the third positive value "-0.8" after normalization and the third tension value "-0.8" after normalization. The second weighting factor "0.1" is multiplied by each. As a result, the weighted third positive value is "-0.8" and the third tension value is "-0.08".
　判定部１７３は、重み付けされた第１ポジティブ値、重み付けされた第２ポジティブ値及び重み付けされた第３ポジティブ値を用いて、第１合計値を算出する。重み付けされた第１ポジティブ値、重み付けされた第２ポジティブ値及び重み付けされた第３ポジティブ値はそれぞれ“０”、“－０．０２”及び“－０．８”であるので、第１合計値は－０．８２となる。 The determination unit 173 calculates the first total value using the weighted first positive value, the weighted second positive value, and the weighted third positive value. Since the weighted first positive value, the weighted second positive value, and the weighted third positive value are "0", "-0.02", and "-0.8", respectively, the first total value. Is -0.82.
　判定部１７３は、重み付けされた第１緊張値、重み付けされた第２緊張値及び重み付けされた第３緊張値を用いて、第２合計値を算出する。重み付けされた第１緊張値、重み付けされた第２緊張値及び重み付けされた第３緊張値はそれぞれ“－０．１”、“－０．２”及び“－０．０８”であるので、第２合計値は－０．３８となる。 The determination unit 173 calculates the second total value using the weighted first tension value, the weighted second tension value, and the weighted third tension value. The weighted first tension value, the weighted second tension value, and the weighted third tension value are "-0.1", "-0.2", and "-0.08", respectively. 2 The total value is -0.38.
　判定部１７３は、第１合計値をＸ軸座標、第２合計値をＹ座標とする、第１合計値及び第２合計値とからなる２次元座標が、図２で示す２次元心理モデルにおける４象限のうちいずれかの象限に含まれるかを特定する。判定部１７３は、特定した象限に対応する感情を、ユーザの感情として判定する。ここでは、第１合計値は－０．８２、第２合計値はー０．３８であるので、第１合計値及び第２合計値とからなる２次元座標は第４象限に存在する。したがって、判定部１７３は、ユーザの感情は空虚であると判定する。 In the determination unit 173, the two-dimensional coordinates consisting of the first total value and the second total value, in which the first total value is the X-axis coordinate and the second total value is the Y coordinate, are in the two-dimensional psychological model shown in FIG. Identify which of the four quadrants is included. The determination unit 173 determines the emotion corresponding to the specified quadrant as the user's emotion. Here, since the first total value is −0.82 and the second total value is −0.38, the two-dimensional coordinates consisting of the first total value and the second total value exist in the fourth quadrant. Therefore, the determination unit 173 determines that the user's emotions are empty.
　（５）利点
　以上説明したように、感情判定システム１は、取得部１７２と、判定部１７３と、を備える。取得部１７２は、ユーザの感情に関する指標値を取得する。判定部１７３は、指標値に対して重み付けを行い、重み付けされた指標値を基に、ユーザの感情を判定する。 (5) Advantages As described above, the emotion determination system 1 includes an acquisition unit 172 and a determination unit 173. The acquisition unit 172 acquires an index value related to the user's emotion. The determination unit 173 weights the index value and determines the user's emotion based on the weighted index value.
　この構成によると、感情判定システム１は、重み付けされた指標値を基に、ユーザの感情を判定するので、より精度よくユーザの感情を判定することができる。 According to this configuration, the emotion determination system 1 determines the user's emotion based on the weighted index value, so that the user's emotion can be determined more accurately.
　また、感情判定システム１では、判定部１７３は、指標値に含まれる第１値及び第２値とのそれぞれに対して、所定の範囲に収まるように正規化を行い、正規化された第１値及び第２値とのそれぞれに対して重み付けを行う。 Further, in the emotion determination system 1, the determination unit 173 normalizes each of the first value and the second value included in the index value so as to fall within a predetermined range, and is normalized first. Weighting is performed for each of the value and the second value.
　この構成によると、指標の基準が異なる値（アンケートの回答、バイタル値、表情解析結果）を、同一の指標で扱うことができる。そのため、より精度よくユーザの感情を判定することができる。 According to this configuration, values with different index criteria (questionnaire responses, vital values, facial expression analysis results) can be handled with the same index. Therefore, the user's emotion can be determined more accurately.
　（６）変形例
　以下、実施形態の変形例について説明する。 (6) Modification Example Hereinafter, a modification of the embodiment will be described.
　（６．１）変形例１
　実施形態では、感情判定装置１０は、ポジティブ度合及び緊張度合の双方を用いて、ユーザの感情を判定する構成としているが、この構成に限定されない。 (6.1) Modification 1
In the embodiment, the emotion determination device 10 is configured to determine the emotion of the user by using both the positive degree and the tension degree, but is not limited to this configuration.
　感情判定装置１０は、ポジティブ度合及び緊張度合のうち一方のみを用いて、ユーザの感情を判定してもよい。 The emotion determination device 10 may determine the user's emotion using only one of the positive degree and the tension degree.
　例えば、感情判定装置１０がポジティブ度合のみを用いる場合、感情判定装置１０は、上述した第１合計値を基に、ユーザの感情がポジティブであるか、ネガティブであるかを判定する。具体的には、感情判定装置１０は、第１合計値が０以上である場合にはユーザの感情はポジティブであると判定し、第１合計値が０より小さい値である場合にはユーザの感情はネガティブであると判定する。 For example, when the emotion determination device 10 uses only the positive degree, the emotion determination device 10 determines whether the user's emotion is positive or negative based on the above-mentioned first total value. Specifically, the emotion determination device 10 determines that the user's emotion is positive when the first total value is 0 or more, and when the first total value is less than 0, the user's emotion is determined. Emotions are judged to be negative.
　例えば、感情判定装置１０が緊張度合のみを用いる場合、感情判定装置１０は、上述した第２合計値を基に、ユーザの感情が高テンションであるか、低テンションであるかを判定する。具体的には、感情判定装置１０は、第２合計値が０以上である場合にはユーザの感情は高テンションであると判定し、第２合計値が０より小さい値である場合にはユーザの感情は低テンションであると判定する。 For example, when the emotion determination device 10 uses only the degree of tension, the emotion determination device 10 determines whether the user's emotion is high tension or low tension based on the above-mentioned second total value. Specifically, the emotion determination device 10 determines that the user's emotion is high tension when the second total value is 0 or more, and the user when the second total value is less than 0. It is judged that the emotion of is low tension.
　（６．２）変形例２
　カメラ３０が撮影を行っている間において、ユーザの表情が変化する場合がある。この場合、解析部１７１が複数の表情解析結果を得る可能性がある。 (6.2) Modification 2
The facial expression of the user may change while the camera 30 is taking a picture. In this case, the analysis unit 171 may obtain a plurality of facial expression analysis results.
　そこで、取得部１７２は、複数の表情解析結果が解析部１７１で得られた場合、複数の表情解析結果にそれぞれ対応する複数の得点のうち最大値を代表値とし、当該代表値を正規化処理及び重み付け処理に用いてもよい。すなわち、取得部１７２は、代表値を指標値として用いて、ユーザの感情を判定してもよい。 Therefore, when a plurality of facial expression analysis results are obtained by the analysis unit 171, the acquisition unit 172 sets the maximum value among the plurality of scores corresponding to the plurality of facial expression analysis results as the representative value, and normalizes the representative value. And may be used for weighting processing. That is, the acquisition unit 172 may determine the emotion of the user by using the representative value as the index value.
　または、複数の表情解析結果にそれぞれ対応する複数の得点の平均値、中央値、最小値のいずれかを代表値としてもよい。 Alternatively, any one of the average value, the median value, and the minimum value of the plurality of scores corresponding to the plurality of facial expression analysis results may be used as the representative value.
　（６．３）変形例３
　実施形態では、感情判定装置１０は、指標値として、アンケートの回答に基づく値、バイタル値に基づく値、及び表情解析結果に基づく値を用いる構成としているが、この構成に限定されない。 (6.3) Modification 3
In the embodiment, the emotion determination device 10 is configured to use a value based on the answer to the questionnaire, a value based on the vital value, and a value based on the facial expression analysis result as the index value, but the present invention is not limited to this configuration.
　感情判定装置１０は、アンケートの回答に基づく値、バイタル値に基づく値、及び表情解析結果のうち１つを指標値として用いてもよい。または、感情判定装置１０は、アンケートの回答に基づく値、バイタル値に基づく値、及び表情解析結果のうち２つを指標値として用いてもよい。 The emotion determination device 10 may use one of a value based on the answer to the questionnaire, a value based on the vital value, and a facial expression analysis result as an index value. Alternatively, the emotion determination device 10 may use two of the value based on the answer to the questionnaire, the value based on the vital value, and the facial expression analysis result as the index value.
　すなわち、感情判定装置１０は、アンケートの回答に基づく値、バイタル値に基づく値、及び表情解析結果のうち少なくとも１つを指標値として用いる構成であればよい。 That is, the emotion determination device 10 may be configured to use at least one of a value based on the answer to the questionnaire, a value based on the vital value, and a facial expression analysis result as an index value.
　（６．４）変形例４
　実施形態では、感情判定装置１０の判定部１７３は、指標値の正規化を行う構成としているが、この構成に限定されない。 (6.4) Modification 4
In the embodiment, the determination unit 173 of the emotion determination device 10 is configured to normalize the index value, but is not limited to this configuration.
　判定部１７３は、指標値の正規化を行わなくてもよい。すなわち、判定部１７３は、指標値の正規化を行うことは必須ではない。言い換えると、判定部は、指標値に対して、少なくとも重み付けを行う構成であればよい。 The determination unit 173 does not have to normalize the index value. That is, it is not essential for the determination unit 173 to normalize the index value. In other words, the determination unit may be configured to at least weight the index value.
　指標値の正規化を行わない場合には、判定部１７３は、取得部１７２が取得した指標値（第１ポジティブ値、第１緊張値、第２ポジティブ値、第２緊張値、第３ポジティブ値及び第３緊張値）に対して、重み付けを行う。 When the index value is not normalized, the determination unit 173 uses the index value (first positive value, first tension value, second positive value, second tension value, third positive value) acquired by the acquisition unit 172. And the third tension value) are weighted.
　（その他の変形例）
　上記実施形態は、本開示の様々な実施形態の一つに過ぎない。上記実施形態は、本開示の目的を達成できれば、設計等に応じて種々の変更が可能である。また、感情判定システム１と同様の機能は、感情判定方法、コンピュータプログラム、又はプログラムを記録した非一時的な記録媒体等で具現化されてもよい。 (Other variants)
The above embodiment is only one of the various embodiments of the present disclosure. The above embodiment can be variously modified according to the design and the like as long as the object of the present disclosure can be achieved. Further, the same function as the emotion determination system 1 may be embodied by an emotion determination method, a computer program, a non-temporary recording medium on which the program is recorded, or the like.
　一態様に係る感情判定システム１の感情判定方法は、取得ステップと、判定ステップと、を含む。取得ステップは、ユーザの感情に関する指標値を取得する。判定ステップは、指標値に対して重み付けを行い、重み付けされた指標値を基に、ユーザの感情を判定する。一態様に係るプログラムは、コンピュータシステムを、上述した感情判定システム１又は感情判定システム１の感情判定方法として機能させるためのプログラムである。 The emotion determination method of the emotion determination system 1 according to one aspect includes an acquisition step and a determination step. The acquisition step acquires an index value related to the user's emotion. The determination step weights the index value and determines the user's emotion based on the weighted index value. The program according to one aspect is a program for making a computer system function as the emotion determination method of the emotion determination system 1 or the emotion determination system 1 described above.
　本開示における感情判定システム１又は感情判定システム１の感情判定方法の実行主体は、コンピュータシステムを含んでいる。コンピュータシステムは、ハードウェアとしてのプロセッサ及びメモリを有する。コンピュータシステムのメモリに記録されたプログラムをプロセッサが実行することによって、本開示における感情判定システム１又は感情判定システム１の感情判定方法の実行主体としての機能が実現される。プログラムは、コンピュータシステムのメモリに予め記録されていてもよいが、電気通信回線を通じて提供されてもよい。また、プログラムは、コンピュータシステムで読み取り可能なメモリカード、光学ディスク、ハードディスクドライブ等の非一時的な記録媒体に記録されて提供されてもよい。コンピュータシステムのプロセッサは、半導体集積回路（ＩＣ）又は大規模集積回路（ＬＳＩ）を含む１乃至複数の電子回路で構成される。ここでいうＩＣ又はＬＳＩ等の集積回路は、集積の度合いによって呼び方が異なっており、システムＬＳＩ、ＶＬＳＩ（Very Large Scale Integration）、又はＵＬＳＩ（Ultra Large Scale Integration）と呼ばれる集積回路を含む。さらに、ＬＳＩの製造後にプログラムされる、ＦＰＧＡ（Field-Programmable Gate Array）、又はＬＳＩ内部の接合関係の再構成若しくはＬＳＩ内部の回路区画の再構成が可能な論理デバイスについても、プロセッサとして採用することができる。複数の電子回路は、１つのチップに集約されていてもよいし、複数のチップに分散して設けられていてもよい。複数のチップは、１つの装置に集約されていてもよいし、複数の装置に分散して設けられていてもよい。 The executing body of the emotion determination system 1 or the emotion determination method of the emotion determination system 1 in the present disclosure includes a computer system. The computer system has a processor and memory as hardware. When the processor executes the program recorded in the memory of the computer system, the function as the execution subject of the emotion determination system 1 or the emotion determination method of the emotion determination system 1 in the present disclosure is realized. The program may be pre-recorded in the memory of the computer system, but may be provided through a telecommunication line. Further, the program may be recorded and provided on a non-temporary recording medium such as a memory card, an optical disk, or a hard disk drive that can be read by a computer system. The processor of a computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large scale integrated circuit (LSI). The integrated circuit such as IC or LSI referred to here has a different name depending on the degree of integration, and includes an integrated circuit called a system LSI, VLSI (Very Large Scale Integration), or ULSI (Ultra Large Scale Integration). Further, an FPGA (Field-Programmable Gate Array) programmed after the LSI is manufactured, or a logical device capable of reconfiguring the junction relationship inside the LSI or reconfiguring the circuit partition inside the LSI should also be adopted as a processor. Can be done. A plurality of electronic circuits may be integrated on one chip, or may be distributed on a plurality of chips. A plurality of chips may be integrated in one device, or may be distributed in a plurality of devices.
　また、感情判定システム１における複数の機能が、１つの筐体内に集約されていることは感情判定システム１に必須の構成ではなく、感情判定システム１の構成要素は、複数の筐体に分散して設けられていてもよい。さらに、感情判定システム１の少なくとも一部の機能がクラウド（クラウドコンピューティング）等によって実現されてもよい。 Further, it is not an essential configuration for the emotion determination system 1 that a plurality of functions in the emotion determination system 1 are integrated in one housing, and the components of the emotion determination system 1 are dispersed in a plurality of housings. It may be provided. Further, at least a part of the functions of the emotion determination system 1 may be realized by a cloud (cloud computing) or the like.
　（まとめ）
　以上説明したように、第１の態様の感情判定システム（１）は、取得部（１７２）と、判定部（１７３）と、を備える。取得部（１７２）は、ユーザの感情に関する指標値を取得する。判定部（１７３）は、指標値に対して重み付けを行い、重み付けされた指標値を基に、ユーザの感情を判定する。 (summary)
As described above, the emotion determination system (1) of the first aspect includes an acquisition unit (172) and a determination unit (173). The acquisition unit (172) acquires an index value related to the user's emotion. The determination unit (173) weights the index value and determines the user's emotion based on the weighted index value.
　この構成によると、感情判定システム（１）は、重み付けされた指標値を基に、ユーザの感情を判定するので、より精度よくユーザの感情を判定することができる。 According to this configuration, the emotion determination system (1) determines the user's emotion based on the weighted index value, so that the user's emotion can be determined more accurately.
　第２の態様の感情判定システム（１）では、第１の態様において、指標値は、ユーザのポジティブ度合を表す第１値と、ユーザの緊張度合を表す第２値と、含む。判定部（１７３）は、第１値及び第２値とのそれぞれに対して重み付けを行い、重み付けされた第１値及び第２値で表される２次元座標を基に、ユーザの感情を判定する。 In the emotion determination system (1) of the second aspect, in the first aspect, the index value includes a first value indicating the degree of positiveness of the user and a second value indicating the degree of tension of the user. The determination unit (173) weights each of the first value and the second value, and determines the user's emotion based on the two-dimensional coordinates represented by the weighted first value and the second value. do.
　この構成によると、２次元心理モデルを用いてユーザの感情は判定することができる。 According to this configuration, the user's emotions can be determined using a two-dimensional psychological model.
　第３の態様の感情判定システム（１）では、第２の態様において、判定部（１７３）は、第１値及び第２値とのそれぞれに対して、所定の範囲に収まるように正規化を行い、正規化された第１値及び第２値とのそれぞれに対して重み付けを行う。 In the emotion determination system (1) of the third aspect, in the second aspect, the determination unit (173) normalizes each of the first value and the second value so as to fall within a predetermined range. And weighting is performed for each of the normalized first value and the second value.
　この構成によると、指標の基準が異なる値（アンケートの回答、バイタル値、表情解析結果）を、同一の指標で扱うことができる。そのため、より精度よくユーザの感情を判定することができる。 According to this configuration, values with different index criteria (questionnaire responses, vital values, facial expression analysis results) can be handled with the same index. Therefore, the user's emotion can be determined more accurately.
　第４の態様の感情判定システム（１）では、第１～第３のいずれかの態様において、指標値は、ユーザへのアンケートの回答結果、ユーザのバイタル値、及びユーザに対する表情解析結果のうち少なくとも１つから得られる値である。 In the emotion determination system (1) of the fourth aspect, in any one of the first to third aspects, the index value is a result of a questionnaire to the user, a vital value of the user, and a facial expression analysis result to the user. It is a value obtained from at least one.
　この構成によると、ユーザへのアンケートの回答結果、ユーザのバイタル値、及びユーザに対する表情解析結果のうち少なくとも１つから得られる値を用いて、ユーザの感情を判定することができる。 According to this configuration, the user's emotion can be determined using the value obtained from at least one of the response result of the questionnaire to the user, the vital value of the user, and the facial expression analysis result for the user.
　第５の態様の感情判定システム（１）では、第４の態様において、バイタル値は、ユーザの心拍数、心拍変動係数、及び自律神経活性度のうち少なくとも１つを含む。 In the fifth aspect of the emotion determination system (1), in the fourth aspect, the vital value includes at least one of the user's heart rate, heart rate variability coefficient, and autonomic nervous activity.
　この構成によると、ユーザの心拍数、心拍変動係数、及び自律神経活性度のうち少なくとも１つを用いて、ユーザの感情を判定することができる。 According to this configuration, the user's emotion can be determined using at least one of the user's heart rate, heart rate variability coefficient, and autonomic nervous activity.
　第６の態様の感情判定システム（１）では、第４又は第５の態様において、表情解析結果は、ユーザの表情における感情を数値化した感情値のうち最大値である感情値を代表値として含む。判定部（１７３）は、代表値を用いてユーザの感情を判定する。 In the emotion determination system (1) of the sixth aspect, in the fourth or fifth aspect, the facial expression analysis result is represented by the emotion value which is the maximum value among the emotion values obtained by quantifying the emotions in the user's facial expression. include. The determination unit (173) determines the user's emotion using the representative value.
　この構成によると、代表値を用いて、ユーザの感情を判定することができる。 According to this configuration, the user's emotion can be determined using the representative value.
　第７の態様の感情判定方法は、取得ステップと、判定ステップと、を含む。取得ステップは、ユーザの感情に関する指標値を取得する。判定ステップは、指標値に対して重み付けを行い、重み付けされた指標値を基に、ユーザの感情を判定する。 The emotion determination method of the seventh aspect includes an acquisition step and a determination step. The acquisition step acquires an index value related to the user's emotion. The determination step weights the index value and determines the user's emotion based on the weighted index value.
　この感情判定方法によると、より精度よくユーザの感情を判定することができる。 According to this emotion determination method, the user's emotion can be determined more accurately.
　第８の態様のプログラムは、コンピュータに、第７の態様の感情判定方法を実行させるためのプログラムである。 The program of the eighth aspect is a program for causing a computer to execute the emotion determination method of the seventh aspect.
　このプログラムによると、より精度よくユーザの感情を判定することができる。 According to this program, the user's emotions can be judged more accurately.
　　１　感情判定システム
　　１０　感情判定装置
　　１７２　取得部
　　１７３　判定部 1 Emotion judgment system 10 Emotion judgment device 172 Acquisition unit 173 Judgment unit

Claims (8)

  1. 　ユーザの感情に関する指標値を取得する取得部と、
    　前記指標値に対して重み付けを行い、重み付けされた前記指標値を基に、前記ユーザの感情を判定する判定部と、を備える、
    　感情判定システム。     An acquisition unit that acquires index values related to the user's emotions,
    A determination unit that weights the index value and determines the emotion of the user based on the weighted index value is provided.
    Emotion judgment system.
  2. 　前記指標値は、前記ユーザのポジティブ度合を表す第１値と、前記ユーザの緊張度合を表す第２値と、含み、
    　前記判定部は、前記第１値及び前記第２値とのそれぞれに対して重み付けを行い、重み付けされた前記第１値及び前記第２値で表される２次元座標を基に、前記ユーザの感情を判定する、
    　請求項１に記載の感情判定システム。     The index value includes a first value representing the degree of positiveness of the user and a second value representing the degree of tension of the user.
    The determination unit weights each of the first value and the second value, and based on the two-dimensional coordinates represented by the weighted first value and the second value, the user's Judging emotions,
    The emotion determination system according to claim 1.
  3. 　前記判定部は、前記第１値及び前記第２値とのそれぞれに対して、所定の範囲に収まるように正規化を行い、正規化された前記第１値及び前記第２値とのそれぞれに対して重み付けを行う、
    　請求項２に記載の感情判定システム。     The determination unit normalizes each of the first value and the second value so as to fall within a predetermined range, and applies the normalized first value and the second value to each of the normalized first value and the second value. Weighting against,
    The emotion determination system according to claim 2.
  4. 　前記指標値は、前記ユーザへのアンケートの回答結果、前記ユーザのバイタル値、及び前記ユーザに対する表情解析結果のうち少なくとも１つから得られる値である、
    　請求項１～３のいずれか一項に記載の感情判定システム。     The index value is a value obtained from at least one of a questionnaire response result to the user, a vital value of the user, and a facial expression analysis result to the user.
    The emotion determination system according to any one of claims 1 to 3.
  5. 　前記バイタル値は、前記ユーザの心拍数、心拍変動係数、及び自律神経活性度のうち少なくとも１つを含む、
    　請求項４に記載の感情判定システム。     The vital value comprises at least one of the user's heart rate, heart rate variability coefficient, and autonomic nerve activity.
    The emotion determination system according to claim 4.
  6. 　前記表情解析結果は、前記ユーザの表情における感情を数値化した感情値のうち最大値である感情値を代表値として含み、
    　前記判定部は、前記代表値を用いて前記ユーザの感情を判定する、
    　請求項４又は５に記載の感情判定システム。     The facial expression analysis result includes, as a representative value, the emotion value which is the maximum value among the emotion values obtained by quantifying the emotions in the facial expression of the user.
    The determination unit determines the emotion of the user using the representative value.
    The emotion determination system according to claim 4 or 5.
  7. 　ユーザの感情に関する指標値を取得する取得ステップと、
    　前記指標値に対して重み付けを行い、重み付けされた前記指標値を基に、前記ユーザの感情を判定する判定ステップと、を含む、
    　感情判定方法。     The acquisition step to acquire the index value related to the user's emotion, and
    A determination step of weighting the index value and determining the emotion of the user based on the weighted index value is included.
    Emotion judgment method.
  8. 　コンピュータに、請求項７に記載の感情判定方法を実行させるためのプログラム。 A program for causing a computer to execute the emotion determination method according to claim 7.
PCT/JP2021/004907 2020-11-26 2021-02-10 Emotion assessment system, emotion assessment method, and program WO2022113380A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020196298 2020-11-26
JP2020-196298 2020-11-26

Publications (1)

Publication Number Publication Date
WO2022113380A1 true WO2022113380A1 (en) 2022-06-02

Family

ID=81754130

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/004907 WO2022113380A1 (en) 2020-11-26 2021-02-10 Emotion assessment system, emotion assessment method, and program

Country Status (1)

Country Link
WO (1) WO2022113380A1 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009111938A (en) * 2007-11-01 2009-05-21 Nippon Telegr & Teleph Corp <Ntt> Device, method and program for editing information, and record medium recorded with the program thereon
JP2011155605A (en) * 2010-01-28 2011-08-11 Nikon Corp Image processing device, imaging device, and image processing program
JP2017144222A (en) * 2015-10-14 2017-08-24 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Emotion estimating method, emotion estimating apparatus, and recording medium storing program
JP2018189720A (en) * 2017-04-28 2018-11-29 パナソニックＩｐマネジメント株式会社 Information output control device, information output control method, information output system and program
JP2019036281A (en) * 2017-08-21 2019-03-07 パナソニックＩｐマネジメント株式会社 Information processing method, information processing device and information processing program
CN111079465A (en) * 2018-10-18 2020-04-28 北京入思技术有限公司 Emotional state comprehensive judgment method based on three-dimensional imaging analysis
WO2020170645A1 (en) * 2019-02-22 2020-08-27 ソニー株式会社 Information processing device, information processing method, and program

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009111938A (en) * 2007-11-01 2009-05-21 Nippon Telegr & Teleph Corp <Ntt> Device, method and program for editing information, and record medium recorded with the program thereon
JP2011155605A (en) * 2010-01-28 2011-08-11 Nikon Corp Image processing device, imaging device, and image processing program
JP2017144222A (en) * 2015-10-14 2017-08-24 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Emotion estimating method, emotion estimating apparatus, and recording medium storing program
JP2018189720A (en) * 2017-04-28 2018-11-29 パナソニックＩｐマネジメント株式会社 Information output control device, information output control method, information output system and program
JP2019036281A (en) * 2017-08-21 2019-03-07 パナソニックＩｐマネジメント株式会社 Information processing method, information processing device and information processing program
CN111079465A (en) * 2018-10-18 2020-04-28 北京入思技术有限公司 Emotional state comprehensive judgment method based on three-dimensional imaging analysis
WO2020170645A1 (en) * 2019-02-22 2020-08-27 ソニー株式会社 Information processing device, information processing method, and program

Similar Documents

Publication Publication Date Title
JP7293050B2 (en) Mild Cognitive Impairment Judgment System
US10123735B2 (en) Electronic device for determining sleep state and method of controlling same
US10937528B2 (en) Chronic disease discovery and management system
JP6144412B2 (en) Automatic quality assessment of physiological signals
US11178389B2 (en) Self-calibrating display device
US20190261863A1 (en) System and method for providing an indication of the well-being of an individual
US9924861B2 (en) System and methods for assessing vision using a computing device
US20230222934A1 (en) Systems and methods for dynamic monitoring of test taking
WO2020207317A1 (en) User health assessment method and apparatus, and storage medium and electronic device
US20160135752A1 (en) Small data aggregator for personal health management
KR20180108201A (en) Method and apparatus for controlling white balance function of electronic device
KR20190021111A (en) Method and apparatus for providing guide information associated with exercise intensity based on user activity information
US20210406928A1 (en) Information processing device, information processing method, and recording medium
WO2022113380A1 (en) Emotion assessment system, emotion assessment method, and program
JP2017176580A (en) Emotion control device, emotion control method, and program
US20200178840A1 (en) Method and device for marking adventitious sounds
US20220114674A1 (en) Health lab data model for risk assessment
KR102390599B1 (en) Method and apparatus for training inner concentration
Seto et al. Prediction of personal cardiovascular risk using machine learning for smartphone applications
US20210193171A1 (en) Information processing apparatus and non-transitory computer readable medium
JP7119755B2 (en) HEALTH MANAGEMENT DEVICE, HEALTH MANAGEMENT METHOD, AND PROGRAM
JP2021174039A (en) Determination apparatus, determination method, and determination program
TWM590744U (en) Risk assessment system
US20220148089A1 (en) Information processing apparatus, information processing method, and recording medium
Gupta et al. A hybrid approach based stress monitoring system for office environment using IoT

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21897360

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21897360

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP