JP7170274B2 - Mental state determination device - Google Patents

Description

The technical field of the present specification relates to a psychological state determination device for estimating a person's mental state.

A person's psychological state affects various activities such as consumption behavior and vehicle driving tendency. A person's psychological state fluctuates according to an external stimulus. Therefore, methods for estimating a person's psychological state have been researched and developed.

Patent Literature 1 discloses a technique for estimating a person's emotional intensity from a person's pupil diameter. In Patent Document 1, an emotion calculation unit normalizes the second pupil diameter information with the first pupil diameter information to generate information for estimating the intensity of emotion of the observer who observed the target image. The information for estimating the strength of the observer's emotion corresponds to the stronger the observer's emotion as the value obtained by normalizing the second pupil diameter information with the first pupil diameter information increases ( Patent Document 1, claim 1 of Japanese Patent No. 5438591).

JP 2011-239891 A

As described above, the technique of Patent Document 1 can estimate the emotional intensity of a person. However, it is difficult to determine whether the emotion is pleasant or unpleasant. Comparing a person's psychological state in a pleasant state and a person's psychological state in an unpleasant state, human activities are completely different.

The problem to be solved by the technology of the present specification is to provide a psychological state determination device that can determine whether a person's mental state is a pleasant state, an unpleasant state, or a neutral state.

The psychological state determination device according to the first aspect includes a pupil measurement unit that measures the diameter of a person's pupil, a psychological determination unit that determines the psychological state of the person, and a period that the psychological determination unit sets a period for use in determination. and a setting unit. The period setting unit sets a reference time, a first period from the reference time to the first time, and a second period from the first time to the second time. The psychological determination unit determines whether the person's psychological state is a pleasant state, an unpleasant state, or a neutral state from the change history of the diameter of the pupil measured by the pupil measurement unit during the first period and the second period. determine whether

This psychological state determination device can determine a person's psychological state from a measured value of the person's pupil diameter. Even if measurements other than the person's pupil are not used, the person's psychological state can be determined. Therefore, this psychological state determination device is very simple and can determine a person's mental state without a complicated measuring device.

This specification provides a psychological state determination device capable of determining whether a person's mental state is a pleasant state, an unpleasant state, or a neutral state.

BRIEF DESCRIPTION OF THE DRAWINGS It is a figure which shows schematic structure of the psychological state determination apparatus of 1st Embodiment. 2 is a block diagram showing a control system of the psychological state determination device of the first embodiment; FIG. 4 is a graph schematically showing responsiveness of pupil diameter when a stimulus is presented to a person. 4 is a flowchart for explaining the flow of determining a person's mental state by the mental state determination device of the first embodiment; 9 is a flow chart for explaining the flow of determining a person's mental state by the mental state determination device of the second embodiment; It is a figure which shows an experimental procedure. 4 is a graph showing the amount of change in pupil diameter with respect to stimulation. 7 is a graph showing the amount of change in pupil diameter during the first period T1. 9 is a graph showing the amount of change in pupil diameter during the second period T2. It is a graph which shows the elapsed time from the reference time t0 to the time when a peak value is taken. It is a graph which shows a classification result.

Specific embodiments will be described below by taking a mental state determination device as an example. However, the technology herein is not limited to these embodiments.

(First embodiment)
1. Mental State Determination Device FIG. 1 is a diagram showing a schematic configuration of a mental state determination device 100 according to the first embodiment. The mental state determination device 100 is a device that estimates a person's mental state by measuring changes in the diameter of a person's pupil over time. As shown in FIG. 1 , psychological state determination device 100 includes visual stimulus presentation section 110 , auditory stimulus presentation section 120 , pupil measurement section 130 , and control section 140 . The visual stimulus presentation unit 110 and the auditory stimulus presentation unit 120 are stimulus presentation units that present stimuli to people.

The visual stimulus presentation unit 110 is for presenting visual stimuli to people. The visual stimulus presentation unit 110 is, for example, a display. The visual stimulus presentation unit 110 presents, for example, a video or an image to a person as a visual stimulus.

The auditory stimulus presentation unit 120 is for presenting an auditory stimulus to a person. The auditory stimulation presentation unit 120 is, for example, a speaker. The auditory stimulus presenting unit 120 presents, for example, a voice instruction or music to a person as an auditory stimulus. Alternatively, other auditory stimuli may be given. The auditory stimulus presenting unit 120 intermittently presents, for example, sounds that are unrelated to a person's psychological state. The irrelevant sound may be periodic.

The pupil measurement unit 130 is for measuring the diameter of a human pupil. Pupil measurement unit 130 continuously measures a person's pupil. Therefore, the pupil measurement unit 130 measures the change history of the diameter of the pupil. Pupil measurement unit 130 is, for example, a high-resolution camera.

Control unit 140 controls visual stimulus presentation unit 110 , auditory stimulus presentation unit 120 , and pupil measurement unit 130 . Also, the control unit 140 determines the psychological state of the person.

2. Control System FIG. 2 is a block diagram showing the control system of the psychological state determination device 100 of the first embodiment. As shown in FIG. 2, the control unit 140 includes a visual stimulus control unit 141, an auditory stimulus control unit 142, a period setting unit 143, a pupil information acquisition unit 144, a pupil diameter calculation unit 145, and a psychology determination unit 146. and have

The visual stimulus control section 141 controls the visual stimulus presentation section 110 . Then, the visual stimulation control section 141 selects a video or image to be presented to the person by the visual stimulation presentation section 110 . Also, the visual stimulus control unit 141 receives an input from the period setting unit 143 of the timing for presenting a video or image to a person.

The auditory stimulation control section 142 controls the auditory stimulation presentation section 120 . The auditory stimulation control section 142 then selects a voice instruction or music to be presented to the person by the auditory stimulation presentation section 120 . Also, the auditory stimulation control section 142 receives an input from the period setting section 143 of the timing for presenting the voice instruction or music to the person.

The period setting unit 143 sets a period for the psychology determination unit 146 to use for determination. As will be described later, the psychology determination unit 146 uses the change history of the pupil diameter within the period set by the period setting unit 143 for determination. The period setting unit 143 sets a reference time, a first period from the reference time to the first time, and a second period from the first time to the second time. The reference time is, for example, the time when the auditory stimulation presentation unit 120 starts presenting the sound to the person. The first time is the time after a period of 0.5 seconds or more and 1 second or less has elapsed from the reference time. The second time is the time after a period of 0.5 seconds or more and 1 second or less has elapsed from the first time.

The pupil information acquisition unit 144 receives the video or image information of the human pupil from the pupil measurement unit 130 . The time of the video or image information of the human pupil is synchronized with the time set by the period setting unit 143 . The pupil information acquisition unit 144 transmits the video or image information of the human pupil to the pupil diameter calculation unit 145 .

The pupil diameter calculation unit 145 calculates the diameter of the human pupil from the video or image of the human pupil acquired by the pupil information acquisition unit 144 . This pupil diameter value is associated with the time set by the period setting unit 143 . For this reason, the pupil diameter calculator 145 continues to output the value of the diameter of the human pupil over time.

The psychological determination unit 146 determines the psychological state of a person. Psychological determination unit 146 receives the reference time, the first period, and the second period set by period setting unit 143 . The psychology determination unit 146 also receives the value of the pupil diameter associated with the time of the period setting unit 143 from the pupil diameter calculation unit 145 .

3. Classification of Human Mental States In the first embodiment, human mental states are classified into "emotional states" and "neutral states." The "emotional state" is classified into "pleasant state" and "unpleasant state". The first embodiment does not deal with emotional states other than pleasant and unpleasant states.

Neutral state is the normal state in which a person is not particularly emotional. An emotional state is a state in which a person has some degree of emotion. A comfortable state is a state in which a person feels a pleasant feeling. An uncomfortable state is a state in which a person feels uncomfortable.

4. Responsiveness of Pupil Diameter to Stimulus FIG. 3 is a graph schematically showing the responsiveness of the pupil diameter when a stimulus is presented to a person. Although FIG. 3 schematically depicts experimental trends, it does not represent actual experimental values. The horizontal axis of FIG. 3 is time. The vertical axis in FIG. 3 represents the amount of change in pupil diameter. In FIG. 3, the solid line indicates the comfortable state, the dashed line indicates the unpleasant state, and the dashed line indicates the neutral state.

When a stimulus associated with emotion is given to a person, the person's pupil constricts for a moment, then dilates, and then converges. Here, mydriasis means enlargement of a human pupil. As will be described later, the way in which the diameter of a person's pupil changes slightly differs depending on the emotion that a person receives from a stimulus.

FIG. 3 shows a reference time t0, a first time t1, and a second time t2. A reference time t0 is a time at which a stimulus irrelevant to emotion is presented to a person. The first time t1 is a time equal to or longer than 0.5 seconds and equal to or shorter than 1 second from the reference time t0. The second time t2 is 0.5 seconds or more and 1 second or less from the first time t1. The first period T1 is the time from the reference time t0 to the first time t1. The second period T2 is the time from the first time t1 to the second time t2.

The period setting unit 143 sets the reference time t0, the first time t1, and the second time t2. Thus, the first period T1 and the second period T2 are set. The first period T1 and the second period T2 are times for the psychological determination unit 146 to measure the diameter of the pupil in order to determine the psychological state of the person.

Note that the time one second after the reference time t0 is included, for example, between the first time t1 and the second time t2. In other words, the pupil diameter changes in about one second.

At the reference time t0, the amount of change in the diameter of the pupil is 0 mm.

In the first period T1, the diameter of the pupil monotonously increases in any state. Only in the neutral state, the increase in the diameter of the pupil is somewhat suppressed. In the second period T2, the pupil diameter stops increasing in either state, and thereafter the pupil diameter starts decreasing. That is, both states take the maximum value within the period of the second period T2. The diameter of the pupil in the comfortable state is longer than the diameter of the pupil in other states, and reaches its maximum value at a later time.

The comfortable state indicated by the solid line has points P1, P2, and Pm. A point P1 is the value of the pupil diameter at the first time t1. A point P2 is the value of the pupil diameter at the second time t2. Point Pm is the maximum diameter of the pupil. The point Pm is within the period of the second period T2.

The discomfort state indicated by the dashed-dotted line has points N1, N2, and Nm. A point N1 is the value of the pupil diameter at the first time t1. A point N2 is the value of the pupil diameter at the second time t2. A point Nm is the maximum diameter of the pupil. The point Nm is within the period of the second period T2.

The neutral state indicated by dashed lines has points A1, A2 and Am. A point A1 is the value of the pupil diameter at the first time t1. A point A2 is the value of the pupil diameter at the second time t2. A point Am is the maximum diameter of the pupil. The point Am is within the period of the second period T2.

At the first time t1, the values of the point P1 in the comfortable state and the point N1 in the uncomfortable state are larger than the value of the point A1 in the neutral state. Therefore, it is possible to distinguish between the neutral state and other states. It should be noted that the value of the comfortable state point P1 and the value of the uncomfortable state point N1 are close to each other.

At the second time t2, the value of the comfortable state point P2 is greater than the values of the neutral state point A2 and the uncomfortable state point N2. Therefore, it is possible to distinguish between a comfortable state and other states. Note that the value of the point N2 in the uncomfortable state and the value of the point A2 in the neutral state are close to each other.

Note that FIG. 3 is merely a graph showing a tendency. Responses to stimuli deviate somewhat from the curves in FIG. 3 depending on the stimulus presented. However, for example, when distinguishing between the neutral state and other states at the first time t1, by selecting a portion where the difference in value is large, the respective states can be distinguished.

5. Method for Determining Human Mental State A method for determining a person's mental state performed by the mental state determination unit 146 will be described. In the first embodiment, the psychological determination unit 146 determines whether the person's psychological state is a comfortable state or an unpleasant state based on the change history of the diameter of the pupil measured by the pupil measurement unit 130 during the first period T1 and the second period T2. and the neutral state.

Here, the change history of the pupil diameter includes the change amount of the pupil diameter and the elapsed time from the reference time to the time when the change amount of the pupil diameter takes the maximum value. The amount of change in the diameter of the human pupil at time t is the amount of change in the diameter of the human pupil at time t from the diameter of the human pupil at the reference time t0. In general, human pupils tend to dilate after being stimulated. Therefore, the amount of change in pupil diameter is generally a positive value.

5-1. 1st Step As shown in Table 1, in the first step, the psychology determination section 146 classifies the person's state of mind into "emotional state" and "neutral state".

If the amount of change in pupil diameter during the first period is equal to or greater than a predetermined first threshold value J1, the psychology determination unit 146 determines that the person's state of mind at the time of receiving the stimulus is an emotional state.

If the amount of change in pupil diameter during the first period is less than a predetermined first threshold value J1, the psychology determination unit 146 determines that the person's state of mind when receiving the stimulus is a neutral state.

In this way, the psychological determination unit 146 determines whether the person's psychological state is an emotional state including a pleasant state and an unpleasant state, and a neutral state, based on the amount of change in the diameter of the pupil measured by the pupil measurement unit 130 during the first period. , and a first step of determining which is performed. The first threshold J1 is preferably a value between points A1 and N1 in FIG.

5-2. Second Step As shown in Table 1, the psychological determination unit 146 classifies a person's psychological state into "comfortable state" and "uncomfortable state" in the second step.

If the amount of change in the diameter of the pupil during the second period is equal to or greater than a predetermined second threshold value J2, the psychology determination unit 146 determines that the person's state of mind when receiving the stimulus is a comfortable state.

If the amount of change in pupil diameter during the second period is less than a predetermined second threshold value J2, the psychology determination unit 146 determines that the person's state of mind when receiving the stimulus is an unpleasant state.

In this way, the psychological determination unit 146 determines whether the person's psychological state is a pleasant state or an unpleasant state from the amount of change in the diameter of the pupil measured by the pupil measurement unit 130 during the second period. Execute the second step to The second threshold J2 may be a value between point P2 and point N2 in FIG.

5-3. Result of Classification As a result of the classification as described above, the psychological state of a person is classified into one of three types of "pleasant state", "unpleasant state" and "neutral state".

[Table 1]
1st step 2nd step Emotional state Pleasant state Emotional state Unpleasant state Neutral state

6. Determination Flow of Human Mental State FIG. 4 is a flowchart for explaining the flow of determination of a person's mental state by the mental state determination device 100 of the first embodiment.

First, the period setting unit 143 sets a reference time in advance (S101). Next, the visual stimulus presenting unit 110 and the auditory stimulus presenting unit 120 present visual stimuli and auditory stimuli to the person (S102). Then, a stimulus unrelated to emotions is given to the person at the reference time. Next, the pupil information acquisition unit 144 measures the diameter of the human pupil from the reference time, and the pupil diameter calculation unit 145 calculates the amount of change in the diameter of the human pupil from the reference time (S103). Then, the process proceeds to S104.

If the amount of change in pupil diameter during the first period is equal to or greater than the predetermined first threshold value (S104: Yes), the psychology determination unit 146 proceeds to S105; otherwise (S104: No), proceeds to S106. move on. In S105, the psychology determination unit 146 determines that the person's state of mind is an emotional state, and proceeds to S107. In S106, the psychology determination unit 146 determines that the person's state of mind is neutral.

If the amount of change in the diameter of the pupil during the second period is equal to or greater than the predetermined second threshold (S107: Yes), the psychology determination unit 146 proceeds to S108; otherwise (S107: No), to S109 move on. In S108, the psychology determination unit 146 determines that the person's state of mind is a comfortable state. In S109, the psychology determination unit 146 determines that the person's state of mind is an unpleasant state.

7. Effect of First Embodiment The psychological state determination device 100 of the first embodiment determines a person's psychological state from a measured value of a person's pupil diameter. The only measurement value required for determination is the diameter of the human pupil. Therefore, it is very simple, and the psychological state of a person can be determined without a complicated measuring device.

8. Modification 8-1. Period Setting Unit In the first embodiment, the period setting unit 143 holds the end time of the first period and the end time of the second period. However, the period setting unit 143 may receive input from the outside such as the user regarding the end time of the first period and the end time of the second period.

8-2. Visual Stimulus or Auditory Stimulus In the first embodiment, the psychological state determination device 100 has both a visual stimulus presentation unit 110 and an auditory stimulus presentation unit 120 . Only one of the visual stimulus presentation unit 110 and the auditory stimulus presentation unit 120 may be provided.

Even in that case, the period setting unit 143 sets the reference time t0. In this case, the reference time t0 is the start time at which the visual stimulus presentation unit 110 or the auditory stimulus presentation unit 120 gives a stimulus unrelated to emotion to the person.

8-3. Visual Stimulation Controller and Auditory Stimulus Controller In the first embodiment, the controller 140 has a visual stimulus controller 141 and an auditory stimulus controller 142 . Visual stimulus controller 141 and auditory stimulus controller 142 may exist outside controller 140 . In that case, the controller 140 does not have the visual stimulus controller 141 and the auditory stimulus controller 142 .

8-4. Visual Stimulus Presenting Unit and Pupil Measuring Unit In the first embodiment, the visual stimulus presenting unit 110 and the pupil measuring unit 130 are separate entities. Visual stimulus presentation unit 110 and pupil measurement unit 130 may be integrated.

8-5. Visual Stimulus Presenting Unit In the first embodiment, the visual stimulus presenting unit 110 exists at a position relatively distant from the person. However, the visual stimulus presentation unit 110 may be positioned closer to the person. For example, a goggle-type display may be used.

8-6. Pupil Measurement Unit Pupil measurement unit 130 may be an infrared camera. In this case, the pupil measurement unit 130 can measure the diameter of the human pupil even in a dark environment.

8-7. Vehicle A vehicle may be equipped with the mental state determination device 100 of the first embodiment. In that case, information outside the vehicle viewed by the driver presents the stimulus to the driver. Examples of stimuli include driving manners of other automobiles. Specifically, there are cases where the driver gives way to another vehicle or encounters a dangerously driven vehicle. Alternatively, other stimuli include traffic information notified to the driver. The stimulus in this case is the information that the car gives to the person.

8-8. Storage Section The psychological state determination device 100 may have a storage section in addition to the control section 140 .

8-9. Combination The above modifications may be freely combined.

(Second embodiment)
A second embodiment will be described. The mechanical configuration and control system of the second embodiment are similar to those of the first embodiment. The processing performed by the psychology determination unit of the second embodiment differs from that of the first embodiment. Therefore, different points will be described.

1. Responsiveness of Pupil Diameter to Stimulus A description will be given with reference to FIG. The time point Pm is taken is later than the time points Nm and Am are taken. In particular, the time when the point Pm is taken is sufficiently far from the time when the point Nm is taken. Therefore, it is possible to distinguish between the point Pm in the comfortable state and the point Nm in the uncomfortable state by the time when the maximum value is obtained.

2. Method for Determining Human Mental State In the second embodiment, the criterion for determining the pleasant state and the unpleasant state is different from that in the first embodiment. That is, the criteria for the first step of the second embodiment are the same as those of the first embodiment, and the criteria for the second step of the second embodiment are different from those of the first embodiment. Therefore, the second step of judging the pleasant state and the unpleasant state will be described.

If the elapsed time from the reference time to the time when the diameter of the pupil in the second period takes the maximum value is equal to or greater than a predetermined third threshold value J3, the psychology determination unit 146 determines whether or not the person received the stimulus. The psychological state is determined as a comfortable state.

If the elapsed time from the reference time to the time when the diameter of the pupil in the second period takes the maximum value is less than a predetermined third threshold J3, the psychology determination unit 146 determines whether the person received the stimulus. The psychological state is determined as an unpleasant state.

In this way, the psychological determination unit 146 determines whether the person's psychological state is a pleasant state or an unpleasant state from the time from the reference time to the time when the amount of change in the diameter of the pupil reaches the maximum value. A second step of determining is performed. The third threshold J3 may be a time between the time of point Pm and the time of point Nm in FIG.

3. Determination Flow of Human Mental State FIG. 5 is a flowchart for explaining the flow of determination of a person's mental state by the mental state determination device 100 of the second embodiment. 5 is the same as FIG. 4 up to S105. Therefore, processing after S105 will be described. In S105, the psychology determination unit 146 determines that the state is an emotional state, and proceeds to S207.

If the elapsed time from the reference time to the time when the diameter of the pupil in the second period takes the maximum value is equal to or greater than the predetermined third threshold (S207: Yes), the psychology determination unit 146 proceeds to S108. If not (S207: No), proceed to S109. In S108, the psychology determination unit 146 determines that the person's state of mind is a comfortable state. In S109, the psychology determination unit 146 determines that the person's state of mind is an unpleasant state.

4. Effect of Second Embodiment As in the first embodiment, the psychological state determination device 100 of the second embodiment determines a person's psychological state from a measured value of the person's pupil diameter. The only measurement value required for determination is the diameter of the human pupil. Therefore, it is very simple, and the psychological state of a person can be determined without a complicated measuring device.

5. Modifications The second embodiment may be freely combined with modifications of the first embodiment.

(Third Embodiment)
A third embodiment will be described.

1. Method for Determining Human Mental State In the third embodiment, when determining the second step, the amount of change in the diameter of the pupil used in the first embodiment and the mydriatic peak used in the second embodiment Elapsed time to value and both are used. Therefore, for example, artificial intelligence such as a support vector machine may be used. Here, the elapsed time until the mydriatic peak value is the elapsed time from the reference time to the time when the diameter of the pupil takes the maximum value during the second period.

In this way, the psychology determination unit 146 determines the amount of change in the diameter of the pupil measured by the pupil measurement unit 130 during the second period, and the time from the reference time to the time when the amount of change in the diameter of the pupil reaches the maximum value. , a second step of determining whether the person's state of mind is pleasant or unpleasant.

2. Modifications The third embodiment may be freely combined with modifications of the first embodiment.

(experiment)
1. EXPERIMENTAL METHOD Photograph collections were used to evoke emotions of either a pleasant state, an unpleasant state, or a neutral state. IAPS was used as the photo collection. Each IAPS photograph is given a 9-step threshold. Photographs with a threshold value of 6 or higher were classified as photographs evoking a pleasant state. Photos with a threshold value of 4 or more and less than 6 were classified as photos that evoke a neutral state. Photographs with a threshold of less than 4 were classified as photographs evoking discomfort.

The subjects were 23 healthy men and 9 healthy women, for a total of 32 people. The average age of the subjects was 21.3 years. In addition, the data of 2 persons out of 32 persons were excluded. 300 sets were performed per person.

FIG. 6 is a diagram showing the experimental procedure. First, the subject is presented with a fixation point for 500 ms. Next, the subject is presented with one IAPS photograph for 200 ms. The photograph presented here is a photograph randomly selected from one of the photograph collections to which threshold values are given in nine stages. Next, the subject is presented with a fixation point for 600 ms.

The time when presentation of the fixation point ends is defined as a reference time t0. A sound is presented to the subject for 100 ms from the reference time t0. This sound is an oddball stimulus and does not evoke any particular emotion in the subject. Next, the subject is presented with a fixation point for 1900 ms.

Next, the subject answers whether the combination of the sound and the image is a pleasant state, a displeasing state, or a neutral state. It also answers whether the presented sound was high temperature or low temperature. This is one set. After completing one set, return to presentation of the first fixation point.

Then, the information about the comfortable state, the unpleasant state, and the neutral state answered by the subject was compared with the change history of the pupil of the subject.

2. Experimental results 2-1. Responsiveness of Pupil Diameter to Stimulus FIG. 7 is a graph showing the amount of change in pupil diameter to a stimulus. The horizontal axis of FIG. 7 is time. The vertical axis in FIG. 7 represents the amount of change in pupil diameter. The N number is 30. FIG. 7 shows results similar to those shown in FIG.

2-2. First Period FIG. 8 is a graph showing the amount of change in pupil diameter during the first period T1. The bars are shown in order from the left side of FIG. 8 for the neutral state, the unpleasant state, and the pleasant state. As shown in FIG. 8, for both high and low frequency stimuli, the amount of change in pupillary diameter in the pleasant and unpleasant states is significantly greater than the amount of change in pupillary diameter in the neutral state.

2-3. Second Period FIG. 9 is a graph showing the amount of change in pupil diameter during the second period T2. As shown in FIG. 9, the amount of change in pupil diameter in the pleasant state is greater than the amount of change in pupil diameter in the uncomfortable state and neutral state for both high-frequency stimuli and low-frequency stimuli.

2-4. Elapsed Time to Peak FIG. 10 is a graph showing the elapsed time from the reference time t0 to the peak value. As shown in FIG. 10, for both high-frequency stimulation and low-frequency stimulation, the time from the reference time t0 in the pleasant state to the peak value is the time from the reference time t0 to the peak value in the unpleasant state. sufficiently longer than

2-5. Classification Results FIG. 11 is a graph showing the classification results. The horizontal axis of FIG. 11 is the elapsed time to the mydriatic peak. The vertical axis of FIG. 11 represents the amount of change in pupil diameter. A support vector machine was used to classify as in FIG.

As shown in FIG. 11, it was possible to spatially separate into three types of states: a pleasant state, an unpleasant state, and a neutral state.

2-6. Identification rate 2-6-1. Rate of Change in Pupil Diameter in Second Period Using the psychological state determination device 100 of the first embodiment, the subject's response was compared with the change history of the pupil. The rate of change in pupil diameter during the first period was used for the first step, and the rate of change in pupil diameter during the second period was used for the second step. We then used support vector machines to classify.

The recognition rate of comfortable state was 90.00%. The identification rate of discomfort was 63.33%. The discrimination rate of the neutral state was 80.00%. The average discrimination rate for these three states was 77.78%.

2-6-2. Elapsed Time to Mydriatic Peak Using the psychological state determination device 100 of the second embodiment, the answers of the subjects were compared with the change history of the pupil. The rate of change in the diameter of the pupil during the first period was used for the first step, and the elapsed time to peak mydriasis was used for the second step. We then used support vector machines to classify.

The recognition rate of comfortable state was 73.33%. The identification rate of discomfort was 70.00%. The discrimination rate of the neutral state was 80.00%. The average discrimination rate for these three states was 74.44%.

2-6-3. Change Rate of Pupil Diameter in Second Period and Elapsed Time to Peak Mydriasis Using the psychological state determination device 100 of the third embodiment, the answers of the subjects were compared with the change history of the pupil. For the first step, the rate of change in pupil diameter in the first period was used, and in the second step, both the rate of change in pupil diameter and the elapsed time to peak mydriasis in the second period were used. We then used support vector machines to classify.

The recognition rate of comfortable state was 90.00%. The identification rate of discomfort was 70.00%. The discrimination rate of the neutral state was 76.67%. The average discrimination rate for these three states was 78.89%.

(Appendix)
The psychological state determination device according to the first aspect includes a pupil measurement unit that measures the diameter of a person's pupil, a psychological determination unit that determines the psychological state of the person, and a period that the psychological determination unit sets a period for use in determination. and a setting unit. The period setting unit sets a reference time, a first period from the reference time to the first time, and a second period from the first time to the second time. The psychological determination unit determines whether the person's psychological state is a pleasant state, an unpleasant state, or a neutral state from the change history of the diameter of the pupil measured by the pupil measurement unit during the first period and the second period. determine whether

In the psychological state determination device according to the second aspect, the psychological state determination unit determines whether the person's psychological state is an emotional state including a pleasant state and an unpleasant state from the amount of change in the diameter of the pupil measured by the pupil measurement unit during the first period. A first step is performed to determine whether it is a state or a neutral state.

In the psychological state determination device according to the third aspect, the psychological determination unit determines whether the person's psychological state is a pleasant state or an unpleasant state based on the amount of change in the diameter of the pupil measured by the pupil measurement unit during the second period. A second step is performed to determine which.

In the psychological state determination device according to the fourth aspect, the psychological determination unit determines whether the person's psychological state is a comfortable state or an unpleasant state from the time from the reference time to the time when the amount of change in the diameter of the pupil reaches the maximum value. , is performed.

In the psychological state determination device according to the fifth aspect, the psychological determination unit measures the amount of change in the diameter of the pupil measured by the pupil measurement unit during the second period, and the time when the amount of change in the diameter of the pupil reaches the maximum value from the reference time. A second step of determining whether the person's state of mind is a comfortable state or an unpleasant state is performed.

In the mental state determination device according to the sixth aspect, the first time is a time after a period of 0.5 seconds or more and 1 second or less has elapsed from the reference time. The second time is the time after a period of 0.5 seconds or more and 1 second or less has elapsed from the first time.

A psychological state determination device according to the seventh aspect has a stimulus presentation unit that presents a stimulus to a person.

In the psychological state determination device according to the eighth aspect, the stimulus presentation section has a visual stimulus presentation section that presents the stimulus to the human vision.

In the psychological state determination device according to the ninth aspect, the stimulus presenting section has an auditory stimulus presenting section that presents stimuli to human auditory senses. The auditory stimulus presenting unit intermittently presents sounds unrelated to the person's psychological state. The period setting unit sets the time at which the auditory stimulation presentation unit starts presenting the sound to the person as the reference time.

In the psychological state determination device according to the tenth aspect, the auditory stimulus presenting unit periodically presents a sound unrelated to the person's mental state.

DESCRIPTION OF SYMBOLS 100... Psychological state determination apparatus 110... Visual stimulation presentation part 120... Auditory stimulation presentation part 130... Pupil measurement part 140... Control part

Claims (10)

a pupil measuring unit for measuring the diameter of a human pupil;
a psychological determination unit that determines a person's psychological state;
a period setting unit for setting a period for the psychological determination unit to use for determination;
has
The period setting unit
a reference time;
a first period from the reference time to the first time;
a second period from the first time to the second time;
and set
The psychological judgment unit
From the change history of the diameter of the pupil measured by the pupil measurement unit during the first period and the second period,
A mental state determination device that determines whether a person's mental state is a pleasant state, an unpleasant state, or a neutral state. In the psychological state determination device according to claim 1,
The psychological judgment unit
From the amount of change in the diameter of the pupil measured by the pupil measurement unit during the first period,
1. A mental state determination apparatus comprising executing a first step of determining whether a person's mental state is an emotional state including a pleasant state and an unpleasant state, or a neutral state. In the psychological state determination device according to claim 2,
The psychological judgment unit
From the amount of change in the diameter of the pupil measured by the pupil measurement unit during the second period,
A mental state determination device including executing a second step of determining whether a person's mental state is a pleasant state or an unpleasant state. In the psychological state determination device according to claim 2,
The psychological judgment unit
From the time from the reference time to the time when the amount of change in the diameter of the pupil reaches the maximum value,
A mental state determination device including executing a second step of determining whether a person's mental state is a pleasant state or an unpleasant state. In the psychological state determination device according to claim 2,
The psychological judgment unit
From the amount of change in the diameter of the pupil measured by the pupil measurement unit during the second period and the time from the reference time to the time when the amount of change in the diameter of the pupil reaches the maximum value,
A mental state determination device including executing a second step of determining whether a person's mental state is a pleasant state or an unpleasant state. In the psychological state determination device according to any one of claims 1 to 5,
The first time is
A time after a period of 0.5 seconds or more and 1 second or less has elapsed from the reference time,
The second time is
The psychological state determination device, wherein the time is after a time period of 0.5 seconds or more and 1 second or less has elapsed from the first time. In the psychological state determination device according to any one of claims 1 to 6,
A psychological state determination device including a stimulus presentation unit that presents a stimulus to a person. In the psychological state determination device according to claim 7,
The stimulus presentation unit
A mental state determination device including a visual stimulus presenting unit that presents stimuli to human vision. In the psychological state determination device according to claim 7 or claim 8,
The stimulus presentation unit
having an auditory stimulus presenting unit that presents stimuli to the auditory sense of a person;
The auditory stimulus presentation unit
Intermittently presenting sounds unrelated to the person's psychological state,
The period setting unit
A psychological state determination apparatus, comprising setting a time at which the auditory stimulation presentation unit starts presenting a sound to a person as a reference time. In the psychological state determination device according to claim 9,
The auditory stimulus presentation unit
A mental state determination device including periodically presenting a sound unrelated to a person's mental state.

Images