JP2023069103A - Analysis system - Google Patents

Abstract

To provide an analysis system which can more accurately analyze a fatigue state of a user.SOLUTION: An analysis system comprises: a display unit which displays information; an input unit which receives input of the information by a user; an imaging unit which captures an image of the face of the user; an output control unit which displays on the display unit the image of the face of the user captured by the imaging unit, information of a question about a state of a prescribed portion of the face of the user displayed on the display unit and information urging input of feeling information indicating a content of a feeling felt by the user for the image of the face of the user; an input reception unit which receives input of information of an answer to the question and the feeling information via the input unit in such a state that the image of the face of the user captured by the imaging unit is displayed on the display unit; and a subjective fatigue state information acquisition unit which acquires a value indicating a degree of a subjective fatigue state felt by the user that is derived from the information of the answer to the question and the feeling information.SELECTED DRAWING: Figure 1

Description

The present invention relates to a system for analyzing fatigue state of a user.

The inventors have filed a patent application for the system described in Patent Document 1.

The system described in Patent Literature 1 is a solution providing system that can analyze the user's fatigue state and easily provide an appropriate solution according to the user's fatigue state.

The system displays an image of the user's face imaged by the imaging unit on the display unit, and asks questions about the state of the user's face, which is correlated with the fatigue state appearing on the user's face displayed on the display unit. is displayed on the display. Further, input of an answer by the user to a question about the state of the user's face is accepted while the image of the face is displayed on the display unit.

Then, the user's fatigue state is analyzed based on the information including the answers, and the user is provided with a solution according to the analysis result.

According to the system described in Patent Literature 1, the user answers the questions about the condition of the face while looking at his/her own face, so the answer is easy.

In addition, since the subject is given an opportunity to calmly reflect on his or her own facial condition, awareness of the facial condition that is closely related to the fatigue state is promoted, and the possibility of accurately responding to the condition of one's own face increases.

This makes it possible to accurately analyze the state of fatigue felt by the user.

Patent application 2020-200827

In addition, in the system described in Patent Document 1, the answers to the questions about the state of the face are used to analyze the fatigue state. There is a technical problem that it is difficult to obtain the analysis results of , with high accuracy, and further improvements have been desired.

The inventors have recently improved the function of the system described in Patent Literature 1 to develop an analysis system capable of more accurately analyzing the user's fatigue state.

The analysis system of the present invention is
A computer system for analyzing a user's fatigue state,
a display for displaying information;
an input unit that receives input of information by the user;
an imaging unit that captures an image of the user's face;
an image of the user's face imaged by the imaging unit is displayed on the display unit, and information about a question about the state of a predetermined part of the user's face displayed on the display unit; an output control unit for displaying, on the display unit, information prompting input of emotion information indicating the content of the user's own feelings toward the image;
an input reception unit that receives input of information on answers to the questions and the emotion information via the input unit in a state where the image of the user's face captured by the imaging unit is displayed on the display unit;
a subjective fatigue state information acquisition unit that acquires a value indicating the degree of subjective fatigue state felt by the user, which is calculated by a predetermined method from the information of the answers to the questions and the emotion information. Characterized by

According to the present invention, in a state in which an image of the user's face captured by the imaging unit is displayed on the display unit, the input reception unit allows the predetermined image of the user's face displayed on the display unit to be displayed on the display unit via the input unit. Input of information of answers to questions about the state of the body part and emotion information indicating the details of the feelings that the user has about the image of the user's face are accepted.

The user's face clearly shows the fatigue state of the user. Therefore, as in the present invention, the analysis system can effectively grasp the user's understanding of the fatigue state by having the user enter answers to questions about the state of a predetermined part of the face while showing the user's own face. can be done.

Then, the subjective fatigue state information acquiring unit acquires a value indicating the degree of subjective fatigue state felt by the user, which is calculated by a predetermined method from the information of the answer to the question and the emotion information.

As a result, not only answers to questions about the state of predetermined parts of the face, but also emotional information that indicates the content of the user's own feelings toward the image of the user's face is taken into consideration, and the user's subjective feeling It is possible to obtain an analysis result of the degree of fatigue state. Therefore, it is possible to increase the user's satisfaction with the analysis result of the fatigue state.

Furthermore, these actions provide the user with the experience of seeing their own face and gaining a bird's-eye view of their fatigue state from various angles, including self-recognition. can also bring

In this way, by improving the system of Patent Document 1, which analyzes the fatigue state of the user using the answers to the questions about the state of the face, the user's facial image expresses the content of the user's feelings. By controlling the computer to analyze the user's fatigue state using information, we were able to improve the system so that it can acquire the analysis result of the value that expresses the degree of fatigue state that is highly convincing to the user. is the effect of the present invention.

According to the research of the inventors, the information that prompts the user to input emotional information includes words of encouragement or consolation suitable for improving the state of fatigue recognized by the user himself/herself. We found that analyzing the user's subjective state of fatigue using the information of the words that the user wants to say as emotional information has the effect of increasing the user's satisfaction with the analysis results of the state of fatigue.

Therefore, in the analysis system of the present invention,
The output control unit provides the user with words of encouragement or consolation suitable for improving the state of fatigue recognized by the user, which is displayed on the display unit, as the information prompting the input of the emotional information. It is preferable that the display unit displays information prompting the user to input information.

According to the present invention, as the information prompting the user to input the emotion information, the user can receive the input of words of encouragement or comfort suitable for improving the state of fatigue recognized by the user himself/herself. The user's subjective state of fatigue is analyzed by using the information of the words (emotional information about the state of fatigue recognized by the user), so that the fatigue state gives the user a higher sense of satisfaction. analysis results can be reliably obtained.

Moreover, in the present invention,
Information obtained by combining a value indicating the subjective state of fatigue of the user and the emotional information, and making the user aware of the user's subjective state of fatigue or improving the user's subjective state of fatigue A determination unit for determining the fatigue recognition improvement information corresponding to the combined information by referring to the information indicating the correspondence relationship between the fatigue recognition improvement information consisting of information for
Preferably, the output control section is configured to output the fatigue recognition improvement information to the user.
According to the present invention, the determination unit determines the fatigue recognition improvement information, which is information for making the user aware of the user's subjective fatigue state or improving the user's subjective fatigue state, The output control unit outputs the determined fatigue recognition improvement information to the user.

It should be noted that, as in the present invention, subjective degree of fatigue can be calculated from information of questions about the state of a predetermined part of the face and emotion information indicating the details of the user's feelings toward the image of the user's face. Multifaceted analysis of the indicated values has the advantage of being able to accurately recognize the user's subjective state of fatigue.

On the other hand, if the user's fatigue state recognition accuracy only increases, the emotional information cannot be directly reflected in the determination of the fatigue recognition improvement information, and the user will not be satisfied with the fatigue recognition improvement information provided to the user. You may not get enough feel.

Therefore, the determining unit is configured to combine the value indicating the user's subjective degree of fatigue with emotion information, and determine the fatigue recognition improvement information corresponding to the combination.

In other words, even if the value indicating the degree of subjective fatigue state felt by the user is the same, fatigue recognition differs according to the content of the input emotional information (for example, positive content, pessimistic content, etc.). Remediation information can be determined.

As a result, it is possible to determine fatigue recognition improvement information that is highly convincing to the user and that is close to the user's feelings without impairing the advantage of being able to accurately recognize the subjective state of fatigue of the user.

In the present invention,
The determination unit includes: information on a combination of a value indicating the degree of subjective state of fatigue of the user and the emotional information; a first comment consisting of verbal information indicating the subjective state of fatigue of the user; By referring to the information indicating the correspondence relationship, the first comment corresponding to the information of the combination is configured to be determined as the fatigue recognition improvement information,
It is preferable that the output control section is configured to output the first comment determined by the determination section toward the user.

According to the present invention, the determination unit determines the first comment indicating the user's subjective state of fatigue, and the output control unit outputs the first comment to the user.

Acquiring a plurality of pieces of information about the user's subjectivity and analyzing them from multiple perspectives has the advantage that the user's subjective state of fatigue can be recognized with high accuracy.

On the other hand, simply increasing the accuracy of recognizing the user's fatigue state does not directly reflect the emotional information in the decision of the first comment. You may not get enough feel.

Therefore, the determination unit combines the value indicating the subjective degree of fatigue of the user with the emotion information, and determines the first comment according to the combination.

As a result, even if the subjective fatigue level felt by the user is the same, different first comments can be determined according to the content of the input emotion information. It is possible to reliably obtain comments that are close to each other and give the user a high degree of satisfaction.

Even when the subjective state of fatigue is low, the objective state of fatigue may be high. Or, conversely, it is possible that the subjective state of fatigue is high but the objective state of fatigue is not so high. Therefore, it would be more desirable if not only the subjective state of fatigue but also the objective state of fatigue could be analyzed together and both analysis results could be presented to the user.

Therefore, in the present invention,
An objective fatigue state information acquisition unit that acquires a value indicating the objective degree of fatigue of the user calculated by a predetermined method,
The determination unit refers to information indicating a correspondence relationship between a value indicating the objective degree of fatigue of the user and a second comment made of verbal information indicating the objective fatigue state of the user. , configured to determine the second comment corresponding to the value indicating the objective degree of fatigue of the user as the fatigue recognition improvement information,
It is preferable that the output control section is configured to output the second comment determined by the determination section toward the user.

According to the present invention, not only the subjective state of fatigue but also the objective state of fatigue can be analyzed together, and both analysis results can be presented to the user. and the objective state of fatigue can be recognized at the same time.

The state of the user's heart rate has a close relationship with the user's objective state of fatigue. really appear.

Therefore, in the present invention,
The objective fatigue state information acquisition unit acquires information on the heartbeat of the user by a predetermined method, heartbeat state information indicating the state of the heartbeat of the user derived from the information on the heartbeat, and autonomic nerves of the user. obtaining autonomic balance information indicating balance, obtaining a value indicating an objective degree of fatigue of the user based on the heartbeat state information and the autonomic balance information,
The determination unit provides information on a combination of a value indicating the objective degree of fatigue of the user and the autonomic nerve balance information, and a second comment consisting of verbal information indicating the objective fatigue state of the user. , with reference to the information indicating the correspondence relationship, and is configured to determine the second comment corresponding to the information of the combination as the fatigue recognition improvement information,
It is preferable that the output control section is configured to output the second comment determined by the determination section toward the user.

According to the present invention, the second comment indicating the objective state of fatigue of the user is determined by the determination unit and output to the user by the output control unit.

It should be noted that, as in the present invention, a plurality of pieces of information related to the user's objective fatigue state, namely, heartbeat state information indicating the state of the user's heartbeat and autonomic nerve balance information indicating the user's autonomic nerve balance, are acquired and multifaceted. This analysis has the advantage of being able to accurately recognize the user's objective state of fatigue.

On the other hand, if the accuracy of the user's objective fatigue state recognition increases, the autonomic nerve balance information cannot be directly reflected in the determination of the second comment, and the second comment provided to the user There is a possibility that you will not be satisfied with the second comment.

Therefore, the determining unit determines the second comment according to the combination of the value indicating the user's objective degree of fatigue and the autonomic nerve balance.

That is, even if the objective fatigue level of the user is the same, different second comments can be determined according to the state of the autonomic nerve balance that clearly represents the user's objective fatigue status.

As a result, it is possible to reliably obtain a comment that gives the user a high sense of satisfaction, obtained by emphasizing autonomic nerve balance based on specific information such as the user's heart rate.

In the present invention,
an objective fatigue state information acquisition unit that acquires a value indicating an objective degree of fatigue state of the user calculated by a predetermined method;
A storage unit that stores a plurality of improvement contents, which is information for improving the user's subjective fatigue state and objective fatigue state,
The determination unit provides information indicating a correspondence relationship between information on a combination of a value indicating the subjective degree of fatigue of the user and a value indicating the objective degree of fatigue of the user, and the improvement content. with reference to determine the improvement content corresponding to the information of the combination as the fatigue recognition improvement information,
Preferably, the output control section is configured to output the improvement content determined by the determination section toward the user.

According to the present invention, the determination unit determines the improvement content, which is information for improving the user's subjective and objective fatigue state, and outputs the content to the user. can be improved to

In addition, the improved content acquires multiple information related to the user's subjectivity, including question information about the state of a predetermined part of the face and emotional information that indicates the content of the user's feelings toward the image of the user's face. It acquires multiple pieces of information related to the user's objective fatigue state, such as a value indicating the user's subjective degree of fatigue recognized by multilateral analysis, heartbeat state information, and autonomic nerve balance information. Since it is determined according to the combination with the value indicating the degree of the user's objective fatigue state recognized by multilateral analysis, it is possible to reliably determine the improvement content that gives the user a high degree of satisfaction. can.

In the present invention,
The improvement content preferably consists of one or both of vibration and sound.

Vibrations and sounds have the effect of inducing the user's mind and body into a relaxed state and improving the state of fatigue. It is effective to provide the user with vibration and sound according to the user's fatigue state.

According to the present invention, the improvement content determined according to the combination of the value indicating the degree of the subjective state of fatigue of the user and the value indicating the degree of the objective state of fatigue is obtained from one or both of vibration and sound. Therefore, it is possible to provide the user with improved content that can effectively improve the user's fatigue state.

In the present invention,
The improvement content consists of a combination of one or both of vibration and sound and verbal information,
The decision unit
If the value indicating the degree of the user's subjective fatigue state indicates that the user's subjective fatigue state is worse than a predetermined first criterion, the user's subjective fatigue state determining said verbal information for improving the
When the value indicating the degree of the user's objective fatigue state indicates that the user's objective fatigue state is worse than a predetermined second standard, the user's objective fatigue state preferably configured to determine said verbal information for improving the

According to the present invention, the improvement content determined according to the combination of the value indicating the degree of subjective state of fatigue of the user and the value indicating the degree of objective state of fatigue includes one or both of vibration and sound. It consists of a combination of verbal information.

As a result, the improved content consists of abundant information rather than the improved content consisting of only one or both of vibration and sound, so it is possible to provide the user with improved content that can more effectively improve the user's state of fatigue. can.

Moreover, in the present invention,
The decision unit
Improving the subjective state of fatigue of the user corresponding to the emotional information by referring to information indicating the correspondence between the emotional information and verbal information for improving the subjective state of fatigue of the user. determine the verbal information for
Correspondence between autonomic nerve balance information indicating the user's autonomic nerve balance derived from information on the user's heartbeat acquired by a predetermined method and verbal information for improving the user's objective fatigue state It is preferable to refer to the information indicating the relationship and determine verbal information for improving the user's objective state of fatigue corresponding to the autonomic nerve balance information.

According to the present invention, even when the determination unit determines the information of words that determine that the fatigue state of the user is worse than the predetermined standard, even if the degree of the user's fatigue state is the same, Depending on the content of the emotional information or the autonomic balance information, different verbal information can be reliably determined.

1 is a block diagram showing an example of an overview of an analysis system of the present invention; FIG. FIG. 2 is a block diagram showing another example of the overview of the analysis system of the present invention; 4 is a flow chart showing an example of processing contents of the analysis system of the present invention. The figure which shows an example of the output content of the analysis system of this invention. 4 is a flow chart showing an example of processing contents of the analysis system of the present invention. 4 is a flow chart showing an example of processing contents of the analysis system of the present invention. 4 is a flow chart showing an example of information content used for processing by the analysis system of the present invention. 4 is a flow chart showing an example of information content used for processing by the analysis system of the present invention.

<Analysis system configuration>
First, the configuration of the analysis system of this embodiment will be described with reference to FIG. In addition, about the same structure, the same code|symbol may be attached|subjected and description may be abbreviate|omitted.

The analysis system of the present embodiment is, for example, as shown in FIG. 1, a computer system composed of a user terminal 1 and a server 2. are connected by a communication network NW. Although only one user terminal 1 and one server 2 are shown in FIG. 1, a plurality of each may be provided.

The user terminal 1 is, for example, a smartphone, tablet, or other computer that includes a display unit 10, an input unit 30, an imaging unit 50, and a terminal control unit 70a. The user terminal 1 may further include a speaker 110 for outputting sound information and a vibrator 130 for generating vibration.

The display unit 10 is, for example, a display for the user terminal 1 to display information to the user.

The input unit 30 is, for example, a touch panel for accepting input of information such as operation contents by the user, but may be a keyboard, mouse, or other pointing device.

The imaging unit 50 is a camera that captures an image of the user's face.

The terminal control unit 70a includes an arithmetic processing unit (processor) such as a CPU (Central Processing Unit), a memory, an I/O (Input/Output) device, and the like. Arithmetic processing unit (processor) of terminal control unit 70a
functions as, for example, an output control unit 710 and an input reception unit 730 by reading and executing a predetermined program.

The output control unit 710 displays an image of the user's face imaged by the imaging unit 50 on the display unit 10, and also displays question information about the state of a predetermined part of the user's face displayed on the display unit 10, to the display unit 10, and information prompting the input of emotion information indicating the content of the emotion that the user has with respect to the image of the face of the user.

The input reception unit 730 receives the information of the answer to the question and the emotion information through the input unit 30 in a state where the image of the user's face captured by the imaging unit 50 is displayed on the display unit 10 by the output control unit 710. Accept input.

The server 2 is a computer including a server control section 70b and a storage section 90. FIG.

The server control unit 70b includes an arithmetic processing unit such as a CPU, a memory, an I/O device, and the like. The server control unit 70b arithmetic processing unit (processor) reads and executes a predetermined program to function as, for example, a subjective fatigue state information acquisition unit 750, or furthermore, an objective fatigue state information acquisition unit 770, a determination unit 790, function as

The subjective fatigue state information acquisition unit 750 obtains predetermined information from the information on the answers to the questions received by the input reception unit 730 of the user terminal 1 and the emotion information indicating the content of the user's feelings regarding the image of the user's face. acquires a value indicating the degree of subjective fatigue state felt by the user, which is calculated by the following method.

The objective fatigue state information acquisition unit 770 acquires information about the user's heartbeat by a predetermined means, and obtains the heartbeat state information indicating the state of the user's heartbeat calculated by a predetermined method from the information about the heartbeat, and the user's autonomy. Autonomic nerve balance information indicating nerve balance is obtained, and objective fatigue level information of the user is obtained based on the heartbeat state information and the autonomic nerve balance information.

The determination unit 790 allows the user to recognize the information obtained by combining the value indicating the degree of the user's subjective fatigue state and the emotional information, and the user's subjective fatigue state, or improve the user's subjective fatigue state. By referring to the information indicating the correspondence relationship between the fatigue recognition improvement information composed of the information for and the information indicating the correspondence relationship, the fatigue recognition improvement information corresponding to the combined information is determined.

The fatigue recognition improvement information is, for example, a first comment consisting of verbal information indicating the user's subjective fatigue state, a second comment consisting of verbal information indicating the user's objective fatigue state, and the user's subjective improvement content, which is information for improving the objective state of fatigue and the objective state of fatigue.

The storage unit 90 is configured by a storage device such as a ROM (Read Only Memory), a RAM (Random Access Memory), and an HDD (Hard Disk Drive). The storage unit 90 stores a content database (DB) 910 that stores a plurality of improvement contents, as well as information necessary for processing of the analysis system, processing results of the analysis system, and the like.

FIG. 2 shows an embodiment in which the above configuration is provided in the user terminal 1. As shown in FIG. As shown in FIG. 2, the analysis system of the present invention may be configured with only the user terminal 1 without the server 2 .

<Overview of processing>
Next, the processing contents of the analysis system of this embodiment will be described. First, a series of processing by the analysis system will be described with reference to FIG. A case in which the analysis system is composed of the user terminal 1 and the server 2 will be described below.

When the process starts, the imaging unit 50 of the user terminal 1 takes an image of the user's face (FIG. 3/S11).

Then, the output control unit 710 of the user terminal 1 displays the image of the user's face imaged by the imaging unit 50 on the display unit 10, and asks questions about the state of the predetermined part of the user's face displayed on the display unit 10. is displayed on the display unit 10 (Fig. 3/S13).

Information in questions about the condition of certain parts of the user's face, for example, whether the eyes look tired, whether the corners of the mouth look drooped, and whether the complexion feels dull This includes information asking questions about the condition of the user's face, which has a correlation with the fatigue condition appearing on the user's face displayed on the display unit 10, such as whether the user feels stiff and difficult to move. .

The output control unit 710 sequentially displays the information of these questions on the display unit 10, for example, one by one, and the input receiving unit 730 sequentially receives information of answers to these questions (FIG. 3/S15).

The input reception unit 730 receives information on answers to these questions, for example, by allowing the user to select the degree of feeling that each question corresponds to the questioned state from a five-grade evaluation from 1 to 5. The magnitude of the degree indicates, for example, 1 being the smallest and 5 being the largest.

Next, the output control unit 710 displays the image of the user's face imaged by the imaging unit 50 on the display unit 10, and also displays the user's own feelings regarding the image of the user's face displayed on the display unit 10. is displayed on the display unit 10 (FIG. 3/S17), and the input accepting unit 730 accepts the input of the emotional information (FIG. 3/S19).

The information that prompts the user to enter emotional information that indicates the content of the user's feelings toward the image of the user's face is, for example, a display such as "What kind of words would you like to say to yourself when you look at your face?" This is information that prompts the user displayed on the unit 10 to input information of words that the user wants to say, such as words of encouragement or consolation suitable for improving the fatigue state recognized by the user himself/herself.

For example, the input reception unit 730 can input words that the user wants to say to the user, such as "You did your best!"・” to accept the input of emotion information.

Note that the input reception unit 730 receives input of information on answers to questions and emotion information via the input unit 30 in a state where the image of the user's face captured by the imaging unit 50 is displayed on the display unit 10. .

After that, the input reception unit 730 of the user terminal 1 transmits the information of the answer to the question and the emotion information to the server 2 via, for example, the communication network NW.

In the server 2 that has received the information of the answer to the question and the emotion information from the user terminal 1, subjective fatigue state information acquisition processing for acquiring a value indicating the degree of subjective fatigue state felt by the user (Fig. 3 / S30) Objective fatigue state information acquisition processing (FIG. 3/S50) for acquiring a value indicating the objective degree of fatigue state of the user and determination processing (FIG. 3/S70) for determining fatigue recognition improvement information are executed. The contents of these processes will be described later.

Then, for example, the subjective fatigue state information acquisition unit 750, the objective fatigue state information acquisition unit 770, and the determination unit 790 of the server 2 send the acquired and determined subjective fatigue state information, objective fatigue state information, and fatigue recognition improvement information to the user terminal 1. Send to

The output control unit 710 of the user terminal 1 outputs the subjective fatigue state information and the objective fatigue state information received from the server 2 by displaying them on the display unit 10 (Fig. 3/S91). The improvement information is provided to the user (FIG. 3/S93), and the series of processing ends.

FIG. 4 is an output image of a screen for displaying subjective fatigue state information and objective fatigue state information, and for providing fatigue recognition improvement information to the user. In the following, an embodiment will be described in which the user's subjective fatigue level is output as the "mental health level" and the user's objective fatigue level is output as the "physical health level."

As shown in FIG. 4, for example, the subjective fatigue state information is a display showing how many points out of 10 the mental health degree SF is, and a display showing the score depending on how many heart marks are filled. etc., and displayed. In addition, the objective fatigue state information is converted into a display showing how many points out of 10 points the physical health degree OF is, and a display showing the score according to how much the human-shaped mark is satisfied. Is displayed.

Below that, a first comment Com1 consisting of verbal information indicating the user's subjective state of fatigue, and a second comment Com2 consisting of verbal information indicating the user's objective fatigue state are provided. is displayed. Or furthermore, the information of the general comment Com3 that comprehensively evaluated the subjective and objective fatigue state, such as the one at the top of the screen You are slightly tired, but you are mentally tired and should be careful.") may be displayed.

Below that, a button B1 for providing the improved content determined by the determination unit 790 is displayed. For example, as shown in Fig. 4, to provide content that takes a short time (short), content that takes a long time (deep), and content that encourages sleep (sleep) according to the convenience of the user. button B1 may be provided.

When the user's operation of pressing one of the buttons B1 is accepted, the output control unit 710 displays the character information included in the fatigue recognition improvement information on the display unit 10, and the sound information is transmitted through the speaker 110. Vibration information is provided to the user by generating vibration through the vibrator.

Alternatively, as displayed at the bottom, a button B2 for displaying more detailed analysis results and the like may be displayed. Specifically, for example, autonomic nerve balance, LF/HF value, CVR-R (coefficient of variation RR interval) value, and the like.

<Subjective Fatigue State Information Acquisition Processing>
When the process is started, the subjective fatigue state information acquisition unit 750 scores the information of the answer to the question and the emotion information received from the user terminal 1 as the user's subjective fatigue level by a predetermined method.

That is, for example, the subjective fatigue state information acquisition unit 750 calculates the total value (5 to 20) of the 5-level evaluation whose input was accepted as the degree of feeling that it applies to the state asked in each question as an answer to the question. For emotional information, the score associated with the words selected by the user in advance (for example, 10 points for "You did your best!", 8 points for "It was a nice day", etc.) . . ” is a score of 0, etc.) is a score (0 to 10) based on emotion information.

It should be noted that the balance of the weighting between the score related to the information of the answer to the question and the score related to the emotional information and the score associated with each word selected by the user were determined by the inventors during the development of the analysis system of the present invention. In the experiment conducted, the user's degree of satisfaction was high, and the balance and score were used for setting.

Specifically, the contents of the experiment were: (1) the score based on the answer to the question was divided by 0.2 and converted to 100 points, and (2) the score based on the answer to the question and the score based on emotional information. The total score was divided by 0.3 and converted to 100 points. .

As a result, 89 subjects answered that (2) was more satisfactory, and 11 subjects answered that (1) was more satisfactory. Therefore, it was confirmed that (2) is more satisfactory.

Then, in the present embodiment, the subjective fatigue state information acquisition unit 750 evaluates the sum of the scores based on the answers to the questions and the scores based on the emotion information in 10-level evaluation using a predetermined algorithm. Information on the user's "mental health level", which indicates how many points the user has, is acquired as a subjective fatigue level value. In the "mental health level", the higher the value, the higher the mental health level (=lower subjective fatigue level), and the lower the value, the lower the mental health level (=higher subjective fatigue level).

The subjective fatigue state information acquisition unit 750 transmits the thus acquired "mental health level" value to the user terminal 1 as the user's subjective fatigue level value, and ends the subjective fatigue state information acquisition process. do.

<Objective fatigue state information acquisition processing>
The contents of the objective fatigue state information acquisition process will be described with reference to FIG.

When the process starts, the objective fatigue state information acquisition section 770 acquires information on the user's heartbeat (FIG. 5/S51). Various well-known methods may be arbitrarily adopted as a method for acquiring information about the user's heartbeat. Get information about your heart rate.

More specifically, for example, the input receiving unit 730 detects changes in luminance of each color component of RGB from a plurality of still images or moving images of faces continuously captured by the imaging unit 50 for a certain period of time (for example, 30 seconds). Get information. Then, the input reception unit 730 transmits to the server 2 information on changes in luminance of each color component of RGB based on the acquired image of the user's face. Alternatively, for example, the information that the input reception unit 730 transmits to the server 2 may be information on changes in brightness of a color component of a specific color (for example, G) based on the image of the user's face.

The objective fatigue state information acquisition unit 770 that has received the information acquires the user's heart rate during a certain period of time as information related to the user's heartbeat from the information on the change in luminance of each RGB color component based on the user's face image. .

After that, the objective fatigue state information acquisition unit 770 acquires heart rate state information indicating the state of the user's heart rate from the user's heart rate information (FIG. 5/S53).

The objective fatigue state information acquisition unit 770 acquires, for example, CVR-R, which is information about fluctuations in the user's heartbeat, as the heartbeat state information. This is because heartbeat fluctuation is closely related to the user's objective state of fatigue.

In addition, the objective fatigue state information acquisition unit 770 acquires autonomic nerve balance information indicating the user's autonomic nerve balance from the user's heart rate information (FIG. 5/S55).

For example, the objective fatigue state information acquisition unit 770 obtains the ratio of LF (Low Frequency), which is a low frequency component of heartbeat fluctuation, and HF (High Frequency), which is a high frequency component of heartbeat fluctuation, obtained by frequency analysis of heartbeat fluctuation ( LF/HF value) is acquired as autonomic nerve balance information.

After that, the objective fatigue state information acquisition unit 770 acquires objective fatigue level information by a predetermined method from the CVR-R, which is the heartbeat state information, and the LF/HF value, which is the autonomic nerve balance information (Fig. 5/S57).

That is, for example, the objective fatigue state information acquisition unit 770 evaluates the CVR-R value and the LF/HF value by a 10-point scale according to a predetermined algorithm, and calculates how many points each is out of 10 points. , the sum of these values is divided by 2 to obtain an average value, and the average value is defined as the “physical health level”. The objective fatigue state information acquisition unit 770 acquires the value of the "physical health level" calculated in this manner as the objective fatigue level value. In the "physical health level", the higher the value, the higher the physical health (=lower the objective fatigue level), and the lower the value, the lower the physical health level (=higher the objective fatigue level).

The objective fatigue state information acquisition unit 770 transmits the “physical health level” value thus acquired based on the heartbeat state information and the autonomic nerve balance information to the user terminal 1 as an objective fatigue level value. to end the objective fatigue state information acquisition process.

<Decision process>
The contents of the determination process will be described with reference to FIGS. 6 to 8. FIG. After starting the processing, the determination unit 790 sequentially performs the following processing.

Determination of First Comment First, the determination unit 790 determines the first comment corresponding to the state of the combination of subjective fatigue level information and emotion information (FIG. 6/S71).

More specifically, the determination unit 790 stores, for example, in advance in the storage unit 90, information on a combination of the user's subjective fatigue level value and emotional information, as shown in FIG. 7, and the user's A first comment corresponding to the combined information is determined by referring to the information indicating the correspondence between the first comment made up of verbal information indicating the subjective state of fatigue.

FIG. 7 shows part of the information indicating the correspondence. The determining unit 790 refers to the information and identifies the first comment corresponding to the combination of the subjective fatigue level score and the emotional information.

In this embodiment, the first comment corresponding to the combination of the subjective fatigue level 〇〇 points and the emotional information "You did your best!" The first comment corresponding to the combination of the same subjective fatigue point and the emotional information "I'm tired..." is "You can change your mind." As if there is an awareness that you have been forced to spend time without being caught...".

In this way, even if the subjective fatigue level scores are the same, the contents of the first comment differ depending on the emotion information.

Determination of Second Comment Subsequently, the determination unit 790 determines a second comment corresponding to the state of the combination of the objective fatigue level information and the autonomic nerve balance information (FIG. 6/S73).

More specifically, the determination unit 790 stores, for example, the information of the combination of the user's objective fatigue level value and the autonomic nerve balance information, which are stored in advance in the storage unit 90, and the user's objective fatigue state. By referring to the information indicating the correspondence between the second comment consisting of the information of the word indicating the and, the second comment corresponding to the information of the combination is determined.

An image of the information indicating the corresponding relationship is the same as the image shown in FIG. That is, for example, in the objective fatigue state information acquisition process described above, the “body health level” obtained as an objective fatigue level value from CVR-R, which is the heartbeat state information, and the LF/HF value, which is the autonomic nerve balance information. and the state of the LF / HF value, which is the autonomic nerve balance information (for example, the first state, which is the best state if the LF / HF value is less than 0.8, ... If the LF / HF value is 5 or more For example, the fourth state, which is the worst state, is stored in the information indicating the corresponding relationship.

By determining the second comment with reference to such information, even if the values of the "physical health level" are the same, the second comment is determined by the state of the LF/HF value, which is the autonomic nerve balance information. have different contents.

Determination of Contents to be Improved Next, the determination unit 790 determines vibrations and sounds corresponding to the combined state of the user's subjective fatigue level information and objective fatigue level information (FIG. 6/S75).

For example, the determination unit 790 determines the mental health score (out of 10 points) acquired in the subjective fatigue state information acquisition process, the physical health score (out of 10 points) acquired in the objective fatigue state information acquisition process, and are divided into three groups according to their respective points, referring to a matrix table as shown in FIG. Identify.

The matrix table of FIG. 8 indicates that the state "A" in which both the user's mental health level and physical health level are high is the best state.

C1 to C3 indicate that either the user's mental health level or physical health level is low, and "C3", in which both are low, is the worst.

The determining unit 790 determines vibrations and sounds pre-associated with each combination of the user's mental health level and physical health level identified in this manner as improvement content.

For example, the determining unit 790 relatively shortens the length of vibration included in the improved content if the combination is A. If the combination is B, the length of vibration is slightly increased, and if the combination is C1 to C3, the length of vibration is maximized. This is because the effect of improving the fatigue state of the user is higher when the length of time for which the vibration stimulation is provided is longer than when the length of time for which the vibration stimulation is provided is shorter.

Further, the determination unit 790 changes the contents of sounds included in the improved content according to the combination. That is, for example, if the combination is A, the determination unit 790 determines that the content of the sound is music. If the combination is B, then the content of the sound is a combination of music and environmental sounds (such as chirping of birds, babbling of a river, etc.) or a combination of music and reading voice. This is because providing a combination of environmental sounds and reading voices in addition to music is more effective in improving the user's state of fatigue.

Alternatively, if the combination is C1, that is, if the mental health level is low and the physical health level is medium or high, the determination unit 790 selects music having the effect of improving the mental health level. and If the combination is C2, that is, if the physical health level is low and the mental health level is medium or high, the determination unit 790 selects the content of the sound as music that has the effect of improving the physical health level. do.

Then, if the combination is C3, that is, if both the mental health level and the physical health level are low, the determination unit 790 selects music having the effect of improving the mental and physical health levels as the content of the sound.

・Determination of word information to be included in the improved content Verbal information for improving the fatigue state is determined (FIG. 6/S79), and if the user's objective fatigue state is worse than the predetermined second criterion (FIG. 6/S81: Yes), the user's Verbal information for improving the objective state of fatigue is determined (FIG. 6/S83). This suggests that providing specific verbal information to improve the fatigue state is more likely to improve the fatigue state than not providing such verbal information, especially when the fatigue state is high. This is because the improvement effect is high.

More specifically, for example, when the mental health level is less than 3 and the physical health level is 3 or more, the determination unit 790 determines the combination of the mental health level and the physical health level. is C1, the user's subjective state of fatigue is determined to be worse than a predetermined first criterion, and verbal information for improving the user's mental health (subjective state of fatigue) is determined. .

Verbal information for improving the user's mental health (subjective state of fatigue) is, for example, a voice guide or written words that encourage so-called self-compassion, recognizing oneself and feeling kind to oneself. information.

Note that the determination unit 790 refers to the information indicating the correspondence relationship between the emotional information and verbal information for improving the mental health level (subjective state of fatigue), and determines the mental health level corresponding to the emotional information. Determine verbal information to improve.

Specifically, the determination unit 790 determines information of words that are particularly effective in improving mental health (subjective state of fatigue) if the emotional information is "It was painful...". If it is "I'm tired...", the information of words that have a high improvement effect is decided, and if the emotional information is "You did your best!" Determine the information in the following words.

Then, for example, when the physical health level is less than 3 and the mental health level is 3 or more, the determining unit 790 determines that the combination of the physical health level and the mental health level is C2. , determine that the user's objective fatigue state is worse than a predetermined second standard, and determine verbal information for improving the user's physical fitness level (objective fatigue state).

Verbal information for improving the user's physical health (objective state of fatigue) is, for example, recognizing and relaxing the tension in the user's body, promoting so-called self-release, voice guidance or written words Information.

Note that the determination unit 790 refers to the information indicating the correspondence relationship between the autonomic nerve balance information and the verbal information for improving the health level of the body (objective fatigue state), verbal information to improve the health of the patient (objective state of fatigue).

Specifically, the determination unit 790 determines information of words that has a particularly high effect of improving body health (objective fatigue state) if the LF / HF value, which is autonomic balance information, is 5 or more, If the LF/HF value is 2 or more and less than 5, the information of words with a high improvement effect is determined, and if the LF/HF value is less than 2, the information of words with an intermediate or less improvement effect is determined.

Alternatively, for example, if both the mental health level and the physical health level are less than 3, that is, if the combination of the physical health level and the mental health level is C3, the user's subjective It is determined that both the fatigue state and the objective fatigue state are worse than a predetermined standard, and the user's physical health level (objective fatigue state) and mental health level (subjective fatigue state) are determined. The information of the words with the particularly high improvement effect of both is determined.

In this way, the combination of physical health (objective state of fatigue) and mental health (subjective state of fatigue), combination of physical health and autonomic balance information, and mental health and The storage unit 90 stores a plurality of improved contents with different content, a first comment, and a first comment, so that the improved content, the first comment, and the second comment can be determined and provided to the user according to the combination with the emotional information. A comment and a second comment are stored.

Although the analysis system of the present embodiment has been described above, the embodiment of the present invention is not limited to this. Various modifications are possible without departing from the scope of the present invention.

For example, either the subjective fatigue state information acquisition process or the objective fatigue state information acquisition process may be performed first. In the objective fatigue state information acquisition process, the information that the input reception unit 730 transmits to the server 2 is a still image or a moving image of a plurality of faces captured by the imaging unit 50, and from the images to the image of the user's face The objective fatigue state information acquisition section 770 may perform the process of acquiring information on changes in brightness of each color component of RGB (or a color component of a specific color) based on.

Alternatively, for example, the improvement content may be vibration only, sound only, or verbal information only. Alternatively, part or all of the fatigue recognition improvement information determined by the determination unit in the determination process may be omitted. In this case, if the speaker 110 and the vibrator 130 are unnecessary, they may be omitted.

Alternatively, for example, part or all of the objective fatigue state information acquisition process may be omitted. When all of the objective fatigue state information acquisition process is omitted, the objective fatigue state information acquisition unit 770 is also omitted, and the information output to the user is a value indicating the user's subjective degree of fatigue. The fatigue recognition improvement information provided to the user is information for making the user aware of the user's subjective fatigue state or improving the user's subjective fatigue state.

DESCRIPTION OF SYMBOLS 10... Display part, 30... Input part, 50... Imaging part, 70... Control part, 90... Storage part, 110... Speaker, 130... Vibrator, 710... Output control part, 730... Input reception part, 750... Subjective fatigue state Information acquisition unit 770...Objective fatigue state information acquisition unit 790...Determination unit.

Claims (10)

A computer system for analyzing a user's fatigue state,
a display for displaying information;
an input unit that receives input of information by the user;
an imaging unit that captures an image of the user's face;
an image of the user's face imaged by the imaging unit is displayed on the display unit, and information about a question about the state of a predetermined part of the user's face displayed on the display unit; an output control unit for displaying, on the display unit, information prompting input of emotion information indicating the content of the user's own feelings toward the image;
an input reception unit that receives input of information on answers to the questions and the emotion information via the input unit in a state where the image of the user's face captured by the imaging unit is displayed on the display unit;
a subjective fatigue state information acquisition unit that acquires a value indicating the degree of subjective fatigue state felt by the user, which is calculated by a predetermined method from the information of the answers to the questions and the emotion information. Characterized analysis system. In the analysis system according to claim 1,
The output control unit provides the user with words of encouragement or consolation suitable for improving the state of fatigue recognized by the user, which is displayed on the display unit, as the information prompting the input of the emotional information. An analysis system characterized by being configured to display information prompting the input of information on the display unit. In the analysis system according to claim 1 or 2,
Information obtained by combining a value indicating the subjective state of fatigue of the user and the emotional information, and making the user aware of the user's subjective state of fatigue or improving the user's subjective state of fatigue A determining unit for determining the fatigue recognition improvement information corresponding to the combined information by referring to the information indicating the correspondence relationship between the fatigue recognition improvement information consisting of information for
The analysis system, wherein the output control unit is configured to output the fatigue recognition improvement information to the user. In the analysis system according to claim 3,
The determination unit includes: information on a combination of a value indicating the degree of subjective state of fatigue of the user and the emotional information; a first comment consisting of verbal information indicating the subjective state of fatigue of the user; By referring to the information indicating the correspondence relationship, the first comment corresponding to the information of the combination is configured to be determined as the fatigue recognition improvement information,
The analysis system, wherein the output control unit is configured to output the first comment determined by the determination unit to the user. In the analysis system according to claim 3 or 4,
An objective fatigue state information acquisition unit that acquires a value indicating the objective degree of fatigue of the user calculated by a predetermined method,
The determination unit refers to information indicating a correspondence relationship between a value indicating the objective degree of fatigue of the user and a second comment composed of verbal information indicating the objective fatigue state of the user. , configured to determine the second comment corresponding to the value indicating the objective degree of fatigue of the user as the fatigue recognition improvement information,
The analysis system, wherein the output control unit is configured to output the second comment determined by the determination unit to the user. In the analysis system according to claim 5,
The objective fatigue state information acquisition unit acquires information on the heartbeat of the user by a predetermined method, heartbeat state information indicating the state of the heartbeat of the user derived from the information on the heartbeat, and autonomic nerves of the user. obtaining autonomic balance information indicating balance, obtaining a value indicating an objective degree of fatigue of the user based on the heartbeat state information and the autonomic balance information,
The determination unit provides information on a combination of a value indicating the objective degree of fatigue of the user and the autonomic nerve balance information, and a second comment consisting of verbal information indicating the objective fatigue state of the user. , with reference to the information indicating the correspondence relationship, and is configured to determine the second comment corresponding to the information of the combination as the fatigue recognition improvement information,
The analysis system, wherein the output control unit is configured to output the second comment determined by the determination unit to the user. In the analysis system according to any one of claims 3 to 6,
an objective fatigue state information acquisition unit that acquires a value indicating an objective degree of fatigue state of the user calculated by a predetermined method;
A storage unit that stores a plurality of improvement contents, which is information for improving the user's subjective fatigue state and objective fatigue state,
The determination unit provides information indicating a correspondence relationship between information on a combination of a value indicating the subjective degree of fatigue of the user and a value indicating the objective degree of fatigue of the user, and the improvement content. with reference to determine the improvement content corresponding to the information of the combination as the fatigue recognition improvement information,
The analysis system, wherein the output control unit is configured to output the improvement content determined by the determination unit to the user. In the analysis system according to claim 7,
The analysis system, wherein the improvement content consists of one or both of vibration and sound. In the analysis system according to claim 7,
The improvement content consists of a combination of one or both of vibration and sound and verbal information,
The decision unit
If the value indicating the degree of the user's subjective fatigue state indicates that the user's subjective fatigue state is worse than a predetermined first criterion, the user's subjective fatigue state determining said verbal information for improving the
When the value indicating the degree of the user's objective fatigue state indicates that the user's objective fatigue state is worse than a predetermined second standard, the user's objective fatigue state An analysis system configured to determine said verbal information for improving . In the analysis system according to claim 9,
The decision unit
Improving the subjective state of fatigue of the user corresponding to the emotional information by referring to information indicating the correspondence between the emotional information and verbal information for improving the subjective state of fatigue of the user. determine the verbal information for
Correspondence between autonomic nerve balance information indicating the user's autonomic nerve balance derived from information on the user's heartbeat acquired by a predetermined method and verbal information for improving the user's objective fatigue state An analysis system configured to determine verbal information for improving the user's objective state of fatigue corresponding to the autonomic nerve balance information by referring to the information indicating the relationship.

Images