WO2022113276A1

WO2022113276A1 - Information processing device, control method, and storage medium

Info

Publication number: WO2022113276A1
Application number: PCT/JP2020/044250
Authority: WO
Inventors: 恵渋谷; あずさ古川; 剛範辻川
Original assignee: 日本電気株式会社
Priority date: 2020-11-27
Filing date: 2020-11-27
Publication date: 2022-06-02
Also published as: JPWO2022113276A1

Abstract

This information processing device 1X mainly has a base type acquisition means 14X, a stress state acquisition means 15X, and a mental state estimation means 16X. The base type acquisition means 14X acquires a base type indicating the basic type of a subject. The stress state acquisition means 15X acquires the result of estimating the stress state of the subject. The mental state estimation means 16X estimates the mental state of the subject on the basis of the base type and the result of estimating the stress state.

Description

Information processing equipment, control method and storage medium

The present disclosure relates to technical fields of information processing devices, control methods, and storage media that perform processing related to estimation of an internal state.

A device or system for determining the stress state of a subject based on the examination (measurement) data of the subject is known. For example, Patent Document 1 discloses a stress measuring device that determines a temporary stress level of a subject and a stress level of the subject over time based on the test data of the subject. ..

JP-A-2007-201113

When aiming to relieve or improve stress, intervention that accurately grasps the mental state (psychological state, mental state) of the subject, which changes under the influence of stress, is required. For example, when the subject is in a mentally weakened state, encouragement may actually worsen the stress state.

An object of the present disclosure is to provide an information processing device, a control method, and a storage medium capable of accurately estimating a mental state in view of the above-mentioned problems.

One aspect of the information processing device is
A base type acquisition means for acquiring a base type indicating the basic type of a subject, and
The stress state acquisition means for acquiring the estimation result of the stress state of the subject, and the stress state acquisition means.
A mental state estimation means for estimating the mental state of the subject based on the base type and the estimation result of the stress state, and
It is an information processing device having.

One aspect of the control method is
The computer
Get a base type that shows the basic type of the subject,
Obtaining the estimation result of the stress state of the subject,
The mental state of the subject is estimated based on the base type and the estimation result of the stress state.
It is a control method. The "computer" includes any electronic device (which may be a processor included in the electronic device), and may be composed of a plurality of electronic devices.

One aspect of the storage medium is
Get a base type that shows the basic type of the subject,
Obtaining the estimation result of the stress state of the subject,
It is a storage medium in which a program for causing a computer to execute a process of estimating the mental state of the subject based on the base type and the estimation result of the stress state is stored.

According to the present disclosure, the mental state of the subject can be suitably estimated.

The schematic configuration of the mental state estimation system which concerns on 1st Embodiment is shown. An example of the hardware configuration of the information processing apparatus common to each embodiment is shown. It is an example of the functional block of the information processing apparatus which concerns on 1st Embodiment. This is an example of the data structure of mental state-related information. A display example of the mental state confirmation screen in the first embodiment is shown. This is an example of a flowchart executed by the information processing apparatus in the first embodiment. This is an example of a functional block of the information processing apparatus according to the second embodiment. A display example of the mental state confirmation screen in the second embodiment is shown. A schematic configuration of the mental state estimation system according to the third embodiment is shown. It is a block diagram of the information processing apparatus in 4th Embodiment. This is an example of a flowchart executed by the information processing apparatus in the fourth embodiment.

Hereinafter, embodiments of an information processing device, a control method, and a storage medium will be described with reference to the drawings.

<First Embodiment>
(1) System Configuration Figure 1 shows a schematic configuration of the mental state estimation system 100 according to the first embodiment. The mental state estimation system 100 estimates the mental state of the subject and visualizes the estimation result. Here, the "target person" may be an athlete or an employee whose mental state is managed by the organization, or may be an individual user. In addition, "mental state" refers to the mental state (psychological state, mental state) of the subject, for example, the tendency of attitude / posture toward a task, the tendency of reaction to things, the tendency of attitude / posture toward others, etc. Point to.

The mental state estimation system 100 mainly includes an information processing device 1, an input device 2, a display device 3, a storage device 4, and a sensor 5.

The information processing device 1 performs data communication with the input device 2, the display device 3, and the sensor 5 via a communication network or by direct communication by wireless or wired. Then, the information processing device 1 is mental of the subject based on the input signal "S1" supplied from the input device 2, the sensor signal "S3" supplied from the sensor 5, and the information stored in the storage device 4. Estimate the state, etc. Further, the information processing device 1 generates a display signal "S2" based on an estimation result of the mental state of the target person, and supplies the generated display signal S2 to the display device 3.

The input device 2 is an interface that accepts user input (manual input) of information about each target person. The user who inputs information using the input device 2 may be the target person himself / herself, or may be a person who manages or supervises the activities of the target person. The input device 2 may be various user input interfaces such as a touch panel, a button, a keyboard, a mouse, and a voice input device. The input device 2 supplies the input signal S1 generated based on the user's input to the information processing device 1. The display device 3 displays predetermined information based on the display signal S2 supplied from the information processing device 1. The display device 3 is, for example, a display or a projector.

The sensor 5 measures the biological signal of the subject and supplies the measured biological signal or the like to the information processing apparatus 1 as the sensor signal S3. In this case, the sensor signal S3 is an arbitrary biological signal (including vital information) such as the subject's heartbeat, brain wave, sweating amount, hormone secretion amount, cerebral blood flow, blood pressure, body temperature, myoelectricity, and respiratory rate. May be good. Further, the sensor 5 may be a device that analyzes blood collected from the subject and outputs a sensor signal S3 indicating the analysis result. Further, the sensor 5 may be a wearable terminal worn by the target person, or may be a camera for photographing the target person, a microphone for generating an audio signal of the target person's utterance, or the like.

The storage device 4 is a memory that stores various information necessary for estimating the mental state and the like. The storage device 4 may be an external storage device such as a hard disk connected to or built in the information processing device 1, or may be a storage medium such as a flash memory. Further, the storage device 4 may be a server device that performs data communication with the information processing device 1. Further, the storage device 4 may be composed of a plurality of devices.

The storage device 4 has base type information 40, estimated stress information 41, mental state-related information 42, and advice information 43.

The base type information 40 is information indicating the base type of the target person, and is, for example, information in which the identification information (target person ID) of the target person is associated with the identification information indicating the base type of the target person. Here, the "base type" refers to a basic type (category) related to the inside of the subject, and is based on at least one of the subject's age, personality, cognitive tendency, gender, occupation, income, race, and the like. Is classified (categorized). The base type information 40 may be generated by the information processing device 1 and stored in the storage device 4, or may be generated in advance by a device other than the information processing device 1 and stored in the storage device 4. There may be.

The estimated stress information 41 is information related to a value (also referred to as a "stress estimated value") representing a stress state estimated by the information processing apparatus 1 based on the sensor signal S3. The estimated stress information 41 is, for example, a database having a record in which the stress estimated value calculated by the information processing apparatus 1 is associated with the date and time information indicating the estimated date and time and the identification information (target person ID) of the target person. The above "estimated date and time" may be the generation date and time of the signal used for the estimation, or may be the date and time when the estimation was performed.

The mental state relationship information 42 is information representing the relationship between the mental state and other elements (specifically, the stress state and the base type). The mental state relationship information 42 is, for example, table information indicating the mental state corresponding to each combination of the stress estimated value and the base type. A specific example of the mental state-related information 42 will be described later with reference to FIG.

The advice information 43 is information regarding advice for the target person. The advice information 43 is, for example, a database in which advice suitable for each mental state is recorded. The advice information 43 may be information recording advice according to the combination of the mental state and the attributes (gender, occupation, age, etc.) of the subject.

The configuration of the mental state estimation system 100 shown in FIG. 1 is an example, and various changes may be made to the configuration. For example, the input device 2 and the display device 3 may be integrally configured. In this case, the input device 2 and the display device 3 may be configured as a tablet-type terminal integrated with or separate from the information processing device 1. Further, the input device 2 and the sensor 5 may be integrally configured. Further, the information processing device 1 may be composed of a plurality of devices. In this case, the plurality of devices constituting the information processing device 1 exchange information necessary for executing the pre-assigned process among the plurality of devices. In this case, the information processing apparatus 1 functions as an information processing system.

(2) Hardware Configuration of Information Processing Device FIG. 2 shows the hardware configuration of the information processing device 1. The information processing apparatus 1 includes a processor 11, a memory 12, and an interface 13 as hardware. The processor 11, the memory 12, and the interface 13 are connected via the data bus 19.

The processor 11 functions as a controller (arithmetic unit) that controls the entire information processing device 1 by executing a program stored in the memory 12. The processor 11 is, for example, a processor such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a TPU (Tensor Processing Unit), or a quantum processor. The processor 11 may be composed of a plurality of processors. The processor 11 is an example of a computer.

The memory 12 is composed of various volatile memories such as a RAM (Random Access Memory), a ROM (Read Only Memory), and a flash memory, and a non-volatile memory. Further, the memory 12 stores a program for executing the process executed by the information processing apparatus 1. A part of the information stored in the memory 12 may be stored by one or a plurality of external storage devices that can communicate with the information processing device 1, and is stored by a storage medium that can be attached to and detached from the information processing device 1. You may.

The interface 13 is an interface for electrically connecting the information processing device 1 and another device. These interfaces may be wireless interfaces such as network adapters for wirelessly transmitting and receiving data to and from other devices, and may be hardware interfaces for connecting to other devices by cables or the like.

The hardware configuration of the information processing device 1 is not limited to the configuration shown in FIG. For example, the information processing device 1 may include at least one of the input device 2 and the display device 3. Further, the information processing device 1 may be connected to or built in a sound output device such as a speaker.

(3) Functional block FIG. 3 is an example of a functional block of the information processing apparatus 1. The processor 11 of the information processing unit 1 functionally includes a base type determination unit 14, a stress state estimation unit 15, a mental state estimation unit 16, and a display control unit 17. In FIG. 3, the blocks in which data is exchanged are connected by a solid line, but the combination of blocks in which data is exchanged is not limited to FIG. The same applies to the figures of other functional blocks described later.

The base type determination unit 14 determines the base type of the target person based on the input signal S1 generated by the input to the input device 2 of the target person. In this case, for example, the base type determination unit 14 determines the base type of the target person by receiving the input signal S1 indicating the answer content of the questionnaire from the input device 2 via the interface 13. This questionnaire is, for example, a question about at least one of the subject's age, personality, cognitive tendency (that is, what kind of situation and how they tend to react), and is difficult to estimate from biometric data. Consists of. For example, there is a major five-factor personality test as a means of determining the personality of a respondent based on the answer to such a question. In this case, the base type determination unit 14 or the display control unit 17 selects the question option by, for example, transmitting the display signal S2 for displaying the question and answer options to the display device 3 via the interface 13. Display to the target person in a selectable manner. Information necessary for determining the base type from the contents of the questionnaire answers is stored in advance in the storage device 4 or the memory 12.

In this way, the base type determination unit 14 preferably determines the base type of the subject based on the subjective information (subjective value or subjective measurement value) which is the subjective information of the subject such as the questionnaire result. Can be done. The base type determination unit 14 records the determined base type in the base type information 40 in association with the target person ID of the target person.

The base type determination unit 14 determines the base type based on objective information (objective value or objective measurement value) which is objective information detected from the subject, not limited to subjective information such as questionnaire results. May be good. For example, the base type determination unit 14 estimates the walking amount (activity amount) of the target person based on the position information such as GPS, and determines whether or not the target person is active based on the estimated walking amount. To determine the base type of the target person. In another example, the base type determination unit 14 extracts a word uttered by the subject based on an arbitrary voice recognition technique from the voice data including the conversation of the subject, and determines the base type based on the extracted word. In this case, any natural language processing method such as word2vec may be used. In yet another example, even if the base type determination unit 14 determines the base type of the subject based on the age, gender, occupation, income, race, etc. included in the information registered in the system in advance by the subject. good.

The stress state estimation unit 15 calculates a stress estimated value, which is the estimated degree of stress of the subject who is the subject, based on the sensor signal S3. There are various methods for calculating the stress estimated value from biological data and the like, and the stress state estimation unit 15 may calculate the stress estimated value by any of these methods. Information necessary for calculating the stress estimated value from the sensor signal S3 (for example, parameters of the calculation model) is stored in advance in the storage device 4 or the memory 12. The stress state estimation unit 15 records the calculated stress estimated value in the estimated stress information 41 in association with the subject ID of the subject and the estimated date and time.

The mental state estimation unit 16 uses the mental state-related information 42 based on the base type of the subject indicated by the base type information 40 and the estimated stress value of the subject indicated by the estimated stress information 41, and uses the mental state of the subject. To estimate. The method of estimating the mental state using the mental state estimation unit 16 will be described later.

The display control unit 17 performs display control regarding the mental state of the target person estimated by the mental state estimation unit 16. Specifically, the display control unit 17 generates a display signal S2 of a confirmation screen (also referred to as a “mental state confirmation screen”) regarding the mental state of the target person based on the estimation result of the mental state of the target person. Then, the display control unit 17 supplies the generated display signal S2 to the display device 3 via the interface 13. The mental state confirmation screen to be displayed on the display device 3 will be described later. The viewer of the mental state confirmation screen displayed on the display device 3 may be, for example, a target person or a person who manages or supervises the target person.

Each component of the base type determination unit 14, the stress state estimation unit 15, the mental state estimation unit 16, and the display control unit 17 described with reference to FIG. 3 can be realized, for example, by the processor 11 executing a program. Further, each component may be realized by recording a necessary program in an arbitrary non-volatile storage medium and installing it as needed. It should be noted that at least a part of each of these components is not limited to being realized by software by a program, but may be realized by any combination of hardware, firmware, and software. Further, at least a part of each of these components may be realized by using a user-programmable integrated circuit such as an FPGA (Field-Programmable Gate Array) or a microcontroller. In this case, this integrated circuit may be used to realize a program composed of each of the above components. Further, at least a part of each component may be configured by an ASIC (Application Specific Standard Produce), an ASIC (Application Specific Integrated Circuit), or a quantum processor (quantum computer control chip). As described above, each component may be realized by various hardware. The above is the same in other embodiments described later. Further, each of these components may be realized by the collaboration of a plurality of computers by using, for example, cloud computing technology.

(4) Mental state estimation Next, the details of the mental state estimation method by the mental state estimation unit 16 will be described.

FIG. 4 is an example of the data structure of the mental state-related information 42. The mental state relationship information 42 shown in FIG. 4 is a table corresponding to each combination of the stress estimated value and the base type. Here, as an example, the base type is represented by a combination of an identification symbol of Roman letters (X to Z, ...) And a brief explanation of the corresponding base type (positive thinking, negative thinking, withdrawal thinking, ...). In addition, stress estimates are classified into five stages (low, slightly low, medium, slightly high, and high). Information in the range of stress estimates corresponding to each stage is stored in advance in the storage device 4 or the memory 12.

In this case, the mental state estimation unit 16 determines the corresponding mental state from the base type of the target person and the stress estimated value of the target person by referring to the mental state relationship information 42 shown in FIG.

For example, in the mental state estimation unit 16, when the base type of the subject is "X: positive thinking" and the stress estimation value of the subject belongs to "low", the mental state of the subject is "challenge". Recognize that it is a "state". In another example, in the mental state estimation unit 16, when the base type of the subject is "Y: negative thinking" and the stress estimation value of the subject belongs to "high", the mental state of the subject is "". Recognize that it is in a closed state.

As described above, the mental state estimation unit 16 can suitably estimate the mental state of the subject based on the base type of the subject and the stress estimation value by referring to the mental state relationship information 42.

The mental state relationship information 42 is not limited to the table information as shown in FIG. 4, and may be information of an inference device that infers the relationship between the base type, the stress state, and the mental state. In this case, the inferior is, for example, a model trained to output information identifying the corresponding mental state when a base type and a stress estimate are input. In this case, the inferior is pre-learned based on a learning data set consisting of an appropriate combination of the base type, the stress estimate, and the mental state, and the parameters of the inferior obtained by the learning are stored as the mental state-related information 42. It is stored in 4. The inferior model may be any machine learning model such as a neural network or a support vector machine. Then, in this case, the mental state estimation unit 16 configures the above-mentioned inference device by referring to the mental state relationship information 42, and inputs the target base type and the stress estimation value to the inference device to input the target person's base type and stress estimation value to the inference device. Estimate the mental state.

Next, the stress estimate used for estimating the mental state will be described.

The mental state estimation unit 16 may estimate the mental state based on the latest stress estimation value estimated by the stress state estimation unit 15 (or at the time when the mental state is to be estimated), and may perform a plurality of mental state estimations at different time points. The mental state may be estimated based on the stress estimate.

In the former case, the mental state estimation unit 16 extracts one stress estimated value from the estimated stress information 41, and estimates the extracted stress estimated value based on the combination with the base type of the subject indicated by the base type information 40. Estimate the mental state at the time. As a result, the mental state estimation unit 16 estimates the mental state that accurately reflects the stress state of the subject at the time when the mental state is to be estimated.

In the latter case, the mental state estimation unit 16 extracts, for example, the latest predetermined number of stress estimates of the subject from the estimated stress information 41, and based on the combination with the base type of the subject indicated by the base type information 40, for example. A predetermined number of mental states corresponding to each stress estimate are determined. The "estimated stress value for a predetermined number" is, for example, an estimated stress value of a subject estimated within the latest predetermined period (for example, one week or one month). Then, the mental state estimation unit 16 determines a representative mental state of the subject from the mental states determined for each of the stress estimated values. In this case, the mental state estimation unit 16 determines the most common mental state and the like as a representative mental state based on the aggregated result of the mental states determined for each of the stress estimated values. Then, the mental state estimation unit 16 estimates a typical mental state as the mental state of the subject. In this example, the mental state estimation unit 16 can suitably estimate the mental state that accurately reflects the recent tendency of the stress state of the subject.

(5) Mental state confirmation screen FIG. 5 shows a display example of the mental state confirmation screen in the first embodiment. The display control unit 17 generates a display signal S2 based on the mental state of the target person estimated by the mental state estimation unit 16, and supplies the generated display signal S2 to the display device 3, thereby causing the display device 3 to have a mental state. A confirmation screen is displayed. The display control unit 17 mainly provides a base type display area 51, a stress transition display area 52, a mental state display area 53, and an advice display area 54 on the mental state confirmation screen.

In the example of FIG. 5, the display control unit 17 refers to the base type information 40 and displays the base type “X: negative thinking” of the subject in the base type display area 51. Further, the display control unit 17 refers to the estimated stress information 41 and displays a graph showing the transition of the stress estimated value (stress level) for the latest week of the subject in the stress transition display area 52.

Further, the display control unit 17 displays the mental state of the target person estimated by the mental state estimation unit 16 in the mental state display area 53. Here, the display control unit 17 refers to the mental state-related information 42 shown in FIG. 4, and sets the mental state “withdrawn state” associated with the base type “X: negative thinking” and the stress estimated value “high”. It is defined as a mental state. Further, the display control unit 17 extracts the text information of the advice associated with the mental state estimated by the mental state estimation unit 16 from the advice information 43, and displays the extracted text information in the advice display area 54.

By displaying the mental state confirmation screen as shown in FIG. 5 on the display device 3, the display control unit 17 can suitably present the stress state, mental state and advice of the target person to the viewer.

(6) Processing Flow FIG. 6 is an example of a flowchart executed by the information processing apparatus 1 in the first embodiment. The information processing apparatus 1 executes, for example, the processing of the flowchart shown in FIG. 6 when the estimation request of the mental state in which the target person is designated is detected based on the input signal S1 or the like.

First, the information processing apparatus 1 determines whether or not the base type of the target person is known (step S11). In this case, the information processing apparatus 1 determines whether or not the base type of the target person is registered in the base type information 40. Then, when the base type of the target person is known (step S11; Yes), the information processing apparatus 1 shifts the process to step S13. On the other hand, when the base type of the target person is not known (step S11; No), the information processing apparatus 1 determines the base type of the target person (step S12). In this case, the information processing apparatus 1 determines the base type of the target person based on the input signal S1 indicating the answer to the questionnaire of the target person, and updates the base type information 40 based on the determination result.

Next, the information processing apparatus 1 estimates the stress of the subject based on the sensor signal S3 output by the sensor 5 with the subject as the subject (step S13). Then, the information processing apparatus 1 updates the estimated stress information 41 based on the calculated stress estimated value.

Then, the information processing apparatus 1 refers to the mental state-related information 42, and estimates the mental state of the target person based on the base type of the target person and the stress estimation value (step S14). In this case, for example, the information processing apparatus 1 estimates the mental state based on the stress estimated value calculated in the immediately preceding step S13. In another example, the information processing apparatus 1 is a representative mental state determined from the mental states specified respectively based on the stress estimated values of a predetermined number of subjects including the stress estimated values calculated in the immediately preceding step S13. May be estimated as the mental state of the subject.

Then, the information processing apparatus 1 outputs the estimation result of the mental state in step S14 (step S15). The information processing device 1 generates, for example, a display signal S2 for displaying the mental state confirmation screen shown in FIG. 5 based on the estimation result of the mental state in step S14, and displays the generated display signal S2 on the display device 3. Send.

Note that, instead of generating the display signal S2 based on the estimation result of the mental state, the information processing device 1 may store the estimation result of the mental state in the storage device 4 in association with the target person. In another example, the information processing device 1 may generate voice data for voice output of the estimation result of the mental state, and may supply the generated voice data to a sound output device (not shown).

<Second Embodiment>
FIG. 7 shows a functional block diagram of the information processing apparatus 1A according to the second embodiment. The information processing apparatus 1A in the second embodiment calculates an acute stress estimated value and a chronic stress estimated value as an index showing the stress state of the subject, and estimates the mental state with high accuracy based on these estimated values. Hereinafter, the same components as those in the first embodiment will be appropriately designated with the same reference numerals, and the description thereof will be omitted. It is assumed that the information processing apparatus 1A has the same hardware configuration as the hardware configuration of the information processing apparatus 1 shown in FIG.

The processor 11 of the information processing device 1A functionally has a base type determination unit 14, a stress state estimation unit 15A, a mental state estimation unit 16A, and a display control unit 17. Further, the storage device 4 mainly stores the base type information 40, the acute stress information 41a, the chronic stress information 41b, the mental state relationship information 42A, the advice information 43, and the sensor accumulation information 44.

The stress state estimation unit 15A calculates the acute stress estimation value and the chronic stress estimation value of the subject based on the sensor accumulation information 44. Here, the sensor storage information 44 is information that stores the sensor signal S3 generated with the subject as the subject, and is, for example, date and time information indicating the generation date and time of the target person ID, the sensor signal S3, and the sensor signal S3. Is the associated database. Then, the stress state estimation unit 15 calculates the acute stress estimated value of the subject based on the sensor signal S3 corresponding to the latest state of the subject. Further, the stress state estimation unit 15 calculates the chronic stress estimated value of the subject based on the sensor signal S3 generated in the latest predetermined period (for example, the latest one month) of the subject. There are various methods for calculating acute or chronic stress estimates from biological data and the like, and the stress state estimation unit 15A may calculate acute stress estimates and chronic stress estimates by any of these methods. .. The stress state estimation unit 15 records the calculated acute stress estimated value in the acute stress information 41a in association with the subject ID of the subject and the estimated date and time, and records the calculated chronic stress estimated value in the subject ID of the subject and the subject ID and the estimated date and time. Record in chronic stress information 41b in association with the estimated date and time.

The mental state estimation unit 16A uses the base type of the subject indicated by the base type information 40, the acute stress estimated value of the subject indicated by the acute stress information 41a, and the chronic stress estimated value of the subject indicated by the chronic stress information 41b. Based on this, the mental state of the subject is estimated. In this case, the mental state-related information 42A is, for example, table information showing the mental state corresponding to each combination of the base type, the acute stress estimated value, and the chronic stress estimated value. In another example, the mental state relationship information 42A may be parameter information for constructing an inferior learned by deep learning or the like. In this case, the inferior is a model trained to output the corresponding mental states when the base type, acute stress estimates and chronic stress estimates are input. For example, the mental state-related information 42A estimates the mental state of the subject based on the latest acute stress estimates and chronic stress estimates. In another example, the mental state relationship information 42A determines a representative mental state determined from the mental state specified for each set of acute stress estimates and chronic stress estimates corresponding to multiple estimated dates and times. , Estimated as the mental state of the subject.

The display control unit 17A controls the display of the display device 3 based on the mental state estimated by the mental state estimation unit 16A, the base type information 40, the acute stress information 41a, the chronic stress information 41b, the advice information 43, and the like. A specific example of the display control unit 17A will be described later.

FIG. 8 shows a display example of the mental state confirmation screen in the second embodiment. The display control unit 17A generates a display signal S2 based on the mental state of the target person estimated by the mental state estimation unit 16A, and supplies the generated display signal S2 to the display device 3, whereby FIG. 8 is shown on the display device 3. The mental status confirmation screen shown in is displayed. The display control unit 17A mainly provides a base type display area 51, a stress transition display area 52A, a mental state display area 53, and an advice display area 54 on the mental state confirmation screen.

In the example of FIG. 8, the display control unit 17A is a graph of the acute stress estimated value for the latest week of the subject based on the acute stress information 41a and the subject based on the chronic stress information 41b on the stress transition display region 52A. A graph of chronic stress estimates for the last week is displayed. Thereby, the display control unit 17A can preferably make the viewer visually recognize the recent transition of the stress state of the chronic or acute subject.

Further, the display control unit 17A displays the base type of the target person based on the base type information 40 in the base type display area 51, and displays the mental state estimated by the mental state estimation unit 16A in the mental state display area 53. Further, the display control unit 17A displays the advice corresponding to the mental state of the target person, which is determined based on the advice information 43, in the advice display area 54.

<Third Embodiment>
FIG. 9 shows a schematic configuration of the mental state estimation system 100B in the third embodiment. The mental state estimation system 100B according to the third embodiment is a system of a server client model, and the information processing device 1B functioning as a server device is the information processing device 1 in the first embodiment or the information processing device 1A in the second embodiment. Process. Hereinafter, the same components as those of the first embodiment or the second embodiment will be appropriately designated by the same reference numerals, and the description thereof will be omitted.

As shown in FIG. 9, the mental state estimation system 100A mainly includes an information processing device 1B that functions as a server, a storage device 4, and a terminal device 8 that functions as a client. The information processing device 1B and the terminal device 8 perform data communication via the network 7.

The terminal device 8 is a terminal used by a user (user) who is a subject, has an input function, a display function, and a communication function, and functions as an input device 2 and a display device 3 shown in FIG. do. The terminal device 8 may be, for example, a personal computer, a tablet terminal such as a smartphone, a PDA (Personal Digital Assistant), or the like. The terminal device 8 is electrically connected to a sensor 5 such as a wearable sensor worn by the user, and outputs a biological signal of the subject and the like (that is, information corresponding to the sensor signal S3 in FIG. 1) output by the sensor 5. , Transmit to the information processing device 1B. Further, the terminal device 8 receives user input related to the answer to the questionnaire and transmits the information generated by the user input (information corresponding to the input signal S1 in FIG. 1) to the information processing device 1B.

The information processing apparatus 1B has the same hardware configuration as the hardware configuration of the information processing apparatus 1 shown in FIG. 2, and the processor 11 of the information processing apparatus 1B has a functional block shown in FIG. 3 or FIG. Then, the information processing apparatus 1B receives the information corresponding to the input signal S1 and the sensor signal S3 in FIG. 1 from the terminal apparatus 8 via the network 7, determines the base type, estimates the stress state, and estimates the mental state. Executes the processing related to. Further, the information processing device 1B transmits a display signal for displaying the mental state confirmation screen or the like shown in FIG. 6 or FIG. 8 to the terminal device 8 via the network 7 based on the display request from the terminal device 8. do.

According to the third embodiment, the mental state of the subject is estimated based on the biological signal of the subject received from the terminal used by the subject, the result of the questionnaire, and the like, and the estimated result is transmitted to the subject to the terminal. Can be suitably presented above.

<Fourth Embodiment>
FIG. 10 is a block diagram of the information processing apparatus 1X according to the fourth embodiment. The information processing apparatus 1X mainly includes a base type acquisition unit 14X, a stress state acquisition unit 15X, and a mental state estimation unit 16X. The information processing device 1X may be composed of a plurality of devices.

The base type acquisition means 14X acquires a base type indicating the basic type of the subject. In this case, the base type acquisition means 14X may acquire the base type by determining the base type based on the questionnaire result of the subject or the like, and obtains the information of the base type determined by the device other than the information processing apparatus 1X. The base type may be acquired by receiving. In the former case, the base type acquisition means 14X can be the base type determination unit 14 in the first to third embodiments.

The stress state acquisition means 15X acquires the estimation result of the stress state of the subject. In this case, the stress state acquisition means 15X may acquire the stress state estimation result by estimating the stress state of the subject based on the biological signal of the subject, and the device other than the information processing device 1X may acquire the stress state estimation result. The estimation result of the stress state may be acquired by receiving the estimation result of the estimated stress state. In the former case, the stress state acquisition means 15X can be the stress state estimation unit 15 in the first embodiment or the third embodiment, or the stress state estimation unit 15A in the second embodiment or the third embodiment. The stress state acquisition means 15X may acquire a plurality of estimation results of the stress state of the subject at different time points.

The mental state estimation means 16X estimates the mental state of the subject based on the base type and the estimation result of the stress state. The mental state estimation means 16X can be, for example, the mental state estimation unit 16 in the first embodiment or the third embodiment, or the mental state estimation unit 16A in the second embodiment or the third embodiment.

FIG. 11 is an example of a flowchart executed by the information processing apparatus 1X in the fourth embodiment. First, the base type acquisition means 14X acquires a base type indicating the basic type of the subject (step S21). The stress state acquisition means 15X acquires the estimation result of the stress state of the subject (step S22). The mental state estimation means 16X estimates the mental state of the subject based on the base type and the estimation result of the stress state (step S23).
According to the fourth embodiment, the information processing apparatus 1X can accurately estimate the mental state of the subject based on the base type indicating the basic type of the subject and the stress state.

In each of the above-described embodiments, the program is stored using various types of non-transitory computer readable medium and can be supplied to a processor or the like which is a computer. Non-temporary computer-readable media include various types of tangible storage media. Examples of non-temporary computer-readable media include magnetic storage media (eg, flexible disks, magnetic tapes, hard disk drives), optomagnetic storage media (eg, optomagnetic disks), CD-ROMs (ReadOnlyMemory), CD-Rs, Includes CD-R / W, semiconductor memory (eg, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (RandomAccessMemory)). The program may also be supplied to the computer by various types of transient computer readable medium. Examples of temporary computer readable media include electrical, optical, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

Other than that, a part or all of each of the above embodiments may be described as in the following appendix, but is not limited to the following.

[Appendix 1]
A base type acquisition means for acquiring a base type indicating the basic type of a subject, and
The stress state acquisition means for acquiring the estimation result of the stress state of the subject, and the stress state acquisition means.
A mental state estimation means for estimating the mental state of the subject based on the base type and the estimation result of the stress state, and
Information processing device with.
[Appendix 2]
The stress state acquisition means acquires an estimation result regarding the acute stress of the subject and an estimation result regarding the chronic stress of the subject, and obtains the estimation result.
The information processing apparatus according to Appendix 1, wherein the mental state estimation means estimates the mental state based on the base type, the estimation result regarding the acute stress, and the estimation result regarding the chronic stress.
[Appendix 3]
The stress state acquisition means acquires the estimation results of the stress state at a plurality of time points of the subject, respectively.
The information processing apparatus according to

Appendix

1 or 2, wherein the mental state estimation means estimates the mental state based on the aggregated results of the mental states specified from the estimation results at the plurality of time points.
[Appendix 4]
The mental state estimation means estimates the mental state based on the mental state relationship information which is the information defining the relationship between the base type, the stress state, and the mental state. The information processing device described.
[Appendix 5]
The information processing apparatus according to Appendix 4, wherein the mental state relationship information is table information representing the relationship or information of an inference device for inferring the relationship.
[Appendix 6]
The information according to any one of Supplementary note 1 to 5, wherein the base type acquisition means determines the base type based on subjective information based on the subjectivity of the subject or objective information detected from the subject. Processing equipment.
[Appendix 7]
The information processing apparatus according to any one of Supplementary note 1 to 6, further comprising an output control means for displaying information or sound output regarding the estimation result of the mental state.
[Appendix 8]
The information processing apparatus according to Appendix 7, wherein the output control means performs the display or the sound output regarding the advice determined based on the mental state.
[Appendix 9]
The information processing apparatus according to

Supplementary note

7 or 8, wherein the output control means at least displays the estimation result of the mental state and the transition of the estimation result of the stress state within a predetermined period as the display.
[Appendix 10]
The item according to any one of Supplementary note 7 to 9, wherein the output control means causes the terminal device to execute the display or the sound output by transmitting a signal necessary for the display or the sound output to the terminal device. Information processing equipment.
[Appendix 11]
The computer
Get a base type that shows the basic type of the subject,
Obtaining the estimation result of the stress state of the subject,
The mental state of the subject is estimated based on the base type and the estimation result of the stress state.
Control method.
[Appendix 12]
Get a base type that shows the basic type of the subject,
Obtaining the estimation result of the stress state of the subject,
A storage medium in which a program for causing a computer to execute a process of estimating the mental state of a subject based on the base type and the estimation result of the stress state is stored.

Although the invention of the present application has been described above with reference to the embodiment, the invention of the present application is not limited to the above embodiment. Various changes that can be understood by those skilled in the art can be made within the scope of the present invention in terms of the configuration and details of the present invention. That is, it goes without saying that the invention of the present application includes all disclosure including claims, various modifications and modifications that can be made by those skilled in the art in accordance with the technical idea. In addition, each disclosure of the above-mentioned patent documents cited shall be incorporated into this document by citation.

1, 1A, 1B, 1X Information processing device 2 Input device 3 Display device 4 Storage device 5 Sensor 8

Terminal device

100, 100B Mental state estimation system

Claims

A base type acquisition means for acquiring a base type indicating the basic type of a subject, and
The stress state acquisition means for acquiring the estimation result of the stress state of the subject, and the stress state acquisition means.
A mental state estimation means for estimating the mental state of the subject based on the base type and the estimation result of the stress state, and
Information processing device with.
The stress state acquisition means acquires an estimation result regarding the acute stress of the subject and an estimation result regarding the chronic stress of the subject, and obtains the estimation result.
The information processing apparatus according to claim 1, wherein the mental state estimation means estimates the mental state based on the base type, the estimation result regarding the acute stress, and the estimation result regarding the chronic stress.
The stress state acquisition means acquires the estimation results of the stress state at a plurality of time points of the subject, respectively.
The information processing apparatus according to claim 1 or 2, wherein the mental state estimation means estimates the mental state based on the aggregated results of the mental states specified from the estimation results at the plurality of time points.
The mental state estimation means is any one of claims 1 to 3 for estimating the mental state based on the mental state relationship information which is the information defining the relationship between the base type, the stress state and the mental state. The information processing device described in.
The information processing device according to claim 4, wherein the mental state relationship information is table information representing the relationship or information of an inference device for inferring the relationship.
The method according to any one of claims 1 to 5, wherein the base type acquisition means determines the base type based on subjective information based on the subjectivity of the subject or objective information detected from the subject. Information processing device.
The information processing apparatus according to any one of claims 1 to 6, further comprising an output control means for displaying information or sound output regarding the estimation result of the mental state.
The information processing device according to claim 7, wherein the output control means performs the display or the sound output regarding the advice determined based on the mental state.
The information processing apparatus according to claim 7 or 8, wherein the output control means at least displays the estimation result of the mental state and the transition of the estimation result of the stress state within a predetermined period as the display.
According to any one of claims 7 to 9, the output control means causes the terminal device to execute the display or the sound output by transmitting a signal necessary for the display or the sound output to the terminal device. The information processing device described.
The computer
Get a base type that shows the basic type of the subject,
Obtaining the estimation result of the stress state of the subject,
The mental state of the subject is estimated based on the base type and the estimation result of the stress state.
Control method.
Get a base type that shows the basic type of the subject,
Obtaining the estimation result of the stress state of the subject,
A storage medium in which a program for causing a computer to execute a process of estimating the mental state of a subject based on the base type and the estimation result of the stress state is stored.