JP2014076209A - Context information generation device, context information storage device, context information generation method, and context information generation program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To more accurately determine a user state and generate context information containing the determined user state, by using a measured external state relating to a user or the periphery of the user.SOLUTION: A context information generation device 100 comprises: an external state acquisition part 101 for acquiring an external state relating to the user or the periphery of the user; a biological information acquisition part 102 for acquiring biological information of the user; a reliability determination part 103 for determining the reliability of each piece of biological information on the basis of the external state; and an internal state determination part 104 which determines an internal state on the basis of the reliability determined by the reliability determination part 103, the biological information, and internal state determination information containing a previously stored internal state corresponding to the biological information and generates context information containing the internal state.

Description

  The present invention relates to a context information generation device that determines a human internal state based on biological signals such as a pulse wave and an electroencephalogram, and generates context information including the determined internal state, a context information storage device that stores the context information, The present invention relates to a context information generation method and a context information generation program.

  In recent years, with the spread of mobile communication devices and small terminals equipped with a variety of sensors, it is possible to easily measure external information such as user movement and position, and biological information such as pulse waves and brain waves. It was.

  For example, in Patent Document 1 below, using a pulse wave sensor and an acceleration sensor, the concentration level of the measurement subject is stably and reliably measured, and the concentration level of the measurement subject is determined together with the situation at the time of measurement. Techniques that enable this are disclosed. As a result, the degree of concentration in consideration of the user's movement can be calculated from the measurement result of the acceleration sensor.

JP 2007-283041 A

  However, in Patent Document 1, when the motion activity measured by the acceleration sensor exceeds a certain threshold, the data of the autonomic nerve activity measured by the pulse wave sensor during that time is used to determine the user's concentration level. Not used for. That is, the data measured by the pulse wave sensor during the period when the measured value by the acceleration sensor exceeds the threshold value is not taken into account when determining the user's concentration level. Further, external states other than the user's movement activity measured by the acceleration sensor are not taken into consideration.

  Therefore, an object of the present invention is to determine a user state with higher accuracy by using an external state relating to a measured user or a user periphery, and to generate context information including the determined user state.

  The context information generation apparatus according to the present invention includes an external state acquisition unit that acquires an external state relating to a user or a user's surroundings, a biological information acquisition unit that acquires biological information of the user, and a reliability for each biological information based on the external state. The internal state is determined based on the reliability determination means for determining the reliability, the reliability determined by the reliability determination means, the biological information, and the internal state determination information in which the internal state corresponding to the biological information is stored in advance. And internal state determination means for generating context information including the internal state.

  A context information generation method according to the present invention is a context information generation method executed by a context information generation device that generates context information, and includes an external state acquisition step of acquiring an external state related to a user or a user, and a user's A biological information acquisition step for acquiring biological information, a reliability determination step for determining reliability for each biological information based on the external state, the reliability determined by the reliability determination step, the biological information, and the biological information An internal state determination step of determining an internal state based on internal state determination information in which a corresponding internal state is stored in advance, and generating context information including the internal state.

  A context information generation program according to the present invention includes a computer provided in a context information generation apparatus that generates context information, an external state acquisition unit that acquires an external state related to a user or a user, and a biological body that acquires biological information of the user. Information acquisition means, reliability determination means for determining reliability for each biological information based on the external state, reliability determined by the reliability determination means, biological information, and internal state corresponding to the biological information in advance The internal state is determined based on the stored internal state determination information, and functions as an internal state determination unit that generates context information including the internal state.

  According to such a form, for example, by measuring with a sensor, an external state related to the user or the user's surroundings and the biological information of the user are acquired, and the reliability for each piece of biological information is determined based on the acquired external state. Context information including the determined internal state by determining the internal state (for example, emotion, concentration state, relaxed state, etc.) of the user based on the degree, the biological information, and the internal state (internal state determination information) corresponding to the biological information Can be generated. As a result, it is possible to determine the user state (internal state) with higher accuracy using the measured external state, and to generate context information including the determined internal state.

  In the context information generation device according to the present invention, an external state acquisition unit that acquires an external state related to the user or the user's surroundings, a biological information acquisition unit that acquires biometric information of the user, and a user are placed based on the external state. For each scene determined by the scene determination means, the scene determination means for determining the scene, and the internal state based on the biological information and the internal state determination information in which the internal state corresponding to the measurement value of the biological information is stored in advance. Internal state determination means for determining and generating context information including the internal state.

  A context information generation method according to the present invention is a context information generation method executed by a context information generation device that generates context information, and includes an external state acquisition step of acquiring an external state related to a user or a user, and a user's Corresponding to biometric information and biometric information for each biometric information acquisition step for acquiring biometric information, a scene determination step for determining a scene where the user is placed based on the external state, and a scene determined by the scene determination step An internal state determination step of determining an internal state based on internal state determination information in which the internal state to be stored is stored in advance, and generating context information including the internal state.

  A context information generation program according to the present invention includes a computer provided in a context information generation apparatus that generates context information, an external state acquisition unit that acquires an external state related to a user or a user, and a biological body that acquires biological information of the user. Information acquisition means, scene determination means for determining a scene where the user is placed based on the external state, and internal information corresponding to the biological information are stored in advance for each scene determined by the scene determination means The internal state is determined based on the determined internal state determination information, and functions as an internal state determination unit that generates context information including the internal state.

  According to such a form, the external state and the user's biological information related to the user or the user's surroundings are acquired, for example, by measurement by a sensor, and the scene where the user is placed (for example, walking) based on the acquired external state Medium or stationary), and for each scene, the user's internal state (eg emotion, concentration state, relaxed state, etc.) based on the biological information and the internal state (internal state determination information) corresponding to the biological information Context information including the determined internal state can be generated. Accordingly, it is possible to determine the user state with higher accuracy using the measured external state, and to generate the context information including the determined internal state.

  A context information storage device according to the present invention includes a context information generation device, data output means for outputting context information, and data storage means for storing context information output by the data output means.

  According to such a form, the context information generated by the context information generation device can be used by another information system or can be stored permanently by storage means such as a database. Thereby, for example, context information can be used for management of a user's life record (life log) and use in another application (for example, an application for improving quality of life (QOL)).

  In the context information storage device, the internal state determined by the internal state determining unit and the external state corresponding to the internal state are presented to the user, and the user presenting unit that allows the user to input the correct value is input by the user. Learning means for performing learning related to determination of the internal state by the internal state determination means based on the correct answer value may be further provided. Thus, by making the user input a correct value and learning about the determination of the internal state, it is possible to determine an appropriate internal state suitable for the user. That is, it is possible to determine the user state with higher accuracy in consideration of individual differences among users.

  In the context information storage device, the context information in which the internal state that is the same or similar to the internal state presented by the user presenting unit and the external state that is the same or similar to the external state presented by the user presenting unit is associated. You may further provide the similar information presentation means which extracts from a data storage means, shows a user the internal state and external state which were linked | related with the said context information, and makes a user input a correct value. In such a configuration, unlearned context information associated with a situation similar to the situation (internal state and external state) determined by the internal state determination unit is extracted from the context information already stored, The user can also input a correct value for the context information. In similar situations, the correct answer values are generally considered to match, so it can be expected that the user burden for remembering what the correct answer value is will not be so great. Therefore, according to such a configuration, efficient learning can be performed by learning together about similar situations while suppressing the user burden.

  In the context information storage device, the learning result storage unit includes the internal state determined by the internal state determination unit, the external state and biological information used for determining the internal state, and the internal state corresponding to the correct value. Are stored in association with each other, the learning result storage means is referenced, noise in the measurement of biological information is extracted based on the internal state corresponding to the correct answer value, and the characteristics of the noise are analyzed to calculate a correction parameter for the biological information In addition, noise analysis means for notifying the correction parameter to the internal state determination means is further provided, and the internal state determination means corrects the measured value of the biological information based on the correction parameter notified by the noise analysis means. Good. Thereby, it is possible to obtain a correction parameter for correcting the measurement value of the biological information so that an appropriate determination suitable for the user can be performed based on the learning result, and the internal state determination unit performs correction using the correction parameter. Since the internal state can be determined after performing the above, it can be expected that the accuracy of the determination of the user state is further improved.

  ADVANTAGE OF THE INVENTION According to this invention, while determining the user state with a higher precision using the measured external state regarding the user or the user periphery, context information including the determined user state can be generated.

It is a block diagram which shows the whole structure of the context information storage device which concerns on 1st Embodiment. It is a hardware block diagram of the context information storage device which concerns on 1st-5th embodiment. It is a flowchart which shows the reliability determination operation | movement in 1st Embodiment. It is an example of the reliability adjustment information for determining the reliability in 1st Embodiment. It is a flowchart which shows the internal state determination operation | movement in 1st Embodiment. It is an example of the internal state determination information for determining the internal state in 1st Embodiment. It is explanatory drawing for demonstrating the internal state determination method in 1st Embodiment. It is a sequence diagram which shows operation | movement of the context information storage device which concerns on 1st Embodiment. It is a block diagram which shows the whole structure of the context information storage device which concerns on 2nd Embodiment. It is a sequence diagram which shows operation | movement of the context information storage apparatus which concerns on 2nd Embodiment. It is a block diagram which shows the whole structure of the context information storage device which concerns on 3rd Embodiment. It is explanatory drawing for demonstrating the scene determination method in 3rd Embodiment. It is a sequence diagram which shows operation | movement of the context information storage apparatus which concerns on 3rd Embodiment. It is a block diagram which shows the whole structure of the context information storage device which concerns on 4th Embodiment. It is a figure which shows the example of the information shown to a user in 4th Embodiment. It is a sequence diagram which shows operation | movement of the context information storage apparatus which concerns on 4th Embodiment. It is a block diagram which shows the whole structure of the context information storage device which concerns on 5th Embodiment. It is a flowchart which shows operation | movement of the similar information presentation part in 5th Embodiment. It is a block diagram which shows the whole structure of the context information storage device which concerns on 6th Embodiment. It is a flowchart which shows operation | movement of the noise analysis part in 6th Embodiment. It is a block diagram which shows the function structure of the context information generation program which concerns on 1st and 3rd embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same or equivalent elements are denoted by the same reference numerals, and redundant description is omitted.

[First Embodiment]
In the first embodiment, the external state and the user's biological information related to the user or the user's periphery are acquired, the reliability for each biological information is determined based on the external state, and the determined reliability, the biological information, and the biological information are supported. A context information generation device that determines an internal state based on internal state determination information in which the internal state is stored in advance, and generates context information by associating the internal state with the external state and biological information corresponding to the internal state The context information generation method will be described. A context information storage device that outputs the context information generated by the context information generation device and stores the output context information will be described.

  First, the overall configuration of the context information storage device according to the first embodiment will be described with reference to FIG. The context information storage device 10 illustrated in FIG. 1 includes a context information generation device 100, a data output unit 11, and a data storage unit 12. The context information generation device 100 includes an external state acquisition unit 101, a biological information acquisition unit 102, a trust A degree determination unit 103 and an internal state determination unit 104 are provided.

  Next, the hardware configuration of the context information storage device 10 will be described with reference to FIG. As shown in FIG. 2, the context information storage device 10 includes a CPU 1 that executes an operating system, application programs, and the like, a main storage unit 2 that includes ROM and RAM, and an auxiliary storage unit 3 that includes hard disk memory and the like. A communication control unit 4 that performs data communication, an output unit 5 including a liquid crystal monitor, an operation unit 6 including a keyboard and a mouse as input devices, a USB memory, a CD-ROM, a DVD, and the like And a storage medium reading unit 7 for reading the storage medium 8.

  Each function of the context information storage device 10 shown in FIG. 1 is realized by reading a predetermined software program into the main storage unit 2 and executing it under the control of the CPU 1. At that time, the CPU 1 controls the data reading and writing operations in the main storage unit 2 and the auxiliary storage unit 3 according to the processing procedure of the software program, and controls the operations of the operation unit 6, the output unit 5, and the communication control unit 4. .

  Subsequently, each functional element of the context information storage device 10 will be described.

  The context information storage device 10 is a portable communication terminal carried by a user, for example. As described above, the context information storage device 10 includes the context information generation device 100, the data output unit 11, and the data storage unit 12. However, the context information storage device 10 is not limited to the portable communication terminal, and may be a car navigation system, a notebook PC, a desktop PC, or the like.

  As described above, the context information generation apparatus 100 includes the external state acquisition unit 101, the biological information acquisition unit 102, the reliability determination unit 103, and the internal state determination unit 104, and external information and biological information are obtained by these functional elements. Obtaining and determining the reliability for each biological information, determining the internal state of the user, and generating the context information by associating the internal state with the external state and the biological information corresponding to the internal state. Hereinafter, each functional element will be described in detail.

  The external state acquisition unit 101 is an external state acquisition unit that acquires an external state related to a user or a user periphery. The “external state” is information indicating a state related to the user such as the user's position (location) and a user's movement (acceleration) and a state related to the user's surroundings such as temperature. Specifically, the external state acquisition unit 101 includes one or more external sensors (for example, a GPS sensor, an acceleration sensor, and a temperature sensor). The external sensor may be directly mounted on a mobile communication terminal or the like that is the context information storage device 10, or the context information storage device 10 by wired communication or wireless communication (wireless LAN, Bluetooth (registered trademark), etc.) using a wired cable. It may be connected so that it can communicate with a portable communication terminal or the like.

  For example, the external state acquisition unit 101 measures the user's position, acceleration, and temperature by measuring the user's position using a GPS sensor, measuring the user's movement (position change) using an acceleration sensor, and measuring the temperature using a temperature sensor. Get as external state. However, the “external state” is not limited to the above. For example, various types of information that can be acquired by mobile communication terminals, such as consumer electronics power consumption, screen lighting, battery level, camera activation history, 1Seg viewing history, setting change history, telephone / mail communication history, and application activation history Data can be used as an external state.

  The biometric information acquisition unit 102 is a biometric information acquisition unit that acquires biometric information of a user. “Biometric information” is, for example, user's own biological information such as heartbeat and pulse. Specifically, the biological information acquisition unit 102 includes one or a plurality of biological sensors (for example, a heart rate sensor and a pulse wave sensor). The biometric sensor may be directly mounted on a mobile communication terminal or the like that is the context information storage device 10, or the context information storage device 10 by wired communication or wireless communication (wireless LAN, Bluetooth (registered trademark), etc.) using a wired cable. It may be connected so that it can communicate with a portable communication terminal or the like.

  The biological information acquisition unit 102 acquires the user's heartbeat and pulse wave as biological information, for example, by the heartbeat sensor measuring the user's heartbeat and the pulse wave sensor measuring the user's pulse wave. However, “biological information” is not limited to the above. For example, various data representing biological information such as blood pressure, respiratory rate, skin temperature, electrodermal activity, electroencephalogram, cerebral blood flow, and sweating degree can be used as the biological information.

  The reliability determination unit 103 is a reliability determination unit that determines the reliability for each biological information based on the external state. “Reliability” is the reliability of a biosensor or biometric information for determining the internal state of the user. The “reliability” may be regarded as the reliability with respect to the measurement accuracy of the biosensor included in the biometric information acquisition unit 102 (reliability with respect to the biosensor itself), or as the reliability with respect to the biometric information itself measured by the biosensor. It may be understood that both of them may be included.

  Regarding the concept of reliability, the external state acquisition unit 101 includes a temperature sensor and an acceleration sensor, and the biological information acquisition unit 102 includes a sweat sensor, an electroencephalogram sensor, and a pulse wave sensor. The external state and the internal state acquired by these sensors A case where the user's internal state (here, “tension level” is taken as an example) is determined as an example. For example, when the temperature is equal to or higher than a predetermined value (or lower than the predetermined value), it is assumed that the amount of sweating of the user increases (or decreases) due to the influence of the temperature. As described above, when it is considered that the external state (temperature) has a great influence on the biometric information (sweat degree), it is appropriate to determine the user's internal state (degree of tension) based on the amount of the user's sweat amount. There may not be. That is, when the temperature is equal to or higher than a predetermined value (or lower than the predetermined value), it can be considered that the reliability of the sweat sensor is low in determining the internal state of the user.

  Further, when the acceleration measured by the acceleration sensor is large, it is assumed that the user's brain waves and pulse waves are disturbed due to the influence of the user's movement. It is also assumed that the measurement accuracy of the electroencephalogram sensor or pulse wave sensor itself is lowered due to the influence of vibration. Thus, when it is thought that the external state (acceleration) has a great influence on the biological information (electroencephalogram and pulse wave), the user's internal state (degree of tension) can be determined based on the value of the electroencephalogram or pulse wave. It may not be appropriate. That is, when the acceleration is equal to or higher than a predetermined value, it can be considered that the reliability of the electroencephalogram sensor or the pulse wave sensor is low in determining the internal state of the user.

  Based on the above-described concept of reliability, the operation of the reliability determination unit 103 will be described with reference to FIGS. 3 and 4. FIG. 3 is a flowchart showing the operation of the reliability determination unit 103. FIG. 4 is an example of reliability adjustment information used by the reliability determination unit 103 to adjust the reliability of the sweat sensor. “Difference” in the table shown in FIG. 4 indicates a value obtained by subtracting a threshold value (25 ° C. as an example) from the temperature measured by the temperature sensor, and “Reliability (%)” indicates biological information ( This shows the confidence level adjustment value.

  As illustrated in FIG. 3, the reliability determination unit 103 first acquires the external state (temperature, acceleration, etc.) acquired by the external state acquisition unit 101 (step S31). Subsequently, the reliability determination unit 103 determines whether or not the temperature is equal to or higher than a threshold value (25 ° C.), and adjusts the reliability of the sweat sensor if the temperature is equal to or higher than the threshold value (steps S32 and S33). Specifically, the reliability determination unit 103 adjusts the reliability based on the reliability adjustment information illustrated in FIG. That is, for example, when the temperature is 32 ° C., the reliability determination unit 103 performs the reliability adjustment “−50%” corresponding to the difference because the difference from the threshold (25 ° C.) is “+7”. . The reliability determination unit 103 performs the same determination on the acceleration, and adjusts the reliability of the electroencephalogram sensor and the pulse wave sensor (steps S34 and S35). The reliability determination unit 103 performs reliability adjustment for each corresponding biological information (biological sensor) for all external states acquired by the external state acquisition unit 101, and finally determines the reliability for each biological information. Is output to the internal state determination unit 104 described later (step S36).

  The initial value of the reliability of each biological information may be set by the service provider or may be set by the user. The method for setting the initial value of reliability by the user is not particularly limited. For example, the method for selecting a preset value for each behavior pattern prepared on the initial value setting screen for reliability and the behavior pattern are similar. Another method is to read setting value data of another user and use it as its own setting.

  The internal state determination unit 104 determines the internal state of the user based on the reliability, the biological information, and the internal state determination information in which the internal state corresponding to the biological information is stored in advance, and context information including the internal state It is an internal state determination means which produces | generates. The operation of the internal state determination unit 104 will be described with reference to FIGS. FIG. 5 is a flowchart showing an internal state determination operation by the internal state determination unit 104. FIG. 6 is an example of internal state determination information. FIG. 7 is an explanatory diagram for explaining an internal state determination method by the internal state determination unit 104.

  As shown in FIG. 5, the internal state determination unit 104 first acquires biological information (such as brain waves, pulse waves, and sweating degree) acquired by the biological information acquisition unit 102 and internal state determination information as shown in FIG. Step S41). Subsequently, the internal state determination unit 104 performs internal state determination (individual determination) using the internal state determination information for each piece of biological information (step S42). For example, when the electroencephalogram acquired by the biological information acquisition unit 102 is “10 Hz”, the internal state determination unit 104 refers to the internal state determination information illustrated in FIG. 6 to determine the internal state of the user based on the electroencephalogram. Judged as "relaxed". The internal state determination unit 104 performs such individual determination for all biological information, and then performs internal state determination (total determination) in consideration of all biological information (step S43). Thereafter, the internal state determination unit 104 outputs the internal state as a result of the individual determination and the comprehensive determination in steps S42 and S43, respectively.

  The comprehensive determination method in step S43 will be described using FIG. In the example illustrated in FIG. 7, as a result of the reliability determination unit 103 adjusting the reliability for each biological information based on the external state (temperature 32 degrees, acceleration 0) acquired by the external state acquisition unit 101, the electroencephalogram and the pulse wave The reliability is 100% (reliability adjustment value is 0), and the reliability of sweating degree is 50% (reliability adjustment value is −50%). Further, as a result of the internal state determination unit 104 determining the internal state for each biological information based on the internal state determination information, the internal state of the user based on the brain wave and the pulse wave is determined to be “relaxed”, and the user's internal state based on the degree of sweating is determined. The internal state indicates that it is determined as “tension”. The process from here is the comprehensive determination process in step S43. That is, the internal state determination unit 104 uses the internal information based on the biological information (electroencephalogram and pulse wave) having the highest reliability based on the reliability and internal state (individual determination result) determined for the electroencephalogram, pulse wave, and sweating degree. The state determination result (relaxed) is used as the comprehensive determination result. However, the comprehensive determination method is not limited to the above. For example, the internal state determination unit 104 extracts a predetermined number of internal states (individual determination results) based on biological information having higher reliability, and determines the internal state (individual determination result) most frequently determined among them as a comprehensive determination result. It is good.

  In the example illustrated in FIG. 7, the internal state determination unit 104 determines the determined internal state (“relaxation” based on the brain wave, “relaxation” based on the pulse wave, “tension” based on the degree of sweating, and the overall determination result) Context information including “relax”) is generated. Here, the context information may be associated with information such as an external state (temperature 32 ° C., acceleration 0), biological information (electroencephalogram, pulse wave, sweating degree), reliability, and the like. The specific data structure of the context information is not particularly limited. The context information may be, for example, information including one record including all of the above information, or may be information including a plurality of records associated with each other.

  Here, the internal state determination unit 104 may perform individual determination (step S42) for all the biological information as illustrated in FIG. 5, but filtering based on reliability (for example, biological information whose reliability is below a certain level). For example, it is possible to omit the individual determination for the biological information that does not meet the filtering conditions.

  The data output unit 11 is a data output unit that outputs the context information generated by the internal state determination unit 104. The data storage unit 12 is a data storage unit that stores the context information output by the data output unit 11.

  Next, the operation of the context information storage device 10 will be described with reference to FIG. First, the external state acquisition unit 101 transmits the external state such as the position and movement of the user acquired by measurement with an external sensor to the data storage unit 12 together with time information for acquiring the external state (step S101, external state). Acquisition step). The data storage unit 12 stores the received external state and time information (step S102). The biometric information acquisition unit 102 transmits the biometric information of the user such as a pulse wave and an electroencephalogram acquired by measurement with the biometric sensor to the data storage unit 12 together with the time information at which the biometric information is acquired (Step S103, biometric information acquisition). Step). The data storage unit 12 stores the received biological information and time information (step S104).

  Subsequently, the reliability determination unit 103 stores the external state and the reliability adjustment information from the data storage unit 12 at an arbitrary point in time after the external state and the biological information are stored in the data storage unit 12 by the processes in steps S101 to S104. (Steps S105 and S106), and the reliability for each biological information is determined based on the external state and the reliability adjustment information (step S107, reliability determination step). Subsequently, the reliability determination unit 103 transmits the external state acquired in step S106 and the reliability determined in step S107 to the internal state determination unit 104 (step S108).

  Subsequently, the internal state determination unit 104 acquires biometric information and internal state determination information from the data storage unit 12 (steps S109 and S110), and the reliability received in step S108. Based on the above, individual determination and comprehensive determination of the internal state are performed, and context information is generated (step S111, internal state determination step). Subsequently, the internal state determination unit 104 transmits the generated context information to the data output unit 11 (step S112). Further, the data output unit 11 transmits the received context information to the data storage unit 12 (step S113). Thereafter, the data storage unit 12 stores the received context information (step S114).

  As described above, according to the context information generation device 100, the external state acquisition unit 101 (external sensors such as a GPS sensor, an acceleration sensor, and a temperature sensor) performs an external state (user position, user movement) related to the user or the periphery of the user. The biometric information acquisition unit 102 (biological sensors such as a pulse wave sensor, an electroencephalogram sensor, and a sweat sensor) acquires biometric information of the user (pulse wave, electroencephalogram, sweat rate, etc.), and the reliability The determination unit 103 determines the reliability for each biological information based on the acquired external state, and the internal state determination unit 104 determines the internal state (individual determination) based on the reliability, the biological information, and the internal state determination information. Result and comprehensive determination result) and generate context information. As a result, it is possible to determine the user state (internal state) with higher accuracy using the measured external state, and to generate context information including the determined internal state.

  Further, according to the context information storage device 10, the context information generated by the context information generation device 100 can be used by another information system or can be permanently stored by a storage means such as a database. Become. Thereby, for example, context information can be used for management of a user's life record (life log) and use in another application (for example, an application for improving quality of life (QOL)).

[Second Embodiment]
As a second embodiment, a context information storage device that distributes and provides functions included in the context information storage device according to the first embodiment by using a plurality of devices (two devices as an example) will be described. In the following description, detailed description of the same configuration and the same processing content as in the first embodiment will be omitted.

  First, the overall configuration of the context information storage device according to the second embodiment will be described with reference to FIG. As shown in FIG. 9, the context information storage device according to the second embodiment includes an information acquisition device 20A including an external state acquisition unit 201 and a biological information acquisition unit 202, a reliability determination unit 203, an internal state determination unit 204, The internal state determination device 20B including the data output unit 21 and the data storage unit 22 is configured to be communicable via the communication network N and operate in cooperation with each other. In the above configuration, the portion (the portion surrounded by the broken line in FIG. 9) that combines the information acquisition device 20A and the internal state determination device 20B corresponds to the context information storage device 20, and the external state acquisition unit provided in the information acquisition device 20A. 201, the biometric information acquisition unit 202, the reliability determination unit 203 included in the internal state determination device 20 </ b> B, and the internal state determination unit 204 (portion surrounded by a dashed line in FIG. 9) are the context information generation device 200. It corresponds to. Further, the communication network N is not limited to wired or wireless, and may be, for example, the Internet network, a wired network that performs communication by directly connecting devices using a USB cable or the like, and is a wireless LAN. And a wireless network that performs communication by wireless communication such as Bluetooth (registered trademark).

  The information acquisition device 20A acquires the external state and the biological information, and transmits the acquired external state and biological information to the internal state determination device 20B via the communication network N. The internal state determination device 20B determines the internal state and generates and stores context information based on the external state and the biological information received from the information acquisition device 20A. Here, as the information acquisition apparatus 20A, an external sensor for acquiring an external state and a biological sensor for acquiring biological information are mounted, and a portable communication terminal carried by a user is mainly assumed. It is not limited to. The internal state determination device 20B only needs to be able to communicate with the information acquisition device 20A. For example, the internal state determination device 20B may be a mobile communication terminal carried by the user as in the information acquisition device 20A, or may be a remote data center or the like. It may be a database server or the like provided in.

  Next, operations of the information acquisition device 20A and the internal state determination device 20B will be described with reference to FIG. First, the external state acquisition unit 201 transmits the external state such as the position and movement of the user acquired by measurement with an external sensor to the data storage unit 22 via the communication network N together with time information for acquiring the external state. (Step S201, external state acquisition step). The data storage unit 22 stores the received external state and time information (step S202). The biometric information acquisition unit 202 transmits user biometric information such as a pulse wave and an electroencephalogram acquired by measurement with a biometric sensor to the data storage unit 22 via the communication network N together with time information acquired. Step S203, biometric information acquisition step). The data storage unit 22 stores the received biological information and time information (step S204).

  The processing contents and processing order of steps S205 to S214 by the internal state determination device 20B are the same as the processing contents and processing order of steps S105 to S114 by the context information storage device 10 according to the first embodiment shown in FIG. A description of steps S205 to S214 is omitted.

  Since the context information storage device 20 has a configuration in which the context information storage device 10 according to the first embodiment is physically distributed to two devices, the same effect as the context information storage device 10 according to the first embodiment. Play. Moreover, the context information generation device 200 included in the context information storage device 20 also has the same effect as the context information generation device 100 according to the first embodiment. Further, in the second embodiment, functions can be appropriately distributed among a plurality of devices, so that it is possible to improve maintenance such as repair and replacement of the devices, and to reduce the size and weight of the terminal carried by the user.

  Note that the information acquisition device 20A may be configured by one device as illustrated in FIG. 9 or may be configured by a plurality of devices. When the information acquisition device 20A is configured by a plurality of devices, a different sensor (external sensor or biological sensor) may be mounted for each device. Further, in order to measure the external state or biological information with higher accuracy, a plurality of devices may be equipped with sensors for measuring the same external state or biological information.

[Third Embodiment]
As a third embodiment, a context information generating device, a context information generating method, and a context for determining a scene where a user is placed based on an external state, determining an internal state based on the scene, and generating context information The information storage device will be described. In the following description, detailed description of the same configuration and the same processing content as in the first embodiment will be omitted.

  First, the overall configuration of the context information storage device according to the third embodiment will be described with reference to FIG. The context information storage device 30 illustrated in FIG. 11 includes a context information generation device 300, a data output unit 31, and a data storage unit 32. The context information generation device 300 includes an external state acquisition unit 301, a biological information acquisition unit 302, and a scene. A determination unit 305 and an internal state determination unit 304 are provided.

  The scene determination unit 305 is a scene determination unit that determines a scene where the user is placed based on an external state. The “scene” indicates a specific action situation of the user such as a stationary state and a walking state. For example, when the external state acquisition unit 301 includes an acceleration sensor, the scene determination unit 305 determines that the scene is “still” when the acceleration measured by the acceleration sensor is 0, and the acceleration is within a predetermined range. If a value is indicated, the scene is determined to be “walking”. However, the above is an example, and the scene determination unit 305 may determine a scene other than those described above by combining various other external states. For example, information combined with other external conditions such as time and place (for example, “walking a park around 15:00”) may be used as a “scene”.

  The internal state determination unit 304 determines an internal state for each scene determined by the scene determination unit 305 based on the biological information and the internal state determination information, and generates context information including the internal state. It is. For example, the internal state determination unit 304 collects internal states (overall determination results) at a plurality of points in time when the scenes determined by the scene determination unit 305 are the same, and the internal state (total determination result) most frequently determined among them. ) Can be determined as the internal state of the user in the scene. A scene determination method performed by the internal state determination unit 304 will be described with reference to FIG.

  In FIG. 12, the external state (user position and acceleration) is acquired continuously in time by the external state acquisition unit 301 including a GPS sensor and an acceleration sensor, and the scene determination unit 305 displays the scene in the time zone T1 as “park”. Is determined to be “walking”, and the scene in the time period T2 is determined to be “sit in the park”. In addition, the internal state determination unit 304 calculates the internal state at each time point. In FIG. 12, the internal state indicated by the bar-shaped region represents the internal state at each time point. Here, the internal state determination method at each time point by the internal state determination unit 304 is not particularly limited. For example, the user state determined most frequently among the internal states (individual determination results) of the user determined based on each piece of biological information at the same time point may be the internal state at the time point, or the context information generation device 300 Are provided with functional elements equivalent to the reliability determination unit 103 according to the first embodiment, and the internal state determination unit 304 determines the internal state of the user by using the reliability for each piece of biological information determined by the functional elements. It may be a thing.

  Subsequently, the internal state determination unit 304 determines, for each scene, the internal state determined most among the internal states determined at each time point included in the scene as the internal state in the scene. That is, the internal state determination unit 304 adopts “relaxation” determined most frequently in the scene as the user's internal state in the scene (walking in the park) in the time zone T1, and sits in the scene in the time zone T2 (sitting in the park) The “concentration” determined most frequently in the scene is adopted as the internal state of the user in (). However, as described above, the method (majority determination method) for determining the most internal state among the internal states at each time point included in the scene as the internal state in the scene is an example, and the internal state determination unit 304 is other than the above The internal state of each scene may be determined by a method.

  The internal state determination unit 304 may generate context information in the same manner as the context information storage device 10 according to the first embodiment after determining the internal state for each scene, but appropriately identifies the information specified for each scene. In order to store it, it is preferable to associate scene information with the context information.

  Next, the operation of the context information storage device 30 will be described with reference to FIG. First, the external state acquisition unit 301 transmits the external state such as the position and movement of the user acquired by measurement with the external sensor to the data storage unit 32 together with the time information that acquired the external state (step S301, external state). Acquisition step). The data storage unit 32 stores the received external state and time information (step S302). Similarly, the biological information acquisition unit 302 transmits the user's biological information such as a pulse wave and an electroencephalogram acquired by measurement with the biological sensor to the data storage unit 32 together with the time information at which the biological information is acquired (step S303, Biometric information acquisition step). The data storage unit 32 stores the received biological information and time information (step S304).

  Subsequently, the scene determination unit 305 acquires the external state from the data storage unit 32 at an arbitrary time after the external state and the biological information are stored in the data storage unit 32 by the processes of steps S301 to S304 (step S305). , S306), a scene is determined based on the external state (step S307, scene determination step). Subsequently, the scene determination unit 305 transmits the external state acquired in step S306 and the scene determined in step S307 to the internal state determination unit 304 (step S308).

  Subsequently, the internal state determination unit 304 acquires biometric information and internal state determination information from the data storage unit 32 (steps S309 and S310), and the biometric information and internal state determination information and the scene received in step S308. Based on the scene, the internal state of the user is determined for each scene, and context information is generated (step S311, internal state determination step). Subsequently, the internal state determination unit 304 transmits the generated context information to the data output unit 31 (step S312). Further, the data output unit 31 transmits the received context information to the data storage unit 32 (step S313). Thereafter, the data storage unit 32 stores the received context information (step S314).

  As described above, according to the context information generation device 300, the external state acquisition unit 301 (a GPS sensor, an acceleration sensor, a temperature sensor, or the like) performs an external state (user position, user movement, temperature, etc.) related to the user or the user's surroundings. ), The biological information acquisition unit 302 (pulse wave sensor, brain wave sensor, sweating sensor, etc.) acquires the user's biological information (pulse wave, brain wave, sweating degree, etc.), and the scene determination unit 305 is acquired. A scene where the user is placed (for example, walking or standing still) is determined based on the external state, and the internal state determination unit 304 determines whether or not the internal state is determined based on the biological information and the internal state determination information for each scene. A state (for example, a concentrated state and a relaxed state) is determined, and context information is generated. As a result, it is possible to determine the user state (internal state) with higher accuracy using the measured external state, and to generate context information including the determined internal state.

  Moreover, according to the context information storage device 30, the context information generated by the context information generation device 300 included in the context information storage device 30 can be output to another information system or stored permanently. it can. Thereby, context information can be utilized for management of a user's life record (life log) and use in other applications (for example, an application aimed at improving QOL).

[Fourth Embodiment]
As a fourth embodiment, in the context information storage device according to the first embodiment, the internal state determined by the internal state determination unit and the external state corresponding to the internal state are presented to the user, and the correct answer value is presented to the user. A user presenting unit to be input, a learning unit that performs learning related to determination of the internal state by the internal state determining unit based on a correct value input by the user, and a learning result storage unit that stores a learning result by the learning unit The configuration will be described. In the following description, detailed description of the same configuration and the same processing content as in the first embodiment will be omitted.

  First, the overall configuration of the context information storage device according to the fourth embodiment will be described with reference to FIG. The context information storage device 40 illustrated in FIG. 14 includes a context information generation device 400, a data output unit 41, a data storage unit 42, a user presentation unit 43, a learning unit 44, and a learning result storage unit 45, and the context information generation device 400. Includes an external state acquisition unit 401, a biological information acquisition unit 402, a reliability determination unit 403, and an internal state determination unit 404.

  The user presenting unit 43 is a user presenting unit that presents the internal state determined by the internal state determining unit 404 and the external state corresponding to the internal state to the user and allows the user to input a correct value. More specifically, the user presentation unit 43 outputs, for example, a screen as illustrated in FIG. 15 to the output unit 5 included in the context information storage device 40. FIG. 15 is an example of a screen presented to the user by the user presentation unit 43. As shown in FIG. 15, the user presenting unit 43 includes an internal state (relaxed) determined by the internal state determining unit 404 and an external state when the internal state is determined (here, date, user's (Location, time, temperature calculated from the location information) and a message for prompting the user to input the correct value "Is there any mistake in the following?" And a registration button "Register" for the user to actually input And a correction button “correct” are output. When the user is actually in a relaxed state, that is, when the presented information is correct, the user presenting unit 43 corrects the internal state (relaxed) presented by letting the user select the registration button. As input. On the other hand, when the user is actually nervous, that is, when the presented information is incorrect, the user selects the correction button to input the internal state (tension) as a correct answer value. .

  The learning unit 44 is a learning unit that performs learning related to the determination of the internal state by the internal state determination unit 404 based on the correct value input by the user. More specifically, the learning unit 44 adjusts the reliability adjustment information or the internal state determination information used for the internal state determination by the internal state determination unit 404 based on the correct value input by the user.

  The adjustment of the reliability adjustment information by the learning unit 44 will be described using the example of the reliability adjustment information shown in FIG. As shown in FIG. 4, the reliability adjustment value when the difference between the temperature measured by the temperature sensor and the threshold value (25 ° C.) is “+6” is “−30%”. Here, it is assumed that the internal state (individual determination result) based on the degree of sweating determined by the internal state determination unit 404 is “tension”. In such a case, by adjusting the reliability of the sweating degree based on the reliability adjustment value, the reliability of the sweating degree becomes a low value compared with the reliability of other biological information, The internal state (total determination result) determined by the internal state determination unit 404 may be “relaxed”. However, when the correct answer value input by the user is “tension”, it can be seen that the internal state (individual determination result) based on the degree of sweating actually matches the internal state of the user. That is, it is proved later that the reliability of the sweating degree in determining the internal state of the user was higher than expected. Therefore, in such a case, the learning unit 44 sets the reliability adjustment value when the difference is “+6” so that the reliability of the sweating degree determined by the reliability determination unit 403 is set higher. Is preferably adjusted (for example, adjusted to “−20%” or the like).

  Next, adjustment of the internal state determination information by the learning unit 44 will be described using an example of the internal state determination information illustrated in FIG. As illustrated in FIG. 6, when the brain wave is “8 to 12 Hz”, the internal state determination unit 404 determines that the internal state based on the brain wave (individual determination result) is “relaxed” and the brain wave is “13 to In the case of “15 Hz”, the internal state (individual determination result) based on the electroencephalogram is determined to be “tension”. However, when the electroencephalogram is measured as “13 Hz” and the correct value input by the user is “relaxed”, the electroencephalogram is determined to be “relaxed” as the internal state of the user at “13 Hz”. It turns out that it is preferable. Therefore, in such a case, the learning unit 44 adjusts the internal state determination information so that it is determined to be “relaxed” when the brain wave is “13 Hz” (for example, “8 to 13 Hz”). It is preferable to adjust so that it is determined as “tension” when the brain wave is “14 to 15 Hz”.

  Note that the timing of learning by the learning unit 44 is not particularly limited. That is, the learning unit 44 may perform learning immediately after the correct value is input by the user, for example, by storing the correct value input by the user in the learning result storage unit 45 or the like described later. Learning may be performed by referring to the learning result storage unit 45.

  The learning result storage unit 45 is a learning result storage unit that stores a learning result (adjusted internal state determination information or reliability adjustment information) by the learning unit 44. The learning result storage unit 45 may be the same as or different from the data storage unit 42 as shown in FIG.

  Next, the operation of the context information storage device 40 will be described with reference to FIG. The processing contents and processing order of steps S401 to S414 by the external state acquisition unit 401, the biometric information acquisition unit 402, the reliability determination unit 403, the internal state determination unit 404, the data output unit 41, and the data storage unit 42 are shown in FIG. Since the processing contents and processing order of steps S101 to S114 by the context information storage device 10 according to the first embodiment shown are the same, descriptions of steps S401 to S414 are omitted.

  After the context information transmission (step S412) to the data output unit 41 by the internal state determination unit 404 is completed, the user presenting unit 43 determines the internal state determined by the internal state determination unit 404 from the data output unit 41, the internal state The external state corresponding to the state is acquired (steps S415 and S416), and the acquired information is processed into a display format (screen as shown in FIG. 15) that is easy for the user to understand and presented to the user (step S417). The correct value input by the user on the screen presented by the user presentation unit 43 is transmitted from the user presentation unit 43 to the learning unit 44 (step S418).

  Subsequently, the learning unit 44 performs learning based on the received correct answer value. That is, the reliability adjustment information and the internal state determination information are acquired from the data storage unit 42 (steps S419 and S420), and the reliability adjustment information and the internal state determination information are adjusted (step S421). The learning unit 44 transmits the learning result (the adjusted reliability adjustment information and the internal state determination information) in step S421 to the learning result storage unit 45 (step S422). Thereafter, the learning result storage unit 45 stores the received information (step S423).

  As described above, according to the context information storage device 40, the learning unit 44 performs learning related to the determination of the internal state (adjustment of reliability adjustment information and internal state determination information), so that an appropriate internal state suitable for the user is obtained. Can be determined. That is, it is possible to determine the user state with higher accuracy in consideration of individual differences among users.

[Fifth Embodiment]
As the fifth embodiment, a configuration in which the context information storage device 40 according to the fourth embodiment further includes similar information presenting means will be described. In the following description, detailed description of the same configuration and the same processing content as in the first embodiment will be omitted.

  First, the overall configuration of the context information storage device according to the fifth embodiment will be described with reference to FIG. The context information storage device 50 illustrated in FIG. 17 includes a context information generation device 500, a data output unit 51, a data storage unit 52, a user presentation unit 53, a learning unit 54, a learning result storage unit 55, and a similar information presentation unit 56. The context information generation device 500 includes an external state acquisition unit 501, a biological information acquisition unit 502, a reliability determination unit 503, and an internal state determination unit 504.

  The similar information presentation unit 56 is context information in which an internal state that is the same or similar to the internal state presented by the user presentation unit 53 and an external state that is the same or similar to the external state presented by the user presentation unit 53 are associated with each other. This is similar information presenting means for extracting the data from the data storage unit 52, presenting the internal state and external state associated with the context information to the user, and allowing the user to input the correct value. The operation of the similar information presentation unit 56 will be described with reference to FIG. FIG. 18 is a flowchart showing the operation of the similar information presentation unit 56.

  As illustrated in FIG. 18, first, the similar information presentation unit 56 acquires information presented by the user presentation unit 53 after the presentation by the user presentation unit 53 and the user's input are completed (step S61). Subsequently, the similar information presentation unit 56 extracts context information by referring to the data storage unit 52, and the external state and internal state associated with the context information are the internal state and external state presented by the user presentation unit 53. Is the same or similar (steps S62, S63, S64). If they are not the same or similar in the external state or the internal state (step S63: NO or step S64: NO), it is determined whether there is undetermined context information (step S65), and undetermined context information. If there is any (step S65: YES), the same determination is performed for the undetermined context information (step S62 to step S64). If there is no undetermined context information (step S65: NO), the process ends. When context information associated with the internal state and the external state that is the same as or similar to the internal state and the external state presented by the user presenting unit 53 is found (step S63: YES, step S64: YES), the relevant context The internal state and external state of the information are presented to the user (step S66).

  Regarding the “similarity”, each of the external state and the internal state will be described. For the external state, the similar information presenting unit 56 can determine that “similar” when, for example, the time difference, the position difference, the temperature difference, or the like is equal to or less than a predetermined value. For the internal state, the similar information presenting unit 56 can determine that the internal states adjacent to each other across the determination boundary in the internal state determination information such as “tension” and “slight tension” are “similar”. . However, the criteria for “similarity” are not limited to the above.

  As described above, the context information storage device 50 is similar to the situation determined by the internal state determination unit 504 among the context information already stored in the data storage unit 52 by including the similar information presentation unit 56. Unlearned context information regarding the situation can be extracted, and the correct value can be input to the user for the context information. That is, the learning unit 54 performs learning (adjustment of reliability adjustment information and internal state determination information) based on the correct value input by the user presenting unit 53 to the user, similarly to the learning unit 44 in the fourth embodiment. Learning based on the correct value input by the similar information presenting unit 56 to the user can be performed together. In similar situations, the correct answer values are generally considered to match, so it can be expected that the user burden for remembering what the correct answer value is will not be so great. Therefore, according to such a configuration, efficient learning can be performed by learning together about similar situations while suppressing the user burden.

[Sixth Embodiment]
As the sixth embodiment, a configuration in which the context information storage device 40 according to the fourth embodiment further includes noise analysis means will be described. In the following description, detailed description of the same configuration and the same processing content as in the first embodiment will be omitted.

  First, the overall configuration of the context information storage device according to the sixth embodiment will be described with reference to FIG. The context information storage device 60 illustrated in FIG. 19 includes a context information generation device 600, a data output unit 61, a data storage unit 62, a user presentation unit 63, a learning unit 64, a learning result storage unit 65, and a noise analysis unit 67. The context information generation apparatus 600 includes an external state acquisition unit 601, a biological information acquisition unit 602, a reliability determination unit 603, and an internal state determination unit 604.

  The noise analysis unit 67 refers to the learning result storage unit 65, extracts noise in the measurement of biological information based on the internal state corresponding to the correct answer value, and analyzes the characteristics of the noise to determine the correction parameter of the biological information. This is a noise analysis unit that calculates and notifies the correction parameter to the internal state determination unit 604. “Noise” as used herein refers to a location where biological information that is not determined to be an internal state corresponding to a correct value is measured in the determination of an internal state (individual determination result) based on biological information by the internal state determination unit 604. . The operation of the noise analysis unit 67 will be described with reference to FIG. FIG. 20 is a flowchart showing the operation of the noise analysis unit 67.

  As illustrated in FIG. 20, the noise analysis unit 67 extracts the noise of the biological information by referring to the information stored in the learning result storage unit 65 (information in which the correct value is associated with the context information) (step). S71, step S72: YES). The noise analysis unit 67 extracts a feature of each noise by referring to a plurality of pieces of information stored in the learning result storage unit 65, and calculates a correction parameter for biological information corresponding to a specific external state (step S73). ).

  That is, the noise analysis unit 67 refers to a plurality of pieces of information stored in the learning result storage unit 65, for example, when the external state is “the temperature is a predetermined value or higher and the acceleration is a predetermined value or higher”. Noise of the heart rate measured by the heart rate sensor (the internal state corresponding to the correct answer value is “relaxed”, but the internal state determining unit 604 indicates the internal state (individual determination result) ) Is determined to be “tension”, and the average and variance of measured values in noise can be calculated. The noise analysis unit 67 extracts characteristics of noise in the specific external state as described above (probability of occurrence, average and variance of measured values in noise, etc.), so that the internal state determination unit 604 determines whether the noise is internal state. A correction parameter that reduces the influence on is calculated.

  More specifically, the noise analysis unit 67 refers to a plurality of pieces of information stored in the learning result storage unit 65 as described above, and performs noise extraction and noise feature analysis, for example, an external state. Is a ratio indicating that the temperature is a predetermined value or more and the acceleration is a predetermined value or more (hereinafter referred to as “external state A”), and the heart rate is a predetermined value (for example, “200 times / minute”) or more. Is greater than or equal to a predetermined value (for example, 90%), and noise in such a case (for example, the internal state determination result based on the heart rate is “tension”, whereas the internal state corresponding to the correct value is It is possible to extract a noise feature that the ratio of “relaxed” portion is a predetermined value (for example, 80%) or more. Thereby, the noise analysis unit 67, for example, “in the case of the external state A, the portion where the heart rate shows a value of 200 times / minute or more is regarded as noise, and the internal state based on the heart rate can be determined to be relaxed. Thus, a correction parameter indicating information “corrects the measured value of the heart rate to a predetermined value (for example, a critical value at which the internal state is determined to be relaxed)” is calculated.

  Subsequently, the noise analysis unit 67 notifies the internal state determination unit 604 of the correction parameter calculated in step S73 (step S74). The internal state determination unit 604 that has received the correction parameter corrects the measurement value of the biological information using the correction parameter in the subsequent determination of the internal state, and thereby the internal state corresponding to the correct value input by the user. Can be determined.

  As described above, the context information storage device 60 includes the noise analysis unit 67 so that the internal state determination unit 604 can make an appropriate determination suitable for the user based on the learning result. Since the correction parameter for correcting the measured value of information can be obtained and the internal state determination unit 604 can perform the correction with the correction parameter and determine the internal state, the accuracy of the determination of the user state Can be expected to increase. Note that the context information storage device 60 may include the similar information presentation unit 56 described in the fifth embodiment.

[About the context information generation program]
Next, the context information generation programs P100 and P300 for causing the computer to function as the context information generation apparatus 100 according to the first embodiment and the context information generation apparatus 300 according to the third embodiment will be described with reference to FIG. .

  FIG. 21A is a block diagram illustrating modules of a context information generation program P100 that allows a computer to function as the context information generation apparatus 100. As shown in FIG. 21A, the context information generation program P100 includes an external state acquisition module P101, a biological information acquisition module P102, a reliability determination module P103, and an internal state determination module P104. The functions realized by the execution of each module described above are the functions of the external state acquisition unit 101, the biological information acquisition unit 102, the reliability determination unit 103, and the internal state determination unit 104 corresponding to the context information generation apparatus 100 described above. Similar to function.

  FIG. 21B is a block diagram illustrating modules of a context information generation program P300 that allows a computer to function as the context information generation apparatus 300. As shown in FIG. 21B, the context information generation program P300 includes an external state acquisition module P301, a biological information acquisition module P302, a scene determination module P305, and an internal state determination module P304. The functions realized by executing each of the modules described above are the functions of the external state acquisition unit 301, the biological information acquisition unit 302, the scene determination unit 305, and the internal state determination unit 304 corresponding to the context information generation apparatus 300 described above. It is the same.

  The context information generation programs P100 and P300 thus configured are each stored in the storage medium 8 shown in FIG. 2 and executed by a computer used as the context information generation apparatus 100 or 300. When the storage medium 8 is inserted into the storage medium reader 7, the computer can access the context information generation program P100 or P300 stored in the storage medium 8 from the storage medium reader 7, and the context information generation program P100 and By executing P300, it becomes possible to operate as the context information generating apparatus 100 or 300.

  Each of the context information generation programs P100 and P300 may be provided via a network as a computer data signal superimposed on a carrier wave. In this case, the computer used as the context information generation device 100 or 300 executes the context information generation program P100 or P300 by storing the context information generation program P100 or P300 received by the communication control unit 4 in the main storage unit 2. can do.

  The embodiment according to the present invention has been described in detail above. However, the present invention is not limited to the above embodiment. The present invention can be variously modified without departing from the gist thereof.

  For example, the context information storage device may be used by a single user or shared by a plurality of users. Moreover, when using by multiple users, you may create and use the group containing the said user. By setting a group, various settings (such as an initial value of reliability) can be shared by a plurality of users, so that user convenience can be improved. In addition, when the individual differences among users included in the group are not so large, it is possible to efficiently learn by sharing the learning results, and determination of an appropriate internal state suitable for the users included in the group It can be performed.

  Moreover, acquisition of the external state by the external state acquisition unit or the biometric information by the biometric information acquisition unit may be automatically performed regularly or manually by the user. In addition, when the acquisition setting of the external state or the biological information is automatic (periodic), the time for automatic acquisition (time interval) and the conditions for executing the acquisition operation may be manually set by the user. It may be set by the service provider.

  Further, the setting value (threshold value, etc.) of the internal state determination information or the reliability adjustment information may be set by the service provider or the user. As for the internal state determination information, as shown in the context information storage device according to the present embodiment, the data storage unit holds, and the internal state determination unit may refer to the data storage unit every time it is used. You may hold | maintain by the internal state determination part side. Similarly for the reliability adjustment information, as shown in the context information storage device according to the present embodiment, the data storage unit holds, the reliability determination unit may refer to the data storage unit every time it is used, You may hold | maintain by the reliability determination part side.

10, 20, 30, 40, 50, 60 ... context information storage device, 100, 200, 300, 400, 500, 600 ... context information generation device, 101, 201, 301, 401, 501, 601 ... external state acquisition unit 102, 202, 302, 402, 502, 602 ... biometric information acquisition unit, 103, 203, 403, 503, 603 ... reliability determination unit, 104, 204, 304, 404, 504, 604 ... internal state determination unit, 305 ... Scene determination unit, 11, 21, 31, 41, 51, 61 ... Data output unit, 12, 22, 32, 42, 52, 62 ... Data storage unit, 43, 53, 63 ... User presentation unit, 44, 54, 64 ... learning unit, 45, 55, 65 ... learning result storage unit, 56 ... similar information presentation unit, 67 ... noise analysis unit, P100, P300 ... context Information generation program.

Claims (10)

An external state acquisition means for acquiring an external state relating to a user or a user periphery;
Biometric information acquisition means for acquiring biometric information of the user;
Reliability determination means for determining reliability for each of the biological information based on the external state;
An internal state is determined based on the reliability determined by the reliability determination means, the biological information, and internal state determination information in which an internal state corresponding to the biological information is stored in advance, and includes the internal state An internal state determination means for generating context information;
A context information generation device comprising: An external state acquisition means for acquiring an external state relating to a user or a user periphery;
Biometric information acquisition means for acquiring biometric information of the user;
Scene determination means for determining a scene where the user is placed based on the external state;
For each scene determined by the scene determination means, the internal state is determined based on the biological information and internal state determination information in which an internal state corresponding to the biological information is stored in advance, and a context including the internal state Internal state determination means for generating information;
A context information generation device comprising: The context information generation device according to claim 1 or 2,
Data output means for outputting the context information;
Data storage means for storing the context information output by the data output means;
A context information storage device. User presenting means for presenting the internal state determined by the internal state determining means and the external state corresponding to the internal state to the user and allowing the user to input a correct value;
Learning means for performing learning related to determination of an internal state by the internal state determination means based on a correct value input by a user;
Learning result storage means for storing a learning result by the learning means;
The context information storage device according to claim 3. Context information in which the internal state that is the same or similar to the internal state presented by the user presenting means and the external state that is the same or similar to the external state presented by the user presenting means is extracted from the data storage means And providing similar information presenting means for presenting the internal state and the external state associated with the context information to the user and allowing the user to input a correct value.
The context information storage device according to claim 4. The learning result storage unit stores the internal state determined by the internal state determination unit, the external state and biological information used for the determination of the internal state, and the internal state corresponding to the correct answer value in association with each other. ,
Referencing the learning result storage means, extracting noise in the measurement of the biological information based on the internal state corresponding to the correct value, calculating the correction parameter of the biological information by analyzing the characteristics of the noise, Noise analysis means for notifying the correction parameter to the internal state determination means;
The internal state determination unit corrects the measurement value of the biological information based on the correction parameter notified by the noise analysis unit;
The context information storage device according to claim 4 or 5. A context information generation method that is executed by a context information generation device that generates context information,
An external state acquisition step of acquiring an external state related to the user or the user's surroundings;
A biometric information acquisition step of acquiring biometric information of the user;
A reliability determination step for determining reliability for each of the biological information based on the external state;
An internal state is determined based on the reliability determined in the reliability determination step, the biological information, and internal state determination information in which an internal state corresponding to the biological information is stored in advance, and includes the internal state An internal state determination step for generating context information;
Context information generation method including A context information generation method that is executed by a context information generation device that generates context information,
An external state acquisition step of acquiring an external state related to the user or the user's surroundings;
A biometric information acquisition step of acquiring biometric information of the user;
A scene determination step for determining a scene where the user is placed based on the external state;
For each scene determined by the scene determination step, the internal state is determined based on the biological information and internal state determination information in which an internal state corresponding to the biological information is stored in advance, and a context including the internal state An internal state determination step for generating information;
Context information generation method including A computer provided in a context information generation device that generates context information,
An external state acquisition means for acquiring an external state related to a user or a user periphery;
Biometric information acquisition means for acquiring biometric information of the user,
Reliability determining means for determining reliability for each of the biological information based on the external state; and
An internal state is determined based on the reliability determined by the reliability determination means, the biological information, and internal state determination information in which an internal state corresponding to the biological information is stored in advance, and includes the internal state Internal state determination means for generating context information;
Context information generation program to function as A computer provided in a context information generation device that generates context information,
An external state acquisition means for acquiring an external state related to a user or a user periphery;
Biometric information acquisition means for acquiring biometric information of the user,
A scene determination means for determining a scene where the user is placed based on the external state; and
For each scene determined by the scene determination means, the internal state is determined based on the biological information and internal state determination information in which an internal state corresponding to the biological information is stored in advance, and a context including the internal state Internal state determination means for generating information,
Context information generation program to function as

Images