JP2006295823A - Situation communicating device and situation communication program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To accurately and appropriately offer various services, such as user's emotion inference or situation communication, by carrying out optimal processing corresponding to data attributes of the values measured by various sensors. <P>SOLUTION: The situation communicating device measures biological information, relating to a user or environmental information related to an ambient environment using its own various sensors. If a pressure is detected by a pressure sensor (S21:YES) and light is not detected by a light sensor (S23:NO), temperature data by a temperature sensor are specified as "human body information" (S25) and the relevant temperature data are stored as "body temperature"; whereas, if pressure is not detected by the pressure sensor (S21:NO) or light is detected with the light sensor (S23:YES), temperature data by the temperature sensor are specified as "environmental information" (S25), and the relevant temperature data are stored as "atmospheric temperature". <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a situation communication device and a situation communication program, and more particularly, to a situation communication apparatus and a situation communication program for measuring human body information about a user and environmental information about a surrounding environment.

  Conventionally, as means for communicating with others, a means of having a conversation using a telephone or other telephone device is generally performed. In such a call device, there is known a call device that includes a display unit for displaying characters on the call device in order to enhance communication with the call partner, and displays the user and the other party's character on the display unit. (For example, refer to Patent Document 1). In this communication device, it has been proposed to detect a change in a user's body temperature, heartbeat, grip strength for gripping a portable device, etc., and to perform emotion estimation more reliably.

In addition, a mobile terminal device including a plurality of sensors including an optical sensor, a temperature sensor, a pressure sensor, and the like is known (see Patent Document 2). This mobile terminal device has a good security characteristic by providing a substrate shared by a plurality of sensors on the sensor body and having flexibility so that the substrate can be formed in a shape that follows the shape of the device cover. And ergonomic suitability as well as good suitability for continuous production.
Japanese Patent Laid-Open No. 2003-248841 JP 2004-223263 A

  The above-described conventional technology makes it possible to estimate a user's emotion based on information measured from each sensor by providing a sensor group in one terminal. However, it has been impossible to distinguish the data attribute of whether the information measured from each sensor is information about the user (hereinafter referred to as human body information) or information about the surrounding environment of the terminal (hereinafter referred to as environmental information). For example, conventionally, it has not been possible to distinguish whether the temperature data from the temperature sensor indicates the body temperature of the user or the temperature around the terminal. And if the data attribute of measurement information cannot be distinguished, there existed a problem that the optimal process according to the data attribute could not be performed.

  For example, when estimating a user's emotion, it is necessary to perform estimation based only on human body information such as the user's body temperature and sweating. However, when the data attributes of measurement information cannot be distinguished, the user's emotion is estimated based on environmental information such as temperature and humidity around the terminal, and the user's emotion cannot be estimated accurately. there were. Similarly, when estimating the status of a person using a terminal, there is a problem that if the data attributes of the measurement information cannot be distinguished, the two information are mistaken and erroneous estimation is performed.

  The present invention has been made to solve the above problems, and can perform optimal processing according to the data attribute of measurement information measured by various measuring means, and can provide various services such as user emotion estimation and situation communication. It is an object of the present invention to provide a situation communication device and a situation communication program that can accurately and appropriately provide information.

  In order to achieve the above object, the situation communication device according to the first aspect of the present invention expresses the user's situation and measuring means for measuring human body information about the user or environmental information about the surrounding environment of the situation communication device. Situation expression means, transmission means for transmitting measurement information measured by the measurement means or information based on the measurement information, reception means for receiving the measurement information or information based on the measurement information, and reception by the reception means And the situation expression control means for controlling the situation expression means according to the measurement information or the information based on the measurement information, and based on the measurement information measured by the measurement means, the measurement information is the human body information or the Measurement information determination means for determining which of the environmental information is included.

  According to a second aspect of the present invention, in addition to the configuration of the first aspect of the invention, the measuring means includes a contact sensor for measuring contact from the outside on the surface of the casing of the situation communication device. , At least one of a temperature sensor that measures temperature from the outside and an optical sensor that measures irradiation of light from the outside, wherein the measurement information determination means includes contact data that is measurement information by the contact sensor; Based on at least one of temperature data, which is measurement information by the temperature sensor, and brightness data, which is measurement information by the optical sensor, the measurement information measured by the measurement means is the human body information or the environmental information. It is characterized by determining which one.

  According to a third aspect of the present invention, in addition to the configuration of the second aspect of the invention, the contact sensor generates a pressure on the surface of the casing of the situation communication device generated by an external contact. It is a thing to measure.

  In addition to the configuration of the invention according to claim 2 or 3, the situation communication device of the invention according to claim 4 is characterized in that, when the measurement information determination means determines that the measurement information is the human body information, While the temperature data is specified as “body temperature”, when it is determined that the measurement information is the environmental information, the temperature data is specified as “air temperature”.

  In addition to the configuration of the invention according to any one of claims 2 to 4, the situation communication device according to the invention according to claim 5 determines that the measurement information is the human body information. The brightness data is specified as “darkness due to user's light blocking”, while the brightness data is specified as “darkness of the surrounding environment” when the measurement information is determined to be the environment information It is characterized by doing.

  Further, the situation communication program of the invention according to claim 6 is a computer, a measurement step for measuring human body information about the user or environmental information about the surrounding environment of the situation communication device, a situation expression step for expressing the situation of the user, A transmission step of transmitting measurement information measured by the measurement step or information based on the measurement information, a reception step of receiving the measurement information or information based on the measurement information, the measurement information received by the reception step, or the Whether the measurement information is the human body information or the environmental information based on the measurement information measured by the measurement expression, the situation expression control step for controlling the situation expression step according to the information based on the measurement information A measurement information determination step for determining is executed.

  According to a seventh aspect of the present invention, in addition to the configuration of the sixth aspect of the invention, the measurement step includes a contact sensor that measures contact from the outside on the surface of the casing of the situation communication device. The human body information or the environment information is measured by at least one of a temperature sensor that measures temperature from the outside and an optical sensor that measures irradiation of light from outside, and the measurement information determination step includes the contact sensor The measurement information measured by the measurement step based on at least one of contact data that is measurement information by the sensor, temperature data that is measurement information by the temperature sensor, and brightness data that is measurement information by the optical sensor Is the human body information or the environmental information.

  According to an eighth aspect of the present invention, in the situation communication program, in addition to the configuration of the seventh aspect of the invention, the contact sensor generates a pressure on the surface of the casing of the situation communication device generated by an external contact. It is a thing to measure.

  In addition to the configuration of the invention according to claim 7 or 8, the status communication program of the invention according to claim 9 adds the configuration of the invention according to claim 7 or 8, and when the measurement information determination step determines that the measurement information is the human body information, While the temperature data is specified as “body temperature”, when it is determined that the measurement information is the environmental information, the temperature data is specified as “air temperature”.

  In addition to the configuration of the invention according to any one of claims 7 to 9, the situation communication program of the invention according to claim 10 determines that the measurement information is the human body information. The brightness data is specified as “darkness due to user's light blocking”, while the brightness data is specified as “darkness of the surrounding environment” when the measurement information is determined to be the environment information It is characterized by doing.

  In the situation communication device of the invention according to claim 1, the human body information or the environment information is measured by the measuring means, and the measurement information or the information based on the measured information is transmitted. It represents a person's situation, and it is determined whether the measurement information measured by the measurement means is human body information or environmental information. Therefore, optimal processing can be executed according to the data attribute of the measurement information measured by the measurement means, and various services such as user emotion estimation and situation communication can be provided accurately and appropriately.

  In addition, in the situation communication device of the invention according to claim 2, in addition to the effect of the invention of claim 1, the measurement information is either human body information or environmental information using a contact sensor, a temperature sensor, and an optical sensor. Determine whether. Therefore, the data attribute of the measurement information can be determined more accurately based on the contact data, temperature data, and brightness data.

  Further, in the situation communication device according to the third aspect of the invention, in addition to the effect of the invention according to the second aspect, the contact sensor measures the pressure on the surface of the casing of the situation communication device. Therefore, it is possible to accurately determine the data attribute of the measurement information based on the pressure data.

  Further, in the situation communication device of the invention according to claim 4, in addition to the effect of the invention according to claim 2 or 3, when the measurement information is human body information, the temperature data is specified as “body temperature”, and the measurement information is If it is environmental information, the temperature data is specified as “temperature”. Therefore, it is possible to execute an optimum process according to the data attribute of the temperature data without mistaking “body temperature” and “air temperature”.

  Further, in the situation communication device of the invention according to claim 5, in addition to the effect of the invention according to any one of claims 2 to 4, when the measurement information is human body information, the brightness data is set to “user's light blocking”. If the measurement information is environment information, the brightness data is specified as “darkness of the surrounding environment”. Therefore, it is possible to execute optimum processing according to the data attribute of the brightness data without mistaking “darkness due to light blocking by the user” and “darkness of the surrounding environment”.

  In the situation communication program of the invention according to claim 6, human body information or environmental information is measured by the measuring means, and the measurement information or information based on the measured information is transmitted. The user's situation is expressed, and it is determined whether the measurement information measured by the measuring means is human body information or environmental information. Therefore, optimal processing can be executed according to the data attribute of the measurement information measured by the measurement means, and various services such as user emotion estimation and situation communication can be provided accurately and appropriately.

  In the situation communication program of the invention according to claim 7, in addition to the effect of the invention of claim 6, the measurement information is either human body information or environmental information using a contact sensor, a temperature sensor, and an optical sensor. Determine whether. Therefore, the data attribute of the measurement information can be determined more accurately based on the contact data, temperature data, and brightness data.

  Moreover, in the situation communication program of the invention which concerns on Claim 8, in addition to the effect of the invention of Claim 7, a contact sensor measures the pressure in the housing | casing surface of a situation communication apparatus. Therefore, it is possible to accurately determine the data attribute of the measurement information based on the pressure data.

  Further, in the situation communication program of the invention according to claim 9, in addition to the effect of the invention according to claim 7 or 8, when the measurement information is human body information, the temperature data is specified as “body temperature”, and the measurement information is If it is environmental information, the temperature data is specified as “temperature”. Therefore, it is possible to execute an optimum process according to the data attribute of the temperature data without confusion between “body temperature” and “air temperature”.

  In addition, in the situation communication program of the invention according to claim 10, in addition to the effect of the invention according to any one of claims 7 to 9, when the measurement information is human body information, the brightness data is set to “user's light blocking”. If the measurement information is environment information, the brightness data is specified as “darkness of the surrounding environment”. Therefore, it is possible to execute optimum processing according to the data attribute of the brightness data without mistaking “darkness due to light blocking by the user” and “darkness of the surrounding environment”.

  Hereinafter, a first embodiment of the present invention will be described. First, the overall configuration of a service providing system using the situation communication device 1 of the present invention will be described. FIG. 1 is a system configuration diagram showing a configuration of a service providing system using the status communication device 1 of the present invention.

  As shown in FIG. 1, in the service providing system using the status communication device 1, the service providing server 2 can be connected to the Internet 4. The status communication device 1 can be connected to a base station 3 of a mobile communication network such as a mobile phone network or a PHS phone network, and can be connected to the Internet 4 via the base station 3. In addition, the situation communication device 1 can communicate with each other when the situation communication device 1 exists in the vicinity. The status communication device 1 can be connected to a personal computer (hereinafter referred to as a PC) 5 using a cable. The status communication device 1 can take in data from the PC 5 and send data to the PC 5. Can be connected to.

  The service providing server 2 is a well-known server terminal including various storage means such as a CPU, RAM, ROM, and hard disk device for controlling, and a communication device for connecting to the Internet 4. Well-known personal computer equipped with various storage means such as CPU, RAM, ROM, hard disk, etc., a communication device for connecting to the Internet 4, a keyboard and mouse for inputting, a display for displaying a screen, etc. It is a computer. The service providing server 2 stores a plurality of contents to be provided to the status communication device 1 in advance, as will be described later.

  Next, the situation communication device 1 will be described. FIG. 2 is a cross-sectional view of the status communication device 1. FIG. 3 is a block diagram showing an electrical configuration of the status communication device 1.

  As shown in FIG. 2, the status communication device 1 is a sphere, and the size is a portable terminal that fits in the palm of a person. The casing of the situation communication device 1 is formed in a spherical shape with a transparent synthetic resin having a thickness of several mm (for example, 5 mm), and a spherical sealed space is formed in the inside. In addition, a circular plate-like substrate 200 arranged in a plane parallel to the installation surface at the lower end of the casing of the status communication device 1 and passing through the center of the casing is provided inside the casing. Various sensors 11 to 19 and the control unit 100 are arranged on the upper side of the substrate 200, and various actuators 21 to 26 are arranged on the lower side of the substrate 200. In order to facilitate understanding, only the bending sensor 11, the acceleration sensor 12, the temperature sensor 13, the optical sensor 15, the pressure sensor 16, and the humidity sensor 17 among the various sensors 11 to 19 are illustrated, and various actuators are illustrated. Of 21 to 26, only the LED 21, the motor 23, and the speaker 25 are illustrated.

  As shown in FIG. 3, in the case communication device 1, the CPU 10, ROM 20, and RAM 30 that control the situation communication device 1, the time measuring device 40 that measures time, and other situation communication devices 1 are used for transmission and reception. And a control unit 100 in which a communication unit 60 for communicating with a base station of a wireless communication network, an I / O interface 70 for connecting various sensors, and the like are housed. In the control unit 100, the ROM 20, RAM 30, timing device 40, transmission / reception unit 50, communication unit 60, and I / O interface 70 are connected to the CPU 10 via the bus 80. Although not shown, the status communication device 1 is powered by a battery. The ROM 20 stores a status communication program for executing a main process (FIG. 4) described later. The RAM 30 is provided with a storage area (measurement value storage area) for information detected (measured) by the various sensors 11 to 19, which will be described in detail later.

  Further, a USB port 75 for connecting to the PC 5 and an expansion port 90 for inserting various modules (various sensors and various actuators) are provided on the surface of the status communication device 1. In the example shown in FIG. 3, the expansion port 90 includes a bending sensor (strain sensor) 11, an acceleration sensor 12, a temperature sensor 13, a heart rate sensor 14, an optical sensor 15, a pressure sensor 16, a humidity sensor 17, a sweat sensor 18, A microphone 19, LED 21, flash lamp 22, motor 23, heater 24, speaker 25, and 7 segment LED 26 are connected.

  In addition, the bending sensor 11 measures the degree of distortion of the surface of the status communication device 1 using a strain gauge. The acceleration sensor 12 is an acceleration sensor that uses a change in capacitance, piezoelectric ceramic, or the like, and measures the movement of the situation communication device 1 (acceleration applied to the situation communication device 1 and its direction). The temperature sensor 13 is a so-called thermometer using a platinum resistance thermometer, thermistor, thermocouple, and the like, and measures the temperature around the status communication device 1 and the temperature of the palm or finger touching the device. The heart rate sensor 14 is a so-called pressure sensor, and is provided on the surface of the situation communication device 1. Then, the blood pressure (pulse rate) is measured by measuring the blood pressure. In addition, a so-called infrared sensor may be provided to detect a difference in distance due to blood expansion and contraction to measure the heart rate (pulse rate) of the person touching. The optical sensor 15 is a sensor that measures the intensity of light using a phototransistor, CdS, or the like, and is provided on the surface of the status communication device 1.

The pressure-sensitive sensor 16 is a so-called contact sensor, and is provided on the surface of the status communication device 1, and by connecting a constant resistance to the conductive rubber in series and applying a certain voltage to measure the partial pressure value of the conductive rubber. The pressure applied to the status communication device 1 is measured. The humidity sensor 17 is provided on the surface of the situation communication device 1 and measures the amount of moisture in the air around the situation communication device 1 using ceramics or polymer. The perspiration sensor 18 is a small humidity sensor, and is provided on the surface of the status communication device 1, and measures the amount of sweat on the surface of what is touched by measuring the amount of moisture evaporated. The unit of the sweat sensor 18 is mg / cm ² / min, and the amount of sweat measured at 1 cm ² per minute is measured. The microphone 19 inputs sound around the situation communication device 1 such as voice. The LED 21 lights up with various colors and brightness. The flash lamp 22 emits light with various intensities. The motor 23 vibrates the status communication device 1. The heater 24 heats the surface of the status communication device 1 at a low temperature (a temperature at which the user feels warm and does not burn). The speaker 25 outputs sound. The 7-segment LED can display a single digit.

  The status communication device 1 is not provided with a keyboard like a personal computer. Therefore, information detected by the various sensors 11 to 19 of the situation communication device 1 is registered in advance as an instruction input for instructing a predetermined operation, and the user grasps the situation communication device 1 and performs a gesture (was a predetermined number of times, holds it, etc. The operation is instructed.

  Here, a process (service) that can be executed by the status communication device 1 in the service providing system of the present embodiment will be briefly described. In the following, three examples of “gesture processing”, “mode-specific processing”, and “reception processing” executed by the status communication device 1 will be exemplified as main processing (services).

  First, “gesture processing” is processing for designating the status communication apparatus 1 as a service that the user wants to receive. Here, referring to various measurement values stored in the measurement value storage area (not shown) of the RAM 30, when the value indicates a predetermined gesture, for example, a process instructed by the gesture, for example, Mode setting, speaker volume setting, and the like are performed. That is, the user performs mode switching, volume setting, and the like by performing a pre-registered gesture.

  Here, the RAM 30 is provided with a mode storage area (not shown) for storing the implemented mode. Here, there are seven flags: an operation mode flag, an inference mode <emotion> flag, an inference mode <atmosphere> flag, an inference mode <environment> flag, an inference mode <message> flag, a content service mode flag, and a communication target designation mode flag “1” is stored in only the flag of the mode being implemented and “ON” is stored, and “0” is stored in the other flags and is “OFF”.

  For example, in the “gesture processing”, the measurement value (acceleration data) by the acceleration sensor 12 is referred to, and if it indicates “acceleration twice in the vertical direction”, “volume UP” is executed, If “acceleration four times” is indicated, “content service mode ON” is executed. At the start of the main process (FIG. 4), the mode storage area (not shown) of the RAM 30 is initialized by the initialization process (S1) (for example, “operation mode” is set as the default mode and only the operation mode flag is “ON”. The other mode flags are “OFF”).

  Secondly, the “mode-specific processing” is processing for the status communication device 1 to execute various types of processing according to the mode set in “gesture processing”. In the present embodiment, “operation mode”, “inference mode <emotion>”, “inference mode <atmosphere>”, “inference mode <environment>”, “inference mode <message>”, “content service mode”, “ Seven modes of “communication target designation mode” are provided.

  Specifically, in the “operation mode”, the rule table transmitted from the PC 5 is received and stored in the RAM 30, the rule table is transmitted in response to a request from the PC 5, and other status communication devices 1 are connected. Register a gesture to designate as a communication partner.

  In the “communication target designation mode”, the user designates a communication partner in the following “inference mode” by a gesture. In each “inference mode” of “inference mode <emotion>”, “inference mode <atmosphere>”, “inference mode <environment>”, and “inference mode <message>”, the measurement values of various sensors 11 to 19 are used. The index information indicating the user's situation is determined based on a predetermined rule, and the measurement value and the index information are transmitted to the other party designated in the “communication target designation mode”. The predetermined rule is a table in which index information is determined corresponding to each measurement value, and is stored in the RAM 30 in advance.

  In the “content service mode”, when the user designates the content by the gesture, the measurement values of the various sensors 11 to 19 are transmitted to the service providing server 2 together with the content designation code. And based on the information returned from the service provision server 2, various actuators 21-26 are controlled and a result (content) is expressed.

  Thirdly, the “reception process” is a process in which the situation communication device 1 receives measurement values and index information from other situation communication devices 1, determines control information from the measurement values and index information, and expresses them in an actuator. is there. Here, the various actuators 21 to 26 of the situation communication device 1 are controlled in an expression form determined based on a predetermined rule from each measurement value and index information received from the other situation communication device 1 and used in other ways. The situation of the person (partner) is expressed. The predetermined rule is a table in which the control method of the various actuators 21 to 26 is determined corresponding to each measurement value and index information, and is stored in the RAM 30 in advance.

  Next, the main operation according to the present invention, which is executed in parallel with the above processing (service) in the situation communication device 1, will be described. FIG. 4 is a flowchart of the main process. FIG. 5 is a flowchart showing details of the measurement process (S3). FIG. 6 is a flowchart showing details of the data attribute determination process (S13). The main processing (FIG. 4) of the present embodiment is executed continuously by the CPU 10 of the status communication device 1 when the battery is set in the status communication device 1 and the power is turned on. Is done.

  First, various data and flags are initialized (S1). For example, in the RAM 30, a mode storage area to be described later is initialized, a measurement value storage area is initialized, a count value for counting the number of gestures is cleared, and settings for various sensors 11 to 19 are initialized. Is done. And the measurement process which performs the measurement by the various sensors 11-19 is performed (S3).

  As shown in FIG. 5, in the measurement process (S3), measurement operations are executed by the various sensors 11 to 19, and measurement values are acquired in each of them (S11). And as shown below, the data attribute judgment process (S13) which judges the data attribute of the measured value detected by various sensors 11-19 is performed. In the present embodiment, the case where the data attribute of the measurement value (temperature data) measured by the temperature sensor 13 is determined will be described as an example.

  As shown in FIG. 6, in the data attribute determination process (S13), it is first determined whether or not pressure is detected by the pressure sensor 16 (S21). In S21, based on the measured value (pressure data) by the pressure sensor 16, it is determined whether or not external pressure is applied to the pressure sensor 16 provided on the surface of the status communication device 1. When pressure is detected by the pressure sensor 16 (S21: YES), it is determined whether light is detected by the optical sensor 15 (S23). In S23, based on the measurement value (brightness data) by the optical sensor 15, it is determined whether or not the optical sensor 15 provided on the surface of the status communication device 1 is irradiated with light.

  And when light is not detected by the optical sensor 15 (S23: NO), it can be considered that the user is holding the status communication apparatus 1 and the user is in a state where light irradiation is blocked. it can. Therefore, since it can be considered that the user is using the situation communication device 1, the temperature data is specified as “human body information” regarding the user (S25). That is, it is specified as the “body temperature” of the user.

  On the other hand, when no pressure is detected by the pressure sensor 16 (S21: NO) or when light is detected by the optical sensor 15 (S23: YES), the user does not hold the status communication device 1. It can be considered that light from the surrounding environment is being detected. Therefore, since it can be considered that the user is not using the status communication device 1, the temperature data is specified as “environment information” regarding the surrounding environment of the status communication device 1 (S27). That is, it is specified as “temperature” around the situation communication device 1.

  As described above, when the data attribute is specified as the temperature data is “human body information” or “environment information” (S25, S27), the data attribute determination process (FIG. 6) is ended.

  Returning to the measurement process (FIG. 5), the measurement values acquired by the various sensors 11 to 19 are written in the measurement value storage area (not shown) of the RAM 30 (S15). In the present embodiment, the measurement value storage area of the RAM 30 is divided into a human body information storage area (not shown) for storing “human body information” and an environment information storage area (not shown) for storing “environment information”. It is provided and various measurement values are written in an area corresponding to the data attribute. For example, if the temperature data whose data attribute is specified in the data attribute determination process (S13) is “body temperature”, it is stored in the human body information storage area, and if it is “temperature”, it is stored in the environment information storage area. . As a result, the latest various measured values are stored in the measured value storage area of the RAM 30 according to the data attributes. Thereafter, the process returns to the main process.

  Returning to the main processing (FIG. 4), in the following processing (S5 to S9), various services are provided to the user of the status communication device 1 based on various measurement values stored in the measurement value storage area of the RAM 30. Provided. The outline will be described below.

  First, it is determined whether or not the various measurement values acquired in the measurement process (S3) are specified as “human body information” (S5). In S5, with reference to the data types of various measurement values stored in the measurement value storage area of the RAM 30, it is determined whether it is “human body information” or “environment information”. In the present embodiment, if the temperature data acquired in S11 is “body temperature” (S5: YES), a process in the case of specifying “human body information” is executed (S7). On the other hand, if the temperature data acquired in S11 is “air temperature” (S5: NO), processing in the case of specifying “environment information” is executed (S9).

  Here, the process executed in S7 or S9 differs depending on the mode set in the mode storage area (not shown) of the RAM 30 in the above-described “gesture process”. For example, if “inference mode <emotion>” is set, in S7, the emotion of the user is inferred based on “temperature” and the index information is determined. On the other hand, if “inference mode <environment>” is set, in S9, the surrounding environment of the status communication device 1 is inferred based on “temperature”, and the index information is determined. If the “content service mode” is set, the optimum content is executed according to “temperature” in S7, while the optimum content is executed according to “temperature” in S9.

  As described above, in the present embodiment, human body information and environmental information are stored separately in the measurement value storage area (not shown) of the RAM 30, and optimum processing is executed according to the data types of various measurement values. become. For example, in each “inference mode”, the index information can be accurately determined without mistaking “temperature” and “body temperature”.

  As described above, according to the situation communication device 1 according to the first embodiment, the measurement values and index information of the various sensors 11 to 19 are transmitted to other terminals, while the measurement values and index information are received from the other terminals. It is determined whether the measured temperature data is human body information (body temperature) or environmental information (air temperature). Therefore, optimal processing according to the data attribute of temperature data can be performed, and various services, such as a user's emotion estimation and situation communication, can be provided correctly and appropriately.

  Further, it is determined using the pressure sensor 16 and the optical sensor 15 whether the temperature data is human body information or environmental information. Therefore, the data attribute of temperature data can be determined more accurately based on pressure data and brightness data.

  Next, a second embodiment of the present invention will be described. The second embodiment is basically the same as the first embodiment, but the details of the data attribute determination process (S13) are different. Only the differences from the first embodiment will be described below. FIG. 7 is a flowchart showing details of the data attribute determination process (S13) in the second embodiment. In the present embodiment, a case where the data attribute of the measurement value (brightness data) by the optical sensor 15 and the measurement value (acceleration data) by the acceleration sensor 12 are determined will be described as an example.

  As shown in FIG. 7, in the data attribute determination process (S13) of the present embodiment, first, whether or not the pressure is detected by the pressure sensor 16 as in S21 (FIG. 6) of the first embodiment. It is determined (S31). When the pressure is detected by the pressure sensor 16 (S31: YES), it is determined whether or not the temperature detected by the temperature sensor 13 is 30 to 38 ° C. (S33). In S33, based on the measured value (temperature data) by the temperature sensor 13, it is determined whether or not the temperature on the surface of the status communication device 1 is within a range of 30 to 38 ° C.

  When the detected temperature is 30 to 38 ° C. (S33: YES), it can be considered that the user is holding the status communication device 1 and the body temperature of the user is being detected. Therefore, since it can be considered that the user is using the status communication device 1, the brightness data and the acceleration data are specified as “human body information” as in S25 (S35). That is, the brightness data is specified as “darkness due to light blocking by the user” indicating the ratio, area, position, etc. of the user covering the status communication device 1. Further, the acceleration data is specified as “acceleration caused by the user's operation”, which is an acceleration generated when the user moves the situation communication device 1.

  On the other hand, when pressure is not detected by the pressure sensor 16 (S31: NO) or when a temperature other than 30 to 38 ° C. is detected by the temperature sensor 13 (S33: NO), the user turns the status communication device 1 on. It can be considered that the temperature of the surrounding environment is detected without being grasped. Therefore, since it can be considered that the user is not using the status communication device 1, the brightness data and the acceleration data are specified as “environment information” as in S27 (S37). That is, the brightness data is specified as “darkness of the surrounding environment” indicating the light intensity in the surrounding environment of the situation communication device 1. Further, the acceleration data is specified as “acceleration due to other influences” that are accelerations generated by the situation communication apparatus 1 moving due to influences other than the user (for example, wind pressure, inclination, etc.).

  As described above, when the brightness attribute and the acceleration data are identified as “human body information” or “environment information” (S35, S37), the data attribute determination process (FIG. 7) is terminated. In S15 of the measurement process (FIG. 5), “darkness due to user's light blocking” and “acceleration due to user's operation” are stored in the human body information storage area, and “darkness of surrounding environment” and “others” "Acceleration due to the influence of" is stored in the environmental information storage area.

  As described above, according to the situation communication device 1 according to the second embodiment, the pressure sensor 16 and the temperature sensor 13 are used to determine whether the brightness data and the acceleration data are human body information or environmental information. The Therefore, the data attributes of the brightness data and the acceleration data can be more accurately determined based on the pressure data and the temperature data.

  In the case of human body information, the brightness data is specified as “darkness due to user's light blocking”, and the acceleration data is specified as “acceleration due to user's operation”, whereas in the case of environment information, the brightness data is specified as brightness. The data is specified as “darkness of the surrounding environment”, and the acceleration data is specified as “acceleration due to other influences”. Therefore, optimal processing according to the data attributes of the brightness data and the acceleration data can be executed without mistaking the data attributes.

  Next, a third embodiment of the present invention will be described. The third embodiment is basically the same as the first and second embodiments, but the details of the data attribute determination process (S13) are different. Only differences from the first and second embodiments will be described below. FIG. 8 is a flowchart showing details of the data attribute determination process (S13) in the third embodiment. In the present embodiment, a case will be described in which the data attributes are determined for all the measurement values detected by the various sensors 11 to 19.

  As shown in FIG. 8, in the data attribute determination process (S13) of the present embodiment, as in S21 (FIG. 6), it is first determined whether or not pressure is detected by the pressure sensor 16 (S41). When the pressure is detected by the pressure sensor 16 (S41: YES), it is determined whether or not light is detected by the optical sensor 15 as in S23 (FIG. 6) (S43). When light is detected by the optical sensor 15 (S43: YES), it is determined whether or not the temperature detected by the temperature sensor 13 is 30 to 38 ° C. as in S33 (FIG. 7) (S45). ).

  When no light is detected by the optical sensor 15 (S43: NO) or when the temperature detected by the temperature sensor 13 is 30 to 38 ° C. (S45: YES), S25 (FIG. 6) and S35 (FIG. Similarly to 7), each measurement value detected by the various sensors 11 to 19 is specified as “human body information” (S47). For example, the temperature data is specified as “body temperature”, the brightness data as “darkness due to user's light blocking”, and the acceleration data as “acceleration due to user's operation”.

  On the other hand, when no pressure is detected by the pressure sensor 16 (S41: NO), or when the temperature detected by the temperature sensor 13 is other than 30 to 38 ° C. (S45: NO), S27 (FIG. 6) and S37. Similarly to (FIG. 7), each measured value detected by the various sensors 11 to 19 is specified as “environment information” (S49). For example, the temperature data is specified as “temperature”, the brightness data as “darkness of the surrounding environment”, and the acceleration data as “acceleration due to other influences”.

  As described above, when the data attribute is specified as the “human body information” or the “environment information” as the temperature data, brightness data, and acceleration data (S47, S49), the data attribute determination process (FIG. 8) ends. In S15 of the measurement process (FIG. 5), each measurement value identified as “human body information” is stored in the human body information storage area, and each measurement value identified as “environment information” is stored in the environment information. Stored in the storage area.

  As described above, according to the situation communication device 1 according to the third embodiment, the measured values of the various sensors 11 to 19 are either human body information or environmental information using the pressure sensor 16, the optical sensor 15, and the temperature sensor 13. Is determined. Therefore, based on the pressure data, the brightness data, and the temperature data, the data attributes of the measurement values of the various sensors 11 to 19 can be determined more accurately.

  By the way, the bending sensor (distortion sensor) 11, the acceleration sensor 12, the temperature sensor 13, the heart rate sensor 14, the optical sensor 15, the pressure sensor 16, the humidity sensor 17, the perspiration sensor 18, and the microphone 19 of the above embodiment are included in the present invention. The LED 21, the flash lamp 22, the motor 23, the heater 24, the speaker 25, and the 7-segment LED 26 correspond to “situation expressing means” of the present invention. The transmission / reception unit 50 and the communication unit 60 correspond to the “transmission unit” and “reception unit” of the present invention. The CPU 10 that performs S5 to S9 of the main process (FIG. 4) corresponds to the “situation expression control means” of the present invention, and the CPU 10 that performs the data attribute determination process (FIGS. 6 to 8) of the present invention. This corresponds to “measurement information determination means”.

  Moreover, the measurement process (FIG. 5) of S3 corresponds to the “measurement step” of the present invention. The gesture process (S5), the mode-specific process (S7), and the reception process (S9) correspond to the “situation expression step”, “transmission step”, “reception step”, and “situation expression control step” of the present invention. The data attribute determination process (FIGS. 6 to 8) in S13 corresponds to the “measurement information determination step” of the present invention.

  It should be noted that the situation communication device and the situation communication program of the present invention are not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present invention.

  In the above embodiment, the situation communication device 1 is a sphere that fits in the palm of the hand, but the shape of the situation communication device 1 is not limited to this. In the above embodiment, as the “measuring means”, the bending sensor 11, acceleration sensor 12, temperature sensor 13, heart rate sensor 14, optical sensor 15, pressure sensor 16, humidity sensor 17, sweat sensor 18, and microphone 19 are used. Although it is used, the types of “measuring means” are not limited to these. Impact sensors, body temperature sensors, body fat sensors, blood pressure sensors, sensors for measuring skin stains, sensors for measuring oxygen concentration in the atmosphere, air Various measuring means such as a sensor for measuring the carbon dioxide concentration in the inside may be used. Further, although the LED 21, flash lamp 22, motor 23, heater 24, speaker 25, and 7-segment LED 26 are used as “situation expression means”, the type of “situation presentation means” is not limited to this, but a liquid crystal panel or the like. A small screen or the like may be used.

  In the above embodiment, the data attribute of each measurement value is determined as “human body information” or “environment information” based on temperature data, brightness data, and acceleration data. Data attributes may be determined using data, bending data, audio data, and the like.

  Furthermore, in the said embodiment, when pressure (contact) is not detected by the pressure sensor 16 (contact sensor), it determines with it being "environment information" (S21: NO, S31: NO, S41). : NO), “human body information” or “environment information” may be specified by other methods. That is, regarding the various sensors 11 to 19, it is possible to determine “human body information” or “environment information” using various elements such as the detection positions, the number, and the contents of measurement values.

  For example, in the pressure sensor 16 (contact sensor), if contact or point contact of the casing's own weight is detected, specify “environment information”, and if surface contact or multiple contacts are detected, specify “human body information”. May be. Further, in the situation communication device 1, a foot for placing the casing on another object is provided, and the pressure-sensitive sensor 16 is disposed at a position where no contact is made in the placed state. A plurality of pressure sensors 16 may be arranged so that the size of both hands can be discriminated, or “contact information” may be specified when contact is detected in the upper hemisphere of the housing.

  In the first embodiment, the data attribute of the temperature data is determined by the pressure sensor and the optical sensor. In the second embodiment, the data attribute of the brightness data and the acceleration data is determined by the pressure sensor and the temperature sensor. In the third embodiment, the case where the data attributes of all measured values are determined by a pressure sensor, an optical sensor, and a temperature sensor is illustrated. However, whether the data attribute of each measurement value is determined based on the measurement value by which measurement means may be arbitrarily set by the designer or the user according to the application or purpose.

  Moreover, in the said embodiment, in each "inference mode", it illustrated that index information could be determined correctly, without mistaking "air temperature" and "body temperature". However, in each “inference mode”, other measurement values can be distinguished and used by data attributes. In other modes as well, each measurement value is distinguished by data attributes according to the purpose of each mode. Available.

  Further, not only “mode-specific processing” but also “gesture processing” can be used by distinguishing each measurement value by a data attribute. For example, in the acceleration data from the acceleration sensor 12, only “acceleration by user's operation” is referred, and if it indicates “acceleration twice in the vertical direction”, “volume UP” is executed, If “acceleration four times” is indicated in the direction, “content service mode ON” may be executed.

  In the above embodiment, the measurement value storage area (not shown) of the RAM 30 is provided with a human body information storage area (not shown) and an environment information storage area (not shown) distinguished for convenience. However, each measurement value may be stored in the same storage area as long as the data attribute of each measurement value can be distinguished.

  The situation communication device and the situation communication program of the present invention can be used for a device that measures human body information about a user and environmental information about a surrounding environment and provides various services to the user.

1 is a system configuration diagram showing a configuration of a service providing system using a status communication device 1 of the present invention. It is sectional drawing of the status communication apparatus. 3 is a block diagram showing an electrical configuration of the status communication device 1. FIG. It is a flowchart of a main process. It is a flowchart which shows the detail of a measurement process (S3). It is a flowchart which shows the detail of a data attribute judgment process (S13). It is a flowchart which shows the detail of the data attribute determination process (S13) in 2nd Embodiment. It is a flowchart which shows the detail of the data attribute judgment process (S13) in 3rd Embodiment.

Explanation of symbols

1 Status Communication Device 10 CPU
11 Bending sensor 12 Acceleration sensor 13 Temperature sensor 14 Heart rate sensor 15 Optical sensor 16 Pressure sensor 17 Humidity sensor 18 Sweating sensor 19 Microphone 20 ROM
21 LED
22 Flash lamp 23 Motor 24 Heater 25 Speaker 26 7 segment LED
30 RAM
100 control unit 200 substrate

Claims (10)

Measuring means for measuring human body information about the user or environmental information about the surrounding environment of the situation communication device;
A situation expression means for expressing a user's situation;
Transmission means for transmitting measurement information measured by the measurement means or information based on the measurement information;
Receiving means for receiving the measurement information or information based on the measurement information;
Situation expression control means for controlling the situation expression means according to the measurement information received by the receiving means or information based on the measurement information;
A situation communication device comprising: measurement information determination means for determining whether the measurement information is the human body information or the environment information based on measurement information measured by the measurement means. The measurement means includes at least one of a contact sensor that measures contact from the outside on the surface of the casing of the situation communication device, a temperature sensor that measures temperature from the outside, and an optical sensor that measures irradiation of light from outside. And
The measurement information determination unit is based on at least one of contact data that is measurement information by the contact sensor, temperature data that is measurement information by the temperature sensor, and brightness data that is measurement information by the optical sensor. 2. The situation communication device according to claim 1, wherein it is determined whether the measurement information measured by the measurement means is the human body information or the environment information.   The situation communication device according to claim 2, wherein the contact sensor is configured to measure a pressure generated on the surface of the casing of the situation communication device, which is generated by an external contact.   When the measurement information determination unit determines that the measurement information is the human body information, the temperature information is specified as “body temperature”, while when the measurement information is determined to be the environment information, the temperature data The status communication device according to claim 2, wherein the status communication device is specified as “temperature”.   When the measurement information determination unit determines that the measurement information is the human body information, the measurement information determination unit specifies the brightness data as “darkness due to light blocking by a user”, while the measurement information is the environment information. 5. The situation communication device according to claim 2, wherein the brightness data is specified as “darkness of the surrounding environment” when it is determined. On the computer,
A measurement step for measuring human body information about the user or environmental information about the surrounding environment of the situation communication device,
A situation expression step for expressing the situation of the user,
A transmission step of transmitting measurement information measured by the measurement step or information based on the measurement information;
Receiving step for receiving the measurement information or information based on the measurement information;
A situation expression control step for controlling the situation expression step according to the measurement information received by the reception step or information based on the measurement information;
A situation communication program for executing a measurement information determination step for determining whether the measurement information is the human body information or the environment information based on the measurement information measured in the measurement step. The measurement step includes at least one of a contact sensor that measures contact from outside on the surface of the casing of the status communication device, a temperature sensor that measures temperature from the outside, and an optical sensor that measures irradiation of light from the outside. By measuring the human body information or the environmental information,
The measurement information determination step is based on at least one of contact data that is measurement information by the contact sensor, temperature data that is measurement information by the temperature sensor, and brightness data that is measurement information by the optical sensor. The situation communication program according to claim 6, wherein it is determined whether the measurement information measured in the measurement step is the human body information or the environment information.   The situation communication program according to claim 7, wherein the contact sensor measures a pressure on the surface of the casing of the situation communication apparatus, which is generated by an external contact.   When the measurement information determination step determines that the measurement information is the human body information, the temperature data is identified as “body temperature”, while when the measurement information is determined to be the environmental information, the temperature data The situation communication program according to claim 7 or 8, characterized in that is specified as "temperature". In the measurement information determination step, when the measurement information is determined to be the human body information, the brightness data is specified as “darkness due to light blocking by a user”, while the measurement information is the environment information. The situation communication program according to claim 7, wherein the brightness data is specified as “darkness of the surrounding environment” when it is determined.

Images