JP5105779B2 - Information selection system - Google Patents

Description

  The present invention relates to a communication system. In particular, measuring the user's state and environment with measuring means that can be worn on the user's body, measuring results by means of communication with the outside, calculation results based on the measurement results, display of the structure configured as software on the system The present invention relates to a communication system for communicating contents and the like.

  In recent years, with the development of PCs and communication infrastructures, the Internet, e-mail, chat, etc. are rapidly expanding, and the number of users is increasing. The lives of users are remarkably improved in character and data transmission and information collection. The Internet, e-mail, chat, and the like are rapidly expanding, and the number of users is increasing (see, for example, Patent Document 1, Patent Document 2, and Patent Document 3).

Japanese Patent Laid-Open No. 2003-248841 JP 2002-233507 A JP 2003-108502 A

  However, all of these technologies are mainly text and data information, and there is no information exchange regarding user behavior, emotion, environment, and the like. In human-human communication, information on user behavior, emotion, environment, etc. is extremely important. This information has a significant impact on the accuracy, effectiveness and efficiency of communication.

  The present invention has been made in view of the above, and an object of the present invention is to provide a communication system capable of making communication more effective and more accurate.

In order to solve the above-described problems and achieve the object, according to the present invention, the action of measuring the movement of each part of the user's body with the measuring means attached to the user's body or carried by the user. At least one of a measuring unit, a biological information measuring unit that measures biological information of the user's body, and an environmental measuring unit that measures the surrounding environment of the user, the behavior measuring unit, and the biological information Measurement result storage means for storing measurement results acquired from at least one of the measurement means and the environment measurement means as measurement result storage information; and at least one of the measurement result storage information stored in the measurement result storage means A calculation means for calculating using the past measurement information consisting of the current measurement information and the current measurement information consisting of at least one of the measurement results, and the calculation result output from the calculation means. And information selection means for selecting information from the predetermined information to be displayed after the time point when the calculation result relating to the current measurement information is output. The past measurement information is obtained by the calculation means. is information which is acquired before the time which is calculated, the current measurement information Ri information der obtained when it is calculated by the calculating means, calculating storing calculation result calculated by said calculation means The information selection unit further includes a result storage unit, and the information selection unit stores the calculation result relating to the past measurement information stored in the calculation result storage unit before displaying the information to the user, and the information to the user. a calculation result for the current measurement information calculated by said calculation means after viewing, based on the information, characterized in you to select information from among the predetermined information It is possible to provide a-option system.

Moreover, according to a preferable aspect of the present invention, the calculation unit further includes a second calculation unit that rewrites a predetermined coefficient used for calculation, and the second calculation unit displays the information to the user. It is desirable to rewrite the coefficient by calculating using the calculation result previously stored in the calculation result storage means and the calculation result calculated by the calculation means after displaying the information to the user. .

  According to a preferred aspect of the present invention, it is desirable that the past measurement information and the current measurement information are obtained from at least one of the behavior measurement means and the biological information measurement means.

Further, according to a preferred aspect of the present invention, the second calculation means calculates using a predetermined coefficient, and the past measurement information before displaying the information to the user, and the information to the user. It is preferable that the predetermined coefficient used for the calculation is rewritten for each user based on the current measurement information after the display.

According to a preferred aspect of the present invention, it is desirable that the past measurement information and the current measurement information are acquired from two or more of the behavior measurement means, the biological information measurement means, and the environment measurement means. .
Moreover, according to a preferable aspect of the present invention, it is desirable that the past measurement information and the current measurement information are acquired from the behavior measurement unit and the environment measurement unit.
Moreover, according to a preferable aspect of the present invention, it is desirable that the past measurement information and the current measurement information are acquired from the environment measurement unit and the biological information measurement unit.
Moreover, according to a preferable aspect of the present invention, it is desirable that the calculating means calculates using the past measurement information and the current measurement information.
Further, according to a preferred aspect of the present invention, the information selection means displays from among the predetermined information based on the attribute relating to the measurement result used for the calculation result and the attribute of the predetermined information. It is desirable to select information.
Further, according to a preferred aspect of the present invention, the attribute includes information on coordinates with the plurality of numerical values as axes, and the information selection means outputs the output within a predetermined range of the coordinates related to the predetermined information. When a value is included, it is desirable to select it as information to be displayed.
Moreover, according to a preferable aspect of the present invention, it is desirable to further include display means for displaying a structure to the user based on information selected by the information selection means.
Moreover, according to a preferable aspect of the present invention, it is desirable that the display means displays the structure by changing the content of the structure according to the relationship between the user who discloses the structure and the user.
According to a preferred aspect of the present invention, the measurement result storage unit is configured to measure the measurement result from at least one of the behavior measurement unit, the biological information measurement unit, and the environment measurement unit, and the measurement result. It is desirable to store the date and time information that has been recorded together.
Moreover, according to the preferable aspect of this invention, it further has a 2nd memory | storage means,
The second storage unit preferably stores the calculation result calculated by the calculation unit together with the calculated date and time.
Further, according to a preferred aspect of the present invention, the apparatus further comprises third storage means, and the third storage means changes based on the output of the calculation means of the structure displayed by the display means. It is desirable to store the display contents and date / time information when the measurement result is measured.
Further, according to a preferred aspect of the present invention, it is desirable to further include a communication means for communicating with the information storage means in which the predetermined information is stored.
Moreover, according to a preferable aspect of the present invention, it is desirable to further include an information storage unit in which the predetermined information is stored.

  According to the present invention, it is possible to provide a communication system capable of making communication more effective and more accurate.

Embodiments of a communication system (information selection system) according to the present invention will be described below in detail with reference to the drawings. Note that the present invention is not limited to the embodiments.

  Embodiments of an information display system having a communication system according to the present invention will be described below in detail with reference to the drawings. Note that the present invention is not limited to the embodiments.

  FIG. 1 shows a schematic configuration of an information display system having a communication system according to an embodiment of the present invention. The information display system includes various sensor groups worn by a user U, an information display unit 102, and a mobile computer 101. FIG. 2 shows functional blocks of the information display system 100.

  First, a device and a sensor group worn by the user U will be described. The user U includes an indoor / outdoor sensor 110, a GPS (Global Positioning System) 111, a foot pressure sensor 112, a speech / mastication / specific environmental sound sensor 113, a wristwatch-type motion measurement sensor 114, a heart rate Number sensor 115, body temperature sensor 116, peripheral skin temperature sensor 117, sweat sensor 118, facial color sensor 119, pupil size sensor 120, ambient temperature sensor 121, ambient humidity sensor 122, and ambient light intensity sensor 123 are worn on the body. .

  These sensors are hereinafter referred to as “sensor 110 etc.” as appropriate. The sensor 110 and the like correspond to behavior measuring means, biological information measuring means, and environment measuring means. The user U wears the information display unit 102 in the vicinity of one eye of the head. Next, various sensors will be described.

(Indoor / outdoor sensor)
The indoor / outdoor sensor 110 detects and determines whether the user U exists indoors or outdoors. The indoor / outdoor sensor 110 includes an irradiation unit, a reception unit, and a determination unit. For example, the irradiating unit irradiates ultrasonic waves toward the object to be reflected and the ceiling, and determines and measures the time until the light is reflected and returned. The indoor / outdoor sensor 110 is not limited to ultrasonic waves, and may use the following method.
(1) Active light method (application of general distance sensors) that detects reflection by irradiating laser or infrared light.
(2) Passive UV method for detecting light in the UV region (utilizing different amounts of UV light indoors and outdoors),
(3) Passive infrared method (utilizing the difference in temperature between the ceiling and the sky) that measures the upward space temperature (the amount of infrared rays from clouds, etc.) with a pyroelectric sensor,
(4) A passive noise method in which noise is measured with a microphone (utilizing that the noise spectrum pattern is different indoors and outdoors).

(GPS)
User U wears GPS 111 on his body. The location of the user U can be detected by the GPS 111. Further, a location information service of a mobile phone can be used instead of the GPS 111.

(Foot pressure sensor)
The foot pressure sensor 112 detects the pressure distribution of the sole applied to the shoes worn by the user U. The foot pressure sensor 112 measures and determines the standing state, the sitting state, and the walking state of the user U.

(Speech / mastication / specific environmental sound sensor)
The utterance / mastication / specific environmental sound sensor 113 measures the possibility that the user U is speaking, that is, talking, or chewing, ie, eating. Further, the possibility of where the user U is in a plurality of previously registered environments is measured. The utterance / mastication / specific environmental sound sensor 113 is an earphone sensor that is worn on one ear of the user U. A bone conduction microphone and an external sound microphone are built in one housing of the earphone type sensor.

  The bone conduction microphone detects body sounds. The body sound is vibration that is generated from the body and propagates through the body when the user U speaks and chews. Specific examples of body sounds are vocal cord vibration, the sound of teeth biting food, the sound of food passing through the throat, the sound of movement of the chin joint, and the like. The external sound microphone detects external sound in the environment where the user is present. In addition to environmental noise, the external sound includes vibration that propagates outside the body in response to the voice of the user U, that is, sound.

When the power in the first unit time T ₁ (for example, 100 ms) of the sound captured by the bone conduction microphone and the external sound microphone is P ₁ and P ₂ , respectively, P ₁ is larger than the first threshold C ₁ , and, the P ₂ when the second is smaller than the threshold value C ₂ is assumed that detected the sound associated with chewing, adds the mastication detection number N _1. Then, by using the mastication detection rate (N ₁ × T ₁ / T ₂ ) in the second unit time T ₂ (for example, _{2 s} ) as a measurement value, this measurement value is the possibility of mastication in the second unit time T ₂ . Can be shown.
Similarly, when P ₁ is larger than the third threshold C ₃ and P ₂ is larger than the fourth threshold C ₄ , it is assumed that the sound accompanying the utterance is detected, and the utterance detection number N ₂ is added. To do. Then, by using the mastication detection rate (N ₂ × T ₁ / T ₂ ) in the second unit time T ₂ (for example, _{2 s} ) as a measurement value, this measurement value can be uttered in the second unit time T ₂ . Can be shown.
Furthermore, the environment surrounding the user U can be estimated to some extent by analyzing the level and frequency of the sound captured by the external sound microphone. For example, the level fluctuation pattern and frequency distribution of noise captured by an external sound microphone in a train, bus, or airplane were measured in advance, and the external sound microphone actually worn by the user U was captured. By comparing the sound with the previously measured fluctuation and frequency distribution, it is possible to estimate which vehicle the user is in. For example, the correlation coefficient with the noise in the airplane is used as the measured value. Then you can show the possibility of being in an airplane.

(Arm-mounted motion measurement sensor)
The arm-mounted motion measurement sensor 114 (hereinafter referred to as “motion measurement sensor” as appropriate) detects the movement of the user U's arm. The motion measurement sensor 114 includes an acceleration sensor and an angular velocity sensor. Then, it is possible to more accurately identify the daily action and walking state of the user U together with the detection result of the foot pressure sensor 112 described above. Examples of the method of wearing on the arm include a wristwatch type or a type attached to the arm.

(Heart rate sensor)
A heart rate measurement sensor 115 is attached to a finger or ear and measures changes in blood flow associated with pulsation by changes in infrared light transmittance and reflectance.

(Body temperature sensor)
The body temperature sensor 116 measures body temperature using, for example, a thermistor, a radiation thermometer, or a temperature sensor using a thermocouple.

(Erase skin temperature sensor)
The peripheral skin temperature sensor 117 measures the peripheral skin temperature using, for example, a thermistor, a radiation thermometer, or a thermocouple temperature sensor.

(Sweating sensor)
The perspiration sensor 118 measures the perspiration of the skin by, for example, a change in the surface resistance of the skin.

(Face color sensor)
The face color sensor 119, for example, arranges an optical sensor near the face, and measures the light intensity after passing through a plurality of optical bandpass filters.

(Pupil size sensor)
The pupil size sensor 120, for example, installs a camera near the pupil, analyzes a signal from the camera, and measures the size of the pupil.

(Ambient temperature sensor)
The ambient temperature sensor 121 measures the ambient temperature using, for example, a thermistor, a radiation thermometer, or a temperature sensor using a thermocouple.

(Ambient humidity sensor)
For example, the ambient humidity sensor 122 is measured by a humidity sensor using a sensor whose electrical resistance changes depending on humidity.

(Ambient light intensity sensor)
The ambient light intensity sensor 123 measures the ambient light intensity using, for example, a sensor using a photoelectric element.

(Information display section)
The user U wears on the head an information display unit 102 that displays information to be described later. The information display unit 102 is, for example, a small and lightweight display unit worn on the head. However, the information display unit 102 is not limited to this, and may be configured by a device that presents information by any means such as a headphone or a vibrator. Good.

(Mobile computer)
Next, the mobile computer 101 will be described. The mobile computer 101 has five functions. The first function is to collect information from each sensor 110 described above. The second function is to calculate based on the measurement results of each sensor 110 and the like. The third function is a function for fetching information from the display information database 208 described later based on the calculation result. The fourth function is a function for transferring the captured information to the information display unit 102. The fifth function is a function of communicating (communication) with the outside to acquire information. The mobile computer 101 may be anything as long as it has the above five functions, and may use a portable device such as a mobile phone or a portable audio player.

(Sensor information aggregation function)
The outputs of the sensors 110 and the like used in the present invention are generally analog outputs. In this state, it is difficult for the mobile computer 101 to process. For this reason, it is desirable to add an analog / digital conversion function to the sensor.

  In FIG. 2, the behavior measuring unit 201 includes a GPS 111, a foot pressure sensor 112, an utterance / mastication / specific environment sound sensor 113, a wristwatch-type motion measurement sensor 114, and an utterance / mastication sensor 113. In addition, it is desirable that the behavior measurement unit 201 includes at least one of the arm movement, the leg movement, the head movement, the voice, and the body sound of the user U.

  In addition, it is desirable that the behavior measurement unit 201 captures user's scheduled behavior data stored in advance as measurement data.

  In addition, it is desirable that the behavior measurement unit 201 captures past data of measurement results obtained by the environment measurement unit 203 that measures the user's surrounding environment as data at the time of calculation.

  The biological information measuring unit 202 includes a heart rate sensor 115, a body temperature sensor 116, a peripheral skin temperature sensor 117, a sweat sensor 118, a face color sensor 119, and a pupil size sensor 120.

  The environment measurement unit 203 includes an ambient temperature sensor 121, an ambient humidity sensor 122, and an ambient light intensity sensor 123.

  Each sensor 110 and the like further includes a communication unit 211 that communicates (communicates) with the mobile computer 101 wirelessly. The communication unit 211 has a transmission / reception function. Wireless communication between each sensor 110 or the like and the mobile computer 101 can be performed by multiplex communication by any one of time division, frequency division, or spectrospreading. Further, the external communication unit 212 has a function of communicating with an external device different from the mobile computer 101.

  Next, a processing procedure in the present embodiment will be described. FIG. 3 is a flowchart showing the flow of processing.

  In step S301, the calculation unit 205 captures measurement results from the sensors 110 and the like. In step S302, the captured measurement result is converted from an analog output to a digital output. As described above, each sensor 110 or the like may have an analog / digital conversion function.

  In step S304, the calculation unit 205 performs a calculation according to a procedure described later. Calculation results are stored in the calculation result storage unit 213, and measurement results are stored in the measurement result storage unit 204. In steps S303, S305, and S306, individualized calculations can be performed on the user U using current and / or past calculation results and measurement results. Details of such calculation for personalization will be described later.

  In step S307, the second storage unit 214 stores the calculation result calculated by the calculation unit 205 together with the calculated date and time. The content stored in this manner is communicated to an external device by the external communication unit 212 in step S312.

  In step S308, the information selection circuit 209 extracts information from the display information database 208 according to a procedure described later based on the calculation result. In step S309, a structure to be displayed by software is created using a drawing engine. The software construct is, for example, an avatar displayed on the display unit 210. In step S310, the display unit 210 displays a structure that is predetermined information.

  In step S311, the third storage unit 216 stores the structure displayed by the display unit 210, for example, the display content changed based on the output of the avatar calculation unit 205, and the date / time information when the measurement result was measured. To do.

  In step S <b> 312, the external communication unit 212 determines part or all of the measurement results and / or part or all of the measurement result storage information stored in the measurement result storage unit 204 and / or part of the calculation result or Communicate everything to the outside.

  In addition, the external communication unit 212 measures the display contents that are stored in the third storage unit 216 and displayed on the display unit 210, for example, the display content changed based on the output of the avatar calculation unit 205, and the measurement result. It is also possible to communicate the date and time information sent to the outside.

  The content (type) of information transmitted to the outside by the external communication unit 212 is designated by the user's selection. In addition, in the apparatus on the side of receiving the transmitted information, display is performed by a display forming function described later based on the received information.

  When an external device (not shown) receives the display content of the avatar, the received display content is displayed on the external device. Furthermore, as described above, it is also possible to transmit the measurement values of behavior measurement, living body measurement, and environment measurement to the outside using a communication (communication) function with the outside.

(Calculation function)
Next, calculation processing performed by the calculation unit 205 will be described. The calculation unit 205 includes a part or all of measurement values from at least one of the behavior measurement unit 201, the biological information measurement unit 202, and the environment measurement unit 203, and / or measurement results stored in the measurement result storage unit 204. Calculation is performed using some or all of the stored information. This corresponds to steps S303 and S304 in FIG.

Specifically, the calculation unit 205 has a function of multiplying and adding a signal from each digitized sensor 110 or the like. For example, as shown in the following equation (1), a product-sum calculation of the numerical value X _j of the measurement result from each sensor 110 or the like and the coefficient A _ij represented by a two-dimensional matrix (matrix) is performed. Then, the result of product-sum calculation is calculated as an n-dimensional vector Y _i using multidimensional coordinates. Note that i is an i coordinate in an n-dimensional space. In the numerical value X _j , j is a number assigned to each sensor 110 or the like.

(Measurement result)
Part or all of measurement values from at least one of the behavior measurement unit 201, the biological information measurement unit 202, and the environment measurement unit 203, and / or a part of measurement result storage information stored in the measurement result storage unit 204 Or, when all the numerical values are used for calculation, but not all sensors are connected, when an abnormal value appears in a part of the measured value, or when calculating using a part of the measured value , X _j is preferably calculated using a predetermined default value. An abnormality in the measured value is, for example, determined as abnormal when a certain range is specified and the numerical value is out of the range, or abnormal when the temporal change in the time-series measured value exceeds a certain threshold. judge. Alternatively, as another method, a plurality of coefficient matrices for calculation may be prepared in accordance with the type or number of sensors, and calculation may be performed using a coefficient matrix selected according to the type or number of sensors. Various methods can be considered.

(Display information transfer function)
Output from the display information database 208 is transferred to the display unit 210. The display unit 210 displays the information. The displayed time can be indicated by the user U with an input device (not shown) attached to the mobile computer 101.

  At this time, the size of the pupil is measured using the pupil size sensor 120. Then, when the size of the pupil satisfies a predetermined condition set in advance, it is determined that the user has stared. More specifically, the size of the pupil is differentiated, and it is determined that the user has stared when the coefficient exceeds a predetermined size. At this time, the display can be continued. Further, when there is no instruction from an input unit (not shown) attached to the mobile computer 101, and when the predetermined size of the pupil satisfies the set condition, after the preset time has elapsed, the next Display information.

(External communication function)
Next, extraction of information from the display information database 208 will be described. The output of the calculation unit 205 is expressed as multidimensional coordinates as described above. The information selection circuit 209 compares the output coordinates with the attribute coordinates of the information stored in the display information database 208.

  The first method of comparison is as follows. As shown in FIG. 4, when the coordinates of the output calculation result exist within the range of the predetermined width of the coordinates added to the information in the display information database 208, the information is determined as the information to be displayed. And output.

FIG. 4 shows information existing within a predetermined width of coordinates in the vector space. For example, c to d for _{Y 3} axis, the _{Y 5} axis to b, in the range of e~f for _{Y 8} axes, when output operation result is present, the information X is selected. The display unit 210 displays the selected information X.

  The determination of coordinates and the extraction of information are performed at a preset time interval or when the output value of the calculation unit 205 changes more than a predetermined value. FIG. 4 shows only three axes for convenience of illustration. As can be easily seen from FIG. 4, the information X is located in the ranges of ab, cd, and ef of each axis.

  Further, when the output calculation result does not exist within a predetermined range of the vector space, information closest to the calculation result is selected. Here, whether or not it is close to the calculation result is determined by a multidimensional distance between the coordinates of the calculation result and the center coordinates of the area where information exists around the calculation result.

The second method of comparison is as follows. FIG. 5 shows a point P plotted using the multidimensional coordinates output from the calculation unit 205 in the vector space and a point Q plotted using the coordinates of the individual information attributes stored in the information database 208. ₁ , Q ₂ , Q ₃ ... Information attributes have weights in addition to coordinates. Points P and _{Q 1,} Q _{2, Q} 3 Distance _{··· L 1, L 2, L} 3 ··· to divide the multiplication of the weight, preferentially from the information point _{Q i} value is less Are determined and output as information to be displayed.

  Here, priority means that information with high priority is displayed in an earlier order, information is displayed for a longer time than information with low priority, or all information is displayed instead of part of the information. The output is to display a large number of repeated display.

  The determination of coordinates and the extraction of information are performed at a preset time interval or when the output value of the calculation unit 205 changes more than a predetermined value. In FIG. 5, only three axes are shown for convenience of illustration.

  The calculated Y value of the Y coordinate may be a numerical value having no conceptual meaning such as fatigue or busy, but may have a conceptual meaning depending on the setting of the A coefficient. For example, each A coefficient multiplied by the X value of heart rate, sweating, and body temperature is set to a value larger than the A coefficient for other measurement values. The Y value multiplied / added by this increases as the measured values of heart rate, sweating, and body temperature increase, and the Y value represents the so-called “excitability”. And the Y axis can be positioned as excitement. Also, if the A coefficient for the measured value of the speech / mastication / specific environmental sound sensor's speech and mastication and the foot pressure sensor is large, the measured value of the speech / mastication is high, When there is no movement of the foot pressure sensor, the corresponding Y value calculated indicates that the person seems to be sitting and talking. In addition, when the measured values of speech and mastication are low and the measured value of the foot pressure sensor is low, the corresponding Y value calculated is low, and it can be estimated whether the person is thinking quietly or is sleeping. . In this way, by further increasing the types of sensors, each Y value, in other words, the Y-axis can be made to generally correspond to the contents of the user's actions and emotions.

Further, in the present invention for selecting and displaying information specified by the coordinates of the n-dimensional vector Y _i obtained as a result of the arithmetic circuit, the calculated Y coordinate selects the same information as the Y coordinate calculated immediately before. In this sense, the same information can be used as acquired information. Also, a plurality of pieces of information can be stored and associated with the Y coordinate space for selecting the same information, and when the same Y coordinate space is selected, another information can be selected. In this case, an order can be attached to a plurality of pieces of information, and selection can be made according to the order. In this method, it is not always necessary to compare with the immediately preceding information. If the same information is selected within a certain time, the next information can be selected in order.

  Furthermore, the display information database 208 may be provided outside. For example, the display information database 208 in the information display system 100 may not be able to acquire the desired information X. In this case, it is desirable to further acquire information using the external display information database 220.

  At this time, information X is acquired from the external display information database 220 through the external communication unit 212 in the same procedure as described above. Information X is transferred to the mobile computer 101. Then, the display unit 210 displays the information X. At this time, the information is stored in the external display information database 220 with an attribute having a predetermined width in a multidimensional vector space.

In the present embodiment, a second calculation unit 207 can be further provided. The second calculation unit 207, based on the coefficient _{A nm} already obtained, for calculating a new coefficient _{A nm.}

The second arithmetic unit 207 also has a function as a coefficient rewriting unit for rewriting the coefficient stored in the coefficient storage unit 206. By repeating the procedure of the formula (2), the coefficient A _nm is sequentially rewritten. This corresponds to steps S305 and S306 in FIG.

In equation (2), A _{nm on} the right side is the calculation coefficient so far, and A _{nm on} the left side gives a new calculation coefficient. This calculation is an example, and the present invention is not limited to this method.

Further, for example, C _nm can be given as the following equation (3) as a function of the change amount ΔX _i of the measured value X _i .

C _nm = f (ΔX ₁ , ΔX ₂ ,..., ΔX _i ,... ΔX _m ) (3)

Here, the change amount ΔX _i of the measurement value X _i is defined by the change amount between the measurement result and the measurement result storage information.

In other words, the change amount [Delta] X _i of the measured value X _i, expressed a measurement result in a state before giving the information by the information display system to the user U, the state after the given information a difference between a measurement result Yes. This difference corresponds to the degree of influence of this information on the user U. Based on this degree of influence, C _nm varies and is determined.

  In addition, the present invention is not limited to this, and the second calculation unit 207 may perform calculation using a change amount between the calculation result and the calculation result storage information as in the following equation (4). Here, the calculation result storage unit 213 stores the calculation result by the calculation unit 205 as calculation result storage information.

C _nm = f (ΔY ₁ , ΔY ₂ ,..., ΔY _i ,... ΔY _m ) (4)

Further, the calculation may be performed using both ΔX _i and ΔY _i .
C _nm = f (ΔX ₁ , ΔX ₂ ,..., ΔX _i ,... ΔX _m , ΔY ₁ , ΔY ₂ ,..., ΔY _i ,... ΔY _m ) (5)

In other words, the change amount [Delta] Y _i of computation result Y _i, expressed the result of the previous operation state to provide information by the information display system to the user U, the difference between the state calculation result of after giving information Yes. This difference corresponds to the degree of influence of this information on the user U. Based on this degree of influence, C _nm varies and is determined.

  In the above-described calculation, it is desirable to use both the current calculation result and the calculation result recorded in the past situation. Thereby, the change and direction of the situation of the user U can be acquired more accurately. Such calculation makes it possible to display information that is individualized according to each user, for example, “a place where the user U frequently visits”, and information different from other places. That is, even if the state and environment of the user U are exactly the same, necessary information changes depending on whether it is the first time or when it is repeated several times, but this can be dealt with. .

Further, as described above, when the coefficient A _nm is changed, it is desirable to measure a change in behavior of the user U after displaying information on the display unit 210. Accordingly, it can be determined whether or not the user U has reacted to the displayed information.

In addition to rewriting the coefficient A _nm , the calculation result Y in response to the displayed information is also taken into account. Thereby, it can individualize with respect to the user U more correctly.

  In addition, when the information is displayed on the display unit 210, a plurality of information presentation methods can be prepared. The degree of reaction of the user U is determined from the measurement result. Then, it is possible to select which presentation is to be made.

  Here, the way of presenting information is, for example, “let's go to bed early” or “get up early in the morning tomorrow”.

(Displaying the structure)
Next, the display formation of the structure will be described. An information display system 100 including a communication system according to the present invention includes a drawing engine 215 for drawing a structure.

  The drawing engine 215 draws based on the multidimensional numerical value of the calculation result. The drawing engine 208 can use an existing engine. The present invention is not limited by the type and content.

  The display information database 208 stores a structure configured as software on the information display system and a plurality of display information whose movements and expressions are changed. Then, as described above, one or more of the selected multidimensional numerical values (also referred to as multidimensional coordinates) are selected.

  The third storage unit 216 preferably stores the display content changed based on the output of the construction calculation unit 205 displayed by the display unit 210 and the date and time information when the measurement result is measured. Thereby, when the user U sees the structure, for example, an avatar, the user U can remember his / her state of the recorded date and the surrounding scene. For example, an avatar album that can be used like a photo album.

  This example will be described more specifically. For example, when information is exchanged by chat among a plurality of users, the current location, operation / behavioral state, mental state, and environmental state of each other can be exchanged within a range designated by each person.

  In addition, the display contents displayed on the communication system of each user are, for example, the current and / or past location, operation / behavioral state, mental state, and environmental state of each person and other person. Characters, graphs, anthropomorphic displays (constructions configured as software on the system), etc.

  Thereby, the communication between users can be made very efficient, the topic adapted to the situation can be expanded, and the communication such as the sentence adapted to the mental state can be accurately performed.

As another specific example, the present invention can be applied to, for example, home treatment of mental illness. Interviews are the basic treatment for mental illness. For home treatment, communicate with the patient using the phone or the Internet. At this time, it is very difficult for the doctor in charge to check the mental state of the patient, the degree of excitement, the degree of pessimism, the degree of discouragement, etc. by telephone or the Internet.

  Therefore, by applying the present invention, it is possible to transmit the calculation result based on the measurement results of various sensors attached to the patient's body to the doctor. Thereby, the doctor can grasp | ascertain a patient's physical state and mental state. As a result, the present invention is effective for home medical care and counseling for mental disorders.

  As described above, the present invention can take various modifications without departing from the spirit of the present invention.

  As described above, the communication system according to the present invention is useful when performing accurate communication.

It is a figure which shows schematic structure of the information display system which has a communication system which concerns on an Example. It is a figure which shows the functional block of the information display system which has a communication system which concerns on an Example. It is a flowchart which shows the process sequence in an Example. It is a figure which shows the coordinate of the information in vector space. It is another figure which shows the coordinate of the information in vector space.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Information display system which has communication system 101 Mobile computer 102 Information display part 110 Indoor / outdoor sensor 111 GPS
112 Foot pressure sensor 113 Speech / mastication sensor 114 Watch-type motion measurement sensor 115 Heart rate sensor 116 Body temperature sensor 117 Peripheral skin temperature sensor 118 Sweating sensor 119 Facial color sensor 120 Pupil size sensor 121 Ambient temperature sensor 122 Ambient humidity sensor 123 Ambient light intensity Sensor 200 Information display system 201 Behavior measurement unit 202 Biometric information measurement unit 203 Environmental measurement unit 204 Measurement result storage unit 205 Calculation unit 206 Coefficient storage unit 207 Second calculation unit 208 Display information database 209 Information selection circuit 210 Display unit 211 Communication unit 212 External communication unit 213 Calculation result storage unit 214 Second storage unit 215 Drawing engine 216 Third storage unit 220 External display information database U user

Claims (17)

Behavior measurement means for measuring movement of each part of the user's body by measurement means attached to the user's body or carried by the user, and biological information measurement for measuring biological information of the user's body At least one means among means and environment measuring means for measuring the ambient environment of the user;
Measurement result storage means for storing measurement results acquired from at least one of the behavior measurement means, the biological information measurement means, and the environment measurement means as measurement result storage information;
An arithmetic means for calculating using past measurement information consisting of at least one of the measurement result storage information stored in the measurement result storage means and current measurement information consisting of at least one of the measurement results;
Information selection means for selecting information from among the predetermined information to be displayed after the time point when the calculation result relating to the current measurement information is output based on the calculation result output from the calculation means; ,
The past measurement information is information acquired before the time that is calculated by said calculation means, said current measurement information Ri information der obtained when it is calculated by the calculating means,
A calculation result storage means for storing a calculation result calculated by the calculation means;
The information selection means calculates the past measurement information stored in the calculation result storage means before displaying the information to the user, and calculates by the calculation means after displaying the information to the user. It has been said and operation results for the current measurement information, on the basis of the information selection system characterized you to select information from among the predetermined information. The calculation means further has second calculation means for rewriting a predetermined coefficient used for calculation,
The second calculation means includes a calculation result stored in the calculation result storage means before displaying the information to the user, and a calculation calculated by the calculation means after displaying the information to the user. The information selection system according to claim 1, wherein the coefficient is rewritten by calculating using a result. The information selection system according to claim 1, wherein the past measurement information and the current measurement information are acquired from at least one of the behavior measurement unit and the biological information measurement unit. The second calculating means calculates using a predetermined coefficient,
The predetermined coefficient used for calculation for each user based on the past measurement information before displaying the information to the user and the current measurement information after displaying the information to the user The information selection system according to claim 2, wherein the information is rewritten. The past measurement information and the current measurement information are acquired from two or more of the behavior measurement unit, the biological information measurement unit, and the environment measurement unit. The information selection system described in the section. The information selection system according to claim 5, wherein the past measurement information and the current measurement information are acquired from the behavior measurement unit and the environment measurement unit. The information selection system according to claim 5, wherein the past measurement information and the current measurement information are acquired from the environment measurement unit and the biological information measurement unit. The information selection system according to any one of claims 1 to 7, wherein the calculation means calculates using the past measurement information and the current measurement information. The information selection means selects information to be displayed from the predetermined information based on an attribute relating to a measurement result used for the calculation result and an attribute of the predetermined information. The information selection system as described in any one of 1-8. The attribute includes information on coordinates with the plurality of numerical values as axes,
The information selection system according to claim 9, wherein the information selection unit selects the information to be displayed when the output value is included in a predetermined range of the coordinates related to the predetermined information. The information selection system according to any one of claims 1 to 10, further comprising display means for displaying a structure to the user based on information selected by the information selection means. The information selection system according to claim 11, wherein the display unit displays the structure by changing a configuration content of the structure according to a relationship between the user who discloses the structure and the user. The measurement result storage unit stores both the measurement result from at least one of the behavior measurement unit, the biological information measurement unit, and the environment measurement unit, and date / time information on which the measurement result was measured. The information selection system according to any one of claims 1 to 12. Furthermore, it has a second storage means,
The information selection system according to claim 1, wherein the second storage unit stores the calculation result calculated by the calculation unit together with the calculated date and time. Furthermore, it has a third storage means,
The third storage means stores the display content changed based on the output of the calculation means of the structure displayed by the display means, and date information when the measurement result is measured. The information selection system according to claim 11 or 12. 16. The information selection system according to claim 1, further comprising a communication unit that communicates with an information storage unit that stores the predetermined information. The information selection system according to claim 1, further comprising an information storage unit in which the predetermined information is accumulated.

Images