JP2005244375A - Communication apparatus, communication method, communication program, and communication system employing this apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a communication apparatus, a communication method, and a communication program capable of acquiring living body information depending on a communication opposite party and to provide a communication system employing the apparatus. <P>SOLUTION: A user operates an input operation section 11 to activate a control section 10, which controls operations of a wireless communication section 30 and an antenna 31. Thus, the user can make a conversation with the communication opposite party and transmit / receive information with respect to electronic mail to / from the communication opposite party. When the user uses the input operation section 11 of a mobile phone 100 to make operations related to communication to the communication opposite party (speech opposite party) or the user makes a communication with the communication opposite party by using the wireless communication section 30 and the antenna 31, the control section 10 controls a physiological amount data measurement section 20, that is, electrodes 20a, 20d, a thermistor 20b, and a photosensor 20c so as to detect living body information of the user. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a communication device, a communication method, a communication program, and a communication system using the same for transferring various information.

  In recent years, attention has been focused on human psychological state as represented by stress. At the same time, an apparatus has been devised for easily estimating a psychological state and guiding the user's psychological state to a more stable state in accordance with the estimated psychological state.

For example, the stress state is measured based on the skin electrical resistance value, the user's stress level is estimated by transmitting / receiving the measured stress state to / from the center server, and the user is based on the estimated stress level. There has been proposed a portable communication device that presents relaxation information to the user (see, for example, Patent Document 1).
JP 2003-153905 A

  By the way, human psychological state changes in various aspects. In particular, the human psychological state is susceptible to external influences. For example, human beings have different psychological states when talking with others who have disgust and when talking with others who have a favor.

  However, the portable communication device described above cannot measure a stress state that changes depending on the conversation partner.

  In the above portable communication device, it is difficult to receive advice based on a diagnosis result obtained by a conversation with a doctor or other diagnostician.

  Furthermore, it is preferable that the measurement of human biological information is performed so that the user is not conscious of being in the measurement state. However, in the portable communication device described above, the user needs to place a finger on the electrode provided at the lower part of the input means when measuring the skin electrical resistance value. Therefore, the user must be aware that he / she is measuring the skin electrical resistance value.

  An object of the present invention is to provide a communication device, a communication method, a communication program, and a communication system using the same that can acquire biological information that depends on a communication partner.

  Another object of the present invention is to provide a communication system that can easily obtain advice based on a diagnosis result by a conversation with a diagnostician.

  Another object of the present invention is to provide a communication device that can easily detect biological information without the user being aware of it.

  A communication device according to a first aspect of the present invention is a communication device for communicating information, an operation device operated by a user to perform an operation related to communication by the communication device, and detecting biometric information of the user. And the operation of the communication means based on the operation of the operation means, and the detection means is controlled so as to detect the biological information of the user when the operation means is operated by the user or during communication by the communication means. And a control means.

  In the communication apparatus according to the present invention, the operation of the communication means is controlled by the control means based on the operation of the operation means by the user. In addition, when the user performs an operation related to communication with an arbitrary partner using the operation unit of the communication device or when the user performs communication with the other party using the communication unit, the biometric information of the user is stored. The detection means is controlled by the control means so as to be detected. Therefore, it is possible to acquire biometric information that depends on the partner conscious of the user.

  The communication unit may include a call unit that transmits and receives a voice as an audio signal as information, and the control unit may control the detection unit so as to detect the user's biological information when the user calls by the call unit. .

  In this case, the user's biometric information is detected when the user is making a voice call with any other party using the calling means. Thereby, the biometric information depending on the call partner can be acquired.

  The communication apparatus further includes a determining unit that determines when the user speaks by the calling unit, and the control unit controls the detecting unit to detect the user's biological information when the user speaks by the calling unit. Good.

  In this case, the time when the user speaks by the calling means is determined by the determining means, and the biometric information of the user is detected when the user speaks. Thereby, biometric information depending on the other party and the content of the call can be acquired.

  The communication device further includes a determination unit that determines a voice indicating a question from the other party based on the voice signal received by the calling unit, and the control unit is used when the voice indicating the question is determined by the determination unit. The detection means may be controlled so as to detect the biological information of the person.

  In this case, based on the audio signal received by the calling means, the sound indicating the question from the other party is determined by the determining means, and the user's biological information is detected when the sound indicating the question is determined. Thereby, biometric information depending on the other party and the content of the call can be acquired.

  The communication means includes an e-mail communication means for transmitting and receiving an e-mail as a data signal as information, and the operation means includes an e-mail operation unit for performing an operation for creating, transmitting, receiving or browsing an e-mail, The control means may control the detection means so as to detect the user's biological information when the user operates the electronic mail operation unit.

  In this case, when the user is creating or sending an e-mail to be sent to any other party by operating the e-mail operation unit, or when receiving or viewing an e-mail from any other party The biometric information of the user is detected. Thereby, biometric information depending on the partner of the e-mail or the content of the e-mail can be acquired.

  The communication device creates an estimation unit that estimates the user's psychological state based on the biological information detected by the detection unit, and information indicating the user's psychological state estimated by the estimation unit is created by the e-mail operation unit. You may further provide the insertion means inserted in an electronic mail.

  In this case, the psychological state of the user is estimated by the estimation unit based on the biological information detected by the detection unit. Then, information indicating the estimated psychological state of the user is inserted by the inserting unit into the e-mail created by the e-mail operation unit. As a result, an electronic mail in which information indicating the user's psychological state is inserted is transmitted to the other party.

  The communication apparatus may further include an estimation unit that estimates a user's psychological state based on the biological information detected by the detection unit.

  In this case, the psychological state of the user is estimated by the estimation unit based on the biological information detected by the detection unit. Thereby, the user's psychological state depending on the communication partner can be recognized.

  The estimation means may estimate the degree of tension of the user as the user's psychological state based on the biological information detected by the detection means.

  In this case, the degree of tension of the user is estimated by the estimation unit based on the biological information detected by the detection unit. Thereby, the user's degree of tension depending on the communication partner can be recognized.

  The estimation means may estimate the user's lie as the user's psychological state based on the biological information detected by the detection means.

  In this case, the user's lie is estimated by the estimation means based on the biological information detected by the detection means. Thereby, the user's lie depending on the communication partner can be recognized.

  The estimation means may estimate the user's emotions as the user's psychological state based on the biological information detected by the detection means.

  In this case, the user's emotions are estimated by the estimation unit based on the biological information detected by the detection unit. Thereby, the user's emotions depending on the communication partner can be recognized.

  The communication apparatus may further include a voice output unit that outputs information indicating the user's psychological state estimated by the estimation unit as a voice.

  In this case, information indicating the user's psychological state estimated by the estimating means is output as sound by the sound output means. Thereby, the user can easily recognize the psychological state depending on the communication partner.

  The communication apparatus may further include display means for displaying information indicating the user's psychological state estimated by the estimation means.

  In this case, information indicating the psychological state of the user estimated by the estimation unit is displayed by the display unit. Thereby, the user can easily recognize the psychological state depending on the communication partner.

  The communication apparatus may further include an information output unit that outputs information for changing the psychological state of the user estimated by the estimation unit.

  In this case, information for changing the user's psychological state based on the user's psychological state estimated by the estimating unit is output by the information output unit. Thereby, the user's psychological state depending on the communication partner can be changed.

  The communication apparatus may further include a storage unit that stores the psychological state of the user estimated by the estimation unit for each partner.

  In this case, the psychological state of the user estimated by the estimation unit is stored for each partner by the storage unit. Thereby, the user can easily confirm the psychological state depending on the partner and the history of the psychological state based on the stored contents of the storage unit.

  The communication unit may perform an incoming operation for the user to recognize the incoming call when the incoming call is received, and the control unit may control the incoming operation by the communication unit based on the user's psychological state stored in the storage unit. .

  In this case, the incoming call operation by the communication means is controlled based on the psychological state of the user stored in the storage means. Thereby, the user can easily recognize the psychological state depending on the caller at the time of the incoming call by the incoming call operation.

  The communication apparatus further includes an acquisition unit that acquires environmental information indicating an environmental state, and a correction unit that corrects the change state of the user's biological information detected by the detection unit based on the environmental information acquired by the acquisition unit. You may prepare. Here, the change state includes, for example, a change amount, a change gradient, a cumulative change amount within a specific time, a variation variation, and the like.

  In this case, the environmental information indicating the environmental state is acquired by the acquiring unit, and the change amount of the user's biological information detected based on the acquired environmental information is corrected by the correcting unit. Thereby, while being able to acquire correctly the variation | change_quantity etc. of the user's biometric information which changes according to an environmental state, the estimation precision of a user's psychological state can be improved.

  The communication apparatus may further include a voice recording unit that records the voice of the user when the biological information is detected by the detection unit.

  In this case, the user's voice is recorded by the voice recording means when the biological information is detected by the detection means. Accordingly, the user can easily grasp the state of the user's voice depending on the other party based on the recorded content.

  The communication device further includes a determination unit that determines whether or not the biological information detected by the detection unit exceeds a predetermined threshold, and the voice recording unit includes the biological information that exceeds the predetermined threshold by the determination unit. If it is determined that the user's voice has been exceeded, the user's voice for a predetermined time including the time when the threshold value is exceeded may be recorded.

  In this case, the determination means determines whether or not the biological information detected by the detection means exceeds a predetermined threshold value, and if the biological information exceeds the predetermined threshold value, the threshold value is set. The voice recording means records the user's voice for a predetermined time including the time when the time is exceeded. Thereby, the user can easily grasp the state of the sound when the biometric information greatly reacts depending on the other party from the recorded contents.

  An operation method of a communication apparatus according to a second aspect of the invention includes a communication means for communicating information and an operation means operated by a user to perform an operation related to communication by the communication means. The operation of the communication means is controlled based on the operation of the operation means, and the user's biological information is detected when the user operates the operation means or when the communication means communicates.

  In the operation method of the communication device according to the present invention, the operation of the communication unit is controlled based on the operation of the operation unit by the user. In addition, when the user performs an operation related to communication with an arbitrary partner using the operation unit of the communication device or when the user performs communication with the other party using the communication unit, the biometric information of the user is stored. The detection means is controlled so as to be detected. Therefore, it is possible to acquire biological information that depends on the communication partner.

  A communication program according to a third aspect of the invention is a communication means for communicating information, an operation means operated by a user to perform an operation related to communication by the communication means, and controls the communication means based on the operation of the operation means. A communication program that can be executed by the processing device and that controls the operation of the communication means based on the operation of the operation means, and when the operation means is operated or by the communication means The processing device executes processing for detecting the user's biological information during communication.

  According to the communication program of the present invention, the operation of the communication unit is controlled based on the operation of the operation unit by the user. In addition, when the user performs an operation related to communication with an arbitrary partner using the operation unit of the communication device or when the user performs communication with the other party using the communication unit, the biometric information of the user is stored. The detection means is controlled so as to be detected. Therefore, it is possible to acquire biological information that depends on the communication partner.

  A communication system according to a fourth aspect of the present invention includes a first communication device for a user, a second communication device for a diagnostician, and an information processing device for the diagnostician. Communication means for performing communication with the second communication device and information communication with the information processing device, and detection means for detecting biometric information of the user when the communication means communicates with the second communication device. The communication unit transmits information based on the biological information detected by the detection unit to the information processing device, and the second communication device or the information processing device receives advice from the diagnostician based on the information received by the information processing device. It is transmitted to the first communication device.

  In the communication system according to the present invention, when the user is making a call with the diagnostician having the second communication device by the communication means of the first communication device, the biometric information of the user is detected by the detection means. The Then, information based on the detected biological information is transmitted to the information processing apparatus by the communication unit during or after the call with the diagnostician by the communication unit. Thereby, the diagnostician can diagnose the health condition of the user based on the information transmitted to the information processing apparatus. Here, the health condition includes both a physical health condition and a mental health condition. Hereinafter, the health condition is simply referred to as a health condition.

  The diagnostician can transmit the advice based on the diagnosis result to the first communication device by a call by the second communication device or information communication by the information processing device. Thereby, the user can easily receive advice based on the diagnosis result by the conversation with the diagnostician.

  Note that the second communication device and the information processing device may be provided integrally.

  A communication apparatus according to a fifth aspect of the present invention is a communication device for communicating information, an operation device operated by a user to perform an operation related to communication by the communication device, and detecting biometric information of the user. And a casing that integrally holds the communication means, the operation means, and the detection means. The casing has a front surface portion, a back surface portion, one side surface portion, and the other side surface portion, and one side surface. And the other side surface portion can be held with one hand, the operation means is provided on the front surface portion, and the detection means is provided on one side surface portion.

  In the communication apparatus according to the present invention, the operation of the communication means is controlled by the control means based on the operation of the operation means by the user. The user can operate the operating means with the other hand while holding the housing of the communication apparatus with one hand. At this time, a user's hand touches the detection means of the side part of a housing | casing, and a user's biometric information is detected.

  Therefore, it is possible to easily detect biological information without the user being aware of it.

  The front part, the rear part, the one side part, and the other side part of the housing are not limited to a flat shape, and may be formed in a curved shape. The front part, the rear part, one side part, and the other Two or more of the side portions may be continuous with a curved surface.

  According to the communication device, the communication method, and the communication program according to the present invention, the operation of the communication unit is controlled by the control unit based on the operation of the operation unit by the user. In addition, when the user performs an operation related to communication with an arbitrary partner using the operation unit of the communication device or when the user performs communication with the other party using the communication unit, the biometric information of the user is stored. The detection means is controlled by the control means so as to be detected. Therefore, it is possible to acquire biometric information that depends on the partner conscious of the user.

  Further, according to the communication system according to the present invention, when the user makes a call with the diagnostician having the second communication device by the communication means of the first communication device, the biometric information of the user is detected by the detection means. Is detected. Then, information based on the detected biological information is transmitted to the information processing apparatus by the communication unit during or after the call with the diagnostician by the communication unit. Thereby, the diagnostician can diagnose the health condition of the user based on the information transmitted to the information processing apparatus.

  The diagnostician can transmit the advice based on the diagnosis result to the first communication device by a call by the second communication device or information communication by the information processing device. Thereby, the user can easily receive advice based on the diagnosis result by the conversation with the diagnostician.

  Further, according to the communication device of the present invention, the operation of the communication unit is controlled by the control unit based on the operation of the operation unit by the user. The user can operate the operating means with the other hand while holding the housing of the communication apparatus with one hand. At this time, a user's hand touches the detection means of the side part of a housing | casing, and a user's biometric information is detected.

  Therefore, it is possible to easily detect biological information without the user being aware of it.

  Hereinafter, a communication device, a communication method, a communication program, and a communication system using the communication device according to an embodiment of the present invention will be described. In the following, a mobile phone will be described as an example of a communication apparatus according to an embodiment of the present invention. The mobile phone according to the following description has a function of detecting the user's biological information in addition to the original telephone function.

  In the following description, communication includes voice calls, transmission / reception of electronic mail, and connection to a site via the Internet.

  Here, the user's biological information is information related to the living body obtained from voice data related to the user's voice and objectively measurable physiological quantity data such as the user's skin temperature, pulse, and GSR (skin electrical reflection). It is. In the following description, physiological data is a measurement result of a user's skin temperature, pulse and GSR.

(First embodiment)
FIG. 1 is an external view of a mobile phone according to the first embodiment. As shown in FIG. 1, a mobile phone 100 according to the present embodiment is formed of a first housing 1 and a second housing 2. Both the first casing 1 and the second casing 2 have a substantially rectangular parallelepiped shape, and the lower end of the first casing 1 and the upper end of the second casing 2 are connected by a hinge 3. Thereby, the first housing 1 can be folded in the direction of the arrow with respect to the second housing 2 around the hinge 3.

  A surface on the side facing each other when the first housing 1 and the second housing 2 are folded is referred to as a front surface. A surface opposite to the front surface of the first housing 1 and the second housing 2 is referred to as a back surface.

  As shown in FIG. 1A, a main display unit 13 for displaying various types of information described later is provided at the front center of the first housing 1. On the upper part of the main display unit 13, a speaker 15b for call is provided. The main display unit 13 includes, for example, a liquid crystal display or an organic electroluminescence display. The main display unit 13 is not limited to these as long as it can display images, characters, and the like.

  On the other hand, an input operation unit 11 is provided in the center of the front surface of the second housing 2. The input operation unit 11 includes a plurality of numeric buttons, a plurality of operation setting buttons, a cursor button KK, a determination button KS, and the like. When the user operates the input operation unit 11, the mobile phone 100 performs a predetermined operation. A microphone 16 is provided below the input operation unit 11.

  A physiological data measurement unit 20 is provided on the side surface of the second housing 2. In FIG. 1A, two electrodes 20 a and 20 d for measuring a user's GSR are provided on both side surfaces of the second housing 2. In addition, on one side surface of the second housing 2, a thermistor 20b for measuring the user's skin temperature and a photosensor 20c for measuring the user's pulse are provided together with the electrode 20a.

  In the present embodiment, the physiological data measuring unit 20 is provided on both side surfaces of the second housing 2, but the method of providing the physiological data measuring unit 20 is not limited to this. For example, the physiological data measuring unit 20 may be provided on only one of both side surfaces.

  As shown in FIG. 1B, a sub display unit 14 that performs a light emission operation is provided in the center of the back surface of the first housing 1. The sub display unit 14 includes, for example, an LED (light emitting diode). The sub display unit 14 is not limited to this as long as it emits light.

  A charge coupled device (hereinafter abbreviated as CCD) camera 17 is provided above the sub display unit 14. Two speakers 15 a are provided on the upper rear side of the first housing 1. An antenna 31 is provided on the upper rear side of the second housing 2.

  At the time of detection of biological information, physiological data is measured by the user holding the second casing 2. That is, when the user's finger or palm touches the electrodes 20a and 20d, the thermistor 20b, and the photosensor 20c, the user's GSR, skin temperature, and pulse are measured. Also, voice data can be obtained by the user having a conversation through the microphone 16.

  FIG. 2 is a block diagram showing a configuration of the mobile phone 100 according to the first embodiment. As shown in FIG. 2, the mobile phone 100 according to the present embodiment includes a control unit 10, an input operation unit 11, a memory 12, a main display unit 13, a sub display unit 14, a speaker 15a, a call speaker 15b, and a microphone 16. A CCD camera 17, a signal processing unit 18, a physiological data measurement unit 20, a wireless communication unit 30, and an antenna 31. In addition, amplifiers an1, an2, and an3 are provided corresponding to the speaker 15a, the call speaker 15b, and the microphone 16, respectively.

  The control unit 10 includes, for example, a CPU (Central Processing Unit) or a microcomputer, and controls the operation of each of the above components. The input operation unit 11 gives a command signal based on a user's operation to the control unit 10. The memory 12 includes, for example, a nonvolatile memory such as a flash memory or a volatile memory such as an SRAM (Static Random Access Memory) and a data holding power source for holding the data. The memory 12 stores a plurality of information. The internal configuration of the memory 12 will be described later.

  In either the control unit 10 or the memory 12, a system program related to the original function of the mobile phone and a communication program described later are stored. Here, the original function of the mobile phone is, for example, a function for a user to make a call, a function for a user to create, send and receive an e-mail, and a user to a desired site via the Internet. It is a function for accessing.

  The display operation of the main display unit 13 is controlled based on a command signal from the control unit 10. The sub display unit 14 is controlled in light emission operation based on a command signal from the control unit 10.

  The speaker 15a outputs various sounds based on an electric signal given through the amplifier an1. The call speaker 15b outputs various sounds based on the electric signal given through the amplifier an2. The microphone 16 generates an electrical signal based on the user's voice. The generated electric signal is given to the signal processing unit 18 and the memory 12 through the amplifier an3. The imaging operation of the CCD camera 17 is controlled based on a command signal from the control unit 10.

  In the signal processing unit 18, conversion of the format of signals given from other components is performed. For example, the signal processing unit 18 converts analog physiological data measured by the physiological data measuring unit 20 into digital physiological data.

  As described above, the physiological data measurement unit 20 includes the electrodes 20a and 20d, the thermistor 20b, and the photosensor 20c. The GSR of the user is measured by the electrodes 20a and 20d, the skin temperature of the user is measured by the thermistor 20b, and the pulse of the user is measured by the photosensor 20c. The measured physiological quantity data is given to the signal processing unit 18.

  The wireless communication unit 30 performs wireless communication such as the above-described physiological data, voice data, and data related to electronic mail via the antenna 31.

  FIG. 3 is a diagram showing an example of the internal configuration of the memory 12 of FIG. The memory 12 includes an operation setting storage unit 121, a psychological state estimation table storage unit 122, a personal information data storage unit 123, a history data storage unit 124, a voice analysis table storage unit 125, and a correction data storage unit 126.

  Details of the storage unit and the storage unit in the memory 12 will be described with reference to FIGS.

  FIG. 4 is a diagram showing an example of contents stored in the operation setting storage unit 121 of FIG. In FIG. 4, as an example of the contents stored in the operation setting storage unit 121, an incoming call operation setting table of the mobile phone 100 is shown.

  In the incoming call operation setting table of FIG. 4, a melody pattern, a light emission pattern, and a display pattern for incoming calls are set in advance for each communication partner.

  Here, the melody pattern refers to a voice pattern output from the speaker 15a in FIG. 2 when an incoming call is received, and the light emission pattern refers to a pattern in which the sub display unit 14 in FIG. 2 emits light when an incoming call is received. 2 is a pattern displayed on the main display unit 13.

  Combinations of these incoming melody patterns, light emission patterns, and display patterns are classified into incoming call operation groups P1 and P2.

  In the example of FIG. 4, when the incoming call operation group is P1, “Pampakapan” is set as the melody pattern, “Lit green” is set as the light emission pattern, and “Let's talk in the normal tone” as the display pattern. Is set. Also, when the incoming call operation group is P2, “boo boo” is set as the melody pattern, “red light” is set as the light emission pattern, and “Please speak relaxedly” as the display pattern. .

  Here, the incoming call operation group is determined based on a psychological state level history average, which will be described later, calculated for each communication partner from the past communication history when communicating with the communication partner. For example, in FIG. 4, when the average psychological state level history value when communicating with a certain communication partner is 2 or less, P1 is set as the incoming call operation group for that communication partner, and communication with a certain communication partner is performed. When the average value of the psychological state level history is 3 or more, P2 is set as an incoming call operation group for the communication partner.

  The control unit 10 shown in FIG. 2 controls the operation of each of the components based on the incoming call operation setting table stored in the operation setting storage unit 121 as described above. Thereby, the control part 10 performs operation control of the speaker 15a, the sub display part 14, and the main display part 13 according to a communication partner based on the incoming call operation setting table of FIG. The control unit 10 also updates the contents of the incoming call operation setting table. The update operation will be described later.

  FIG. 5 is a diagram showing an example of contents stored in the psychological state estimation table storage unit 122 of FIG. In FIG. 5, as an example of the contents stored in the psychological state estimation table storage unit 122, psychology for estimating the user's psychological state (degree of tension) based on physiological data measured by the physiological data measurement unit 20. A state estimation table is shown.

  Here, in FIG. 5, the degree of tension of the user is expressed as psychological state levels 1 to 6. In the example of FIG. 5, the user's degree of tension is higher as the psychological state level is smaller. For example, psychological state level 1 indicates that the user is very nervous, psychological state level 2 indicates that the user is nervous, and psychological state level 3 indicates that the user is slightly nervous. Represents.

  The psychological state level 4 indicates that the user is in a normal state, the psychological state level 5 indicates that the user is relaxed, and the psychological state level 6 indicates that the user is very relaxed. Represents. These psychological state levels are classified based on measured physiological data, that is, a combination of a user's GSR, skin temperature, and change per unit time of pulse.

  The combination of the change amounts is determined based on the magnitude relationship of the measurement values with respect to the reference values set for each of the GSR, skin temperature, and pulse change amounts.

  In FIG. 5, three reference values α, β, and γ are set for the amount of change in GSR in order to determine the combination of the amounts of change. These reference values α, β, and γ are larger in the order of α, β, and γ. Also, 0 is set as a reference value for the amount of change in skin temperature and pulse.

  An example of classification of psychological state levels by a combination of GSR, skin temperature, and pulse variation will be described.

  For example, if the GSR change amount ΔG is greater than or equal to the reference value γ, the skin temperature change amount ΔT is less than 0, and the pulse change amount ΔH is greater than or equal to 0, the psychological state level is classified as 1. Yes.

  When the GSR change amount ΔG is equal to or less than the reference value α, the skin temperature change amount ΔT is 0 or more, and the pulse change amount ΔH is less than 0, the psychological state level is classified as 6. Yes.

  The control unit 10 in FIG. 2 uses the psychological state estimation table stored in the psychological state estimation table storage unit 122 and the physiological data of the user's GSR, skin temperature, and pulse measured by the physiological data measurement unit 20 as described above. The user's psychological state level is estimated based on the data.

  The reference values α, β, and γ may be set by setting specific values in advance, or may be set for each user according to characteristics such as the health condition and personality of each user. .

  FIG. 6 is a diagram showing an example of contents stored in the personal information data storage unit 123 of FIG. In FIG. 6, personal information data of the communication partner of the user is shown as an example of the contents stored in the personal information data storage unit 123.

  In the personal information data of FIG. 6, for each communication partner of the user, the gender of the communication partner, the relationship between the user and the communication partner, and the telephone number of the communication partner are associated. The personal information data may be associated with the communication partner's e-mail address for each communication partner in addition to the gender, relationship, and telephone number.

  The control unit 10 in FIG. 2 can specify the communication partner of the transmission source when receiving an incoming call or when receiving an e-mail based on the personal information data stored in the personal information data storage unit 123 as described above. That is, when the mobile phone 100 receives an incoming call, the control unit 10 can identify the communication partner based on the personal information data.

  FIG. 7 is a diagram illustrating an example of contents stored in the history data storage unit 124 of FIG. In FIG. 7, as an example of the contents stored in the history data storage unit 124, history data in which information related to past communication performed between the user and the communication partner is associated with each communication partner of the user. It is represented.

  According to FIG. 7, the information regarding the past communication performed between the user and the communication partner is, for example, the average of the history of the psychological state level estimated at the time of the user's past communication (hereinafter referred to as the psychological state). Called level history average.) And a record of the user's past communications. Here, the past communication records associated with each communication partner are the communication date and time, the communication time, the psychological state level estimated at the time of communication, and the voice data at the time of communication. Note that a method for storing audio data will be described later in another embodiment.

  In the example of FIG. 7, 6 is associated with the communication partner AA as the psychological state level history average. This represents that the average psychological state of the user during the past communication between the user and the communication partner AA was a psychological state level 6, that is, a very relaxed state. In addition, the past communication record for the communication partner AA is that the communication date and time at the previous communication is ○ month △ day □ hour ▽ minutes, the communication time is ○ minutes, and the psychological state estimated at the time of communication is the psychological state Indicates that it is level 5. Furthermore, the voice data AA1 at the time of the previous communication of the communication partner AA is stored.

  Thereby, the control unit 10 in FIG. 2 can specify the user's past psychological state level history average and past communication records for each communication partner based on the history data stored in the history data storage unit 124. it can.

  In the present embodiment, the control unit 10 updates the contents of the history data in FIG. 7 every time the user performs communication. Then, the control unit 10 updates the contents of the incoming call operation setting table of FIG. 4 based on the updated history data. As a result, the mobile phone 100 according to the present embodiment performs various operations according to the communication partner of the user.

  The control unit 10 may control the main display unit 13, the sub display unit 14, the speaker 15a, the call speaker 15b, and the like in FIG. In this case, the user can know information related to past communication for each communication partner.

  The voice analysis table storage unit 125 in FIG. 3 stores a table for analyzing voice data during user communication. The correction data storage unit 126 stores a table for correcting the physiological data of the user according to the surrounding environment. Details of the contents stored in the speech analysis table storage unit 125 and the correction data storage unit 126 will be described later in other embodiments.

  FIG. 8 and FIG. 9 are diagrams illustrating examples of contents displayed on the main display unit 13 when the user uses the mobile phone 100 according to the first embodiment.

  The user operates the input operation unit 11 of the mobile phone 100 when making a call.

  FIG. 8A shows a display example of the main display unit 13 when the user makes a call to a desired partner (when making a call). FIG. 8B shows a display example of the main display unit 13 when a call is made to the user's mobile phone 100 (when receiving a call). The main display unit 13 displays a call origination or incoming call and a telephone number.

  When the main display unit 13 of the mobile phone 100 is in the display state of FIG. 8A, the user operates the input operation unit 11 or the other party who receives a call from the user operates his / her mobile phone. By doing so, a call becomes possible.

  FIG. 8C shows a display example of the main display unit 13 during a call. The main display unit 13 displays the current call time when the user is talking, and displays that the user's biometric information is detected. Thereafter, when the user or the other party operates the input operation unit 11 of the mobile phone 100, the call is terminated.

  FIG. 9D shows a display example of the main display unit 13 when the user ends the call. The main display unit 13 displays the user's call time when the user's call ends, and displays the user's psychological state estimated based on the biological information detected during the call.

  The control unit 10 in FIG. 2 displays the call time and psychological state in FIG. 9D by the main display unit 13, and then stores the contents of the above-described incoming call operation setting table based on the biological information detected during the call. Update. Then, the updated contents of the incoming call operation setting table are displayed on the main display unit 13.

  FIG. 9E is a display example of the contents of the incoming call operation setting table displayed on the main display unit 13 after the display of FIG. Thereby, the user can know the operation at the time of the incoming call of the mobile phone 100.

  In the example of FIG. 9 (e), the user can know that the incoming call operation group P1 is set in the call partner (communication partner in FIG. 4) AB as the incoming call operation setting table of FIG. .

  FIG. 9F illustrates a display example of the main display unit 13 when the user calls the call partner AB again (at the time of outgoing call) after the above setting is performed. FIG. 9G illustrates a display example of the main display unit 13 when a call is received from the call partner AB to the user's mobile phone 100 after the above setting is performed (when receiving a call).

  When an incoming call operation group is set for a specific call partner, the main display unit 13 displays a display pattern (for example, the display pattern shown in FIG. 4) determined by the incoming call operation group, and whether a call is received or received Message and phone number are displayed.

  For example, if it is estimated that the past psychological state for a specific call partner is always “very tense”, the main display unit 13 displays the call to the other party and the incoming call from the other party. A message that you should relax and talk is displayed.

  A communication program according to the present embodiment will be described. 10 and 11 are flowcharts illustrating an example of the communication program according to the first embodiment.

  According to the communication program according to the present embodiment, the control unit 10 in FIG. 2 operates as follows.

  First, the control unit 10 in FIG. 2 determines whether or not a command signal indicating that a call is to be made to another telephone is received by the operation of the input operation unit 11 by the user (step S10). The command signal in this case includes the telephone number of the communication partner.

  When the control unit 10 receives a command signal for transmission, the control unit 10 identifies a communication partner based on the command signal (step S11).

  Next, the control unit 10 displays a display pattern corresponding to the communication partner of the transmission destination on the main display unit 13, and causes the sub display unit 14 of FIG. 2 to emit light with the light emission pattern corresponding to the communication partner (step S12). And the control part 10 discriminate | determines whether there was a response from the communicating party (step S13). When there is a response, the control unit 10 starts measuring physiological data (step S18).

  On the other hand, the control part 10 discriminate | determines whether there exists any incoming call from another telephone, when the command signal to the effect of transmitting in step S10 is not received (step S14). In this case, the data transmitted from the other telephone includes the telephone number of the communication partner.

  When there is no incoming call from another telephone, the control unit 10 repeats the operation of step S10. On the other hand, when there is an incoming call from another telephone, the control unit 10 identifies a communication partner based on the data transmitted from the other telephone (step S15).

  Next, the control unit 10 causes the main display unit 13 to display a display pattern corresponding to the communication partner of the transmission destination, and causes the sub display unit 14 of FIG. 2 to emit light with the light emission pattern corresponding to the communication partner, thereby corresponding to the communication partner. Voice is output from the speaker 15a with a melody pattern (step S16). Therefore, the control unit 10 determines whether or not a command signal for responding to the incoming call has been received by the user operating the input operation unit 11 (step S17). When there is a response, the control unit 10 performs the operation of step S18.

  The control unit 10 determines whether or not the communication has ended while performing the operation of step S18 (step S19).

  Control part 10 repeats operation of the above-mentioned step S18, when communication does not end. On the other hand, when the communication is completed, the control unit 10 stops the measurement of physiological data, and estimates the psychological state during communication based on the measured physiological data (step S20). Thereafter, the control unit 10 displays the estimated psychological state during communication of the user on the main display unit 13 (step S21).

  Finally, the control unit 10 updates the contents of the history data based on the identified communication partner and psychological state estimation results (step S22). And the control part 10 updates the content of the operation setting table at the time of an incoming call based on the content of the updated log | history data (step S23). The control part 10 which complete | finished the operation | movement of step S23 repeats the operation | movement of the said step S10 again.

  Here, the update operation of the contents of the history data in FIG. 7 will be described. In step S22, the control unit 10 stores the psychological state level estimated based on the measured physiological data in the history data storage unit 124. And the control part 10 calculates the average value of the psychological state level at the time of communication with the communication partner from the past psychological state level memorize | stored for every communication partner and the currently estimated psychological state level. The average value calculated in this way is the above-described psychological state level history average.

  In addition, the control unit 10 records past communication based on the contents of the communication that is currently performed (for example, communication date and time during communication, communication time, psychological state level estimated during communication, voice data during communication, and the like). Update.

  Thus, the contents of the history data in FIG. 7 are updated by the control unit 10 every time communication is performed.

  As described above, in the communication device according to the present embodiment, the operation of each component of mobile phone 100 is controlled by control unit 10 based on the operation of input operation unit 11 by the user. Further, when the user performs an operation related to communication with the communication partner (calling partner) with the input operation unit 11 of the mobile phone 100 or when the user communicates with the communication partner with the wireless communication unit 30 and the antenna 31. The physiological data measuring unit 20, that is, the electrodes 20a and 20d, the thermistor 20b, and the photosensor 20c are controlled by the control unit 10 so that the user's biological information is detected. Therefore, it is possible to acquire biometric information that depends on the communication partner that the user is aware of.

  In the present embodiment, the user's biological information is detected when the user is making a voice call with any other party through the wireless communication unit 30 and the antenna 31. Thereby, the biometric information depending on the call partner can be acquired.

  In the present embodiment, the control unit 10 estimates the user's psychological state based on the biological information detected by the physiological data measurement unit 20. Thereby, the user's psychological state depending on the communication partner can be recognized.

  Further, the control unit 10 estimates the degree of tension of the user based on the biological information detected by the physiological data measurement unit 20. Thereby, the user's degree of tension depending on the communication partner can be recognized.

  In addition, in the present embodiment, information indicating the psychological state of the user estimated by the control unit 10 is displayed on the main display unit 13. Thereby, the user can easily recognize the psychological state depending on the communication partner.

  In the present embodiment, the user's psychological state estimated by the control unit 10 is stored for each communication partner by the history data storage unit 124 of the memory 12. Thereby, the user can easily confirm the psychological state depending on the communication partner and the history of the psychological state based on the stored contents of the storage unit.

  Furthermore, in the present embodiment, the incoming call operation of mobile phone 100 is controlled based on the user's psychological state stored in memory 12. Thereby, the user can easily recognize the psychological state depending on the communication partner at the time of the incoming call by the incoming call operation.

  In mobile phone 100 according to the present embodiment, physiological data measurement unit 20 (electrodes 20a and 20d and photosensor 20c) is provided on the side surface of second casing 2. Thus, the user can operate the input operation unit 11 with the other hand while holding the second housing 2 with one hand. At this time, when the user's hand touches the physiological data measurement unit 20 on the side surface of the second housing 2, the user's biological information is detected.

  Therefore, it is possible to easily detect biological information without the user being aware of it.

  In addition, the front surface, the back surface, the one side surface, and the other side surface of the second housing 2 are not limited to a flat shape, and may be formed in a curved shape. The front surface, the back surface, the one side surface, and the other side surface Two or more of them may be continuous with a curved surface.

  As shown in FIG. 1, the physiological data measurement unit 20 of the mobile phone 100 according to the present embodiment includes electrodes 20a and 20d, a thermistor 20b, and a photosensor 20c, but the electrodes 20a and 20d, the thermistor 20b, and the photosensor. It is not restricted to the form containing all of 20c. For example, the physiological data measuring unit 20 may include the electrodes 20a and 20d and the photosensor 20c, or may include only the electrodes 20a and 20d. In this case, it is necessary to set the above-described psychological state estimation table according to the detected physiological data.

  The physiological data measurement unit 20 measures GSR, skin temperature, and pulse as user's physiological data, but the physiological data to be measured is not limited to GSR, skin temperature, and pulse. For example, heart rate, blood pressure, blood flow, breathing, etc. may be used. Also in this case, it is necessary to set the above-described psychological state estimation table according to the detected physiological data.

  In the above description, the psychological state estimation table of FIG. 5 is used to estimate the psychological state. However, the estimation of the user's psychological state based on the biological information is not limited to using the psychological state estimation table of FIG. If biometric information is used, the user's psychological state may be estimated using other estimation tables using only physiological data, or the user's psychological state may be estimated using only voice data. . Further, as will be described later in another embodiment, the psychological state of the user may be estimated using both physiological data and audio data.

  Further, in the above, the degree of tension of the user is estimated as a psychological state, but not limited to this, as described later in other embodiments, the user's lie is estimated based on biological information, You may estimate emotions. In this case, the user can obtain various information about his / her psychological state.

  Furthermore, in the above description, the biological information is detected through the call time during a call by the user's mobile phone 100, but the detection of the biological information is not limited thereto. As will be described later in another embodiment, for example, the mobile phone 100 may detect biometric information only when the user is in a call and the user answers the question. In this case, the user can obtain various information on the psychological state at the time of answer or utterance by estimating the psychological state based on the biological information at the time of his / her answer.

  The mobile phone 100 may detect the user's biometric information even when not in a call. As will be described later in another embodiment, for example, the mobile phone 100 may detect the biological information of the user when the user creates an e-mail. In this case, the user can obtain information about the psychological state at the time of creating an e-mail to his / her specific communication partner.

  As will be described later in another embodiment, the mobile phone 100 may transmit the detected biological information or information about the estimated psychological state to another communication device.

(Second Embodiment)
The mobile phone 100 according to the second embodiment has the same configuration and operation as the mobile phone 100 according to the first embodiment except for the following points.

  Mobile phone 100 according to the present embodiment stores a voice analysis table and a psychological state adjustment table, which will be described later, in voice analysis table storage unit 125 of FIG.

  The mobile phone 100 records the user's conversation as voice data. Then, the cellular phone 100 obtains a tone of tone (tone), intonation and jitter (smoothness) as parameters by analyzing the recorded voice data. Note that the parameters are not limited to tone, inflection, and jitter, but may be the magnitude of pronunciation or the speed of pronunciation.

  In the present embodiment, the control unit 10 in FIG. 2 determines a later-described sound level related to the sound data based on the obtained parameters (tone of tone generation, inflection, jitter, etc.) and the sound analysis table.

  The control unit 10 determines a psychological state level adjustment value, which will be described later, based on the determined sound level and psychological state adjustment table. And the control part 10 adjusts the above-mentioned psychological state level estimated by the physiological data based on the determined psychological state level adjustment value. As a result, in cellular phone 100 according to the present embodiment, the user's psychological state can be estimated by using both physiological data and voice data.

  Note that the psychological state of the user may be estimated based on the physiological data and the voice data without adjusting the psychological state level estimated from the physiological data using the voice data.

  Furthermore, in this Embodiment, the control part 10 controls operation | movement of each structure part of FIG. 2 based on the adjusted psychological state level and the below-mentioned relaxation operation | movement setting table. Accordingly, the user is prompted to relax the tension according to his / her psychological state by the mobile phone 100. Hereinafter, relaxation of the tension to the user is referred to as relaxation.

  The voice analysis table and the psychological state adjustment table will be described. FIG. 12 is a diagram illustrating an example of contents stored in the voice analysis table storage unit 125 of FIG.

  In the following description, in addition to the voice analysis table and the psychological state adjustment table shown in FIG. 12, the voice analysis table storage unit 125 has predetermined tone for each tone, inflection, and jitter obtained by analyzing voice data. A reference value is stored.

  FIG. 12A shows an example of a voice analysis table stored in the voice analysis table storage unit 125. According to FIG. 12A, the sound level is classified into 1 to 8 on the basis of the magnitude relationship with respect to the predetermined reference values of the tone, inflection, and jitter obtained from the sound data.

  The various reference values described above may be set by determining specific values in advance, or may be set for each user according to characteristics such as the health condition and personality of each user.

  Here, the voice level represents the degree of tension of the user estimated from the voice data. In the example of FIG. 12A, the degree of tension of the user is shown to increase as the sound level decreases.

  For example, if the tone is above the reference value, the inflection is above the reference value, and the jitter is above the reference value, the audio level is classified as 1 indicating that the user is very nervous.

  FIG. 12B shows an example of a psychological state adjustment table stored in the voice analysis table storage unit 125. According to FIG.12 (b), in the psychological state adjustment table, psychological state level adjustment value -1, 0, and 1 are matched according to the above-mentioned audio | voice level. The psychological state level adjustment value is used by the control unit 10 to adjust the psychological state level estimated based on the physiological quantity data and the psychological state estimation table of FIG.

  For example, when the control unit 10 determines that the sound level is 1 based on the sound analysis table of FIG. 12A, the control unit 10 sets the psychological state level adjustment value based on the psychological state level adjustment table of FIG. Determine as -1. Thereby, the control part 10 adjusts the mental state level estimated based on physiological quantity data and the mental state estimation table of FIG. 5 by -1. When the psychological state level estimated from the physiological data is 4, the adjusted psychological state level is 3.

  The relaxation operation setting table will be described. FIG. 13 is a diagram illustrating an example of contents stored in the operation setting storage unit 121 of FIG. Here, as an example of content stored in the motion setting storage unit 121, a relaxed motion setting table is represented.

  In the relaxing operation setting table of FIG. 13, a message display pattern, an image display pattern, and a relaxing music pattern are set for each adjusted psychological state level.

  Here, the message display pattern is a character pattern displayed on the main display unit 13 in FIG. 2 during relaxation to the user, and the image display pattern is displayed on the main display unit 13 in FIG. 2 during relaxation to the user. The relaxed music pattern is a sound (music) pattern that is reproduced by the speaker 15a of FIG. 2 during the relaxation to the user.

  In the example of FIG. 13, for the estimated psychological state level 1, “deep breath to rest and relax” is set as the message display pattern, “natural landscape” is set as the image display pattern, and the relaxation music pattern “Buzzing sound” is set.

  14 and 15 are diagrams illustrating examples of contents displayed on the main display unit 13 when the user uses the mobile phone 100 according to the second embodiment.

  The user operates the input operation unit 11 of the mobile phone 100 when making a call.

  FIG. 14A shows a display example of the main display unit 13 when the user ends the call. The main display unit 13 displays the user's call time and also displays an end button 131 and a mental button 132.

  Here, the user can select the end button 131 and the mental button 132 by operating the cursor button KK and the determination button KS of FIG.

  FIG. 14B shows a display example of the main display unit 13 when the user selects the mental button 132. The main display unit 13 displays the user's psychological state estimated based on the biological information detected during the user's call, and also displays an end button 131, a word button 132a, and a music button 132b. .

  The user can select the end button 131, the word button 132a, and the music button 132b by operating the cursor button KK, the determination button KS, and the like in FIG.

  FIG. 15C shows a display example of the main display unit 13 when the user selects the word button 132a. The main display unit 13 displays a message display pattern for relaxing the user's tension, and an end button 131 and a music button 132b.

  The user can select the end button 131 and the music button 132b by operating the cursor button KK, the determination button KS, and the like shown in FIG.

  FIG. 15D illustrates a display example of the main display unit 13 when the user selects the music button 132b. The main display unit 13 displays an image display pattern for relaxing the user's tension, and an end button 131 and a word button 132a.

  The user can select the end button 131 and the music button 132b by operating the cursor button KK, the determination button KS, and the like shown in FIG.

  Further, when the main display unit 13 is in the display state of FIG. 15D, a predetermined relaxing music pattern is reproduced from the speaker 15a of FIG.

  In the above, when the user selects the end button 131 by operating the cursor button KK, the determination button KS or the like of FIG. 1, the relaxation to the user, that is, the display operation of the message display pattern or the image display pattern and the relaxing music. The pattern reproduction operation ends.

  Note that the contents shown in FIGS. 8A, 8 </ b> B, and 8 </ b> C may be displayed on the main display unit 13 before the end of the user's call (for example, at the time of outgoing call, incoming call, and call). .

  In the present embodiment, the relaxation to the user may be set for each communication partner (call partner) as shown in the first embodiment, or may not be set for each communication partner.

  A communication program according to the present embodiment will be described. 16 to 18 are flowcharts illustrating an example of a communication program according to the second embodiment.

  According to the communication program according to the present embodiment, the control unit 10 in FIG. 2 operates as follows.

  First, the control unit 10 in FIG. 2 determines whether or not a command signal for turning on the relaxation mode is received by the operation of the input operation unit 11 by the user (step S30). Turning on the relax mode means that the mobile phone 100 operates a function that prompts the user to relax.

  When receiving a command signal for turning on the relaxation mode, the control unit 10 determines whether or not the user has received a command signal for sending to another telephone by operating the input operation unit 11 ( Step S31).

  When the control unit 10 receives a command signal for transmission, the control unit 10 performs a predetermined operation based on the command signal, and determines whether or not there is a response from the communication partner (step S33). When there is a response, the control unit 10 starts measuring physiological data and recording voice data (step S34).

  When the control unit 10 does not receive the command signal for sending in step S31, the control unit 10 determines whether there is an incoming call from another telephone (step S32).

  When there is no incoming call from another telephone, the control unit 10 repeats the operation of step S30. On the other hand, when there is an incoming call from another telephone, the control unit 10 performs a predetermined operation based on the incoming call and determines whether or not there is a response to the incoming call (step S33). When there is a response, the control unit 10 performs the operation of step S34.

  The control unit 10 determines whether or not the communication has ended while performing the operation of step S34 (step S35).

  When the communication does not end, the control unit 10 repeats the operation of step S34. On the other hand, when the communication ends, the control unit 10 ends the measurement of physiological data and the recording of voice data (step S35b).

  Next, the control unit 10 determines whether or not the mental button 132 has been selected by the user operating the input operation unit 11 (step S36). When the mental button 132 is selected, the control unit 10 estimates the psychological state during communication of the user based on the measured physiological data and the recorded voice data (step S37). And the control part 10 displays an estimation result, ie, a user's psychological state, on the main display part 13 (step S38).

  Subsequently, the control unit 10 determines whether or not the word button 132a is selected by the user operating the input operation unit 11 (step S39).

  When the word button 132a is not selected, the control unit 10 determines whether or not the music button 132b is selected by the user's operation on the input operation unit 11 (step S41). On the other hand, when the word button is selected in step S39, the control unit 10 displays a message display pattern based on the relaxation operation setting table stored in the operation setting storage unit 121 of FIG. 3 on the main display unit 13. (Step S40). And the control part 10 performs operation | movement of the said step S41.

  In step S41, when the music button is not selected, the control unit 10 determines whether or not the end button 131 is selected by the user operating the input operation unit 11 (step S43). On the other hand, when the music button 132b is selected, the control unit 10 displays an image display pattern based on the relaxation operation setting table stored in the operation setting storage unit 121 of FIG. 3 on the main display unit 13, and displays the relaxation music pattern. It reproduces | regenerates from the speaker 15a (step S42). And the control part 10 performs operation | movement of the said step S43.

  In step S43, when the end button 131 is selected, the control unit 10 ends the series of operations. On the other hand, when the end button is not selected, the control unit 10 repeats the operation in step S39.

  Incidentally, in step S36, when the mental button 132 is not selected, the control unit 10 performs the operation of step S43.

  If the relax mode is not turned on in step S30, the control unit 10 makes a call to another telephone by the user operating the input operation unit 11 as in step S31. It is determined whether or not a command signal is received (step S50).

  When the control unit 10 receives a command signal to the effect of transmission, it performs a predetermined operation based on the command signal, and determines whether or not there is a response from the communication partner (step S52). Next, the control part 10 discriminate | determines whether communication was complete | finished, when there exists a response from a communication other party (step S53). When communication is completed, control unit 10 ends the communication program according to the present embodiment.

  In step S50, when the control unit 10 does not receive a command signal for calling, it determines whether there is an incoming call from another telephone (step S51).

  When there is an incoming call, the control unit 10 performs a predetermined operation for the incoming call and performs the operation of step S52. On the other hand, when there is no incoming call in step S51, the control unit 10 repeats the operation of step S30.

  As mentioned above, in this Embodiment, the information regarding the relaxation to a user for relieving a user's tension based on the user's mental state estimated by the control part 10 is displayed by the main display part 13, and a speaker The sound is output by 15a. Thereby, the tension of the user depending on the communication partner is alleviated.

  In the above description, the psychological state estimation table of FIG. 5 and the psychological state adjustment table of FIG. 12 are used to estimate the psychological state. It is not limited to using a table and the psychological state adjustment table of FIG. If biometric information is used, the user's psychological state may be estimated using other estimation tables using only physiological data, or the user's psychological state may be estimated using only voice data. .

  Further, in the above, the degree of tension of the user is estimated as a psychological state, but not limited to this, as described later in other embodiments, the user's lie is estimated based on biological information, You may estimate emotions. In this case, the user can obtain various information about his / her psychological state.

  Furthermore, in the above, the mobile phone 100 estimates the degree of tension of the user as a psychological state and performs relaxation on the user based on the estimated psychological state, but the relaxation method is not limited to the above.

  For example, the mobile phone 100 may perform relaxation for the user only by displaying the message display pattern of FIG. 13 based on the estimated psychological state, or only display the image display pattern of FIG. The user may be relaxed or the user may be relaxed only by playing the relaxing music pattern of FIG.

  In the present embodiment, relaxation is performed as a change in the psychological state, but the change in the psychological state is not limited to this. For example, the mobile phone 100 may output information for activating the user's mood in order to eliminate the depression of the user's mood. Thereby, activation of a user's mood is achieved.

(Third embodiment)
The mobile phone 100 according to the third embodiment has the same configuration and operation as the mobile phone 100 according to the first embodiment except for the following points.

  In cellular phone 100 according to the present embodiment, an operation setting storage unit 121 shown in FIG.

  In the present embodiment, the mobile phone 100 measures physiological data as the user's biological information during the user's call, and estimates the user's psychological state based on the measured physiological data.

  Then, the mobile phone 100 operates so as to mitigate the user's psychological state according to the user's psychological state based on the psychological state estimated during the user's call and a dust operation setting table described later. Hereinafter, an operation for relaxing the psychological state of the user of the mobile phone 100 is referred to as a “smudge operation”. The nagomi operation will be described later.

  The nagomi operation setting table will be described. FIG. 19 is a diagram illustrating an example of contents stored in the operation setting storage unit 121 of FIG. Here, a garbage operation setting table is shown as an example of the contents stored in the operation setting storage unit 121.

  In the garbage operation setting table of FIG. 19, a garbage music pattern and a garbage word pattern are set for each psychological state level estimated based on physiological data.

  Here, the nagomi music pattern refers to a voice pattern that is reproduced by the call speaker 15b in FIG. 2 when the user performs a deaf operation, and the nagomi word pattern is reproduced by the call speaker 15b in FIG. This is a voice pattern.

  In the example of FIG. 19, for the estimated psychological state level 1 and psychological state level 2, “buzzing sound” is set as the nagomi music pattern, and “hidden, let's go!” Is set as the nagomi word pattern. ing. For the estimated psychological state level 3 and psychological state level 4, “high, take a deep breath” is set as the nagomi word pattern.

  FIG. 20 is a diagram illustrating an example of contents displayed on the main display unit 13 when the user uses the mobile phone 100 according to the third embodiment.

  The user operates the input operation unit 11 of the mobile phone 100 when making a call.

  FIG. 20A shows a display example of the main display unit 13 in a case where a music music pattern is reproduced from the call speaker 15b during a user's call. The main display unit 13 displays that a music music pattern and a music word pattern are being reproduced, and displays a volume button 134 and an off button 135.

  FIG. 20B shows a display example of the main display unit 13 when a small word pattern is reproduced from the call speaker 15b during a user's call. The main display unit 13 displays that the music music pattern is being played, and displays a volume button 134 and an off button 135.

  20A and 20B, the user can select the volume button 134 and the off button 135 by operating the cursor button KK, the determination button KS, and the like shown in FIG.

  Here, when the user selects the volume button 134 by operating the input operation unit 11, the user can set the volume of the music music pattern and the music word pattern reproduced from the call speaker 15 b.

  On the other hand, when the user selects the off button 135 by operating the input operation unit 11, the user's operation of the mobile phone 100 can be terminated.

  FIG. 20C illustrates a display example of the main display unit 13 when the user ends the call. The main display unit 13 displays the user's call time, and asks whether or not to continue the garbage operation, and displays a yes button 136a and a no button 136b.

  The user operates the cursor button KK and the decision button KS of FIG. 1 in response to the question as to whether or not to continue the garbage operation displayed on the main display unit 13, and thereby the yes button 136a and the no button 136b. Select one of the following.

  When the user selects the yes button 136 a by operating the input operation unit 11, it is possible to continue the garbage operation of the mobile phone 100. On the other hand, when the user selects the No button 136 b by operating the input operation unit 11, the garbage operation of the mobile phone 100 can be terminated.

  20D and 20E show display examples of the main display unit 13 when the user selects the YES button 136a when the main display unit 13 is in the display state of FIG. 20C.

  In FIG. 20D, the main display unit 13 displays that the music music pattern and the word pattern are being reproduced from the call speaker 15b, and also displays an end button 131. In this case, the user can listen to the trash music pattern and the trash word pattern reproduced from the call speaker 15b.

  In FIG. 20 (e), the main display unit 13 displays that a speech word pattern is being reproduced from the call speaker 15b and also displays an end button 131. In this case, the user can hear the dirty word pattern reproduced from the call speaker 15b.

  When the user selects the end button 131 by operating the cursor button KK, the enter button KS, or the like of FIG. 1 while the main display unit 13 is in the display state of FIG. The operation can be terminated.

  Note that the contents shown in FIGS. 8A and 8B may be displayed on the main display unit 13 before the user calls (for example, at the time of outgoing and incoming calls).

  Further, in the present embodiment, the garbage operation for the user may be set for each communication partner as shown in the first embodiment, or may not be set for each communication partner.

  A communication program according to the present embodiment will be described. 21 to 23 are flowcharts illustrating an example of a communication program according to the third embodiment.

  According to the communication program according to the present embodiment, the control unit 10 in FIG. 2 operates as follows.

  First, the control unit 10 of FIG. 2 determines whether or not a command signal for turning on the dust mode is received by the operation of the input operation unit 11 by the user (step S60). The turning on of the garbage mode means that the mobile phone 100 is in a state where the above-described garbage operation can be performed.

  When receiving a command signal for turning on the dust mode, the control unit 10 performs the same operation as Steps S31 to S33 described in the second embodiment (Steps S61 to S63).

  In step S63, when there is a response, the control unit 10 starts measuring physiological data (step S64).

  The control unit 10 estimates the psychological state during the communication of the user based on the measured physiological quantity data when a predetermined time elapses (step S65). Thereby, a user's psychological state is classified into either of the psychological state levels 1 to 6 in FIG.

  Next, the control part 10 discriminate | determines whether a user's psychological state level is 1 or 2 (step S66). When the psychological state level of the user is 1 or 2, the control unit 10 reproduces the trash word pattern and the trash music pattern from the call speaker 15b based on the trash operation setting table of FIG. 19 (step S67).

  After the operation of step S67 or when the user's psychological state level is not 1 or 2, the control unit 10 determines whether or not the user's psychological state level is 3 or 4 (step S68). When the psychological state level of the user is 3 or 4, the control unit 10 reproduces the word pattern from the call speaker 15b based on the character operation setting table of FIG. 19 (step S69).

  Next, after the operation of step S69 or when the user's psychological state level is not 3 or 4, the control unit 10 determines whether or not the communication has ended (step S70).

  Control part 10 repeats operation of the above-mentioned step S64, when communication does not end. On the other hand, when the communication ends, the control unit 10 ends the measurement of physiological data (step S70b).

  Subsequently, the control unit 10 displays on the main display unit 13 an inquiry as to whether or not to continue the dirt operation for the user (step S71). And the control part 10 discriminate | determines whether the yes button 136a was selected by the user operating the input operation part 11 (step S72).

  When the Yes button is selected, the control unit 10 reproduces the music music pattern and the word message pattern from the call speaker 15b based on the character operation setting table of FIG. 19 (step S73).

  Thereafter, the control unit 10 determines whether or not the end button 131 is selected by the user operating the input operation unit 11 (step S74). When the end button is not selected, the control unit 10 repeats the operation in step S73. On the other hand, when the end button 131 is selected, the control unit 10 ends the communication program according to the present embodiment.

  In step S72, when the yes button 136a is not selected, the control unit 10 determines whether or not the no button 136b is selected by the user operating the input operation unit 11 (step S75). When the No button 136b is not selected, the control unit 10 repeats the operation of Step S72. On the other hand, when the No button 136b is selected, the control unit 10 ends the communication program according to the present embodiment.

  Moreover, the control part 10 performs the operation | movement similar to step S50-S53 of 2nd Embodiment, when the dust mode does not turn on in said step S60 (steps S80-S83). In this case, the control unit 10 ends the communication program according to the present embodiment when the communication is ended in step S83.

  As described above, in the present embodiment, information indicating the user's psychological state estimated by the physiological data measurement unit 20 and the control unit 10 is output as voice by the call speaker 15b. Thereby, the user can easily recognize the psychological state depending on the communication partner.

  Further, in the present embodiment, information for relieving the user's tension based on the user's psychological state estimated by the control unit 10 (information related to nagging) is output from the call speaker 15b. Thereby, the tension of the user depending on the communication partner is alleviated.

  In the above, the degree of tension of the user is estimated as a psychological state as in the first embodiment. However, the present invention is not limited to this, but will be described later in other embodiments. A lie may be estimated, or emotions may be estimated. In this case, the user can obtain various information about his / her psychological state. Then, in place of the garbage setting table of FIG. 19, by setting an operation according to the estimated content, the user can obtain relaxation according to the estimation result during the call or garbage due to the operation of the mobile phone 100. Can do.

  The mobile phone 100 may detect the user's biometric information even when not in a call. As will be described later in another embodiment, for example, the mobile phone 100 may detect the user's biometric information when the user creates an e-mail. In this case, the user can obtain information about the psychological state at the time of creating an e-mail to his / her specific communication partner. Further, in this case, since the mobile phone 100 performs a rubbing operation according to the psychological state at the time of creating the e-mail, the user can obtain the rubbish even when the degree of tension increases at the time of creating the e-mail. .

(Fourth embodiment)
The mobile phone 100 according to the fourth embodiment has the same configuration and operation as the mobile phone 100 according to the first embodiment except for the following points.

  Mobile phone 100 according to the present embodiment estimates the degree of emotions as the user's psychological state. The degree of emotion of the user is estimated based on the analysis result of the user's physiological data and voice data.

  In the present embodiment, GSR is used as physiological data. As the voice data, the voice of the user's conversation recorded as described in the second embodiment is used.

  FIG. 24 is a diagram for explaining a data extraction method for estimating the degree of emotion of the user.

  As shown in FIG. 24, the mobile phone 100 stores the user's GSR and voice data from the start of the user's call to the end of the call. Then, the mobile phone 100 specifies the time when the user uttered based on the obtained audio data. The time specified by this is called an utterance period.

  The mobile phone 100 determines a time to be analyzed from the stored voice data and GSR by adding a predetermined time before and after the specified utterance period. The time determined by this is called an analysis target period. In FIG. 24, the analysis target period is represented by a code TT1 and a code TT2.

  The mobile phone 100 analyzes the audio data in each of the determined analysis target periods TT1 and TT2. As a result, the cellular phone 100 obtains the tone, inflection, and jitter of the pronunciation as the parameters of the audio data in each of the analysis target periods TT1 and TT2. In the following description, it is assumed that the analysis results of tone, inflection, and jitter are quantified.

  In addition, the mobile phone 100 performs GSR analysis in each of the determined analysis target periods TT1 and TT2. This analysis is performed by calculating a difference value from the maximum value to the minimum value of the measured GSR in each of the analysis target periods TT1 and TT2. Hereinafter, this difference value is referred to as a GSR difference value.

  In FIG. 24, the GSR difference values calculated for each analysis target period TT1, TT2 are represented by arrows ΔGm1 and ΔGm2, respectively.

  In cellular phone 100 according to the present embodiment, psychological state estimation table storage section 122 in FIG. 3 stores a physiological emotion estimation table, a voice emotion estimation table, an emotion estimation reference table, and a point determination table, which will be described later.

  The cellular phone 100 determines an emotion level, which will be described later, based on the above-described GSR difference value and physiological quantity estimation table obtained by analyzing physiological data for each determined analysis target period. In addition, the mobile phone 100 determines an emotion level, which will be described later, based on the above-described pronunciation tone, inflection and jitter, and speech emotion estimation table obtained by analyzing the speech data for each determined analysis target period.

  Thereafter, the mobile phone 100 estimates the degree of emotion of the user based on the plurality of emotion levels determined based on the GSR difference value, tone, inflection, and jitter, the emotion estimation reference table, and the point determination table. To do.

  The physiological emotion estimation table and the voice emotion estimation table will be described. 25 is a diagram illustrating an example of contents stored in the psychological state estimation table storage unit 122 and the voice analysis table storage unit 125 of FIG. Here, as an example of contents stored in the psychological state estimation table storage unit 122 and the voice analysis table storage unit 125, a physiological quantity emotion estimation table and a voice emotion estimation table are represented.

  FIG. 25A shows an example of a physiological emotion estimation table stored in the psychological state estimation table storage unit 122. As described above, the GSR difference value is calculated based on the measured GSR of the user. An emotion level for estimating the degree of emotion of the user is determined based on the GSR difference value calculated by the physiological emotion estimation table. The emotion level is determined based on the magnitude relationship of the GSR difference value with respect to a predetermined reference value.

  In FIG. 25A, three reference values Kα, Kβ, and Kγ are set for the GSR difference value ΔGm. These reference values Kα, Kβ, and Kγ are larger in the order of Kα, Kβ, and Kγ.

  An example of determination of the emotion level based on the GSR difference value ΔGm will be described. According to FIG. 25A, for example, when the GSR difference value ΔGm is greater than or equal to the reference value Kγ, the emotion level 3 is determined, and the GSR difference value ΔGm is greater than or equal to the reference value Kβ and less than the reference value Kγ. Even in some cases, emotion level 3 is determined.

  When the GSR difference value ΔGm is equal to or greater than the reference value Kα and less than the reference value Kβ, the emotion level 1 is determined. When the GSR difference value ΔGm is less than the reference value Kα, the emotion level 2 is determined. The

  FIG. 25B shows an example of a voice emotion estimation table stored in the voice analysis table storage unit 125. As described above, the emotion level for estimating the degree of emotion of the user is determined based on the tone, intonation, and jitter obtained by analyzing the user's voice data. The emotion level is determined for each of tone, inflection, and jitter, and is determined based on the magnitude relationship of tone, inflection, and jitter with respect to a preset reference value. In this case, the predetermined reference value is set for each of tone, inflection, and jitter.

  In FIG. 25B, three reference values Lα, Lβ, and Lγ are set for the tone TO. These reference values Lα, Lβ, Lγ are larger in the order of Lα, Lβ, Lγ. In addition, three reference values Mα, Mβ, and Mγ are set for the intonation YO. These reference values Mα, Mβ, Mγ are larger in the order of Mα, Mβ, Mγ. Further, three reference values Nα, Nβ, and Nγ are set for the jitter GI. These reference values Nα, Nβ, Nγ are larger in the order of Nα, Nβ, Nγ.

  An example of emotion level determination by tone TO will be described. According to FIG. 25B, for example, when the tone TO is greater than or equal to the reference value Lγ, the emotion level 3 is determined, and when the tone TO is greater than or equal to the reference value Lβ and less than the reference value Lγ. Emotion level 3 is determined.

  Further, when the tone TO is greater than or equal to the reference value Lα and less than the reference value Lβ, the emotion level 1 is determined, and when the tone TO is less than the reference value Lα, the emotion level 3 is determined.

  The emotion estimation reference table and the point determination table will be described. FIG. 26 is a diagram illustrating an example of contents stored in the psychological state estimation table storage unit 122 of FIG. Here, as an example of contents stored in the psychological state estimation table storage unit 122, an emotion estimation reference table and a point determination table are represented.

  FIG. 26A shows an example of an emotion estimation reference table stored in the psychological state estimation table storage unit 122.

  In FIG. 26 (a), combinations of emotion levels determined based on GSR difference values, tones, intonations, and jitters are classified into four groups of emotions: joy, anger, sadness, and enjoyment. . Such a combination of emotion levels in FIG. 26A is referred to as a reference combination.

  An example of this reference combination will be described. According to FIG. 26 (a), for example, in the reference combination for pleasure, the emotion level based on the GSR difference value is 3, the emotion level based on the tone is 3, the emotion level based on inflection is 3, The emotion level based on jitter is 3.

  The four standard combinations of joy, anger, sadness and enjoyment thus defined are then a combination of emotional levels based on GSR difference values obtained by measurement and tone, inflection and jitter obtained by analysis of speech data. (Hereinafter referred to as measurement combination).

  At the time of comparison between the reference combination and the measurement combination, comparison is performed for each combined emotion level. Then, the points described later are determined as a result of the comparison.

  FIG. 26B shows an example of a point determination table stored in the psychological state estimation table storage unit 122. In FIG. 26 (b), points are set according to the difference in emotion level when comparing the reference combination and the measurement combination.

  Assume that each emotion level of the reference combination is compared with the corresponding emotion level of the measurement combination. According to FIG. 26B, if there is no difference between the emotion level of the reference combination and the emotion level of the measurement combination as a result of the comparison, the point is determined as 30. If the difference in emotion level is 1, the point is determined as 20. Further, when the emotion level difference is 2, the point is determined as 10, and when the emotion level difference is 3, the point is determined as 0.

  FIG. 27 is a diagram for explaining an example in which the degree of emotion is estimated from the measurement combination.

  FIG. 27A shows an example of a measurement combination. In FIG. 27A, the emotion level based on the GSR difference value is 3, the emotion level based on tone is 3, the emotion level based on inflection is 3, and the emotion level based on jitter is 3. It is represented.

  As described above, at the time of estimating the degree of emotions, the measurement combination shown in FIG. 27 (a) is the joy, anger, sadness and enjoyment of the emotion estimation reference table shown in FIG. 26 (a). Each of the four reference combinations is compared. Then, a measurement result point table to be described later is created based on the comparison result between the measurement combination and the reference combination and the point determination table in FIG. The measurement result point table is stored in the personal information data storage unit 123.

  FIG. 27B shows an example of the measurement result point table. In FIG. 27 (b), the comparison result of each emotion level of the measurement combination represented in FIG. 27 (a) and each emotion level of the reference combination of FIG. 26 (a) and the point setting table of FIG. 26 (b). On the basis of a combination of points about joy, anger, sadness and fun.

  As an example of the combination of points, a combination of points related to pleasure will be described.

  As described above, in the measurement combination of FIG. 27A, the emotion level based on the GSR difference value is 3, the emotion level based on the tone is 3, the emotion level based on the inflection is 3, and based on jitter Emotion level is 3. On the other hand, in the joy standard combination of FIG. 26A, the emotion level based on the GSR difference value is 3, the emotion level based on the tone is 3, the emotion level based on the inflection is 3, and the emotion based on jitter Level is 3.

  Therefore, when these are compared with each other, all emotion levels are the same. As a result, the difference between each emotion level of the measurement combination represented in FIG. 27A and each emotion level of the reference combination represented in FIG.

  Here, according to the point determination table of FIG. 26B, when the difference between the emotion level of the measurement combination and the emotion level of the reference combination is 0, 30 points are determined.

  Therefore, in this case, as shown in FIG. 27B, in the combination of points relating to pleasure, the point based on the GSR difference value is determined to be 30, the point based on the tone is determined to be 30, and the point based on inflection Is determined to be 30, and a jitter based point is determined to be 30.

  Similarly, for anger, sadness, and enjoyment, each emotion level of the measurement combination is compared with each emotion level of the reference combination. As a result, each combination of points is determined.

  As shown in FIG. 27B, the determined points are summed for each combination.

  That is, in the combination of points relating to pleasure, the point 30 based on the GSR difference value, the point 30 based on the tone, the point 30 based on the inflection, and the point 30 based on the jitter are summed, and a total value 120 is calculated. On the other hand, according to FIG. 27B, the total value 90 is calculated for the combination of points related to anger. On the other hand, the total value 40 is calculated for the combination of points concerning sadness. Furthermore, a total value of 100 is calculated for combinations of points related to enjoyment.

  Finally, the calculated total value is subtracted. In the present embodiment, the total value of points related to anger is subtracted from the total value of points related to pleasure, and the total value of points related to sadness is subtracted from the total value of points related to pleasure.

  As a result, the mobile phone 100 can estimate the degree of emotion of the user based on the relationship between joy and anger and the relationship between sadness and enjoyment. FIG. 27C is an example of a graph representing the degree of emotion of the user obtained by the above operation.

  The above-described estimation operation of the degree of emotion of the user is performed for each analysis target period extracted at the time of the user's call. When there are a plurality of analysis target periods, the average value is further calculated based on the plurality of estimation results. As a result, the user can know the degree of emotions during his / her call.

  In the present embodiment, as described above, the physiological emotion estimation table, the voice emotion estimation table, the emotion estimation reference table, and the point determination table are used to estimate the degree of emotion of the user. However, the estimation operation described above may be performed using another table as long as it can estimate the degree of emotion during the call.

  In the above description, the GSR difference value, tone, intonation, and jitter are used as parameters for estimating the degree of emotion of the user. However, if the degree of emotion of the user can be estimated. The parameters are not limited to these. For example, skin temperature and pulse may be used as physiological data, or other values obtained by performing a predetermined analysis based on GSR measurement values may be used.

  Furthermore, the number of parameters used for estimation of emotions is not limited to the above. By using more parameters used for estimating emotions, the accuracy of the estimation result of the degree of emotions of the user is improved.

  In the above, in order to estimate the degree of emotion of the user, the analysis target period is set from the user's utterance period, but not limited to this, all physiological data during the user's call time and The degree of emotions may be estimated based on the voice data.

  The various reference values described above may be set by determining specific values in advance, or may be set for each user according to characteristics such as the health condition and personality of each user.

  FIG. 28 is a diagram illustrating an example of contents displayed on the main display unit 13 when the user uses the mobile phone 100 according to the fourth embodiment. In the following description, an operation in which the mobile phone 100 estimates the degree of emotions during a user's call is referred to as emotions.

  FIG. 28A shows a display example of the main display unit 13 when the user ends the call. The main display unit 13 displays the call time of the user, and also displays an end button 131 and an emotional button 180.

  FIG. 28B shows a display example of the main display unit 13 when the user selects the emotion button 180 in the display state of FIG.

  In FIG. 28 (b), the main display unit 13 displays a graph having a vertical axis composed of the degree of joy and anger and a horizontal axis composed of the degree of sadness and pleasure, and an end button 131. In the graph, an estimated value of the degree of emotions during the user's call is plotted. Thereby, the user can know the degree of emotions during his / her call.

  When the user selects the end button 131 by operating the cursor button KK, the enter button KS, or the like of FIG. 1 while the main display unit 13 is in the display state of FIGS. The emotional operation of the telephone 100 can be terminated.

  Note that the contents of FIGS. 8A and 8B may be displayed on the main display unit 13 before the user's call (for example, at the time of outgoing and incoming calls).

  Furthermore, the mobile phone 100 may display the contents of FIG. 28B in real time by performing the above-described emotions during the user's call and for each user's utterance period.

  In FIG. 28 (b), the plotted points in the graph indicate the average value of the degree of emotion of the user estimated for each of a plurality of speaking periods during a call. However, the present invention is not limited to this, and in FIG. 28 (b), all the estimated contents for each utterance period during a user's call may be plotted. In this case, the memory 12 may store the estimated content and voice data for each utterance period during the user's call in association with the plot. Here, when the user selects a specific plot, the main display unit 13 displays the estimated contents, and the call speaker 15b is set to output the audio data, so that the user can select his / her own plot. The degree of emotions at the time of speaking can be reconfirmed.

  In FIG. 28 (b), a two-dimensional graph is used to display the estimation result of the degree of joy, anger, and emotion of the user. The estimation results for the degree of joy, anger, sadness, and enjoyment are respectively shown. It may be represented as a bar graph.

  Further, in the present embodiment, in order to estimate the degree of emotion of the user, the reference combination for joy, anger, sadness, and enjoyment is set in FIG. Instead, the above-described reference combination may be set for various emotions such as surprise, fear, anxiety and affection. In this case, the user can obtain information on various emotions.

  A communication program according to the present embodiment will be described. 29 to 31 are flowcharts illustrating an example of a communication program according to the fourth embodiment.

  According to the communication program according to the present embodiment, the control unit 10 in FIG. 2 operates as follows.

  First, the control unit 10 in FIG. 2 determines whether or not a command signal for turning on the emotional mode is received by the operation of the input operation unit 11 by the user (step S100). Turning on the emotional mode means that the mobile phone 100 is in a state where the cellular phone 100 can perform the emotional and emotional operation described above.

  When the control unit 10 receives a command signal to turn on the emotion mode, the control unit 10 performs the same operations as those in steps S31 to S33 described in the second embodiment (steps S101 to S103). In step S103, when there is a response, the control unit 10 starts measuring physiological data and recording voice data (step S104).

  Next, the control unit 10 determines whether or not the communication has ended (step S105). When the communication is not terminated, the control unit 10 repeats the operation in step S104. On the other hand, when the communication is completed, the control unit 10 ends the measurement of physiological data and the recording of voice data (step S106).

  Subsequently, the control unit 10 identifies the user's utterance based on the recorded voice data (step S107). And the control part 10 discriminate | determines whether there exists a user's utterance (step S108).

  When there is a user's utterance, the control unit 10 specifies the time of the user's utterance and sets the above-described analysis target period for each utterance (step S109).

  The control unit 10 estimates the degree of emotion at the time of the user's utterance based on the measured physiological data and the recorded voice data for each set analysis target period (step S110).

  Then, the control unit 10 calculates an average value of the degree of emotions during the call based on the estimated degree of emotions (step S111).

  Thereby, the control unit 10 displays the estimated degree of emotion during the call on the main display unit 13 (step S112). Finally, the control unit 10 stores the degree of emotions and emotions estimated in the history data storage unit 124 of FIG. 3 as history data (step S113). Thereby, the control part 10 complete | finishes the communication program which concerns on this Embodiment.

  Moreover, the control part 10 complete | finishes the communication program which concerns on this Embodiment, when there is no user utterance in said step S108.

  In step S100, if the emotion mode is not turned on, the control unit 10 performs the same operation as steps S50 to S53 of the second embodiment (steps S120 to S123). When the communication ends in step S123, the control unit 10 ends the communication program according to the present embodiment.

  In the communication program according to the present embodiment described above, the degree of emotional emotion estimated for each user call by the operation in step S113 is stored as history data in the history data storage unit 124 of FIG. Thus, the user can obtain information about his / her emotions during past calls by calling the history data from the history data storage unit 124.

  In the above description, in the description of FIG. 28, the description of the operation based on the operation by the user of the end button 131 and the emotion button 180 displayed on the main display unit 13 is omitted. 28 terminates the communication program by selecting the end button 131 in FIG. 28, and causes the main display unit 13 to display the degree of emotion that is estimated when the user selects the emotion button 180.

  Further, in the above description, the mobile phone 100 stores the estimated degree of emotions and emotions as history data, but the mobile phone 100 may not store the estimated degree of emotions and emotions as history data.

  As described above, in the present embodiment, the control unit 10 determines the user's utterance period (analysis target period) for the telephone speaker 15b, and the user's biometric information is detected during the user's utterance period. Thereby, biometric information depending on the other party and the content of the call can be acquired.

  In the present embodiment, the control unit 10 estimates the degree of emotion of the user based on the biological information detected by the physiological data measurement unit 20 and the speaker 15b for calling. Thereby, the user's emotions depending on the communication partner can be recognized.

  In the above description, the physiological emotion estimation table and the voice emotion estimation table of FIG. 25 and the emotion estimation reference table and point determination table of FIG. 26 are used to estimate the degree of emotion. For example, the user's emotion level may be estimated by using only other physiological data and other estimation tables. Alternatively, the user's emotion level may be estimated by using only voice data. It may be estimated.

  In the above, the degree of emotions at the time of the user's utterance is estimated as the psychological state, but not limited to this, the user's lie is estimated based on biological information, or the degree of tension is estimated. May be. In this case, the user can obtain various information about his / her psychological state at the time of speaking.

  The mobile phone 100 may detect the user's biometric information and estimate the degree of emotions based on the detected biometric information even when the phone call is not in progress. As will be described later in another embodiment, for example, the mobile phone 100 may detect the user's biometric information when the user creates an e-mail. In this case, the user can obtain information about the degree of emotions when composing an e-mail to his / her specific communication partner.

  As will be described later in another embodiment, the mobile phone 100 may transmit the detected biological information or information about the estimated degree of emotions to other communication devices.

  In the present embodiment, the values set in the respective tables may be set for each communication partner (call partner) as shown in the first embodiment, or may not be set for each communication partner. Good.

(Fifth embodiment)
The mobile phone 100 according to the fifth embodiment has the same configuration and operation as the mobile phone 100 according to the first embodiment except for the following points.

  Mobile phone 100 according to the present embodiment stores a mail operation setting table (to be described later) in operation setting storage unit 121 in FIG.

  The cellular phone 100 measures the physiological data of the user at the time of creating the e-mail. Then, similarly to the first embodiment, the mobile phone 100 estimates the psychological state at the time of creating the user's e-mail based on the measured physiological data and the psychological state estimation table of FIG.

  Furthermore, the mobile phone 100 according to the present embodiment can add predetermined pictograms corresponding to the psychological state or attach files such as predetermined images and music to the e-mail created by the user. it can.

  The mail operation setting table will be described. FIG. 32 is a diagram illustrating an example of contents stored in the operation setting storage unit 121 of FIG. The table in FIG. 32 represents an example of a mail operation setting table stored in the operation setting storage unit 121.

  According to FIG. 32, the emotion character added to the text of the email created by the mobile phone 100 and the emotion image attached to the created email are based on the measured physiological data and the psychological state estimation table of FIG. It is classified according to the determined psychological state level.

  For example, as emotional characters for psychological state level 1, "(^^); F (^^); F", "Doki (◎. ◎) DOK", "(F_F;)" and "(" Q " ) "Or the like. Further, as an emotion image for the psychological state level 1, an image reminiscent of a person being very nervous, an image representing the degree of tension as a wave, and the like are associated with each other.

  For example, the cellular phone 100 determines that the psychological state level at the time of creating the user's e-mail is 1 based on the physiological data measured at the time of creating the user's e-mail and the psychological state estimation table of FIG. In this case, emotional characters such as “(^^); f (^^); f” are added to the e-mail based on the mail operation setting table of FIG. 32, or it is reminiscent of being very nervous. Attach an image. Thereby, the mobile phone 100 according to the present embodiment can transmit an e-mail according to the psychological state of the user to the communication partner. Thereby, the user can tell the communication partner his / her psychological state at the time of e-mail creation.

  FIGS. 33 and 34 are diagrams illustrating an example of contents displayed on the main display unit 13 when the user uses the mobile phone 100 according to the fifth embodiment.

  The user operates the input operation unit 11 of the mobile phone 100 when creating an e-mail.

  FIG. 33A shows a display example of the main display unit 13 when the user finishes creating the e-mail. The main display unit 13 displays the contents of the e-mail created by the user and displays a send button 140, an edit button 141, and a sub button 142.

  Here, the user can select the transmission button 140, the edit button 141, and the sub button 142 by operating the cursor button KK, the determination button KS, and the like of FIG.

  FIG. 33B shows a display example of the main display unit 13 when the user selects the transmission button 140. The main display unit 13 displays the psychological state of the user estimated based on the biological information detected during the creation of the user's e-mail in a new window 13S, as well as an emotion addition button 140a and an emotion addition A none button 140b is displayed.

  The user can select the emotion addition button 140a and the no emotion addition button 140b by operating the cursor button KK and the determination button KS of FIG.

  FIG. 34C shows a display example of the main display unit 13 when the user selects the emotion addition button 140a. The main display unit 13 displays that the e-mail is sent with the emotion image shown in FIG. 32 attached to the e-mail created by the user in a new window 13S, and includes an end button 131, an edit button 141, and a sub A button 142 is displayed.

  FIG. 34D shows another display example of the main display unit when the user selects the emotion addition button 140a. The main display unit 13 displays a message indicating that the emotional character of FIG. 32 has been added to the e-mail created by the user in a new window 13S and that the e-mail has been transmitted, and also includes an end button 131, an edit button 141, and a sub button. 142 is displayed.

  Here, in the display state of FIGS. 34C and 34D on the main display unit 13, the user operates the cursor button KK and the determination button KS of FIG. The sub button 142 can be selected.

  FIG. 34E shows a display example of the main display unit 13 of the mobile phone 100 of the communication partner who has received the electronic mail created by the user. When an emotional image is attached to an e-mail created by the user and sent, the main display unit 13 of the communication partner that receives the e-mail receives the contents of the e-mail created by the user and is created by the user. An image 144 attached to the e-mail, a reply button 143, an edit button 141, and a sub button 142 are displayed.

  FIG. 34F shows another display example of the main display unit 13 of the mobile phone 100 of the communication partner who has received the electronic mail created by the user. As shown in FIG. 34 (d), when an emotional character is added to an e-mail created by the user and transmitted, the main display unit 13 of the communication partner that received the transmission displays the e-mail created by the user. The contents of the mail, emotion characters 145 added to the electronic mail created by the user, a reply button 143, an edit button 141, and a sub button 142 are displayed.

  In FIGS. 34E and 34F, the user can select the reply button 143, the edit button 141, and the sub button 142 by operating the cursor button KK, the determination button KS, and the like in FIG.

  In the above, when the user selects the edit button 141, the user can edit the content of the e-mail created by the user. Further, when the user selects the sub button 142, the user can perform other functions (for example, registration of the electronic mail address of the communication partner in the personal information data).

  When the user selects the end button 131, the user can end the e-mail creation operation and transmission operation of the mobile phone 100. Furthermore, when the user selects the reply button 143, a reply e-mail for the received e-mail can be created.

  A communication program according to the present embodiment will be described. 35 and 36 are flowcharts illustrating an example of a communication program according to the fifth embodiment.

  According to the communication program according to the present embodiment, the control unit 10 in FIG. 2 operates as follows.

  First, in FIG. 2, the control unit 10 determines whether or not a command signal for turning on the emotion mail mode is received by the operation of the input operation unit 11 by the user (step S200). “Emotion mail mode on” means that the mobile phone 100 activates a function of adding emotion characters according to a user's psychological state or attaching an emotion image to an email created by the user. .

  When the control unit 10 receives a command signal to turn on the emotion mail mode, the control unit 10 determines whether or not creation of an e-mail is started by the user operating the input operation unit 11 (step S201).

  When the creation of the user's email is started, the control unit 10 starts measuring physiological data (step S202).

  Subsequently, the control unit 10 determines whether or not the transmission button 140 is selected by the user operating the input operation unit 11 (step S203). When the transmission button 140 is selected, the control unit 10 ends the measurement of physiological data, and estimates the psychological state during creation of the user's e-mail based on the measured physiological data (step S204). .

  And the control part 10 displays the estimation result of a user's psychological state on the main display part 13 (step S205). Here, the control unit 10 determines whether or not the user has selected the emotion addition button 140a (step S206).

  When the emotion addition button 140a is selected, the control unit 10 adds the emotion character to be added to the email created based on the estimated psychological state of the user and the email operation setting table of FIG. 32 or the created email. The emotion image to be attached to is selected (step S207).

  Here, the selection of emotion characters and emotion images by the control unit 10 may be performed by setting specific emotion characters and emotion images in advance according to the communication partner. Moreover, the control part 10 may select an emotion character and an emotion image based on operation of the input operation part 11 of a user.

  Thereafter, the control unit 10 adds an emotion character or attaches an emotion image to the created e-mail (step S208). Finally, the control unit 10 transmits an e-mail created by the user (step S210). Thereby, the communication program according to the present embodiment ends.

  When the emotion addition button 140a is not selected in step S206, the control unit 10 determines whether or not the emotion addition no button 140b is selected (step S209). When the no emotion addition button 140b is not selected, the control unit 10 repeats the operation of step S206. On the other hand, when the no emotion addition button 140b is selected, the control unit 10 performs the operation of step S210.

  In addition, when the emotion mail mode is not turned on in step S200, the control unit 10 determines whether the control unit 10 has started creating an e-mail when the user operates the input operation unit 11 as in step S201. It is determined whether or not (step S220). Here, the control part 10 repeats the operation | movement of the said step S200, when creation of an email is not started. On the other hand, when the creation of the e-mail is started, the control unit 10 determines whether or not the send button 140 has been selected (step S221).

  When the transmission button 140 is selected, the control unit 10 performs the operation of step S210, and the control unit 10 ends the communication program according to the present embodiment.

  As described above, in the present embodiment, when the user operates the input operation unit 11 to create an e-mail to be transmitted to an arbitrary partner, the biometric information of the user is detected. Thereby, biometric information depending on the partner of the e-mail or the content of the e-mail can be acquired.

  In the above example, the mobile phone 100 detects the biometric information when the user's mail is created. However, the present invention is not limited to this, and the mobile phone 100 detects the biometric information when the user's e-mail is transmitted. May be. Furthermore, the mobile phone 100 may detect the user's biometric information when an e-mail is received and when the received e-mail is being browsed.

  In this case, when the user's biological information is detected when the user's e-mail is transmitted, when the e-mail is received, and when the received e-mail is viewed, the mobile phone 100 can detect the e-mail partner or the e-mail. The biometric information of the user depending on the contents of the mail can be acquired.

  In the present embodiment, the control unit 10 estimates the user's psychological state based on the biological information detected by the physiological data measurement unit 20. Then, information indicating the estimated psychological state of the user is inserted into the e-mail created by the input operation unit 11 by the control unit 10. As a result, an electronic mail in which information indicating the user's psychological state is inserted is transmitted to the communication partner.

  In the present embodiment, emotion characters and emotion images are set according to the psychological state level shown in FIG. 32, but not limited to this, the degree of tension of the user, the utterance or use of the user's lie Emotion characters and emotion images may be set in accordance with the estimation results of various psychological states such as the person's emotions. In this case, the user can convey various information about his / her psychological state to the communication partner.

  In the mail operation setting table of FIG. 32, emotion characters to be added to the email created by the user and emotion images to be attached to the email are set, but not limited to this, For example, a specific music pattern may be set according to the psychological state of the user. In this case, by attaching a music pattern corresponding to the user's psychological state to the created electronic mail, the user can convey information about his / her psychological state to the communication partner using music.

  In the above description, the psychological state estimation table of FIG. 5 is used to determine the psychological state level. However, the estimation of the user's psychological state based on the biological information is not limited to using the psychological state estimation table of FIG. If biometric information is used, the psychological state level may be determined using other estimation tables using only physiological data, or the user's voice data is obtained at the time of e-mail creation and the voice data is used. The psychological state level may be determined. Furthermore, the psychological state level may be determined using both physiological data and voice data.

  The mobile phone 100 may detect the user's biometric information during a call even if the e-mail is not being created. In this case, for example, after the user's call, the mobile phone 100 transmits an e-mail to which an emotion character related to the user's psychological state is added or an e-mail to which an emotion image is attached to the communication partner. A person can convey various information about his / her psychological state during a call to a communication partner.

(Sixth embodiment)
The mobile phone 100 according to the sixth embodiment has the same configuration and operation as the mobile phone 100 according to the first embodiment except for the following points.

  Mobile phone 100 according to the present embodiment measures physiological data during a user's call and estimates a psychological state. In addition, the mobile phone 100 according to the present embodiment records voice data during a user's call, and the voice data for a specific period is recorded from the voice data recorded based on the measured physiological data of the user. Data can be extracted and stored. Thereby, the user can reproduce | regenerate the audio | voice data (call content) of a specific period.

  Here, the specific period means, for example, a period when the physiological data of the user is in a specific state, that is, when the psychological state is estimated to be tense based on the physiological data. . In addition, this specific period is not restricted to the period when the user is tense.

  In the present embodiment, as described in the first embodiment, GSR, skin temperature, and pulse are used as physiological data. As the audio data, as described in the second embodiment, the recorded voice of the user's conversation is used.

  FIG. 37 is a diagram for explaining a method of extracting voice data for a specific period based on changes in physiological data during a user's call. As shown in FIG. 37, the mobile phone 100 stores the user's skin temperature, GSR, and voice data from the start of the user's call to the end of the call when the user's call ends.

  Here, in the present embodiment, the psychological state estimation table storage unit 122 of FIG. 3 stores various reference values related to the psychological state estimation table of FIG. The reference values TTH and GTH for are stored.

  The mobile phone 100 compares the measured skin temperature and GSR measurement values with the reference values TTH and GTH. At the time of comparison between the measured skin temperature and the reference value TTH, as shown in FIG. 37, the mobile phone 100 specifies periods when the measured value is lower than the reference value TTH as skin temperature lowering periods Sa1 to Sa3. .

  In general, it is considered that a human is likely to be in a tension state when the skin temperature is low. Therefore, it is estimated that the user is in a tense state during the skin temperature decrease period Sa1 to Sa3.

  On the other hand, at the time of comparison between the measured GSR and the reference value GTH, the mobile phone 100 specifies a period in which the GSR measurement value exceeds the reference value GTH as GSR detection periods Ga1 and Ga2, as shown in FIG.

  In general, it is considered that a person is likely to be in a tension state when the GSR is high. Therefore, it is estimated that the user is in a tense state during the GSR detection periods Ga1 and Ga2.

  Here, in this Embodiment, in order to detect a user's tension state accurately, the overlap period of said specified skin temperature fall period Sa1-Sa3 and GSR detection period Ga1, Ga2 is detected. Then, the mobile phone 100 uses the overlapping period of the detected skin temperature decrease periods Sa1 to Sa3 and the GSR detection periods Ga1 and Ga2 to select a specific call period from the entire voice data ADT from the start of the call to the end of the call. Extract voice data of AD1 and AD2. As shown in FIG. 37, in the specific call periods AD1 and AD2, the periods indicated by the symbols et1 and et2 are additional periods that are added with a margin before and after the overlap period. The lengths of the additional period et1 and the additional period et2 may be the same or different from each other. By setting such additional periods et1 and et2, the mobile phone 100 can also extract audio data before and after the user is nervous.

  The voice data of the specific call periods AD1, AD2 may be stored as history data in the history data storage unit 124 of FIG. 3, for example. In this case, the user can reproduce the content of the call at the time of tension during the call by calling the history data.

  FIG. 38 is a diagram illustrating an example of contents displayed on the main display unit 13 when the user uses the mobile phone 100 according to the sixth embodiment.

  The user operates the input operation unit 11 of the mobile phone 100 when making a call.

  FIG. 38A shows a display example of the main display unit 13 during a call. The main display unit 13 displays the current call time when the user is talking, indicating that the user's biometric information is being detected and recording voice data.

  FIG. 38B illustrates a display example of the main display unit 13 when the user ends the call. The main display unit 13 displays a user's call time, a user's psychological state estimated based on biometric information detected during the user's call, an end button 131 and playback buttons 150 and 151.

  Here, the user can select the end button 131 and the reproduction buttons 150 and 151 by operating the cursor button KK and the determination button KS of FIG.

  The two playback buttons 150 and 151 in FIG. 38 (b) correspond to the number of the above-mentioned specific call periods AD1 and AD2 that are detected during the user's call.

  FIG. 38C shows a display example of the main display unit 13 and playback from the call speaker 15b when the user selects the playback buttons 150 and 151 when the main display unit 13 is in the display state of FIG. An example of the contents is shown. In FIG. 38C, the display content of the main display unit 13 is the same as the display content shown in FIG. However, when the playback buttons 150 and 151 are selected, the voice data recorded in the above-described specific call periods AD1 and AD2 is played from the call speaker 15b.

  In the above, when the user selects the end button 131 by operating the cursor button KK, the enter button KS, or the like of FIG. 1, the reproduction operation of the audio data to the user ends.

  The reproduction of the audio data during the specific call period as described above is not limited to immediately after the call ends, but the user's past audio data is stored in the history data storage unit 124 of the memory 12, and at any point in time, The voice data of the specific call period as described above may be reproduced by calling the stored voice data. In this case, the user can call and reproduce the past audio data stored in the history data storage unit 124 of FIG. 3 by operating the input operation unit 11 of FIG.

  In this case, the storage of the voice data in the history data storage unit 124 may be performed for each communication partner as in the first embodiment.

  A communication program according to the present embodiment will be described. 39 to 41 are flowcharts showing an example of a communication program according to the sixth embodiment. According to the communication program according to the present embodiment, the control unit 10 in FIG. 2 operates as follows.

  First, the control unit 10 in FIG. 2 determines whether or not a command signal indicating that a call is to be made to another telephone is received by the operation of the input operation unit 11 by the user (step S300). When the control unit 10 receives a command signal for transmission, the control unit 10 determines whether or not there is a response from the communication partner (step S301). When there is a response, the control unit 10 starts measuring physiological data and recording voice data (step S304).

  On the other hand, when the control unit 10 does not receive a command signal to make a call in step S300, the control unit 10 determines whether there is an incoming call from another telephone (step S302). When there is no incoming call, the control unit 10 repeats the operation of step S300. On the other hand, when there is an incoming call from another telephone, the control unit 10 determines whether or not a command signal for responding to the incoming call has been received (step S303). When there is a response, the control unit 10 performs the operation of step S304.

  After performing the operation of step S304, the control unit 10 determines whether or not the communication has ended (step S305).

  When the communication is completed, the control unit 10 ends the measurement of physiological data and the recording of voice data (step S306).

  And the control part 10 discriminate | determines whether the measurement value of skin temperature and GSR exceeded reference value TTH and GTH set corresponding to each among the measured physiological quantity data (step S307). . When both the skin temperature and the GSR measurement results do not exceed the reference values TTH and GTH, the control unit 10 performs an operation of step S310 described later.

  When both the skin temperature and GSR measurement results exceed the reference values TTH and GTH, the control unit 10 determines a specific call period (step S308). And the control part 10 extracts the audio | voice data of a specific call period (step S309).

  Thereafter, the control unit 10 estimates the psychological state during communication of the user based on the measured physiological quantity data and the psychological state estimation table of FIG. 5 (step S310), and the estimated psychological state during communication of the user. The state is displayed on the main display unit 13 (step S311).

  The control unit 10 determines whether or not the playback buttons 150 and 151 are selected by the user operating the input operation unit 11 during the operation of step S311 (step S312). When the reproduction buttons 150 and 151 are selected, the control unit 10 reproduces the voice data extracted in step S309 from the call speaker 15b (step S313). On the other hand, the control unit 10 determines whether or not the end button 131 has been selected by the user operating the input operation unit 11 when the playback buttons 150 and 151 are not selected or after the operation of step S313. (Step S314).

  When the end button 131 is selected, the control unit 10 updates the content of the history data in FIG. 7 based on the communication partner, the psychological state estimation result, and the extracted voice data (step S315). Thereby, the communication program according to the present embodiment ends.

  In this example, as in the first embodiment, it is assumed that the control unit 10 identifies a specific communication partner by acquiring information about the communication partner at the time of outgoing or incoming.

  In the present embodiment, it is not necessary to estimate the user's psychological state during the entire call as shown in step S310.

  In the above description, the reference values set for the skin temperature and the GSR measured to determine the specific call period may be set by setting a specific value in advance, and each user's health It may be set for each user according to characteristics such as state and personality.

(Examples of other communication programs in the sixth embodiment)
The communication program according to the sixth embodiment is not limited to the one described with reference to FIGS. Hereinafter, another example of the communication program according to the sixth embodiment will be described. 42 to 44 are flowcharts showing other examples of the communication program according to the sixth embodiment. According to the communication program shown in FIGS. 42 to 44, the control unit 10 in FIG. 2 operates as follows.

  First, the control unit 10 in FIG. 2 performs the same operation as the above-described steps S300 to S303 (steps S320 to S323).

  When there is a response in steps S321 and S323, the control unit 10 starts recording voice data (step S324) and starts measuring physiological data (step S325).

  And the control part 10 discriminate | determines whether the predetermined reaction determination period passed (step S326). The reaction determination period is a period for determining whether or not the user is nervous.

  When the reaction determination period has not elapsed, the control unit 10 repeats the operation of step S325. On the other hand, when the reaction determination period has elapsed, the control unit 10 determines whether or not the skin temperature and the GSR measurement results of the measured physiological quantity data both exceed the reference values set in correspondence with each other. (Step S327).

  When both the skin temperature and the GSR measurement value exceed the reference values, the control unit 10 continues recording the audio data for a predetermined period (step S328), and ends the audio data recording when the predetermined period elapses. (Step S329). On the other hand, when both the skin temperature and the GSR do not exceed the reference values, the control unit 10 ends the recording of the sound data and deletes the sound data recorded during the reaction determination period (step S330).

  The controller 10 determines whether or not the communication has ended after the operation of step S329 or after the operation of step S330 (step S331).

  When the communication is not terminated, the control unit 10 repeats the operation in step S324. On the other hand, when the communication is completed, the control unit 10 ends the measurement of physiological data (step S331b), and estimates the psychological state during communication based on the measured physiological data (step S332). Thereafter, the control unit 10 displays the estimated psychological state during communication of the user on the main display unit 13 (step S333).

  And the control part 10 performs the operation | movement similar to the above-mentioned step S312-S315 (step S334-S337). As a result, the communication program as another example of the sixth embodiment ends.

  According to the communication program described with reference to FIGS. 42 to 44 described above, since it is not necessary to record the voice data of the entire user's call, the capacity of data stored in the memory 12 of FIG. Data processing can be performed.

  As described above, in the present embodiment, the user's voice data is stored in the user's memory 12 when the control unit 10 detects the biological information. Thereby, the user can easily grasp the state of the user's voice depending on the other party based on the stored content.

  In the present embodiment, the control unit 10 determines whether or not the physiological data (skin temperature and GSR) detected by the control unit 10 exceeds various reference values, and the physiological data exceeds the reference value. If it is determined that the voice data of the user has been exceeded, the voice data of the user during the specific call period including the time point exceeding the reference value is stored in the memory 12. Thereby, the user can easily grasp the state of the voice when the biological information greatly reacts depending on the other party based on the stored content.

  In the above, skin temperature and GSR are used in the physiological data to determine the specific call period. However, the present invention is not limited to this, and only the skin temperature is used as a parameter for determining the specific call period. Alternatively, only GSR may be used, only pulse may be used, or a combination thereof may be used.

  Further, not only physiological data but also biological information, tone, inflection and jitter obtained by analyzing voice data may be used. In this case, a reference value is set for each parameter.

  In the present embodiment, the specific call period is determined based on the magnitude relationship with respect to the reference value of the biometric information. It may be done.

  The mobile phone 100 may detect the user's biometric information even when not in a call. For example, the mobile phone 100 may detect the user's biometric information when the user creates an e-mail. In this case, the user can obtain information about the psychological state at the time of creating an e-mail to his / her specific communication partner. Then, when the biometric information exceeds a predetermined reference value when the user's e-mail is created, the contents of the user's e-mail and voice data may be recorded.

  As will be described later in another embodiment, the mobile phone 100 may transmit the extracted voice data or information about the estimated psychological state to another communication device.

(Seventh embodiment)
The mobile phone 100 according to the seventh embodiment has the same configuration and operation as the mobile phone 100 according to the first embodiment except for the following points.

  Mobile phone 100 according to the present embodiment stores a later-described question identification table in voice analysis table storage unit 125 in FIG.

  Based on the question identification table, the mobile phone 100 can identify the question of the other party at the time of the user's call, and can determine whether or not the user's answer to the question is a lie.

  In the present embodiment, GSR is used as physiological data. As the voice data, the voice of the user's conversation recorded as in the above-described embodiments is used.

  FIG. 45 is a diagram for explaining an example of contents stored in the voice analysis table storage unit 125 of FIG. 3 and a method for determining whether or not a user's answer is a lie.

  First, the question identification table will be described. FIG. 45A shows an example of a question identification table stored in the voice analysis table storage unit 125 of FIG. In the example of FIG. 45 (a), the mobile phone 100 identifies a question when the inflection of the utterance of the other party is increased and the ending word is “Is?”, And the other In some cases, it indicates that it is not a question. Thereby, mobile phone 100 according to the present embodiment can identify whether or not the utterance of the other party during a call is a question.

  As shown in FIG. 45 (b), when the mobile phone 100 identifies the questions Qu1 and Qu2 based on the call partner's utterance and the question identification table, it identifies the user's responses Ans1 and Ans2 to the questions Qu1 and Qu2. To do.

  Then, the mobile phone 100 determines whether or not the GSR measurement value in the period identified as the user's answers Ans1 and Ans2 exceeds a predetermined reference value GTH as shown in FIG. 45 (c).

  When the GSR measurement value exceeds the predetermined reference value GTH, the mobile phone 100 determines that the user's answer Ans1 corresponding to the measurement is a lie. Further, when the GSR measurement value does not exceed the predetermined reference value GTH, the mobile phone 100 determines that the user's answer Ans2 corresponding to the measurement is true.

  In general, it is considered that a person is likely to be in a tension state when the GSR is high. Therefore, when the GSR measurement value exceeds the predetermined reference value GTH, it is estimated that the user is in a tension state by answering a lie. The reference value GTH may be set by determining a specific value in advance, or may be set for each user according to characteristics such as the health condition and personality of each user.

  A series of operations including identification of the other party's question, identification of the user's answer and determination of whether or not the answer is a lie by the mobile phone 100 described above is called a lie determination operation.

  The mobile phone 100 according to the present embodiment performs the above-described lie determination operation and also performs a lie response operation described later for notifying the user of the determination result when determining whether or not the user's response is a lie. Do. In addition, when the user's call ends, the mobile phone 100 performs a lie diagnosis operation described later for notifying the user of a diagnosis result indicating how many lies the answer is during the call.

  The lie response operation and the lie diagnosis operation are performed based on a lie notification operation setting table described below. Hereinafter, the time when the user's answer is determined to be a lie is referred to as a lie answer, and the time when the user's call is completed and the number of lies in the user's answer is diagnosed is referred to as a lie diagnosis time. .

  The lie notification operation setting table will be described. 46 is a diagram showing an example of a lie notification operation setting table stored in the operation setting storage unit 121 of FIG.

  In FIG. 46, combinations of a lie melody pattern, a lie emission pattern, and a lie display pattern are classified for each of the lie answer time and the lie diagnosis time. For example, in the case of a lie utterance, “boo boo” is set as the lie melody pattern, “red light” is set as the lie light emission pattern, and “lie lie” is set as the lie display pattern.

  Thereby, the mobile phone 100 performs an operation based on each of the above patterns at the time of a lie answer and a lie diagnosis. Thereby, the user can know the answer of his / her lie.

  As shown in FIG. 46, in the present embodiment, a lie level for performing the above-described lie diagnosis operation is set according to the number of lies during a user's call. For example, when the user answers three times during a call, if it is determined that all those answers are lies, lie level 1 is determined, and two of the three answers are lies Lie level 2 is determined, and lie level 3 is determined when one of the three answers is a lie.

  The method for determining the lie level is not particularly limited. For example, in addition to the above, it may be determined in accordance with the ratio of the number of times of lies to the total number of answers during a call. Further, the number of lie levels is not limited to the above.

  At the time of lie diagnosis, combinations of lie melody patterns, lie light emission patterns, and lie display patterns are classified for each lie level. For example, for lie level 3 at the time of lie diagnosis, “boo boo” is set as the lie melody pattern, “red light” is set as the lie emission pattern, and there are many lies as the lie display pattern. A lie level meter represented by a bar graph and a comment “Large liar!” Are set.

  Thereby, the mobile phone 100 performs the above-described operation of each pattern based on the determination result of the lie level at the time of lie diagnosis. Thereby, the user can know the number of times the lie is answered during the call.

  Here, in the mobile phone 100 according to the present embodiment, as described above, it is not necessary to determine only the lie or true of the answer when the user answers. As will be described later, the mobile phone 100 may determine the degree of the lie of the answer when the user answers. In this case, the setting contents of the lie notification operation setting table are different from the above.

  An example of the determination method of the lie level in this case and an example of the lie notification operation setting table used at the time of this determination will be described.

  47 is a diagram for explaining a determination method for determining the degree of a user's answer lie and a diagram illustrating another example of a lie notification operation setting table stored in the operation setting storage unit 121 of FIG. is there.

  FIG. 47A shows a determination method for determining the degree of lie of the user's answer. In this example, the GSR measurement result at the time of the user's answer is divided into levels by two reference values GTH1 and GTH2. Thereby, a lie level indicating the degree of lie of the answer is determined for each user's answer based on the magnitude relationship between the GSR measurement result and the two reference values GTH1 and GTH2. As shown in FIG. 47, the two reference values GTH1 and GTH2 are larger in this order. Thereby, in this example, the lie level is divided into 1-3.

  For example, when the GSR measurement value at the time of the user's answer exceeds both the reference values GTH1 and GTH2, the answer lie level is 3 which is the highest. Further, when the GSR measurement value at the time of the user's answer is between the reference values GTH1 and GTH2, the lie level of the answer is 2, which indicates a medium level.

  FIG. 47B shows an example of a lie notification operation setting table based on the lie level described above. In FIG. 47 (b), combinations of lie melody patterns, lie light emission patterns, and lie display patterns are classified according to the above-mentioned lie level at the time of a lie answer.

  For example, for the lie level 2 at the time of a lie answer, “Pillariro” is set as the lie melody pattern, “Lit blue” is set as the lie light emission pattern, and the lie level is moderate as the lie display pattern. A lie level meter is set to show that there is a bar graph.

  As a result, the mobile phone 100 performs the above-described pattern operations based on the lie level when answering a lie. As a result, the user can know the degree of lie of his / her answer when answering the question of the other party.

  By the way, in the present embodiment, the mobile phone 100 stores the diagnosis result of the lie during a user's call as history data in the history data storage unit 124 of FIG. FIG. 48 is a diagram showing an example of history data including past lie diagnosis results.

  As shown in FIG. 48, in the present embodiment, the past diagnosing results for each communication partner are stored in the history data storage unit 124 of FIG. 3 as part of the history data. Thereby, the user can know the past diagnosis result of a lie for a specific communication partner by calling the history data.

  For example, in the history data of FIG. 48, the diagnosis result of the past lie is stored as the lie level 1 together with the contents described in FIG. 7 of the first embodiment, corresponding to the communication partner AA.

  In the following description, it is assumed that the lie notification operation setting table of FIG. 46 is stored in the operation setting storage unit 121 of FIG. Therefore, the mobile phone 100 may determine whether the user's answer is a lie or true during the user's call, and may determine the number of times the lie is answered during the call when the lie is diagnosed.

  49 and 50 are diagrams illustrating an example of contents displayed on the main display unit 13 when the user uses the mobile phone 100 according to the seventh embodiment.

  The user operates the input operation unit 11 of the mobile phone 100 when making a call.

  FIG. 49A shows a display example of the main display unit 13 during a user call. The main display unit 13 displays the current call time when the user is making a call and displays that the user's biometric information is detected. When it is determined that the user's answer is a lie during the user's call, the display on the main display unit 13 is switched.

  FIG. 49B is a diagram illustrating an example of contents displayed on the main display unit 13 when it is determined that the user's answer is a lie during a call. The main display unit 13 displays that the current call time and biometric information are detected, and displays a lie display pattern indicating that the user's answer is a lie.

  In the display state of the main display unit 13, the sub display unit 14 emits light with the lie emission pattern “lit red” at the time of a lie response in FIG. 46, and the lie melody pattern “boo-boo” at the time of a lie response in FIG. 46. The speaker 15a outputs sound.

  When the user or the other party operates the input operation unit 11 of the mobile phone 100, the call ends.

  FIG. 49C shows a display example of the main display unit 13 when the user ends the call. At the end of the call, the mobile phone 100 performs the lie diagnosis operation described above. As a result, the main display unit 13 displays the user's call time, and also displays a lie level meter that represents the number of times the user's lie is answered during a call, and a comment “Little liar !?”. Is done. In the display example of FIG. 49C, it is diagnosed that the user's lie level is 2. Further, an end button 131 and a cross button 160 are displayed on the main display unit 13.

  In the display state of the main display unit 13, the sub display unit 14 emits light with the lie emission pattern “lights blue” at the time of lie diagnosis in FIG. 46, and the lie melody pattern “Pyrrolillo” at the time of lie response in FIG. 46. The speaker 15a outputs sound.

  On the other hand, when the lie notification operation setting table of FIG. 47 is stored in the operation setting storage unit 121 of FIG. 3, the control unit 10 determines the degree of lie during the user's call and determines the lie notification operation setting. Perform table-based operations.

  FIG. 50D illustrates a display example of the main display unit 13 during a user call when the lie notification operation setting table of FIG. 47 is stored in the operation setting storage unit 121 of FIG.

  The main display unit 13 displays a call time of the user and a lie level meter that represents a determination result of a degree of a lie of an answer during the call of the user by a bar graph. In the display example of FIG. 50D, it is diagnosed that the user's lie level is 2. Further, an end button 131 and a cross button 160 are displayed on the main display unit 13.

  In the display state of the main display unit 13, the sub display unit 14 emits light in the lie emission pattern “light blue” at the time of a lie response in FIG. 47B, and the lie melody pattern “at the time of a lie response in FIG. The speaker 15a outputs a sound in “Pylori low”.

  49 (c) and 50 (d) on the main display unit 13, the user operates either the cursor button KK, the enter button KS, or the like in FIG. Can be selected.

  When the user selects the end button 131 by operating the input operation unit 11, the above-described lie determination operation, lie response operation, and lie diagnosis operation are ended.

  Here, the mobile phone 100 according to the present embodiment displays information about the cross game on the main display unit 13 in accordance with the determined degree of the user's answer or the number of times of the answer after the user's call ends. It may be displayed.

  FIG. 50E is a display example of the main display unit 13 when the user selects the cross button 160. According to FIG. 50 (e), the main display unit 13 displays a comment “Your liar you!” According to the degree of the user's answer or the number of answers, and the comment as a cross game. “Put the next person on the shoulder” is displayed.

  In FIG. 50E, the end button 131 is also displayed. Similarly to the above, when the user selects the end button 131 by operating the input operation unit 11, a lie determination operation and a lie answer time are displayed. Operation and operation during lie diagnosis are completed.

  A communication program according to the present embodiment will be described. 51 to 53 are flowcharts showing an example of a communication program according to the seventh embodiment. According to this flowchart, the mobile phone 100 can determine whether or not the user's answer is a lie, and can perform a lie diagnosis based on the number of lies at the end of the call.

  According to the communication program according to the present embodiment, the control unit 10 in FIG. 2 operates as follows.

  First, the control unit 10 of FIG. 2 determines whether or not a command signal for turning on the lie discovery mode is received by the operation of the input operation unit 11 by the user (step S400). Turning on the lie discovery mode means that the mobile phone 100 is in a state where it can perform the above-described lie determination operation, lie response operation, and lie diagnosis operation.

  When receiving a command signal to turn on the lie discovery mode, the control unit 10 performs the same operations as those in steps S31 to S33 described in the second embodiment (steps S401 to S403). In step S403, when there is a response, the control unit 10 starts measuring physiological data and analyzing voice data of the communication partner (step S404).

  Thereafter, the control unit 10 identifies whether the communication partner utters and whether the utterance is a question based on the question identification table of FIG. 45 (step S405). When determining that the occurrence of the communication partner is a question, the control unit 10 identifies whether or not the user has answered (Step S406). Here, when the user answers, the control unit 10 determines whether or not the GSR measurement value at the time of the user's answer exceeds the reference value GHT (step S407).

  When the GSR measurement value at the time of the user's answer exceeds the reference value GHT, the control unit 10 determines that the user's answer is a lie, and temporarily stores the fact in the memory 12 of FIG. S408).

  Then, the control unit 10 causes the main display unit 13 to display the lie display pattern corresponding to the lie answer in the lie notification operation setting table of FIG. 46, and displays the sub display unit 14 of FIG. 2 with the lie emission pattern corresponding to the lie answer. The light is emitted, and the sound is output from the speaker 15a with the melody pattern corresponding to the lie answer (step S409).

  Next, the control unit 10 determines whether or not communication has ended (step S411). Here, in step S407, when the GSR measurement value at the time of the user's answer does not exceed the reference value GHT, the control unit 10 determines that the user's answer is true, and temporarily indicates that fact in FIG. (Step S410). And the control part 10 performs operation | movement of the said step S411.

  When the communication is not terminated, the control unit 10 repeats the operation in step S404. On the other hand, when the communication is completed, the control unit 10 calculates the number of lies and the number of true replies based on the contents temporarily stored in the memory 12 in steps S408 and S410, and the lie level described above. Is determined (step S412).

  As a result, the control unit 10 causes the main display unit 13 to display a lie display pattern corresponding to the confirmed lie level based on the confirmed lie level and the lie notification operation setting table of FIG. The sub display unit 14 of FIG. 2 emits light with the lie light emission pattern corresponding to the level, and the sound is output from the speaker 15a with the melody pattern corresponding to the confirmed lie level (step S413).

  Finally, the control unit 10 stores the determined lie level as history data in the history data storage unit 124 of FIG. 3 (step S414). Thereby, the control part 10 complete | finishes the communication program which concerns on this Embodiment.

  When the lie discovery mode is not turned on in step S100, the control unit 10 performs the same operation as steps S50 to S53 of the second embodiment (steps S420 to S423). When the communication ends in step S423, the control unit 10 ends the communication program according to the present embodiment.

  In the communication program according to the present embodiment, the lie level determined for each user call by the operation in step S414 is stored as history data in the history data storage unit 124 of FIG. As a result, the user can obtain information about his / her answer during a past call by calling the history data from the history data storage unit 124.

  In the above description, in the description of FIG. 49 and FIG. 50, the operation based on the operation by the user of the end button 131 and the cross button 160 displayed on the main display unit 13 is omitted. As shown in FIG. 50, the user selects the end button 131 to end the communication program, and the user selects the cross button 160 to comment on the cross game according to the lie level determined by the user. The operation to display is performed.

  Furthermore, in the above description, the mobile phone 100 stores the determined lie level as history data. However, the mobile phone 100 may not store the determined lie level as history data.

  As described above, in the present embodiment, the voice data indicating the question from the other party is identified by the control unit 10 based on the voice data received by the wireless communication unit 30 and the antenna 31, and the voice data indicating the question is identified. The user's biological information is detected. Thereby, biometric information depending on the other party and the content of the call can be acquired.

  In the present embodiment, the lie of the user is estimated by the estimation unit based on the biological information detected by the physiological data measurement unit 20. Thereby, the user's lie depending on the communication partner can be recognized.

  The reference values GTH, GTH1, and GTH2 described above may be set for each communication partner.

  In the present embodiment, only GSR is used as physiological data in order to determine the user's answer lie. However, the present invention is not limited to this, and the parameters for determining the user's answer lie are as follows. Only the skin temperature may be used, only GSR may be used, only the pulse may be used, or a combination of these may be used.

  Further, not only physiological data but also biological information, tone, inflection and jitter obtained by analyzing voice data may be used. In this case, a reference value is set for each parameter.

  In the above description, the user's lie is determined based on the GSR measurement value only during the call by the user's mobile phone 100 and during the user's answer. The degree of lie during the call of the user may be determined based on the GSR of the entire call. In this case, the user can obtain various information related to the lie throughout the call by determining the degree of the lie based on the biological information at the time of his / her speech of the entire call.

  The mobile phone 100 may detect the user's biometric information even when not in a call. For example, the mobile phone 100 may detect biometric information when the user answers a question by e-mail. In this case, it is possible to determine the degree of lie in the e-mail of the answer to the question based on the biometric information. Further, the determined content may be transmitted as an attachment to the reply e-mail. In this case, the user can obtain information on the degree of lie when creating the reply e-mail.

  As will be described later in another embodiment, the mobile phone 100 may transmit the detected biological information or information about the estimated psychological state to another communication device.

  Furthermore, in the above, it is determined whether or not the answer is a lie during the user's call, and after the user's call, a diagnosis is made regarding the number of times the lie is answered during the call. There is no need to be done. The mobile phone 100 may only determine whether or not the answer is a lie during the user's call, or may perform only a diagnosis regarding the number of lies during the user's call.

(Eighth embodiment)
A communication system according to the eighth embodiment will be described. The communication system according to the present embodiment includes a mobile phone 100, a diagnostician phone, and a diagnostician computer according to the first embodiment.

  FIG. 54 is a diagram for explaining the outline of the communication system according to the eighth embodiment. According to the communication system 700 according to the present embodiment, a user (referred to as a patient in the present embodiment) uses the mobile phone 100 to talk to a doctor, a counselor, or other diagnostician, and at the time of the call. The biometric information can be transmitted to the diagnostician. And the diagnostician can transmit the advice with respect to the transmitted biometric information to the patient by the diagnostic computer.

  FIG. 54A shows a state in which a call is made between the patient PA and the diagnostician DO. As shown in FIG. 54A, the patient PA uses a mobile phone 100. The diagnostician DO uses the diagnostic telephone 100X. At the time of a call between the patient PA and the diagnostician DO, the mobile phone 100 detects the biological information of the user.

  Here, the mobile phone 100 may measure physiological data (GSR, skin temperature, pulse, etc.) of the patient PA as biometric information as shown in the first embodiment, or the second embodiment. As shown in FIG. 5, parameters (tone, inflection, jitter, etc.) obtained by analyzing the voice data may be measured.

  FIG. 54B shows a state at the end of a call between the patient PA and the diagnostician DO. At the end of the call, the cellular phone 100 of the patient PA transmits the biological information detected during the call, that is, the physiological data and voice data of the patient PA to the diagnostic computer 100PC of the diagnostician DO, for example, by e-mail DA1. To do. Thereby, the diagnostician DO can confirm the biological information of the patient PA by the diagnostic computer 100PC based on the transmitted email DA1.

  Then, the diagnostician DO can analyze the health state of the patient PA based on the biological information of the patient PA and the content of the call during the call in which the biological information is detected.

  FIG. 54 (c) shows a state in which the diagnostician DO provides advice regarding the health condition to the patient PA. The diagnostician DO analyzes the health condition of the patient PA, and transmits advice on the health condition to the cellular phone 100 of the patient PA using the diagnostic computer 100PC by the electronic mail DA2.

  As described above, according to the communication system 700 according to the present embodiment, the diagnostician DO can analyze the health state of the patient PA based on the biological information and the content of the call of the patient PA who is talking. Can provide accurate advice on health status. On the other hand, the patient PA can obtain accurate advice on his / her health condition based on the transmitted email DA2.

  FIGS. 55 and 56 are diagrams illustrating an example of contents displayed on the main display unit 13 when the patient PA uses the mobile phone 100 of the communication system 700 according to the eighth embodiment.

  The patient PA operates the input operation unit 11 of the mobile phone 100 when making a call.

  FIG. 55A shows a display example of the main display unit 13 of the mobile phone 100 when the patient PA calls the diagnostician DO (at the time of outgoing call). The main display unit 13 displays that the mobile phone 100 is making a call to the diagnostic telephone 100X of the diagnostician DO (in FIG. 55A, a stress diagnostic window) and the telephone number of the diagnostic telephone 100X.

  FIG. 55B shows a display example of the main display unit 13 of the mobile phone 100 during a call between the patient PA and the diagnostician DO. The main display unit 13 displays the current call time and indicates that the biological information of the patient PA is being detected.

  FIG. 56C shows a display example of the main display unit 13 of the mobile phone 100 when the call is terminated between the patient PA and the diagnostician DO. The main display unit 13 displays the call time of the patient PA at the end of the user's call, displays that the data related to the biometric information detected during the call is transmitted to the diagnostician DO, and displays a cancel button 190. Is done.

  The patient PA can select the cancel button 190 by operating the input operation unit 11 of the mobile phone 100. When the patient PA selects the cancel button 190, the data transmission operation to the diagnostician DO and the display operation of the main display unit 13 are stopped.

  When the patient PA does not select the cancel button 190, data relating to biological information is transmitted to the diagnostician DO by e-mail.

  FIG. 56D shows a display example of the main display unit 13 of the mobile phone 100 that has received advice-related data from the diagnostician DO after the call ends.

  In this case, as shown in FIG. 56 (d), the main display unit 13 displays the received electronic mail, the contents of the received mail, a reply button 143, an edit button 141, and a sub button 142.

  As a result, the patient PA can obtain advice on his / her health based on his / her biological information and the contents of the call with the diagnostician DO.

  In FIG. 56D, the various functions of the reply button 143, the edit button 141, and the sub button 142 are as described in the fifth embodiment.

  As described above, the operation of the mobile phone 100 that automatically transmits the biometric information of the patient PA detected during the call to the diagnostician DO after the call ends is referred to as a stress diagnosis operation.

  A communication program according to the present embodiment will be described. 57 and 58 are flowcharts showing an example of a communication program according to the eighth embodiment.

  According to the communication program according to the present embodiment, control unit 10 of mobile phone 100 in FIG. 2 operates as follows.

  First, the control unit 10 of the mobile phone 100 determines whether or not a command signal for turning on the stress diagnosis mode is received by the operation of the input operation unit 11 by the user (step S500). Turning on the stress diagnosis mode means that the mobile phone 100 is in a state where the above-described stress diagnosis operation can be performed.

  When the control unit 10 receives a command signal to turn on the stress diagnosis mode, has the patient PA received the command signal to transmit to the diagnostic telephone 100X of the diagnostician DO by operating the input operation unit 11? It is determined whether or not (step S501).

  When receiving a command signal for transmission, the control unit 10 performs a predetermined operation based on the command signal and determines whether or not there is a response from the diagnostician DO (step S502). When there is a response, the control unit 10 detects biological information, that is, measures physiological data and records voice data (step S503).

  Thereafter, the control unit 10 determines whether or not the communication is finished (step S504). When the communication is not terminated, the control unit 10 repeats the operation in step S503.

  On the other hand, when the communication is completed, the control unit 10 ends the measurement of the physiological data and the recording of the voice data, and transmits the measured physiological data and the recorded voice data to the diagnostic computer 100PC of the diagnostician DO. (Step S505). Thereby, operation | movement of the mobile telephone 100 by the communication program which concerns on this Embodiment is complete | finished.

  In the communication system 700 according to the present embodiment, the mobile phone 100 receives advice regarding the health condition of the diagnostician DO based on the physiological data and the voice data after the series of operations in steps S500 to S505.

  By the way, if the stress diagnosis mode is not turned on in step S500, the control unit 10 of the mobile phone 100 operates the input operation unit 11 when the patient PA operates, and instructs the diagnosis telephone DO to make a call to the diagnosis phone 100X. It is determined whether or not a signal has been received (step S510).

  And control part 10, when receiving a command signal to the effect of transmission, performs a predetermined operation based on the command signal and determines whether or not there is a response from diagnostician DO (step S511). Thereafter, when there is a response from the diagnostician DO, the control unit 10 determines whether or not the communication has ended (step S512). When communication is completed, control unit 10 ends the communication program according to the present embodiment.

  In the above description, the diagnostician DO transmits advice to the patient PA to the mobile phone 100 using e-mail. However, the diagnosis DO is not limited to this, and the diagnostician DO uses the mobile phone 100 directly to give advice to the patient PA. You may tell.

(Examples of other communication programs in the eighth embodiment)
The communication program according to the eighth embodiment is not limited to the one described with reference to FIGS. 57 and 58 described above. Hereinafter, another example of the communication program according to the eighth embodiment will be described.

  FIG. 59 is a diagram for explaining the outline of the communication system according to the eighth embodiment when another communication program is used. According to the communication system 700b in this case, the patient PA can transmit the biological information at the time of the call to the diagnostician DO during the call by calling the diagnostician using the mobile phone 100.

  FIG. 59A shows a state where a call is started between the patient PA and the diagnostician DO. As shown in FIG. 59 (a), the patient PA uses a mobile phone 100. The diagnostician DO uses the diagnostic telephone 100X.

  FIG. 59B shows a state during a call between the patient PA and the diagnostician DO. At the time of a call between the patient PA and the diagnostician DO, the mobile phone 100 detects the biological information of the user. Here, the cellular phone 100 transmits / receives data related to the call to / from the diagnostic telephone 100X of the diagnostician DO and transmits the detected biological information as an electronic mail DA1 to the diagnostic computer 100PC of the diagnostician DO.

  Thereby, the diagnostician DO can confirm the biological information of the patient PA by the diagnostic computer 100PC based on the electronic mail DA1 during the call with the patient PA. Thereby, the diagnostician DO can analyze the health state of the patient PA based on the biometric information of the patient PA and the content of the call during the call in which the biometric information is detected.

  FIG. 59 (c) shows a state in which the diagnostician DO gives advice on the health condition to the patient PA. The diagnostician DO analyzes the health condition of the patient PA, and transmits advice on the health condition to the cellular phone 100 of the patient PA using the diagnostic computer 100PC by the electronic mail DA2.

  As described above, also in the communication system 700b according to the present embodiment, the diagnostician DO can analyze the health state of the patient PA based on the biometric information and the content of the call of the patient PA who is talking. Provide accurate advice on health status. On the other hand, the patient PA can obtain accurate advice on his / her health condition based on the transmitted email DA2.

  A communication program according to this example will be described. FIG. 60 is a flowchart showing another example of the communication program according to the eighth embodiment.

  According to the communication program of this example, the control unit 10 of the mobile phone 100 in FIG. 2 operates as follows.

  First, the control unit 10 performs the operations in steps S500 to S502. When there is a response in step S502, the control unit 10 detects biological information, that is, measures physiological data and records voice data, and measures the measured physiological data and recorded voice data. Is transmitted to the diagnostic computer 100PC of the diagnostician DO (step S520).

  Thereafter, the control unit 10 determines whether or not communication has ended (step S521). When the communication is not terminated, the control unit 10 repeats the operation of step S520.

  On the other hand, when the communication is completed, the control unit 10 ends the measurement of the physiological data and the recording of the voice data, and ends the operation of transmitting the physiological data and the voice data to the diagnostic computer 100PC (step S522). Thereby, the operation of the mobile phone 100 by the communication program according to the present example ends.

  In the communication system 700b as well, the mobile phone 100 receives advice regarding the health condition of the diagnostician DO based on the physiological data and voice data after the series of operations in steps S500 to S502 and S520 to S522.

  When the stress diagnosis mode is not turned on in step S500, the control unit 10 of the mobile phone 100 performs the same operation as in steps S510 to S512.

  In the above description, the diagnostician DO transmits advice to the patient PA to the mobile phone 100 using e-mail. However, the diagnosis DO is not limited to this, and the diagnostician DO uses the mobile phone 100 directly to give advice to the patient PA. You may tell.

  As described above, in the communication systems 700 and 700b according to the present embodiment, when the patient PA is talking with the diagnostician DO having the diagnostic telephone 100X using the wireless communication unit 30 and the antenna 31 of the mobile phone 100, The biometric information of the user is detected by the quantity data measuring unit 20, the call speaker 15b, and the control unit 10. Then, during or after the call with the diagnostician DO by the wireless communication unit 30 and the antenna 31, information based on the detected biological information is transmitted to the diagnostic computer 100PC by the wireless communication unit 30 and the antenna 31. Thereby, the diagnostician DO can analyze the health condition of the user based on the information transmitted to the diagnostic computer 100PC.

  The diagnostician can transmit advice based on the analysis result to the mobile phone 100 by a telephone call by the diagnostic telephone 100X or information communication by the diagnostic computer 100PC. Thereby, the patient PA can easily receive advice based on the analysis result by the conversation with the diagnostician DO.

  The diagnostic telephone 100X and the diagnostic computer 100PC may be provided integrally.

  In the present embodiment, patient PA is assumed as the user and diagnostician DO is assumed as the communication partner, but the relationship between the user and the communication partner is not limited to this.

(Ninth embodiment)
The mobile phone 100 according to the ninth embodiment has the same configuration and operation as the mobile phone 100 according to the first embodiment except for the following points.

  In mobile phone 100 according to the present embodiment, a correction table described later is stored in correction data storage section 126 in FIG.

  Similar to the first embodiment, the mobile phone 100 detects biometric information during a user call. Here, in the present embodiment, the GSR measurement value of the physiological data among the detected biological information is corrected by the correction table. As a result, the mobile phone 100 can accurately estimate the user's psychological state (degree of tension) without being affected by the environmental state.

  The correction table will be described. 61 is a diagram showing an example of contents stored in the correction data storage unit 126 of FIG.

  In the correction table of FIG. 61, GSR measurement value correction amounts CP1 to CP3, CQ1 to CQ3, and CR1 to CR3 are set for each use region and use time of the mobile phone 100.

  In general, it is considered that the GSR measurement value changes according to the environmental state. When the temperature is low as the environmental state, the GSR is low, and when the temperature is high, the GSR is high.

  For example, the GSR measurement value correction amount is set to be smaller in the order of CP1, CP2, and CP3, smaller in the order of CQ1, CQ2, and CQ3, and smaller in the order of CR1, CR2, and CR3. Further, the GSR measurement value correction amount is set to be smaller in the order of CP1, CQ1, and CR1, smaller in the order of CP2, CQ2, and CR2, and smaller in the order of CP3, CQ3, and CR3.

  For example, in the use region “Hokkaido”, the GSR measurement value correction amount CP2 is associated with the use period “spring”, the GSR measurement value correction amount CP3 is associated with the use period “summer”, and the use period “autumn”. The GSR measurement value correction amount CP2 is associated, and the use period “winter” is associated with the GSR measurement value correction amount CP1.

  Accordingly, when the user uses the mobile phone 100 in spring in Hokkaido, the GSR measurement value by the physiological data measurement unit 20 in FIG. 20 is corrected by the GSR measurement value correction amount CP2 based on the correction table in FIG. Is done. As a result, the mobile phone 100 can accurately estimate the user's psychological state based on the corrected GSR measurement value.

  In the above, the mobile phone 100 may specify the usage region based on information from the communication base station. In addition, the mobile phone 100 may specify the use time when the control unit 10 has a management function for the current date and time.

  Here, a method of specifying the area of use by the mobile phone 100 will be described. FIG. 62 is a diagram illustrating an example of a method for the mobile phone 100 according to the ninth embodiment to specify a usage region.

  As illustrated in FIG. 62, the communication base station 800 includes, for example, a radio communication unit 810, an antenna 811, a control unit 820, and a base station communication device 830. The communication base station 800 can communicate with the user's mobile phone 100 through the wireless communication unit 810 and the antenna 811, and can transmit and receive various types of information.

  Control unit 820 includes a CPU and the like, and controls operations of radio communication unit 810 and base station communication device 830. Base station communication apparatus 830 is connected to public line network 900.

  For example, when a user makes a call with another telephone using the mobile phone 100, the voice data of the user is sent to the other telephone through the communication base station 800 and the public line network 900.

  A plurality of communication base stations 800 are installed for each region. When the mobile phone 100 is used, the mobile phone 100 communicates with a communication base station 800 located nearby among the plurality of communication base stations 800.

  Each communication base station 800 can transmit information regarding its own location to the user's mobile phone 100. As a result, the mobile phone 100 can specify the area of use based on the information regarding the location from the communication base station 800.

  However, the method of specifying the use area is not limited to the above, and may be performed by the user's operation of the input operation unit 11 of FIG.

  In the present embodiment, the GSR measurement value correction amount has been described as an example of the correction table. However, the correction table is not limited to this, and the correction amount for the skin temperature and pulse obtained from the physiological data of the user is included in the correction table. It may be set. In this case, since each measurement value is corrected for a plurality of physiological data, the estimation of the psychological state becomes more accurate.

  In the correction table, correction amounts for each of tone, inflection, and jitter obtained by analyzing user's voice data may be set. Thereby, when the mobile phone 100 estimates the user's psychological state based on the audio data, the correction of the parameter obtained from the audio data is performed, so that the estimation of the psychological state becomes more accurate.

  In the above description, the GSR correction amount is set based on the use region and use time of the mobile phone 100. However, the present invention is not limited to this, and a temperature value is provided in the mobile phone 100 of FIG. The GSR correction amount may be set based on the above.

  In the present embodiment, the measurement value of the physiological data is corrected based on the correction table. However, the present invention is not limited to this, and the psychological state level of the first embodiment may be corrected according to the environmental state. .

  The above-mentioned GSR measurement value correction amount may be set by determining a specific value in advance, or may be set for each user according to characteristics such as the health state and personality of each user.

  Also in the mobile phone 100 according to the first to eighth embodiments, physiological data or psychological state levels may be corrected in the same manner as described above. In this case, the cellular phone 100 according to the first to eighth embodiments has physiological data used for estimating a user's psychological state (degree of tension, degree of emotion, lie, etc.). It is preferable that a correction table corresponding to each is set according to the analysis result of the audio data.

  As described above, in the present embodiment, information on the environmental state is acquired by the control unit 10, the wireless communication unit 30, and the antenna 31, and the biological information of the user detected based on the acquired information is corrected by the control unit 10. Is done. Thereby, it is possible to accurately acquire the biological information of the user that changes according to the environmental state. As a result, the mobile phone 100 can accurately estimate the user's psychological state based on accurate biological information.

  As described above, in the first to ninth embodiments, the mobile phone 100 corresponds to a communication device, the wireless communication unit 30 and the antenna 31 correspond to a communication unit, the input operation unit 11 corresponds to an operation unit, and signal processing. The unit 18, the physiological data measurement unit 20, the electrodes 20a and 20d, the thermistor 20b, the photosensor 20c, and the call speaker 15b correspond to detection means.

  The control unit 10 corresponds to a control unit, the call speaker 15b, the microphone 16, the signal processing unit 18, the wireless communication unit 30, and the antenna 31 correspond to a call unit, and the control unit 10 corresponds to a determination unit. The unit 10, the wireless communication unit 30, and the antenna 31 correspond to an e-mail communication unit, and the input operation unit 11 and the main display unit 13 correspond to an e-mail operation unit.

  Further, the control unit 10 corresponds to estimation means, the control unit 10 corresponds to insertion means, the speaker 15a and the call speaker 15b correspond to audio output means, and the main display unit 13 and the sub display unit 14 serve as display means. Correspondingly, the main display unit 13, the speaker 15a, and the call speaker 15b correspond to an information output unit, and the memory 12 and the history data storage unit 124 correspond to a storage unit.

  In addition, the control unit 10, the wireless communication unit 30, and the antenna 31 correspond to an acquisition unit, the control unit 10 corresponds to a correction unit, the memory 12 corresponds to an audio recording unit, and the control unit 10 corresponds to a determination unit. .

  The mobile phone 100 corresponds to the first communication device, the diagnostic telephone 100X corresponds to the second communication device, the diagnostic computer 100PC corresponds to the information processing device, and the communication systems 700 and 700b correspond to the communication system. The second housing 2 corresponds to the housing.

  The present invention can be effectively used for estimating a user's psychological state depending on a communication partner.

1 is an external view of a mobile phone according to a first embodiment. It is a block diagram which shows the structure of the mobile telephone which concerns on 1st Embodiment. FIG. 3 is a diagram illustrating an example of an internal configuration of a memory in FIG. 2. It is a figure which shows an example of the content memorize | stored in the operation | movement setting memory | storage part of FIG. It is a figure which shows an example of the content memorize | stored in the psychological state estimation table storage part of FIG. It is a figure which shows an example of the content memorize | stored in the personal information data storage part of FIG. It is a figure which shows an example of the content memorize | stored in the historical data storage part of FIG. It is a figure showing an example of the content displayed on a main display part, when a user uses the mobile telephone which concerns on 1st Embodiment. It is a figure showing an example of the content displayed on a main display part, when a user uses the mobile telephone which concerns on 1st Embodiment. It is a flowchart which shows an example of the communication program which concerns on 1st Embodiment. It is a flowchart which shows an example of the communication program which concerns on 1st Embodiment. It is a figure which shows an example of the content memorize | stored in the audio | voice analysis table storage part of FIG. It is a figure which shows an example of the content memorize | stored in the operation | movement setting memory | storage part of FIG. It is a figure showing an example of the content displayed on a main display part, when a user uses the mobile telephone which concerns on 2nd Embodiment. It is a figure showing an example of the content displayed on a main display part, when a user uses the mobile telephone which concerns on 2nd Embodiment. It is a flowchart which shows an example of the communication program which concerns on 2nd Embodiment. It is a flowchart which shows an example of the communication program which concerns on 2nd Embodiment. It is a flowchart which shows an example of the communication program which concerns on 2nd Embodiment. It is a figure which shows an example of the content memorize | stored in the operation | movement setting memory | storage part of FIG. It is a figure showing an example of the content displayed on a main display part, when a user uses the mobile telephone which concerns on 3rd Embodiment. It is a flowchart which shows an example of the communication program which concerns on 3rd Embodiment. It is a flowchart which shows an example of the communication program which concerns on 3rd Embodiment. It is a flowchart which shows an example of the communication program which concerns on 3rd Embodiment. It is a figure for demonstrating the extraction method of the data for estimating the degree of emotion of a user. It is a figure which shows an example of the content memorize | stored in the psychological state estimation table storage part and speech analysis table storage part of FIG. It is a figure which shows an example of the content memorize | stored in the psychological state estimation table storage part of FIG. It is a figure for demonstrating an example in the case of estimating the degree of emotions from the combination of the GSR difference value obtained by the measurement, and the tone, the inflection, and the jitter obtained by the analysis of the voice data. It is a figure showing an example of the content displayed on a main display part, when a user uses the mobile telephone which concerns on 4th Embodiment. It is a flowchart which shows an example of the communication program which concerns on 4th Embodiment. It is a flowchart which shows an example of the communication program which concerns on 4th Embodiment. It is a flowchart which shows an example of the communication program which concerns on 4th Embodiment. It is a figure which shows an example of the content memorize | stored in the operation | movement setting memory | storage part of FIG. It is a figure showing an example of the content displayed on a main display part, when a user uses the mobile telephone which concerns on 5th Embodiment. It is a figure showing an example of the content displayed on a main display part, when a user uses the mobile telephone which concerns on 5th Embodiment. It is a flowchart which shows an example of the communication program which concerns on 5th Embodiment. It is a flowchart which shows an example of the communication program which concerns on 5th Embodiment. It is a figure for demonstrating the method to extract the audio | voice data of a specific period based on the change of the physiological data during a user's telephone call. It is a figure showing an example of the content displayed on a main display part, when a user uses the mobile telephone which concerns on 6th Embodiment. It is a flowchart which shows an example of the communication program which concerns on 6th Embodiment. It is a flowchart which shows an example of the communication program which concerns on 6th Embodiment. It is a flowchart which shows an example of the communication program which concerns on 6th Embodiment. It is a flowchart which shows the other example of the communication program which concerns on 6th Embodiment. It is a flowchart which shows the other example of the communication program which concerns on 6th Embodiment. It is a flowchart which shows the other example of the communication program which concerns on 6th Embodiment. It is a figure for demonstrating an example of the content memorize | stored in the audio | voice analysis table storage part of FIG. 3, and the determination method whether a user's answer is a lie. It is a figure which shows an example of the lie notification operation | movement setting table memorize | stored in the operation | movement setting memory | storage part of FIG. It is a figure for demonstrating the determination method for determining the lie degree of a user's answer, and the figure which shows the other example of the lie notification operation | movement setting table memorize | stored in the operation | movement setting memory | storage part of FIG. It is a figure which shows an example of the historical data containing the diagnosis result of the past lie. It is a figure showing an example of the content displayed on a main display part, when a user uses the mobile telephone which concerns on 7th Embodiment. It is a figure showing an example of the content displayed on a main display part, when a user uses the mobile telephone which concerns on 7th Embodiment. It is a flowchart which shows an example of the communication program which concerns on 7th Embodiment. It is a flowchart which shows an example of the communication program which concerns on 7th Embodiment. It is a flowchart which shows an example of the communication program which concerns on 7th Embodiment. It is a figure for demonstrating the outline | summary of the communication system which concerns on 8th Embodiment. It is a figure showing an example of the content displayed on a main display part, when a patient uses the mobile phone of the communication system which concerns on 8th Embodiment. It is a figure showing an example of the content displayed on a main display part, when a patient uses the mobile phone of the communication system which concerns on 8th Embodiment. It is a flowchart which shows an example of the communication program which concerns on 8th Embodiment. It is a flowchart which shows an example of the communication program which concerns on 8th Embodiment. It is a figure for demonstrating the outline | summary of the communication system which concerns on 8th Embodiment at the time of using another communication program. It is a flowchart which shows the other example of the communication program which concerns on 8th Embodiment. It is a figure which shows an example of the content memorize | stored in the correction data memory | storage part of FIG. It is a figure which shows an example of the method in which the mobile telephone which concerns on 9th Embodiment specifies a use area.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 1st housing | casing 2 2nd housing | casing 10 Control part 11 Input operation part 12 Memory 13 Main display part 14 Sub display part 15a Speaker 15b Speaker for calling 16 Microphone 18 Signal processing part 20 Physiological data measurement part 20a, 20d Electrode 20b Thermistor 20c Photosensor 30 Wireless communication unit 31 Antenna 100 Mobile phone 100X Diagnosis phone 100PC Diagnosis computer 124 History data storage unit 700, 700b Communication system

Claims (22)

A communication means for communicating information;
Operation means operated by a user to perform operations related to communication by the communication means;
Detection means for detecting the biological information of the user;
The operation of the communication unit is controlled based on the operation of the operation unit, and the detection unit is controlled to detect the biological information of the user when the user operates the operation unit or when the communication unit communicates. And a communication device. The communication means includes call means for transmitting and receiving voice as the information as the information,
The communication device according to claim 1, wherein the control unit controls the detection unit so as to detect the biological information of the user when the user calls by the calling unit. A discriminating means for discriminating when the user utters the calling means;
3. The communication apparatus according to claim 2, wherein the control unit controls the detection unit so as to detect the biological information of the user when the user speaks by the calling unit. A discriminating unit for discriminating a voice indicating a question from the other party on the basis of the voice signal received by the calling unit;
4. The communication apparatus according to claim 2, wherein the control unit controls the detection unit so as to detect a user's biological information when a voice indicating a question is determined by the determination unit. The communication means includes an electronic mail communication means for transmitting and receiving an electronic mail as the data signal as the information,
The operation means includes an e-mail operation unit that performs an operation for creating, sending, receiving or browsing an e-mail,
The communication device according to claim 1, wherein the control unit controls the detection unit so as to detect a user's biological information when the user operates the electronic mail operation unit. . Estimating means for estimating the psychological state of the user based on the biological information detected by the detecting means;
6. The communication apparatus according to claim 5, further comprising an insertion unit that inserts information indicating the psychological state of the user estimated by the estimation unit into an e-mail created by the e-mail operation unit. . The communication apparatus according to claim 1, further comprising an estimation unit that estimates a user's psychological state based on the biological information detected by the detection unit. The communication device according to claim 7, wherein the estimation unit estimates a degree of tension of the user as the psychological state of the user based on the biological information detected by the detection unit. The communication device according to claim 7, wherein the estimation unit estimates a user's lie as a psychological state of the user based on the biological information detected by the detection unit. 10. The communication according to claim 7, wherein the estimation unit estimates a user's emotions as a psychological state of the user based on the biological information detected by the detection unit. apparatus. The communication apparatus according to any one of claims 7 to 10, further comprising voice output means for outputting information indicating the psychological state of the user estimated by the estimation means as voice. The communication apparatus according to claim 7, further comprising display means for displaying information indicating the psychological state of the user estimated by the estimation means. The communication apparatus according to claim 7, further comprising an information output unit that outputs information for changing the psychological state of the user estimated by the estimation unit. The communication apparatus according to claim 7, further comprising a storage unit that stores the psychological state of the user estimated by the estimation unit for each partner. The communication means performs an incoming call operation for the user to recognize the incoming call when receiving an incoming call,
15. The communication device according to claim 14, wherein the control unit controls an incoming call operation by the communication unit based on a mental state of the user stored in the storage unit. An acquisition means for acquiring environmental information indicating an environmental state;
The correction means which corrects the change state of the user's biological information detected by the detection means based on the environmental information acquired by the acquisition means, further comprising: A communication device according to claim 1. The communication apparatus according to claim 1, further comprising a voice recording unit that records a voice of a user when the biological information is detected by the detection unit. A determination means for determining whether or not the biological information detected by the detection means exceeds a predetermined threshold;
The voice recording unit records a user's voice for a predetermined time including a time point when the threshold value is exceeded when the determination unit determines that the biological information exceeds a predetermined threshold value. The communication device according to claim 17. An operation method of a communication apparatus comprising: a communication unit that communicates information; and an operation unit that is operated by a user to perform an operation related to communication by the communication unit,
An operation of the communication unit is controlled based on an operation of the operation unit, and biometric information of the user is detected when the user operates the operation unit or communicates with the communication unit. How it works. Communication comprising: a communication means for communicating information; an operation means operated by a user to perform an operation related to communication by the communication means; and a processing device for controlling the communication means based on an operation of the operation means A communication program used in an apparatus and executable by the processing apparatus,
Processing for controlling the operation of the communication means based on the operation of the operation means;
A communication program that causes the processing device to execute a process of detecting biometric information of a user when the operation means is operated or when communication is performed by the communication means. A first communication device for a user;
A second communication device for a diagnostician;
An information processing device for a diagnostician,
The first communication device is:
Communication means for communicating with the second communication device and communicating information with the information processing device;
Detecting means for detecting biometric information of a user during a call with the second communication device by the communication means;
The communication means transmits information based on biological information detected by the detection means to the information processing apparatus,
The communication system, wherein the second communication device or the information processing device transmits a diagnosis person's advice based on information received by the information processing device to the first communication device. A communication means for communicating information;
Operation means operated by a user to perform operations related to communication by the communication means;
Detection means for detecting the biological information of the user;
A housing that integrally holds the communication means, the operation means, and the detection means;
The housing has a front surface portion, a back surface portion, one side surface portion and the other side surface portion, and is formed so that the one side surface portion, the back surface portion and the other side surface portion can be held with one hand,
The communication device according to claim 1, wherein the operation means is provided on the front surface portion, and the detection means is provided on the one side surface portion.

Images