JP2010199741A - Portable telephone terminal device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve a problem that a call originator and a call terminator both cannot discriminate whether originating information can be correctly transmitted to a terminating side when speaking using a portable telephone terminal device, and cannot smoothly advance communication. <P>SOLUTION: The portable telephone terminal device allows both parties to recognize that the originating information is not transmitted by comparing a sound volume of an originating voice with a surrounding sound volume of a disturbing sound, noise, etc., near an own terminal, discriminating whether an originated voice is correctly transmitted to a parter side, and transmitting the discrimination result to the originating side and the terminating side. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a mobile phone terminal device. The present invention can also be applied to, for example, a mobile phone terminal device that can detect a state where spoken information is not transmitted to the receiving side.

  Information transmission by voice using a mobile phone terminal is easily affected by ambient noise, radio wave conditions between the mobile phone terminal and the radio base station, etc., and information from the utterance side cannot be accurately transmitted to the reception side There is a case.

  In order to solve this problem, in the existing mobile phone system, a technology for improving the quality of the received voice and improving the recognition rate of the receiver by using a noise canceling function or complementing the missing received voice is widely known.

  For example, if the radio wave condition between a radio base station and a mobile phone terminal is poor and the voice information spoken on the radio transmission path between the mobile phone terminals is lost and transmitted to the receiver in the missing state, There is known a technique of complementing missing voice information in a mobile phone terminal (see, for example, Patent Document 1).

  Also, depending on the radio wave condition between the wireless base station and the mobile phone terminal device, it is determined whether the spoken information itself has reached the other party, and the radio wave condition is poor, and the information spoken to the other party has arrived. There is known a technique of notifying the user of the mobile phone terminal device of the fact that there is no such change (see, for example, Patent Document 2).

JP 2002-330233 A Japanese Patent Laid-Open No. 10-164187

  However, the conventional technology described above has a problem in that it is impossible for the utterance side to determine whether or not the uttered information is correctly transmitted to the receiving side, and communication cannot proceed smoothly.

  For example, even if the quality of the received voice is improved and the recognition probability is improved, only the received voice on the receiving side is cleared, and the uttering side determines whether or not the spoken information can be correctly transmitted to the receiving side. It is not possible.

  Similarly, even if the voice that is missing on the wireless transmission path is supplemented by the mobile phone terminal device on the receiving side, for example, the voice output from the mobile phone terminal device is received before the voice reaches the ear of the listener. If the sound is erased by ambient noise such as noise or noise in the surrounding environment of the person, the receiving side cannot correctly recognize the spoken information.

  Therefore, the speaking side continues to talk despite the situation in which the information spoken by the receiving side is not recognized, causing misunderstandings between the speakers, and cannot smoothly communicate.

  In addition, even if the signal condition is good and the spoken information reaches the other party, if the received information includes not only the spoken information but also the surrounding noise, the receiver side correctly sets the spoken information. It cannot be recognized.

  Even in this case, the utterance side may continue to unilaterally speak to the receiving side even though the receiving side has not recognized the call information. As a result, misunderstandings and troubles between speakers are likely to occur and communication cannot proceed smoothly.

  The apparatus disclosed herein is intended to achieve smooth communication.

  In order to solve the above-described problems and achieve the object, the mobile phone terminal device has a volume of peripheral sounds including a volume of audio input by a user of the mobile phone terminal device and a volume around the mobile phone terminal device. Utterance volume judgment means for judging whether or not the user's voice is correctly transmitted to the other party's mobile phone terminal device, and output means for outputting the judgment result of the utterance volume judgment means As a requirement.

  According to the mobile phone terminal device disclosed herein, it is possible to achieve smooth communication.

FIG. 1 is a diagram for explaining the outline of the first embodiment. FIG. 2 is a diagram for explaining the mobile phone terminal system according to the first embodiment. FIG. 3 is a diagram illustrating the configuration of the mobile phone terminal apparatus according to the first embodiment. FIG. 4 is a diagram for explaining a determination operation performed by the speech volume determination unit. FIG. 5 is a diagram for explaining a determination operation performed by the volume comparison determination unit. FIG. 6 is a diagram for explaining an operation of determining whether or not both parties speak at the same time. FIG. 7 is a diagram for explaining an operation for determining whether or not there is a response. FIG. 8 is a flowchart for determining whether or not the uttered voice has been transmitted to the receiver side. FIG. 9 is a flowchart for determining whether or not the received voice can be transmitted to the receiving side. FIG. 10 is a flowchart for determining a case where both uttered simultaneously. FIG. 11 is a flowchart for determining the no-response time after utterance. FIG. 12 is a diagram for explaining the outline of the second embodiment. FIG. 13 is a diagram illustrating the configuration of the mobile phone terminal according to the second embodiment. FIG. 14 is a diagram for explaining the processing of the text comparison unit 316c. FIG. 15 is a flowchart illustrating processing of the mobile phone terminal according to the second embodiment. FIG. 16 is a diagram illustrating a hardware configuration of a mobile phone terminal device that executes a program for determining non-transmission of speech information.

  Exemplary embodiments of a mobile phone terminal according to the present invention will be explained below in detail with reference to the accompanying drawings.

  First, the outline | summary of the mobile telephone terminal device based on Example 1 is demonstrated. The mobile phone terminal according to the first embodiment determines whether or not the uttered information can be transmitted to the receiver, and notifies the speaker and the receiver of the determination result.

  FIG. 1 is a diagram for explaining the outline of the first embodiment. In FIG. 1, first, the speaker 10 uses the mobile phone 100a and the speaker 20 uses the mobile phone 100b to make a call. Then, the speaker 10 speaks to the mobile phone 100a (step S1). Hereinafter, for convenience of explanation, it is assumed that the speaker 10 is the speaker 10 and the speaker 20 is the receiver 20.

  Thereafter, when the mobile phone 100a determines that the uttered information cannot be correctly transmitted to the receiver 20, the mobile phone 100a detects the determination result. The mobile phone 100a notifies the speaker 10 of the determination result and also notifies the receiver 20 via the mobile phone 100b (step S2).

  As described above, when the mobile phone terminal device determines that the information uttered to the other party cannot be transmitted correctly, the mobile phone terminal device notifies the utterance side and the receiving side of the determination result. It becomes possible to recognize the transmission.

  As a result, it is possible to prompt the speaker to take measures for correctly transmitting information to the other party. For example, moving to a place where the surrounding noise is low, or speaking again.

  In addition, it is possible to reduce anxiety and trouble between speakers due to information not being transmitted correctly, and to realize smooth communication.

  Next, the configuration of the mobile phone terminal system that is the premise of the first embodiment will be described. FIG. 2 is a diagram for explaining the mobile phone terminal system according to the first embodiment. FIG. 1 shows an example in which the mobile phone 100a and the mobile phone 100b communicate with each other via the telephone network 200.

  The telephone network 200 is means for transmitting call information to the mobile phone 100a and the mobile phone 100b, and includes a base station 200a, a base station 200b, an exchange 200c, an exchange 200d, and an exchange 200e.

  Various devices included in the telephone network 200 have a function of notifying the other party's mobile phone when the mobile phone 100a or the mobile phone 100b detects non-transmission of spoken information.

  Next, the configuration of the mobile phone terminal according to the first embodiment will be described. FIG. 3 is a diagram illustrating the configuration of the mobile phone terminal apparatus according to the first embodiment. As illustrated in FIG. 3, the mobile phone terminal device 100 includes a microphone 101, a speaker 113, a wireless unit 114, and a control unit 115.

  The microphone 101 is a means for acquiring voices uttered by a speaker and peripheral sounds such as peripheral noise, noise, and noise, and inputting the acquired information to the utterance sound conversion unit 102.

  The speaker 113 is a means for reproducing sound indicating a situation where the uttered information cannot be transmitted to the receiving side, or reproducing sound indicated by the call information.

  In addition to the normal wireless communication function performed by the mobile phone terminal device, the wireless unit 114 is closely related to the present invention. It is a means for outputting information indicating that it cannot be transmitted.

  The control unit 115 is a means for variously controlling information uttered by the user of the mobile phone terminal device 100. The utterance sound conversion unit 102, the human language determination unit 103, the utterance volume determination unit 104, and the reception sound conversion unit 105 The human language determination unit 106, the volume comparison determination unit 107, the reception / utterance monitoring / determination unit 108, the user notification unit 109, the call destination notification unit 110, the display control unit 111, and the vibrator control unit 112 Have.

  The utterance sound conversion unit 102 converts information input from the microphone 101 into a format handled by the mobile phone terminal device 100, and converts the converted information to the human language determination unit 103, the utterance volume determination unit 104, or the volume comparison determination unit 107. It is a means to input.

  The human language determination unit 103 is a unit that determines whether or not language information is included in the information input from the utterance sound conversion unit 102. This linguistic information is information including the word information indicating the word itself such as “A” and “I” and the volume (hereinafter referred to as the word volume) of the word information such as “A” and “I”. is there.

  If language information is included, the human language determination unit 103 extracts the language information of the speaker from the input information, and uses the extracted language information as the utterance volume determination unit 104 or the received / utterance monitoring / determination. Input to the unit 108.

  The utterance volume determination unit 104 determines whether or not the uttered information is transmitted to the receiving side based on the information input from the utterance sound conversion unit 102 and the human language determination unit 103, and the uttered information is received. This means is a means for inputting the determination result to the user notification unit 109 when it is determined that it cannot be transmitted to the user side.

  The determination operation performed by the speech volume determination unit 104 will be described with reference to FIGS. FIG. 4 is a diagram for explaining a determination operation performed by the speech volume determination unit. Note that the mobile phone 100a and the mobile phone 100b shown in FIG. 4 correspond to the mobile phone terminal device 100 shown in FIG. 3, and for convenience of explanation, the mobile phone 100a is used as an utterance side terminal device and the mobile phone 100b is used as a receiver. It is illustrated as a side terminal device.

  First, when the speaker 10 speaks using the mobile phone 100a, the voice of the speaker 10 and ambient sounds such as noise and noise are input to the microphone 101 (step S10).

  Thereafter, the utterance volume determination unit 104 receives the information input to the microphone 101 from the utterance sound conversion unit 102, and holds the volume of the received information as the entire volume. Therefore, this total volume indicates the volume input to the microphone 101 (the volume combined with the volume of the voice of the speaker and the surrounding sounds such as noise and noise).

  On the other hand, when the utterance volume determination unit 104 receives language information from the human language determination unit 103, the utterance volume determination unit 104 holds the word volume included in the received language information as the utterance volume.

  Then, the utterance volume determination unit 104 compares the overall volume with the utterance volume, determines whether the utterance volume is sufficiently high, and if the utterance volume cannot be determined to be sufficiently high, It is determined that the message cannot be transmitted to the listener 20 (step S11).

  The determination shown in step S11 described above will be described using, for example, the following equation (1) and threshold value X.

  Formula (1); (speech volume A / total volume B) ≦ X (constant)

  According to Expression (1), the speech volume determination unit 104 determines that the speech volume is sufficient if the value obtained by dividing the speech volume A (unit: decibel) by the total volume B (unit: decibel) is equal to or less than the constant X. Not determined to be large.

  On the other hand, the utterance volume determination unit 104 determines that the utterance volume is sufficiently high when the value obtained by dividing the utterance volume A by the overall volume B exceeds a constant X. The constant X described above indicates a threshold value for establishing a call using the mobile phone terminal device, and can be arbitrarily set.

  For example, when the threshold value X is 0.6, the utterance volume is 50 db, and the overall volume is 100 db, the utterance volume determination unit 104 does not determine that the utterance volume is sufficiently high from Equation (1), It is determined that the received information cannot be transmitted to the listener 20.

  50/100 (= 0.5) ≦ 0.6

  When the mobile phone 100a determines that the uttered information has not been transmitted to the receiver 20, the mobile phone 100a notifies the speaker 10 of the determination result via the user notification unit 109 described later. On the other hand, the receiver 20 is also notified via a call destination notification unit 110 described later (step S12).

  Next, returning to the description of FIG. 3, the received sound conversion unit 105 will be described. The received sound conversion unit 105 is a unit that converts the received voice reproduced by the speaker 113 into a format handled by the mobile phone terminal device 100 via the wireless unit 114 and inputs the converted information to the human language determination unit 106. .

  The human language determination unit 106 is a unit that determines whether or not the information received from the received sound conversion unit 105 includes language information. When the language information is included, the language information is extracted, and the extracted language information is input to the volume comparison determination unit 107 and the received / utterance monitoring / determination unit 108.

  The volume comparison determination unit 107 determines whether the received voice has been correctly transmitted to the receiver side based on the information input from the utterance sound conversion unit 102 and the human language determination unit 106, and the received voice is transmitted to the receiver side. A means for inputting the determination result to the user notification unit 109 when it is determined that the information cannot be transmitted.

  The determination operation performed by the volume comparison determination unit 107 will be described with reference to FIGS. FIG. 5 is a diagram for explaining a determination operation performed by the volume comparison determination unit. Note that the mobile phone 100a and the mobile phone 100b shown in FIG. 5 correspond to the mobile phone terminal device 100 shown in FIG. 3, and for convenience of explanation, the mobile phone 100a is the utterance side terminal and the mobile phone 100b is the receiving side. It is illustrated as a terminal.

  First, the speaker 10 speaks using the mobile phone 100a, and the spoken information reaches the mobile phone 100b via the telephone network 200 (see FIG. 2) (step S20).

  Thereafter, the spoken information is input to the human language determination unit 106 via the received sound conversion unit 105. In addition, ambient noise of the mobile phone 100b is input to the utterance sound conversion unit 102 via the microphone 101 (step S21).

  Subsequently, the volume comparison determination unit 107 receives ambient sounds such as noise and noise input from the utterance sound conversion unit 102, and holds the volume included in the received ambient sounds as an ambient noise amount. Further, the volume comparison determination unit 107 receives the word volume included in the language information from the human language determination unit 106, and holds the volume indicated by the word volume as the reception volume.

  The volume comparison / determination unit 107 compares the ambient noise amount with the received volume, determines whether the received volume is sufficiently high, and if the received volume cannot be determined to be sufficiently high, It is determined that the message cannot be transmitted to the listener 20 (step S22).

  The determination shown in step S22 described above will be described using, for example, the following equation (2) and threshold value Y.

  Expression (2); (receiving volume C / ambient noise amount D) ≦ Y (constant)

  According to Equation (2), the volume comparison / determination unit 107 is sufficient if the value obtained by dividing the received volume C (unit: decibel) by the ambient noise amount D (unit: decibel) is equal to or less than the constant Y. It is not judged that it is big.

  On the other hand, when the value obtained by dividing the reception volume C by the ambient noise amount D exceeds the constant Y, the volume comparison determination unit 107 determines that the reception volume is sufficiently high. The constant Y described above indicates a threshold value for establishing a call using the mobile phone terminal device, and can be arbitrarily set.

  For example, if the threshold Y is 0.7, the received sound volume is 40 db, and the ambient noise amount is 100 db, the volume comparison determination unit 107 does not determine that the received sound volume is sufficiently large from the equation (2), It is determined that the received voice cannot be transmitted to the listener 20.

  40/100 (= 0.4) ≦ 0.7

  When it is determined that the received voice cannot be transmitted to the listener 20, the mobile phone 100b notifies the receiver 20 of the determination result via the notification unit 109 to the user. On the other hand, the speaker 10 is also notified through the call destination notification unit 110 (step S23).

  Next, returning to the description of FIG. 3, the reception / utterance monitoring / determination unit 108 will be described. The reception / utterance monitoring / determination unit 108 determines that the spoken information cannot be transmitted to the receiving side when both parties are speaking at the same time or when there is no response from the receiving side after a certain time has elapsed since the completion of the speaking. This is means for making a determination and inputting the determination result to the user notification unit 109.

  First, an operation in which the reception / speech monitoring / determination unit 108 determines whether or not both parties are speaking at the same time will be described with reference to FIGS. 3 and 6. FIG. FIG. 6 is a diagram for explaining an operation of determining whether or not both parties speak at the same time.

  In the description of FIG. 6, for convenience, the mobile phone 100 a is set as the utterance side terminal and the mobile phone 100 b is set as the receiving side terminal. A case will be described as an example.

  First, the speech information of the speaker 10 reaches the mobile phone 100b via the telephone network 200 (see FIG. 2). Then, the uttered information is input to the received sound conversion unit 105 via the speaker 113.

  Subsequently, the language determination unit 106 extracts language information (for example, “A”) from the information uttered by the speaker 10 and inputs the extracted language information to the reception / utterance monitoring / determination unit 108 (step S30). ).

  On the other hand, when the listener 20 speaks, the speech information is input to the speech sound conversion unit 102, and the human language determination unit 103 extracts language information (for example, “I”) from the information spoken by the receiver 20 and extracts it. Language information is input to the received / utterance monitoring / determination unit 108 (step S31).

  Thereafter, the reception / utterance monitoring / determination unit 108 monitors the interval from the time when the language information “A” is received until the language information “I” is received. As a result of the monitoring, the interval is less than or equal to a certain value (for example, T If it is equal to or less than a second; T is a natural number), it is determined that “spoken almost simultaneously”.

  Therefore, the reception / utterance monitoring / determination unit 108 determines that the utterance information of the speaker 10 cannot be transmitted to the receiver 20, and inputs the determination result to the user notification unit 109 (step S32).

  When it is determined that the spoken information cannot be transmitted correctly, the mobile phone 100b notifies the receiver 20 of the determination result via the user notification unit 109. On the other hand, the speaker 10 is also notified via the call destination notification unit 110 (step S33).

  Next, an operation in which the reception / utterance monitoring / determination unit 108 determines whether or not there is a response on the receiving side after a lapse of a certain time after the utterance on the speaking side is completed will be described with reference to FIGS. 3 and 7. To do. FIG. 7 is a diagram for explaining an operation for determining whether or not there is a response.

  Note that the mobile phone 100a and the mobile phone 100b shown in FIG. 7 correspond to the mobile phone terminal device 100 shown in FIG. 3, and for convenience of explanation, the mobile phone 100a is the utterance side terminal and the mobile phone 100b is the reception side. It is illustrated as a terminal.

  First, information uttered by the speaker 10 reaches the mobile phone 100 b and is input to the received sound conversion unit 105 via the wireless unit 114. Then, the human language determination unit 106 extracts language information (for example, “A”), and inputs the extracted language information to the received / utterance monitoring / determination unit 108 (step S40).

  After that, the reception / utterance monitoring / determination unit 108 monitors the time until the language information is received from the human language determination unit 103 after receiving the language information “A” (step S41).

  As a result of monitoring, if there is no input of linguistic information from the human language determination unit 103 to the reception / speech monitoring / determination unit 108 when a certain value or more (for example, N seconds or more; N is a natural number), the reception / utterance monitoring / determination The unit 108 considers that the receiver 20 was listening to the utterance information of the speaker 10 in the sky, and determines that the uttered information has not been correctly transmitted (step S42).

  Then, the volume comparison determination unit 107 inputs the determination result in step S42 to the user notification unit 109, and the mobile phone 100b gives the determination result obtained in step S42 to the user notification unit 109. Notify via On the other hand, the speaker 10 is also notified via the call destination notification unit 110 (step S43).

  Next, returning to the description of FIG. 3, the user notification unit 109 will be described. The user notification unit 109 notifies the user of the mobile phone terminal device of “a situation where the spoken information cannot be transmitted to the receiver” or “a situation where the received information cannot be transmitted to the receiver”. It is means to do.

  Specifically, when the utterance volume determination unit 104 or the reception / utterance monitoring / determination unit 108 determines that “the information that has been uttered cannot be transmitted to the reception side”, or the volume comparison determination unit 107 “ When it is determined that the received information cannot be transmitted to the receiving side, information indicating that is input to the call destination notification unit 110, the display control unit 111, the vibrator control unit 112, and the speaker 113. .

  For example, when the mobile phone terminal device 100 is used as a mobile phone terminal device on the utterance side, the user notification unit 109 is not able to transmit the uttered information to the receiver (for example, the receiver 20; see FIG. 2). Is notified to the speaker (for example, the speaker 10; see FIG. 2) through the operation of the display or the vibrator.

  On the other hand, when used as a mobile phone terminal on the receiving side, the user notification unit 109 displays information indicating that the received information cannot be transmitted to the receiver (for example, the receiver 20; see FIG. 2) on the display. The receiver 20 is notified through the display and the operation of the vibrator.

  In response to the notification from the user notification unit 109, the call destination notification unit 110 is a means for notifying the mobile phone terminal device of the call destination of information indicating “a situation where the spoken information cannot be transmitted to the receiver”.

  For example, when the mobile phone terminal device 100 is used as a mobile phone terminal device on the speaker side, the call destination notification unit 110 can transmit the uttered information to the receiver (for example, the receiver 20; see FIG. 2). Information indicating the absence is notified to the receiver via the telephone network 200.

  In addition, as described above, when the wireless unit 114 obtains the “situation where received information cannot be transmitted to the receiver” from the wireless unit 114, the user notification unit 109 determines the result of the determination. To the speaker.

  On the other hand, when used as a mobile phone terminal device on the receiver side, the callee notification unit 110 provides information indicating that the received information cannot be transmitted to the receiver via the telephone network 200 (for example, an utterance). Person 10; see FIG. 2).

  Further, as described above, when the wireless unit 114 obtains the “situation where the spoken information cannot be transmitted to the receiver” from the wireless unit 114, the user notification unit 109 displays the determination result. Notify the listener.

  The display control unit 111 is a means for displaying information indicating “a situation in which spoken information cannot be transmitted to the receiver” on the display of the mobile phone terminal.

  The vibrator control unit 112 is a means for receiving an instruction from the user notification unit 109 and issuing an operation command indicating “a situation where spoken information cannot be transmitted to the receiver” to the vibrator of the mobile phone terminal device. .

  Next, a description will be given of a processing procedure in which the mobile phone terminal 100 compares the uttered voice and the ambient noise on the utterance side to determine whether or not the uttered information can be transmitted to the other side. FIG. 8 is a flowchart for determining whether or not the uttered voice has been transmitted to the receiver side.

  First, utterance information, ambient sound, and the like are input to the mobile phone terminal device 100 (step S100). Thereafter, the utterance volume determination unit 104 holds the information input from the utterance sound conversion unit 102 as the overall volume (step S101).

  Subsequently, the human language determination unit 103 extracts language information from the information received from the utterance sound conversion unit 102 (step S102). The human language determination unit 103 then inputs the extracted information to the utterance volume determination unit 104 (step S103).

  Thereafter, the utterance volume determination unit 104 holds the word volume included in the information extracted by the human language determination unit 103 as the utterance volume (step S104), compares the held overall volume with the utterance volume, and determines the utterance volume. Is determined to be sufficiently large (step S105), and if it is determined to be sufficiently large (step S106, Yes), the process returns to step S100.

  On the other hand, when it is determined that the volume is not sufficiently large (No in step S106), the utterance volume determination unit 104 determines that the uttered information cannot be transmitted to the receiver. Then, the determination result is notified to the speaker and the receiver (step S107).

  According to this flowchart, the speaker and receiver can both recognize that the spoken information cannot be transmitted to the other party, and measures for correctly transmitting the information to the other party to the speaker and receiver. Can be encouraged to achieve smooth communication.

  Next, a processing procedure in which the mobile phone terminal device 100 determines whether or not the received voice can be transmitted to the receiver by comparing the received voice and the ambient noise on the receiver side will be described. FIG. 9 is a flowchart for determining whether or not the received voice can be transmitted to the receiving side.

  First, the reception information and the ambient sound including noise and noise of the mobile phone terminal device 100 are input to the mobile phone terminal device 100 (step S200). Thereafter, the volume comparison determination unit 107 holds the volume indicated by the information input from the utterance sound conversion unit 102 as the amount of ambient noise (step S201).

  Subsequently, the human language determination unit 106 extracts language information from the information received from the received sound conversion unit 105 (step S202). Then, the human language determination unit 106 inputs the extracted information to the volume comparison determination unit 107 (step S203).

  The volume comparison determination unit 107 holds the word volume included in the information extracted by the human language determination unit 106 as the reception volume (step S204), and compares the stored ambient noise amount with the reception volume to determine the reception volume. It is determined whether it is sufficiently large (step S205), and when it is determined that it is sufficiently large (step S206, Yes), the process returns to step S200.

  On the other hand, when it is determined that the volume is not sufficiently high (No at Step S206), the volume comparison determination unit 107 determines that the received voice cannot be transmitted to the receiver. Then, the determination result is notified to the speaker and the receiver (step S207).

  According to this flowchart, the speaker and the receiver can both recognize that the received voice has not been transmitted to the receiver, and take measures to correctly transmit information to the other party to the speaker. Can be encouraged to take. In addition, it is possible to prompt the listener to take measures so that the user can accurately receive the call. Therefore, the speaker and the listener can take measures to facilitate communication.

  Next, a processing procedure of the mobile phone terminal device 100 when both speak simultaneously will be described. FIG. 10 is a flowchart for determining a case where both uttered simultaneously.

  First, information uttered by a speaker reaches the mobile phone terminal device 100 via the telephone network 200 (see FIG. 2). Then, information from the speaker is input to the received sound conversion unit 105 via the wireless unit 114. On the other hand, when the receiver speaks, speech information is input to the speech conversion unit 102 (step S300).

  Subsequently, the human language determination unit 106 extracts language information “A” from the information spoken by the speaker, and inputs the extracted language information (for example, “A”) to the received / utterance monitoring / determination unit 108 (Step S1). S301).

  Further, when the listener speaks, the utterance information of the listener is input to the utterance sound conversion unit 102, and the language determination unit 103 extracts and extracts language information (for example, “I”) from the information received by the listener. The language information “I” is input to the reception / utterance monitoring / determination unit 108 (step S302).

  Thereafter, the reception / utterance monitoring / determination unit 108 determines whether or not the interval from the reception of the language information “A” to the reception of the language information “I” is equal to or less than a predetermined value (step S303). As a result of the determination, if the interval is equal to or smaller than a certain value (step S304, Yes), it is determined that “spoken almost simultaneously”.

  Then, the cellular phone terminal device 100 notifies the receiver of the determination result obtained in step S304 via the user notification unit 109. On the other hand, the speaker is also notified to the receiver via the call destination notification unit 110 (step S305).

  On the other hand, if the interval exceeds a certain value (step S304, No), it is not determined that “spoken almost simultaneously”, and the process proceeds to step S300.

  According to this flowchart, when the speaker and the listener speak at the same time, both sides can recognize that the spoken information cannot be transmitted to the receiver, and the speaker and the listener can smoothly communicate. To be able to take measures to

  Next, a description will be given of a processing procedure in which the mobile phone terminal device 100 determines whether or not there is a response on the receiving side after a lapse of a certain time from the end of the speaking side. FIG. 11 is a flowchart for determining the no-response time after utterance.

  First, information uttered by the speaker reaches the mobile phone terminal device 100 and is input to the received sound conversion unit 105 (step S400).

  Then, the language determination unit 106 extracts language information (for example, “A”) (step S401), and inputs the extracted language information to the reception / utterance monitoring / determination unit 108 (step S402).

  Thereafter, the reception / speech monitoring / determination unit 108 monitors the time until the language information related to the utterance of the receiver is received from the human language determination unit 103 after receiving the language information “A” (step S403).

  As a result of the monitoring, if the language information is not input from the human language determination unit 103 for a certain period and exceeds a certain value (elapse of a certain period) (Yes in step S404), the received / utterance monitoring / determination unit 108 determines that “correctly It is determined that there is a possibility that information is not transmitted ", and the determination result is notified to the receiver and the speaker (step S405).

  On the other hand, when the language information is input from the human language determination unit 103 to the reception / speech monitoring / determination unit 108 within a certain period (step S404, No), the process proceeds to step S400.

  According to this flowchart, the mobile phone terminal device 100 can determine that the uttered information cannot be correctly transmitted when there is no response on the receiving side after a lapse of a certain time from the end of the speaking on the speaking side. In addition, by notifying the listener and the speaker of the determination result, the speaker and the speaker can take measures to facilitate communication.

  As described above, the mobile phone terminal according to the first embodiment determines the non-transmission of spoken information and notifies the speaker and the listener of the determination result, thereby transmitting the spoken information to the receiver. It is possible for both parties to recognize that this is not possible, and for the speaker and receiver to take measures to facilitate communication.

  Incidentally, as described above, according to the first embodiment, the example in which the spoken information is not transmitted to the other party has been described. However, the case where the spoken information is correctly transmitted to the other party is also described. The mobile phone terminal device 100 can make a determination, and can notify the speaker and receiver of the determination result.

  For example, when the utterance volume determination unit 104 shown in FIG. 3 compares the overall volume and the utterance volume, and the utterance volume is sufficiently larger than the overall volume, the spoken information is correctly transmitted to the other party. The determination result can be notified to the speaker and the receiver via the user notification unit 109 and the call destination notification unit 110.

  As a result, the utterance side can recognize that the information uttered to the other side is correctly transmitted, and can move to a place where there is little ambient noise, etc., or utter again. You can talk with confidence.

  As in the case where it is determined that the spoken information is not transmitted to the other party, smooth communication is achieved by reducing the occurrence of human-related troubles due to information not being transmitted correctly and reducing speaker anxiety. Can be achieved.

  Next, an outline of the mobile phone terminal device according to the second embodiment will be described. When the mobile phone terminal device according to the second embodiment is used as a receiver-side mobile phone terminal device, the mobile phone terminal device determines whether or not call information is missing due to the influence of ambient noise on the receiver side. If it is determined that the alarm sound is detected, an alarm sound is notified to the speaker.

  FIG. 12 is a diagram for explaining the outline of the second embodiment. In FIG. 12, first, the speaker 10 uses the mobile phone 300a and the speaker 20 uses the mobile phone 300b to make a call. Then, a case where the speaker 10 speaks “set at 9 o'clock” to the mobile phone 300a is described as an example (step S50). Hereinafter, for convenience of explanation, it is assumed that the speaker 10 is the speaker 10 and the speaker 20 is the receiver 20.

  Thereafter, the information “9 o'clock set” spoken by the speaker 10 reaches the mobile phone 300b via the telephone network 200 (see FIG. 2), and reaches the ear of the receiver 20 via the speaker of the mobile phone 300b. To reach.

  During this time, for example, when the sound collecting unit (not shown) in the mobile phone 300b acquires the ambient noise of the mobile phone 300b, the “9 o'clock set” has been drowned due to the influence of the acquired ambient noise and the like. When the information is transmitted to the ear of the listener 20 in the state (step S51), the mobile phone 300b determines that the information spoken by the speaker 10 has been transmitted to the receiver 20 in a missing state, and transmits the information to the mobile phone 300a. A “missing alarm” is notified (step S52).

  Therefore, this missing alarm refers to an alarm indicating that information uttered by a speaker has been affected by ambient noise on the receiving side and has reached the ear of the receiver in a missing state.

  In this way, the mobile phone 300b notifies the speaker of the “missing alarm” indicating the absence of spoken information, so that the information spoken by the speaker is not correctly transmitted to the receiver. Can be recognized.

  Next, the configuration of the mobile phone terminal device according to the second embodiment will be described. FIG. 13 is a block diagram illustrating the configuration of the mobile phone terminal according to the second embodiment. 13 corresponds to the mobile phone 300a and the mobile phone 300b shown in FIG. 12, but for convenience of explanation, the mobile phone terminal device 300 is used as the mobile phone 300b on the receiving side. This will be described below by taking the case as an example.

  As illustrated in FIG. 13, the mobile phone terminal device 300 includes a memory 301, a CPU (Central Processing Unit) 302, a speaker 303, a monitor microphone 304, and a display unit 318.

  The memory 301 is a storage unit that stores various data used by the CPU 302. The CPU 302 is a central processing unit that reads various data from the memory 301 and executes various processes.

  As specific processing, the speech is converted into text, and the information including mixed speech and ambient noise of the mobile phone terminal 300 is converted into text, and the speech is lost based on the text information. If it is determined that it is missing, a missing alarm is notified to the mobile phone terminal device on the utterance side.

  Then, the CPU 302 performs a wireless control unit 310, a call control unit 311, a speaker control unit 312, a monitor microphone control unit 313, a voice recognition engine 314, a voice recognition engine 315, a missing alarm unit 316, and an alarm sound. And a generation unit 317.

  The wireless control unit 310 is a means for acquiring utterance voice, outputting the missing alarm generated by the alarm sound generation unit 317 and the text data indicated by the missing information to the mobile phone 300a on the utterance side (see FIG. 12).

  The call control unit 311 is means for performing input / output control of speech voice and predetermined text data, and a creation request and output of a missing alarm. For example, the call control unit 311 outputs the uttered voice acquired by the wireless control unit 310 to the speaker control unit 312 and the missing alarm unit 316. Further, predetermined text data is output to the wireless control unit 310 and the display unit 318 based on the information converted into text by the speech recognition engine 314 and the speech recognition engine 315.

  The speaker control unit 312 is means for outputting the uttered voice input from the call control unit 311 to the speaker 303.

  The monitor microphone control unit 313 is means for outputting information acquired by the monitor microphone 304 to the missing alarm unit 316. Note that, as described above, the information acquired by the monitor microphone 304 is information in which the uttered voice and the peripheral sound including the peripheral noise and noise of the mobile phone terminal device 300 are mixed.

  The speech recognition engine 314 is a means for converting the speech speech input to the call control unit 311 into text by speech recognition via the missing alarm unit 316 and holding the text data as text data A. Further, the text data A is output to the missing alarm unit 316 in response to a request from the missing alarm unit 316.

  The voice recognition engine 315 converts the mixed information of the speech voice input to the monitor microphone control unit 313 and the ambient sound of the mobile phone terminal device 300 through the missing alarm unit 316 into text by voice recognition and converts the information into text. Means for holding the data as text data B. Further, the text data B is output to the missing alarm unit 316 in response to a request from the missing alarm unit 316.

  The missing alarm unit 316 compares the text data A and the text data B converted by the speech recognition engine 314 and the speech recognition engine 315 based on a predetermined interval, and the difference between the compared text data This is means for determining whether or not the above has occurred. The “difference” indicates a case where the matching rate of the text data to be compared is a predetermined value or less.

  Further, when the missing alarm unit 316 determines that a difference has occurred, the missing alarm unit 316 requests the call control unit 311 to generate a missing alarm, and includes a timer 316a, a text input / output control unit 316b, and a text comparison unit 316c. And have.

  The timer 316a is means for generating time information and outputting the generated time information to the text input / output control unit 316b. Examples of the time information to be generated include 1 second, 3 seconds, and 5 seconds.

  The text input / output control unit 316b is a unit that simultaneously requests the voice recognition engine 314 and the voice recognition engine 315 to acquire various text data and outputs the acquired various text data to the text comparison unit 316c. Note that the text input / output control unit 316b makes various text data acquisition requests periodically (for example, for 5 seconds) based on the time information generated by the timer 316a.

  When the text input / output control unit 316b acquires the text data A from the speech recognition engine 314 and the text data B from the speech engine 315, the text input / output control unit 316b outputs the acquired text data A and text B to the text comparison unit 316c. To do.

  The text comparison unit 316c compares the various text data acquired from the text input / output control unit 316b, determines whether or not a difference has occurred between the compared text data, and based on the determination result, the speech voice Is a means for determining whether or not the message has arrived at the receiver.

  Further, the text comparison unit 316c is a unit that, when it is determined that a missing voice has occurred, generates a missing alarm request and outputs text data corresponding to the missing part to the call control unit 311. .

  The processing performed by the text comparison unit 316c will be specifically described with reference to the drawings. FIG. 14 is a diagram for explaining the processing of the text comparison unit 316c. The upper part of FIG. 14 shows the case where the text data matches, while the lower part shows the case where a difference occurs in the text data.

  As illustrated in the upper part of FIG. 14, the process performed by the text comparison unit 316c will be described by taking as an example the case where the text data A indicated by the speech is “9 o'clock set”. First, the text comparison unit 316c acquires “9 o'clock set” as the text data A from the text input / output control unit 316b.

  Similarly, when the text comparison unit 316c acquires “9 o'clock set” as the text data B from the text input / output control unit 316b, the text data A and the text data B match, so no difference occurs.

  Therefore, the text comparison unit 316c determines that the speech has not been lost and has arrived at the receiver, and does not make a call to the call control unit 311 to generate a missing alarm.

  On the other hand, as shown in the lower part of FIG. 14, when the text comparison unit 316 c acquires “9 o'clock set” as text data A and “gagaga set” as text data B from the text input / output control unit 316 b. When the text data A and the text data B are compared, the text data common to the text data A and the text data B is “set”, and “9:00” is included only in the text data A. "GAGAGA" is included only in the text data B.

  Therefore, the text comparison unit 316c determines that a difference has occurred between the text data A and the text data B. When the text comparison unit 316c determines that a difference has occurred, the text comparison unit 316c determines that the speech has arrived at the receiver in a state in which the utterance is missing, and makes a request for generating a missing alarm to the call control unit 311. The missing text data “9:00” is output to the call control unit 311.

  At this time, the call control unit 311 that has received the missing text data “9 o'clock” transmits the text data “9 o'clock” to the mobile phone 300a on the utterance side via the radio control unit 310. After that, the cellular phone 300a displays “9:00” on the display unit (not shown) of its own device.

  Further, the call control unit 311 outputs the missing text data “9:00” to the display unit 318 as well.

  Note that the text comparison unit 316c determines whether or not a difference between various types of text data occurs, and thus is not affected by the accuracy of the speech recognition engine 314 and the speech recognition engine 315 (text recognition accuracy). The text comparison 316c can determine the difference between various text data.

  Next, returning to the description of FIG. 13, the alarm sound generation unit 317 will be described. The alarm sound generation unit 317 is a unit that generates a missing alarm in response to a missing alarm generation request from the call control unit 311 and outputs the generated missing alarm to the call control unit 311.

  The speaker 303 is means for outputting speech information speech (hereinafter referred to as speech speech) spoken by the speaker 10 shown in FIG. Specifically, the uttered voice output from the CPU 302 is output to the listener 20.

  The monitor microphone 304 is a means for acquiring speech sound output from the speaker 303, ambient sounds including ambient noise of the mobile phone terminal device 300, and the like, and is adjacent to the speaker 303. Note that the monitor microphone 304 is adjacent to the speaker 303 and may be integrated with the speaker 303.

  The display unit 318 is means for displaying missing text data (for example, “9 o'clock”; see FIG. 14) in response to a request from the call control unit 311.

  Next, processing performed by the mobile phone terminal device 300 will be described. FIG. 15 is a flowchart showing processing of the mobile phone terminal device 300.

  First, the utterance voice uttered by the speaker 10 is input to the voice recognition engine 314 from the call control unit 311 (step S500), and the voice recognition engine 314 performs text conversion by voice recognition on the input utterance voice. Is started (step S501).

  Subsequently, the information acquired by the monitor microphone 304 is input from the monitor microphone control unit 313 to the voice recognition engine 315 (step S502), and the voice recognition engine 315 converts the input information into text by voice recognition. Is started (step S503).

  Thereafter, the text input / output control unit 316b determines whether or not a predetermined time (for example, 5 seconds) has elapsed based on the time information generated by the timer 316a, and when 5 seconds have elapsed (step S504, Yes), the process proceeds to step S505. On the other hand, if 5 seconds have not elapsed (step S504, No), the process proceeds to step S503.

  Then, the text input / output control unit 316b requests the speech recognition engine 314 and the speech recognition engine 315 to acquire text data converted by speech recognition (step S505).

  Thereafter, the speech recognition engine 314 outputs the converted text data (for example, text data A) to the text input / output control unit 316b. On the other hand, the speech recognition engine 315 outputs the converted text data (for example, text data B) to the text input / output control unit 316b.

  Thereafter, the text comparison unit 316c acquires the text data A from the text input / output control unit 316b (step S506), and further acquires the text data B (step S507). Then, the text comparison unit 316c compares the text data A acquired from the text input / output control unit 316b with the text data B (step S508).

  Subsequently, when the text comparison unit 316c determines that there is a difference between the text data A and the text data B (step S509, Yes), the call control unit 311 utters the missing alarm generated by the alarm sound generation unit 317. (Step S510).

  On the other hand, when the text comparison unit 316c determines that there is no difference (No in step S509), the process proceeds to step S511.

  When the call is terminated (step S511, Yes), the voice recognition is terminated (step S512). On the other hand, if the call is not terminated (No at step S511), the process proceeds to step S504.

  According to this flowchart, when the mobile phone terminal device 300 determines that the speech has been transmitted to the ear on the receiving side in a state in which the speech is missing, it notifies the speaker of the “missing alarm” by the speaker. It can be recognized that the spoken information is not correctly transmitted to the receiver.

  As described above, when the mobile phone terminal device 300 according to the second embodiment reaches the listener's ear in a state where the spoken information is missing, the mobile phone on the utterance side notifies the “missing alarm” of the spoken information. By notifying the terminal device, the speaker can grasp that the information he / she spoke is missing and transmitted to the other party, and the speaker should take measures to facilitate communication. Will be able to.

  Heretofore, the first embodiment and the second embodiment have been described as examples, and have been described separately. However, each of the mobile phone terminal device 100 shown in the first embodiment and the mobile phone terminal device 300 shown in the second embodiment is described. The processing units may be combined.

  By the way, among the processes described in the first and second embodiments, all or part of the processes described as being automatically performed can be manually performed, or have been described as being manually performed. All or part of the processing can be automatically performed by a known method. In addition, the information including the processing procedure, control procedure, specific name, and various data shown in the above document and drawings can be arbitrarily changed unless otherwise specified.

  Further, each component of the cellular phone terminal device 100 shown in FIG. 3 and the cellular phone terminal device 300 shown in FIG. 13 is functionally conceptual, and it is necessary that the components are not physically configured as illustrated. do not do. In other words, the specific form of distribution / integration of each device is not limited to that shown in the figure, and all or a part thereof may be functionally or physically distributed or arbitrarily distributed in arbitrary units according to various loads or usage conditions. Can be integrated and configured. Furthermore, each processing function performed by each device may be realized by a CPU and a program that is analyzed and executed by the CPU, or may be realized as hardware by wired logic.

  FIG. 16 is a diagram illustrating a hardware configuration of a mobile phone terminal device that executes a program for determining non-transmission of speech information. As shown in FIG. 16, the cellular phone terminal device 400 has a microphone 401, a wireless communication unit 402, a voice conversion unit 403, a storage area 404, a CPU (Central Processing Unit) 405, a vibrator 406, a display 407, and a speaker 408 as a bus. 409 is connected.

  In the storage area 404, various data 404a including data used by the CPU 405, and an utterance volume determination that exhibits the same function as the above-described function of comparing and determining the utterance volume and the overall volume of the mobile phone terminal device 100 described above. Human language that performs the same function as the program 404b, the volume comparison / determination program 404c that performs the same function as the function that compares and determines the received sound volume and the surrounding sound volume, and the function that extracts language information from the utterance information and the received information Judgment program 404d, whether the speaker and the listener have spoken at the same time, or the reception / speech monitoring program 404e that performs the same function as the function of judging the non-response time after utterance, whether the spoken voice is missing A missing alarm program 404f for judging the above is stored.

  Then, the CPU 405 reads and executes the utterance volume determination program 404b, the volume comparison determination program 404c, the human language determination program 404d, the received / utterance monitoring program 404e, and the missing alarm program 404f, thereby executing the utterance volume determination process 405a, the volume. The comparison determination process 405b, the human language determination process 405c, the received / utterance monitoring process 405d, and the missing alarm process 405e are activated. Here, the speech volume determination process 405a corresponds to the speech volume determination unit 104 shown in FIG. 3, the volume comparison determination process 405b corresponds to the volume comparison determination unit 107 shown in FIG. 3, and the human language determination process 405c The speech / utterance monitoring process 405d corresponds to the speech / utterance monitoring / determination unit 108, and the missing alarm process 405e corresponds to the personal language determination unit 103 and human language determination unit 106 shown in FIG. Corresponds to the missing alarm unit 316.

  Examples of the various data 404a include data such as an utterance volume and an overall volume used for the utterance volume determination process 405a. Then, the CPU 405 reads out the various data 404a, temporarily stores it in the storage area 404, and based on the various data 404a stored in the storage area 404, “whether or not the uttered information is correctly transmitted to the other party”. Is performed.

  By the way, the utterance volume determination program 404b, the volume comparison determination program 404c, the human language determination program 404d, the received / utterance monitoring program 404e, and the missing alarm program 404f shown in FIG. There is no need to remember. For example, the data is stored in a “portable physical medium” such as an SD card, and the mobile phone terminal device has a speech volume determination program 404b, a volume comparison determination program 404c, a language determination program 404d, a received / speech monitoring program 404e, missing. The alarm program 404f may be read and executed.

  The following additional notes are further disclosed with respect to the embodiments including the above examples.

(Supplementary Note 1) The volume of the voice input by the user of the mobile phone terminal device is compared with the peripheral volume including the volume around the mobile phone terminal device, and the voice of the user is compared with the mobile phone on the other side. An utterance volume determination means for determining whether or not it is correctly transmitted to the terminal device;
A mobile phone terminal device comprising: output means for outputting a judgment result of the utterance volume judgment means.

(Supplementary note 2) The supplementary note 1, further comprising notification means for outputting the judgment result of the utterance volume judgment means to the counterpart mobile phone terminal device and notifying the user of the mobile phone terminal device of the judgment result Mobile phone terminal device.

(Additional remark 3) The said notification means is a mobile telephone terminal device of Additional remark 2 which notifies the said determination result to the said user by an alarm, a vibrator, or a display display.

(Supplementary Note 4) When the speech volume determination unit determines that the voice of the user of the mobile phone terminal device is correctly transmitted to the mobile phone terminal device on the other side, the output unit displays the determination result. 4. The mobile phone terminal device according to appendix 1, 2 or 3 for output.

(Additional remark 5) The audio | voice input by the user of the other party's portable telephone terminal device is acquired, the volume of the acquired voice is compared with the peripheral volume including the volume around the own portable telephone terminal device, Volume comparison determination means for determining whether the user's voice input to the mobile phone terminal device on the side is correctly transmitted to the user of the mobile phone terminal device;
A mobile phone terminal device comprising: output means for outputting a judgment result of the volume comparison judgment means.

(Supplementary note 6) The supplementary note 5, further comprising notification means for outputting the judgment result of the volume comparison judgment means to the counterpart mobile phone terminal device and notifying the user of the mobile phone terminal device of the judgment result. Mobile phone terminal device.

(Additional remark 7) The said notification means is a mobile telephone terminal device of Additional remark 6 which notifies the said determination result to the said user by an alarm, a vibrator, or a display display.

(Supplementary Note 8) When the volume comparison determination unit determines that the voice of the user of the mobile phone terminal device is correctly transmitted to the mobile phone terminal device on the other side, the output unit displays the determination result. 8. The mobile phone terminal device according to appendix 5, 6 or 7 for outputting.

(Additional remark 9) The 1st conversion means which converts into a 1st character information the audio | voice input into the own mobile phone terminal device from the said other party's mobile phone terminal device, and the said mobile phone terminal device from the said other party mobile phone terminal device A second conversion means for acquiring the output sound together with surrounding sounds around the mobile phone terminal device when the sound input to the terminal device is output, and converting the acquired sound into second character information; The first character information is compared with the second character information, and whether or not the voice from the counterpart mobile phone terminal device is correctly transmitted to the user of the mobile phone terminal device based on the comparison result The mobile phone terminal device according to any one of appendices 5 to 8, further comprising a determination unit that determines whether or not.

(Additional remark 10) The said judgment means exists in the said 1st character information based on the said 1st character information and the said 2nd character information, and the character which does not exist in the said 2nd character information 10. The mobile phone terminal device according to any one of appendices 5 to 9, wherein information is determined and a determination result is notified to the counterpart mobile phone terminal device.

(Supplementary note 11) The mobile phone terminal according to any one of supplementary notes 5 to 10, further comprising display means for displaying a determination result by the determination means on the counterpart mobile phone terminal device and / or the own mobile phone terminal device. apparatus.

(Supplementary note 12) Reception / speech for determining whether or not the voice of the user of the mobile phone terminal device is correctly transmitted to the mobile phone terminal device on the other side depending on whether the speech and the reception are performed simultaneously The mobile phone terminal device according to any one of appendices 1 to 11, further comprising a determination unit.

(Additional remark 13) The said voice / utterance judging means inputs the voice of the user to the mobile phone terminal device on the other side even if a predetermined time has passed after the voice input by the user of the mobile phone terminal device is completed. If not, the mobile phone terminal device according to any one of appendices 1 to 12, which determines that the voice of the user of the mobile phone terminal device is not correctly transmitted to the mobile phone terminal device on the other side.

(Supplementary Note 14) In a device for transmitting call information of a mobile phone terminal device, voice input from the mobile phone terminal device according to any of Supplementary Notes 1 to 13 to the mobile phone terminal device is transmitted to the mobile phone terminal device on the other side. A transmission device comprising a transmission means for transmitting the notified information to the mobile phone terminal device on the other party side when information indicating that the information is not made is notified.

(Supplementary Note 15) The mobile phone terminal device
A storage step of storing, in a storage device, a volume of a voice input by a user of the mobile phone terminal device and a peripheral volume including a volume around the mobile phone terminal device;
An utterance volume determination step of comparing the volume of the voice stored in the storage device with the peripheral volume to determine whether or not the user's voice is correctly transmitted to the counterpart mobile phone terminal device When,
An output step for outputting a determination result of the utterance volume determination step.

(Supplementary note 16)
A storage procedure for storing, in a storage device, a volume of voice input by a user of the mobile phone terminal device and a peripheral volume including a volume around the mobile phone terminal device;
An utterance volume determination procedure for comparing the voice stored in the storage device with the peripheral volume and determining whether the user's voice is correctly transmitted to the other party's mobile phone terminal device;
An output procedure for outputting a determination result of the speech volume determination procedure.

DESCRIPTION OF SYMBOLS 10 Speaker 20 Receiver 100, 300, 400 Mobile phone terminal device 100a, 100b, 300a, 300b Mobile phone 200 Telephone network 200a, 200b Base station 200c, 200d, 200e Switch 101, 301 Microphone 102 Speech sound conversion unit 103, 106 Human language determination unit 104 Speech volume determination unit 105 Received sound conversion unit 107 Volume comparison determination unit 108 Received / utterance monitoring / determination unit 109 User notification unit 110 Call destination notification unit 111 Display control unit 112 Vibrator control unit 113, 303, 408 Speaker 114 Wireless unit 115 Control unit 301 Memory 302, 405 CPU
304 monitor microphone 310 wireless control unit 311 call control unit 312 speaker control unit 313 monitor microphone control unit 314, 315 speech recognition engine 316 missing alarm unit 316a timer 316b text input / output control unit 316c text comparison unit 317 alarm sound generation unit 318 display unit 401 Microphone 402 Wireless communication unit 403 Voice conversion unit 404 Storage area 404a Various data 404b Speech volume determination program 404c Volume comparison determination program 404d Human language determination program 404e Speech / speech monitoring program 404f Missing alarm program 405a Speech volume determination process 405b Volume comparison determination Process 405c Human language determination process 405d Speech / utterance monitoring process 405e Missing alarm process 406 Vibrator 4 7 display 409 bus

Claims (10)

By comparing the volume of the voice input by the user of the mobile phone terminal device with the peripheral volume including the volume around the mobile phone terminal device, the voice of the user is correctly transmitted to the mobile phone terminal device on the other side. Utterance volume judgment means for judging whether or not it is transmitted,
A mobile phone terminal device comprising: output means for outputting a judgment result of the utterance volume judgment means.   2. The mobile phone terminal according to claim 1, further comprising a notification unit that outputs a determination result of the utterance volume determination unit to the mobile phone terminal device of the other party and notifies the user of the mobile phone terminal device of the determination result. apparatus. The voice input by the user of the other party's mobile phone terminal device is acquired, and the volume of the acquired voice is compared with the peripheral volume including the volume around the own mobile phone terminal, and the other party's mobile phone terminal Volume comparison judgment means for judging whether or not the voice of the user input to the device is correctly transmitted to the user of the mobile phone terminal device;
A mobile phone terminal device comprising: output means for outputting a judgment result of the volume comparison judgment means.   The mobile phone terminal according to claim 3, further comprising notification means for outputting the determination result of the volume comparison determination means to the counterpart mobile phone terminal device and notifying the user of the mobile phone terminal device of the determination result. apparatus.   First conversion means for converting voice input from the counterpart mobile phone terminal device to the first mobile phone terminal device to first character information, and input from the counterpart mobile phone terminal device to the mobile phone terminal device Second output means for acquiring the output sound together with ambient sounds around the mobile phone terminal device when the output sound is output, and converting the acquired sound into second character information; The character information is compared with the second character information, and based on the comparison result, it is determined whether or not the voice from the other party's mobile phone terminal device is correctly transmitted to the user of the own mobile phone terminal device. 5. The mobile phone terminal device according to claim 3, further comprising a determination unit.   The determination means determines character information that exists in the first character information and does not exist in the second character information, based on the first character information and the second character information. 6. The mobile phone terminal device according to claim 3, 4 or 5, wherein the determination result is notified to the mobile phone terminal device on the other side.   The mobile phone terminal device according to any one of claims 3 to 6, further comprising display means for displaying a determination result by the determination means on the counterpart mobile phone terminal device and / or the own mobile phone terminal device.   A receiving / speech judging means for judging whether or not the voice of the user of the mobile phone terminal device is correctly transmitted to the mobile phone terminal device on the other side according to whether or not the utterance and the receiving speech are performed simultaneously; The mobile phone terminal device according to any one of claims 1 to 7.   The reception / speech determination means, when the user's voice is not input to the other party's mobile phone terminal device even after a predetermined time has elapsed after the voice input by the user of the mobile phone terminal device is completed, The mobile phone terminal device according to any one of claims 1 to 8, wherein it is determined that the voice of the user of the mobile phone terminal device is not correctly transmitted to the mobile phone terminal device on the other side. The mobile phone terminal device
A storage step of storing, in a storage device, a volume of a voice input by a user of the mobile phone terminal device and a peripheral volume including a volume around the mobile phone terminal device;
An utterance volume determination step of comparing the volume of the voice stored in the storage device with the peripheral volume to determine whether or not the user's voice is correctly transmitted to the counterpart mobile phone terminal device When,
An output step for outputting a determination result of the utterance volume determination step.

Images