JP2013026779A - Communication terminal and communication method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To promote smooth communication by promptly shifting to a hold state at the start of a language selection operation when language selection is performed during telephone conversation, and by clearly conveying resumption of telephone conversation using a translation target language associated with telephone conversation with the opposite party.SOLUTION: A mobile terminal 1 communicating with other mobile communication terminals 30, 40 includes: at communication with the other terminals 30, 40, an input unit 11 for accepting a selection operation input of the translation target language associated with the communication with the other mobile communication terminals 30, 40 to translate an input voice data; and at the start of inputting the selection operation of the translation target language, a control unit 10 for shifting the communication state of communication with the other mobile communication terminals 30, 40 to a hold state.

Description

  The present invention relates to a communication terminal and a communication method for making a call with one or more other communication terminals.

  In recent years, communication terminals such as mobile phones are widely used as tools for promoting communication between users.

  Conventionally, as such a communication terminal, a call translation apparatus that translates (interprets) voice data between a caller and a callee is known (see, for example, Patent Document 1). This call translation device extracts regional data from identification information of a transmission destination transmitted to a partner terminal, reads out language information corresponding to the regional data, selects a language to be translated, and converts voice data in the selected language. Translate. In this way, by making a call in the translated language, communication between the caller and the callee can be promoted.

JP 2003-288340 A

  However, in the above-described conventional communication terminal, when it becomes necessary to reselect a language during a call, the user needs to perform a process of confirming and selecting a language, which causes a blank period of communication. was there. At this time, silent time or noise (noise) is generated in a call between users, and it is considered that smooth communication cannot be established. Therefore, the other party cannot confirm what is happening, which causes inconvenience in communication.

  When the language reselection is executed during a call by using the configuration of the call translation device of Patent Document 1 described above, the call is inevitably interrupted by the user confirming the language several times, resulting in a gap. Therefore, it can be considered that the communication is hindered as well.

  Therefore, the present invention has been made in view of the above-described conventional circumstances, and when performing language selection during a call, the call state is quickly shifted to a hold state at the start of a language selection operation, It is an object of the present invention to provide a communication terminal and a communication method that clearly convey that a call is resumed in the language of the translation destination corresponding to the call of, and promote smooth communication.

  The present invention is the communication terminal described above, which is a communication terminal that makes a call with one or a plurality of other communication terminals, and that the input voice data is transferred to the other communication terminal during a call with the other communication terminal. An input unit that accepts input of a translation language selection operation corresponding to a call with a terminal, and a call status of a call with the other communication terminal is put on hold at the start of input of the translation language selection operation The control part which transfers to.

  In addition, the present invention is the communication method described above, which is a communication method in a communication terminal that makes a call with one or more other communication terminals, and that is input voice data during a call with the other communication terminal. Receiving an input of a translation destination language selection operation corresponding to a call with the other communication terminal, and at the start of an input of the translation destination language selection operation, a call with the other communication terminal Transitioning the state to a pending state.

  According to the configuration described above, when performing language selection during a call, the call state is quickly shifted to the hold state at the start of the language selection operation, and the call is performed in the language of the translation destination corresponding to the call with the other party. You can clearly communicate that you will resume and promote smooth communication.

  According to the present invention, when language selection is performed during a call, the call state is quickly shifted to the hold state at the start of the language selection operation, and the call is resumed in the language of the translation destination corresponding to the call with the other party. You can clearly communicate that you want to do and promote smooth communication.

1 is a system configuration diagram showing a configuration of a communication system including a mobile communication terminal according to the first embodiment. The block diagram which shows the hardware constitutions of the portable communication terminal of 1st Embodiment The figure which shows the contents of the table which is remembered in the database The figure which shows the screen displayed on the display part of a portable communication terminal, (A) Explanatory drawing which shows the screen during a telephone call, (B) Explanatory drawing which shows the screen at the time of language selection Sequence diagram for explaining the overall operation procedure of the translation destination language selection process (selection operation) performed during another party's call The flowchart explaining the operation | movement procedure at the time of the start of the selection process (selection operation) of the language of the translation destination of a portable communication terminal The flowchart explaining the operation | movement procedure at the time of completion | finish of the selection process (selection operation) of the language of the translation destination of a portable communication terminal The flowchart explaining the operation | movement procedure of a portable communication terminal when the selection process (selection operation) of the language of a translation destination is performed by each called party (each call partner) during another party's call The figure which shows the screen displayed on the display part of a portable communication terminal The flowchart explaining the operation | movement procedure at the time of completion | finish of the input of the selection process (selection operation) of the language of the translation destination of the portable communication terminal of 2nd Embodiment. Block diagram showing a hardware configuration of a mobile communication terminal including an automatic translation function unit

  Embodiments of a communication terminal according to the present invention will be described below with reference to the drawings. The communication terminal according to the present invention is applicable to a mobile communication terminal such as a mobile phone or a smartphone having a wireless communication function capable of transmitting and receiving information or data and a call function. In the following embodiments, for example, one caller uses a communication terminal (mobile communication terminal) according to the present invention, and a plurality of callees (calling partners) each using a mobile communication terminal having the same configuration. The case where the caller selects the language of the translation destination corresponding to each other party of the other party's call during the other party's call at the same time will be described as an example.

  For example, if a caller who speaks Japanese and speaks Japanese, a caller who speaks English in the United States, and another caller who speaks French in French and speaks French, The language is English or French spoken by the caller as seen by the Japanese caller.

  The present invention can also be expressed as a device for operating a device such as a mobile communication terminal or a mobile communication terminal as a computer. Furthermore, the present invention can also be expressed as a method including processing (steps) executed by the mobile communication terminal. That is, the present invention can be expressed in any category of terminals (devices), methods, and programs.

(First embodiment)
FIG. 1 is a system configuration diagram illustrating a configuration of a communication system 100 including the mobile communication terminal 1 of the first embodiment. The communication system 100 according to the present embodiment includes a mobile communication terminal 1 used by a caller, wireless base stations 25 to 27, a network 35, a server 20, and mobile communication terminals 30 and 40 used by a callee.

  In the communication system 100, a caller using the mobile communication terminal 1 and a plurality of callees respectively holding the mobile communication terminals 30 and 40 via the radio base stations 25 to 27 and the network 35 are simultaneously one-to-many. It is possible to make another person's call.

  Note that the configuration of the communication system 100 is an example, and the configuration of the caller or the callee can be variously changed. For example, in FIG. 1, two wireless base stations 26 and 27 and two portable communication terminals 30 and 40 are configured as one wireless base station 26 and one portable communication terminal 30, respectively. One mobile communication terminal 30 used by the other caller may make a call with the mobile communication terminal 1 via the wireless base station 26 in a hands-free call state.

  The server 20 corresponds to the caller using the mobile communication terminals 30 and 40 with the voice data of the call contents transmitted from the mobile communication terminal 1 used by the caller and the text data of the message (see FIG. 3) described later (suitable) E) An automatic translation function unit 22 that translates into the translation destination language.

(Configuration of mobile communication terminal 1)
FIG. 2 is a block diagram illustrating a hardware configuration of the mobile communication terminal 1 according to the first embodiment. As shown in FIG. 2, the mobile communication terminal 1 includes a control unit 10, an input unit 11, a communication unit 12 to which an antenna is connected, a display unit 13, an audio processing unit 14, a timer 15, a storage unit 16, and a database 17. It is the composition which includes. The audio processing unit 14 is connected to a speaker 18 as an audio output unit and a microphone (microphone) 19 as an audio input unit. Since the mobile communication terminals 30 and 40 have the same configuration as the hardware configuration of the mobile communication terminal 1 in FIG. 2, the mobile communication terminal 1 will be described below as an example. Omitted.

  The control unit 10 is configured using a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like built in the mobile communication terminal 1, and controls the operation of each unit of the mobile communication terminal 1. To do. The operation of the control unit 10 will be described later with reference to FIGS.

  The input unit 11 is a user interface that receives an input operation on the mobile communication terminal 1 of the caller using the mobile communication terminal 1, and outputs an operation signal corresponding to the operation content of the caller to the control unit 10. For example, the input unit 11 responds to the other party's call with the mobile communication terminals 30 and 40 by using the voice data that is the caller's call content input to the microphone 19 when the other party calls with the mobile communication terminals 30 and 40. Accept input of translation language selection operation. The input unit 11 outputs an operation signal corresponding to the accepted language selection operation to the control unit 10.

  The input unit 11 can be configured using various keys such as a numeric keypad for inputting a telephone number and the like, a caller key for performing on-hook or off-hook, and a function key. Furthermore, the input unit 11 may be configured using a touch panel that is disposed on the display unit 13 and can accept an input operation using a caller's finger or a stylus pen.

  The communication unit 12 is configured using a wireless communication circuit capable of transmitting and receiving information or data, communicates with the wireless base station 25 via an antenna, and transmits and receives data such as voice data, text data, or image data.

  The display unit 13 is configured by using an LCD (Liquid Crystal Display) or an organic EL display (Organic Electroluminescence Display), and is displayed on a standby screen used in the mobile communication terminal 1 and during a call under the control of the control unit 10. Or a language selection screen (see FIG. 4B) displayed at the time of selecting the language to be translated.

  The audio processing unit 14 is configured using an audio processing circuit capable of performing audio processing such as removing noise audio or adjusting the volume level from the input audio data, and is input by the caller via the microphone 19. The voice data is voice processed and output to the control unit 10. In addition, the voice processing unit 14 performs voice processing on voice data transmitted from the other party (called party) and outputs the voice data from the speaker 18.

  The timer 15 counts the hold duration time from when the other party's call with the called party (calling party) starts to shift to the hold state based on the instruction indicating the shift to the hold state output from the control unit 10. To do.

  The storage unit 16 is configured by using a flash memory or a hard disk built in the mobile communication terminal 1 and stores various data used in the operation of the mobile communication terminal 1 or instructed to be saved by the caller.

  The database 17 is configured by using a flash memory or a hard disk built in the mobile communication terminal 1 in the same manner as the storage unit 16, and a table 17a described later and text data of a preset message used in the table 17a. And voice data are stored. When the mobile communication terminal 1 is set so that the language used (Japanese) can be used in accordance with the specifications of the user (for example, Japanese), the text data and voice data of the message corresponding to the language used are stored. Preferably it is stored.

  In addition, the database 17 stores voice data of a holding sound that is output as voice between the mobile communication terminals 30 and 40 when the mobile communication terminal 1 shifts to the hold state. In FIG. 1, the storage unit 16 and the database 17 are shown as separate configurations, but the storage unit 16 and the database 17 may be integrated in the mobile communication terminal 1.

  In the first embodiment, among the plurality of messages stored in the database 17, text data or voice data of the fixed message “I am sorry to wait. I will resume the call.” Used.

  FIG. 3 is a diagram showing the contents of the table 17 a stored in the database 17. In the table 17a, a hold duration and a message corresponding to the hold duration are fixedly set in advance.

  Specifically, when the hold duration time is within 5 sec (seconds), the message “Sorry for waiting. I will resume the call” is used. When the hold duration is within 10 sec (seconds), the message “Are you ready? Call resumed” is used. If the hold duration is less than 30 seconds (seconds), the message “Sorry for waiting too long. Sorry, we will resume the call. Please prepare.” Is used.

  FIG. 4 is a diagram illustrating a screen displayed on the display unit 13 of the mobile communication terminal 1. FIG. 4A is an explanatory diagram showing a screen during a call. FIG. 4B is an explanatory diagram showing a screen when a language is selected. The display unit 13 is provided on the front side of the housing 1 a of the mobile communication terminal 1.

  On the screen during the call in FIG. 4A, the text data of the message indicating that “the other party is talking” and the telephone numbers of the mobile communication terminals 30 and 40 used by the other party in the other party's call are displayed. Is done. In addition, various operation keys including a language selection key 11a are displayed at the bottom of the screen of the display unit 13 so that they can be pressed (selected).

  In addition, in the language selection screen shown in FIG. 4B, translation destination language candidates that can be selected in the mobile communication terminal 1 such as “Japanese”, “English”, and “French” are displayed in a list. . FIG. 4B shows that, for example, English is focused and selected as the currently selected language. Further, a menu key 11b, an enter key 11c, a cancel key 11d, and the like are displayed at the bottom of the screen of the display unit 13 so as to be pressed (selectable).

  The speaker 18 is configured using an audio output element capable of outputting audio data processed by the audio processing unit 14, and is subjected to audio processing by the audio processing unit 14 based on the audio processing instruction output from the control unit 10. Output audio data.

  The microphone 19 is configured using a voice input element that collects call voice data from a caller using the mobile communication terminal 1, and collects call voice data that is a call content uttered by the caller to perform voice processing. To the unit 14.

(Operation of the mobile communication terminal 1)
Next, the operation of the mobile communication terminal 1 including the above-described configuration will be described. First, an outline of an operation at the time of a translation destination language selection operation during a third party call between the mobile communication terminal 1 and the mobile communication terminals 30 and 40 will be described with reference to FIG. FIG. 5 is a sequence diagram for explaining the overall operation procedure of the translation destination language selection process (selection operation) performed during a call by another person.

  In FIG. 5, it is assumed that a caller who uses the mobile communication terminal 1 and a callee who uses the mobile communication terminals 30 and 40 are calling each other using the automatic translation function unit 22 of the server 20. At the time of another person's call, the mobile communication terminal 1 presses the language selection key 11a from the caller at the start of input of the translation destination language selection process (selection operation) by the caller's operation using the mobile communication terminal 1 An operation is accepted, and further, a translation destination language selection process (selection operation) corresponding to the callee is accepted (step T1).

  When the operation of depressing the language selection key 11a in step T1 and the selection process (selection operation) of the translation destination language corresponding to the called party are performed, the control unit 10 performs the other party's call with the mobile communication terminals 30 and 40. An instruction to shift the call state to the hold state is output to the communication unit 12 and the voice processing unit 14 (step T2). Thereby, the other party's call in the mobile communication terminal 1 and the mobile communication terminals 30 and 40 temporarily shifts to the hold state (step T2).

  During the transition to the hold state, the caller using the mobile communication terminal 1 performs a translation destination language selection process (selection operation) corresponding to the callee.

  At the end of the input of the translation destination language selection process (selection operation) (step T3), the control unit 10 outputs a hold state release instruction to the communication unit 12 and the voice processing unit 14, respectively (step T4). Thereby, the hold state of the other party call between the mobile communication terminal 1 and the mobile communication terminals 30 and 40 is released, and the call state of the other party call is restored. Further, the control unit 10 transmits the text data and / or voice data of the message set in the table 17a to the mobile communication terminals 30 and 40 (step T5).

  FIG. 6 is a flowchart for explaining the operation procedure at the start of the translation destination language selection process (selection operation) of the mobile communication terminal 1. A program for realizing the operation procedure of the flowchart of FIG. 6 is stored in advance in a ROM built in the control unit 10, and the operation procedure of the flowchart of FIG. 6 is periodically executed by the CPU built in the control unit 10. .

  In FIG. 6, the control unit 10 determines whether any key operation is accepted from the input unit 11 when the mobile communication terminal 1 and the mobile communication terminals 30 and 40 are talking to each other (step S <b> 1). . When no key operation is received from the input unit 11 in step S1 (step S1, NO), the operation of the control unit 10 shown in the flowchart of FIG. 6 ends.

  On the other hand, when any key operation is received from the input unit 11 in step S1 (step S1, YES), the control unit 10 determines whether or not another person is in a call (step S2). For example, a flag (information) indicating that the mobile communication terminal 1 is in a call with the mobile communication terminals 30 and 40 is stored in a RAM or the like built in the control unit 10 as to whether or not the other party is in a call. It is determined according to whether or not it is.

  When it is determined that the other party is not calling (step S2, NO), the control unit 10 performs non-call processing, for example, activation of another application, in accordance with the input operation from the caller received in step S1. (Step S3). After step S3, the operation of the control unit 10 ends.

  On the other hand, when it is determined in step S2 that the other party is talking (step S2, YES), the control unit 10 presses the language selection key 11a according to the input operation from the caller received in step S1, It is determined whether or not input of a translation destination language selection process (selection operation) has started (step S4).

  If it is determined in step S4 that the input of the translation destination language selection process (selection operation) has not started (NO in step S4), the control unit 10 performs the input operation from the caller accepted in step S1. In response, non-language selection processing such as volume adjustment is performed (step S5). After step S5, the operation of the control unit 10 ends.

  On the other hand, if it is determined in step S4 that the input of the translation destination language selection process (selection operation) has been started (step S4, YES), the control unit 10 communicates a transfer instruction for shifting to the hold state. Are output to the unit 12 and the voice processing unit 14 (step S6). The communication unit 12 transmits the instruction to shift to the hold state from the control unit 10 to the mobile communication terminals 30 and 40, respectively. The voice processing unit 14 acquires the voice data of the holding sound from the database 17 and outputs it from the speaker 18 based on the instruction to shift to the hold state from the control unit 10. Note that the mobile communication terminals 30 and 40 cause the sound data of the hold sound to be output from the speakers of the mobile communication terminals 30 and 40 based on the instruction to shift to the hold state transmitted from the communication unit 12.

  Thereby, the mobile communication terminal 1 and the mobile communication terminals 30 and 40 shift from the state of the other person's call to the hold state (step S7). After step S7, the operation of the control unit 10 ends.

  FIG. 7 is a flowchart for explaining the operation procedure at the end of the translation destination language selection process (selection operation) of the mobile communication terminal 1. A program for realizing the operation procedure of the flowchart of FIG. 7 is stored in advance in a ROM built in the control unit 10, and the operation procedure of the flowchart of FIG. 7 is periodically executed by the CPU built in the control unit 10. .

  In FIG. 7, when the other party's call between the mobile communication terminal 1 and the mobile communication terminals 30 and 40 is on hold (step S11), the control unit 10 selects a translation destination language (selection) from the caller. It is periodically determined whether or not the input of (operation) has been completed (step S12).

  If it is determined in step S12 that the input of the translation destination language selection process (selection operation) has not been completed (NO in step S12), the control unit 10 selects the translation destination language (selection operation). ) Until the input is completed (step S13). After step S13, the operation of the control unit 10 returns to the process of step S11.

  On the other hand, when it is determined in step S12 that the input of the translation destination language selection process (selection operation) has been completed (step S12, YES), the control unit 10 stores the text data of the message stored in the database 17 Alternatively, audio data or both data are read (step S14).

  Furthermore, the control unit 10 transmits the text data and / or voice data of the message read in step S14 from the mobile communication terminal 1 to the mobile communication terminals 30 and 40 via the communication unit 12, respectively. (Step S15). Further, the control unit 10 causes the display unit 13 to display the text data of the message read in step S14. Further, the control unit 10 outputs the voice data of the message read in step S <b> 14 from the speaker 18 by the voice processing unit 14. In the case of outputting audio data, the audio processing unit 14 interrupts the acquisition of the on-hold audio data from the control unit 10. In the description of FIG. 7, it is assumed that a fixed message, for example, text data and / or voice data of a message “sorry for waiting. After step S15, the control unit 10 releases the hold state of the other person communication (step S16). Thereby, the operation of the control unit 10 ends.

  FIG. 8 is a flowchart for explaining the operation procedure of the mobile communication terminals 30 and 40 when the translation destination language selection processing (selection operation) is performed by each callee (each call partner) during another party's call. . A program for realizing the operation procedure of the flowchart of FIG. 8 is stored in advance in a ROM built in each control unit of the mobile communication terminals 30 and 40, and the operation procedure of the flowchart of FIG. 8 is built in the control unit. It is periodically executed by the CPU.

  When the mobile communication terminal 1 shifts to the hold state when the other party is talking with the mobile communication terminal 1 (step S31), the control unit of the mobile communication terminals 30 and 40 receives a message from the communication unit 12 of the mobile communication terminal 1. Wait until text data or audio data is received (step S32). The text data or voice data of the message transmitted to the mobile communication terminals 30 and 40 is selected in the mobile communication terminal 1 from the text data or voice data (for example, Japanese) of the message used in the mobile communication terminal 1. This is translated into the translated language by the automatic translation function unit 22 of the server 20 (for example, English or French).

  When the text data or voice data of the message is received (step S32, YES), the control unit of the mobile communication terminals 30 and 40 receives the message received in step S32, that is, the Japanese message transmitted from the mobile communication terminal 1. Text data of the message "I'm so sorry to have kept you waiting. Our communication will be back in business soon." Is displayed on the screen of the display unit 13 (see step S33, FIG. 9), and the voice data of this message is output from the speaker 18 by the voice processing unit 14. In the case of outputting audio data, the audio processing unit 14 interrupts the acquisition of the on-hold audio data from the control unit 10. FIG. 9 is a diagram showing a screen displayed on the display unit 13 of the mobile communication terminals 30 and 40. The called party using the mobile communication terminals 30 and 40 respectively confirms the message displayed on the screen of the display unit 13 or the voice output from the speaker 18 to resume the other party call with the calling party. Can be recognized.

  The control part of the portable communication terminals 30 and 40 instructs the sound processing part to stop outputting the sound data of the holding sound to the speaker after step S33. Thereby, the other party's call between the mobile communication terminals 30 and 40 and the mobile communication terminal 1 returns to the call state (step S34). Thus, the operation of the control unit of the mobile communication terminals 30 and 40 ends.

  As described above, according to the mobile communication terminal of the first embodiment, during the other party's call, the caller is put on hold from the call state of the other party's call at the start of input of the translation destination language selection process (selection operation). By quickly shifting to the state, it is possible to clearly communicate that the call is resumed in the language of the translation destination corresponding to the call with each callee (each call partner). Thereby, according to the portable communication terminal of the first embodiment, it is possible to prevent communication troubles between the call partners and to give the call partner a sense of security.

  Further, when the other party's call between the mobile communication terminal 1 and the mobile communication terminals 30 and 40 has shifted to the hold state, the mobile communication terminal 1 may receive the text data or voice data of the message before canceling the hold state. Alternatively, both data are transmitted to the mobile communication terminals 30 and 40 of the other party. Thereby, the mobile communication terminal 1 can prompt each user who uses the mobile communication terminals 30 and 40 to prepare for the return of the call. In addition, when the language selection operation is performed by the caller in the mobile communication terminal 1, the language selection is started, so that the caller of the other party call can start the language selection at his / her arbitrary timing. In addition, since the automatic translation function is installed in the server 20, the mobile communication terminal 1 can have a simple configuration.

(Second Embodiment)
In the first embodiment described above, when canceling the hold state and resuming the call, fixed message text data or voice data or both data is transmitted from the mobile communication terminal 1 to the mobile communication terminals 30 and 40, respectively. Sent. In the second embodiment, the message transmitted from the mobile communication terminal 1 to the mobile communication terminals 30 and 40 is changed according to the hold duration time (also simply referred to as hold time).

  In the second embodiment, it is assumed that a message is set in advance every 5 seconds (seconds) of the holding duration of the table 17a in FIG. Further, in the second embodiment, the threshold value of the hold duration time during which the message in the table 17a is changed is represented as a parameter Nj (j is a natural number). Therefore, in the table 17a of FIG. 3, N1 = 5, N2 = 10,..., N6 = 30,.

  Since the mobile communication terminal of the second embodiment has almost the same configuration as the mobile communication terminal of the first embodiment, the same reference numerals are used for the same components as those of the mobile communication terminal of the first embodiment. Therefore, the description is omitted.

  Further, the operation procedure at the start of input of the language selection process (selection operation) of the translation destination of the mobile communication terminal 1 used by the caller in the other party's call is the same as the contents of the first embodiment shown in FIG. is there. Furthermore, the operation procedure of the portable communication terminal when the translation destination language selection processing (selection operation) is performed by each callee (each call partner) during the other party's call is the first implementation shown in FIG. It is the same as the contents of the form.

  FIG. 10 is a flowchart illustrating an operation procedure at the end of input of a translation destination language selection process (selection operation) of the mobile communication terminal 1 according to the second embodiment. A program for realizing the operation procedure of the flowchart of FIG. 10 is stored in advance in a ROM built in the control unit 10, and the operation procedure of the flowchart of FIG. 10 is periodically executed by the CPU built in the control unit 10. .

  In FIG. 10, the control unit 10 outputs to the timer 15 an instruction indicating that the mobile communication terminal 1 and the mobile communication terminals 30 and 40 are on hold when the other party's call is on hold. As a result, the timer 15 starts measuring the hold duration time from the start of shifting to the hold state based on the instruction from the control unit 10 (step S21). Based on the operation signal from the input unit 11, the control unit 10 periodically determines whether or not the input of the translation destination language selection process (selection operation) by the caller has been completed (step S22).

  If it is determined that the input of the translation destination language selection process (selection operation) by the caller has not been completed (step S22, NO), the control unit 10 selects the translation destination language (selection operation). ) Until the input is completed (step S23). After step S23, the operation of the control unit 10 returns to the process of step S22.

  On the other hand, if it is determined in step S22 that the language selection process (selection operation) for the translation destination has been completed (YES in step S22), the control unit 10 determines the hold duration (k and Is determined), the threshold value Nj of the hold duration time for determining the message transmitted to the mobile communication terminals 30 and 40 is determined (step S24).

  For example, when the hold duration k measured in step S21 is 3 sec, the control unit 10 sets the hold duration threshold Nj for determining a message transmitted to the mobile communication terminals 30 and 40 to N1 = It is determined as 5 sec (j = 1). If the hold duration time k measured in step S21 is 10 sec, the control unit 10 sets the hold duration threshold value Nj for determining a message transmitted to the mobile communication terminals 30 and 40 to N2 = It is determined as 10 sec (j = 2). Furthermore, when the hold duration k measured in step S21 is 11 sec, the control unit 10 sets the hold duration threshold Nj for determining the message transmitted to the mobile communication terminals 30 and 40 to N3 = It is determined as 15 sec (j = 3).

  After step S24, the controller 10 refers to the table 17a stored in the database 17 and reads a message corresponding to the threshold value Nj of the hold duration determined in step S24 (step S25). For example, when the threshold value Nj of the hold duration determined in step S24 is within N1 = 5 sec, “I'm waiting, I will resume the call”, when the threshold Nj is within N6 = 30 sec, “ I ’m sorry to have kept you waiting very long. I ’ll read it again.

  Further, the control unit 10 transmits the text data and / or voice data of the message read in step S25 via the communication unit 12 from the mobile communication terminal 1 to the mobile communication terminals 30 and 40, respectively. (Step S26). Further, the control unit 10 causes the display unit 13 to display the text data of the message read in step S25. Further, the control unit 10 causes the voice processing unit 14 to output the voice data of the message read in step S14 from the speaker 18. After step S26, the control unit 10 releases the hold state of the other person communication (step S27). As a result, the operation of the control unit 10 in FIG. 10 ends.

  As described above, according to the mobile communication terminal 1 of the second embodiment, when returning to the call state after the hold state continues for a certain time (threshold duration threshold) or more, the hold duration measured by the timer 15 is set. In response, the information is switched to information that takes into account the flow of the talk or the emotion of the recipient. Thereby, according to the mobile communication terminal 1 of 2nd Embodiment, compared with the mobile communication terminal 1 of 1st Embodiment, communication can be smoothed more.

  While various embodiments have been described above with reference to the drawings, it goes without saying that the present invention is not limited to such examples. It is obvious for those skilled in the art that variations and modifications of various embodiments, and combinations of various embodiments can be conceived within the scope of the claims. Of course, it is understood that it belongs to the technical scope of the present invention.

  For example, in each of the above-described embodiments, the automatic translation function unit 22 is provided in the server 20 connected to the network 35 via the wireless base station 25, but is used by the caller without being provided in the server 20. The mobile terminal device 1 may be equipped with the automatic translation function unit 5. FIG. 11 is a block diagram showing a hardware configuration of the mobile communication terminal 1A equipped with an automatic translation function. 1 A of portable communication terminals are the structures containing the automatic translation function part 5 which has the function similar to the automatic translation function part 22 instead of the automatic translation function part 22 provided in the server 20 in 1st Embodiment. Thereby, the load in the translation process of the server 20 can be reduced.

  In the above-described embodiment, a message is transmitted when the other party's call is resumed from the hold state. However, the message may be put on hold for language selection processing by the caller using the mobile communication terminal 1. A similar message may be sent.

  In the embodiment described above, the message transmitted in Japanese is the message translated in the server 20 and transmitted to the mobile communication terminals 30 and 40. The language selected by the caller using the mobile communication terminal 1 is used. The message may be transmitted using. This makes it easier for the other party to understand and gives a sense of security for communication. In this case, it is assumed that not only Japanese messages but also messages having the same contents for each language are stored in the table 17a in advance.

  In addition, the other party's call may be performed by transmitting / receiving digital audio data by bidirectional communication such as VoIP (Voice over Internet Protocol) in addition to analog audio data. In this case, information such as a message can be easily transmitted. The information is not limited to the message, but may be a known mark (image data).

  Further, in the above-described embodiment, the case where one-to-many conversation is made is shown. However, the present invention can be similarly applied to a case where a many-to-many conversation or one-to-one conversation is performed. is there.

  Moreover, although the case where it applied to a mobile communication terminal as a communication terminal was shown in embodiment mentioned above, you may apply to communication terminals, such as a fixed telephone.

  In the present invention, when language selection is performed during a call, the call state is quickly shifted to a hold state at the start of the language selection operation, and the call is resumed in the language of the translation destination corresponding to the call with the other party. It is useful as a communication terminal and communication method that clearly conveys the above and promotes smooth communication.

1, 1A, 30, 40 Mobile communication terminal 5, 22 Automatic translation function unit 10 Control unit 11 Input unit 12 Communication unit 13 Display unit 14 Audio processing unit 15 Timer 16 Storage unit 17 Database 17a Table 18 Speaker 19 Microphone 20 Server 25, 26, 27 Radio base station 35 Network 100 Communication system

Claims (7)

A communication terminal that communicates with one or more other communication terminals,
An input unit that accepts input of selection operation of a translation destination language corresponding to a call with the other communication terminal for the input voice data during a call with the other communication terminal;
A communication terminal comprising: a control unit that shifts a call state of a call with the other communication terminal to a hold state at the start of input of a selection operation of the language to be translated. The communication terminal according to claim 1,
A communication unit that transmits information according to an instruction from the control unit to the other communication terminal;
The said control part is a communication terminal which instruct | indicates transmission of the information which restarts the said call state at the time of completion | finish of the input operation of the language selection of the said translation destination in the said holding | maintenance state. The communication terminal according to claim 2,
The said control part is a communication terminal which instruct | indicates the transmission of the information to the effect of restarting the said call state according to the selected said language of the said translation destination. The communication terminal according to claim 1,
A timer for measuring a hold duration time after transitioning to the hold state;
A database that stores a table including the measured hold duration and information indicating that the call state is resumed according to the hold duration;
The control unit refers to the table, and instructs the transmission of information indicating that the call state is resumed according to the selected translation destination language and the hold duration measured by the timer . The communication terminal according to claim 3 or 4,
A communication terminal connected to a server including an automatic translation function unit that translates the input voice data or information indicating that the call state is to be resumed into the selected translation destination language. The communication terminal according to claim 3 or 4,
A communication terminal further comprising: an automatic translation function unit that translates the input voice data or information indicating that the call state is to be resumed into the selected translation destination language. A communication method in a communication terminal for calling with one or more other communication terminals,
Accepting input of a selection operation of a translation destination language corresponding to a call with the other communication terminal for the input voice data during a call with the other communication terminal;
And a step of transitioning a call state of a call with the other communication terminal to a hold state at the start of input of the translation destination language selection operation.

Images