JP2009004904A - Communication terminal and input mode switching method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a communication terminal in which an input mode can be appropriately switched even when a signal instructing the input mode can not be acquired from the outside. <P>SOLUTION: A mobile 1 receives video telephone signals to display the video telephone images and at the same time receives web reception signals to display the web images. Then, on the basis of the analysis result of at least one of the video telephone signal and the web reception signal, the mobile 1 judges whether or not to switch the setting of a PB mode and a web mode and switches the setting of the input mode according to the judgement. Then, when receiving input from a user, the mobile 1 transmits transmission signals corresponding to the set input mode. Thus, the mobile 1 judges the changeover of the input mode independently. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a communication terminal for switching an input mode and an input mode switching method thereof.

  Conventionally, there are communication terminals capable of executing applications such as videophone and web communication. In this type of communication terminal, when a key input is accepted during a videophone call, a signal corresponding to the key input is generated in an input mode corresponding to the videophone. Also, when key input is accepted while web communication is being executed, a signal corresponding to the key input is generated in an input mode corresponding to web communication. Thus, the input mode corresponding to the application is set in the communication terminal.

In recent years, there is a technology for executing two applications simultaneously in a communication terminal. For example, in a communication terminal, there is a technique for simultaneously displaying two broadcast images of television broadcast and data broadcast on a display. In this case, it is necessary to set the input mode corresponding to one of the television broadcast and the data broadcast in the communication terminal. In view of this, Japanese Patent Laid-Open No. 2004-228688 proposes a technique in which an instruction signal instructing which input mode should be set is included in a data broadcast signal and the communication terminal switches the input mode in accordance with the instruction signal.
JP 2006-59117 A

  The technique disclosed in Patent Document 1 is a technique when television broadcasting and data broadcasting are linked. In such a case, an instruction signal instructing which input mode should be set can be transmitted from the distribution side in accordance with both broadcasts. However, an instruction signal may not be provided from the distribution side. In particular, when two applications are not linked, an instruction signal cannot be transmitted from the distribution side. In such a case, the input mode cannot be appropriately set in the communication terminal.

  Accordingly, an object of the present invention is to provide a communication terminal capable of appropriately switching the setting of the input mode even when a signal indicating the input mode cannot be acquired from the outside, and an input mode switching method thereof. To do.

  The communication terminal according to the present invention includes a receiving means for receiving a first received signal corresponding to the first application and a second received signal corresponding to the second application, and a first reception received by the receiving means. Display means for simultaneously displaying a first image based on the signal and a second image based on the second received signal, and at least one of the first received signal and the second received signal received by the receiving means Determining means for determining whether to switch the setting between the first input mode corresponding to the first application and the second input mode corresponding to the second application based on the analysis result of one signal; , A switching means for switching the setting between the first input mode and the second input mode, an input means for receiving an input from the user, and a first input mode according to the determination by the determination means. The first transmission signal corresponding to the first input mode is transmitted according to the input received by the input means, and the input is set when the second input mode is set. Transmission means for transmitting a second transmission signal corresponding to the second input mode in response to an input accepted by the means.

  In the input mode switching method of the present invention, the reception means receives the first reception signal corresponding to the first application and the second reception signal corresponding to the second application, and the display means The display step for simultaneously displaying the first display based on the first received signal received in the receiving step and the second display based on the second received signal, and the judging means receive the first display received in the receiving step. A first input mode corresponding to the first application and a second input mode corresponding to the second application based on an analysis result of at least one of the first received signal and the second received signal A determination step for determining whether or not to switch the setting between the first input mode and the second input mode according to the determination in the determination step. A switching step for switching the setting, an input step in which the input means accepts an input from the user, and, if the transmission means is set in the first input mode, according to the input accepted in the input step When the first transmission signal corresponding to the first input mode is transmitted and the second input mode is set, the second input mode is supported according to the input accepted in the input step. A transmission step of transmitting the second transmission signal.

  According to the present invention, the first received signal is received to display the first image, and at the same time, the second received signal is received to display the second image. That is, two applications are executed simultaneously. Then, based on the analysis result of at least one of the first reception signal and the second reception signal, the first input mode corresponding to the first application and the second input corresponding to the second application It is determined whether or not to switch the setting with the input mode. That is, while two applications are being executed on the communication terminal, it is independently determined which input mode should be set according to which application. Subsequently, since the setting of the input mode is switched according to the determination, the input mode can be switched appropriately even when a signal indicating the input mode cannot be acquired from the outside. And if an input is received from a user, the transmission signal according to the set input mode will be transmitted. Therefore, when the user performs input via the input means while executing two applications, it is possible to respond to the appropriate application and transmit a signal corresponding to the input without being aware of switching of the input mode. it can.

  Preferably, a sound detection means for detecting a sound signal included in the first reception signal by analyzing the first reception signal received by the reception means is provided, and the determination means is a result of the analysis by the sound detection means. When the audio signal is not detected for a predetermined time, it is determined to switch from the first input mode to the second input mode.

  For example, when a videophone is being executed as the first application, it can be inferred that the call is not progressing if no audio signal is detected for a predetermined time. Therefore, at this timing, there is a high possibility that the user desires an input corresponding to the second application. In such a case, it is desirable to switch to the input mode (second input mode) corresponding to the second application. Therefore, when the audio signal is not detected for a predetermined time, it is possible to appropriately determine the switching of the input mode by determining to switch from the first input mode to the second input mode.

  Preferably, an image detection unit that detects a change in the first image displayed by the display unit by analyzing the first reception signal received by the reception unit is provided, and the determination unit analyzes by the image detection unit. As a result, when a change in the first image is not detected for a predetermined time, it is determined to switch from the first input mode to the second input mode.

  For example, when no change in the first image is detected for a predetermined time, it can be estimated that there is no progress in the first image. At this timing, there is a high possibility that the user desires an input corresponding to the second application. In such a case, it is desirable to switch to the input mode (second input mode) corresponding to the second application. Therefore, when the change of the first image is not detected for a predetermined time, it is possible to appropriately determine the switching of the input mode by determining to switch from the first input mode to the second input mode.

  Preferably, the position specifying means for acquiring the position information for specifying the position of the communication terminal, and the second received signal received by the receiving means are analyzed, so that the information provided by the second application A position extracting means for extracting a high position, and the determining means has a distance between the position specified by the position information acquired by the position specifying means and the position extracted by the position extracting means within a predetermined range. In this case, it is determined to switch from the first input mode to the second input mode.

  For example, when the information provided by the second application is information according to a specific position, when the communication terminal is located in the vicinity of the specific position, the input mode corresponding to the second application (second Mode). Therefore, when the position of the communication terminal is near the position highly relevant to the information provided by the second application, it is determined that the input mode is switched from the first input mode to the second input mode. It is possible to appropriately determine the switching.

  In the present invention, since the input mode is determined autonomously in the communication terminal, the setting of the input mode can be appropriately switched even when a signal indicating the input mode cannot be acquired from the outside. Therefore, when the user performs input via the input means while executing two applications, it is possible to respond to the appropriate application and transmit a signal corresponding to the input without being aware of switching of the input mode. it can.

  An embodiment of a communication terminal and an input mode switching method according to the present invention will be described with reference to the drawings. Initially, with reference to FIG. 1, the structure of the mobile device (communication terminal) 1 which concerns on this embodiment is demonstrated. FIG. 1 is a diagram illustrating a configuration of a mobile device according to the present embodiment.

  The mobile device 1 is a communication terminal such as a mobile phone or PHS (Personal Handy-phone System). The mobile device 1 is configured to execute various applications by transmitting and receiving information to and from other communication terminals via the wireless network N. Various applications include video calls and browsing of websites. Specifically, the mobile device 1 is configured to be able to make a videophone call with the mobile device 2. The mobile device 1 is configured to be able to browse a website provided from the web server 3 and transmit information to the web server 3.

  When executing an application, the mobile device 1 switches to an input mode suitable for the application to be executed. The input mode refers to a key (input means) 11 provided in the mobile device 1 indicating information corresponding to an application and associating a signal in a format corresponding to the application.

  Specifically, when the mobile device 1 executes a videophone, the mobile device 1 is set to a PB (Push Button) mode (first input mode) corresponding to the videophone. In the PB mode, when the user presses the key 11 of the mobile device 1, a key designation signal assigned to the key 11 is sent to the wireless network N. The key designation signal reaches the exchange that accommodates the connection partner (mobile device 2) via the wireless network N. In the exchange accommodating the mobile device 2, the received key designation signal is converted into a PB signal and transmitted to the mobile device 2. Note that the PB signal is superimposed on the voice communication.

  When the mobile device 1 executes browsing of the website and transmission of information, the mobile device 1 is set to the web mode (second input mode). In the web mode, when the user presses the key of the mobile device 1, the JIS code assigned to the key is transmitted to the wireless network N. Then, the web server 3 receives the JIS code and converts the information. In the mobile device 1, the sent JIS code is converted into characters and displayed on the display unit 12. Thereby, the information transmitted from the mobile device 1 to the web server 3 is displayed on the display unit 12. The JIS code is transmitted in the data communication mode.

  The mobile device 1 is configured to be able to execute two applications simultaneously. In the present embodiment, the mobile device 1 is configured to be able to browse a website provided from the web server 3 and transmit / receive information simultaneously with making a videophone call with the mobile device 2. While executing two applications simultaneously, the mobile device 1 autonomously determines which input mode is set for which application based on the received information, and switches the setting of the input mode.

  Therefore, the mobile device 1 includes, as functional components, a transmission / reception unit (transmission unit and reception unit) 13, a switching unit (switching unit) 14, a determination unit (determination unit) in addition to the key 11 and the display unit 12 described above. ) 15 and an analysis unit 16 are provided. Each of these components will be described in detail.

  A plurality of keys 11 are provided to accept input from the user. The key 11 outputs a signal specifying the key 11 pressed by the user among the plurality of keys 11 to the switching unit 14.

  The transmission / reception unit 13 transmits and receives signals. Further, the transmission / reception unit 13 outputs the received signal to the display unit 12. More specifically, the transmission / reception unit 13 includes an RF band TRX 17 and a wireless LAN band TRX 18.

  The RF band TRX 17 is a transceiver that supports RF band signals. The RF band TRX 17 receives a video phone signal (first received signal) corresponding to the video phone transmitted from the mobile device 2. The videophone signal includes an audio signal and an image signal. The RF band TRX 17 transmits a PB transmission signal (key designation signal) corresponding to the PB mode that is generated in response to an input from the key 11.

  The wireless LAN band TRX18 is a transmitter / receiver that supports wireless LAN band signals. The wireless LAN band TRX 18 receives a web reception signal transmitted from the web server 3. In addition, the wireless LAN band TRX 18 transmits a web transmission signal (JIS code) corresponding to the web mode, which is generated in response to an input from the key 11.

  The display unit 12 is physically configured with a display or the like. The display unit 12 displays a videophone image (first image) based on the image signal included in the videophone signal input from the transmission / reception unit 13. The display unit 12 displays a web image (second image) based on the web reception signal input from the transmission / reception unit 13.

  The display unit 12 includes a first display unit 19 and a second display unit 20. As shown in FIG. 2, the first display unit 19 is provided in the upper region on the rectangular display, and the second display unit 20 is provided in the lower region. The first display unit 19 displays a videophone image, and the second display unit 20 displays a web image. Thereby, the display part 12 displays a videophone image and a web image simultaneously.

  When the switching unit 14 receives a signal indicating the result of determining that the input mode is to be switched from the determination unit 15, the switching unit 14 switches the setting between the PB mode and the web mode. In addition, when the PB mode is set, when the signal is input from the key 11, the switching unit 14 generates a PB transmission signal corresponding to the key 11 and outputs the PB transmission signal to the RF band TRX 17. In this case, the PB transmission signal is a signal of a format corresponding to the PB mode while indicating the meaning assigned to the key 11. Accordingly, when the PB mode is set, the transmission / reception unit 13 transmits a PB transmission signal corresponding to the PB mode in accordance with the input received by the key 11.

  When the web mode is set, the switching unit 14 generates a web transmission signal and outputs the web transmission signal to the wireless LAN band TRX 18 when a signal is input from the key 11. In this case, the web transmission signal is a signal of a format corresponding to the web mode while indicating the meaning assigned to the key 11. Thereby, when the web mode is set, the transmission / reception unit 13 transmits a web transmission signal corresponding to the web mode in accordance with the input accepted by the key 11.

  The determination unit 15 determines whether or not to switch the setting between the PB mode and the web mode based on the analysis result of the videophone signal and the web reception signal by the analysis unit 16. When the determination unit 15 determines to switch the input mode, the determination unit 15 outputs a signal indicating the determination result to the switching unit 14.

  The determination method of the determination part 15 is demonstrated with the analysis content of the analysis part 16. FIG. The analysis unit 16 includes a sound detection unit (sound detection unit) 21, an image detection unit (image detection unit) 22, a GPS (position specifying unit) 23, a position extraction unit (position extraction unit) 24, and a counter 25.

  The sound detection unit 21 detects a voice signal included in the videophone signal by analyzing the videophone signal. Specifically, the sound detection unit 21 extracts a signal in the form of an audio signal from the videophone signal, analyzes the extracted signal, and detects an audio signal when a signal of a predetermined level or higher is detected. Judge. When the audio signal is not detected for a predetermined time, it can be assumed that the conversation on the videophone is not progressing. Therefore, at this timing, there is a high possibility that the user desires an input corresponding to the website. In such a case, the input mode is optimally set to the web mode.

  Therefore, the determination unit 15 determines to switch from the PB mode to the web mode when the sound signal is not detected for a predetermined time in the state set to the PB mode as a result of the analysis by the sound detection unit 21. Further, the determination unit 15 determines to switch from the web mode to the PB mode when an audio signal is detected for a predetermined time in the state where the web mode is set. Note that the determination unit 15 grasps whether or not a predetermined time has elapsed based on the output of the counter 25.

  The image detector 22 detects a change in the videophone image by analyzing the videophone signal. Specifically, the image detection unit 22 takes in a videophone image signal from a videophone signal and analyzes the captured image signal to calculate a change in the bit pattern of the videophone image. When the bit pattern changes more than a predetermined value, the image detection unit 22 determines that the videophone image has changed.

  When a change in the videophone image is not detected for a predetermined time, it can be assumed that the videophone conversation is not progressing. Therefore, at this timing, there is a high possibility that the user desires an input corresponding to the website. In such a case, the input mode is optimally set to the web mode.

  Therefore, the determination unit 15 determines to switch from the PB mode to the web mode when the change of the videophone image is not detected for a predetermined time in the state set to the PB mode as a result of the analysis by the image detection unit 22. Further, the determination unit 15 determines to switch from the web mode to the PB mode when a change in the videophone image is detected for a predetermined time in the state where the web mode is set.

  The GPS 23 calculates the position of the mobile device 1 using a global positioning system. The position of the mobile device 1 calculated by the GPS 23 is indicated by latitude and longitude. The position extraction unit 24 extracts a position highly relevant to the web image by analyzing the web reception signal.

  For example, when the mobile device 1 is browsing a website of a specific department store, the web reception signal may include information indicating the position of the specific department store. The position extraction unit 24 extracts information indicating the position of the specific department store from the web reception signal, and specifies the position of the department store. A position highly relevant to the web image specified by the position extraction unit 24 is indicated by latitude and longitude.

  When the mobile device 1 is located near a position highly related to the website, there is a high possibility that the user desires an input corresponding to the website. In such a case, the input mode is optimally set to the web mode. Therefore, the determination unit 15 sets the mobile device 1 when the distance between the position calculated by the GPS 23 and the position specified by the position extraction unit 24 is within a predetermined distance in the PB mode. Is determined to be switched to the web mode from the PB mode. When the distance between the position calculated by the GPS 23 and the position specified by the position extracting unit 24 is greater than a predetermined distance in the state where the web mode is set, the determining unit 15 It is determined that the user is not in a predetermined position highly related to the website, and it is determined to switch from the web mode to the PB mode.

  Each function of the mobile device 1 described above is realized by the hardware shown in FIG. FIG. 3 is a hardware configuration diagram of the mobile device according to the present embodiment. As shown in FIG. 3, the mobile device 1 physically includes a CPU 101, a RAM 102 and a ROM 103 which are main storage devices, an auxiliary storage device 105 such as a hard disk, an input device 106 such as a keyboard and a mouse which are input devices, and a display. The computer system includes an output device 107 such as a network module and a communication module 104 which is a data transmission / reception device such as a network card.

  Each function described in FIG. 1 has a communication module 104, an input device 106, and an output device 107 under the control of the CPU 101 by loading predetermined computer software on the hardware such as the CPU 101 and the RAM 102 shown in FIG. This is realized by reading and writing data in the RAM 102 and the auxiliary storage device 105.

  Subsequently, the operation of the mobile device 1 will be described, and a mode switching method for switching the input mode when two applications are executed simultaneously will be described. FIG. 4 is a flowchart showing an outline of the operation of the mobile device according to the present embodiment.

  First, a videophone signal and a web reception signal are received by the PF band TRX 17 and the wireless LAN band TRX 18 included in the transmission / reception unit 13 (reception step S1). A videophone image based on the received videophone signal and a web image based on the web reception signal are simultaneously displayed by the first display unit 19 and the second display unit 20 (display step S2).

  Based on the analysis results of the videophone signal and the web reception signal, the determination unit 15 determines whether or not to switch the setting between the PB mode and the web mode. Are switched by the switching unit 14 (determination and switching step S3).

  Further, an input from the user is accepted by the key 11 (input step S4). Then, when the PB mode is set, a PB transmission signal corresponding to the PB mode is transmitted to the mobile device 2 through the RF band TRX 17 in accordance with the input accepted in the input step. When the web mode is set, a web transmission signal corresponding to the web mode is transmitted to the web server 3 by the wireless LAN band TRX 18 according to the input accepted in the input step (transmission step S5).

  As described above, the input mode is switched, and a signal corresponding to the user input is transmitted to a destination corresponding to the application. The determination and switching step S3 is preferably executed at predetermined intervals after the reception of the videophone signal and the web reception signal is started, regardless of the input from the user.

  Subsequently, this determination and the determination method in the switching step S3 will be described in more detail. First, a determination method based on an audio signal will be described with reference to FIG. FIG. 5 is a flowchart showing an operation at the time of determination based on the audio signal of the mobile device according to the present embodiment.

  First, when the videophone connection and the web connection are made at the same time (YES in step S11), the analysis of the videophone signal is started, and the audio signal capturing process of the videophone is performed by the sound detector 21 ( Step S12).

  When it is determined that the sound signal is captured and the sound signal is detected by the sound detector 21 (YES in step S13), 1 is added to the counter V by the counter 25 (step S14). Then, the counter N is cleared by the counter 25 (step S15).

  Subsequently, when the counter V is smaller than 5 (NO in step S16), the process returns to step S12, and the process of capturing the audio signal of the videophone is executed again. When the counter V is 5 or more (YES in step S16), the PB mode is set (step S17). That is, when the PB mode is already set, the input mode is not switched. When the web mode is set, a signal for converting from the web mode to the PB mode is output by the determination unit 15, and the input mode is set by the switching unit 14 to the PB mode.

  On the other hand, when it is determined that the audio signal is captured and the audio signal is not detected by the sound detector 21 (NO in step S13), 1 is added to the counter N by the counter 25 (step S18). Then, the counter V is cleared by the counter 25 (step S19).

  If the counter N is smaller than 5 (NO in step S20), the process returns to step S12, and the video signal audio signal capturing process is executed again. If the counter N is 5 or more (YES in step S20), the web mode is set (step S21). That is, when the web mode is already set, the input mode is not switched. When the PB mode is set, a signal for converting from the PB mode to the web mode is output by the determination unit 15, and the input mode is set by the switching unit 14.

  When the input mode is set, if the videophone connection and the web connection are made at the same time (YES in step S22), the process returns to step S11 and the above flow is repeated again. If the videophone connection and the web connection are not made simultaneously (NO in step S22), the process ends. As described above, the input mode is appropriately set.

  Next, a determination method based on image changes will be described with reference to FIG. FIG. 6 is a flowchart showing an operation at the time of determination based on the image change of the mobile device according to the present embodiment.

  First, when the videophone connection and the web connection are made simultaneously (step S31), the analysis of the videophone signal is started, and the video signal image signal capturing process is performed by the image detection unit 22 (step S32). ). If there is no accumulated image (NO in step S33), the process returns to step S32 and the image signal capturing process is performed again. If there is an accumulated image (YES in step S33), the image detection unit 22 compares the previous image signal with the latest image signal (step S34).

  As a result of the comparison of the image signals, when it is determined that the image change is detected by the image detection unit 22 (YES in step S35), 1 is added to the counter P by the counter 25 (step S36). Then, the counter W is cleared by the counter 25 (step S37).

  If the counter P is smaller than 5 (NO in step S38), the process returns to step S32, and the video phone image signal capturing process is executed again. When the counter P is 5 or more (YES in step S38), the PB mode is set (step S39). That is, when the PB mode is already set, the input mode is not switched. When the web mode is set, a signal for converting from the web mode to the PB mode is output by the determination unit 15 by the switching unit 14, and the switching unit 14 sets the PB mode.

  On the other hand, if it is determined as a result of the comparison of the image signals that no image change has been detected by the image detection unit 22 (NO in step S35), 1 is added to the counter W by the counter 25 (step S40). Then, the counter P is cleared by the counter 25 (step S41).

  If the counter W is smaller than 5 (NO in step S42), the process returns to step S32, and the video phone image signal capturing process is executed again. When the counter W is 5 or more (YES in step S42), the web mode is set (step S43). That is, when the web mode is already set, the input mode is not switched. When the PB mode is set, a signal for converting from the PB mode to the web mode is output by the determination unit 15 by the switching unit 14, and the switching unit 14 sets the web mode.

  When the input mode is set, if the videophone connection and the web connection are made at the same time (YES in step S44), the process returns to step S31 and the above flow is repeated again. If the videophone connection and the web connection are not made simultaneously (NO in step S44), the process ends. As described above, the input mode is appropriately set.

  Further, a determination method based on the position of the mobile device 1 will be described with reference to FIG. FIG. 7 is a flowchart showing an operation at the time of determination based on the position of the mobile device according to the present embodiment. The determination method based on the position of the mobile device 1 is executed when a position highly relevant to the website is extracted by the position extraction unit 24 in a state where the videophone connection and the web connection are made simultaneously.

  First, the position information of the mobile device 1 is captured by the GPS 23 (step S51). If the position captured (calculated) by the GPS 23 is not within the predetermined range of the predetermined position highly relevant to the web image (NO in step S52), 1 is added to the counter V by the counter 25 (step S53). ). Then, the counter N is cleared by the counter 25 (step S54).

  If the counter V is smaller than 5 (NO in step S55), the process returns to step S51 and the position information capturing process for the mobile device 1 is executed again. When the counter V is 5 or more (YES in step S55), the PB mode is set (step S56). That is, when the PB mode is already set, the input mode is not switched. When the web mode is set, a signal for converting from the web mode to the PB mode is output by the determination unit 15 by the switching unit 14, and the switching unit 14 sets the PB mode.

  On the other hand, when the position captured by the GPS 23 is within the predetermined range of the predetermined position highly related to the web image (YES in step S52), 1 is added to the counter N by the counter 25 (step S57). Then, the counter V is cleared by the counter 25 (step S58).

  When the counter N is smaller than 5 (NO in step S59), the process returns to step S51 and the position information capturing process for the mobile device 1 is executed again. If the counter N is 5 or more (YES in step S59), the web mode is set (step S60). That is, when the web mode is already set, the input mode is not switched. When the PB mode is set, a signal for converting from the PB mode to the web mode is output by the determination unit 15 by the switching unit 14, and the switching unit 14 sets the web mode.

  When the input mode is set, if the videophone connection and the web connection are made at the same time (YES in step S61), the process returns to step S51 and the above-described flow is repeated again. If the videophone connection and the web connection are not made simultaneously (NO in step S61), the process ends. As described above, the input mode is appropriately set.

  The determination unit 15 may determine by any one of a determination method based on an audio signal, a determination method based on a change in an image, and a determination method based on the position of the mobile device 1, or three determination methods You may judge by combining. For example, in both the determination method based on the audio signal and the determination method based on the image change, when it is determined that the PB mode is set, the PB mode may be set.

  The mobile device 1 according to the present embodiment described above receives a videophone signal and displays a videophone image, and simultaneously receives a web reception signal and displays a web image. Based on the analysis result of at least one of the videophone signal and the web reception signal, it is determined whether or not to switch the setting between the PB mode and the web mode, and the input mode is determined according to the determination. Switch settings. Subsequently, when an input is received from the user, a transmission signal corresponding to the set input mode is transmitted.

  Therefore, since the mobile device 1 autonomously determines the input mode switching, the input mode can be appropriately switched even when a signal indicating the input mode cannot be acquired from the outside. Therefore, when the user performs input via the input means while executing two applications, it is possible to respond to the appropriate application and transmit a signal corresponding to the input without being aware of switching of the input mode. it can.

  Further, the determination unit 15 determines to switch from the PB mode to the web mode when the sound signal is not detected for a predetermined time in the state set to the PB mode as a result of the analysis by the sound detection unit 21. When the audio signal is not detected for a predetermined time, it can be assumed that the conversation on the videophone is not progressing. Therefore, at this timing, there is a high possibility that the user desires an input corresponding to the website. In such a case, since the web mode is set, the input mode can be appropriately switched.

  Such a specific situation will be described. For example, the operator using the mobile device 2 is conducting a questionnaire for the user of the mobile device 1. The operator gives an explanation regarding the questionnaire questions through the voice and image of the videophone. Survey responses are collected on the website. When the operator utters “Please answer the questionnaire” at the end of the explanation and stops the conversation for a predetermined time, in this embodiment, since the audio signal is not detected for the predetermined time, the input mode setting in the mobile device 1 is changed from the PB mode. Switch to web mode. The web image displays “Please answer the questionnaire. If yes, press yes.”, And the user selects “Yes” with the key 11, so that the information associated with the key 11 is displayed in the web transmission signal. The converted information indicating “Yes” is transmitted to the web server 3. In this way, the user can transmit a signal corresponding to the application without using the input mode switching while using the two applications of the videophone and the web.

  In addition, as a result of analysis by the sound detection unit 21, the determination unit 15 determines to switch from the web mode to the PB mode when an audio signal is detected for a predetermined time while being set in the web mode. When the audio signal is detected for a predetermined time, it can be estimated that the conversation on the videophone is resumed. Therefore, at this timing, there is a high possibility that the user desires an input corresponding to the videophone. In such a case, since the PB mode is set, the input mode can be appropriately switched. Thereby, for example, switching of operator guidance / automatic guidance, switching of content to be viewed on a videophone, designation of a call extension telephone number, and a signal indicating the contents of a questionnaire response, etc. are transmitted to the mobile device 2 in response to a user input. Can do.

  In addition, as a result of analysis by the image detection unit 22, the determination unit 15 determines to switch from the PB mode to the web mode when a change in the videophone image is not detected for a predetermined time in the state where the PB mode is set. When no change in the videophone image is detected for a predetermined time, it can be inferred that there is no progress in the video image and the conversation in the videophone is not progressing. Therefore, at this timing, there is a high possibility that the user desires an input corresponding to the web image. In such a case, since the web mode is set, the input mode can be appropriately switched.

  Such a specific situation will be described. For example, as described above, an operator using the mobile device 2 is conducting a questionnaire for the user of the mobile device 1. When the operator utters “Please answer the questionnaire” at the end of the explanation and the transmission of a new image signal stops, in this embodiment, since the image change is not detected for a predetermined time, the input mode is changed from the PB mode to the web mode. Switch to Also in this case, the user can input without using the input mode switching while using two applications of the videophone and the web.

  In addition, as a result of analysis by the image detection unit 22, the determination unit 15 determines to switch from the web mode to the PB mode when a change in the videophone image is detected for a predetermined time in a state where the web mode is set. When a change in the videophone image is not detected for a predetermined time, it can be estimated that the videophone conversation has resumed. Therefore, at this timing, there is a high possibility that the user desires an input corresponding to the videophone. In such a case, since the PB mode is set, the input mode can be appropriately switched. Thereby, a signal can be transmitted to the mobile device 2 in accordance with a user input.

  In addition, when the determination unit 15 is in the PB mode and the distance between the position calculated by the GPS 23 and the position specified by the position extraction unit 24 is within a predetermined distance, the determination unit 15 starts from the PB mode. Determine to switch to web mode. For example, when the mobile device 1 is browsing a website of a specific department store, the user is likely to desire an input corresponding to the web image when approaching the department store. In such a case, since the web mode is set, the input mode can be appropriately switched.

  Further, when the determination unit 15 is set in the web mode and the distance between the position calculated by the GPS 23 and the position specified by the position extraction unit 24 is more than a predetermined distance, the determination unit 15 changes from the web mode to the PB mode. Judge to switch to. For example, even when the mobile device 1 is browsing a website of a specific department store, there is a high possibility that the user desires an input corresponding to a videophone when the mobile device 1 leaves the department store. In such a case, since the web mode is set, the input mode can be appropriately switched. Thereby, a signal can be transmitted to the mobile device 2 in accordance with a user input.

  Although the present embodiment has been described above, the present invention is not limited to the above embodiment, and various modifications can be made.

  For example, the determination by the determination unit 15 may be performed based on setting conditions in the mobile device 1 as shown in FIG. The setting conditions are settings such as “the reception volume is minimum” and “speaker reception”. FIG. 8 is a flowchart showing an operation at the time of determination of the mobile device according to the modification of the present embodiment.

  First, when the videophone connection and the web connection are made simultaneously (step S71), it is determined that the reception volume is not set to the minimum (NO in step S72), and the speaker reception is set. If it is determined that it has not been made (NO in step S73), the input mode is not switched and the process returns to step S72.

  If it is determined that the reception volume is not set to the minimum (NO in step S72), and if it is determined that the reception is set for the speaker (YES in step S73), the PB mode is set. (Step S74). That is, when the PB mode is already set, the input mode is not switched. When the web mode is set, a signal for converting from the web mode to the PB mode is output by the determination unit 15 by the switching unit 14, and the switching unit 14 sets the PB mode.

  If it is determined that the reception volume is set to the minimum (YES in step S72), the web mode is set (step S75). That is, when the web mode is already set, the input mode is not switched. When the PB mode is set, a signal for converting from the PB mode to the web mode is output by the determination unit 15 by the switching unit 14, and the switching unit 14 sets the web mode. In this way, the input mode is appropriately set.

  When the input mode is set, if the videophone connection and the web connection are made simultaneously (YES in step S76), the process returns to step S71 and the above flow is repeated again. If the videophone connection and the web connection are not made simultaneously (NO in step S76), the process ends. As described above, the input mode is appropriately set.

  Thus, when the received sound volume is set to the minimum, it can be estimated that the conversation by the videophone is not progressing. Therefore, at this timing, there is a high possibility that the user desires an input corresponding to the web image. In such a case, since the web mode is set, the input mode can be appropriately switched.

  Further, when the speaker reception is set, it can be estimated that a conversation by videophone is being made. Therefore, at this timing, there is a high possibility that the user desires an input corresponding to the web image. In such a case, since the PB mode is set, the input mode can be appropriately switched.

  For example, the determination by the determination unit 15 may be performed based on time. In this case, it is set to switch to a predetermined input mode at a predetermined time. Then, when the video phone and the website are simultaneously connected, when the predetermined time comes, the input mode is switched to the predetermined input mode.

  For example, the determination by the determination unit 15 may be performed based on time. In this case, when a predetermined time elapses from the time when the state where the videophone and the website are simultaneously connected starts, the mode is switched to a predetermined input mode.

  In the above embodiment, videophone and browsing of websites are given as examples of applications to be executed simultaneously, but the present invention is not limited to this. For example, normal telephone and website browsing, data communication using telephone and wireless LAN functions, execution of mobile phone content such as videophone and games, and the like can be mentioned. The two applications may not be related to each other.

It is a figure which shows the structure of the moving apparatus which concerns on this embodiment. It is a figure which shows the display part with which the moving apparatus which concerns on this embodiment is provided. It is a hardware block diagram of the mobile apparatus which concerns on this embodiment. It is a flowchart which shows the operation | movement outline | summary of the moving apparatus which concerns on this embodiment. It is a flowchart which shows the operation | movement at the time of the judgment based on the audio | voice signal of the mobile device which concerns on this embodiment. It is a flowchart which shows the operation | movement at the time of the determination based on the change of the image of the mobile device which concerns on this embodiment. It is a flowchart which shows the operation | movement at the time of the judgment based on the position of the mobile device which concerns on this embodiment. It is a flowchart which shows the operation | movement at the time of judgment of the mobile apparatus which concerns on the modification of this embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Mobile device (communication terminal), 11 ... Key (input means), 12 ... Display part (display means), 13 ... Transmission / reception part (transmission means, reception means), 14 ... Switching part (switching means), 15 ... Determination Part (determination means), 21 ... sound detection part (sound detection means), 22 ... image detection part (image detection means), 23 ... GPS (position specifying means), 24 ... position extraction part (position extraction means).

Claims (5)

Receiving means for receiving a first received signal according to the first application and a second received signal according to the second application;
Display means for simultaneously displaying a first image based on the first received signal received by the receiving means and a second image based on the second received signal;
Based on the analysis result of at least one of the first received signal and the second received signal received by the receiving means, the first input mode according to the first application and the second Determining means for determining whether to switch the setting to the second input mode according to the application;
Switching means for switching the setting between the first input mode and the second input mode according to the determination by the determination means;
Input means for receiving input from the user;
When the first input mode is set, the first transmission signal corresponding to the first input mode is transmitted according to the input received by the input means, and the second input mode is set. A transmission means for transmitting a second transmission signal corresponding to the second input mode in response to an input received by the input means,
A communication terminal comprising: Analyzing the first received signal received by the receiving means to provide a sound detecting means for detecting an audio signal included in the first received signal;
2. The determination unit according to claim 1, wherein if the sound signal is not detected for a predetermined time as a result of the analysis by the sound detection unit, the determination unit determines to switch from the first input mode to the second input mode. The communication terminal described in 1. An image detecting means for detecting a change in the first image displayed by the display means by analyzing the first received signal received by the receiving means;
The determination unit determines to switch from the first input mode to the second input mode when a change in the first image is not detected for a predetermined time as a result of analysis by the image detection unit. The communication terminal according to claim 1 or 2. Position specifying means for acquiring position information for specifying the position of the communication terminal;
Analyzing the second received signal received by the receiving means to extract a position highly relevant to the information provided by the second application, and
When the distance between the position specified by the position information acquired by the position specifying means and the position extracted by the position extracting means is within a predetermined range, the determining means starts from the first input mode. The communication terminal according to any one of claims 1 to 3, wherein it is determined to switch to the second input mode. A receiving step in which the receiving means receives a first received signal according to the first application and a second received signal according to the second application;
A display step in which the display means simultaneously displays a first display based on the first received signal received in the receiving step and a second display based on the second received signal;
A first input mode corresponding to the first application based on an analysis result of at least one of the first reception signal and the second reception signal received in the reception step; And a determination step of determining whether or not to switch setting between the second input mode corresponding to the second application,
A switching step in which switching means switches the setting between the first input mode and the second input mode in accordance with the determination in the determination step;
An input step for receiving input from the user;
When the transmission means is set to the first input mode, the transmission means transmits a first transmission signal corresponding to the first input mode according to the input accepted in the input step, and A transmission step of transmitting a second transmission signal corresponding to the second input mode in response to the input accepted in the input step;
An input mode switching method comprising: