JP2016201815A - Communication terminal device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a graphical user interface which improves operability.SOLUTION: A communication terminal device includes: a launcher storage part which stores a launcher for selecting either a loudspeaker reception mode in which a telephone voice is emitted from a loudspeaker or a normal reception mode in which a telephone voice is emitted from an ear speaker; a launcher execution part for starting the launder when a call is terminated, and displaying a launcher image including a speaker reception image and a normal reception image; and a control part which sets a telephone function part to the loudspeaker reception mode when a portion corresponding to the speaker reception image receives operation input, makes the launcher execution part display a launcher image including a speaker-off image for switching from the loudspeaker reception mode to the normal reception mode, sets the telephone function part to the normal reception mode when a portion corresponding to th normal reception image receives operation input, on the other hand, and displays a screen sharing menu corresponding to an information sharing mode with another communication terminal device.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a communication terminal device.

  A part of the display unit switched from the standby screen to the function screen includes at least an area for displaying the state of the communication terminal. When an incoming call is received during a user operation, the operation input position on the display unit is determined. A communication terminal is known that displays an incoming call at a position different from the operation input position in the area of the display unit while holding the function screen (for example, see Patent Document 1).

JP 2008-193740 A

When a communication terminal device that performs communication using a wireless communication line performs voice communication while executing an application program, it is necessary to select whether to output sound from a loud speaker or an ear speaker.
The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a communication terminal device that realizes a graphical user interface with excellent operability when performing voice communication while executing an application program. .

  [1] In order to solve the above-described problem, a communication terminal device according to an aspect of the present invention includes a telephone function unit including a first speaker for loudspeaking and a second speaker for earpiece, and an application program. In the case where a telephone call is made by the telephone function unit while executing the application program by the application execution unit, the display unit, the operation input receiving unit, and the application execution unit, a telephone voice is transmitted from the first speaker. A launcher storage unit for storing a launcher for selecting between a first reception mode for emitting a sound and making a call or a second reception mode for emitting a telephone sound from the second speaker and making a call When the telephone function unit receives a call, the launcher stored in the launcher storage unit is activated to correspond to the first reception mode. A launcher execution unit that displays on the display unit a launcher image including the received first GUI image and a second GUI image associated with the second reception mode; and the launcher displayed by the launcher execution unit In the image, when a portion corresponding to the first GUI image in the operation input reception unit receives an operation input, the telephone function unit is set to the first reception mode, and the launcher execution unit A launcher image including a third GUI image for switching from the first reception mode to the second reception mode is displayed on the display unit, and corresponds to the second GUI image in the operation input reception unit. When the operation part accepts the operation input, the telephone function unit is set to the second reception mode, and is associated with the information sharing mode with other communication terminal devices. The resulting screen sharing menu and a control unit for displaying on the display unit.

[2] In the communication terminal apparatus according to [1], the control unit deletes the launcher image after a predetermined time has elapsed after setting the telephone function unit to the first reception mode, and the screen sharing An icon image for transitioning to menu display is displayed.
[3] In the communication terminal device according to [2], when the portion corresponding to the icon image in the operation input receiving unit receives an operation input, the control unit displays the screen sharing menu on the display unit. Let
[4] In the communication terminal device according to [2], when the portion corresponding to the third GUI image in the operation input receiving unit receives an operation input within the predetermined time, the control unit The telephone function unit is switched from the first reception mode to the second reception mode.
[5] The communication terminal device according to any one of [1] to [4], wherein the screen sharing menu is an adjustment GUI for adjusting both or any one of a call volume and a media volume of the application program. Includes images.

  According to the present invention, it is possible to realize a graphical user interface with excellent operability when performing voice communication while executing an application program.

1 shows a schematic configuration diagram of a communication system to which a communication terminal device according to an embodiment of the present invention is applied. FIG. It is a block diagram which shows the function structure of the communication terminal device which is one Embodiment. It is a figure which shows typically the example of a display of the display part at the time of operating the graphical user interface (Graphical User Interface: GUI) of a launcher and setting a telephone function part to a loudspeaker reception mode. It is a figure which shows typically the example of a display of a display part at the time of operating GUI of a launcher and setting a telephone function part to normal call reception mode. It is a flowchart which shows the example of the process sequence of the communication terminal device which is one Embodiment. It is a flowchart which shows the example of the process sequence of the communication terminal device which is one Embodiment.

Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the drawings.
FIG. 1 is a schematic configuration diagram of a communication system to which a communication terminal apparatus according to an embodiment of the present invention is applied. As illustrated in FIG. 1, the communication system 100 includes a communication terminal device 50-1, a communication terminal device 50-2, and a network 51. The communication terminal device 50-1 and the communication terminal device 50-2 are communicably connected via the network 51.
In the following description, when the communication terminal device 50-1 and the communication terminal device 50-2 are not distinguished, the communication terminal devices 50-1 and 50-2 may be described as the communication terminal device 50.

  The communication terminal device 50 is a wireless communication terminal capable of telephone (voice communication) and data communication using a wireless communication line. For example, the communication terminal device 50 is a smartphone or a mobile phone. The communication terminal device 50-1 and the communication terminal device 50-2 can perform a call by a method of communicating voice packet data obtained by packetizing digital voice data, for example. By using this communication method, the communication terminal device 50 can make a voice call while executing an application program and streaming or downloading content data.

In addition, the communication terminal device 50-1 can execute an application program (shared application) that shares information with the communication terminal device 50-2 that is the other party of the call.
Similarly, the communication terminal device 50-2 can execute a shared application that shares information with the communication terminal device 50-1 that is the other party of the call. That is, each of the communication terminal devices 50-1 and 50-2 executes the shared application and performs mutual authentication, thereby transmitting the display content of the communication terminal device 50-1 to the communication terminal device 50-2, for example. It can be displayed on the device 50-2. Thereby, the user of the communication terminal device 50-2 can talk with the user of the communication terminal device 50-1 while viewing the same screen as the user of the communication terminal device 50-1. A mode in which communication terminal apparatus 50-1 and communication terminal apparatus 50-2 share information by mutual authentication is referred to as an information sharing mode. Examples of the information sharing mode include screen sharing, position information sharing, camera image sharing, and handwritten character sharing.

  The network 51 is a communication network constructed so that communication is possible between the communication terminal device 50-1 and the communication terminal device 50-2. For example, the network 51 includes a packet switching network. The network 51 includes a server device that establishes a communication session for the communication terminal devices 50-1 and 50-2 set to the information sharing mode to execute a shared application and share display data. For example, the communication terminal device 50-1 can determine whether or not the partner communication terminal device 50-2 is a device that can execute the shared application by inquiring the server device.

  FIG. 2 is a block diagram illustrating a functional configuration of the communication terminal device 50. As shown in FIG. 2, the communication terminal device 50 includes a telephone function unit 15, a display unit 21, a touch panel 22 (operation input receiving unit), a communication unit 23, a proximity sensor 24, a notification unit 25, an application, An execution unit 26, a control unit 27, a launcher storage unit 28, a launcher execution unit 29, a reception unit 30, and an application storage unit 31 are included.

The telephone function unit 15 is a function unit that performs a voice call with another communication terminal device. As shown in FIG. 2, the telephone function unit 15 includes a loudspeaker 16 (first speaker), an ear speaker 17 (second speaker), and a sound collection unit 18.
When the loudspeaker 16 is set by the control unit 27 to the loudspeaker reception mode (first reception mode) in which the telephone function unit 15 turns on the loudspeaker 16, the call sound or the application execution unit 26 is set to the application. It is a loudspeaker that outputs sound (media sound) generated according to execution of a program.

The ear speaker 17 receives a call sound when the control unit 27 is set to the normal reception mode (second reception mode) in which the telephone function unit 15 turns off the loudspeaker 16 and turns on the ear speaker 17. It is a speaker for ear pads that outputs.
For example, when the proximity sensor 24 provided in the vicinity of the ear speaker 17 detects an approaching object (for example, an ear), the control unit 27 sets the telephone function unit 15 to the normal reception mode. Also, for example, when the telephone function unit 15 is set to the normal reception mode, if the proximity sensor 24 no longer detects an object (here, an ear), the control unit 27 causes the telephone function unit 15 to receive a loudspeaker speaker. Set to mode.

  The sound collection unit 18 is a microphone that collects the voice of the speaker of the communication terminal device 50 during a call. The telephone function unit 15 converts the sound collected by the sound collection unit 18 into digital data. Then, the communication unit 23 converts the digital voice data into packet data, and transmits the voice packet data to the other communication terminal device. When the communication unit 23 receives the voice packet data transmitted from the other communication terminal device, the communication unit 23 extracts the digital voice data from the voice packet data and supplies the digital voice data to the telephone function unit 15. And the telephone function part 15 acquires digital audio | voice data, and outputs a sound according to a loudspeaker reception mode or normal reception mode.

  The display unit 21 displays various information according to the application execution unit 26 executing the application program. In addition, the display unit 21 displays information on a received program in accordance with the reception unit 30 receiving a digital broadcast (for example, one segment).

  The touch panel 22 is, for example, an operation input receiving unit that is provided on the display surface of the display unit 21 so as to be able to input multiple points. The touch panel 22 accepts a tap operation, a double tap operation, a drag operation, a flick operation, a pinch-in / pinch-out operation, etc., corresponding to the application program. The touch panel 22 receives a tap operation corresponding to a launcher described later.

  For example, when the part of the touch panel 22 corresponding to the GUI image displayed on the display unit 21 in response to the application execution unit 26 executing the application program is tapped, the application execution unit 26 associates with the GUI image. Information obtained.

  Further, the launcher execution unit 29 corresponds to a GUI image (for example, a speaker reception image, a normal reception image, a speaker on image, and a speaker off image, which will be described later) in the launcher image displayed on the display unit 21 when the launcher is executed. When the part of the touch panel 22 is tapped, the launcher execution unit 29 acquires information associated with the GUI image.

  When the telephone function unit 15 receives a call, the notification unit 25 notifies that the call has been received. For example, the notification unit 25 is a vibrator or a lighting indicator. When the telephone function unit 15 is set to the loudspeaker reception mode, the telephone function unit 15 may notify from the loudspeaker 16.

The application storage unit 31 stores application programs.
The application execution unit 26 reads an application program stored in the application storage unit 31 and executes this application program.

  The launcher storage unit 28 stores a launcher and an icon image. In the case where the phone function unit 15 makes a call while executing the application program by the application execution unit 26, the launcher is in the loudspeaker reception mode in which the telephone sound is emitted from the loudspeaker 16 to make a call, or the ear speaker 17 This is a program for selecting a normal reception mode in which a telephone call is emitted from a telephone to make a call. The icon image is a GUI image for making a transition to the display of a screen sharing menu associated with the information sharing mode with the partner communication terminal device.

  The launcher execution unit 29 reads the launcher stored in the launcher storage unit 28 and executes this launcher. That is, when the telephone function unit 15 receives a call, the launcher execution unit 29 activates the launcher stored in the launcher storage unit 28, the speaker reception image (first GUI image) associated with the loudspeaker reception mode, A launcher image including a normal reception image (second GUI image) associated with the normal reception mode, a reception rejection image for rejecting the reception, and a status image indicating that ringing is currently being performed, 21 is displayed. A specific example of the launcher image will be described later.

  In the launcher image displayed by the launcher execution unit 29, when the portion corresponding to the speaker reception image on the touch panel 22 receives the operation input, the control unit 27 sets the telephone function unit 15 to the loudspeaker reception mode and executes the launcher. The display unit 21 displays a launcher image including a speaker off image (third GUI image) for switching from the loudspeaker reception mode to the normal reception mode and a call end image for ending the call. Let That is, when the speaker reception image of the launcher image is tapped, the control unit 27 sets the telephone function unit 15 to the loudspeaker reception mode, cancels the loudspeaker reception mode, and switches the speaker off to switch to the normal reception mode. The image and the call end image are displayed on the display unit 21. When a portion corresponding to the speaker off image on touch panel 22 receives an operation input, that is, when the speaker off image is tapped, control unit 27 switches telephone function unit 15 from the loud speaker reception mode to the normal reception mode. . Thereby, for example, when the user mistakenly taps the speaker reception image, the user can switch from the loud speaker reception mode to the normal reception mode by tapping the speaker off image again. When the portion corresponding to the call end image on the touch panel 22 receives an operation input, that is, when the call end image is tapped, the control unit 27 ends the call session by the telephone function unit 15.

  In addition, in the launcher image displayed by the launcher execution unit 29, when the portion corresponding to the normal reception image on the touch panel 22 receives the operation input, the control unit 27 sets the telephone function unit 15 to the normal reception mode, and the status The image is changed to an image representing the normal reception mode, and the screen sharing menu is displayed on the display unit 21. That is, when the normal reception image of the launcher image is tapped, the control unit 27 sets the telephone function unit 15 to the normal reception mode and causes the display unit 21 to display the screen sharing menu.

  In addition, in the launcher image displayed by the launcher execution unit 29, the control unit 27 stops the reception by the telephone function unit 15 and terminates the launcher when the portion corresponding to the reception rejection image on the touch panel 22 receives the operation input. Let That is, when the reception rejection image of the launcher image is tapped, the control unit 27 disconnects the reception by the telephone function unit 15 and deletes the launcher image.

The control unit 27 sets the telephone function unit 15 to the loudspeaker reception mode, erases the launcher image after a predetermined time (for example, 2 to 3 seconds), and shifts to the display of the screen sharing menu. An icon image may be displayed on the display unit 21. The icon image here indicates that the telephone function unit 15 is currently in the loudspeaker reception mode.
As a result, when the user of the communication terminal device 50 mistakenly taps the speaker reception image, the communication terminal device 50 causes the loudspeaker speaker by tapping the speaker off image displayed during the predetermined time. It is possible to change from the reception mode to the normal reception mode. In addition, since the launcher image is erased and the icon image is displayed after a predetermined time has elapsed, the user can wait for the timing of transition to the information sharing mode while viewing the application screen.

  When the part corresponding to the icon image on the touch panel 22 receives an operation input, the control unit 27 causes the display unit 21 to display a screen sharing menu.

That is, in the launcher image, when the normal received image is tapped, the screen sharing menu is displayed immediately after that on the display unit 21, while when the speaker received image is tapped, the launcher image is displayed for a predetermined time. The screen sharing menu is not displayed unless the icon image for changing to the display of the screen sharing menu is displayed. When an incoming call is received during the execution of the application program, the normal reception image is tapped. This means that the user of the communication terminal device 50 may want to prioritize the telephone reception over viewing the application screen. high. On the other hand, when a call is received while the application program is being executed, the fact that the speaker reception image is tapped has a high possibility that the user of the communication terminal device 50 still wants to watch the application screen. Therefore, as described above, when the speaker reception image is tapped, the screen sharing menu is not displayed until the icon image is tapped.
However, when a call is received during the execution of the application program and the speaker reception image is tapped, the control unit 27 sets the telephone function unit 15 to the loudspeaker reception mode, and sets the status image to the loudspeaker reception mode. The screen sharing menu may be displayed on the display unit 21.

Next, the launcher executed by the launcher execution unit 29 will be specifically described.
FIG. 3 is a diagram schematically illustrating an example of display on the display unit 21 when the launcher GUI is operated to set the telephone function unit 15 to the loudspeaker reception mode. Each of the screens 5-1 to 5-5 on the display unit 21 in FIG. 3 represents a state in which the application execution unit 26 is executing an application program for reproducing a video stream, for example.

  First, when the telephone function unit 15 receives a call while the application execution unit 26 is executing the application program, the launcher execution unit 29 activates the launcher from the launcher storage unit 28 and displays the launcher image 6 on the display unit 21 ( Screen 5-1). On the screen 5-1, for example, the launcher image 6 is displayed in front (upper layer) of the application screen 8 and on the upper side of the screen 5-1. For example, the launcher image 6 is caller information (“Suzuki XX” in FIG. 3) indicating a caller on the calling side, a status image 7a indicating that ringing is currently being performed, and a GUI image. A normal reception image 6a, a speaker reception image 6b, and a reception rejection image 6c are included.

  When the speaker reception image 6b is tapped by the user of the communication terminal device 50, the control unit 27 sets the telephone function unit 15 to the loudspeaker reception mode and sets the status image of the launcher image 6 to the loudspeaker reception mode. And the GUI image of the launcher image 6 are rewritten into a speaker off image 6d and a call end image 6e (screen 5-2). When the touch panel 22 does not accept any operation, the control unit 27 maintains the state of the launcher image 6 on the screen 5-2 for a predetermined time (for example, 3 seconds). Note that during this predetermined time, the telephone call using the loudspeaker 16 and the sound collection unit 18 and the execution of the application program by the application execution unit 26 are continued.

  When the predetermined time elapses, the control unit 27 deletes the launcher image 6 and causes the display unit 21 to display the icon image 11a for changing to display of the screen sharing menu (screen 5-3). That is, since only the icon image 11a is displayed in front (upper layer) of the application screen 8 on the screen 5-3, the user views the application screen 8 while making a speaker call with the other party and shares information. It is possible to wait for the timing of transition to the mode.

  When the icon image 11a is tapped, the launcher execution unit 29 displays the launcher image 6 on the display unit 21. Then, the control unit 27 displays the screen sharing menu 1 on the display unit 21 (screen 5-4). The launcher image 6 on the screen 5-4 is the same as the launcher image 6 on the screen 5-2. In the screen 5-4, for example, the screen sharing menu 1 is displayed in front (upper layer) of the application screen 8 and below the screen 5-4. For example, the screen sharing menu 1 includes a first screen sharing function button 2a, a second screen sharing function button 2b, a third screen sharing function button 2c, and a fourth screen sharing function, each of which is a GUI image. It includes a button 2d, a media volume adjustment bar 3, a call volume adjustment bar 4, and an end button 9 for ending the screen sharing menu 1, each of which is an adjustment GUI image (for example, a slide bar).

  Note that the control unit 27 selects the application being executed from among the first screen sharing function button 2a, the second screen sharing function button 2b, the third screen sharing function button 2c, and the fourth screen sharing function button 2d. Only the screen sharing function button corresponding to the program may be included in the screen sharing menu 1 or displayed in a selectable manner. For example, while the application execution unit 26 is executing an application program for playing back a moving image, the control unit 27 displays only the screen sharing function button associated with screen sharing and handwritten character sharing in the screen sharing menu 1. Display including or selectable display. The control unit 27 may change the size and shape of the screen sharing menu according to the application program. For example, in the case of an application program for playing video, the control unit 27 changes the size of the screen sharing menu according to the size of the video screen, or changes the shape of the screen sharing menu so that the video screen is not hidden. May be.

  In the screen sharing menu 1, when a portion corresponding to the button (knob) of the media volume adjustment bar 3 on the touch panel 22 receives an operation input, that is, when a knob is operated, the control unit 27 is controlled by the application execution unit 26. Adjust the volume of the media sound of the application program to be executed. In the screen sharing menu 1, when the part corresponding to the button (knob) of the call volume adjustment bar 4 on the touch panel 22 receives an operation input, that is, when the knob is operated, the control unit 27 is configured to 15 adjusts the volume of the call.

  Note that the volume adjustment of the media sound and the call sound may be performed using one adjustment GUI image. That is, the media volume and the call volume may be adjusted relatively. Further, the control unit 27 may adjust the media volume and the call volume in response to an operation of a volume adjustment button (for example, a volume adjustment button provided on the side of the apparatus) provided in the communication terminal device 50. Further, the control unit 27 may display the media volume adjustment bar 3 and the call volume adjustment bar 4 on the display unit 21 simultaneously with the launcher image 6 on the screen 5-2. In addition, when the media sound emitted from the loudspeaker 16 is collected by the sound collection unit 18, the control unit 27 may control the volume of the media sound to be lowered. In addition, the control unit 27 transmits the media sound generated by the execution of the application execution unit 26 to the communication terminal device of the other party via the communication unit 23 regardless of the sound collection path by the sound collection unit 18. Can do.

For example, when the first screen sharing function button 2a of the screen sharing menu 1 is tapped, the control unit 27 starts execution of the shared application associated with the first screen sharing function button 2a, and communicates with the other party. After mutual authentication with the terminal device, a request to start screen sharing is made, and when the partner communication terminal device accepts this, an icon image 11b indicating sharing is displayed in front (upper layer) of the application screen 8 (Screen 5-5). Note that the control unit 27 may display a frame (a frame of a specific color) on the screen 5-5 to indicate that screen sharing is currently being performed.
Note that the control unit 27 may display, for example, a voice recognition menu instead of the screen sharing menu 1. In the voice recognition menu, the control unit 27 recognizes the user's voice collected by the sound collection unit 18, extracts a keyword from the recognized voice data, and searches the web based on the keyword (for example, shop This is a menu for searching.

  FIG. 4 is a diagram schematically showing an example of display on the display unit 21 when the launcher GUI is operated to set the telephone function unit 15 to the normal reception mode. Each of the screens 10-1 to 10-3 on the display unit 21 in FIG. 4 represents a state in which the application execution unit 26 is executing an application program that reproduces a video stream, for example.

  First, when the telephone function unit 15 receives a call while the application execution unit 26 is executing the application program, the launcher execution unit 29 activates the launcher from the launcher storage unit 28 and displays the launcher image 6 on the display unit 21 ( Screen 10-1). On the screen 10-1, for example, the launcher image 6 is displayed in front (upper layer) of the application screen 8 and above the screen 10-1. For example, the launcher image 6 is caller information (“Suzuki XX” in FIG. 4) indicating a caller on the calling side, a status image 7a indicating that ringing is currently being performed, and a GUI image. A normal reception image 6a, a speaker reception image 6b, and a reception rejection image 6c are included.

  When the normal reception image 6a is tapped by the user of the communication terminal device 50, the control unit 27 sets the telephone function unit 15 to the normal reception mode, and the status image of the launcher image 6 indicates that it is the normal reception mode. The status image 7c is rewritten, and the GUI image of the launcher image 6 is rewritten to a speaker-on image 6f and a call end image 6e. Then, the control unit 27 displays the screen sharing menu 1 on the display unit 21 (screen 10-2). The contents of the screen sharing menu 1 are the same as those of the screen sharing menu 1 on the screen 5-4 in FIG.

  For example, when the first screen sharing function button 2a of the screen sharing menu 1 is tapped, the control unit 27 changes the telephone function unit 15 from the normal reception mode to the loudspeaker reception mode. And the control part 27 starts execution of the shared application matched with the 1st screen sharing function button 2a, requests | requires the start of screen sharing after mutual authentication with the other party's communication terminal device, When the terminal device accepts this, an icon image 11b indicating sharing is displayed in front (upper layer) of the application screen 8 (screen 10-3). Note that the control unit 27 may display a frame (a frame of a specific color) on the screen 10-3 to indicate that screen sharing is currently being performed.

Next, the operation of the communication terminal device 50 will be described.
5 and 6 are flowcharts illustrating an example of a processing procedure of the communication terminal device 50. However, this flowchart represents processing from when the telephone function unit 15 receives a call until the control unit 27 displays the screen sharing menu on the display unit 21.

  The telephone function unit 15 stands by until an incoming call is received (step S1: NO). When the telephone function unit 15 receives a call (step S1: YES), in step S2, the launcher execution unit 29 reads the launcher stored in the launcher storage unit 28 and starts executing this launcher. The launcher image displayed on the display unit 21 by execution of the launcher includes a normal reception image, a speaker reception image, a reception rejection image, and a status image indicating that ringing is currently in progress.

  The control unit 27 stands by until the touch panel 22 is tapped (step S3: NO). When the touch panel 22 is tapped (step S3: YES), in step S4, the control unit 27 determines whether or not the speaker reception image is tapped. When it is determined that the speaker reception image has been tapped (step S4: YES), the control unit 27 proceeds to the process of step S21, and otherwise (step S4: NO), the process proceeds to step S5.

  In step S5, the control unit 27 determines whether or not the normal received image has been tapped. When it is determined that the normal received image has been tapped (step S5: YES), the control unit 27 proceeds to the process of step S7, and otherwise (step S5: NO), the process proceeds to the process of step S6.

  In step S6, the control unit 27 determines whether or not the reception rejection image has been tapped. When it is determined that the reception rejection image has been tapped (step S6: YES), the control unit 27 proceeds to the process of step S9, and otherwise (step S6: NO) returns to the process of step S3.

  Step S5: After YES, in step S7, the control unit 27 sets the telephone function unit 15 to the normal reception mode, rewrites the status image of the launcher image with the status image indicating the normal reception mode, and launches the launcher image. Are rewritten into a speaker-on image and a call end image.

  Next, in step S8, the control unit 27 causes the display unit 21 to display a screen sharing menu. And the process of this flowchart is complete | finished.

Step S6: After YES, in step S9, the control unit 27 cancels (disconnects) the session received by the telephone function unit 15.
Next, in step S10, the launcher execution unit 29 ends the launcher and deletes the icon image. And the process of this flowchart is complete | finished.

  Step S4: After YES, in step S21, the control unit 27 sets the telephone function unit 15 to the loudspeaker reception mode, and rewrites the status image of the launcher image with a status image indicating the loudspeaker reception mode. The GUI image of the launcher image is rewritten into a speaker off image and a call end image.

  Next, in step S <b> 22, the control unit 27 starts timing by a timer.

  Next, in step S23, the control unit 27 determines whether or not the touch panel 22 has been tapped. If it is determined that the touch panel 22 has been tapped (step S23: YES), the control unit 27 proceeds to the process of step S24 and determines that it has not been tapped. If so (step S23: NO), the process proceeds to step S26.

  In step S24, the control unit 27 determines whether or not the speaker off image has been tapped. If it is determined that the speaker off image has been tapped (step S24: YES), the control unit 27 proceeds to the process of step S31, and otherwise (step S24: NO) proceeds to the process of step S25.

  In step S25, the control unit 27 determines whether or not the call end image has been tapped. When determining that the call end image has been tapped (step S25: YES), the control unit 27 proceeds to the process of step S33, and otherwise (step S25: NO), proceeds to the process of step S26.

  In step S26, the control unit 27 determines whether or not a predetermined time (for example, 2 to 3 seconds) has elapsed by counting with a timer. When it is determined that the predetermined time has elapsed (step S26: YES), the control unit 27 proceeds to the process of step S27, and when it is determined that the predetermined time has not elapsed (step S26: NO), the process of step S23. Return to.

In step S <b> 27, the launcher execution unit 29 deletes the launcher image and causes the display unit 21 to display an icon image for changing to display of the screen sharing menu. The icon image here indicates that the telephone function unit 15 is set to the loudspeaker mode, for example.
Next, the control unit 27 stands by until the icon image is tapped (step S28: NO). When the icon image is tapped (step S28: YES), the launcher execution unit 29 displays the launcher image on the display unit 21 in step S29.
Next, in step S30, the control unit 27 causes the display unit 21 to display a screen sharing menu. And the process by this flowchart is complete | finished.

  Step S24: After YES, in step S31, the control unit 27 switches the telephone function unit 15 from the loudspeaker reception mode to the normal reception mode, and the status image of the launcher image indicates the normal reception mode. And the GUI image of the launcher image is rewritten into a speaker-on image and a call end image. Next, the control unit 27 proceeds to the process of step S30.

Step S25: After YES, in step S33, the control unit 27 stops the call session of the telephone function unit 15 and disconnects it.
Next, in step S34, the launcher execution unit 29 ends the launcher and deletes the icon image. And the process by this flowchart is complete | finished.

  As described above in detail, the communication terminal device 50 according to the embodiment of the present invention includes the telephone function unit 15 including the loudspeaker 16 for loudspeaking and the earspeaker 17 for ear pads, and application execution for executing an application program. A unit 26, a display unit 21, and a touch panel 22 are provided. In addition, when the communication function is performed by the telephone function unit 15 while executing the application program by the application execution unit 26, the communication terminal device 50 emits a telephone sound from the loudspeaker 16 and makes a first call. And a launcher storage unit 28 for storing a launcher for selecting a mode or a second reception mode in which a telephone call is emitted from the ear speaker 17 to make a call. In addition, when the telephone function unit 15 receives a call, the communication terminal device 50 activates the launcher stored in the launcher storage unit 28, and corresponds to the speaker reception image associated with the first reception mode and the second reception mode. A launcher execution unit 29 is provided for causing the display unit 21 to display a launcher image including the attached normal reception image. Further, in the launcher image displayed by the launcher execution unit 29, the communication terminal device 50 sets the telephone function unit 15 to the first reception mode when the portion corresponding to the speaker reception image on the touch panel 22 receives the operation input. The launcher image including the speaker-off image for setting and causing the launcher execution unit 26 to switch from the loudspeaker reception mode to the normal reception mode is displayed on the display unit 21, while the portion corresponding to the normal reception image on the touch panel 22 is displayed. When an operation input is accepted, the control unit 27 sets the telephone function unit 15 to the second reception mode and causes the display unit 21 to display a screen sharing menu associated with the information sharing mode with other communication terminal devices. Is provided.

  That is, when a speaker reception image is selected in the launcher image displayed as a result of an incoming call, the telephone function unit 15 is set to the loudspeaker reception mode and then switched from the loudspeaker reception mode to the normal reception mode. A speaker off image is displayed. On the other hand, when the normal reception image is selected in the launcher image, the screen sharing menu is displayed after the telephone function unit 15 is set to the normal reception mode. With this configuration, the user can easily select either the loudspeaker reception mode or the normal reception mode. For example, when the user selects a speaker reception image by mistake, the user can normally select from the loudspeaker reception mode. It can be switched to the reception mode. In addition, when the normal received image is selected by the user, the screen sharing menu with the communication terminal device that is the other party can be displayed immediately.

In communication terminal device 50, after setting telephone function unit 15 to the loudspeaker reception mode, control unit 27 deletes the launcher image after a predetermined time (for example, 2 to 3 seconds), and displays the screen sharing menu. An icon image for making a transition to display may be displayed on the display unit 21.
In the launcher image, when the user mistakenly selects the speaker reception image, the loudspeaker reception mode can be switched to the normal reception mode during the predetermined time. In addition, since only the icon image other than the application screen is displayed on the display screen after a predetermined time has elapsed, it is easy to view the application screen.

Further, in the communication terminal device 50, when the portion corresponding to the icon image on the touch panel 22 receives an operation input, the control unit 27 may cause the display unit 21 to display a screen sharing menu.
The user can shift to the information sharing mode with the communication terminal device of the other party at any timing while viewing the application screen.

  Further, in communication terminal device 50, when the portion corresponding to the speaker-off image on touch panel 22 receives an operation input within the predetermined time, control unit 27 causes telephone function unit 15 to perform normal reception from the loudspeaker reception mode. You may switch to mode.

  In communication terminal device 50, the screen sharing menu may include an adjustment GUI image for adjusting both or either of the call volume and the media volume of the application program.

  As described above, according to the communication terminal device 50 according to the present embodiment, it is possible to realize a graphical user interface with excellent operability when performing voice communication while executing an application program.

  As mentioned above, although embodiment of this invention was explained in full detail with reference to drawings, the specific structure is not restricted to that embodiment, The design of the range which does not deviate from the summary of this invention, etc. are included.

  DESCRIPTION OF SYMBOLS 15 ... Telephone function part, 16 ... Loudspeaker (1st speaker), 17 ... Ear speaker (2nd speaker), 18 ... Sound collection part, 21 ... Display part, 22 ... Touch panel (operation input reception part), 23 ... Communication unit, 24 ... Proximity sensor, 25 ... Notification unit, 26 ... Application execution unit, 27 ... Control unit, 28 ... Launcher storage unit, 29 ... Launcher execution unit, 30 ... Reception unit, 31 ... Application storage unit, 50- DESCRIPTION OF SYMBOLS 1,50-2 ... Communication terminal device, 51 ... Network, 100 ... Communication system

[1] In order to solve the above-described problem, a communication terminal device according to an aspect of the present invention includes a telephone function unit including a first speaker for loudspeaking and a second speaker for earpiece, and an application program. In the case where a telephone call is made by the telephone function unit while executing the application program by the application execution unit, the display unit, the operation input receiving unit, and the application execution unit, a telephone voice is transmitted from the first speaker. A launcher storage unit for storing a launcher for selecting between a first reception mode for emitting a sound and making a call or a second reception mode for emitting a telephone sound from the second speaker and making a call If, executes the launcher stored in the launcher storage unit, the first GUI image associated with the first reception mode including In a launcher execution unit that displays a launcher image on the display unit, and in a launcher image displayed by the launcher execution unit, a portion corresponding to the first GUI image in the operation input reception unit receives an operation input The telephone function unit is set to the first reception mode, and a launcher image including a third GUI image for causing the launcher execution unit to switch from the first reception mode to the second reception mode is provided. , executes a process of displaying on the display unit, and a process of displaying the GUI image for transiting the display screen sharing menu associated with the information-sharing mode with another communication terminal apparatus on the display unit, the A control unit.

[2] In the communication terminal apparatus according to [1], the control unit deletes the launcher image after a predetermined time has elapsed after setting the telephone function unit to the first reception mode, and the screen sharing A GUI image for transitioning to menu display is displayed.
[3] In the communication terminal device according to [2] above, when the portion corresponding to the GUI image for transitioning to the display of the screen sharing menu in the operation input receiving unit receives an operation input, the control unit The screen sharing menu is displayed on the display unit.
[4] In the communication terminal device according to [2], when the portion corresponding to the third GUI image in the operation input receiving unit receives an operation input within the predetermined time, the control unit The telephone function unit is switched from the first reception mode to the second reception mode.
[5] The communication terminal device according to any one of [1] to [4] , further including a proximity sensor provided in the vicinity of the second speaker, wherein the control unit approaches the proximity sensor. The telephone function unit is set to the second reception mode by detecting an object.
[6] The communication terminal device according to any one of [1] to [4], further including a proximity sensor provided in the vicinity of the second speaker, wherein the telephone function unit is the second reception mode. When the proximity sensor no longer detects an object when the proximity function is set, the control unit sets the telephone function unit to the first reception mode.
[7] The communication terminal device according to any one of [1] to [4], further including a proximity sensor provided in the vicinity of the second speaker, wherein the control unit approaches the proximity sensor. By detecting the object, the telephone function unit is set to the second reception mode, and the proximity sensor does not detect the object when the telephone function unit is set to the second reception mode. Then, the telephone function unit is set to the first reception mode.

Claims (5)

A telephone function unit including a first speaker for loudspeaker and a second speaker for earpiece;
An application execution unit for executing an application program;
A display unit;
An operation input receiving unit;
In a case where a call is made by the telephone function unit while the application execution unit is executing the application program, the first reception mode in which a telephone voice is emitted from the first speaker to make a call, or the first A launcher storage unit for storing a launcher for selecting a second reception mode in which a telephone voice is emitted from a speaker of 2 and a call is made;
When the telephone function unit receives a call, the launcher stored in the launcher storage unit is activated, and the first GUI image associated with the first reception mode and the second reception mode are associated with each other. A launcher execution unit that displays a launcher image including a second GUI image on the display unit;
In the launcher image displayed by the launcher execution unit, when a portion corresponding to the first GUI image in the operation input reception unit receives an operation input, the telephone function unit is set to the first reception mode. The launcher execution unit displays a launcher image including a third GUI image for switching from the first reception mode to the second reception mode on the display unit, while the operation input reception unit When the part corresponding to the second GUI image in FIG. 2 accepts an operation input, the telephone function unit is set to the second reception mode and is associated with an information sharing mode with another communication terminal device A control unit for displaying a screen sharing menu on the display unit;
A communication terminal device comprising: The control unit, after setting the telephone function unit to the first reception mode, erases the launcher image after a lapse of a predetermined time, and displays an icon image for transitioning to the display of the screen sharing menu.
The communication terminal device according to claim 1. When a portion corresponding to the icon image in the operation input receiving unit receives an operation input, the control unit displays the screen sharing menu on the display unit.
The communication terminal device according to claim 2. When the portion corresponding to the third GUI image in the operation input receiving unit receives an operation input within the predetermined time, the control unit moves the telephone function unit from the first reception mode to the second reception mode. Switch to the listening mode
The communication terminal device according to claim 2. The screen sharing menu includes an adjustment GUI image for adjusting a call volume and / or a media volume of the application program.
The communication terminal device according to any one of claims 1 to 4.

Images