KR101980704B1 - Mobile terminal and controlling method thereof - Google Patents

Abstract

A touch screen for displaying a first screen including a video of the other party when a video call application is executed, and an execution screen for a specific application independent of the video call application during a video call with the other party And a control unit for controlling the display unit to superimpose any one of the first screen and the second screen in a semi-transparent state with another screen, the second screen including the first screen and the second screen, It is possible to provide convenience to the user by keeping the image of the other party on the touch screen even when performing another operation during the call.

Description

[0001] MOBILE TERMINAL AND CONTROLLING METHOD THEREOF [0002]

The present invention relates to a mobile terminal and a control method thereof that can provide a convenient and efficient multitasking function to a user during a video call.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

In the above-described mobile terminal, a multitasking function that allows a user to use various tasks at the same time is important for the convenience of the user and the usability of the mobile terminal. In addition, a video call function capable of transmitting the video of the other party in real time can be recognized as an essential function of the mobile terminal.

However, in the past, there was a limit in performing a different operation by a user during a video call. In order to perform another task during the video call, the video call screen has to be switched to another screen in order to input the execution command of the other task and confirm the execution result of the command. As a result, even when the mobile terminal supports the multitasking function during the video call, the user can not view the other party's image when performing another operation, and the screen switching between the operation screen and the video call screen is repeated.

It is an object of the present invention to provide a mobile terminal and a control method thereof that can perform other operations while a user holds a video of the other party on a touch screen while a video call is being made.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

According to another aspect of the present invention, there is provided a mobile communication terminal including a wireless communication unit for performing a video communication with a partner, a touch screen for displaying a first screen including a video of the other party when the video communication application is executed, A second screen including an execution screen of a specific application that is independent of the application is displayed so as to overlap with the first screen and that any one of the first screen and the second screen is overlapped with another screen in a translucent state And a controller for controlling the mobile terminal.

According to another aspect of the present invention, there is provided a method for controlling a video call, comprising the steps of: starting a video call by executing a video call application, displaying a first screen including a video of the other party on a touch screen, A second screen including an execution screen of a specific application that is independent of the application is superimposed on the first screen and displayed so that any one of the first screen and the second screen is overlapped with another screen in a semitransparent state And a control step of controlling the mobile terminal.

Effects of the mobile terminal and the control method according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, the user can perform efficient multitasking during a video call by performing another operation during a video call while keeping the video of the other party on the touch screen. The user can check the image of the other party of the video communication in real time during other operations, and as a result, the usability of the mobile terminal and the convenience of the user can be improved. In addition, since the touch screen is divided so that the video call screen and the application execution screen are not displayed but the two screens are displayed in a superimposed manner, the user can perform other operations using the entire touch screen even during a video call.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a front perspective view of a mobile terminal according to an embodiment of the present invention.
3 is a rear perspective view of a mobile terminal according to an embodiment of the present invention.
4 is a control flowchart of a mobile terminal according to an embodiment of the present invention.
5 is an exemplary diagram illustrating a control flow of the mobile terminal according to the embodiment of FIG.
6 is a control flowchart of a mobile terminal according to another embodiment of the present invention.
Figs. 7 and 8 are exemplary diagrams showing various examples of the control flow of the mobile terminal according to the embodiment of Fig. 6, respectively.
FIGS. 9A and 9B are views illustrating a case where the first screen and the second screen that are displayed in a superimposed manner are changed to be changed.
FIG. 10 is a diagram illustrating an example in which a first screen and a second screen are displayed according to another embodiment of the present invention.
11A and 11B are views illustrating a case where the first screen and the second screen that are superimposed and displayed according to the embodiment of FIG. 10 are changed to be changed.
Fig. 12 is an exemplary view showing a case where the second screen is transmitted to the other party.
13 is a diagram illustrating an example of receiving a third screen from the other party.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix " module " and " part " for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), navigation and the like.

However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention. The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (Mobile Broadcasting Business Management System), ISDB-T (Integrated Services Digital Broadcasting (ISDB-T)), Digital Multimedia Broadcasting (MBMS) Digital Broadcast-Terrestrial) or the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 may be coupled to a base station, an external terminal, or a server on a mobile communication network, such as, but not limited to, Gobal System for Mobile communications (GSM), Code Division Multiple Access (CDMA), Wideband CDMA Transmits and receives wireless signals with one. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), GSM, CDMA, WCDMA, LTE Evolution (but not limited to) may be used.

The wireless Internet module 113, which performs wireless Internet access through the mobile communication network, is connected to the mobile communication module 110 through the mobile communication network, for example, from the viewpoint that the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, (112). ≪ / RTI >

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module. According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain a three-dimensional string of latitude, longitude, The location information can be accurately calculated. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 can calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a button 136 located on the front, rear, or side of the mobile terminal 100, and a touch sensor (static / static) 137. Although not shown, ), A dome switch, a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141. (The proximity sensor will be described later).

The output unit 150 is for generating output related to the visual, auditory or tactile sense and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154 .

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

In the case where the display unit 151 and the touch sensor 137 have a mutual layer structure or are integrally formed (hereinafter referred to as a 'touch screen'), the display unit 151 may be used as an input device . The touch sensor 137 may be stacked on the display unit 151 to form a layer structure when the touch sensor 137 has a form of a touch film, a touch sheet, a touch pad, or the like. And may be integrally formed.

The touch sensor 137 may be configured to convert a change in a pressure applied to a specific part of the display part 151 or a capacitance generated in a specific part of the display part 151 into an electrical input signal. The touch sensor 137 can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor 137, the corresponding signal (s) is sent to the touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer with a change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as " proximity touch " The act of actually contacting the pointer on the touch screen may be referred to as " contact touch. &Quot; The location where the pointer is proximately touched on the touch screen may refer to a position where the pointer corresponds vertically to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. In this case, the display unit 151 and the audio output module 152 may be a type of the alarm unit 153. The display unit 151 and the audio output module 152 may be connected to the display unit 151 or the audio output module 152, .

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.

The memory unit 160 may store a program for processing and controlling the control unit 180 and temporarily store the input / output data (e.g., telephone directory, message, audio, For example. The memory unit 160 may store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia).

In addition, the memory unit 160 may store data on vibration and sound of various patterns output when the touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 may include, for example, a battery, a connection port, a power supply control unit, and a charge monitoring unit.

The battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like. The connection port may be configured as an example of an interface 170 through which an external charger for supplying power for charging the battery is electrically connected.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

FIG. 2 is a perspective view of a mobile terminal or a portable terminal according to the present invention, as viewed from the front.

The disclosed mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body of the mobile terminal 100 includes a casing 101, 102, In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ Various electronic components may be embedded in the space formed between the front case 101 and the rear case 102. [

A component such as a USIM card and a memory card, such as an auxiliary storage medium 165, which may be detached, may include an opening in the case so as to be inserted into the case from the outside. Slots may be formed on the side of the case so that the auxiliary storage medium 165 may be inserted from the side of the mobile terminal 100 and card slots 166 and 167 may be formed on the surface of the rear case 102 It is possible.

The cases 101, 102, and 103 may be formed by injection molding synthetic resin or may be formed of a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, and the interface 170 may be disposed in the terminal cases 101 and 102.

The display unit 151 occupies most of the main surface of the front case 101. The audio output unit 152 and the camera 121 may be disposed in a region adjacent to one end of the display unit 151 and the user input unit 131 and the microphone 122 may be disposed adjacent to the other end of the display unit 151 . The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100 and may include a plurality of operation units 131, 132, and 133. The operation units 131, 132, and 133 may be collectively referred to as a manipulating portion.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives a command such as start, end, scroll, and the like, and the second operation unit 132 inputs a command such as adjustment of the sound output from the sound output unit 152 And the third operation unit 133 can receive commands such as activation / deactivation of the touch recognition mode of the display unit 151 and the like.

The operation units 131, 132 and 133 may have a button system recognized when a user applies pressure and a touch sensor 137 may be provided to the operation units 131, 132 and 133 in addition to the display unit 151 So that the user's command can be received only by the user's touch.

3 is a rear perspective view of the mobile terminal shown in FIG.

Referring to FIG. 3, a camera 121 'may be further mounted on the rear surface of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to the camera 121 (see FIG. 2), and may be a camera having the same or different pixels as the camera 121.

For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It is preferable to have a large number of pixels. The cameras 121 and 121 'may be installed in the terminal body such that they can be rotated or pop-up.

A flash 123 and a mirror 124 may be additionally disposed adjacent to the camera 121 '. The flash 123 may be illuminated toward the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to illuminate the user's own face or the like when the user intends to shoot himself / herself (self-photographing) using the camera 121 '.

An acoustic output 152 'may be additionally disposed on the rear surface of the terminal body. The sound output 152 'on the rear side of the body may implement the stereo function together with the sound output 152 (see FIG. 2) of the front side of the body, and may be used for the implementation of the speakerphone mode during a call.

In addition to the antenna for talking and the like, a broadcast signal reception antenna 116 may be additionally disposed on the side of the terminal body. The antenna 116, which forms part of the broadcast receiving module 111 (see FIG. 1), can be installed to be able to be drawn out from the terminal body.

Hereinafter, an embodiment of a control method that can be implemented in the mobile terminal configured as described above will be described with reference to FIGS. 4 to 8. FIG.

For convenience of explanation, it is assumed that the mobile terminal referred to below includes at least a part of the components shown in Fig. In detail, the mobile terminal according to the present invention includes a wireless communication unit 110, a display unit 151, and a control unit 180 among the components shown in FIG. The mobile terminal according to the present invention can be more easily implemented when the display unit 151 is the touch screen 151. It is assumed here that the display unit 151 is the 'touch screen 151'.

FIG. 4 is a control flowchart of a mobile terminal according to an embodiment of the present invention, and FIG. 5 is an exemplary view of the embodiment of FIG. FIGS. 4 and 5 illustrate a case where one or more application icons 2021 are automatically overlapped with a video call screen when a video call application is executed.

4, when a video call is started by a user at step S410, the controller 180 displays a first screen 2010 including a video of the other party on the touch screen 151, (Step S420). The video call can be performed by the wireless communication unit 110 of the mobile terminal. In addition, the controller 180 controls one or more application icons 2021 to be superimposed on the first screen 2010 and displayed.

As shown in FIG. 5 (1), a home screen screen 1510 including one or more application icons and widgets may be displayed on the touch screen 151 of the mobile terminal in the standby state. When a video call is started in the mobile terminal having the home screen as described above, the first screen 2010 including the image of the other party may be displayed on the touch screen 151 as shown in (2) of FIG. 5 . As the first screen 2010 is displayed, one or more application icons 2021 may also be displayed on the touch screen 151 automatically from the beginning of the video call, overlapping the first screen 2010. [

At this time, one or more application icons 2021 may be at least a part of one or more application icons 2021 included in the home screen screen 1510 of the mobile terminal. 5 (2), when a video call is initiated, all the application icons 2021 included in the home screen screen 1510 itself or the home screen screen 1510 together with the image of the other party, Can be displayed.

As another example, referring to (2) of FIG. 8, only some application icons 2021 among the application icons 2021 included in the home screen screen 1510 overlap with the first screen 2010 And displayed. The case where only a part of the application icon 2021 is displayed will be described later in detail with reference to Fig.

According to one embodiment, as shown in (2) of FIG. 5, the controller 180 may display one of the first screen 2010 and the application icon 2021 in a translucent manner. 5B shows a case where one or more application icons 2021 are translucent and the first screen 2010 is displayed in an opaque state. However, when the application icon 2021 is opaque and the first screen 2010 is opaque, It may also be displayed semi-transparently. According to the present embodiment, the first screen 2010 is displayed after the semi-transparent application icon 2021, so that the user can see all of the video of the other party.

4, when one of the one or more application icons 2021 displayed in a superimposed manner with the first screen 2010 is selected by the user, the controller 180 displays the selected application icon 2021 during a video call The corresponding specific application is executed (S430). If the specific application is executed, the controller 180 displays the second screen 2022 including the execution screen of the specific application on the touch screen 151 in step S440. At this time, the controller 180 displays either the second screen 2022 or the first screen 2010 in a semi-transparent manner.

According to an embodiment, when the second screen 2022 is displayed in a superimposed manner on the first screen 2010, the controller 180 may activate the second screen 2022 with respect to the touch input of the user. That is, when a user performs a touch input in a state where two overlapping screens are displayed, the controller 180 can recognize the touch input of the user as a touch input to the second screen 2022. [ As a result, when the user performs the touch input in the state that the second screen 2022 is displayed, the second screen 2022 may be changed according to the touch input, or various operations in the specific application may be performed. For example, when the touch drag input for scrolling the second screen 2022 is performed as shown in (3) of FIG. 5, the first screen 2010 is displayed as shown in (4) Only the second screen 2022 can be scrolled.

As shown in (3) of FIG. 5, when one of the one or more application icons 2021 displayed on the touch screen 151 is selected by, for example, touching, a specific application corresponding to the selected application icon 2021 is executed , A second screen 2022 including the execution screen may be displayed so as to overlap with the first screen 2010. [ In FIG. 5, the map application icon 2021 is selected, and the second screen 2022 displayed together with the image of the other party may be the map application execution screen.

At the same time, in (3) of FIG. 5, the second screen 2022 as the map application execution screen is translucent and the video call screen can be displayed opaque. The user can simultaneously view the first screen 2010, which is a video call screen, and the second screen 2022, which is a map application execution screen, and can use the map application while viewing a video of the video communication partner.

In this case, the application corresponding to the application icon 2021 selected by the user may be independent of the video call application. That is, the specific application for generating the second screen 2022 is not linked to the video call application and may not use the information related to the video call at the time of execution. For example, the specific application may be a map application as shown in (2) of FIG. Alternatively, the image viewer application may be an image viewer application as shown in FIG. 8, but the present invention is not limited thereto and may include all executable applications of the control unit 180 of the mobile terminal.

In addition, the specific application corresponding to the application icon 2021 selected by the user may include a function of setting the operation environment of the mobile terminal and the like. For example, the specific application may include a function of changing the volume of the sound output from the mobile terminal, a function of changing the brightness of the touch screen 151, or a function of changing the communication mode of the mobile terminal.

According to the present embodiment, during execution of a video call, the execution screen of another application can be displayed simultaneously with the video of the other party. As a result, the user of the mobile terminal can freely use another application installed in the mobile terminal or change the operation environment of the mobile terminal without ending the video call screen during the video call. Accordingly, efficient multitasking can be performed even during a video call, and usability and convenience of the mobile terminal can be improved.

Meanwhile, according to the present invention, the process of displaying one or more application icons 2021 in a superimposed manner with the first screen 2010 and the process of selecting one of the one or more application icons 2021 may be omitted. 4 and 5, only one or more application icons 2021 are displayed so as to overlap with the first screen 2010 and the user selects one of the one or more application icons 2021 to execute the application, The video call screen and the execution screen of the independent specific application can be superimposed and displayed without processes.

For example, when a video call is initiated without terminating the application while another application independent of the video call application is running, a first screen 2010 including an execution screen of the application that has been executed and a video of the other party Can be superimposed and displayed. This allows the user to make video calls at any time while continuing to work on an application that was previously running.

In the above description, when the video call application is executed, one or more application icons 2021 are automatically overlapped with the first screen 2010, which is the video call screen, together with the start of the video call. 6 to 8 illustrate a case where the one or more application icons 2021 are displayed by a user's command. FIG. 6 is a control flowchart of the mobile terminal according to the embodiment of the present invention, and FIGS. 7 and 8 are exemplary views of the embodiment of FIG.

6, in the present embodiment, when a video call is first started by the user (S610), the controller 180 displays the first screen 2010 including the video of the other party on the touch screen 151 (S620). If the first user command 10 is detected in step S630 while the first screen 2010 is displayed on the touch screen 151, the controller 180 displays one or more application icons 2021 on the touch screen 151 Superimposed on the first screen 2010 and displayed. At this time, according to one embodiment, one of the first screen 2010 and the application icon 2021 may be displayed in a translucent state.

The first user command 10 may be a touch input of a particular gesture or a touch input performed on a specific portion of the touch screen 151. The first user command 10 is not limited to the touch input but may be input through a button 136 included in the user command unit 130 of the mobile terminal, a keypad, a dome switch, a jog wheel, a jog switch, , Or an input via an electrical signal.

When the first screen 2010 and one or more application icons 2021 are superimposed and displayed on the touch screen 151, one of the one or more applications can be selected by the user. In response to the user's selection input, the controller 180 executes the specific application corresponding to the selected application icon 2021 (S650). After executing the specific application, the controller 180 displays a second screen 2022 including the specific application execution screen on the touch screen 151 in a superimposed manner on the first screen 2010 during a video call (S660) . At this time, any one of the first screen 2010 and the second screen 2022 may be displayed semi-transparently. The detailed configuration of these processes is the same as described above, and is omitted.

For example, the mobile terminal according to the present embodiment can be controlled as shown in FIG.

The mobile terminal according to the present embodiment may have a home screen screen 1510 as shown in FIG. 7 (1). As shown, the home screen screen 1510 may include various widgets and one or more application icons 2021. [ When the video call is started in the mobile terminal as described above, the first screen 2010 including the image of the other party may be displayed on the touch screen 151 as shown in (2) of FIG. In this state, the user may enter the first user command 10 to execute another application during a video call. In this figure, it is shown that the first user command 10 designates that the touch input is detected on the home button of the touch screen 151 by the user.

As shown in (2) of FIG. 7, when a user touches a home button during a video call, one or more application icons 2021 overlap with the first screen 2010, as shown in (3) Can be displayed. At this time, according to one embodiment, the one or more application icons 2021 can be included in the home screen screen 1510 shown in (1) of FIG. 7, and furthermore, as shown in (3) The home screen screen 1510 itself can be superimposed on the first screen 2010 and displayed. In this case, the home screen screen 1510 may be overlapped with the first screen 2010 in a semi-transparent state, or the first screen 2010 may be overlapped with the home screen screen 1510 in a semi-transparent state.

In this case, the user may cause the application icons 2021 to be displayed through the first user command 10 when desired during a video call. In addition, when the home screen screen 1510 set on the mobile terminal is overlapped with the video call screen, the user can freely use the home screen screen 1510 while viewing the image of the other party. As a result, the availability and convenience of the multitasking function performed during a video call can be improved.

Alternatively, when a first user command 10 is input, only certain application icons 2021 may be displayed on the touch screen 151 together with the first screen 2010, as shown in FIG.

The user can input the first user command 10 while the first screen 2010 including the image of the other party is displayed as shown in FIG. 8 (1). For example, the first user command 10 may be a long touch input that presses a long video call screen. When a designated first user command 10 is input, only a certain number of application icons 2021 are overlapped with the first screen 2010 in a part of the touch screen 151 as shown in (2) of FIG. 8 Can be displayed. The specific application icons 2021 may be part of one or more icons 2021 included in the home screen screen 1510 and may be selected by the user. Accordingly, the user can display only the application icons 2021 corresponding to some applications, which are expected to be used during the video call, to be overlapped with the video call screen.

Hereinafter, various methods of utilizing the control method of the mobile terminal according to the above-described embodiments will be described in more detail with reference to FIGS. 9A to 13.

9A shows an example in which the user can change the transparency of the first screen 2010 and the second screen 2022 with each other. FIG. 9B shows an example in which the user can remove the second screen 2022. FIG.

9A, when the second user command 20 is detected, the controller 180 makes the semi-transparent screen of the first screen 2010 and the second screen 2022 opaque You can make other screens translucent. Thus, the transparency of the first screen 2010 and the second screen 2022 can be changed. The second user command 20 may be a touch input of a specific pattern, a touch input performed on a specific area of the touch screen 151, or a touch input.

According to the present embodiment, as shown in (1) of FIG. 9A, the first screen 2010 and the second screen 2022 displayed on the touch screen 151 overlap with each other, Quot ;, " video call "). In (1) of FIG. 9A, the second screen 2022 can be displayed in a superimposed manner with the first screen 2010 in a semi-transparent state. In the above state, when the user performs an input to touch a tab (a "video call") of the first screen 2010 as a second user command 20, the first screen 2010 and the second screen 2022 ) Can be mutually changed. That is, as shown in (2) of FIG. 9A, the transparency levels of the first screen 2010 and the second screen 2022 are changed so that the first screen 2010 becomes translucent and the second screen 2022 becomes opaque . At this time, the activated screen can be maintained in the second screen 2022.

The user changes the semitransparent screen to the other one of the first screen 2010 and the second screen 2022 according to the second user command 20 so that the more clear one of the first screen 2010 and the second screen 2022 You can adjust the screen you want to see. As a result, usability and convenience of the multitasking function during video communication can be improved.

According to another embodiment, as shown in FIG. 9B, when the touch input of the user is sensed, the control unit 180 may terminate the specific application that was executed during the video call and terminate the display of the second screen 2022 . The touch input may be a touch input of a specific pattern or a touch input performed on a specific area of the touch screen 151.

According to this embodiment, as shown in (1) of FIG. 9B, a first screen 2010 and a second screen 2022, which are superimposed on each other, are overlapped with each other and displayed on the displayed touch screen 151, Quot; return to video call " area may be formed. In the " return to video call " area, a function of terminating the display of the second screen 2022 and terminating the application that was executed with the video call when the user touches the screen may be set.

9B, when the user touches the " return to video call " area, the control unit 180 terminates the execution of the map application that was being executed simultaneously with the video call as shown in FIG. 9B The display of the second screen 2022 as the map application execution screen can be ended. If the first screen 2010, which is the video call screen in FIG. 9B, is in a translucent state, the controller 180 displays the second screen 2022 when the touch input is detected on the " The first screen 2010 can be opaquely changed.

10 shows a case where the second screen 2022 is displayed in a superimposed manner with the first screen 2010 in a different manner. 11A and 11B show embodiments in which the user changes the display state of the first screen 2010 and the second screen 2022 through a user command, respectively.

10, when the first screen 2010 and the second screen 2022 are overlapped and displayed on the touch screen 151, the controller 180 displays the first screen 2010 and the second screen 2022, 2022 can be controlled to be displayed on one side of the touch screen 151 by being turned back to the other screen. In this case, the screen of one of the first screen 2010 and the second screen 2022 is obliquely overlapped with respect to the other screen, and when the user views both the first screen 2010 and the second screen 2022 at the same time You can see each screen more clearly.

Specifically, as shown in FIG. 10 (1), the first screen 2010, which is a video call screen after the start of a video call, and one or more icons 2021 can be displayed in a superimposed manner. As described above, the entire home screen screen 1510 of the mobile terminal may be displayed superimposed on the first screen 2010 to display one or more icons 2021. [ In this state, when the user selects the photo album application icon 2021 as shown in (1) in Fig. 10, the control unit 180 can execute the photo album application.

The control unit 180 executes the photo album application to display the second screen 2022 which is an execution screen of the photo album application on the touch screen 151 in a translucent manner as shown in Figs. 10 (2) and (3) have. At the same time, the controller 180 can display the first screen 2010 in an opaque state by tilting it to the right side of the touch screen 151.

The execution screen of the photo album application may be composed of thumbnails of pictures stored in the mobile terminal as shown in (2) in FIG. 10 or may be composed of one image as shown in (3) of FIG. 10 . When a screen composed of thumbnails is displayed first, when the user selects one thumbnail as shown in (2) of FIG. 10, the controller 180 controls the selected thumbnail as shown in (3) The corresponding image can be displayed on the entire screen.

The first screen 2010 and the second screen 2022 are overlapped with each other in a state in which one of the first screen 2010 and the second screen 2022 is tilted with respect to the other screen, The positions of the first screen 2010 and the second screen 2022 can be changed by a user's command. According to the present embodiment, when the third user command 30 is detected, the controller 180 makes the semi-transparent screen of the first screen 2010 and the second screen 2022 opaque while making the other screen translucent, One of the first screen 2010 and the second screen 2022 can be controlled to be displayed on one side of the touch screen 151 after the opaquely changed screen is turned back to the semi-transparently changed screen. FIG. 11A shows a control example of the mobile terminal according to the above embodiment.

When the first screen 2010 which is a video call screen is displayed on the right side of the touch screen 151 while being tilted backward from the second screen 2022 as the photo album application execution screen as shown in (1) of FIG. 11A, , The user's third user command 30 may be input. The third user command 30 may be a touch input of a specific pattern, a touch input performed on a specific area of the touch screen 151, or a touch input. In this figure, it is shown that the third user command 30 is a touch drag input of a pattern for dragging the first screen 2010 to the center of the touch screen 151.

When the third user command 30 as described above is input, the controller 180 controls the first user terminal 30 and the second user terminal 30 in response to the third user command 30 as shown in (2) It is possible to change the position of the display unit 2022. The control unit 180 translucently changes the first screen 2010 displayed on the right side of the touch screen 151 in an opaque state as shown in (2) of FIG. 11A, . At the same time, the controller 180 opaquely changes the second screen 2022 displayed on the front surface of the touch screen 151 in a semitransparent state so as to be opaque to the left of the touch screen 151 while being turned back behind the first screen 2010 Can be displayed. Accordingly, the user can change the screen to be viewed from the front of the touch screen 151 while viewing the first screen 2010 and the second screen 2022 at the same time.

10, when one of the first screen 2010 and the second screen 2022 is tilted with respect to the other screen, the first screen 2010 and the second screen 2022 are rotated The display of the second screen 2022 may be terminated by the user's touch input. FIG. 11B shows a control example of the mobile terminal according to the embodiment.

When the first screen 2010 which is a video call screen is displayed on the right side of the touch screen 151 while being tilted backward from the second screen 2022 as the photo album application execution screen as shown in (1) of FIG. 11B, , The user can perform the touch input. The touch input may be a touch input of a specific pattern or a touch input performed on a specific area of the touch screen 151. [ In (1) of FIG. 11B, the case where the user performs a touch input for selecting the right side of the touch screen 151 where the first screen 2010 is located is shown.

In response to the touch input, as shown in (2) of FIG. 11B, the control unit 180 ends the execution of the photo album application that was being executed simultaneously with the video call and displays the second screen 2022 Can be stopped. At the same time, the controller 180 can display the first screen 2010 that has been turned back on the front surface of the touch screen 151 again.

Meanwhile, FIG. 12 illustrates a case where a user transmits a second screen 2022 during a video call, and FIG. 13 illustrates a case where a user receives an image from a counterpart during a video call.

12, when the fourth user command 40 is detected, the controller 180 transmits the second screen 2022 to the other party through the wireless communication unit 110 of the mobile terminal . According to the present embodiment, the user can share the execution screen of the specific application with the video call partner by transmitting the execution screen of the specific application independent of the video call application during the video call to the other party.

12 (1), in a state in which the first screen 2010 and the second screen 2022 are superimposed on the touch screen 151 and displayed, the user selects the fourth user command 40, Can be input. The fourth user command 40 may be a touch input of a specific pattern, a touch input performed on a specific area of the touch screen 151, or a touch input. In (1) of FIG. 12, a case where the fourth user command 40 is an input for long touching the second screen 2022 displayed on the touch screen 151 is shown.

When the fourth user command 40 as described above is input, the controller 180 can display the " shared " and " cancel " areas on the touch screen 151 as shown in (2) of FIG. When the " sharing " area is selected through the touch input, the control unit 180 transmits the displayed second screen 2022 to the other party. When the " Can be set to end the display of the " cancel " area. When the user selects the " shared " area, the controller 180 can transmit the second screen 2022 to the video call partner through the wireless communication unit 110. [

13, when the third screen 2030 is received from the other party during a video call, the controller 180 determines whether any one of the first screen 2010 and the third screen 2030 It is possible to control the screen to be displayed so as to be overlapped with another screen in a semi-transparent state. According to the present embodiment, when the user receives an image or the like from the other party during a video call, the user can check the received image while continuously watching the video call screen.

Specifically, when the first screen 2010 and the second screen 2022 are overlapped and displayed, when the controller 180 receives the image from the other party, the controller 180 displays the touch screen 151 ) To display a pop-up window. The " Accept " and " Reject " areas may be displayed in the pop-up window. When the " accept " area is selected through the touch input, the controller 180 displays the received image on the touch screen 151. When the " reject " area is selected, the controller 180 terminates the display of the pop- . ≪ / RTI >

When the user selects the " Accept " area as shown in (1) of FIG. 13, the controller 180 responds to the received image to the touch screen 151 as shown in (2) Can be displayed. At this time, the third image 2030, which is the received image, and the first image, which is a video call screen, are overlapped and displayed, and either the third image 2030 or the second image 2022 is displayed in a translucent manner have. Also, as shown in FIG. 13 (2), the opaque first screen 2010 may be displayed behind the translucent third screen 2030 and displayed on one side of the touch screen 151.

13, the content received from the other party is an image file, but the content received from the other party may be other multimedia content such as moving pictures and music. In this case, the playback screen of the multimedia contents received from the other party may be displayed in a superimposed manner with the first screen 2010, which is a video call screen. The playback screen of the multimedia content may be an execution screen of a specific application for playing back the received multimedia screen.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention may be included in the scope of the present invention.

100: mobile terminal 110: wireless communication unit
180: control unit 151: touch screen
2010: First screen 2021: Application icon
2022: second screen 2030: third screen
10: first user command 20: second user command
30: third user command 40: fourth user command

Claims (11)

A wireless communication unit for performing video communication with the other party;
A touch screen for displaying a first screen including a video of the other party when the video call application is executed; And
A second screen including an execution screen of a specific application independent of the video call application is displayed in a superimposed manner on the first screen during a video call with the other party,
And a controller for controlling one of the first screen and the second screen to overlap with another screen in a translucent state,
Wherein the control unit controls the opaque screen of the first screen and the second screen to be displayed on one side of the touch screen after being turned back to another screen. The method according to claim 1,
The control unit
One or more application icons are displayed together with the first screen when a first user command is input from the beginning of a video call or during a video call,
Wherein when the icon corresponding to the specific application is selected from among the one or more application icons, the second screen is overlapped with the first screen to be displayed. 3. The method of claim 2,
Wherein the one or more application icons are at least a part of one or more application icons displayed on the home screen screen. The method of claim 3,
Wherein the one or more application icons are preselected by a user from among one or more application icons included on the home screen screen. The method according to claim 1,
The control unit
Wherein when the second user command is detected, the translucent screen of the first screen and the second screen is opaque and the other screen is opaque. delete 6. The method of claim 5,
The control unit
When a third user command is sensed, making the semi-transparent screen of the first screen and the second screen opaque while making the other screen translucent,
Wherein the opaque changed screen of the first screen and the second screen is turned back to a semi-transparently changed screen so as to be displayed on one side of the touch screen. The method according to claim 1,
The control unit
And transmits the second screen to the other party through the wireless communication unit when a fourth user command is detected. The method according to claim 1,
The control unit
And when the third screen is received from the other party during the video call, the first screen and the third screen are overlapped with other screens in a semi-transparent state. Initiating a video call application by executing a video call application;
Displaying a first screen including a video of the other party on a touch screen; And
A second screen including an execution screen of a specific application that is independent of the video call application during a video call with the other party is superimposed on the first screen and is displayed so that any one of the first screen and the second screen Controlling so as to overlap with another screen in a translucent state; And controlling the opaque screen of the first screen and the second screen to be displayed on another side of the touch screen after being turned back to another screen. Executing a video call application to start a video call;
Displaying a first screen including a video of the other party on a touch screen; And a second screen including an execution screen of a specific application which is independent of the video call application during a video call with the other party, superimposed on the first screen and displayed on the screen of either the first screen or the second screen A command for controlling to be superimposed on another screen in a semi-transparent state; And controlling the opaque screen out of the first screen and the second screen to be displayed on one side of the touch screen after being turned back to another screen.

Images