KR20090040613A - Mobile terminal and method of displaying a screen therein - Google Patents

Abstract

A mobile terminal and a method of displaying a screen therein are provided to controls a screen on which an image is displayed by considering the size of the displayed region. A camera(121) photographs an image, and a wireless communication unit(110) performs a data communication operation. When performing an image communication, a display unit(151) displays a main screen which displays the first other party and at least sub-screen which displays an image of the second other party in the main screen. A controller(180) controls the sub-screen to be displayed on the main screen.

Description

MOBILE TERMINAL AND METHOD OF DISPLAYING A SCREEN THEREIN}

The present invention relates to a mobile terminal capable of performing a video call with a plurality of counterparts.

The mobile terminal may be configured to perform various functions. Examples of such various functions include data and voice communication functions, taking pictures or videos through a camera, storing voices, playing music files through a speaker system, and displaying images or videos. Some mobile terminals include additional functionality to play games, while others are implemented as multimedia devices. Moreover, recent mobile terminals can receive broadcast or multicast signals to watch video or television programs.

In addition, efforts to support and increase the function of the mobile terminal continue. The foregoing efforts include not only changes and improvements in the structural components forming the mobile terminal, but also improvements in software or hardware.

Meanwhile, recently, a mobile terminal capable of performing a video call has been developed. In this case, a method of controlling a screen for displaying a video has also been studied.

SUMMARY OF THE INVENTION An object of the present invention is to provide a mobile terminal and a screen display method of a mobile terminal capable of controlling a screen on which an image is displayed in consideration of the size of a display area when performing a video call with a plurality of counterparts.

In addition, an object of the present invention, when performing a video call with a plurality of counterparts, the mobile terminal that can control the screen on which the image is displayed by displaying the first opponent video on the main screen, the second opponent video is displayed on the sub-screen And a screen display method of a mobile terminal.

In order to achieve the above object, the present invention provides a mobile terminal capable of performing a video call with a plurality of counterparts, comprising: a camera for photographing an image; A wireless communication unit for data communication; A display unit configured to display a main screen on which a first counterpart image is displayed and at least one subscreen on which a second counterpart image is displayed in the main screen during a video call; And a controller for controlling the sub screen to be displayed in the main screen.

In order to achieve the above object, the present invention comprises the steps of: displaying a main screen on which the first counterpart image is displayed during a video call; And displaying at least one sub screen on which a second counterpart image is displayed in a main screen.

The mobile terminal and the screen display method of the mobile terminal according to an embodiment of the present invention may control the screen on which the image is displayed in consideration of the size of the display area when performing a video call with a plurality of counterparts.

In addition, the mobile terminal and the screen display method of the mobile terminal according to an embodiment of the present invention, when performing a video call with a plurality of counterparts, the first counterpart image is displayed on the main screen, the second counterpart image is a sub-screen By displaying, the screen on which the image is displayed can be controlled.

Hereinafter, a mobile terminal according to the present invention will be described in more detail with reference to the accompanying drawings.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal can be implemented in various forms. For example, the mobile terminal described herein may be a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, or the like. have.

The illustrated mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, The interface unit 170 may include a controller 180, a power supply unit 190, and the like. 1 illustrates a mobile terminal having various components. However, not all illustrated components are essential components. The mobile terminal may be implemented by more components than the illustrated components, or the mobile terminal may be implemented by fewer components.

Hereinafter, the components will be described in turn.

The wireless communication unit 110 may include one or more components for wireless communication between the mobile terminal 100 and the wireless communication system or wireless communication between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcast systems providing broadcast signals as well as the digital broadcast system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

In addition, the mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access, and the wireless internet module 113 may be internal or external.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

In addition, the location information module 115 is a module for checking or obtaining the location of the mobile terminal. One example is the Global Position System (GPS) module. The GPS module receives location information from a plurality of satellites. Here, the location information may include coordinate information represented by latitude and longitude. For example, the GPS module can measure the exact time and distance from three or more satellites and accurately calculate the current position by triangulating three different distances. A method of obtaining distance and time information from three satellites and correcting the error with one satellite may be used. In particular, the GPS module can obtain not only the location of latitude, longitude, and altitude but also accurate time together with three-dimensional speed information from the location information received from the satellite.

Meanwhile, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the configuration aspect of the terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output in the call mode. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like. In particular, when the touch pad has a mutual layer structure with the display unit 151 described later, this may be referred to as a touch screen.

The sensing unit 140 detects a current state of the mobile terminal 100 such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, presence or absence of a user contact, orientation of the mobile terminal, acceleration / deceleration of the mobile terminal, and the like. To generate a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it is responsible for sensing functions related to whether the power supply unit 190 is supplied with power or whether the interface unit 170 is coupled to an external device.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, wired / wireless headset ports, external charger ports, wired / wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input / output (I / O) ports, Video I / O (Input / Output) port, earphone port, etc. may be included.

Here, the identification module is a chip that stores various types of information for authenticating the use authority of the mobile terminal 100, and includes a user identification module (UIM) and a subscriber identify module (SIM). ), A Universal Subscriber Identity Module (“USIM”), and the like. In addition, the device equipped with the identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Therefore, the identification device may be connected to the terminal 100 through a port. The interface unit 170 receives data from an external device or receives power and transmits the data to each component inside the mobile terminal 100 or transmits the data inside the mobile terminal 100 to an external device.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, a sound output module 152, an alarm unit 153, and the like.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, a user interface (UI) or a graphic user interface (GUI) related to a call is displayed. When the mobile terminal 100 is in a video call mode or a shooting mode, the mobile terminal 100 displays a photographed and / or received image, a UI, or a GUI.

Meanwhile, as described above, when the display unit 13 and the touch pad form a mutual layer structure to form a touch screen, the display unit 151 may be used as an input device in addition to the output device. The display unit 151 may include a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display. 3D display). In addition, two or more display units 151 may exist according to the implementation form of the mobile terminal 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the mobile terminal 100.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, and key signal input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. When a call signal is received or a message is received, the alarm unit 153 may output a vibration to inform this. Alternatively, when a key signal is input, the alarm unit 153 may output a vibration in response to the key signal input. Through the vibration output as described above, the user can recognize the occurrence of the event. Of course, the signal for notification of event occurrence may be output through the display unit 151 or the voice output module 152.

The memory 160 may store a program for processing and controlling the controller 180 and may provide a function for temporarily storing input / output data (for example, a phone book, a message, a still image, a video, etc.). It can also be done.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) magnetic memory, It may include at least one type of storage medium of the optical disk. In addition, the mobile terminal 100 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The controller 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The various embodiments described herein may be implemented in a computer readable recording medium using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing the functions. It may be implemented by the controller 180.

In a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed. The software code may be implemented by a software application written in a suitable programming language. In addition, the software code may be stored in the memory 160 and executed by the controller 180.

 In the above, the mobile terminal related to the present invention has been described in terms of components according to functions. Hereinafter, referring to FIGS. 2 and 3, the mobile terminal related to the present invention will be further described in terms of components according to appearance. Hereinafter, for simplicity, a slider type mobile terminal is described as an example among various types of mobile terminals such as a folder type, a bar type, a swing type, a slider type, and the like. Therefore, the present invention is not limited to the slider type mobile terminal, but can be applied to all types of mobile terminals including the above-described type.

2 is a front perspective view of an example of a mobile terminal according to the present invention;

The mobile terminal of the present invention includes a first body 200 and a second body 205 configured to be slidable in at least one direction on the first body 200.

A state in which the first body 200 is disposed to overlap with the second body 205 may be referred to as a closed configuration, and as shown in the drawing, the first body 200 may be referred to as the second body 205. The exposed state of at least a portion of the N may be referred to as an open configuration.

The mobile terminal mainly operates in a standby mode in a closed state, but the standby mode may be released by a user's operation. In addition, although the mobile terminal operates mainly in a call mode or the like in an open state, the mobile terminal may be switched to a standby mode by a user's manipulation or a lapse of a predetermined time.

The case (casing, housing, cover, etc.) forming the exterior of the first body 200 is formed by the first front case 220 and the first rear case 225. Various electronic components are embedded in the space formed by the first front case 220 and the first rear case 225. At least one intermediate case may be further disposed between the first front case 220 and the first rear case 225.

The cases may be formed by injecting a synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The display module 151, the audio output module 152, the camera 121, or the first user input unit 210 may be disposed on the first body 200, specifically, the first front case 220.

The display module 151 includes a liquid crystal display (LCD), organic light emitting diodes (OLED), and the like, which visually express information.

In addition, since the touch pad is superimposed on the display module 151 in a layer structure, the display unit 151 may operate as a touch screen to enable input of information by a user's touch.

The sound output module 152 may be implemented in the form of a speaker.

The camera 121 may be implemented to be suitable for capturing an image or a video of a user or the like.

Like the first body 200, the case forming the exterior of the second body 205 is formed by the second front case 230 and the second rear case 235.

The second user input unit 215 may be disposed on the second body 205, specifically, on the front face of the second front case 230.

The third user input unit 245, the microphone 122, and the interface unit 170 may be disposed on at least one of the second front case 230 or the second rear case 235.

The first to third user inputs 210, 215, and 245 may be collectively referred to as a manipulating portion 130, and may be any method in which the user operates while giving a tactile feeling. Either may be employed.

For example, the user input unit may be implemented as a dome switch or a touch pad capable of receiving a command or information by a user's push or touch operation, or a wheel or jog method of rotating a key, or a manipulation method such as a joystick. May also be implemented.

In functional terms, the first user input unit 210 is for inputting a command such as start, end, scroll, etc., and the second user input unit 215 is for inputting numbers, letters, symbols, and the like.

In addition, the third user input unit 245 may operate as a hot key for activating a special function in the mobile terminal.

The microphone 122 may be implemented in a form suitable for receiving a user's voice, other sounds, and the like.

The interface unit 170 serves as a passage for allowing the mobile terminal according to the present invention to exchange data with an external device. For example, the interface unit 170 is wired or wirelessly, a connection terminal for connecting with an earphone, a port for short-range communication {for example, an infrared port (IrDA port), a Bluetooth port, a wireless LAN port wireless LAN port), or at least one of power supply terminals for supplying power to the mobile terminal.

The interface unit 170 may be a card socket that accommodates an external card such as a subscriber identification module (SIM) or a user identity module (UIM) and a memory card for storing information.

The power supply unit 190 for supplying power to the (mobile terminal) is mounted on the second rear case 235 side.

The power supply unit 190 may be detachably coupled for charging, for example, as a rechargeable battery.

3 is a rear perspective view of the mobile terminal of FIG. 2.

Referring to FIG. 3, a camera 121 may be additionally mounted on the rear surface of the second rear case 235 of the second body 205. The camera 121 of the second body 205 has a photographing direction substantially opposite to the camera 121 of the first body 200, and the camera 121 and the camera 121 of the first body 200. And may have different pixels.

For example, the camera 121 of the first body 200 has a low pixel so that it is easy to take a picture of the user's face and transmit it to the counterpart in the case of a video call, and the camera 121 of the second body has a general structure. It is preferable to have a high pixel because the subject is often photographed and not immediately transmitted.

The flash 250 and the mirror 255 may be additionally disposed adjacent to the camera 121 of the second body 205. The flash 250 illuminates the subject when the subject is photographed by the camera 121 of the second body 205. The mirror 255 allows the user to see the user's face or the like when photographing (self-photographing) the user by using the camera 121 of the second body 205.

The sound output module 152 may be further disposed on the second rear case 235.

The sound output module 152 of the second body 205 may implement a stereo function together with the sound output module 152 of the first body 200, and may be used for a call in a speakerphone mode.

In addition, an antenna 260 for receiving broadcast signals may be disposed on one side of the second rear case 235. The antenna 260 may be installed to be pulled out of the second body 205 and 2.

A portion of the slide module 265 that slidably couples the first body 200 and the second body 205 is disposed on the first rear case 225 side of the first body 200.

The other part of the slide module 265 may be disposed on the second front case 230 side of the second body 205 and may not be exposed to the outside as shown in the drawing.

In the above description, the second camera 121 and the like have been described as being disposed in the second body 205, but the present invention is not limited thereto.

For example, at least one or more of the components 260, 121 to 250, and 152 described as being disposed on the second rear case 235, such as the camera 121 of the second body, may be the first body 200. May be mounted on the first rear case 225. If so, there is an advantage that the configuration (s) disposed in the first rear case 225 in the closed state are protected by the second body 205. Furthermore, even if the camera 121 of the second body is not provided separately, the camera 121 of the first body may be rotatably formed so that the camera 121 of the second body may be photographed up to the photographing direction of the camera 121 of the second body. .

The terminal 100 illustrated in FIGS. 1 to 3 may be operated in a communication system capable of transmitting data through a frame or packet, including a wired / wireless communication system and a satellite-based communication system. It can be configured to.

Hereinafter, referring to FIG. 4, a communication system capable of operating a terminal according to the present invention will be described.

The communication system may use different air interfaces and / or physical layers. For example, a radio interface usable by a communication system may include frequency division multiple access (FDMA), time division multiple access (TDMA), and code division multiple access (Code Division). Multiple Access (CDMA), Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE)), Global System for Mobile Communications (GSM), etc. May be included. Hereinafter, for convenience of description, the description will be limited to CDMA. However, it is a matter of course that the present invention is applicable to all communication systems including the CDMA wireless communication system.

As shown in FIG. 4, the CDMA wireless communication system includes a plurality of terminals 100, a plurality of base stations (BS) 270, and base station controllers (BSCs) 275. ), And a mobile switching center (MSC) 280. The MSC 280 is configured to be connected to a public switched telephone network (PSTN) 290 and is also configured to be connected to BSCs 275. The BSCs 275 may be coupled to the BS 270 through a backhaul line. The backhaul line may be provided according to at least one of E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. Thus, a plurality of BSCs 275 may be included in the system shown in FIG.

Each BS 270 may include at least one sector, and each sector may include an omnidirectional antenna or an antenna pointing radially out of BS 270. In addition, each sector may include two or more antennas of various types. Each BS 270 may be configured to support a plurality of frequency assignments, each of which has a specific spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of sectors and frequency assignments may be called a CDMA channel. BS 270 may be referred to as a base station transceiver subsystem ('BTSs'). In this case, the word "base station" may be called the sum of one BSC 275 and at least one BS 270. The base station may also indicate “cell site”. Alternatively, each of the plurality of sectors for a particular BS 270 may be called a plurality of cell sites.

As shown in FIG. 4, a broadcasting transmitter (BT) 295 transmits a broadcast signal to terminals 100 operating in the system. The broadcast module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT 295.

In addition, FIG. 4 illustrates multiple satellite positioning systems (GPS) satellites 300. The satellites 300 help to locate the at least one terminal of the plurality of terminals 100. Although two satellites are shown in FIG. 4, useful location information may be obtained by two or less or more satellites. The GPS module 115 shown in FIG. 1 cooperates with the satellites 300 to obtain desired location information. Here, the location can be tracked using all the techniques that can track the location, not just the GPS tracking technology. In addition, at least one of the GPS satellites 300 may optionally or additionally be responsible for satellite DMB transmission.

During typical operation of a wireless communication system, BS 270 receives a reverse link signal from various terminals 100. At this time, the terminals 100 are connecting a call, transmitting or receiving a message, or performing another communication operation. Each of the reverse link signals received by a particular base station 270 is processed within by the particular base station 270. The data generated as a result of the processing is transmitted to the connected BSC 275. BSC 275 provides call resource allocation and mobility management functions, including the organization of soft handoffs between base stations 270. In addition, the BSC 275 transmits the received data to the MSC 280, and the MSC 280 provides an additional transmission service for connection with the PSTN 290. Similarly, PSTN 290 connects with MSC 280, MSC 280 connects with BSCs 275, and BSCs 275 send BSs 270 to transmit a forward link signal to terminals 100. ).

Next, a screen display method of a mobile terminal according to an embodiment of the present invention will be described.

5 is a flowchart illustrating a screen display method of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 according to an embodiment of the present invention can perform a video call. In addition, the mobile terminal 100 may also perform a video call with a plurality of counterparts (S10). The video call with the plurality of counterparts may be made at the same time as the start of the video call, or may be made by the other party participating in the video call with the specific counterpart. Also, the controller 180 may perform a second video call by receiving a call signal for a second video call from a counterpart who is performing the first video call.

When the mobile terminal performs a video call with a plurality of counterparts, the controller 180 may control screen layout in consideration of the size of the display unit 151. For example, the first counterpart image may be displayed on the main screen, and the second counterpart image may be displayed on the sub screen (S20 and S30).

Hereinafter, when a video call is made with a plurality of counterparts in the mobile terminal 100, a method of displaying a screen will be described in more detail.

6 to 7 are diagrams illustrating that a video call is made by another party participating in a video call in a mobile terminal according to an embodiment of the present invention.

6A illustrates a screen in which a user of the mobile terminal 100 is conducting a video call with a first party. As shown, the first counterpart image is displayed at the top of the screen, and the user's own image is displayed at the bottom. In this case, the controller 180 may replace the displayed user's own image with a substitute image and transmit the replaced image.

As shown in FIG. 6A, the mobile terminal 100 may also perform a video call between three parties by participating in a second party while performing video with the first party. Such an example is shown in FIG. 6B. As shown, the first counterpart image is displayed on the main screen, and the second counterpart image is displayed on the subscreen located in the main screen. Also, the user's own image is displayed at the bottom of the screen on which the first and second counterparts are displayed. In this case, the controller 180 may replace the displayed user's own image with a substitute image and transmit the replaced image.

Meanwhile, the mobile terminal 100 may perform a video call by displaying only the other party's image without displaying the user's own image by the user's selection or the limitation of the size of the display unit 151. Such an example is shown in FIG. 7. FIG. 7A illustrates a screen for performing a video call with a first counterpart, and FIG. 7B illustrates a screen for performing a video call with a first counterpart and a second counterpart.

Meanwhile, according to an embodiment of the present invention, the controller 180 can recognize a speaker during a multi-party video call. In this case, the controller 180 can display the speaker's image to be identified. For example, the controller 180 may display the speaker image on the main screen or display a speaker or blink on the speaker image to distinguish it from other images.

Meanwhile, according to an embodiment of the present invention, a video call may be simultaneously performed by simultaneously transmitting a call signal for a video call to a plurality of counterparts.

8 is a diagram illustrating a procedure for performing a video call by simultaneously transmitting call signals for video calls to a plurality of counterparts in a mobile terminal according to an embodiment of the present invention. In this embodiment, a video call attempt is simultaneously made to two counterparts.

8A illustrates a screen in which a plurality of counterparts for a video call is selected. The other party for the video call may be selected using phonebook information stored in the memory 160 or using a shortcut number. When the "video call" menu is selected in the illustrated screen, the controller 180 may transmit a call signal for a video call to the selected counterpart.

8B illustrates a screen in which call signals for video calls are being transmitted to a plurality of counterparts. As illustrated, when attempting to connect to a video call, the controller 180 may display the counterpart image stored in the phonebook information in the form of a thumbnail. In addition, the controller 180 may display a default background image in a thumbnail form during a video call connection attempt.

8C is a diagram illustrating an example of a state in which a video call is connected to a plurality of counterparts. As shown, the first counterpart image is displayed on a main screen, and the second counterpart image is displayed on a sub screen located in the main screen. In addition, the controller 180 may display a counterpart video on which a video call is made first on a main screen, and display a counterpart video on which a video call is performed later on a sub screen.

If a video call is not made with one of the counterparts attempting to connect to the video call, the controller 180 may display only the video of the counterpart on the main screen. For example, when the video call with the second party is not connected in the state of FIG. 8B, the second party video (the previously stored video) disappears and only the first party video with which the video call is connected may be displayed.

Meanwhile, according to an exemplary embodiment of the present invention, the mobile terminal 100 may perform a second video call by receiving a call signal for a second video call to the first party who is performing the first video call. Such an example is shown in FIG. 9.

9A is a screen illustrating a state in which a call signal for a second video call is received from a counterpart in performing a first video call. The first video call may be a multi-party video call or a one-to-one video call. For example, Mr. Lee, Miss Park, Mr. During a video call (first video call) with three Songs, Mr. Lee can make a video call (second video call) to Mr. Kim.

Mr. received a second video call Kim may select a participant to conduct the second video call. That is, the controller 180 may receive a specific signal for selecting a video call participant and select a second video call participant to perform the second video call.

For example, all three first video call participants may be selected as the second video call counterpart. Such an example is shown in FIG. 9B. As illustrated, the first counterpart image may be displayed on the main screen, and the second counterpart and the third counterpart may be displayed on two sub-screens, respectively. In this case, the controller 180 can display a counterpart (Mr. Lee) image directly transmitted on the main screen.

In addition, the controller 180 may select only some of the first video call participants and perform the second video call. Such an example is shown in FIG. 9C. As illustrated, the user may select only Mr. Lee and Mr. Song who have requested the second video call directly as the second video call counterpart. That is, the controller 180 may receive a key signal for selecting a specific counterpart and perform a second video call with some of the first video participants. In this case, the controller 180 may display the Mr.Lee image directly transmitted for the second video call on the main screen and the Mr. Song image on the sub screen. In addition, a voice call may be performed with respect to the other party (Miss Park) who did not accept the video call.

FIG. 9D illustrates a screen in which all three participants in the first video call select the second video call counterpart and perform a video call like FIG. 9B. 9D shows only one sub screen. In this case, the controller 180 may replace the image displayed on the sub screen with another image according to a specific key signal input. For example, when an image of Mr. Lee is displayed on a main screen and an image of Mr. Song is displayed on a sub screen, the controller 180 receives a specific key signal (for example, a scroll key signal) and receives the sub. You can replace the displayed image with Miss Park image. If the display unit 151 of the mobile terminal 100 includes a touch screen, the controller 180 may perform the image replacement by a touch input.

Meanwhile, as shown in FIG. 9D, a method of replacing a video of a sub screen by receiving a specific signal may be applied even when four or more first video call counterparts are used. For example, an image of a counterpart who has made a direct call may be displayed on a main screen, and an image of the other party may be displayed on a sub screen. In this case, the controller 180 may receive an image replacement signal of the sub screen and replace the images in the order in which the calls are connected.

Meanwhile, according to an embodiment of the present invention, an image of a participant captured in a first video call may be received for selecting a second video call counterpart. For example, a user may request an image of Mr. Song or Miss Park from Mr. Lee, in which case Mr. Lee may send the requested picture to the user.

Meanwhile, according to an exemplary embodiment of the present disclosure, the controller 180 may control a display state of the displayed main screen or sub screen by receiving a specific signal. In this case, when the display unit 151 includes a touch screen, the specific signal input may be made by a touch input. Hereinafter, an example in which the display unit 151 includes a touch screen will be described.

According to an embodiment of the present disclosure, the controller 180 may adjust the position of the sub screen. Such an example is shown in FIG. 10.

As illustrated, the user may touch and drag the sub screen on which the second counterpart image is displayed (FIG. 10A). In this case, the controller 180 may recognize the drag by the touch as a signal for adjusting the position of the sub screen. Then, the controller 180 can move the sub screen to the dragged position (FIG. 10B). That is, the controller 180 can move the position of the sub screen by the drag.

FIG. 11 illustrates that a sub screen disappears due to a specific signal input during a video call.

FIG. 11A illustrates a state in which a first partner and a second partner are displayed on a main screen and a sub screen during a multi-party video call. The controller 180 may receive a specific touch signal in the state as shown in FIG. 11A to make the sub screen disappear and display the counterpart image only on the main screen. For example, in a state as shown in FIG. 11A, when a specific touch of the main screen on which the first counterpart is displayed is input, the controller 180 may make the sub screen disappear and display only the first counterpart image on the main screen. In addition, when a specific touch of the main screen on which the second counterpart is displayed is input in the state as illustrated in FIG. 11A, the controller 180 may make the sub screen disappear and display only the second counterpart image on the main screen.

FIG. 12 is a diagram illustrating that images displayed on a main screen and a sub screen are interchanged with each other by input of a specific signal during a video call.

As shown, the user may touch and drag the first opponent image displayed on the main screen to the sub screen, and vice versa, the user may touch and drag the second opponent image displayed on the sub screen to the main screen (FIG. 12A). . The controller 180 may recognize the drag as a mutual replacement signal of the image, display the second counterpart image on the main screen, and display the first counterpart image on the sub screen (FIG. 12B).

Meanwhile, according to an embodiment of the present invention, when a specific touch is input to the main screen or the sub screen, the mobile terminal 100 may perform a function related to the touched screen. 13 shows such an example.

As shown, the controller 180 displays a menu window for performing a function related to the main screen when a specific touch of the main screen is input (FIG. 13A), and when a touch specific to the sub screen is input, associated with the sub screen. A menu window capable of performing a function may be displayed (FIG. 13B).

For example, if a touch is maintained on the main screen for a predetermined time (for example, when long touch is made), a menu window for performing a function related to the main screen is displayed. When "SMS" is selected through the menu window, the controller 180 can execute an application that can transmit a short message to the first party. On the contrary, if a touch is maintained for a predetermined time on the sub screen (for example, when long touch is made), a menu window for performing a function related to the sub screen is displayed. When "SMS" is selected through the menu window, the controller 180 can execute an application that can transmit a short message to the second party.

In addition, when “MMS” is selected, the controller 180 can transmit a message to the counterpart displayed on the screen on which the specific touch is made through MMS. In addition, when “E-mail” is selected, the controller 180 may transmit specific data to the other party displayed on the screen on which the specific touch is made through ㄸ -mail. In addition, when the "change property" is selected, the controller 180 can change the screen style, color, black and white.

14 illustrates an example in which the size or shape of a sub screen is changed by a specific touch input during a video call in a mobile terminal according to an embodiment of the present invention.

14A illustrates an example of changing the size of the sub screen when the edge of the sub screen is touched and dragged. That is, when the edge of the sub screen is touched and dragged by the user, the controller 180 changes the size of the sub screen in consideration of the dragged degree. The second counterpart image may be displayed according to the changed size of the sub screen.

14B illustrates an example of changing the shape of the sub screen when a specific portion of the sub screen is touched and dragged. As illustrated, the controller 180 may change the shape of the sub screen from a rectangle to an ellipse when a specific portion of the sub screen is touched and dragged by the user. In this case, the second counterpart image is displayed according to the changed sub screen shape.

15 is a diagram illustrating an example of synthesizing an image displayed on a main screen and an image displayed on a sub screen during a video call.

FIG. 15A illustrates a screen on which a first opponent image is displayed on a main screen and a substitute image is displayed on a sub screen. In this case, the sub screen may change its size in the same manner as in FIG. 14A. In this case, the controller 180 may adjust the transparency of the substitute image displayed on the sub screen. The controller 180 may overlap the first counterpart image by changing the position of the sub screen whose transparency is adjusted (see FIG. 10). In addition, the controller 180 may synthesize an image in which the first counterpart image and the substitute image overlap with one image. Such an example is shown in FIG. 15B.

Of course, the image composition may be applied even when the second counterpart image is displayed on the sub screen.

In addition, according to an embodiment of the present invention, the above-described method may be embodied as computer readable codes on a medium in which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like, which are also implemented in the form of carrier waves (eg, transmission over the Internet). It also includes. In addition, the computer may include the controller 180 of the terminal.

The mobile terminal capable of a video call with a plurality of counterparts described above is not limited to the configuration and method of the above-described embodiments, but the embodiments may be all or part of each embodiment so that various modifications may be made. May be optionally combined.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

2 is a front perspective view of a mobile terminal according to an embodiment of the present invention.

3 is a rear perspective view of a mobile terminal according to an embodiment of the present invention.

4 is a block diagram of a wireless communication system capable of operating a mobile terminal according to an embodiment of the present invention.

5 is a flowchart illustrating a screen display method of a mobile terminal according to an embodiment of the present invention.

6 to 9 illustrate examples of a screen configuration method during a video call in a mobile terminal according to an embodiment of the present invention.

10 to 15 illustrate an example of a method of controlling a screen during a video call in a mobile terminal according to an embodiment of the present invention.

Claims (15)

A mobile terminal capable of conducting a video call with a plurality of counterparts, A camera for taking an image; A wireless communication unit for data communication; A display unit configured to display a main screen on which a first counterpart image is displayed and at least one subscreen on which a second counterpart image is displayed in the main screen during a video call; And And a controller for controlling the sub screen to be displayed in the main screen. The method of claim 1, wherein the control unit And when a specific signal is input, the second counterpart image displayed on the sub screen may be replaced with another image. The display apparatus of claim 2, wherein the display unit comprises a touch screen, The specific signal input is a mobile terminal, characterized in that the touch input of the touch screen. The method of claim 3, wherein the control unit When the second video call is made by receiving a call signal for the second video call from the other party who is performing the first video call, the other party's video for the second video call is displayed on the main screen. Mobile terminal. The method of claim 4, wherein the control unit When the call signal for the second video call is received from the counterpart who is performing the first video call, the mobile terminal may select a counterpart to participate in the second video call among the first video call participants. . The method of claim 2, wherein the control unit And a video of the current speaker is displayed on the main screen. The method of claim 2, wherein the control unit And when a specific signal is input, the image displayed on the main screen and the image displayed on any one of the displayed sub screens may be interchanged with each other. The display device of claim 7, wherein the display unit comprises a touch screen. When a specific signal is input through a touch input of the touch screen, the controller is configured to swap an image displayed on the main screen and an image displayed on any one of the displayed sub screens with each other. terminal. The method of claim 8, wherein the control unit When the sub screen is dragged through the touch, moving the position of the touched sub screen in the main screen, adjusting the size of the touched sub screen in the main screen, within the main screen And rotating at least one of the touched sub-screens and changing a shape of the touched sub-screens in the main screen. The method of claim 8, wherein the control unit When a specific touch input is performed through any one of the sub screen or the main screen displayed on the touch screen, a menu window for performing a function related to the screen on which the specific touch input is performed is displayed. Mobile terminal. The method of claim 10, wherein the function related to the screen on which the specific touch input is performed is And a data communication performed with a counterpart on which an image is displayed on a screen on which the touch input is performed. 12. The method of claim 11, wherein said data communication is Mobile terminal, characterized in that performed via any one of MMS, SMS, email, Bluetooth. The method of claim 10, wherein the function related to the screen on which the specific touch input is performed is And a function of changing a property of a screen on which the touch input is performed. Displaying a main screen on which a first opponent video is displayed during a video call; And And displaying at least one sub-screen on which the second counterpart image is displayed in the main screen. The method of claim 14, wherein the screen display method of the mobile terminal is And replacing a second counterpart image displayed on the sub screen with another image when a specific signal is input.

Images