KR101924406B1 - Mobile terminal and control method for mobile terminal - Google Patents

Abstract

The present invention relates to a mobile terminal and a control method of the mobile terminal.
In the present invention, the mobile terminal transmits and receives status information related to a video call during a video call connection process, and controls the operation of the mobile terminal related to the stereoscopic video call based on the video call related status information transmitted and received.

Description

[0001] The present invention relates to a mobile terminal and a control method for a mobile terminal,

The present invention relates to a mobile terminal and a control method of the mobile terminal.

A terminal can be divided into a mobile terminal and a stationary terminal depending on whether the terminal is movable. Again, the mobile terminal may be divided into a handheld terminal and a vehicle mount terminal according to whether the user can carry the mobile phone directly.

Recently, as the service provided by the mobile terminal has diversified, it is considered to improve the structural part and / or the software part of the terminal.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a mobile terminal capable of a stereoscopic video call and a control method of the mobile terminal.

A mobile terminal according to one aspect of the present invention includes: a wireless communication unit for connecting to another mobile terminal; At least one camera for acquiring an external image; And receiving status information related to a video call of the other mobile terminal when the video call is connected to the other mobile terminal, receiving at least one of a stereoscopic image and a two-dimensional image based on the received status information, And a controller for controlling the camera and transmitting an image obtained through the at least one camera to the other mobile terminal.

According to another aspect of the present invention, there is provided a mobile terminal including: a wireless communication unit for connecting to another mobile terminal; A display module; At least one camera for acquiring an external image; And when the video call is requested from the other mobile terminal, selects one of a two-dimensional video call mode and a stereoscopic video call mode, and transmits state information including information on the selected video call mode to the other mobile terminal And a controller for controlling the display module and the at least one camera to operate in the selected video communication mode.

According to another aspect of the present invention, there is provided a method of controlling a mobile terminal, the method comprising: requesting a video call to another mobile terminal; Receiving status information of the other mobile terminal related to the video call from the other mobile terminal; Analyzing the received status information to obtain information on which of the stereoscopic video communication mode and the two-dimensional video communication mode the other mobile terminal operates in the video communication mode; And transmitting the one of the two-dimensional image and the stereoscopic image to the other mobile terminal based on the video communication mode of the other mobile terminal.

According to another aspect of the present invention, there is provided a method of controlling a mobile terminal, including: receiving a video call request from another mobile terminal; Selecting one of a two-dimensional video communication mode and a stereoscopic video communication mode; Transmitting status information including information of the selected video call mode to the other mobile terminal; And displaying the image received from the other mobile terminal as a stereoscopic image or a two-dimensional image based on the selected video communication mode.

The mobile terminal and the control method of the mobile terminal according to the present invention can transmit and receive the video call related information with the counterpart mobile terminal during the video call connection process and efficiently control the video call related operation of the mobile terminal based on the information.

1 is a block diagram of a mobile terminal according to embodiments of the present invention.
2 and 3 are views for explaining a stereoscopic image displaying method using a binocular parallax according to embodiments of the present invention.
4 to 7 are views for explaining the appearance of a mobile terminal according to embodiments of the present invention.
8 is a flowchart illustrating a method for requesting a 3D video call of the mobile terminal 100 according to an exemplary embodiment of the present invention.
9 shows an example of a SIP message including video call related status information of the mobile terminal 100 according to an embodiment of the present invention.
10 is a flowchart illustrating a method for selecting whether to change a video call mode when the other mobile terminal operates in a video communication mode different from the video communication mode of the mobile terminal 100 in the mobile terminal 100 according to an embodiment of the present invention. And shows an example of a screen.
11 is a view illustrating an example of a screen for selecting an image displayed on a screen when the mobile terminal 100 receives a stereoscopic image in a two-dimensional video communication mode according to an embodiment of the present invention.
12 to 17 illustrate examples of selecting an image to be transmitted to a counterpart mobile terminal in a case where the mobile terminal 100 operates in a video call mode different from that of the counterpart mobile terminal according to an embodiment of the present invention.
18 is a flowchart illustrating a stereoscopic video call receiving method of the mobile terminal 100 according to an embodiment of the present invention.
19 is a diagram for explaining a stereoscopic video call receiving method of the mobile terminal 100 according to an embodiment of the present invention.
20 is a flowchart illustrating a method for requesting a two-dimensional video call of the mobile terminal 100 according to an embodiment of the present invention.
FIG. 21 is a flowchart illustrating a method for receiving a two-dimensional video call of the mobile terminal 100 according to an embodiment of the present invention.
22 is a flowchart illustrating a method for changing a video call mode by a user's request during a video call in the mobile terminal 100 according to an embodiment of the present invention.
23 shows an example of a screen for changing a video communication mode by a user's request during a video call in the mobile terminal 100 according to an embodiment of the present invention.
FIG. 24 is a flowchart illustrating a method of controlling an operation of a mobile terminal according to a change of a video call mode of a counterpart mobile terminal during a video call in the mobile terminal 100 according to an exemplary embodiment of the present invention.
FIG. 25 shows an example of a screen for guiding a video call mode of a counterpart mobile terminal to be changed in the mobile terminal 100 according to an embodiment of the present invention.
FIG. 26 is a flowchart illustrating a method for displaying video call-related status information of a calling party on a screen according to a request of a user during a video call in the mobile terminal 100 according to an exemplary embodiment of the present invention.
FIG. 27 shows an example of a screen for displaying video call related status information in the mobile terminal 100 according to an embodiment of the present invention.
28 is a flowchart illustrating a method of displaying a stereoscopic video call connection button in the mobile terminal 100 according to an embodiment of the present invention.
29 and 30 are views for explaining a method of displaying a stereoscopic video call connection button in the mobile terminal 100 according to an embodiment of the present invention.
FIG. 31 illustrates an example of a screen for guiding a stereoscopic video call to the other party supporting the stereoscopic video call function in the mobile terminal 100 according to an exemplary embodiment of the present invention.

The above objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. It is to be understood, however, that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and similarities. Like reference numerals designate like elements throughout the specification. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. In addition, numerals (e.g., days, days, etc.) used in the description of the present invention are merely an identifier for distinguishing one component from another component

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

In addition, the suffix "module" and " part "for constituent elements used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) .

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a mobile terminal according to embodiments of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in Fig. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of a DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of a DVBH (Digital Video BroadcastHandheld).

The broadcast receiving module 111 receives a broadcast signal using various broadcasting systems. In particular, the broadcast receiving module 111 may be a digital multimedia broadcasting broadcasting (DMBT), a digital multimedia broadcasting satellite (DMBS), a media forward link only (MediaFLO), a digital video broadcasting ), And ISDBT (Integrated Services Digital Broadcast Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems that provide broadcast signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 refers to a module for wireless Internet access, and the wireless Internet module 113 can be embedded in the mobile terminal 100 or externally. WLAN (WiFi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. A typical example of the location information module is a GPS (Global Position System) module. According to the current technology, the GPS module 115 calculates information on a distance (distance) from three or more satellites to one point (object), information on the time when the distance information is measured, , It is possible to calculate three-dimensional position information according to latitude, longitude, and altitude of one point (individual) in one hour. Further, a method of calculating position and time information using three satellites and correcting the error of the calculated position and time information using another satellite is also used. The GPS module 115 continues to calculate the current position in real time and uses it to calculate speed information.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display module 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. In addition, it may be responsible for a sensing function related to whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating output related to visual, auditory or tactile sense and includes a display module 151, an acoustic output module 152, an alarm unit 153, and a haptic module 154 .

The display module 151 displays information processed by the mobile terminal 100. For example, when the mobile terminal 100 is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display module 151 may be a liquid crystal display, a thin film transistor liquid crystal display, an organic light emitting diode, a flexible display, a 3D display And may include at least one.

Some of these displays may be transparent or light transmissive so that they can be seen through. This may be referred to as a transparent display. A typical example of the transparent display is a transparent LCD or the like. The rear structure of the display module 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display module 151 of the terminal body.

There may be two or more display modules 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display modules may be spaced apart or integrally arranged on one surface, and may be disposed on different surfaces, respectively.

In a case where the display module 151 and the sensor for sensing the touch operation (hereinafter, referred to as 'touch sensor') have a mutual layer structure (hereinafter referred to as 'touch screen' It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display module 151 or a capacitance generated in a specific portion of the display module 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display module 151 is touched or the like.

Referring to FIG. 1, a proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is surrounded by the touch screen. The proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface or an object existing in the vicinity of the detection surface without mechanical contact using an electromagnetic force or an infrared ray. The proximity sensor 141 has a longer life than the contact type sensor and its utilization is also high.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 outputs an acoustic signal related to a function (e.g., a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or audio signal may also be output through the display module 151 or the audio output module 152.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may be configured to perform various functions such as an effect of stimulation by a pin arrangement vertically moving with respect to a contact skin surface, an effect of stimulation by air spraying force or suction force through a jet opening or a suction opening, A variety of tactile effects such as an effect of stimulation through contact of an electrode, an effect of stimulation by an electrostatic force, and an effect of reproducing a cold sensation using a heat absorbing or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to feel the tactile effect through the muscles of the user's finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM At least one of a random access memory (RAM), a static random access memory (SRAM), a read only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read- Type storage medium. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM) (Universal Subscriber Identity Module, USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, microcontrollers, microprocessors, and electrical units for performing functions. In some cases such embodiments may be implemented using a controller 180 < / RTI >

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. In addition, the software codes may be stored in the memory 160 and executed by the control unit 180. [

2 and 3 are views for explaining a stereoscopic image displaying method using a binocular parallax according to embodiments of the present invention. FIG. 2 shows a method using a lenticular lens array, and FIG. 3 shows a method using a parallax barrier.

Binocular parallax is the difference between the left eye and right eye view of a person. When synthesizing the image seen through the left eye and the image seen through the right eye in the human brain, the synthesized image makes a person feel stereoscopic.

Hereinafter, a phenomenon in which a person perceives a stereoscopic effect according to a binocular disparity is referred to as 'stereoscopic vision', and an image causing stereoscopic vision is referred to as a 'stereoscopic image'. In addition, when a specific object included in an image causes stereoscopic vision, the object is referred to as a 'stereoscopic object'.

The stereoscopic image display method according to the binocular disparity can be classified into a spectacle type requiring special glasses and a non-eye type requiring no glasses.

The spectacle type includes a method using a sunglass having wavelength selectivity, a polarized spectacle method using a shading effect according to a polarization difference, and a time-division spectacle method in which right and left images are alternately presented in a residual image time of the eye. In addition, there is a method of mounting a filter having a different transmittance in each of the right and left eyes to obtain a three-dimensional effect on the movement in the left and right direction in accordance with the time difference of the visual system from the difference in transmittance.

In addition, a parallax barrier system, a lenticular lens system, or a microlens array system is used for a non-eye-safety system in which a stereoscopic effect is generated on the side of the image display surface other than the observer.

Referring to FIG. 2, the display module 151 includes a lenticular lens array 11a to display a stereoscopic image. The lenticular lens array 11a is constituted by a pixel L to be input to the left eye 12a and a pixel R to be input to the right eye 12b are alternately arranged along the lateral direction and the display surface 13 and the left and right eyes 12a, 12b and provides optical discrimination directivity for a pixel L to be input to the left eye 12a and a pixel R to be input to the right eye 12b. Accordingly, the image of the human eye, which has passed through the lenticular lens array 11a, is separated and observed from the left eye 12a and the right eye 12a, and the human brain displays the image viewed through the left eye 12a and the image viewed through the right eye 12b And the stereoscopic image is observed.

Referring to FIG. 3, in order to display a stereoscopic image, the display module 151 includes a parallax barrier 11b having a vertical grid shape. The parallax barrier 11b includes a pixel L to be inputted to the left eye 12a and a pixel R to be inputted to the right eye 12b are alternately arranged along the horizontal direction and the display surface 13 and the left and right eyes 12a, 12b so that the images are separated from the left eye 12a and the right eye 12b through an aperture of a vertical grid. Therefore, the human brain combines the image viewed through the left eye 12a and the image viewed through the right eye 12b to observe the stereoscopic image. This parallax barrier 11b is turned on only when it is desired to display a stereoscopic image and separates the incident time. When the flat image is to be displayed, the parallax barrier 11b is turned off so that the incident time can be passed without being separated have.

Meanwhile, the stereoscopic image display methods described above are for illustrating embodiments of the present invention, and the present invention is not limited thereto. The present invention can display stereoscopic images using binocular parallax using various methods in addition to the above-described methods.

4 to 7 are views for explaining the appearance of a mobile terminal according to embodiments of the present invention.

4 and 5 are perspective views seen from the front of examples of mobile terminals related to embodiments of the present invention.

Referring to FIG. 4, the mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are movably coupled to each other.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding a synthetic resin, or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti) or the like.

A display module 151, an audio output module 152, a camera 121, user inputs 130/131 and 132, a microphone 122, an interface 170, and the like may be disposed in the front body 101 have.

The display module 151 occupies most of the main surface of the front case 101. An audio output module 152 and a camera 121 are disposed in an area adjacent to one end of the display module 151 and a user input part 131 and a microphone 122 are disposed in an area adjacent to the other end . The user input unit 132, the interface 170, and the like are disposed on the side surfaces of the front case 101 and the rear case 102.

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100 and may include a plurality of operation units 131 and 132.

The operation units 131 and 132 may be collectively referred to as a manipulating portion and may be employed in any manner as long as the user operates in a tactile manner.

The contents input by the operation units 131 and 132 can be variously set. For example, the operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output module 152, And a switch to the touch recognition mode.

FIG. 5 shows an example in which the number of cameras disposed on the front surface of the mobile terminal 100 and the terminal body shown in FIG. 4 are different. Referring to FIG. 5, a plurality of cameras 121a and 121b may be provided on a front surface of a terminal body.

Figs. 6 and 7 are rear perspective views of examples of mobile terminals related to embodiments of the present invention. Fig.

Referring to FIG. 6, a camera 121 'may be further mounted on the rear surface of the terminal body, that is, the rear case 102. The camera 121 'has a photographing direction substantially opposite to that of the cameras 121 / 121a and 121b (see FIGS. 2 and 3) disposed in the front case 101, / 121a, 121b, respectively.

A power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the terminal body or may be detachable from the outside of the terminal body.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may also be of a light transmission type like the display module 151. In this case, if the display module 151 is configured to output time information on both sides, the time information can be recognized through the touch pad 135 as well. The information output on both sides may be all controlled by the touch pad 135. [ Alternatively, a display may be additionally mounted on the touch pad 135, and a touch screen may be disposed on the rear case 102.

The touch pad 135 operates in correlation with the display module 151 of the front case 101. [ The touch pad 135 may be disposed parallel to the rear of the display module 151. The touch pad 135 may have a size equal to or smaller than that of the display module 151.

FIG. 7 shows an example in which the number of the mobile terminals 100 shown in FIG. 6 and the number of cameras disposed on the rear surface of the terminal body are different. Referring to FIG. 7, a plurality of cameras 121'a and 121'b may be provided on the rear surface of the body.

Figs. 4 to 7 show examples of the appearance of a mobile terminal according to the embodiments of the present invention, and the present invention is not limited thereto. The present invention is applicable even when the arrangement position of the camera is different from the examples shown in Figs.

Embodiments disclosed in this document can be implemented in the mobile terminal 100 described with reference to Figs. Hereinafter, embodiments of the present invention will be described.

According to embodiments of the present invention, the display module 151 may include a panel for implementing stereoscopic vision. As described above, the panel may have a structure for implementing stereoscopic vision by any one of a lenticular lens system and a parallax barrier system.

In addition, according to embodiments of the present invention, the mobile terminal 100 may include a plurality of cameras on at least one of a front surface and a rear surface so that stereoscopic image capturing is possible.

On the other hand, according to one embodiment of the present invention, the mobile terminal 100 may not have a plurality of cameras on either the front side or the rear side. In this case, the multimedia module 181 may convert a two-dimensional image input through one camera 121 or 121 'disposed on the front or rear surface into a stereoscopic image.

Hereinafter, for the sake of convenience of explanation, a camera for capturing a left image corresponding to a left eye image is called a 'left image camera' and a right image corresponding to a right eye image is used for a stereoscopic image generation Is used as a 'right image camera'.

In addition, a camera located on the front of the terminal body is referred to as a 'front camera', and a camera located on the rear side of the terminal body is referred to as a 'rear camera'.

Hereinafter, a video call method of a mobile terminal according to an embodiment of the present invention and an operation of the mobile terminal 100 for implementing the method will be described in detail with reference to necessary drawings.

8 is a flowchart illustrating a method for requesting a 3D video call of the mobile terminal 100 according to an exemplary embodiment of the present invention. 9 to 13 are views for explaining a method of requesting a 3D video call of the mobile terminal 100 according to an embodiment of the present invention. The steps shown in FIG. 8 are not essential, so that the method of requesting a stereoscopic video call of the mobile terminal 100 according to an embodiment of the present invention may have more configuration steps than those shown in FIG. 8, .

Referring to FIG. 8, the controller 180 requests a stereoscopic video call to the other party's mobile terminal through the wireless communication unit 110 in response to a request for a stereoscopic video call to a specific partner through the user input unit 130 (S101 ).

According to an embodiment of the present invention, the control unit 180 may transmit the status information of the mobile terminal 100 in association with the video call when the receiving mobile terminal 100 requests the stereoscopic video call.

The status information of the mobile terminal 100 transmitted to the receiving mobile terminal may include display status information of the mobile terminal 100. [

The display state information indicates whether the display module 151 of the mobile terminal 100 supports the stereoscopic image display function or the display module 151 operates in either the stereoscopic image display mode or the two- And the like.

The stereoscopic image display mode is a display mode in which a stereoscopic image is displayed on the screen by activating a panel for realizing stereoscopic vision provided in the display module 151. Further, the two-dimensional image display mode represents a display mode in which a two-dimensional image is displayed on the screen by deactivating the panel for stereoscopic implementation.

In addition, the status information of the mobile terminal 100 transmitted to the receiving-side mobile terminal in relation to the video call may include the camera status information of the mobile terminal 100. [

The camera status information may include information about a camera used for video communication in the mobile terminal 100. [

For example, the mobile terminal 100 may include information on whether to use a plurality of cameras (a left image camera and a right image camera) or a single camera for video communication.

In addition, for example, the mobile terminal 100 may include information on whether to use a camera located at the front of the body or a camera located at the rear of the body for a video call.

The status information of the mobile terminal 100 transmitted to the receiving mobile terminal may include information on the current video communication mode of the mobile terminal 100 in connection with the video call.

For example, the mobile terminal 100 may include information on whether the mobile terminal 100 is currently operating in a stereoscopic video communication mode or a two-dimensional video communication mode.

In addition, regarding the video call, the status information of the mobile terminal 100 transmitted to the receiving-side mobile terminal may be information indicating the depth of the transmitted stereoscopic image when the image transmitted from the mobile terminal 100 to the counterpart mobile terminal is a stereoscopic image It may also include a depth. The depth value of the stereoscopic image can be changed according to the position of synthesis of the left image and the right image.

Meanwhile, the status information of the mobile terminal 100 transmitted to the receiving-side mobile terminal with respect to the video call can be implemented as a separate message and transmitted.

In addition, the status information of the mobile terminal 100 transmitted to the receiving mobile terminal with respect to the video call may be inserted into the message requesting the stereoscopic video call to the receiving mobile terminal and transmitted.

For example, when a video call with another mobile terminal is connected using a Session Initiation Protocol (SIP), the controller 180 controls the state of the mobile terminal 100 related to the video call Information can be included in the SIP message and transmitted.

9 shows an example of an SIP message including status information of the mobile terminal 100 related to a video call.

9, a SIP message may include a METHODS F1, a HEADER F2, a BLANK LINE F3, a MESSAGE BODY F4, and the like .

The method F1 marks the START LINE of the SIP message and may include the message type, the version of the request ID SIP, and so on.

The header F2 may include the address of the passing node (PATH), the address of the sender's recipient, the sequence number indicating how many times it has been connected to the same address, and the TTL (Time To Live).

Blank line F3 represents the boundary between the header and the message body.

The message body F4 carries the contents of the message and attribute values necessary for communication.

The status information of the mobile terminal 100 transmitted to the receiving mobile terminal in relation to the video call may be included in the message body F4 and transmitted.

For example, when the display module 151 of the mobile terminal 100 supports the stereoscopic image display function, information F41 indicating that the display module type (LCD type) of the mobile terminal 100 is a stereoscopic image display type Message body F4.

For example, when the mobile terminal 100 has a left image camera and a right image for stereoscopic image acquisition, information indicating that the camera type of the mobile terminal 100 is a stereoscopic image acquisition type (F42 May be included in the message body F4.

For example, when the camera used for the video communication is a camera disposed on the front side of the mobile terminal 100, information F43 indicating the camera position used for video communication is transmitted to the message body F4 ).

For example, when the mobile terminal 100 operates in the stereoscopic video communication mode, the information F44 indicating that the current video communication mode (VT Type) of the mobile terminal 100 is the stereoscopic video communication mode is the message body F4.

For example, when the display module 151 of the mobile terminal 100 operates in the stereoscopic image display mode, information F45 indicating that the display mode of the mobile terminal 100 is the stereoscopic image display mode, May be included in the message body F4.

FIG. 9 shows an example of an SIP message including status information of the mobile terminal 100 transmitted to a receiving-side mobile terminal in relation to a video call, and the present invention is not limited thereto. According to the present invention, a SIP message can be implemented to include more or less state information in association with a video call.

8, when the video call is accepted from the receiving-side mobile terminal (S102), the controller 180 receives the status information of the receiving-side mobile terminal related to the video call through the wireless communication unit 110 (S103) .

In connection with the video call, the status information of the receiving-side mobile terminal received from the receiving-side mobile terminal may be configured similar to the status information of the mobile terminal 100 transmitted together with the request for the stereoscopic video call in the above-described step S101 .

In connection with the video call, the status information of the receiving-side mobile terminal received from the receiving-side mobile terminal may include display status information of the receiving-side mobile terminal.

The display state information indicates whether the display module 151 of the receiving-side mobile terminal supports the stereoscopic image display function or whether the display module 151 operates in the stereoscopic image display mode or the two-dimensional image display mode And so on.

Also, regarding the video call, the status information of the receiving-side mobile terminal received from the receiving-side mobile terminal may include the camera status information of the receiving-side mobile terminal.

Also, regarding the video call, the status information of the receiving-side mobile terminal received from the receiving-side mobile terminal may include information on the current video communication mode of the receiving-side mobile terminal.

When the image transmitted from the receiving-side mobile terminal to the mobile terminal 100 is a stereoscopic image, the status information of the receiving-side mobile terminal, which is received from the receiving-side mobile terminal, depth).

Meanwhile, regarding the video call, the status information of the receiving-side mobile terminal received from the receiving-side mobile terminal may be transmitted as a separate message and transmitted.

Also, regarding the video call, the status information of the receiving-side mobile terminal received from the receiving-side mobile terminal may be inserted and transmitted in a message indicating the acceptance of the stereoscopic video call of the receiving-side mobile terminal.

For example, it may be included in the SIP message and transmitted as shown in FIG. 9, which is transmitted and received in the video communication process between the receiving side mobile terminal and the mobile terminal 100.

8, the controller 180 receiving the status information of the receiving-side mobile terminal analyzes the received status information of the receiving-side mobile terminal, thereby analyzing the operation status of the other-side mobile terminal related to the video call Check.

For example, the control unit 180 can confirm whether the receiving-side mobile terminal supports the stereoscopic image display function.

In addition, for example, the controller 180 can confirm whether the video display mode of the receiving-side mobile terminal is the stereoscopic video display mode or the two-dimensional video display mode.

In addition, for example, the control unit 180 can confirm whether the receiving-side mobile terminal includes a left image camera and a right image camera necessary for stereoscopic image shooting.

In addition, for example, the control unit 180 can confirm whether the receiving-side mobile terminal performs the video call using the camera positioned on either the front or the back of the body.

For example, the controller 180 can check whether the receiving mobile terminal is operating in a stereoscopic video communication mode or a two-dimensional video communication mode.

In addition, for example, when the receiving-side mobile terminal transmits the stereoscopic image, the controller 180 can confirm the depth value of the received stereoscopic image.

As a result of analyzing the received state information of the counterpart mobile terminal, if the counterpart mobile terminal operates in the stereoscopic video communication mode (S104), the controller 180 controls the mobile terminal 100 to operate in the stereoscopic video communication mode S106).

On the other hand, when the counterpart mobile terminal operates in the two-dimensional video call mode (S104), the controller 180 instructs the user that the counterpart mobile terminal operates in the two-dimensional video call mode. When the user requests to change the video communication mode to operate in the two-dimensional video communication mode as in the counterpart mobile terminal (S105), the mobile terminal 100 is controlled to operate in the two-dimensional video communication mode (S107).

 On the other hand, if the change of the video call mode is not requested by the user, the controller 180 controls the mobile terminal 100 to operate in the current video communication mode, i.e., the stereoscopic video communication mode (S106).

In the above-described step S105, when the counterpart mobile terminal selects a video communication mode, i.e., a two-dimensional video communication mode, different from the video communication mode requested by the mobile terminal 100, To the same video call mode as the video call mode.

10 shows an example of a screen for selecting whether or not to change the video communication mode when the counterpart mobile terminal operates in a video communication mode different from the video communication mode of the mobile terminal 100. [

Referring to FIG. 10, the controller 180 transmits a message (W10) indicating that the other party mobile terminal has selected a two-dimensional video call in response to a request for a stereoscopic video call and the other party mobile terminal operates in a two- Display for a certain period of time on the screen.

In addition, the control unit 180 displays a selection button B10 on the screen together with the message W10 to select whether to switch to the two-dimensional video communication mode in the same manner as the counterpart mobile terminal.

The user can select whether or not to switch the video communication mode by using the selection button B10. For example, when the user selects the '2D' button B10, the control unit 180 can change the video call mode in the two-dimensional video call mode.

On the other hand, FIG. 10 shows an example of selecting whether to switch to the same video call mode as that of the counterpart mobile terminal based on the selection input of the user when the counterpart mobile terminal selects a video call mode different from the video call mode requested by the mobile terminal 100 And the present invention is not limited thereto.

According to the present invention, when the counterpart mobile terminal selects a video call mode different from the video call mode requested by the mobile terminal 100, the control unit 180 can automatically determine whether the video call mode is changed based on the preset setting information have. In this case, the related setting information may be set by the user using a menu related to the video call.

Also, according to the present invention, the control unit 180 may maintain the current video communication mode of the mobile terminal 100 even if the other mobile terminal selects a video communication mode different from the video communication mode requested by the mobile terminal 100. [

In step S106, the stereoscopic video communication mode is a mode for performing a video communication by displaying a video image received from a counterpart and an image obtained by the mobile terminal 100 as a stereoscopic image.

In the mobile terminal 100 operating in the stereoscopic video communication mode, the display module 151 operates in the stereoscopic image display mode. That is, a panel for stereoscopic implementation is activated. Also, the controller 180 controls the multimedia module 181, the display module 151, and the like so that the image received from the counterpart mobile terminal is displayed as a stereoscopic image.

For example, when the stereoscopic image is received from the counterpart mobile terminal, the controller 180 may display the received stereoscopic image on the screen in the stereoscopic image display mode.

When the two-dimensional image is received from the other mobile terminal, the controller 180 converts the two-dimensional image received through the multimedia module 181 into a stereoscopic image, Can be displayed on the screen in the stereoscopic image display mode.

On the other hand, based on the state information of the counterpart mobile terminal received in step S103, the controller 180 can confirm whether the image received from the counterpart mobile terminal is a stereoscopic image or a two-dimensional image.

In the mobile terminal 100 operating in the stereoscopic video communication mode, the controller 180 determines whether to transmit the two-dimensional image to the counterpart mobile terminal based on the state information of the counterpart mobile terminal, the user's selection input, predetermined setting information, It is possible to select whether or not to transmit the image. In addition, it controls the camera 121/121 'or 121a / 121'a and 121b / 121'b, the multimedia module 181, etc. to acquire the selected image.

For example, if the counterpart mobile terminal is operating in a stereoscopic video communication mode or a stereoscopic image display mode, the controller 180 controls the cameras 121/121 'or 121a / 121'a and 121b / 121'b ) Or the multimedia module 181. Also, the obtained stereoscopic image is transmitted to the counterpart mobile terminal.

In addition, for example, if the counterpart mobile terminal is operating in a two-dimensional video communication mode or a two-dimensional video display mode, the controller 180 controls the camera (e.g., 121/121 'or 121a / 121'a and 121b / 121'b) or the multimedia module 181. Also, the acquired image is transmitted to the counterpart mobile terminal.

For example, if the counterpart mobile terminal is operating in a two-dimensional video communication mode or a two-dimensional video display mode, the controller 180 controls the camera 121 / 121 'or 121a / 121'a and 121b / 121'b) or the multimedia module 181. Also, the acquired image is transmitted to the counterpart mobile terminal.

A method of selecting an image to be transmitted to a counterpart mobile terminal based on a user's selection input, predetermined setting information, and the like in the mobile terminal 100 operating in a stereoscopic image mode will be described in more detail with reference to FIGS. 12 to 14 Explain.

In step S107, the two-dimensional video communication mode represents a mode for performing video communication by displaying a video received from the other party and an image obtained by the mobile terminal 100 as a two-dimensional video.

In the mobile terminal 100 operating in the two-dimensional video communication mode, the display module 151 operates in a two-dimensional video display mode. That is, the panel operates in a state in which the panel for stereoscopic implementation is inactivated. Also, the controller 180 controls the multimedia module 181, the display module 151, and the like so that an image received from the counterpart mobile terminal is displayed as a two-dimensional image.

For example, when a two-dimensional image is received from a counterpart mobile terminal, the controller 180 may display the received two-dimensional image in a two-dimensional image display mode.

In addition, for example, when the stereoscopic image is received from the counterpart mobile terminal, the controller 180 converts the stereoscopic image received through the multimedia module 181 into a two-dimensional image, The image can be displayed on the screen in the two-dimensional image display mode.

When the stereoscopic image is received, the multimedia module 181 can convert a stereoscopic image into a two-dimensional image by acquiring a left image or a right image, which is a two-dimensional image, from the received stereoscopic image. Whether the left image or the right image is used to generate the two-dimensional image may be selected by the user.

11, when the two-dimensional image display mode is selected, the control unit 180 transmits a message W11 indicating that the other-side mobile terminal has transmitted the stereoscopic image as the other-side mobile terminal transmits the stereoscopic image to the screen Display.

In addition, the control unit 180 displays selection buttons B11a to B19c for selecting an image displayed on the screen.

Accordingly, the user can control the selection buttons B11a to B11c to select which image to display as the image of the opposite mobile terminal.

For example, when the user selects the 'LEFT' button B11a, the controller 180 may acquire the left image from the received stereoscopic image and display it on the screen as the image of the opposite mobile terminal.

Also, for example, when the user selects the 'RIGHT' button B11b, the controller 180 may acquire a right image from the received stereoscopic image and display the right image on the screen as the image of the opposite mobile terminal.

In addition, for example, when the user selects the '3D' button B11c, the controller 180 can display the received stereoscopic image on the screen as the image of the counterpart mobile terminal. Here, as the controller 180 operates in the two-dimensional display mode, the controller 180 may display the stereoscopic image on the screen with the panel for stereoscopic implementation disabled. That is, the combined image of the left image and the right image can be displayed on the screen without a panel for stereoscopic implementation.

In the mobile terminal 100 operating in the two-dimensional video communication mode, the controller 180 determines whether to transmit the two-dimensional image to the counterpart mobile terminal based on the state information of the counterpart mobile terminal, the user's selection input, It is possible to select whether to transmit a stereoscopic image. In addition, it controls the camera 121/121 'or 121a / 121'a and 121b / 121'b, the multimedia module 181, etc. to acquire the selected image.

For example, if the counterpart mobile terminal is operating in a two-dimensional video communication mode or a two-dimensional video display mode, the controller 180 controls the cameras 121/121 'or 121a / 121'a and 121b / 121'b) or the multimedia module 181. Also, the obtained two-dimensional image is transmitted to the counterpart mobile terminal.

In addition, for example, when the counterpart mobile terminal is operating in the stereoscopic video communication mode or the stereoscopic image display mode, the controller 180 controls the camera 121 / 121 'or 121a / 121'a and 121b / 121'b) or the multimedia module 181. Also, the acquired image is transmitted to the counterpart mobile terminal.

For example, when the counterpart mobile terminal is operating in the stereoscopic video communication mode or the stereoscopic image display mode, the controller 180 controls the cameras 121 and 121 'to acquire predetermined types of images of the two- Or 121a / 121'a and 121b / 121'b) or the multimedia module 181. Also, the acquired image is transmitted to the counterpart mobile terminal.

A method for selecting an image to be transmitted to a counterpart mobile terminal on the basis of a user's selection input, predetermined setting information, etc. in the mobile terminal 100 operating in a two-dimensional video communication mode will be described in more detail with reference to FIGS. 15 to 17 Will be described in detail.

According to an embodiment of the present invention, when the stereoscopic image is transmitted from the mobile terminal 100 to the counterpart mobile terminal, the transmitted stereoscopic image may be acquired by another method depending on the configuration of the mobile terminal 100. [

When the mobile terminal 100 includes both the left and right video cameras 121a and 121'a and the right and left video cameras 121b and 121b for stereoscopic image capturing, The left and right images obtained through the right and left image cameras 121a and 121'a and the right image cameras 121b and 121'b may be combined to generate a stereoscopic image. That is, the control unit 180 sequentially acquires images or simultaneously acquires images from the left video cameras 121a and 121'a and the right video cameras 121b and 121'b, and synthesizes them to generate a stereoscopic image can do.

On the other hand, when the mobile terminal 100 includes the camera 121/121 'capable of only two-dimensional image capturing, the stereoscopic image transmitted to the counterpart mobile terminal is transmitted to the two- Or may be obtained by converting the image into a stereoscopic image.

According to an embodiment of the present invention, when a two-dimensional image is transmitted from a mobile terminal 100 to a counterpart mobile terminal, the transmitted two-dimensional image may be acquired by another method depending on the configuration of the mobile terminal 100 have.

When the mobile terminal 100 includes the left video cameras 121a and 121'a and the right video cameras 121b and 121'b, the two-dimensional video transmitted to the other mobile terminal is transmitted to the left video cameras 121a and 121 ' a two-dimensional image obtained by using one of the right image camera 121b / 121'b and the right image camera 121b / 121'b.

On the other hand, when the mobile terminal 100 includes the camera 121/121 'capable of only two-dimensional image capturing, the two-dimensional image transmitted to the counterpart mobile terminal is transmitted to the second Dimensional image can be used as it is.

12 to 17 illustrate examples of selecting an image to be transmitted to a counterpart mobile terminal when the counterpart mobile terminal operates in a video communication mode different from that of the counterpart mobile terminal. FIG. 15 to FIG. 17 show a case where the mobile terminal 100 operates in a two-dimensional video communication mode.

12 shows an example of a screen for selecting a transmission image based on a user's selection input in a mobile terminal 100 operating in a stereoscopic video communication mode.

12, when the mobile terminal 100 operates in a two-dimensional video communication mode while the mobile terminal 100 operates in a stereoscopic video communication mode, the controller 180 operates in a two-dimensional video communication mode A message (W12) indicating that a message is displayed on the screen.

In addition, the control unit 180 displays selection buttons B12a and B12b for determining which one of the stereoscopic image and the two-dimensional image is to be transmitted to the counterpart mobile terminal operating in the two-dimensional video communication mode.

The user can select which image is to be transmitted to the counterpart mobile terminal by using the selection buttons B12a and B12b.

For example, when the user selects the '2D' button B12a, the controller 180 may acquire a two-dimensional image and transmit the two-dimensional image to the other mobile terminal.

In addition, for example, when the user selects the '3D' button B12b, the controller 180 may acquire a stereoscopic image and transmit the stereoscopic image to the counterpart mobile terminal.

FIG. 13 shows another example of a screen for selecting a transmission image based on a selection input of a user in a mobile terminal 100 operating in a stereoscopic video communication mode.

Referring to FIG. 13, when the mobile terminal 100 operates in the stereoscopic video communication mode, the controller 180 operates in the two-dimensional video communication mode, and the opponent mobile terminal operates in the two- A message (W13) indicating that a message is displayed on the screen is displayed.

In addition, the control unit 180 displays selection buttons B13a-B13b for determining which image is to be transmitted to the counterpart mobile terminal operating in the two-dimensional video communication mode.

Accordingly, the user can control the selection buttons B13a to B13b to select which image is to be transmitted to the counterpart mobile terminal.

For example, when the user selects the 'LEFT' button B13a, the control unit 180 can transmit the left image obtained through the left image cameras 121a and 121 'a to the counterpart mobile terminal.

Also, for example, when the user selects the 'RIGHT' button B13b, the controller 180 transmits the right image obtained through the right video camera 121b / 121'b to the other mobile terminal.

When the user selects the '3D' button B13c, the control unit 180 controls the left and right video cameras 121b and 121'b ) To the other mobile terminal.

FIG. 14 shows an example of a screen for setting a transmission image through a setting screen related to a stereoscopic video call.

Referring to FIG. 14, the controller 180 displays a setting screen W14 related to the stereoscopic video call through the display module 151. FIG.

In addition, the control unit 180 may be configured to select an operation mode in a case where the counterpart mobile terminal does not support the stereoscopic video call function or the counterpart mobile terminal selects the two-dimensional video communication mode, And the selection items B14a to B14d are displayed.

The user can select an operation mode when the counterpart mobile terminal operates in the two-dimensional video communication mode or the two-dimensional video display mode by selecting any one of the selection items B14a to B14d.

For example, when the user selects the 'notification' item B14a, the control unit 180, when the other party's mobile terminal operates in the two-dimensional video communication mode, And select a transmission image.

If the control unit 180 selects the 'always left' item B14b, the controller 180 controls the left video camera 121a / 121 'a ) May be set to be transmitted to the counterpart mobile terminal.

In addition, when the user selects the 'Always Right' item B14c, for example, when the counterpart mobile terminal operates in the two-dimensional video communication mode, the controller 180 controls the right video camera 121b / And transmit the obtained right image to the other mobile terminal.

If the user selects the 'always 3D' item (B14d), the control unit 180 determines whether the counterpart mobile terminal is in the two-dimensional video communication mode, through the left video camera 121a / 121'a The image obtained by synthesizing the left image obtained and the right image obtained through the right image camera 121b / 121'b may be transmitted to the counterpart mobile terminal.

FIG. 15 shows an example of a screen for selecting a transmission image based on a user's selection input in a mobile terminal 100 operating in a two-dimensional video communication mode.

Referring to FIG. 15, when the mobile terminal 100 operates in the two-dimensional video communication mode while the other mobile terminal operates in the stereoscopic video communication mode, the controller 180 operates in the stereoscopic video communication mode On the screen.

In addition, the control unit 180 displays selection buttons B15a and B15b for selecting an image to be transmitted to the counterpart mobile terminal on the screen.

The user can select which image is to be transmitted to the counterpart mobile terminal by using the selection buttons B15a and B15b.

For example, when the user selects the '2D' button B15a, the controller 180 may acquire a two-dimensional image and transmit the two-dimensional image to the other mobile terminal.

In addition, for example, when the user selects the '3D' button B15b, the controller 180 may acquire a stereoscopic image and transmit the stereoscopic image to the counterpart mobile terminal.

FIG. 16 shows another example of a screen for selecting a transmission image based on a user's selection input in a mobile terminal 100 operating in a two-dimensional video communication mode.

16, when the mobile terminal 100 operates in the two-dimensional video communication mode while the other mobile terminal operates in the stereoscopic video communication mode, the controller 180 operates in the stereoscopic video communication mode On the screen.

In addition, the control unit 180 displays selection buttons B16a-B16c for determining which image is to be transmitted to the counterpart mobile terminal.

The user controls the selection buttons B16a to B16c to select which image is to be transmitted to the counterpart mobile terminal.

For example, when the user selects the 'LEFT' button B16a, the control unit 180 may transmit the left image obtained through the left image cameras 121a and 121 'a to the counterpart mobile terminal.

Also, for example, when the user selects the 'RIGHT' button B16b, the control unit 180 transmits the right image obtained through the right video camera 121b / 121'b to the other mobile terminal.

When the user selects the '3D' button B16c, the control unit 180 controls the left and right video cameras 121b and 121'b ) To the other mobile terminal.

FIG. 17 shows an example of a screen for setting a transmission image through a setting screen related to a two-dimensional video call.

Referring to FIG. 17, the controller 180 displays a setting screen W17 related to the two-dimensional video call through the display module 151. FIG.

In addition, the controller 180 displays the selection items B17a to B17d for selecting the operation mode when the counterpart mobile terminal operates in the stereoscopic video communication mode.

Accordingly, the user can select an operation mode when the counterpart mobile terminal operates in the stereoscopic video communication mode by selecting any one of the selection items B17a to B17d.

For example, when the user selects the 'notification' item B17a, the control unit 180 determines whether the other party mobile terminal operates in the stereoscopic video communication mode, as shown in FIGS. 15 and 16, And select a transmission image.

If the control unit 180 selects the 'always left' item B17b, the control unit 180 determines whether the counterpart mobile terminal is operating in the stereoscopic video communication mode, To the other mobile terminal.

In addition, for example, when the user selects the 'Always Right' item B17c, the control unit 180 determines whether the counterpart mobile terminal is in the stereoscopic video call mode through the right video camera 121b / 121'b To the other mobile terminal.

When the user selects the 'always 3D' item B17d, the control unit 180 determines whether the counterpart mobile terminal is operating in the stereoscopic video communication mode, through the left video camera 121a / 121'a And the right image obtained through the right image camera 121b / 121'b may be transmitted to the counterpart mobile terminal.

18 is a flowchart illustrating a stereoscopic video call receiving method of the mobile terminal 100 according to an embodiment of the present invention. 19 is a diagram for explaining a stereoscopic video call receiving method of the mobile terminal 100 according to an embodiment of the present invention. The steps shown in FIG. 18 are not essential, so that the method of receiving a stereoscopic video call of the mobile terminal 100 according to an embodiment of the present invention may be configured to have more configuration steps than those shown in FIG. 18 or to have fewer steps .

Referring to FIG. 18, the control unit 180 receives a stereoscopic video call request from the calling mobile terminal through the wireless communication unit 110 (S201). Accordingly, the controller 180 notifies the user that a stereoscopic video call request has been received (S202), using a ring tone, a vibration, a message, and an icon.

In step S201, the control unit 180 may receive the status information of the calling side mobile terminal related to the video call together with the stereoscopic video call request. Here, the status information of the calling mobile terminal received from the calling mobile terminal may have the same configuration as the status information of the mobile terminal 100 transmitted to the receiving mobile terminal in step S101 of FIG.

On the other hand, as the stereoscopic video call request is received, the user can select a call acceptance mode, a video call mode, and the like using the user input unit 130.

19, the control unit 180 displays the information W19 of the other party requesting the video call on the screen as the stereoscopic video call is requested from the other-party mobile terminal.

In addition, for the stereoscopic video call request of the other party, the selection buttons B19a to B19c for selecting whether or not to accept the call and the video communication mode are displayed on the screen. The user controls the selection buttons B19a to B19c to select whether or not to accept the call and the video call mode.

For example, when the user selects the '3D' button B19a, the controller 180 accepts the video call request of the other party and can perform the video call in the stereoscopic video call mode.

In addition, for example, when the user selects the 'general' button B19b, the controller 180 can accept the video call request of the other party and can perform the video call in the two-dimensional video call mode.

Also, for example, when the user selects the 'reject' button B19c, the control unit 180 may reject the video call request of the other party and terminate the call.

Referring again to FIG. 18, when the video call is accepted by the user (S203), the controller 180 transmits the status information of the mobile terminal 100 related to the video call to the other mobile terminal (S204).

Since the state information of the mobile terminal 100 transmitted to the counterpart mobile terminal 100 is the same as the state information of the receiving mobile terminal received in step S103 of FIG. 8, A detailed description thereof will be omitted.

The user can select either the stereoscopic video communication mode or the two-dimensional video communication mode when the video communication is accepted.

When the stereoscopic video communication mode is selected by the user in step S205, the controller 180 controls the operation of the mobile terminal 100 so that the mobile terminal 100 operates in the stereoscopic video communication mode in step S206.

When the user selects the two-dimensional video communication mode (S205), the controller 180 controls the operation of the mobile terminal 100 so that the mobile terminal 100 operates in the two-dimensional video communication mode, Mode (S207).

The method of controlling the mobile terminal 100 to operate in the stereoscopic video communication mode in step S206 and the method of controlling the mobile terminal 100 to operate in the two-dimensional video communication mode in step S207 are the same as steps S107 and S108 of FIG. 8 The detailed description will be omitted.

20 is a flowchart illustrating a method for requesting a two-dimensional video call of the mobile terminal 100 according to an embodiment of the present invention. 20 are not essential, a method for requesting a two-dimensional video call of the mobile terminal 100 according to an embodiment of the present invention may have more configuration steps than those shown in FIG. 20, .

Referring to FIG. 20, the controller 180 requests a two-dimensional video call to a mobile terminal of the other party through the wireless communication unit 110 in response to a request for a two-dimensional video call to a specific partner through the user input unit 130 (S301).

According to an embodiment of the present invention, the control unit 180 may transmit the status information of the mobile terminal 100 related to the video call when the two-dimensional video call is requested to the receiving mobile terminal.

Here, the status information of the mobile terminal 100 transmitted to the receiving-side mobile terminal may have the same structure as the status information of the mobile terminal 100 transmitted in the step S101 of FIG.

If the video call is accepted from the receiving-side mobile terminal (S302), the controller 180 receives status information of the receiving-side mobile terminal related to the video call from the receiving-side mobile terminal through the wireless communication unit 110 (S303).

Here, the status information received from the receiving-side mobile terminal has the same structure as that of the receiving-side mobile terminal received in the above-described step S103 of FIG. 8, and thus detailed description will be omitted below.

Upon receiving the status information of the receiving-end mobile terminal, the controller 180 analyzes the received status information of the receiving-end mobile terminal, thereby confirming the operation status of the receiving-end mobile terminal associated with the video call.

As a result of analyzing the state information received in step S303, when the other mobile terminal operates in the two-dimensional video communication mode (S304), the controller 180 controls the mobile terminal 100 to operate in the two-dimensional video communication mode (S306).

On the other hand, when the counterpart mobile terminal operates in the stereoscopic video communication mode (S304), the controller 180 informs the user that the counterpart mobile terminal operates in the stereoscopic video communication mode.

The user can select whether to switch to the same video communication mode as the counterpart mobile terminal, that is, to switch to the stereoscopic video communication mode.

 If the user requests the change to the stereoscopic video communication mode (S305), the controller 180 controls the mobile terminal 100 to operate in the stereoscopic video communication mode (S307).

 On the other hand, if the user does not select the change of the video call mode, the control unit 180 controls the mobile terminal 100 to continue to operate in the two-dimensional video call mode (S306).

If the other party mobile terminal selects a video call mode different from the video call mode requested by the mobile terminal 100 and selects to change the video call mode to the same video call mode as that of the other mobile terminal based on the selection input of the user As an example. However, the present invention is not limited thereto.

According to the present invention, when the counterpart mobile terminal selects a video call mode different from the video call mode requested by the mobile terminal 100, the control unit 180 can automatically determine whether the video call mode is changed based on the preset setting information have. In this case, the user can select related setting information by using a menu related to the video call.

Also, according to the present invention, the control unit 180 may maintain the current video communication mode of the mobile terminal 100 even if the other mobile terminal selects a video communication mode different from the video communication mode requested by the mobile terminal 100. [

The method of controlling the mobile terminal 100 to operate in the two-dimensional video communication mode in step S306 and the method of controlling the mobile terminal 100 to operate in the stereoscopic video communication mode in step S307 are the same as steps S107 and S108 of FIG. 8 The detailed description will be omitted below.

FIG. 21 is a flowchart illustrating a method for receiving a two-dimensional video call of the mobile terminal 100 according to an embodiment of the present invention. The steps shown in FIG. 21 are not essential, so that the method for receiving a two-dimensional video call of the mobile terminal 100 according to an embodiment of the present invention may have more configuration steps than those shown in FIG. 21, .

Referring to FIG. 21, the controller 180 receives a two-dimensional video call request from the calling mobile terminal through the wireless communication unit 110 (S401). Accordingly, the controller 180 notifies the user that a two-dimensional video call request has been received by using a ring tone, a vibration, a message, an icon, or the like (S402).

In step S401, the control unit 180 may receive the two-dimensional video call request together with the status information of the calling side mobile terminal related to the video call. Here, the status information of the calling mobile terminal received from the calling mobile terminal may have the same configuration as the status information of the mobile terminal 100 transmitted to the receiving mobile terminal in step S101 of FIG.

On the other hand, as the two-dimensional video call request is received, the user can select a call acceptance mode, a video call mode, and the like using the user input unit 130.

If the video call is accepted by the user (S403), the controller 180 transmits the status information of the mobile terminal 100 related to the video call to the other mobile terminal (S404).

Since the state information of the mobile terminal 100 transmitted to the counterpart mobile terminal 100 is the same as the state information of the receiving mobile terminal received in step S103 of FIG. 8, A detailed description thereof will be omitted.

In operation S405, the controller 180 controls the operation of the mobile terminal 100 so that the mobile terminal 100 operates in the two-dimensional video communication mode in operation S406.

On the other hand, when the stereoscopic video communication mode is selected by the user (S405), the controller 180 controls the operation of the mobile terminal 100 so that the mobile terminal 100 operates in the stereoscopic video communication mode, Mode (S407).

The method of controlling the mobile terminal 100 to operate in the stereoscopic video communication mode in step S406 and the method of controlling the mobile terminal 100 to operate in the two-dimensional video communication mode in step S407 are the same as steps S107 and S108 of FIG. 8 The detailed description will be omitted.

Meanwhile, according to an embodiment of the present invention, the mobile terminal 100 can change a video communication mode during a call at the request of a user.

FIG. 22 is a flowchart illustrating a method for changing a video communication mode at the request of a user during video communication. 23 shows an example of changing a video communication mode during a call.

Referring to FIG. 22, the control unit 180 may receive a video call mode change request from a user during a video call (S501). That is, the user can request the change of the video call mode through the user input unit 130 during the video call.

23, when the controller 180 is performing a video call in the two-dimensional video communication mode, the controller 180 may display the button B23 corresponding to the stereoscopic video communication mode switching function on the screen.

Also, when the user selects the button B22, it is possible to recognize that the user is requested to change to the stereoscopic video communication mode.

Referring again to FIG. 22, the controller 180 controls the mobile terminal to operate in the changed video communication mode in response to the request for changing the video communication mode (S502). Here, since the method of controlling the mobile terminal 100 to operate in the stereoscopic video communication mode and the method of controlling the mobile terminal 100 to operate in the two-dimensional video communication mode correspond to steps S106 and S107, respectively, Detailed description will be omitted.

In response to the change of the video call mode of the mobile terminal 100, the controller 180 transmits the status information of the mobile terminal 100, which has been changed in the changed video communication mode, to the other mobile terminal in step S503. Here, the status information of the mobile terminal 100 transmitted to the counterpart mobile terminal may have the same structure as the status information transmitted in step S101 of FIG.

According to an embodiment of the present invention, the control unit 180 may receive the status information from the counterpart mobile terminal again and control the operation of the mobile terminal based on the received status information, as the video call mode of the counterpart mobile terminal is changed.

FIG. 24 is a flowchart illustrating a method of controlling an operation of a mobile terminal according to a change of a video communication mode of a counterpart mobile terminal during a video call. FIG. 25 shows an example of a screen for informing that a video call mode of a counterpart mobile terminal is changed.

Referring to FIG. 24, in operation S601, the control unit 180 receives the status information of the other mobile terminal from the other mobile terminal again in operation S602. The re-received status information may include information on the changed video communication mode of the other mobile terminal.

If the status information of the other party's mobile terminal is received again, the controller 180 displays information indicating that the other party's mobile terminal has changed the video call mode on the screen (S603).

The control unit 180 also analyzes the status information of the other party mobile terminal and confirms the changed video call mode of the other party mobile terminal. If the changed video call mode of the other party mobile terminal is the video call mode of the mobile terminal 100 (S604).

If the changed video communication mode of the other mobile terminal is different from the video communication mode of the mobile terminal 100, the controller 180 determines whether to change the video communication mode of the current mobile terminal based on the preset setting information or the user's selection input (S605).

Referring to FIG. 25, when the video call mode of the other party's mobile terminal is changed from the two-dimensional video communication mode to the stereoscopic video communication mode during the video communication in the two-dimensional video communication mode, A message (W25) indicating that the communication mode has been changed is displayed on the screen.

Also, a selection button B25 is displayed on the screen so that the user can select whether to change the mode to the same video communication mode as the other mobile terminal, that is, the stereoscopic video communication mode.

The user can select whether to change the video communication mode to the stereoscopic video communication mode using the selection button B25.

Referring again to FIG. 24, when the video call mode change is selected, the controller 180 changes the video call mode and controls the mobile terminal 100 to operate in the changed video call mode (S606).

Here, the method of controlling the mobile terminal 100 to operate in the stereoscopic video communication mode and the method of controlling the mobile terminal 100 to operate in the two-dimensional video communication mode correspond to steps S106 and S107, respectively, The description will be omitted.

Also, according to an embodiment of the present invention, the control unit 180 stores the status information received from the counterpart mobile terminal in the memory 161. [ When the user requests to display the status information of the other mobile terminal, the status information of the other mobile terminal stored in the memory 160 may be read and displayed on the screen.

26 is a flowchart illustrating a method for displaying video call-related status information of the other party on the screen in response to a user's request during a video call. FIG. 27 shows an example of a screen for displaying video call related status information.

Referring to FIG. 26, in operation S701, the controller 180 may receive a request from the user to display the video call related status information of the other party mobile terminal during the video call.

When the display of the video call related state information of the opposite mobile terminal is requested, the controller 180 reads the state information of the other mobile terminal from the memory 160. In addition, based on the read video call related status information, status information of the other party mobile terminal is displayed on the screen of the mobile terminal 100 (S702).

Here, the video call related status information of the counterpart mobile terminal 100 may be received from the counterpart mobile terminal during the video call connection process or may be received from the counterpart mobile terminal as the video call mode of the counterpart mobile terminal is changed.

27, the control unit 180 may display the video call related status information W27 of the other party mobile terminal on the screen based on the video call related status information received from the other party mobile terminal.

For example, the control unit 180 controls the display unit 180 to display the image currently received at the counterpart mobile terminal 100, the identification information of the counterpart mobile terminal, the image display mode of the counterpart mobile terminal, Can be displayed on the screen.

Also, according to an embodiment of the present invention, the control unit 180 stores the status information received from the counterpart mobile terminal in the memory 161. [ If there is pre-stored video call related status information for the other party corresponding to the telephone number input in the dial mode, it may be determined whether the stereoscopic video call connection button is displayed based on the stored video call related status information.

28 is a flowchart illustrating a method of displaying a stereoscopic video call connection button in the mobile terminal 100 according to an embodiment of the present invention. 29 and 30 illustrate a method of displaying a stereoscopic video call connection button in the mobile terminal 100 according to an embodiment of the present invention.

Referring to FIG. 28, the control unit 180 enters a dial mode for receiving a telephone number (S801). In addition, the telephone number of a specific party is input through the user input unit 130 (S802).

The control unit 180 determines whether there is video call related status information stored in the memory 160 for the corresponding party based on the inputted telephone number (S803).

When the state information related to the video call is received from the counterpart mobile terminal during the video call connection process or the video call process, the controller 180 associates the received state information with the contact information of the counterpart mobile terminal, .

In step S803, if there is no pre-stored video call related status information for the corresponding party, the control unit 180 displays only the video call connection button B29 corresponding to the general video call, .

On the other hand, if the video call related state information previously stored in the corresponding counterpart exists, the controller 180 reads the corresponding video call related state information from the memory 160.

In addition, the read video call related status information is analyzed (S804), and the stereoscopic video call connection button is selectively displayed based on the analysis result (S805).

For example, if the corresponding other mobile terminal is a terminal capable of a stereoscopic video call, the stereoscopic video call connection button B30b is displayed on the screen together with the two-dimensional video call connection button B30a as shown in FIG. do. Accordingly, the user intuitively recognizes that the other party is able to make a stereoscopic video call, and can easily request a stereoscopic video call to the other party.

In addition, for example, when the corresponding other mobile terminal does not support the stereoscopic video call function, only the video call connection button B29 corresponding to the general video call is displayed on the screen as shown in FIG.

Also, according to an embodiment of the present invention, the controller 180 can check whether the counterpart mobile terminal supports the stereoscopic video call function based on the status information received from the counterpart mobile terminal. In addition, information about the other party capable of the stereoscopic video call can be displayed to support the stereoscopic video call function.

31 shows an example of a screen for informing the other party supporting the stereoscopic video call function that the stereoscopic video communication is possible.

When the status information related to the video call is received from the counterpart mobile terminal during the video call connection process or the video call process, the controller 180 analyzes the received status information and displays information on whether the counterpart mobile terminal supports the stereoscopic video call function . In addition, information on whether the counterpart mobile terminal supports the stereoscopic video call function is stored in the memory 160 in association with the contact information of the counterpart.

31, when the corresponding mobile terminal supports the stereoscopic video call function when the contact information is displayed, the controller 180 displays an indicator indicating that the stereoscopic video communication function is supported, for example, an icon 31a Can be displayed together.

As described above, according to an embodiment of the present invention, the mobile terminal 100 transmits and receives video call related information of each other during a video call connection process, and transmits the video call related information of the mobile terminal 100 And controls the call-related operation.

In addition, based on the video call related information transmitted and received, the video call mode of the mobile terminal 100 is automatically determined or the user can select an operation related to the video call.

In addition, the present invention provides the user with information on the operation state of the other party so that the user can control the operation of the mobile terminal 100 according to the operation of the other party.

The above-described method of controlling a mobile terminal according to the present invention can be provided by being recorded in a computer-readable recording medium as a program for execution in a computer.

The control method of the mobile terminal according to the present invention can be executed through software. When executed in software, the constituent means of the present invention are code segments that perform the necessary tasks. The program or code segments may be stored on a processor read functional medium or transmitted by a computer data signal coupled with a carrier wave in a transmission medium or network.

A computer-readable recording medium includes a recording device of a mode type in which data that can be read by a computer system is stored. Examples of the computer-readable recording device include a ROM, a RAM, a CD-ROM, a DVD ROM, a DVD-RAM, a magnetic tape, a floppy disk, a hard disk and an optical data storage device. Also, the computer-readable recording medium may be distributed over a network-connected computer device so that computer-readable code can be stored and executed in a distributed manner.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. The present invention is not limited to the drawings, and all or some of the embodiments may be selectively combined so that various modifications may be made.

Claims (17)

A wireless communication unit for connecting with another mobile terminal;
At least one camera for acquiring an external image;
The method of claim 1, further comprising: receiving state information related to a video call of the other mobile terminal when the video call is connected to the other mobile terminal, and receiving at least one of a stereoscopic image and a two- And transmitting the image obtained through the at least one camera to the other mobile terminal; And
And a memory for storing the received status information,
The received status information includes at least one of a video display mode of the other mobile terminal, camera status information of the other mobile terminal, a video call mode of the other mobile terminal, and a depth value of the stereoscopic video transmitted from the other mobile terminal Including,
Wherein the control unit determines whether the other mobile terminal supports the stereoscopic video call function based on the stored status information when the phone number of the other mobile terminal is input in the dial mode, And selectively displaying a button corresponding to the stereoscopic video call connection function.
delete The method according to claim 1,
Wherein the control unit controls whether to switch the video call mode based on predetermined setting information or a selection input of a user when the video communication mode selected by the mobile terminal is different from the video communication mode of the other mobile terminal terminal.
◈ Claim 4 is abandoned due to the registration fee. The method according to claim 1,
The control unit controls to transmit an image selected by the user among the stereoscopic image and the two-dimensional image to the other mobile terminal when the video communication mode selected by the mobile terminal is different from the video communication mode of the other mobile terminal The mobile terminal comprising:
◈ Claim 5 is abandoned due to the registration fee. The method according to claim 1,
Further comprising a display module having a panel for implementing stereoscopic vision,
Wherein the control unit activates or deactivates the panel based on whether the mobile terminal operates in a stereoscopic video communication mode or a two-dimensional video communication mode.
◈ Claim 6 is abandoned due to the registration fee. 6. The method of claim 5,
Wherein when the stereoscopic image is received from the other mobile terminal while the display module is operating in the two-dimensional image display mode, the control unit displays the left and right images included in the received stereoscopic image, And selects which of the received stereoscopic images is to be displayed on the screen.
◈ Claim 7 is abandoned due to registration fee. 6. The method of claim 5,
And a multimedia module for performing a conversion function between the two-dimensional image and the stereoscopic image,
Wherein the control unit converts the received two-dimensional image into a stereoscopic image through the multimedia module when the display module receives the two-dimensional image from the other mobile terminal while the display module is operating in the stereoscopic image display mode, And displays the image on the screen.
◈ Claim 8 is abandoned due to the registration fee. The method according to claim 1,
Wherein the status information is received using a Session Initiation Protocol message.
The method according to claim 1,
Wherein the control unit receives status information of the other mobile terminal reflecting the changed video communication mode when the video communication mode of the other mobile terminal is changed during a video call.
delete delete delete delete delete delete delete delete

Images