KR101674959B1 - Mobile terminal and Method for controlling photographing image thereof - Google Patents

Abstract

According to the present invention, first and second images are respectively photographed according to first and second photographing conditions set for the first and second cameras, respectively, and the photographed first and second images are combined to form a third image And displays the generated third image as a photographed image, and a method of controlling image capturing of the mobile terminal.

Description

The present invention relates to a mobile terminal and a control method thereof,

The present invention relates to a mobile terminal having a plurality of cameras and a video image capturing control method thereof.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

In general, a mobile terminal having a plurality of cameras can perform each photographing operation using a plurality of cameras.

However, it does not provide an effective user interface for inputting camera-related control commands for each of a plurality of cameras.

Furthermore, a new photographed image can not be generated using a plurality of images photographed using a plurality of cameras.

An object of the present invention is to provide a user interface for effectively receiving control commands for a plurality of cameras provided in a mobile terminal.

Another object of the present invention is to provide a new photographic image from a plurality of photographed images corresponding to respective photographic conditions using a plurality of cameras provided in a mobile terminal.

According to an aspect of the present invention, there is provided a mobile terminal including: a first camera receiving a first image; A second camera for receiving a second image; Setting first and second photographing conditions for each of the first and second cameras, and setting the first and second images using the first and second cameras according to the set first and second photographing conditions, A control unit for generating a third image by combining the first and second images photographed; And a display unit for displaying the generated third image as a photographed image under the control of the control unit.

According to another aspect of the present invention, there is provided a method of controlling an image capture of a mobile terminal, the method comprising: receiving first and second images using first and second cameras, respectively; Setting first and second photographing conditions for the first and second cameras, respectively; Capturing the first and second images using the first and second cameras according to the set first and second imaging conditions, respectively; Synthesizing the photographed first and second images to generate a third image; And displaying the generated third image as a photographed image.

The effect of the mobile terminal and its imaging control method according to at least one embodiment of the present invention constructed as above is as follows.

First, since a plurality of images photographed so as to correspond to respective photographing conditions can be synthesized by using a plurality of cameras to generate a new photographed image, a new photographed image, in which a plurality of photographed conditions are reflected, .

Secondly, a camera shooting command key for controlling each of a plurality of cameras or each camera is commonly provided on a touch screen, thereby allowing a user to conveniently control a plurality of cameras.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2A is a front perspective view of a mobile terminal according to an embodiment of the present invention;
FIG. 2B is a rear perspective view of a mobile terminal according to an embodiment of the present invention; FIG.
2C is a view for explaining binocular disparity according to the present invention.
3 is a first flow diagram of a method of controlling imaging of a mobile terminal according to an embodiment of the present invention.
Figs. 4A and 5B are diagrams for inputting setting command signals for first and second shooting conditions according to the present invention; Fig.
6A to 8E are diagrams showing a process of setting first and second photographing conditions according to the present invention.
9A to 9D are diagrams illustrating display of shooting conditions set in association with the present invention in a preview image.
10A to 10D are diagrams for changing photographing conditions in a preview image according to the present invention;
11A and 11B are views showing a third image obtained by synthesizing first and second images according to the present invention as an image captured.
FIGS. 12A and 14B are diagrams illustrating operations when a first camera performs moving image shooting and a second camera performs still image shooting according to the present invention. FIG.
15A to 15D are views showing a list of photographed images according to the present invention.
FIG. 16 is a second flowchart of a method for controlling image capturing of a mobile terminal according to an embodiment of the present invention. FIG.
17A to 17D are diagrams showing a camera shooting key according to the present invention.
18A and 18B are diagrams showing a process of switching between a two-dimensional photographing mode and a three-dimensional photographing mode according to the present invention.
Figs. 19A to 19C are diagrams showing a preview image input from the left camera in the two-dimensional photographing mode according to the present invention. Fig.
20A to 20C are diagrams showing a preview image input from the right camera in the two-dimensional photographing mode according to the present invention.
FIGS. 21A and 21B are diagrams showing preview images input from the left and right cameras, respectively, in the two-dimensional photographing mode according to the present invention. FIG.
FIGS. 22A to 22C are diagrams for photographing the first and second images when the photographing command touch operation for the common area is inputted in the two-dimensional photographing mode according to the present invention. FIG.
FIGS. 23A and 25B are diagrams sequentially illustrating first and second images when a touch drag operation for a camera shooting key is input in a two-dimensional shooting mode according to the present invention. FIG.
FIGS. 26A and 26B are views for photographing a first or second image when a photographing command touch operation for the first or second camera region is inputted in the two-dimensional photographing mode according to the present invention. FIG.
27A and 27B are views showing a three-dimensional image obtained by synthesizing first and second images respectively input from left and right cameras in a three-dimensional photographing mode as preview images, according to the present invention.
28A to 28C are views showing a first or second image input from a left or right camera as a preview image in a three-dimensional photographing mode according to the present invention.
FIGS. 29A and 29B are views for photographing first and second images when a photographing command touch operation for a common area is input in a three-dimensional photographing mode according to the present invention. FIG.
FIGS. 30A to 32B are views for sequentially photographing first and second images when a touch drag operation for a camera shooting key is input in a three-dimensional shooting mode according to the present invention. FIG.

Hereinafter, a mobile terminal according to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and a navigation device.

However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (DVF-H) And a Digital Broadcasting System (ISDB-T) (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating an output relating to visual, auditory or tactile sense and includes a display unit 151, an acoustic output module 152, an alarm unit 153, a haptic module 154, 155, and the like.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

Referring to FIG. 1, a proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is surrounded by the touch screen. The proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface or an object existing in the vicinity of the detection surface without mechanical contact using an electromagnetic force or an infrared ray. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152 so that they may be classified as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the haptic module 154 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.

The projector module 155 is a component for performing an image project function using the mobile terminal 100 and is similar to the image displayed on the display unit 151 in accordance with a control signal of the controller 180 Or at least partly display another image on an external screen or wall.

Specifically, the projector module 155 includes a light source (not shown) that generates light (for example, laser light) for outputting an image to the outside, a light source And a lens (not shown) for enlarging and outputting the image at a predetermined focal distance to the outside. Further, the projector module 155 may include a device (not shown) capable of mechanically moving the lens or the entire module to adjust the image projection direction.

The projector module 155 may be divided into a CRT (Cathode Ray Tube) module, an LCD (Liquid Crystal Display) module, and a DLP (Digital Left Processing) module depending on the type of the display means. In particular, the DLP module may be advantageous for miniaturization of the projector module 151 by enlarging and projecting an image generated by reflecting light generated from a light source on a DMD (Digital Micromirror Device) chip.

Preferably, the projector module 155 may be provided longitudinally on the side, front or back side of the mobile terminal 100. It goes without saying that the projector module 155 may be provided at any position of the mobile terminal 100 as occasion demands.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit 170 may be a path through which power from the cradle is supplied to the mobile terminal 100, or various commands A signal may be transmitted to the mobile terminal 100. Various command signals input from the cradle or the power source may operate as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The control unit 180 typically controls the overall operation of the mobile terminal 100. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

2A and 2B show a case where a plurality of cameras are provided on the front or rear surface of the terminal, respectively. For convenience of explanation, it is assumed that a plurality of cameras are first and second cameras.

2A and 2B, the first and second cameras (Figs. 2A_121-1 and 121-2), Figs. 2B_121'-1 and 121'-2) 2b < RTI ID = 0.0 > rear). ≪ / RTI >

For example, in FIG. 2A, the first and second cameras 121-1 and 121-2 may be disposed on the left and right sides, respectively. Therefore, assuming that the same subject is photographed, the first camera 121-1 shoots an image in which the subject is relatively positioned on the right side in the photographing angle range, and the second camera 121-2 photographs It is possible to shoot an image in which the subject is relatively positioned to the left.

Although the first and second cameras are arranged side by side on the same plane on the drawing, if the first and second cameras are arranged so that the same subject can be photographed even if the shooting angle range is different at the time of camera shooting, The arrangement type is not limited.

The first and second cameras (Figs. 2A_121-1 and 121-2), Figs. 2B_121'-1, and 121'-2 may be activated at least one when the camera-related application is executed.

Hereinafter, a three-dimensional image display method of a mobile terminal and a structure of a display unit therefor, which can be applied to embodiments of the present invention, will be described.

The stereoscopic image implemented on the display unit 151 of the mobile terminal can be roughly divided into two categories. The criterion for this classification is whether or not different images are provided in both eyes.

First, we describe the first stereoscopic image category.

The first category is monoscopic in that the same image is provided in both eyes, and can be implemented as a general display unit. More specifically, the controller 180 arranges a polyhedron generated through one or more points, lines, surfaces, or a combination thereof on a virtual three-dimensional space, and displays the image viewed from a specific point on the display unit 151 . Therefore, the substantial part of such a stereoscopic image can be referred to as a planar image.

The second category is a stereo scopic method in which different images are provided in both eyes. It is a method using a principle of feeling a three-dimensional feeling when a human is looking at an object with the naked eye. In other words, the two eyes of a person see different plane images when they see the same thing by the distance between them. These different planar images are transmitted to the brain through the retina, and the brain fuses them to feel the depth and reality of the stereoscopic image. Therefore, binocular disparity due to the distance between the two eyes makes a sense of stereoscopic effect, and this binocular disparity becomes the most important element of the second category. This binocular disparity will be described in more detail with reference to FIG. 2C.

2C is a conceptual diagram for explaining the principle of the binocular disparity.

In FIG. 2C, it is assumed that the hexahedron 210 is placed on the front face lower than eye level and viewed with the naked eye. In this case, the left-eye plane image 220 in which only the top, front, and left sides of the hexahedron 210 are visible in the left eye. In addition, a right-eye plane image 230 in which only the top, front, and right sides of the hexahedron 210 are visible in the right eye.

If the left eye plane image 220 and the right eye plane image 230 reach the left eye plane image 220 and the right eye plane, respectively, the person can actually feel as if he or she is looking at the cube 210.

As a result, in order for the stereoscopic image of the second category to be implemented in the mobile terminal, the left eye image and the right eye image of the same object, which are viewed with a time lag, should be distinguished from each other through the display unit.

In this specification, in order to distinguish the two categories described above, the stereoscopic image of the first category is referred to as "2D stereoscopic image" for convenience, and the stereoscopic image of the second category is referred to as "3D stereoscopic image".

Next, an implementation method of the 3D stereoscopic image will be described.

As described above, in order to realize a 3D stereoscopic image, it is necessary that the right eye image and the left eye image are divided into two and reach the binocular. Various methods for this are described below.

1) Parallax barrier method

The parallax barrier method is a method of electronically driving a blocking device provided between a display unit and a binocular to control the traveling direction of light, thereby achieving different images in both eyes.

The structure of the display unit 151 of the field barrier type for displaying the 3D stereoscopic image may have a structure in which switch liquid crystals are combined on a general display device. The optical parallax barrier provided in the switch liquid crystal is operated to control the traveling direction of light so that different light beams can be separated from the left and right eyes. Therefore, when an image in which the right eye image and the left eye image are combined is displayed on the display device, the user can see the image corresponding to each eye and feel as if the eye image is displayed in three-dimensional form.

In addition, by electrically controlling the parallax barrier so that light is totally transmitted, it is possible to eliminate separation of light due to the parallax barrier so that the same image can be seen on the right and left eyes. In this case, the same function as the general display unit can be achieved.

In general, a parallax barrier provides a 3D stereoscopic image with one axis as a reference, but a parallax barrier capable of moving in parallel in two or more axial directions according to a control signal of the controller 180 may be used.

2) Lens refraction method

The lens refraction method (lenticular) is a method using a lenticular screen provided between a display part and a binocular, and a method of refracting a traveling direction of light through lenses on a lenticular screen so that different images are reached in both eyes.

3) polarized glasses system

Polarized light is polarized so that the directions of polarization are orthogonal to each other to provide different images in both directions or in the case of the circular polarized light so that the directions of rotation are different from each other.

4) Active shutter method

Eye image is alternately displayed at a predetermined cycle through the display unit and the user's eyeglasses are arranged such that when the image in the corresponding direction is displayed, the shutter in the opposite direction is closed, To reach the eye. That is, during the time when the left eye image is displayed, the shutter of the right eye is closed to allow the left eye image to be reached only in the left eye, and the shutter of the left eye is closed during the time when the right eye image is displayed.

The mobile terminal referred to herein may include at least one of the components shown in FIG. Furthermore, the mobile terminal 100 may include a plurality of cameras including first and second cameras, and may include a touch screen as an example of the display unit 151. Hereinafter, the same reference numeral 151 as the display unit 151 is assigned to the touch screen.

Hereinafter, a first embodiment of a method for controlling image capturing using a plurality of cameras of a mobile terminal according to the present invention will be described with reference to the accompanying drawings.

The first embodiment relates to shooting a plurality of images corresponding to shooting environments set for each of a plurality of cameras and synthesizing a plurality of the shot images to generate a new shot image.

Fig. 3 is a first flowchart of a video image capturing control method of the mobile terminal.

3, the mobile terminal 100 executes the camera-related application under the control of the control unit 180 (S310).

The mobile terminal 100 displays an application list composed of a plurality of applications, and can execute a camera-related application when a selection operation for a camera-related application is input from a user. Here, the camera-related application may be basically stored in the mobile terminal 100, and may be received (or downloaded) from an external terminal or an external server and stored.

Of course, in the execution step S310, when the key region (e.g., hot key) corresponding to the camera-related application execution command or the button key is selected by the user, or when the camera- (E.g., wiggling, constant angle tilt, etc.) is detected.

When the mobile terminal 100 executes the camera-related application, the mobile terminal 100 activates at least one of the first and second cameras under the control of the controller 180 (S320).

Here, the camera activation may refer to a state in which a camera module is turned on (ON), and an image input from the outside through the camera module can be displayed or photographed as a preview image.

For example, the mobile terminal 100 may activate only the pre-designated camera when the camera to be activated at the time of execution of the camera-related application among the first and second cameras is designated in advance. Alternatively, if there is no pre-designated camera, the mobile terminal 100 may activate both the first and second cameras, or activate only one of the first and second cameras.

Alternatively, the mobile terminal 100 may display a list of activation target cameras (including first and second cameras, for example) at the start of execution of the camera-related application to allow the user to select a camera to activate can do. Accordingly, the mobile terminal 100 can activate only the camera selected by the user.

According to the control of the controller 180, the mobile terminal 100 displays an image input from an activated camera among the first and second cameras as a preview image, and displays a camera image capture command key together with the preview image S330). In particular, the display step S330 may be performed using the touch screen 151. [

For convenience of explanation, it is assumed that a first image is input from a first camera and a second image is input from a second camera.

In the display step S330, the mobile terminal 100 may display at least one image selected by the user or at least one image arbitrarily selected by the controller 180 among the first and second images as a preview image.

For example, when the first camera is designated by the primary camera among the first and second cameras, the controller 180 may display the first image as a preview image. Furthermore, when the first image is displayed as a preview image, the second camera may be turned off (OFF) (no input image), and may receive the image from the outside in the ON state, but not display it as a preview image.

Here, the camera shooting command key is a key for holding a touch operation (including a shooting command touch operation, a preview command touch operation, an environment setting touch operation, and the like) for controlling the camera operation with respect to at least one of the first and second cameras It can mean a key for receiving input.

Further, the camera shooting command key may include a first camera area, a second camera area, and a common area. The first camera region is a touch operation for controlling the operation of the first camera, the second camera region is a touch operation for controlling operations of the second camera, and the common region is a touch operation for controlling operations of the first and second cameras And an area for receiving a touch operation for controlling the camera operation.

In the display step S330, when the first and second images are all displayed as a preview image, the mobile terminal 100 divides the screen into a plurality of regions to divide the first image in the first region into the second region in the second region, Images can be displayed respectively.

Alternatively, in the display step S330, when the first image of the first and second images is displayed as a preview image, the mobile terminal 100 may display the first image on the entire screen, (The main screen takes precedence in a portion where the main screen overlaps with the sub-screen), while displaying the first image on the main screen.

In the display step S330, the mobile terminal 100 displays a preview image at the center of the screen and displays a camera photographing command key in one area of the screen, for example, at the bottom of the screen.

Furthermore, the mobile terminal 100 can move the position of the camera shooting command key according to the user's selection. For example, when a touch drag operation from the first point of the camera shooting command key to the second point on the screen or a touch operation with respect to each of the first point and the second point is input, the mobile terminal 100 moves to the second point It is possible to move the camera photographing command key to a position corresponding to the camera position. Also, the mobile terminal 100 may change the inter-region position within the camera shooting command key according to the user's selection.

Furthermore, the mobile terminal 100 can change the area of the first camera area, the second camera area, or the common area included in the area of the camera shooting key itself or the camera shooting key. For example, under the control of the control unit 180, the mobile terminal 100 may change the area of the camera photographing key itself or the area of the corresponding area so as to correspond to the user input operation, It is possible to enlarge the area or to reduce the area of the area with low selection frequency.

The structure of the camera shooting command key will be described in more detail in the description related to the second embodiment with reference to Figs. 17A to 17D attached hereto.

The mobile terminal 100 sets the first and second shooting conditions for the first and second cameras under the control of the controller 180 (S340).

Here, the first and second photographing conditions may be photographing conditions that are incompatible (or corresponding to each other). In order to solve the problem that it is difficult to reflect all of the opposite shooting conditions at the time of shooting one image, by taking a plurality of images having opposite shooting conditions and synthesizing them, It is for the effect to be reflected.

For example, when the first shooting condition includes the focus setting, the near focus setting, the first exposure time setting, or the movie shooting at the first point, the second shooting condition includes a focus point at the second point Setting, a long focus setting, a second exposure time setting, or a still image shooting.

The setting step S340 may be performed upon receipt of a photographing condition setting signal from the user.

For example, the photographing condition setting command signal is used when a key (or a key area) corresponding to the photographing condition setting or a menu item is selected, or when a photographing condition setting command signal It can be inputted when the terminal movement corresponding to the condition setting is detected.

Further, the photographing condition setting command signal may be input to the first camera, the second camera, or the first and second cameras, respectively. Particularly, in the case of receiving the touch operation of the photographing condition setting for the first and second camera areas, respectively, the states for setting the first and second photographing conditions for the first and second cameras can be respectively set, When a touch operation for setting shooting conditions for an area is input, a state for setting shooting conditions for the first and second cameras can be set.

In the setting step S340, when receiving the photographing condition setting signal, the mobile terminal 100 displays a screen for setting the photographing condition (hereinafter, photographing condition setting screen) according to the setting of the state for setting the photographing condition .

Accordingly, the control unit 180 can set the first or second shooting conditions for the first or second camera using the displayed shooting condition setting screen.

Of course, the setting step S340 may be performed not only in the preview image display state but also in the camera deactivation state or the photographed image display state, and may also be performed when the menu item of the photographing condition setting by general menu search is executed .

The setting step S340 will be described in detail with reference to Figs. 4A to 8E. For example, the first and second cameras may be left and right cameras, respectively.

Figs. 4A and 5B are diagrams for receiving a photographing condition setting command signal. Fig.

4A, the mobile terminal 100 performs a touch drag operation from the first camera area 411 to the display area 420 of the first image in a state in which both the first and second images are displayed as preview images, (2) when receiving a photographing condition setting command signal for the first camera and receiving a touch drag operation from the second camera area 412 to the display area 430 of the second image, When receiving a photographing condition setting command signal for the second camera and receiving a touch drag operation from the common area 413 to a certain point in the first or second area 420 or 430 (3) It is possible to receive a photographing condition setting command signal for all of the two cameras.

At this time, the first and second images may be displayed with indicators 401 and 402 indicating that they are images input from the first and second cameras, respectively.

4B, when the mobile terminal 100 receives the touch drag operation from the first camera region 411 while displaying only the first image (or the second image) as the preview image, (2) receives a photographing condition setting command signal for the first camera, receives a photographing condition setting command signal for the second camera and receives a touch drag operation from the second camera area 412 (3), it is possible to receive a photographing condition setting command signal for both the first and second cameras.

5A and 5B, when the mobile terminal 100 displays a preview image (the first and second images in Figs. 5A and 5B, the first image), the menu area 403 is displayed by the user If so, a menu item list 510 can be displayed.

When the first camera setting 511 is selected from the menu item list 510, the mobile terminal 100 receives a photographing condition setting command signal for the first camera, and when the second camera setting 512 is selected The photographing condition setting command signal for the second camera is received and the photographing condition setting command signal for both the first and second cameras is received when the simultaneous camera setting 513 is selected.

6A to 6E show a case where a photographing condition setting command signal for the first camera is inputted. The first camera is limited to the left camera.

6A, the mobile terminal 100 can display a photographing condition list 610 including photographing conditions that can be set on the left camera on the screen. For example, the shooting conditions may include a focus setting, an exposure time setting, a shooting mode (video / still image), a resolution setting, a waiting time setting, and the like.

6B, when the focus setting is selected from the photographing condition list 610 in FIG. 6A, the mobile terminal 100 displays the focus list 620 (FIG. 6A).

For example, the mobile terminal 100 sets auto-focus for the left camera when automatic selection is made from the focus list 620, and sets the auto-focus for the left camera when the far-focus or close- You can set focus or near focus.

Then, the mobile terminal 100 displays the focus box 601 at the first point of the first image when manual selection is made from the focus list 620, and displays the touch drag operation from the first point to the second point Or to move the focus box 601 to the second point when a touch operation to the second point is input (b). Accordingly, the mobile terminal 100 can set the image portion corresponding to the focus box 601 located at the second point or the second point as the focus of the left camera.

6C, the mobile terminal 100 displays the exposure time setting window 630 when the exposure time setting is selected from the photographing condition list 610 in FIG. 6A, and uses the exposure time setting window 630 You can set the exposure time (for example, 5 seconds) for the left camera.

6D, when the photographing mode is selected from the photographing condition list 610 in Fig. 6A, the mobile terminal 100 displays the photographing mode setting window 640 and displays the photographing mode setting window 640 on the left side You can set the movie recording or still image recording to the camera.

6E, when the standby time setting is selected from the photographing condition list 610 in FIG. 6A, the mobile terminal 100 displays the standby time setting window 650 and uses the standby time setting window 650 A waiting time (for example, 10 seconds) for the left camera can be set.

Figs. 7A to 7E show a case where a photographing condition setting command signal for the second camera is inputted. Fig. The second camera is limited to the right camera.

7A, the mobile terminal 100 can display a photographing condition list 710 including photographing conditions that can be set on the right camera on the screen.

7B, when the focus setting is selected from the photographing condition list 710 in FIG. 7A, the mobile terminal 100 displays the focus list 720 (a), and if manual selection is made from the focus list 720 When the touch box 701 is displayed at the first point of the second image and the touch drag operation from the first point to the second point or the touch operation at the second point is input from the user, (B). Accordingly, the mobile terminal 100 can set the image portion corresponding to the focus box 701 located at the second point or the second point as the focus of the right camera.

7C, the mobile terminal 100 displays the exposure time setting window 730 when the exposure time setting is selected from the photographing condition list 710 in FIG. 7A, and uses the exposure time setting window 730 You can set the exposure time (for example, 3 seconds) for the right camera.

7D, when the photographing mode is selected from the photographing condition list 710 in FIG. 7A, the mobile terminal 100 displays the photographing mode setting window 740 and displays the photographing mode setting window 740 on the right side You can set the movie recording or still image recording to the camera.

7E, the mobile terminal 100 displays the waiting time setting window 750 when the waiting time setting is selected from the photographing condition list 710 in FIG. 7A, and displays the waiting time setting window 750 using the waiting time setting window 750 You can set the wait time for the right camera (for example, 5 seconds).

8A to 8E show a case where a photographing condition setting command signal for the first and second cameras is inputted. The first and second cameras are limited to the left and right cameras.

8A, the mobile terminal 100 can display a photographing condition list 810 including photographing conditions that can be set on the left and right cameras on the screen.

8B, the mobile terminal 100 can set the focus for each of the left and right cameras when the focus setting is selected from the photographing condition list 810 in Fig. 8A (see Figs. 6B and 7B). 8C, when the exposure time setting is selected from the photographing condition list 810 in FIG. 8A, the mobile terminal 100 can set the exposure time for each of the left and right cameras (see FIGS. 6C and 7C) .

8D, when the photographing mode is selected from the photographing condition list 810 in Fig. 8A, the mobile terminal 100 can set moving picture taking and still picture taking for the left and right cameras (Figs. 6D and 6D) 7d). 8E, when the waiting time setting is selected from the photographing condition list 810 in Fig. 8A, the mobile terminal 100 can set the waiting time for each of the left and right cameras (see Figs. 6E and 7E) .

3, the mobile terminal 100 may display the set first or second shooting conditions in the preview image under the control of the controller 180 in the display step S330.

More specifically, when the preview image includes the first or second image, in the first image input from the first camera, the first image capturing condition for the first camera is the second image input from the second camera, A second photographing condition for the camera can be displayed.

The photographing condition display may be performed in one area of the screen (in particular, the lower or upper end of the screen) so as not to interfere with the display of the preview image, or may be determined according to user selection. Further, when the shooting condition is composed of a plurality of condition items, only the condition items selected by the user may be displayed or only the remaining condition items limited to the condition items selected by the user may be displayed.

With reference to the photographing condition display, it will be described in detail with reference to FIGS. 9A to 10D attached hereto. For example, the first and second cameras may be left and right cameras.

Figs. 9A to 9D are diagrams for displaying the set shooting conditions in the preview image.

9A, when the first and second images are all displayed as a preview image, the mobile terminal 100 displays the first and second images in the first image (hereinafter, referred to as first focus) It is possible to display the first focus box 901 at the corresponding point and display the second focus box 902 at the point corresponding to the focus (hereinafter, second focus) set for the second camera in the second image .

9A, when the first image (or the second image) is displayed as a preview image, the mobile terminal 100 displays the first focus frame at the point corresponding to the first focus in the first image, The second focus box 902 can be displayed at a point corresponding to the second focus.

In particular, the first and second focus boxes 901 and 902 shown in FIG. 9A (b) may further be provided with indicators L and R indicating that they are focused on the first and second cameras, respectively.

9B, the mobile terminal 100 displays the standby time and the exposure time set for the first camera in the first image in a state that both the first and second images are displayed as preview images And display the waiting time and the exposure time set for the second camera in the second image.

9B, the mobile terminal 100 displays the first image (or the second image) as a preview image, and displays the waiting time set for the first and second cameras in the first image (E.g., left-10 seconds, right-5 seconds) and exposure time (e.g., left -5 seconds, right-3 seconds).

Referring to FIG. 9C, the mobile terminal 100 notifies 911 that the moving picture shooting is set for the first camera in the first image while displaying both the first and second images as preview images, , It is notified 912 that still image sensing is set for the second camera in the second image.

According to FIG. 9C, the mobile terminal 100 displays moving pictures for the first and second cameras in the first image, while displaying only the first image (or the second image) as a preview image, It can be notified that still image shooting is set (913).

9D, in the mobile terminal 100, when the first and second images are all displayed as preview images, the mobile terminal 100 displays the first image and the second image in the first image, It is possible to display the third focus box 903 at the point corresponding to the focus and display the fourth focus box 904 at the point corresponding to the near focus set for the second camera in the second image.

9D, the mobile terminal 100 displays the third and fourth focus boxes 903 and 904 in the first image while displaying only the first image (or the second image) as a preview image, Can be displayed at corresponding points {see FIG. 9D (a)}, respectively.

10A to 10D are diagrams for changing the shooting conditions in the preview image.

10A and 10B, when the mobile terminal 100 receives the touch drag operation for moving the second focus box 902 corresponding to the focus of the second camera from the current position to another position (1) , The second focus box 902 can be moved to another position and displayed, and the point where the second focus box 902 is moved can be reset to the focus of the second camera.

10A and 10C, the mobile terminal 100 performs a touch operation corresponding to the focus erasure command (for example, a schedule by a multi-pointer) to the second focus box 902 corresponding to the focus of the second camera (2), the focus corresponding to the second focus box 902 may be released from the second camera and the second focus box 902 may no longer be displayed.

10D, when the mobile terminal 100 receives a touch operation for an arbitrary point outside the first or second focus boxes 901 and 902, or receives a touch operation corresponding to a photographing command with respect to the common area , It is possible to receive a photographing command signal for an image currently displayed as a preview image.

Returning to FIG. 3, the mobile terminal 100 receives a common imaging command signal for the first and second cameras (S350).

Here, the common photographing command signal may include a signal instructing that the first and second images, which are currently input by the first and second cameras respectively, are to be photographed.

Furthermore, the common photographing command signal may be a signal for instructing simultaneous photographing of the first and second cameras, or a signal for instructing sequential photographing of the first and second cameras. Particularly, in the latter case, the first and second cameras can perform respective photographing at predetermined time intervals.

When the first and second shooting command touch operations are simultaneously input to the first and second camera regions when the shooting command touch operation for the common area is input, When a touch operation is inputted to a key corresponding to a common shooting command of an image or a key area (apart from the common area), a terminal movement corresponding to the common shooting command of the first and second images is detected . For example, FIG. 10D shows a process of receiving a common imaging command signal.

Under the control of the control unit 180, the mobile terminal 100 captures the first and second images respectively input from the first and second cameras respectively corresponding to the first and second set photographing conditions (S360 ).

In the photographing step S360, the mobile terminal 100 can directly photograph the first and second images when the first and second images are displayed as a preview image when the common photographing command signal is input. On the other hand, if the mobile terminal 100 displays any one of the first and second images as a preview image at the time of inputting the common imaging command signal in the imaging step S360, the mobile terminal 100 converts the preview image into the first and second images After switching, the first and second images can be photographed. At this time, it may be required to re-input the common photographing command signal after switching the preview image.

In the photographing step S360, the mobile terminal 100 can adjust the photographing angles of the first and second cameras such that the first and second cameras face the same object under the control of the controller 180. [ In other words, the first and second cameras can adjust the photographing angles such that certain portions are the same in the first and second images. This is because the third image obtained by synthesizing the first and second images has the same effect as the image captured by using one camera.

The mobile terminal 100 generates a third image by combining the photographed first and second images under the control of the controller 180 (S370).

In the generating step S370, the mobile terminal 100 may synthesize the first and second images around the same part or the same object in the first and second images, and generate the third image as a result of the combining have. Furthermore, if the sizes of the same objects are different from each other in the first and second images, the sizes of the objects included in the first and second images may be adjusted to be the same, and then synthesized. If the size of the third image is larger or smaller than the size of the reference image, the size of the third image may be reduced or enlarged to match the reference image size.

For example, when the first and second focuses (the first focus-close focus or the first point, the second focus-far focus or the second point) are set in the first and second images, Both first and second focuses can be set on the image. Alternatively, when the first and second images are respectively set to the first and second images, the brightness according to the first exposure time and the brightness according to the second exposure time may all be reflected in the third image. Alternatively, when the first image is motion-captured and the second image is captured as a still image, the third image may include a second image obtained by capturing still images of a first image captured as a main image as a sub-image (See Figs. 12A to 13C).

The mobile terminal 100 displays the generated third image as a photographed image using the touch screen 151 under the control of the controller 180 (S380).

In the display step 380, the mobile terminal 100 may display the first image, the second image, and the third image obtained by synthesizing the first and second images, all or selectively as photographed images. In particular, when all the first to third images are displayed, the first to third images can be displayed in a thumbnail format.

In the display step S380, the mobile terminal 100 displays the generated first image and the second image in the third image while displaying the generated third image in the full screen, The second area can be displayed.

Alternatively, in the display step S380, the mobile terminal 100 displays the first sub-screen and the second image, which display the first image at the back of the main screen, while displaying the generated third image as the captured image on the main screen A second sub-screen can be displayed.

At this time, the first to third images include an indicator indicating that the image is input from the first camera, an indicator indicating that the image is input from the second camera, and an indicator indicating the composite image of the images input from the first and second cameras, respectively Can be displayed.

The display step S380 will be described in detail with reference to FIGS. 11A to 14B attached hereto.

Figs. 11A and 11B are views for displaying a third image obtained by synthesizing the first and second images as photographed images. Fig.

11A and 11B, the mobile terminal 100 displays a third image in a full screen, and displays a first image in a first region 1102 in a third image in a second region 1103, Respectively.

In this case, the first and second focus boxes 901 and 902 corresponding to the focal points of the first and second images may be displayed on the third image, and an indicator indicating that the first and second images are composite images 1101) may be displayed.

Figs. 12A to 14B are diagrams showing an operation in the case where the first camera performs moving image capturing and the second camera performs still image capturing.

Figs. 12A to 12C illustrate operations during motion picture shooting using the first camera.

Referring to FIG. 12A, the mobile terminal 100 receives a photographing command touch operation for the second camera area 412 during the moving picture capturing using the first camera, while retaining moving picture capturing of the first image At least one second image can be taken. 12A, a first image during moving image capture can be displayed on the entire screen, and a second image in a preview state can be displayed on one area 1210 of the entire screen.

12B, when the second image viewing area 1201 is touched by the user in FIG. 12A, the mobile terminal 100 displays the first image in the entire screen, And display the at least one second image 1211 to 1213. At this time, the respective photographing time information can be displayed on at least one of the second images 1211 to 1213, for example, the elapsed time from the photographing start time of the first image as the photographing time information can be displayed .

12B, the second image viewing area 1201 shown in FIG. 12A is switched to the second image close area 1201, and when the second image close area 1201 is touched, the state of FIG. 12A can be restored.

12C, when the specific image 1212 of at least one of the second images 1211 to 1213 is touched by the user in FIG. 12B, the mobile terminal 100 selects the specific image 1212 (Or reproduce) the first image from the portion corresponding to the photographing time point of the first image.

At this time, the mobile terminal 100 divides the screen into a plurality of regions, displays a first image being output from the first region 1220, and displays a first image during moving image capture in the second region 1230 .

FIGS. 13A to 13C show operations during output of the first image that has been subjected to motion image capturing.

13A, the mobile terminal 100 can touch the second image viewing area 1301 from the user during the output of the first image captured using the first camera. At this time, in one area of the screen, a notification informing that the second image common to the image is present may be displayed.

13B, when the second image viewing area 1301 is touched by the user in FIG. 13A, the mobile terminal 100 displays the first image in one area of the entire screen while maintaining the display of the first image in the full screen, It is possible to display at least one second image 1311 to 1313 photographed by using the second camera during photographing of the second image. At this time, each of the photographing time information can be displayed on at least one second image 1211 to 1213.

13B, the second image viewing area 1301 shown in FIG. 13A is changed to the second image close area 1301, and when the second image close area 1301 is touched, the state of FIG. 13A can be restored.

13C, when the specific image 1312 of at least one of the second images 1311 to 1313 is touched by the user in FIG. 13B, the mobile terminal 100 displays the specific image 1312 of the first image It is possible to output (or reproduce) the first image from the portion corresponding to the time point.

Figs. 14A and 14B are diagrams showing a state in which the second image viewing area 1201 or 1301 (or the second image closing area) in Fig. 12A (or Fig. 12B) or Fig. 13A And a touch operation corresponding to a list view of images is input. For example, when the user touches the second image viewing area 1201 or 1301 one time or touches the first time, the screen of FIG. 12B (or FIG. 13B) is touched twice or the second time 14a can be configured.

The mobile terminal 100 displays an image list including at least one second image 1411 to 1413 photographed during shooting of the first image (FIG. 14A), displays a specific image 1412 selected from the image list (Fig. 14B).

When the return region is selected in Fig. 14A or 14B, the state can be returned to the state of Fig. 12A or Fig. 13A.

Returning to FIG. 3, the mobile terminal 100 determines whether the first and second images photographed in the photographing step S360 and the third image generated in the generating step S370, under the control of the controller 180, At least one is stored in the memory 160 (S390).

The storage step S390 may be performed when a storage command signal is received from the user or automatically when the storage command signal is input.

For example, the storage command signal may be input in the case of selection of a key or key area corresponding to a storage command, detection of terminal movement corresponding to a storage command, and the like.

According to the present invention, the mobile terminal 100 displays a list of photographed images including the generated third image as photographed images under the control of the control unit 180, It is possible to further display an indicator indicating that the two images are combined. At this time, if the first and second images are stored as photographed images, the first and second images may be included in the photographed image list.

This will be described in detail with reference to Figs. 15A to 15D attached hereto.

15A, the mobile terminal 100 displays an indicator {1511_ (a), 1512, 1513_ (a) indicating the composite image on the third image 1510 generated by synthesizing the first and second images on the captured image list b)} can be displayed.

15B, when the mobile terminal 100 receives the selection signal for the third image 1510 in FIG. 15A, the mobile terminal 100 can display the first to third images on the screen.

For example, according to FIG. 15B, the third image is displayed on the main screen 1520 and the first and second images are displayed on the first and second sub screens 1530 and 1540 arranged behind the main screen 1510, Respectively, or display the first to third images 1520 to 1540 in a thumbnail format according to FIG. 15B (b).

Of course, if the third image 1510 is selected from the photographed image list, the third image may be displayed on the full screen immediately.

According to FIG. 15C, the mobile terminal 100 can display the selected image (one of the first through third images) on the screen in FIG. 15B. In this case, when the third image is displayed, the first and second focus boxes 901 and 902 corresponding to the focus of the first and second images in the third image may be displayed.

15D, the mobile terminal 100 generates a composite command operation (for example, the first and second images 1530 and 1540) for the first and second images 1530 and 1540 in FIG. 15B, (A), it is possible to generate and display a plurality of third images obtained by combining a plurality of condition items included in the first shooting condition and a plurality of condition items included in the second shooting condition (B).

According to the present invention, the mobile terminal 100 can determine whether to generate the third image obtained by synthesizing the first and second images according to the selection of the user when the first and second images are captured. Of course, the mobile terminal 100 may automatically generate the third image if the common imaging command signal is input, even if there is no selection from the user.

In addition, the mobile terminal 100 may generate a third image at the time of completion of shooting of the first and second images, or may receive a composite command for the first and second images that have been photographed at a later time A third image may be generated (see Fig. 15D).

Hereinafter, a second embodiment of a method of controlling image capturing using a plurality of cameras of a mobile terminal according to the present invention will be described with reference to the accompanying drawings.

Here, the second embodiment is characterized by displaying a camera photographing command key including a plurality of areas for controlling each of a plurality of cameras, respectively, and photographing each of a plurality of cameras in accordance with a camera control touch operation on the camera photographing command key Lt; / RTI >

16 is a second flowchart of a method for controlling image capturing of a mobile terminal according to the present invention.

As shown in Fig. 16, the mobile terminal 100 executes the camera-related application under the control of the control unit 180 (S1610).

With reference to the execution step (S1610), the description of the execution step (S310) of the first embodiment will be referred to.

When the camera-related application is executed, the mobile terminal 100 activates at least one of the first and second cameras under the control of the controller 180 (S1620).

With reference to the activation step S1620, the description of the activation step S320 of the first embodiment will be referred to.

The mobile terminal 100 displays the camera photographing command key including the first camera region, the second camera region, and the common region on one area on the screen under the control of the control unit 180 (S1630). In particular, the display step S1630 may be performed using the touch screen 151. [

Referring to the display step S1630, the description of the display step S330 of the first embodiment will be referred to.

The structure of the camera shooting command key will be described in more detail with reference to FIGS. 17A to 17D. For example, the first camera may be a left camera, and the second camera may be a right camera.

17A, the mobile terminal 100 can display a preview image on the entire screen and display the camera shooting command key 410 at the bottom of the entire screen.

The camera photographing command key 410 may include a first camera area 411, a second camera area 412, and a common area 413. More specifically, the first camera region 411 may be located on the left side of the camera photographing command key 410 when the first camera is the left camera, and the second camera region 412 may be located on the right side And may be disposed on the right side in the camera shooting command key 410 if the camera is a camera.

In addition, the mobile terminal 100 can display the identification information of the corresponding camera in the first camera area 411, the second camera area 412, and the common area 413, respectively.

For example, the identification information may include the number of the corresponding camera (first camera_1, second camera_2, common_l + 2), color of the camera (first camera_ red, second camera_blue, common _ Green), a name of the corresponding camera (first camera_Left or L, second camera_Light or R, common_Common or C), and the like. Of course, the identification information is not limited to the above-described examples and can be variously expressed.

17A and 17B, the camera shooting command key 410 may be provided in various forms.

17A, the camera shooting command key 410 divides its area into three equal parts, the first camera area 411 in the first area in the right direction, the common area 413 in the second area, The second camera area 412 can be allocated to the second camera area 412, respectively. In addition, the shape of the camera shooting command key 410 can be variously expressed not only in an elliptical shape.

17B, the camera photographing command key 410 includes a common area 413 at the center, a first camera area 411 in the form of a direction indicator on the left and right sides of the common area 413, And a second camera area 412.

17A or 17B, the mobile terminal 100 is a camera operation-related touch operation for the first camera region 411 or the second camera region 412, Or the touch operation to the second camera area 412 or the touch drag operation to the first camera area 411 or the second camera area 412 in the common area 413. Further, the mobile terminal 100 can receive a touch operation for the common area 413 from the user as a touch operation related to the camera operation with respect to the common area 413.

17B, the camera photographing command key 410 has a circular key assigned with the common area 413, and the first camera area 411 with respect to the counterclockwise direction of the circular key, The second camera area 412 can be allocated to the clockwise direction.

17B, the mobile terminal 100 is a camera operation-related touch operation for the first camera area 411 or the second camera area 412, and is a touch operation for rotating the circular key counterclockwise from the user A touch operation or a touch operation for rotating clockwise can be input. Also, the mobile terminal 100 can receive the touch operation with respect to the circular key as the camera operation-related touch operation with respect to the common area 413.

17C, the camera shooting command key 410 receives a touch drag operation from any area of the first camera area 411, the second camera area 412, or the common area 413 to another area And the position of an area can be temporarily moved to another area corresponding to the touch drag operation. Further, when the touch drag operation is completed, the position of an area can be restored to its original state.

17D, the camera shooting command key 410 is used to simultaneously receive the first and second touch drag operations from the first and second points of the first and second camera areas 411 and 412, respectively, at the same time The first and second camera regions 411 and 412 may be enlarged outward so as to correspond to the first and second touch drag operations, respectively.

In addition, when the first and second touch drag operations are completed, the first and second camera regions 411 and 412 can gradually be restored to their original state. The larger the degree of enlargement, the more time it takes to return to the original state.

16, the mobile terminal 100 sets either the two-dimensional photographing mode or the three-dimensional photographing mode under the control of the control unit 180 when executing the camera-related application (S1640).

Here, the two-dimensional photographing mode means a mode in which the first and second images photographed by the first and second cameras are treated as individual photographed images, and the three-dimensional photographing mode is a mode in which the first and second cameras And a third mode in which the first and second images are combined.

In the setting step S1640, the mobile terminal 100 can set the photographing mode selected by the user or the photographing mode arbitrarily selected by the control unit 180 among the two-dimensional photographing mode and the three-dimensional photographing mode.

Here, the selection of the photographing mode by the user or the control unit 180 can be performed before or after the execution of the camera-related application.

For example, the previous selection by the user may be performed by executing a menu item corresponding to the shooting mode selection through menu search, and the subsequent selection by the user may be performed by the user in the two- And a three-dimensional photographing mode, or in accordance with the execution of the corresponding menu item. In addition, the selection by the control unit 180 can automatically select a camera that has been activated in the most recently executed camera-related application, or automatically select a camera having an activation time (or an activation frequency) for a certain period of time.

In the setting step S1640, the mobile terminal 100 can receive the photographing mode switching touch operation with respect to the common area among the camera photographing command keys, and when the current two-dimensional photographing mode is set under the control of the controller 180 The user can switch to the three-dimensional shooting mode and switch to the two-dimensional shooting mode if the current three-dimensional shooting mode is set.

Here, the photographing mode switching touch operation may mean a touching operation for instructing switching from the currently set photographing mode to another photographing mode. The photographing mode switching touch operation may be configured to have a touch pattern different from a touch command operation or a preview command touch operation for a common area to be described later.

For example, the photographing mode switching touch operation may be a touch hold or a touch operation for a first time, the preview command touch operation may hold a touch for a second time or two touches, the photographing command touch operation may hold a touch for a third time, The touch pattern of the touch can be obtained. Further, the common area may be red according to the touch mode input touch operation, blue when the preview command touch operation is input, and green when the photograph instruction touch operation is input.

Further, identification information for the currently set shooting mode can be displayed in the common area.

For example, when the currently set photographing mode is the two-dimensional setting mode, 2D, 2D, and arbitrary plane images may be included as the identification information. If the currently set photographing mode is the three-dimensional setting mode, 3D , Three-dimensional, three-dimensional, arbitrary three-dimensional image, and the like. The identification information for each shooting mode to be displayed in the common area can be selected from the user stored in the memory or from the identification information received from the external server (or external terminal).

The setting step S1640 will be described in detail with reference to Figs. 18A and 18B.

18A, when the photographing mode switching touch operation for the common area 413 is inputted in a state in which the two-dimensional photographing mode (or the three-dimensional photographing mode) is set, the mobile terminal 100 performs the three- Two-dimensional photographing mode). At this time, when the two-dimensional photographing mode and the three-dimensional photographing mode are set as the identification information, 2D and 3D may be displayed, respectively.

18B, when the mobile terminal 100 receives the touch operation for the switch command area 501 in a state in which the two-dimensional shooting mode (or the three-dimensional shooting mode) is set, the mobile terminal 100 performs the three- Shooting mode).

Of course, although not shown in the drawings, the photographing mode can be switched even when the corresponding menu item is executed through the menu search or when the corresponding terminal movement is detected.

Returning to Fig. 16, the following description will be made by dividing into a case where a two-dimensional photographing mode is set (first case) and a case where a three-dimensional photographing mode is set (second case).

First, a first case (two-dimensional photographing mode) will be described in detail with reference to the accompanying drawings.

16, the mobile terminal 100 displays at least one of a first image input from a first camera and a second image input from a second camera as a preview image under the control of the controller 180 S1651). At this time, the display step S1651 may be performed using the touch screen 151. [

 In the display step S1651, the mobile terminal 100 may display at least one image selected by the user or at least one image arbitrarily selected by the control unit 180 among the first and second images as a preview image.

For example, when the first camera is designated by the primary camera among the first and second cameras, the controller 180 may display the first image as a preview image. Furthermore, when the first image is displayed as a preview image, the second camera may be turned off (OFF) (no input image), and may receive the image from the outside in the ON state, but not display it as a preview image.

Hereinafter, a process of displaying a preview image of a first image will be described with reference to FIGS. 19A to 19C. For example, the first camera may be a left camera.

19A to 19C, when the camera-related application is executed, the mobile terminal 100 activates the first camera designated as the primary camera, and displays the first image input from the first camera as a preview image It is possible to display an indicator 1901 indicating that the preview image is input from the first camera in one area of one image.

19A, the mobile terminal 100 can partially display a second image input from the second camera behind the main screen while displaying the first image as a preview image on the main screen have.

When the first image input from the first camera is displayed as a preview image, the camera photographing command key 410 may identify and display the first camera region 411 corresponding to the first camera.

For example, the first camera region 411 may be displayed in a dark color or in a different color from that of the other region (see Fig. 19A), or the first camera region 411 may be enlarged to a predetermined size The region 411 can be disposed at the center by changing its position from the common region 413 (see FIG. 19C).

Of course, the mobile terminal 100 is not limited to the above-described examples, and the first camera region 411 can be identified and displayed in various ways to indicate that the currently displayed preview image is the first image.

Hereinafter, a process of displaying a second image as a preview image will be described with reference to FIGS. 20A to 20C. For example, the second camera may be a right camera.

20A, the mobile terminal 100 displays a command signal (hereinafter referred to as " command signal ") for switching a second image input from the second camera into a preview image while displaying a first image input from the first camera as a preview image Preview switching command signal).

For example, the mobile terminal 100 receives a preview command touch operation for the second camera region 412 from the user (①), or performs a touch drag operation in the first direction using a single pointer to the first image When receiving motion or flicking motion (2), or when it senses shaking of the terminal once (3), it can receive a preview switching command signal. Of course, the preview switching command signal is not limited to the above-mentioned examples, but can be input in a more various ways.

20B and 20C, when the preview switching command signal is input in FIG. 20A, the mobile terminal 100 switches the preview image from the first image to the second image, displays the second image as a preview image An indicator 2001 indicating that the preview image is input from the second camera in one area of the second image can be displayed.

More specifically, according to FIG. 20C, the mobile terminal 100 can partially display a first image input from the first camera behind the main screen, while displaying the second image as a preview image on the main screen.

In addition, when the second image input from the second camera is displayed as a preview image, the mobile terminal 100 may identify and display the second camera area 412 corresponding to the second camera.

For example, the second camera area 412 may be darkened or displayed in a different color from the other area (see Figs. 20A and 20B), or the second camera area 412 may be enlarged to a predetermined size, 412 can be arranged at the center by changing their positions with respect to the common area 413.

Hereinafter, a process of displaying the first and second images as a preview image will be described with reference to FIGS. 21A and 21B. For example, the first and second cameras may be left and right cameras.

21A, in the state where the first image input from the first camera (or the second image input from the second camera) is displayed as a preview image, the mobile terminal 100 receives input from the first and second cameras (Hereinafter referred to as a preview switching command signal) for switching the first and second images to be preview images.

For example, the mobile terminal 100 receives a preview command touch operation from the user with respect to the common area 413 ((1)), or performs a touch drag operation in the first direction or a flick When receiving a flicking operation (2), or when the terminal senses shaking twice (3), the preview switching command signal can be input. At this time, if it is assumed that the first image is displayed on the preview image, the preview switching command signal to the second image and the preview switching command signal to the first and second images may have different input patterns.

21B, when the preview switching instruction signal is input in FIG. 21A, the mobile terminal 100 switches the preview image from the first image to the first image and divides the screen into a plurality of regions 1 region 2110 and the second image in the second region 2120. [0214] FIG. At this time, it is possible to display the respective indicators 1901 and 2001 indicating that the preview image is input from the first camera and the second camera, respectively, in one area of each of the first and second images.

In addition, when displaying the first and second images input from the first and second cameras as preview images, the mobile terminal 100 identifies a common area 413 corresponding to the first and second cameras in common Can be displayed.

For example, the common area 413 may be displayed darkly or in a different color from the other area (see Fig. 21B), or the common area 413 may be enlarged to a certain size.

16, when the photographing command touch operation is inputted to the common area among the camera photographing command keys, the mobile terminal 100 receives the photographing command touch operation from the first camera and the second camera under the control of the controller 180 The first and second images are photographed (S1652).

More specifically, the control unit 180 generates a common photographing command signal when the photographing command touch operation on the common area is input, and photographs the first and second photographs currently inputted according to the common photographing command signal It is possible to control the first and second cameras, respectively.

For example, when the first and second shooting command touch operations are simultaneously input to the first and second camera regions, including the case where the shooting command touch operation for the common area is input, When a touch operation is inputted on a key or a key area (separate from the common area) corresponding to the common imaging command of the first and second images, the terminal movement corresponding to the common imaging command of the first and second images is sensed Can occur.

In the shooting step S1652, if the first and second images have been displayed as preview images at the time of inputting the shooting command touch operation for the common area, the mobile terminal 100 can immediately shoot the first and second images .

On the other hand, if the mobile terminal 100 displays any one of the first and second images as a preview image at the time of inputting the photographing command touch operation to the common area in the photographing step S1652, The first and second images can be photographed when the image is switched to the second image and the imaging command touch operation for the common area is re-inputted.

According to the control of the controller 180, the mobile terminal 100 performs two-dimensional image processing on the photographed first and second images (S1653).

In the performing step S1653, the mobile terminal 100 processes the photographed first and second images as separate photographed images (hereinafter, referred to as individual image processing) 2 images (hereinafter referred to as " panorama image processing "). Here, the panoramic image may have the same effect as the first and second images are successively photographed by moving the position with reference to a common portion in the first and second images.

Of course, when receiving the photographing command touch operation for the common area, the mobile terminal 100 can distinguish whether the inputted photographing command touch operation commands the individual image processing or the panorama image processing. At this time, since the touch operation patterns set for the individual image processing and the panorama image processing are different, they can be distinguished.

The mobile terminal 100 may display the first and second images processed by the individual photographed images as photographed images in the respective regions under the control of the control unit 180 or display the generated panorama images as photographed images (S1654). At this time, the display step S1654 may be performed using a touch screen.

The display step S1654 will be described in detail with reference to FIGS. 22A to 22C attached hereto.

22A and 22B, when the photographing command touch operation on the common area 413 is input, the mobile terminal 100 displays the first and second images input by using the first and second cameras, respectively, You can shoot with individual images.

22A, the mobile terminal 100 divides the screen into a plurality of areas and displays the captured first image in the first area 2210 in the second area 2220, Respectively.

22B, the mobile terminal 100 displays the photographed second image in the form of a sub-screen 2201 in one area of the screen while displaying the photographed first image on the entire screen, can do. 22B, when the sub screen 2201 displaying the second image is touched, the mobile terminal 100 can display the first image on the entire screen in the form of a sub screen 2202 (Fig. 22 (b)).

At this time, indicators 1901 and 2001 indicating that the images are captured using the first and second cameras may be displayed in the first and second images, respectively.

22C, the mobile terminal 100 photographs the first and second images, respectively, which are input using the first and second cameras, respectively, when the photographing command touch operation is performed on the common area 413, And the panoramic image may be generated by synthesizing the first and second images.

The mobile terminal 100 displays the generated panoramic image on the entire screen, and displays a first sub-screen 2202 in which a first image is displayed in one area of the screen and a second sub-screen 2201 ) Can be displayed.

At this time, an indicator 2203 indicating that the images input from the first and second cameras are combined is displayed in the panorama image, and the first and second images are displayed in the first and second cameras, respectively, An indicator indicating that the image is displayed may be displayed.

Although not shown in the drawing, the first and second images and the generated panorama images may be displayed on a single screen in a thumbnail form.

16, when the touch-drag operation for at least one of the first and second camera areas of the camera shooting command key is input in the shooting step S1652, the mobile terminal 100 controls the control unit 180 , The first and second images can be sequentially photographed using the first and second cameras at time intervals corresponding to the drag distance by the touch drag operation, respectively.

More specifically, the control unit 180 generates a standby photographing command signal having a time interval corresponding to the drag distance when the touch drag operation is inputted to the first or second camera region, Accordingly, it is possible to control the first and second cameras to photograph the first and second images after a predetermined waiting time elapses.

At this time, the touch drag operation with respect to the first or second camera area can be inputted after inputting the photographing instruction touch operation with respect to the common area. In addition, when the touch-drag operation for the first or second camera region is input without inputting the photographing command touch operation for the common area, the control unit 180 controls the photographing operation of the photographing command signal for the first and second images, All signals can be generated.

Further, the wait time for each drag distance can be specified by the control unit 180 or can be designated by the user. For example, a wait time of 5 seconds may be specified for the drag distance D.

The photographing process according to the atmospheric photographing signal will be described in detail with reference to FIGS. 23A to 25B attached hereto. For convenience of explanation, it is assumed that a photographing operation is performed while displaying the first and second images as a preview image, and the first and second images are separately processed.

23A to 23D are diagrams illustrating a case where first and second touch drag operations having first and second drag distances are respectively input to the first and second camera regions 411 and 412, A process of performing the atmospheric photographing for the first and second cameras respectively corresponding to the drag distance will be described.

23A, the mobile terminal 100 performs a first touch drag operation (first drag distance 2D) in the left direction and a second touch drag operation (first drag distance 2D) in the left and right directions with respect to the first and second camera regions 411 and 412, respectively When the touch drag operation (second drag distance D) is input, the waiting time for the first camera and the waiting time for the second camera can be set to 10 seconds and 5 seconds, respectively, corresponding to the drag distance.

Here, the first and second touch drag operations can be simultaneously input as multi-touch drag operations. Also, the first and second camera areas 411 and 412 can extend its length in the drag direction to correspond to the drag distance.

When the input first and second touch drag operations are removed, the mobile terminal 100 performs standby photography using the first and second cameras according to the set waiting times (10 seconds, 5 seconds) Can be performed.

23B, the first and second camera regions 411 and 412 enlarge the length thereof by the drag distances 2D and D of the first and second touch drag operations, respectively (a) If the drag operation is removed, it can gradually decrease in length (b, c). At this time, the reduction distance may be proportional to the elapse of the waiting time according to the atmospheric photographing.

23B and 23C, the elapsed time of the waiting time of 5 seconds (corresponding to the drag distance D), the first camera region 411 has the length D (D decrease from the initial length 2D) , And the second camera area 412 may have a length of 0 (D decrease from the original length D). At this time, the mobile terminal 100 can take the second image because the wait time of 5 seconds is left for the first camera, and there is no wait time for the second camera.

23 (c) and 23 (d), at the elapse of the waiting time of 10 seconds (corresponding to the drag distance 2D), the first camera area 411 has the length 0 (2D reduction from the initial length 2D) . At this time, since the mobile terminal 100 does not have a waiting time for the first camera, it can take a first image.

As a result, the mobile terminal 100 can take the second image at the elapsed time of 5 seconds after the photographing command touch operation is input, and successively photograph the first image at the elapse of 10 seconds.

24A and 24B show the case where first and second touch drag operations having first and second drag distances are respectively input to the first and second camera regions 411 and 412, The process of performing the atmospheric photographing for either the first camera or the second camera so as to correspond to the sum of the drag distance will be described.

For convenience of explanation, it is assumed that the first camera is preliminarily designated as the camera for performing the atmospheric photographing. Alternatively, the mobile terminal 100 may be a camera for performing the atmospheric photographing, and may designate a camera in a camera area corresponding to a longer drag distance among the first and second drag distances, It is possible to designate the camera in the camera area corresponding to the touch drag operation to be removed sooner or later. Alternatively, the mobile terminal 100 may arbitrarily designate the camera to perform the standby photographing regardless of the user selection.

24A, the mobile terminal 100 performs a first touch drag operation (first drag distance D) in the left direction and a second touch drag operation in the left direction (second drag distance D) in the first and second camera regions 411 and 412, respectively When the touch drag operation (second drag distance D) is respectively inputted, the waiting time is set to 10 seconds with respect to the first camera so as to correspond to the sum of the drag distances 2D, and the second camera can be immediately set to photograph. At this time, the first and second camera regions 411 and 412 may be extended in the longitudinal direction by the first and second touch drag distances D, respectively.

Then, when the first second touch drag operation is canceled, the mobile terminal 100 can wait for the first camera to take a picture (waiting time 10 seconds) and take the second picture using the second camera . At this time, the first and second camera regions 411 and 412 may gradually decrease in length in proportion to the elapse of the waiting time according to the atmospheric photographing performed for the first camera.

24B, the sum of the lengths of the first and second camera regions 411 and 412 has a length D (D decrease in the initial length 2D) at the elapse of the waiting time of 5 seconds (corresponding to the drag distance D) , The photographing standby can be maintained with respect to the first camera (waiting time 5 seconds). Further, at the elapse of the waiting time 10 seconds (corresponding to the drag distance 2D), the sum of the lengths of the first and second camera regions 411 and 412 has a length of 0 (2D reduction in the initial length 2D) The terminal 100 can photograph the first image because there is no waiting time for the first camera.

As a result, the mobile terminal 100 can take the second image immediately after inputting the photographing command touch operation, and sequentially photograph the first image at the elapse of 10 seconds.

25A and 25B illustrate a process of performing a standby photographing operation for the first camera corresponding to the drag distance when the touch drag operation is inputted to the first camera region 411. FIG.

25A, when the mobile terminal 100 receives the touch drag operation (drag distance 2D) in the left direction with respect to the first camera area 411, the mobile terminal 100 sets the waiting time for the first camera to correspond to the drag distance 10 seconds can be set. At this time, the first camera region 411 can be extended in the longitudinal direction by the touch drag distance 2D.

When the touch drag operation is canceled, the mobile terminal 100 can wait for the first camera to take a picture (waiting time 10 seconds) and take the second picture using the second camera. At this time, the first camera area 411 may gradually decrease in length in proportion to the elapse of the waiting time according to the atmospheric photographing performed for the first camera.

25B, the first camera area 411 has a length D (D decrease from the initial length 2D) at the elapse of the waiting time of 5 seconds (corresponding to the drag distance D) (Wait time 5 seconds). Further, at the elapse of the waiting time of 10 seconds (corresponding to the drag distance 2D), the first camera region 411 has a length of 0 (2D reduction from the original length 2D) The first image can be photographed because there is no waiting time for the first image.

As a result, the mobile terminal 100 can take the second image immediately after inputting the photographing command touch operation, and sequentially photograph the first image at the elapse of 10 seconds.

16, in the photographing step S1652, when the photographing command touch operation for the first camera area is inputted under the control of the controller 180, the mobile terminal 100 uses the first camera to photograph the first And when the photographing command touch operation with respect to the second camera area is inputted, the second image can be photographed using the second camera.

With reference to the individual photographing of the first and second images, it will be described in detail with reference to FIGS. 26A and 26B attached hereto.

26A, when the first mobile terminal 100 receives a photographing command touch operation for the first camera region 411 while displaying a first image input from the first camera as a preview image, The first image can be captured using (a).

Furthermore, when the mobile terminal 100 receives a touch drag operation having a drag distance D (waiting time of 5 seconds) together with an input of a photographing command touch operation to the first camera area 411, (B), the first image can be taken using the first camera at the time when the waiting time has elapsed 5 seconds.

26B, when the mobile terminal 100 receives the photographing command touch operation with respect to the second camera region 412 while displaying the second image input from the second camera as a preview image, The second image can be taken using (a).

Furthermore, when the mobile terminal 100 receives a touch drag operation having a drag distance D (waiting time of 5 seconds) together with an input of a photographing command touch operation to the second camera area 412, (5 seconds), and the second image can be photographed using the second camera at the elapse of the waiting time of 5 seconds (b).

Next, the second case (three-dimensional photographing mode) will be described in detail with reference to the accompanying drawings.

Here, assuming that the three-dimensional photographing mode uses both the first and second images input from the first and second cameras, the mobile terminal 100 determines that the first and second You can activate all cameras.

16, according to the control of the control unit 180, the mobile terminal 100 generates a preview image of a third image obtained by synthesizing a first image input from a first camera and a second image input from a second camera (S1661). At this time, the display step S1661 may be performed using the touch screen 151. [

Here, the third image may include a three-dimensional image obtained by synthesizing the first and second images, and may be a three-dimensional image generated by using the first image as the left eye image and the second image as the right eye image. In particular, when the third image is a three-dimensional image, the mobile terminal 100 can activate a barrier for displaying a three-dimensional image.

In the display step S1661, the mobile terminal 100 displays the first and second images as preview images in the respective areas, and after receiving the photographing command touch operation, the mobile terminal 100 uses the first and second images photographed, Dimensional image can be synthesized.

Alternatively, in the display step S1661, the mobile terminal 100 may display the first image, the second image, and the third image obtained by synthesizing the first and second images, all or selectively as a preview image.

Hereinafter, a process of displaying a preview image of a first image or a third image will be described with reference to FIGS. 27A to 28C. For example, the first and second cameras may be left and right cameras.

27A and 27B illustrate a preview image display.

Referring to FIG. 27A, when the mobile terminal 100 executes the camera-related application, the mobile terminal 100 displays the third image as a preview image, and displays the first sub-area 2702 displaying the first image in the third image And a second sub-area 2703 displaying the second image.

27B, when the camera-related application is executed, the mobile terminal 100 displays the third image as a preview image on the main screen 2710 and displays the first image on the back of the main screen 2710 A sub-screen 2720 and a second sub-screen 2730 displaying the second video can be displayed.

At this time, the first and second sub-screens 2720 and 2730 are relatively small in size compared to the main screen 2710, and are overlapped with the main screen 2710 to cover the main screen 2710, May not be displayed.

At this time, an indicator 2701 indicating that the third image is a three-dimensional image generated by combining the first and second images may be displayed in the third image. Further, when the third image is displayed as a preview image, the common area 413 can be discriminatedly displayed (see Figs. 19A to 19C).

28A to 28C illustrate preview image switching. For convenience of explanation, it is assumed that a third image is displayed as a preview image as shown in FIG. 27B. Of course, the following embodiment can be applied to the case of FIG.

28A, the mobile terminal 100 can receive a preview switching command signal from the third video to the first video or the second video.

More specifically, the preview switching instruction signal from the third video to the first video is input to the user from the user through the preview command touch operation for the first camera region 411 (1 - 1) (1 - 2) or touching the left hand direction (1 - 3), as shown in FIG.

Accordingly, when the preview switching command signal from the third image to the first image is input, the mobile terminal 100 switches the preview image from the third image to the first image, A first sub-screen 2710 displaying a third image behind the main screen 2720 and a second sub-screen 2730 displaying the second image may be displayed while being displayed on the display unit 2720.

Alternatively, the preview switching instruction signal from the third video to the second video inputs a preview command touch operation for the second camera region 412 from the user in accordance with the input of the switching command signal to the first video (②-1), inputting a touch drag operation or a flicking operation in the right direction with respect to the preview image (②-2), or sensing the terminal shaking in the right direction (②-3) .

Accordingly, when the preview switching command signal from the third image to the second image is inputted, the mobile terminal 100 switches the preview image from the third image to the second image, A first sub-screen 2710 displaying a third image behind the main screen 2730 and a second sub-screen 2720 displaying the first image may be displayed while being displayed on the display unit 2730.

At this time, the indicators 1901, 2001, and 2701 corresponding to the respective regions of the first to third images can be displayed.

16, when the photographing command touch operation is inputted to the common area among the camera photographing command keys, the mobile terminal 100 receives the photographing command touch operation from the first camera and the second camera under the control of the controller 180 The first and second images are photographed (S1662).

In the photographing step S1662, the description of the photographing step S1652 in the case where the photographing instruction touching operation for the common area is inputted in the two-dimensional photographing mode is referred to.

The mobile terminal 100 performs three-dimensional image processing on the photographed first and second images under the control of the controller 180 (S1663).

In the performing step S1663, the mobile terminal 100 may generate a three-dimensional image by synthesizing the first and second images photographed as three-dimensional image processing. More specifically, the mobile terminal 100 sets a first image as a left eye image, a second image as a right eye image, and generates a three-dimensional image by combining first and second images respectively set as a left eye image and a right eye image can do.

The mobile terminal 100 displays the generated three-dimensional image as a photographed image under the control of the control unit 180 (S1664). At this time, the display step S1664 may be performed using the touch screen 151. [

In the display step S1664, the mobile terminal 100 may activate a barrier for three-dimensional image display.

In the display step S1664, the mobile terminal 100 may display the first image, the second image, and the generated three-dimensional image in a thumbnail format.

The display step S1664 will be described in detail with reference to FIGS. 29A and 29B attached hereto.

29A and 29B, when the photographing command touch operation on the common area 413 is input, the mobile terminal 100 displays the first and second images input through the first and second cameras, respectively, And a three-dimensional image obtained by synthesizing the first and second images may be displayed as an image.

29A, the mobile terminal 100 includes a first area 2702 displaying a first image in a three-dimensional image and a second area 2702 displaying a second image in a three-dimensional image while displaying a three- A second area 2703 can be displayed.

When the first area 2702 or the second area 2703 is touched, the mobile terminal 100 displays the first image or the second image on the full screen as the captured image, and displays the three- In a region of < / RTI >

29B, the mobile terminal 100 includes a first sub-screen 2920 displaying a first image behind a main screen 2910 while displaying a three-dimensional image as a captured image on the main screen 2910, The second sub-screen 2930 displaying the second image can be displayed.

At this time, an indicator 2701 indicating that the first and second images photographed using the first and second cameras are synthesized is displayed in the three-dimensional image.

16, when the touch-drag operation for at least one of the first and second camera areas of the camera shooting command key is input in the shooting step S1662, the mobile terminal 100 controls the control unit 180 , The first and second images can be sequentially photographed using the first and second cameras at time intervals corresponding to the drag distance by the touch drag operation, respectively.

In this regard, the description of sequential shooting in the two-dimensional shooting mode is referred to.

With reference to the photographing process according to the atmospheric photographing signal, it will be described in detail with reference to FIGS. 30A to 32B attached hereto. For convenience of explanation, it is assumed that a photographing operation is performed in a state that a third image (or a three-dimensional image) obtained by synthesizing the first and second images is displayed as a preview image.

30A to 30C are diagrams for explaining a case where first and second touch drag operations having first and second drag distances are respectively input to the first and second camera regions 411 and 412, A process of performing the atmospheric photographing for the first and second cameras respectively corresponding to the drag distance will be described.

30A, the mobile terminal 100 performs a first touch drag operation (first drag distance 2D) in the left direction and a second touch drag operation (first drag distance 2D) in the left and right directions with respect to the first and second camera regions 411 and 412, respectively When the touch drag operation (second drag distance D) is input, the waiting time for the first camera and the waiting time for the second camera can be set to 10 seconds and 5 seconds, respectively, corresponding to the drag distance.

30B, the first camera region 411 has a length D (D decrease from the original length 2D) at the elapse of a waiting time of 5 seconds (corresponding to the drag distance D), and the second camera region 412 has a length D Lt; / RTI > may have a length of zero (D decrease from original length D). At this time, the mobile terminal 100 can take the second image because the wait time of 5 seconds is left for the first camera, and there is no wait time for the second camera.

According to FIG. 30C, at the elapse of the waiting time of 10 seconds (corresponding to the drag distance 2D), the first camera region 411 may have a length of 0 (2D reduction from the original length 2D). At this time, since the mobile terminal 100 does not have a waiting time for the first camera, it can take a first image.

31A and 31B are diagrams for explaining the case where first and second touch drag operations having first and second drag distances are respectively input to the first and second camera regions 411 and 412, The process of performing the atmospheric photographing for either the first camera or the second camera so as to correspond to the sum of the drag distance will be described.

For convenience of explanation, it is assumed that the first camera is preliminarily designated as the camera for performing the atmospheric photographing.

31A, the mobile terminal 100 performs a first touch drag operation (first drag distance D) in the left direction and a second touch drag operation (first drag distance D) in the left and right directions with respect to the first and second camera regions 411 and 412, respectively When the touch drag operation (second drag distance D) is respectively inputted, the waiting time is set to 10 seconds with respect to the first camera so as to correspond to the sum of the drag distances 2D, and the second camera can be immediately set to photograph.

31B, the sum of the lengths of the first and second camera regions 411 and 412 has a length D (D decrease in the initial length 2D) at the elapse of the waiting time of 5 seconds (corresponding to the drag distance D) , The photographing standby can be maintained with respect to the first camera (waiting time 5 seconds). Further, at the elapse of the waiting time 10 seconds (corresponding to the drag distance 2D), the sum of the lengths of the first and second camera regions 411 and 412 has a length of 0 (2D reduction in the initial length 2D) The terminal 100 can photograph the first image because there is no waiting time for the first camera.

32A and 32B illustrate a process of performing a standby photographing operation for the first camera corresponding to the drag distance when the touch drag operation is input to the first camera region 411. FIG.

32A, when the mobile terminal 100 receives the touch drag operation (drag distance 2D) in the left direction with respect to the first camera region 411, the mobile terminal 100 sets the waiting time for the first camera to correspond to the drag distance 10 seconds can be set.

32B, the first camera area 411 has a length D (D decrease from the initial length 2D) at the elapse of the waiting time of 5 seconds (corresponding to the drag distance D) (Wait time 5 seconds). Further, at the elapse of the waiting time of 10 seconds (corresponding to the drag distance 2D), the first camera region 411 has a length of 0 (2D reduction from the original length 2D) The first image can be photographed because there is no waiting time for the first image.

16, the mobile terminal 100 displays the first and second images photographed in the photographic steps S1652 and S1662, and the panorama processed in the processing step S1653 or S1663, under the control of the controller 180. [ Or the three-dimensional image, or the photographed image displayed in the display step (S1654, S1664) is stored in the memory (S1670).

Regarding the storing step S1670, the description of the storing step (S390) of the first embodiment will be referred to.

According to the present invention, when the photographing command touch operation for the first time is input to the first or second camera region 411 or 412, the mobile terminal 100 displays the first The image or the second image can be consecutively photographed. In this case, when the touch drag operation of the first distance is further input to the first or second camera region 411 or 412, the first or second touch region is selected as the first or second touch region in a time interval corresponding to the first distance, 2 images can be shot continuously.

In addition, when the mobile terminal 100 receives the photographing command touch operation for the first time with respect to the common area 413, the mobile terminal 100 can sequentially photograph both the first and second images at a number corresponding to the first time . In this case, when the touch drag operation of the first distance is further inputted to the common area 413, the first and second images can be successively photographed at a time corresponding to the first time at a time interval corresponding to the first distance have.

According to an embodiment of the present invention, the image capturing control method described above can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The above-described mobile terminal and its image capturing control method are not limited to the configuration and method of the above-described embodiments, but the embodiments can be applied to all or some of the embodiments so that various modifications can be made. May be selectively combined.

100 mobile terminal
151 Touch screen
180 control unit

Claims (16)

A touch screen displaying an image;
A first camera for capturing a first image;
A second camera for capturing a second image; And
When the photographing command for the two-dimensional photographing mode is inputted, the first camera is controlled to photograph the first image based on the first photographing condition of the first waiting time after the photographing command is inputted, And controls the second camera to photograph the second image based on a second photographing condition of a second waiting time different from the first waiting time after the input of the third photographing condition, And displays the first and second indicators corresponding to the first and second cameras, and displays the first waiting time corresponding to the drag distance amount of the touch drag input performed on the first indicator, And setting the second waiting time according to a drag distance amount of a touch drag input performed on the second indicator,
And the third image includes a two-dimensional stereoscopic image. The method according to claim 1,
Wherein the control unit adjusts the photographing angles of the first and second cameras so as to face the same object. The method according to claim 1,
The first photographing condition may include:
Wherein the first image includes at least one of a focus setting, a near focus setting, a first exposure time setting, and a moving picture shooting at a first point of the first image,
The second photographing condition may include:
And at least one of a focus setting for a second point of the second image, a distance focus setting, a second exposure time setting, and a still image capturing corresponding to the first photographing condition. The method according to claim 1,
Wherein the control unit displays at least one of the first and second images as a preview image before shooting the first and second images, and displays the first and second shooting conditions in the preview image displayed . The method according to claim 1,
Wherein the control unit displays a camera shooting command key including a first camera area, a second camera area, and a common area. 6. The apparatus of claim 5,
Setting the first and second photographing conditions according to the input of the photographing condition setting signal for the camera photographing command key,
And controls the first and second cameras to capture the first and second images, respectively, upon receipt of an imaging command signal for the camera imaging command key. The method according to claim 1,
Wherein the first and second cameras include:
Capturing a first moving image and a second moving image, respectively,
Wherein,
And displays the photographed second image in one area of the output image of the first image during shooting of the moving image using the first camera or after recording of the moving image. 8. The apparatus of claim 7,
And displays the portion of the first image corresponding to the shooting point of the second image when the second image is selected. The method according to claim 1,
Wherein the control unit synthesizes the first and second images to generate the third image, displays the photographed image list including the third image, and the third image synthesizes the first and second images And displays an indicator indicating that the image is one image. A step of inputting a photographing command for a two-dimensional photographing mode;
Controlling a first camera to photograph a first image based on a first photographing condition of a first waiting time after the photographing command is input;
Controlling a second camera to photograph a second image based on a second photographing condition of a second waiting time different from the first waiting time after the photographing command is inputted;
Generating and displaying a third image based on the first and second images;
Displaying first and second indicators corresponding to the first and second cameras, respectively;
Setting the first waiting time corresponding to a drag distance amount of a touch drag input performed on the first indicator; And
Setting the second waiting time corresponding to a drag distance amount of a touch drag input performed on the second indicator; And controlling the image capturing of the mobile terminal. delete delete delete delete delete delete

Images