KR20110136132A - Electronic device and control method for electronic device - Google Patents

Abstract

PURPOSE: A controlling method of an electronic device is provided to increase the convenience of a user when the three-dimensional value of an image is varied. CONSTITUTION: A plurality of cameras(121) obtains an external image. A control unit(180) generates a three-dimensional image through the synthesis of a first image and a second image. The control unit displays a three image through a display module(151). The control unit varies a depth value of the three-dimensional image based on the selected feature object of the third image.

Description

Electronic device and control method for electronic device

The present invention relates to an electronic device and a control method of the electronic device.

In recent years, the movement of providing 3D stereoscopic images in electronic devices has become more active. For this purpose, it is considered to improve the structural part and / or software part of the terminal.

An object of the present invention is to provide an electronic device and a control method of the electronic device to increase the convenience of the user when the depth value of the stereoscopic image is changed.

An electronic device according to an aspect of the present invention includes a display module; A plurality of cameras for acquiring an external image; And generating a stereoscopic image by synthesizing the first image and the second image acquired through the plurality of cameras, and displaying the third image acquired through at least one camera of the plurality of cameras through the display module. And a controller configured to vary a depth of the stereoscopic image based on the specific object selected from the third image.

Further, a control method of an electronic device including a plurality of cameras according to an aspect of the present invention includes the steps of: generating a stereoscopic image by synthesizing a first image and a second image obtained through the plurality of cameras; Displaying a third image acquired through at least one camera of the plurality of cameras; And when a specific object is selected in the third image, varying a depth value of the stereoscopic image based on the selected specific object.

The electronic device and the method for controlling the electronic device according to the present invention have the effect of increasing the convenience of the user when changing the stereoscopic value of the stereoscopic image.

1 is a block diagram of an electronic device according to an embodiment of the present disclosure.
2 and 3 are views for explaining a stereoscopic image display method using a binocular parallax associated with an embodiment of the present invention.
4 and 5 are views illustrating an appearance of an electronic device according to an embodiment of the present disclosure.
6 illustrates an example of obtaining a plurality of images for generating a stereoscopic image according to binocular disparity using a plurality of cameras provided in an electronic device according to an embodiment of the present disclosure.
7 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure.
FIG. 8 illustrates an example in which an electronic device according to an embodiment of the present disclosure displays an image synthesized by overlapping a plurality of images input through a plurality of cameras as a preview image.
FIG. 9 illustrates another example of displaying, as a preview image, an image synthesized by overlapping a plurality of images input through a plurality of cameras in an electronic device according to an embodiment of the present disclosure.
FIG. 10 illustrates an example of displaying, as a preview image, an image input through one of a plurality of cameras in an electronic device according to an embodiment of the present disclosure.
11 to 13 illustrate examples of distinguishing and displaying a plurality of images input through a plurality of cameras as a preview image in an electronic device according to an embodiment of the present disclosure.
14 and 15 illustrate examples of displaying an image and a stereoscopic image, which are input through one of a plurality of cameras, as a preview image in an electronic device according to an embodiment of the present disclosure.
FIG. 15 illustrates an example in which display positions of a first image and a stereoscopic image are changed by user manipulation in an electronic device according to an embodiment of the present disclosure.
16 and 17 illustrate examples of selecting a specific object in a preview image in an electronic device according to an embodiment of the present disclosure.
18 illustrates an example of changing a depth value of a stereoscopic image based on an object selected from a preview image in an electronic device according to an embodiment of the present disclosure.

The above objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. It is to be understood, however, that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and similarities. Like reference numerals designate like elements throughout the specification. In addition, when it is determined that the detailed description of the known function or configuration related to the present invention may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. In addition, numerals (e.g., days, days, etc.) used in the description of the present invention are merely an identifier for distinguishing one component from another component

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

In addition, the suffixes "module" and "unit" for the components used in the following description are given or mixed in consideration of ease of specification, and do not have distinct meanings or roles from each other.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

Meanwhile, according to an embodiment of the present invention, an electronic device may include a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, and a television. ), A desktop computer, a set-top box, a digital camera, or the like.

1 is a block diagram of an electronic device according to an embodiment of the present disclosure.

The electronic device 100 includes a communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, and an interface unit. 170, the controller 180, and the power supply 190 may be included. Since the components shown in FIG. 1 are not essential, an electronic device having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The communication unit 110 may include one or more modules that enable communication between the electronic device 100 and the communication system or between the electronic device 100 and a network in which the electronic device 100 is located. For example, the communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like.

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video BroadcastHandheld (DVBH).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems. In particular, the broadcast receiving module 111 may be a digital multimedia broadcasting broadcasting (DMBT), a digital multimedia broadcasting satellite (DMBS), a media forward link only (MediaFLO), a digital video broadcasting ), And ISDBT (Integrated Services Digital Broadcast Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems that provide broadcast signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives a wireless signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access, and the wireless internet module 113 may be internal or external to the electronic device 100. WLAN (WiFi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The location information module 115 is a module for checking or obtaining the location of the electronic device. A representative example of the location information module is a GPS (Global Position System) module. According to the current technology, the GPS module 115 calculates information on a distance (distance) from three or more satellites to one point (entity), information on the time when the distance information is measured, , Three-dimensional position information according to latitude, longitude, and altitude of one point (individual) in one hour can be calculated. Furthermore, a method of calculating position and time information using three satellites and correcting the error of the calculated position and time information using another satellite is also used. The GPS module 115 may continuously calculate the current position in real time and use the same to calculate speed information.

Referring to FIG. 1, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame can be displayed on the display module 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the communication unit 110. The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.

The sensing unit 140 detects a current state of the electronic device 100, such as an open / closed state of the electronic device 100, a location of the electronic device 100, presence or absence of a user contact, orientation of the electronic device, acceleration / deceleration of the electronic device, and the like. To generate a sensing signal for controlling the operation of the electronic device 100. For example, when the electronic device 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it may be responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor.

The output unit 150 is for generating output related to visual, auditory or tactile sense and includes a display module 151, an acoustic output module 152, an alarm unit 153, and a haptic module 154 .

The display module 151 displays information processed by the electronic device 100. For example, when the electronic device 100 is in a call mode, the electronic device 100 displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the electronic device 100 is in a video call mode or a photographing mode, the electronic device 100 displays a photographed and / or received image, a UI, or a GUI.

The display module 151 is a liquid crystal display, a thin film transistor liquid crystal display, an organic light emitting diode, a flexible display, or a 3D display. It may include at least one.

Some of these displays can be configured to be transparent or light transmissive so that they can be seen from the outside. This may be referred to as a transparent display. A representative example of the transparent display is a transparent LCD. The rear structure of the display module 151 may also be of a light transmission type. With this structure, the user can see the object located behind the terminal body through the area occupied by the display module 151 of the terminal body.

Two or more display modules 151 may exist according to the implementation form of the electronic device 100. For example, a plurality of display modules may be spaced apart or integrally disposed on one surface of the electronic device 100, or may be disposed on different surfaces.

In a case where the display module 151 and the sensor for sensing the touch operation (hereinafter, referred to as 'touch sensor') have a mutual layer structure (hereinafter referred to as 'touch screen' It can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display module 151 or capacitance generated at a specific portion of the display module 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display module 151 is touched or the like.

Referring to FIG. 1, a proximity sensor may be disposed in an inner region of an electronic device surrounded by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

When the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by the change of the electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch The act of actually touching the pointer on the screen is called "contact touch." The position where the proximity touch is performed by the pointer on the touch screen refers to a position where the pointer is perpendicular to the touch screen when the pointer is in proximity proximity.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 may output audio data received from the communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 152 outputs a sound signal related to a function (for example, a call signal reception sound or a message reception sound) performed in the electronic device 100. The sound output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the electronic device 100. Examples of events occurring in the electronic device include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. The video signal or audio signal may also be output through the display module 151 or the audio output module 152.

The haptic module 154 generates various tactile effects that the user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

In addition to the vibration, the haptic module 154 may be used for the effects of stimulation by the arrangement of pins vertically moving with respect to the contact skin surface, the effect of the injection force of the air through the injection or inlet or the stimulation through the suction force, and the stimulation that rubs the skin surface. Various tactile effects may be generated, such as effects by stimulation through contact of electrodes, effects by stimulation using electrostatic force, and effects of reproducing a sense of warmth and heat using an endothermic or heat generating element.

The haptic module 154 may not only deliver the haptic effect through direct contact, but also implement the haptic effect through the muscle sense of the user's finger or arm. Two or more haptic modules 154 may be provided according to a configuration aspect of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 and may temporarily store input / output data (for example, a phone book, a message, a still image, a video, etc.). The memory 160 may store data regarding vibration and sound of various patterns output when a touch input on the touch screen is performed.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM At least one of a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read- Type storage medium. The electronic device 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path with all external devices connected to the electronic device 100. The interface unit 170 receives data from an external device or receives power and transmits the data to each component in the electronic device 100, or transmits the data inside the electronic device 100 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip that stores various information for authenticating the use authority of the electronic device 100, and includes a user identification module (UIM), a subscriber identify module (SIM), and a universal user authentication module. (Universal Subscriber Identity Module, USIM) and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

The interface unit may be a passage through which power from the cradle is supplied to the electronic device 100 when the electronic device 100 is connected to an external cradle, or various command signals input from the cradle by a user may be used. It can be a passage to the device. Various command signals or power input from the cradle may be operated as signals for recognizing that the electronic device is correctly mounted in the cradle.

The controller 180 typically controls the overall operation of the electronic device. For example, perform related control and processing for voice calls, data communications, video calls, and the like. The controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, microcontrollers, microprocessors, and electrical units for performing functions. In some cases such embodiments may be implemented using a controller 180 < / RTI >

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. In addition, the software codes may be stored in the memory 160 and executed by the control unit 180. [

2 and 3 are views for explaining a stereoscopic image display method using binocular parallax according to an embodiment of the present invention, Figure 2 is a method using a lenticular lens array (lenticular lens array) 3 shows a method of using a parallax barrier.

The binocular parallax refers to the difference in the way the left and right eyes of a person see things. When a human's brain synthesizes the image seen through the left eye and the image seen through the right eye, the synthesized image makes a person feel three-dimensional. In the following description, a phenomenon in which a person feels a stereoscopic sense according to binocular parallax is referred to as 'stereoscopic vision', and an image causing stereoscopic vision is called a 'stereoscopic image'. Also, when a specific object included in the image causes stereoscopic vision, the object is referred to as a 'stereoscopic object'.

The stereoscopic image display method according to binocular disparity is classified into a glasses type that requires special glasses and a glassesless type that do not require glasses. The spectacles include a method using sunglasses with wavelength selectivity, a polarization glasses method using a light blocking effect according to a polarization difference, and a time-division glasses method alternately presenting left and right images within an afterimage time of an eye. In addition, there is a method in which a filter having different transmittances is mounted in the left and right sides to obtain a stereoscopic effect on the movement in the left and right directions according to the time difference of the visual system coming from the difference in the transmittances.

The autostereoscopic method, in which a stereoscopic effect is generated on the image display surface rather than the observer, includes a parallax barrier method, a lenticular lens method, a microlens array method, and the like.

Referring to FIG. 2, the display module 151 includes a lenticular lens array 11a to display a stereoscopic image. The lenticular lens array 11a includes a display surface 13 in which the pixels L to be input to the left eye 12a and the pixels R to be input to the right eye 12b are alternately arranged along the horizontal direction, and the left and right eyes 12a, 12b), and provides optical discrimination directivity for the pixel L to be input to the left eye 12a and the pixel R to be input to the right eye 12b. Accordingly, the image passing through the lenticular lens array 11a is observed separately from the left eye 12a and the right eye 12a, and the human brain is viewed through the left eye 12a and through the right eye 12b. By synthesizing the three-dimensional image.

Referring to FIG. 3, the display module 151 includes a vertical grid parallax barrier 11b to display a stereoscopic image. The parallax barrier 11b includes a display surface 13 and left and right eyes 12a in which pixels L to be input to the left eye 12a and pixels R to be input to the right eye 12b are alternately arranged along the horizontal direction. 12b), the image is separated from the left eye 12a and the right eye 12b through a vertical grid-shaped aperture. Therefore, the human brain synthesizes an image viewed through the left eye 12a and an image viewed through the right eye 12b to observe a stereoscopic image. The parallax barrier 11b is turned on only when a three-dimensional image is to be displayed and is separated from the incident time, and is turned off when a planar image is to be displayed. have.

On the other hand, the above-described three-dimensional image display method for explaining the embodiments of the present invention, the present invention is not limited thereto. The present invention can display a stereoscopic image using binocular disparity using various methods in addition to the above-described method.

4 and 5 are views illustrating an appearance of the electronic device 100 according to an embodiment of the present disclosure. 4 illustrates an example in which the electronic device 100 is a digital camera, and FIG. 5 illustrates an example in which the electronic device 100 is a mobile terminal.

Referring to FIG. 4, the digital camera 100 may be configured of one body. FIG. 4A illustrates a front surface of the digital camera 100 and FIG. 4B illustrates a rear surface of the digital camera 100. A plurality of cameras 121a and 121b may be provided in front of the digital camera 100. In addition, a display module 151 is provided on the back of the digital camera 100, and a user input unit 130 such as a keypad is provided. In addition, a circuit for implementing the controller 180 is provided inside the body of the digital camera 100.

Referring to FIG. 5, the mobile terminal 100 may be configured with one bar type body. FIG. 5A illustrates a front surface of the mobile terminal 100, and FIG. 5B illustrates a rear surface of the mobile terminal 100. The front of the mobile terminal 100 is provided with a display module 151, a user input unit 130, such as a keypad is provided. In addition, a circuit for implementing the controller 180 is provided inside the body of the mobile terminal 100. In addition, a plurality of cameras 121a and 121b may be provided on the rear surface of the mobile terminal 100.

4 and 5 illustrate examples of the appearance of the electronic device 100, and the body shape of the electronic device 100 may vary. For example, the mobile terminal 100 may be implemented as a folder type body. In addition, the position of each component of the electronic device 100 may vary. For example, the first camera 121a of the mobile terminal 100 may be disposed above the rear surface of the body, and the second camera 121b may be disposed below the rear surface of the body.

Meanwhile, the plurality of cameras 121a and 121b provided in the electronic device 100 may be synthesized to generate a stereoscopic image according to binocular parallax.

6 illustrates an example of obtaining a plurality of images for generating a stereoscopic image according to binocular disparity using a plurality of cameras 121a and 121b provided in the electronic device 100 according to an embodiment of the present disclosure. It is.

Referring to FIG. 6, FIG. 6A illustrates an example of acquiring a right eye image through the first camera 121a for the same object 6a, and FIG. 6B illustrates a second image. An example of acquiring the left eye image through the camera 121b is illustrated.

As shown in FIG. 6, the electronic device 100 obtains a left eye image and a right eye image having different parallaxes through a plurality of cameras 121a and 121b, and acquires the obtained left eye image and right eye image. Synthesize to generate a stereoscopic image.

An embodiment disclosed in this document may be implemented in the electronic device 100 described with reference to FIGS. 1 to 6.

Hereinafter, a method of controlling the electronic device 100 and an operation of the electronic device 100 performing the same will be described in detail with reference to the accompanying drawings.

7 is a flowchart illustrating a control method of the electronic device 100 according to an embodiment of the present disclosure.

Referring to FIG. 7, the controller 180 receives a first image corresponding to a left eye image and a second image corresponding to a right eye image through a plurality of cameras 121a and 121b (S101). In operation S102, a preview image acquired through at least one of the plurality of cameras 121a and 121b is displayed on the display area of the display module 151. That is, the first image input through the first camera 121a or the second image input through the second camera 121b is displayed as a preview image, or the image overlapping the first image and the second image. Can be displayed as a preview image.

8 to 15 are diagrams illustrating examples in which the electronic device 100 displays a preview image.

FIG. 8 illustrates an example of displaying, as a preview image, an image synthesized by overlapping a first image input through a first camera 121a or a second image input through a second camera 121b. Referring to FIG. 8, an image 8a obtained by overlapping a first image input through the first camera 121a or a second image input through the second camera 121b is displayed as a preview image.

On the other hand, when photographing a near object with the camera 121, even if the same object, the display position in the first image and the display position in the second image may be much different. FIG. 9 illustrates another example in which a first image input through the first camera 121a or a second image input through the second camera 121b is superimposed and displayed as a preview image. Indicates when shooting an object. Referring to FIG. 9, the display positions of the object 9a in the first image and the second image photographing the same object 9a are much different from each other. Accordingly, when a user wants to select an object by touching an object included in the preview image, the object of the first image and the object of the second image displayed on the touched point may be different from each other. Accordingly, a plurality of objects may be located at the touched point in the preview image.

Accordingly, in an exemplary embodiment of the present invention, an image input through any one of the plurality of cameras 121a and 121b is displayed on the screen as a preview image or a plurality of images input through the plurality of cameras 121a and 121b. Images may be distinguished from each other and displayed as preview images. In addition, an image and a stereoscopic image input through any one of the plurality of cameras 121a and 121b may be displayed as a preview image.

FIG. 10 illustrates an example of displaying an image input through one of the plurality of cameras 121a and 121b as a preview image. Referring to FIG. 10, a first image 10a input through the first camera 121a is displayed in the display area. Accordingly, the controller 180 controls the depth value of the stereoscopic image based on the object selected in the first image 10a.

11 to 13 illustrate examples in which a plurality of images input through a plurality of cameras 121a and 121b are distinguished from each other and displayed as a preview image. Referring to FIG. 11, the display area is divided into a first display area 11a and a second display area 11b. In addition, a first image 10a input through the first camera 121a is displayed on the first display area 11a, and a second image input through the second camera 121b is displayed on the second display area 11b. Image 10b is displayed. Accordingly, the controller 180 controls the depth value of the stereoscopic image based on the object selected from the first image 10a or the second image 10b. A method of dividing the display area shown in FIG. 12 into the first display area 11a and the second display area 11b is, for example, the display area as the first display area 11a and the second display area 11b. How to distinguish may vary. In addition, the first display area 11a and the second display area 11b may be logically divided one display area, or may be physically divided display areas.

Referring to FIG. 12, when the controller 180 displays the first image 10a and the second image 10b separately from each other and displays them as a preview image, the controller 180 displays the images from the respective images 10a and 10b when the stereoscopic image is generated. The included area 12 may be displayed. Accordingly, the user can intuitively recognize the area included in the stereoscopic image.

Meanwhile, the display positions of the first image 10a and the second image 10b illustrated in FIG. 11 may be different from those of the first image 10a and the second image 10b, for example. In addition, the display positions of the first image 10a and the second image 10b may be changed by user manipulation.

FIG. 13 illustrates an example in which the display positions of the first image 10a and the second image 10b are changed by a user manipulation.

Referring to FIG. 13, a first image 10a input through the first camera 121a is displayed on the first display area 11a, and a second camera 121b is displayed on the second display area 11b. The input second image 10b is displayed (S201).

Subsequently, as the drag input started in the second display area 11b and terminated in the first display area 11b is input by the user, the controller 180 controls the second camera 121b in the first display area 11a. In operation S202, the second image 10b input through the first camera 1010 is displayed on the second display area 11b.

14 and 15 illustrate an example in which an image and a stereoscopic image input through any one of the plurality of cameras 121a and 121b are displayed as preview images.

Referring to FIG. 14, the first image 10a input through the first camera 121a is displayed in the first display area 11a, and the first image 10a and the first image are displayed in the second display area 11b. The stereoscopic image 10c generated by synthesizing the two images 10b is displayed. Here, the stereoscopic image 10c is a preview image of the stereoscopic image stored in the memory 160 at the time of photographing, and is displayed by an autostereoscopic stereoscopic image display method. According to an embodiment of the present invention, the display module 151 includes a panel for displaying a stereoscopic image by any one of the above-described lenticular lens method or parallax barrier method. It is also possible to partially turn the panel ON / OFF. That is, the display module 151 may control the stereoscopic image to be displayed without glasses in only one of the first display area 11a and the second display area 11b.

According to FIG. 14, the controller 180 controls the depth value of the stereoscopic image 10c displayed on the second display area 11b based on the object selected in the first image 10a. Therefore, the user can intuitively check that the depth value of the stereoscopic image is changed by selecting an object.

On the other hand, the display position of the first image 10a and the stereoscopic image 10c illustrated in FIG. 14 may be, for example, the display positions of the first image 10a and the stereoscopic image 10c different. In addition, the display positions of the first image 10a and the stereoscopic image 10c may be changed by user manipulation.

FIG. 15 illustrates an example in which display positions of the first image 10a and the stereoscopic image 10c are changed by a user operation.

Referring to FIG. 15, the first image 10a is displayed on the first display area 11a and the stereoscopic image 10c is displayed on the second display area 11b (S301).

Subsequently, as the drag input started in the second display area 11b and terminated in the first display area 11b is input by the user, the controller 180 controls the stereoscopic image 10c in the first display area 11a. Is displayed and the display module 151 is controlled to display the stereoscopic image 10c in the second display area 11b (S302).

Meanwhile, in the embodiment of the present invention, the preview image display method may be automatically switched when photographing a close object and when photographing a remote object. For example, when capturing a remote object, the preview image may be displayed by the method illustrated in FIG. 8, and when capturing the near object, the preview image may be displayed by the method described with reference to FIGS. 10 to 15. The method for determining whether the distance to the object to be photographed is far or near is a well-known technique and can be easily performed by a person skilled in the art, and thus detailed description thereof will be omitted.

Referring back to FIG. 7, when a specific object included in the preview image is selected while the preview image is displayed on the screen (S103), the controller 180 controls the depth value of the stereoscopic image based on the selected object (S104). . That is, when synthesizing the first image and the second image to generate a stereoscopic image, the stereoscopic image controls the depth value by controlling the parallax between the two images based on the selected object. The parallax between the two images can be controlled by varying the positions where the two images are synthesized when the two images are synthesized.

16 and 17 illustrate examples of selecting a specific object in the preview image.

Referring to FIG. 16, an image 16a obtained by overlapping a first image input through the first camera 121a or a second image input through the second camera 121b is displayed as a preview image. When a point 16b of the display area is touched while the preview image is displayed, the controller 180 selects an object 16c displayed at the touched point 16b among objects included in the preview image.

Referring to FIG. 17, a first image 10a input through the first camera 121a is displayed on the first display area 11a, and a second camera 121b is displayed on the second display area 11b. The input second image 10b is displayed. When a point 17a of the first display area 121a is touched while the preview image is displayed, the controller 180 is displayed at the touched point 17a of the objects included in the first image 10a. Select object 17c.

Accordingly, the controller 180 displays an icon 17d indicating that the corresponding object is selected in the display area of the same object 17c 'as the selected object 17c among the objects included in the second image 10b. . That is, the selected object 17c 'is also displayed on the second image 10b. Accordingly, the user can intuitively recognize that the object selection is made correctly.

FIG. 17 illustrates an example of displaying the selected object 17c 'on the second image 10b. The method of displaying the selected object 17c' among the objects included in the second image 10b may vary. Can be. For example, the controller 180 may control the contour of the selected object 17c 'and display the distinguished object from other objects. In addition, for example, the controller 180 may control to display a 3D effect of the selected object 17c 'to be distinguished from other objects.

18 illustrates an example in which a depth value of a stereoscopic image is changed based on an object selected in the preview image.

FIG. 18A illustrates a stereoscopic image before an object is selected and FIG. 18B illustrates a stereoscopic image after an object is selected. Referring to FIG. 18, as the first object 11a is selected from among the stereoscopic objects 18a, 18b, and 18c included in the stereoscopic image (a), the controller 180 controls the stereoscopic image of the first object 11a. The parallax is controlled such that the depth value is a reference depth value 18d, for example, "0".

Conventionally, when taking a stereoscopic image, a user changes a depth value of a stereoscopic image by moving a position where a left image and a right image are synthesized by one pixel through a button operation. However, according to the above-described embodiments of the present disclosure, the user may change the depth value of the stereoscopic image only by selecting an object as a reference. Therefore, the user's convenience is increased.

The method for controlling an electronic device according to the present invention described above may be provided by recording on a computer-readable recording medium as a program for executing in a computer.

The control method of an electronic device according to the present invention can be executed through software. When implemented in software, the constituent means of the present invention are code segments that perform the necessary work. The program or code segments may be stored in a processor readable medium or transmitted by a computer data signal coupled with a carrier in a transmission medium or communication network.

The computer-readable recording medium includes a mode type recording device in which data that can be read by a computer system is stored. Examples of computer-readable recording devices include ROM, RAM, CD-ROM, DVD-ROM, DVD-RAM, magnetic tape, floppy disks, hard disks, optical data storage devices, and the like. The computer readable recording medium can also be distributed over network coupled computer devices so that the computer readable code is stored and executed in a distributed fashion.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. The present invention is not limited to the drawings, and all or some of the embodiments may be selectively combined so that various modifications may be made.

Claims (14)

Display module;
A plurality of cameras for acquiring an external image; And
Synthesizing a first image and a second image obtained through the plurality of cameras to generate a stereoscopic image, and displays a third image obtained through at least one of the plurality of cameras through the display module, A controller configured to vary a depth value of the stereoscopic image based on a specific object selected from a third image
.
The method of claim 1,
The controller may vary the depth value of the stereoscopic image such that the depth in the stereoscopic image of the selected specific object becomes a specific depth value.
The method of claim 2,
The controller may vary the depth value of the stereoscopic image by varying a synthesis position of the first image and the second image.
The method of claim 1,
The display module includes a touch screen,
The controller selects the specific object based on a point touched on the touch screen.
The method of claim 1,
And the third image is a composite image of the first image and the second image.
The method of claim 1,
And the third image is the first image.
The method of claim 6,
The controller may display the first image in a first area of the display area of the display module, and display the second image in the second area.
The method of claim 7, wherein
The controller is further configured to display a location of an object identical to the specific object among the objects included in the second image on the second image as the specific object is selected in the first image.
The method of claim 7, wherein
The control unit displays an area included in the stereoscopic image for each of the first image and the second image.
The method of claim 6,
The controller is configured to display the first image in a first area of the display area of the display module and to display the stereoscopic image in the second area.
The method of claim 10,
The display module includes a touch screen,
And the controller is configured to exchange and display an image displayed in the first area and the second area based on a touch input received through the touch screen.
In the control method of an electronic device including a plurality of cameras,
Generating a stereoscopic image by synthesizing a first image and a second image acquired through the plurality of cameras;
Displaying a third image acquired through at least one camera of the plurality of cameras; And
If a specific object is selected in the third image, varying a depth value of the stereoscopic image based on the selected specific object
Control method comprising a.
The method of claim 12,
The variable step,
Varying a depth value of the stereoscopic image such that a depth in the stereoscopic image of the selected specific object becomes a specific depth value
Control method comprising a.
The method of claim 12,
Selecting the specific object located at the specific point as the specific point of the third image is touched
Control method characterized in that it further comprises.

Images