KR20120057696A - Electronic device and control method for electronic device - Google Patents

Abstract

PURPOSE: An electronic device and a control method thereof are provided to increase convenience of a user in generating a 3D image. CONSTITUTION: A control unit receives a first image and a second image through cameras(S101). If a specific object of a preview image is selected when the preview image is displayed on a screen, the control unit varies a depth value of a 3D image based on the selected object. If zoom states of the cameras are changed, the control unit varies the depth value of the 3D image based on the changed zoom states(S105,S106).

Description

Electronic device and control method for electronic device

The present invention relates to an electronic device and a control method of the electronic device.

In recent years, the movement of providing 3D stereoscopic images in electronic devices has become more active. For this purpose, it is considered to improve the structural part and / or software part of the terminal.

An object of the present invention is to provide an electronic device and a control method of the electronic device to increase the convenience of the user when generating a stereoscopic image.

An electronic device according to an aspect of the present invention includes a plurality of cameras for acquiring an external image; And

A control unit configured to generate a stereoscopic image by synthesizing the first image and the second image acquired through the plurality of cameras, and varying a depth value of the stereoscopic image based on a zoom state of the plurality of cameras; Include.

In addition, an electronic device according to another aspect of the present invention, a plurality of cameras for acquiring an external image; And generating a stereoscopic image by synthesizing the first image and the second image acquired through the plurality of cameras, and when the distance between the plurality of points multi-touched on the touch screen is changed, the stereoscopic image of the stereoscopic image is based on the changed distance. It includes a control unit for varying the depth value.

In addition, an electronic device according to another aspect of the present invention, a touch screen; A plurality of cameras for acquiring an external image; And generating a stereoscopic image by synthesizing the first image and the second image acquired through the plurality of cameras, displaying a scroll object on the touch screen, and based on the position of the scroll object, the first image and the second image. It includes a control unit for varying the synthesis position of the image.

In addition, an electronic device according to another aspect of the present invention, a display module; A plurality of cameras for acquiring an external image; And generating a stereoscopic image by synthesizing the first image and the second image acquired through the plurality of cameras, and displaying the third image obtained by using at least one of the first image and the second image. And a controller configured to display through the module and to change a depth value of the stereoscopic image based on the movement of a specific object selected from the third image.

Also, a control method of an electronic device according to an aspect of the present invention may include: generating a stereoscopic image by synthesizing a first image and a second image acquired through a plurality of cameras; And varying a depth value of the stereoscopic image based on the zoom state of the plurality of cameras.

Also, a control method of an electronic device according to another aspect of the present invention may include generating a stereoscopic image by synthesizing a first image and a second image acquired through a plurality of cameras; And varying a depth value of the stereoscopic image based on the movement of a specific object selected from the stereoscopic image.

The electronic device and the method for controlling the electronic device according to the present invention have the effect of increasing the user's convenience when generating a stereoscopic image.

1 is a block diagram of an electronic device according to embodiments of the present disclosure.
2 and 3 are views for explaining a stereoscopic image display method using a binocular parallax associated with embodiments of the present invention.
4 and 5 are views illustrating an appearance of an electronic device according to embodiments of the present disclosure.
6 illustrates an example of obtaining a plurality of images for generating a stereoscopic image according to binocular disparity using a plurality of cameras provided in an electronic device according to an embodiment of the present disclosure.
7 is a flowchart illustrating a control method of the electronic device 100 according to the first embodiment of the present disclosure.
8 illustrates an example of displaying a preview image of a stereoscopic image on a screen of the electronic device 100 in the electronic device 100 according to the first embodiment of the present disclosure.
9 illustrates an example of selecting a specific object from a preview image in the electronic device 100 according to the first embodiment of the present disclosure.
FIG. 10 illustrates an example of automatically changing a depth value of a stereoscopic image as the zoom state of the cameras 121a and 121b is changed in the electronic device 100 according to the first embodiment of the present disclosure.
11 is a flowchart illustrating a control method of the electronic device 100 according to a second embodiment of the present disclosure.
FIG. 12 illustrates an example of changing a depth value of a stereoscopic image based on a change in distance between a plurality of points that are multi-touched in the electronic device 100 according to the second embodiment of the present disclosure.
13 is a flowchart illustrating a control method of the electronic device 100 according to a third embodiment of the present disclosure.
14 illustrates an example of displaying a scroll object in the electronic device 100 according to the third embodiment of the present disclosure.
15 and 16 illustrate examples of changing a depth value of a stereoscopic image based on the position of a scroll object in the electronic device 100 according to the third embodiment of the present disclosure.
17 is a flowchart illustrating a control method of the electronic device 100 according to a fourth embodiment of the present disclosure.
FIG. 18 illustrates an example of controlling a depth value of a stereoscopic image based on the movement of a selected object in the electronic device 100 according to the fourth embodiment of the present disclosure.

The above objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. It is to be understood, however, that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and similarities. Like reference numerals designate like elements throughout the specification. In addition, when it is determined that the detailed description of the known function or configuration related to the present invention may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. In addition, numerals (e.g., days, days, etc.) used in the description of the present invention are merely an identifier for distinguishing one component from another component

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

In addition, the suffixes "module" and "unit" for the components used in the following description are given or mixed in consideration of ease of specification, and do not have distinct meanings or roles from each other.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

Meanwhile, according to an embodiment of the present invention, an electronic device may include a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, and a television. ), A desktop computer, a set-top box, a digital camera, or the like.

1 is a block diagram of an electronic device according to embodiments of the present disclosure.

The electronic device 100 includes a communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, and an interface unit. 170, the controller 180, and the power supply 190 may be included. Since the components shown in FIG. 1 are not essential, an electronic device having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The communication unit 110 may include one or more modules that enable communication between the electronic device 100 and the communication system or between the electronic device 100 and a network in which the electronic device 100 is located. For example, the communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like.

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video BroadcastHandheld (DVBH).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems. In particular, the broadcast receiving module 111 may be a digital multimedia broadcasting broadcasting (DMBT), a digital multimedia broadcasting satellite (DMBS), a media forward link only (MediaFLO), a digital video broadcasting ), And ISDBT (Integrated Services Digital Broadcast Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems that provide broadcast signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless internet module 113 refers to a module for wireless internet access, and the wireless internet module 113 may be internal or external to the electronic device 100. WLAN (WiFi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The location information module 115 is a module for checking or obtaining the location of the electronic device. A representative example of the location information module is a GPS (Global Position System) module. According to the current technology, the GPS module 115 calculates information on a distance (distance) from three or more satellites to one point (entity), information on the time when the distance information is measured, , Three-dimensional position information according to latitude, longitude, and altitude of one point (individual) in one hour can be calculated. Furthermore, a method of calculating position and time information using three satellites and correcting the error of the calculated position and time information using another satellite is also used. The GPS module 115 continues to calculate the current position in real time and uses it to calculate speed information.

Referring to FIG. 1, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame can be displayed on the display module 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the communication unit 110. The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.

The sensing unit 140 detects a current state of the electronic device 100, such as an open / closed state of the electronic device 100, a location of the electronic device 100, presence or absence of a user contact, orientation of the electronic device, acceleration / deceleration of the electronic device, and the like. To generate a sensing signal for controlling the operation of the electronic device 100. For example, when the electronic device 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it may be responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor.

The output unit 150 is for generating output related to visual, auditory or tactile sense and includes a display module 151, an acoustic output module 152, an alarm unit 153, and a haptic module 154 .

The display module 151 displays information processed by the electronic device 100. For example, when the electronic device 100 is in a call mode, the electronic device 100 displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the electronic device 100 is in a video call mode or a photographing mode, the electronic device 100 displays a photographed and / or received image, a UI, or a GUI.

The display module 151 is a liquid crystal display, a thin film transistor liquid crystal display, an organic light emitting diode, a flexible display, or a 3D display. It may include at least one.

Some of these displays can be configured to be transparent or light transmissive so that they can be seen from the outside. This may be referred to as a transparent display. A representative example of the transparent display is a transparent LCD. The rear structure of the display module 151 may also be of a light transmission type. With this structure, the user can see the object located behind the terminal body through the area occupied by the display module 151 of the terminal body.

Two or more display modules 151 may exist according to the implementation form of the electronic device 100. For example, a plurality of display modules may be spaced apart or integrally disposed on one surface of the electronic device 100, or may be disposed on different surfaces.

In a case where the display module 151 and the sensor for sensing the touch operation (hereinafter, referred to as 'touch sensor') have a mutual layer structure (hereinafter referred to as 'touch screen' It can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display module 151 or capacitance generated at a specific portion of the display module 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display module 151 is touched or the like.

Referring to FIG. 1, a proximity sensor may be disposed in an inner region of an electronic device surrounded by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch The act of actually touching the pointer on the screen is called "contact touch." The position where the proximity touch is performed by the pointer on the touch screen refers to a position where the pointer is perpendicular to the touch screen when the pointer is in proximity proximity.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 may output audio data received from the communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 152 outputs a sound signal related to a function (for example, a call signal reception sound or a message reception sound) performed in the electronic device 100. The sound output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the electronic device 100. Examples of events occurring in the electronic device include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. The video signal or audio signal may also be output through the display module 151 or the audio output module 152.

The haptic module 154 generates various tactile effects that the user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may be used for the effects of stimulation by the arrangement of pins vertically moving with respect to the contact skin surface, the effect of the injection force of the air through the injection or inlet or the stimulation through the suction force, and the stimulation that rubs the skin surface. Various tactile effects may be generated, such as effects by stimulation through contact of electrodes, effects by stimulation using electrostatic force, and effects of reproducing a sense of warmth and heat using an endothermic or heat generating element.

The haptic module 154 may not only deliver the haptic effect through direct contact, but also implement the haptic effect through the muscle sense of the user's finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The memory 160 may store a program for the operation of the controller 180 and may temporarily store input / output data (for example, a phone book, a message, a still image, a video, etc.). The memory 160 may store data relating to various patterns of vibration and sound output when a touch input on the touch screen is performed.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM At least one of a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read- Type storage medium. The electronic device 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path with all external devices connected to the electronic device 100. The interface unit 170 receives data from an external device or receives power and transmits the data to each component in the electronic device 100, or transmits the data inside the electronic device 100 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip that stores various information for authenticating the use authority of the electronic device 100, and includes a user identification module (UIM), a subscriber identify module (SIM), and a universal user authentication module. (Universal Subscriber Identity Module, USIM) and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

The interface unit may be a passage through which power from the cradle is supplied to the electronic device 100 when the electronic device 100 is connected to an external cradle, or various command signals input from the cradle by a user may be used. It can be a passage to the device. Various command signals or power input from the cradle may be operated as signals for recognizing that the electronic device is correctly mounted in the cradle.

The controller 180 typically controls the overall operation of the electronic device. For example, perform related control and processing for voice calls, data communications, video calls, and the like. The controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, microcontrollers, microprocessors, and electrical units for performing functions. In some cases such embodiments may be implemented using a controller 180 < / RTI >

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. In addition, the software codes may be stored in the memory 160 and executed by the control unit 180. [

2 and 3 are views for explaining a stereoscopic image display method using binocular parallax associated with embodiments of the present invention, Figure 2 is a method using a lenticular lens array (lenticular lens array) 3 shows a method of using a parallax barrier.

The binocular parallax refers to the difference in the way the left and right eyes of a person see things. When a human's brain synthesizes the image seen through the left eye and the image seen through the right eye, the synthesized image makes a person feel three-dimensional. In the following description, a phenomenon in which a person feels a stereoscopic sense according to binocular parallax is referred to as 'stereoscopic vision', and an image causing stereoscopic vision is called a 'stereoscopic image'. Also, when a specific object included in the image causes stereoscopic vision, the object is referred to as a 'stereoscopic object'.

The stereoscopic image display method according to binocular disparity is classified into a glasses type that requires special glasses and a glassesless type that do not require glasses. The spectacles include a method using sunglasses with wavelength selectivity, a polarization glasses method using a light blocking effect according to a polarization difference, and a time-division glasses method alternately presenting left and right images within an afterimage time of an eye. In addition, there is a method in which a filter having different transmittances is mounted in the left and right sides to obtain a stereoscopic effect on the movement in the left and right directions according to the time difference of the visual system coming from the difference in the transmittances.

The autostereoscopic method, in which a stereoscopic effect is generated on the image display surface rather than the observer, includes a parallax barrier method, a lenticular lens method, a microlens array method, and the like.

Referring to FIG. 2, the display module 151 includes a lenticular lens array 11a to display a stereoscopic image. The lenticular lens array 11a includes a display surface 13 in which the pixels L to be input to the left eye 12a and the pixels R to be input to the right eye 12b are alternately arranged along the horizontal direction, and the left and right eyes 12a, 12b), and provides optical discrimination directivity for the pixel L to be input to the left eye 12a and the pixel R to be input to the right eye 12b. Accordingly, the image passing through the lenticular lens array 11a is observed separately from the left eye 12a and the right eye 12a, and the human brain is viewed through the left eye 12a and through the right eye 12b. By synthesizing the three-dimensional image.

Referring to FIG. 3, the display module 151 includes a vertical grid parallax barrier 11b to display a stereoscopic image. The parallax barrier 11b includes a display surface 13 and left and right eyes 12a in which pixels L to be input to the left eye 12a and pixels R to be input to the right eye 12b are alternately arranged along the horizontal direction. 12b), the image is separated from the left eye 12a and the right eye 12b through a vertical grid-shaped aperture. Therefore, the human brain synthesizes an image viewed through the left eye 12a and an image viewed through the right eye 12b to observe a stereoscopic image. The parallax barrier 11b is turned on only when a three-dimensional image is to be displayed and is separated from the incident time, and is turned off when a planar image is to be displayed. have.

On the other hand, the above-described three-dimensional image display method for explaining the embodiments of the present invention, the present invention is not limited thereto. The present invention can display a stereoscopic image using binocular disparity using various methods in addition to the above-described method.

4 and 5 illustrate examples of the electronic device 100 according to embodiments of the present disclosure. 4 illustrates the appearance of the electronic device 100 as a digital camera, and FIG. 5 illustrates the appearance of the electronic device 100 as a mobile terminal.

Referring to FIG. 4, the digital camera 100 may be configured of one body. FIG. 4A illustrates a front surface of the digital camera 100 and FIG. 4B illustrates a rear surface of the digital camera 100. A plurality of cameras 121a and 121b may be provided in front of the digital camera 100. In addition, a display module 151 is provided on the back of the digital camera 100, and a user input unit 130 such as a keypad is provided. In addition, a circuit for implementing the controller 180 is provided inside the body of the digital camera 100.

Referring to FIG. 5, the mobile terminal 100 may be configured with one bar type body. FIG. 5A illustrates a front surface of the mobile terminal 100, and FIG. 5B illustrates a rear surface of the mobile terminal 100. The front of the mobile terminal 100 is provided with a display module 151, a user input unit 130, such as a keypad is provided. In addition, a circuit for implementing the controller 180 is provided inside the body of the mobile terminal 100. In addition, a plurality of cameras 121a and 121b may be provided on the rear surface of the mobile terminal 100.

4 and 5 illustrate examples of the appearance of the electronic device 100, and the body shape of the electronic device 100 may vary. For example, the mobile terminal 100 may be implemented as a folder type body. In addition, the position of each component of the electronic device 100 may vary. For example, the first camera 121a of the mobile terminal 100 may be disposed above the rear surface of the body, and the second camera 121b may be disposed below the rear surface of the body.

Meanwhile, the plurality of cameras 121a and 121b provided in the electronic device 100 may be synthesized to generate a stereoscopic image according to binocular parallax.

FIG. 6 illustrates an example of obtaining a plurality of images for generating a stereoscopic image according to binocular disparity using a plurality of cameras 121a and 121b in the electronic device 100 according to embodiments of the present disclosure.

Referring to FIG. 6, FIG. 6A illustrates an example of acquiring a right eye image through the first camera 121a for the same object 6a, and FIG. 6B illustrates a second image. An example of acquiring the left eye image through the camera 121b is illustrated.

As shown in FIG. 6, the electronic device 100 obtains a left eye image and a right eye image having different parallaxes through a plurality of cameras 121a and 121b, and acquires the obtained left eye image and right eye image. Synthesize to generate a stereoscopic image.

Embodiments disclosed in this document may be implemented in the electronic device 100 described with reference to FIGS. 1 to 6.

Hereinafter, a method of controlling the electronic device 100 and an operation of the electronic device 100 performing the same will be described in detail with reference to the accompanying drawings.

7 is a flowchart illustrating a control method of the electronic device 100 according to the first embodiment of the present disclosure. 8 to 10 are diagrams for describing a control method of the electronic device 100 according to the first embodiment of the present disclosure.

Referring to FIG. 7, the controller 180 receives a first image corresponding to a left eye image and a second image corresponding to a right eye image through a plurality of cameras 121a and 121b (S101). In addition, a preview image is obtained through at least one camera of the plurality of cameras 121a and 121b and the obtained preview image is displayed on the display area of the display module 151 (S102). The preview image may be a first image input through the first camera 121a or a second image input through the second camera 121b. Also, the preview image may be an image obtained by overlapping the first image and the second image. When the preview image displayed on the display area is a composite image of the first image and the second image, this may be a preview image of the stereoscopic image generated by the electronic device 100.

8 illustrates an example of displaying a preview image of a stereoscopic image on a screen of the electronic device 100.

Referring to FIG. 8, the controller 180 displays an image 8 obtained by combining the first image input through the first camera 121a and the second image input through the second camera 121b. To display a preview image. That is, the controller 180 displays a preview image on the screen of the electronic device 100 so that a user can confirm in advance a stereoscopic image generated by the electronic device 100.

Referring back to FIG. 7, when a specific object included in the preview image is selected while the preview image is displayed on the screen (S103), the controller 180 controls the depth value of the stereoscopic image based on the selected object (S104). . That is, the parallax between the first image and the second image used to generate the stereoscopic image is controlled based on the depth value in the stereoscopic image of the selected object. The parallax between two images can be controlled by varying the convergence point of the two images.

FIG. 9 illustrates an example of selecting a specific object in the preview image illustrated in FIG. 8.

Referring to FIG. 9, as the controller 180 touches a region where a specific object 9a is displayed in the preview image 8 displayed on the touch screen 151, a depth of the stereoscopic image is based on the touched object 9a. Control the value. That is, the depth value of the stereoscopic image is controlled such that the depth value in the stereoscopic image of the selected object 9a becomes a reference value, for example, “0 position”. The controller 180 may change the depth value of the stereoscopic image so that the depth value in the stereoscopic image of the selected object 9a becomes a desired value, and the first image and the second camera 121b input through the first camera 121a. Control the position of synthesizing the second image inputted through.

FIG. 9 illustrates an example in which a user selects an object that is a reference for depth value control of a stereoscopic image by touching an area where a specific object 8a is displayed. However, the present invention is not limited thereto. In the present invention, it is also possible for the controller 180 to extract objects by analyzing images inputted through a plurality of cameras, and to select a specific object as a reference for changing a depth value of a stereoscopic image among the extracted objects. . In addition, in FIG. 9, a case where the display module 151 is implemented as a touch screen has been described as an example, but the present invention is not limited thereto.

Referring back to FIG. 7, when the zoom state of the plurality of cameras 121a and 121b is changed (S105), the controller 180 controls the depth value of the stereoscopic image based on the changed zoom state. In other words, the parallax of the first image and the second image is controlled by varying the synthesis position of the first image and the second image (S106).

When the optical zoom state of the cameras 121a and 121b is changed by the controller 180, the parallax between the plurality of cameras 121a and 121b, that is, the composition position between the images is changed. Therefore, the controller 180 needs to compensate for the change in the synthesis position according to the change in the zoom state of the cameras 121a and 121b. To this end, when the zoom state of the cameras 121a and 121b is changed, the controller 180 obtains a changed composition position of the first image and the second image based on the changed zoom state. . Based on this, the change of the synthesis position according to the change of the zoom state is compensated. That is, the synthesized position of the first image and the second image is varied so that the depth value in the stereoscopic image of the object set as the reference value becomes a reference value in step S104. Here, the reference value of the depth value in the stereoscopic image may be a value changed as the zoom state is changed. That is, the value may vary depending on the zoom level of the cameras 121a and 121b.

FIG. 10 illustrates an example of automatically changing a depth value of a stereoscopic image as the zoom state of the cameras 121a and 121b is changed.

Referring to FIG. 10, a composite image of a first image and a second image is displayed as a preview image 8, and a depth value of a stereoscopic image is changed based on a specific object 8a selected from the preview image 8 ( S201). Subsequently, as the optical zoom state of the cameras 121a and 121b is changed, the synthesis position of the first image and the second image is changed, thereby changing the depth value of the stereoscopic image (S202). Accordingly, the controller 180 controls the combined position of the first image and the second image based on the changed zoom state, and adjusts the depth value of the stereoscopic image again (S203). That is, the combined position of the first image and the second image is varied so that the depth value in the stereoscopic image of the object 8a becomes a reference value corresponding to the changed zoom state. Here, the reference value may be selected according to the zoom degree of the cameras 121a and 121b.

Conventionally, when the optical zoom state of the cameras 121a and 121b for acquiring images used to generate stereoscopic images is changed during stereoscopic image capturing, the user may select a position at which the left and right images are synthesized through a button operation. It was necessary to reset the depth value of the stereoscopic image by shifting the pixel by pixel. However, according to the first embodiment of the present disclosure described above, when the zoom state is changed, the electronic device 100 may automatically change the depth value of the stereoscopic image based on the changed zoom state. Therefore, the user's convenience is increased.

Hereinafter, a method of controlling the electronic device 100 and an operation of the electronic device 100 performing the same according to the second embodiment of the present invention will be described in detail with reference to the accompanying drawings.

11 is a flowchart illustrating a control method of the electronic device 100 according to a second embodiment of the present disclosure. 12 is a diagram for describing a method of controlling the electronic device 100 according to the second embodiment of the present disclosure.

Referring to FIG. 11, the controller 180 receives a first image corresponding to a left eye image and a second image corresponding to a right eye image through the plurality of cameras 121a and 121b (S301). The preview image is displayed on the display area of the display module 151 by using the inputted first image and the second image (S302). That is, the first image input through the first camera 121a and the second image input through the second camera 121b are superimposed and synthesized to generate a preview image of the stereoscopic image, and the Display on the screen.

Subsequently, when a multi-touch input for a plurality of points of the display area is received (S303), the controller 180 checks whether the distance between the plurality of multi-touched points is changed (S304). To this end, the controller 180 obtains the positions of the plurality of points that are multi-touched, and obtains the distance between the plurality of points that are multi-touched based on this. Here, the multi-touch refers to a state in which the controller 180 receives a touch input for at least two points in the display area. In order to receive a multi-touch input, the display module 151 according to the second embodiment of the present invention needs to be implemented as a touch screen.

When the distance between the plurality of multi-touched points is changed, that is, when a drag input starting from at least one of the plurality of multi-touched points is received, the controller 180 changes the depth value of the stereoscopic image based on the changed distance. (S305). That is, the depth value of the stereoscopic image is increased or decreased by varying the synthesis position of the first image and the second image. As the depth value of the stereoscopic image is changed, the preview image displayed on the screen of the electronic device 100 through the display module 151 is also displayed with a variable depth value. Accordingly, the user can intuitively check the depth value of the stereoscopic image which is changed through the multi-touch.

FIG. 12 illustrates an example of changing a depth value of a stereoscopic image based on a change in distance between a plurality of points that are multi-touched in the electronic device 100 according to the second embodiment of the present disclosure.

Referring to FIG. 12, the controller 180 displays a stereoscopic image obtained by synthesizing a first image and a second image on the touch screen 151 as a preview image 12. Thereafter, the controller 180 receives a drag input starting from at least one point of the plurality of multi-touch points in the multi-touch state of the touch screen 151. For example, a drag input using at least one finger among fingers that multi-touch the display area is received (S401). Accordingly, the controller 180 continuously acquires the positions of the plurality of multi-touched points, and calculates a distance change between the plurality of multi-touched points using the positions. The depth value of the stereoscopic image is changed based on the changed distance between the plurality of points that are multi-touched. That is, the synthesis position of the first image and the second image used to generate the stereoscopic image is changed (S402).

According to the second embodiment of the present invention, when the user wants to vary the depth value of the stereoscopic image, the user sets the depth value of the stereoscopic image to a desired value only by multi-touching the display area and moving the touched finger. It is possible. Therefore, compared to the conventional method of setting the depth value of the stereoscopic image by changing the composition position by one pixel through a button operation, the user convenience is increased.

Hereinafter, a method of controlling the electronic device 100 and an operation of the electronic device 100 performing the same according to the third embodiment of the present invention will be described in detail with reference to the accompanying drawings.

13 is a flowchart illustrating a control method of the electronic device 100 according to a third embodiment of the present disclosure. 14 to 16 are diagrams for describing a control method of the electronic device 100 according to the third embodiment of the present disclosure.

Referring to FIG. 13, the controller 180 receives a first image corresponding to a left eye image and a second image corresponding to a right eye image through the plurality of cameras 121a and 121b (S501). The preview image is displayed on the display area of the display module 151 by using the inputted first image and the second image (S502). That is, the first image input through the first camera 121a and the second image input through the second camera 121b are superimposed and synthesized to generate a preview image of the stereoscopic image, and the Display on the screen. In the third embodiment of the present invention, the display module 151 is implemented as a touch screen.

The controller 180 also displays a scroll object superimposed on the preview image (S503). Here, when the state of the electronic device 100 becomes a specific state, for example, the controller 180 may automatically display a scroll object when the preview image is displayed. It can also display scroll objects when requested. Scroll objects include scroll bars and the like.

14 illustrates an example of displaying a scroll object.

Referring to FIG. 14, the controller 180 displays an image obtained by synthesizing a first image and a second image as a preview image 14 on the touch screen 151. In addition, the touch screen 151 may include a scroll region 14a indicating a range in which the synthesis position of the first image and the second image are variable, and a scroll object 14b indicating the composition position of the current first image and the second image. Display. That is, the scroll area 14a representing a range in which the depth value of the stereoscopic image is variable and the scroll object 14b representing the depth value of the current stereoscopic image are displayed on the touch screen. Here, the position of the scroll object may be displayed based on the specific object 14c selected in the preview image. For example, the controller 180 controls the first image and the second image such that the depth value in the stereoscopic image of the object 14c selected in the preview image 14 becomes a reference value, for example, “0 position”. To control the composition position. In addition, based on the case where the depth value in the stereoscopic image of the selected object 14c is set as the reference value, a degree of change in the depth value of the stereoscopic image may be displayed using the scroll object.

Referring back to FIG. 13, when the position of the scroll object is changed through drag input or the like (S504), the controller 180 changes the depth value of the stereoscopic image based on the changed position of the scroll object (S505). That is, the depth value of the stereoscopic image is increased or decreased by varying the synthesis position of the first image and the second image. As the depth value of the stereoscopic image is changed, the preview image displayed on the screen of the electronic device 100 through the display module 151 is also displayed with a variable depth value. Accordingly, the user can intuitively check the depth value of the stereoscopic image which is changed through the multi-touch.

15 and 16 illustrate examples of changing a depth value of a stereoscopic image based on the position of a scroll object.

FIG. 15A illustrates a state in which the scroll object 14c is scrolled in the direction of the 'Near' button 14d by the user. In addition, FIG. 15B illustrates an example in which the stereoscopic effect of the stereoscopic image is changed as the scroll object 14c is scrolled as shown in FIG. 15A. FIG. 16A illustrates a state in which the scroll object 14c is scrolled in the direction of the 'Far' button 14e by the user. Also, FIG. 16B illustrates an example in which a stereoscopic sense of a stereoscopic image is changed as the scroll object 14c is scrolled as shown in FIG. 16A.

Referring to FIG. 15, the closer the scroll object 14c is to the 'Near' button 14d, the more the composition position moves forward. In addition, the depth value of the stereoscopic image is changed based on the display surface 15a of the electronic device 100 on which the image is displayed so that a stereoscopic feeling as if an object in the stereoscopic image is gradually receded is displayed.

Referring to FIG. 16, the closer the scroll object 14c is to the 'Far' button 14e, the more the composition position moves forward. In addition, the depth value of the stereoscopic image is varied so that a stereoscopic feeling as if an object in the stereoscopic image is gradually protruded forward based on the display surface 15a of the electronic device 100 on which the image is displayed.

According to the third embodiment of the present invention, when the user wants to vary the depth value of the stereoscopic image, the user can set the depth value of the stereoscopic image to a desired value only by scrolling the scroll bar. Therefore, compared to the conventional method of setting the depth value of the stereoscopic image by changing the composition position by one pixel through a button operation, the user convenience is increased.

Hereinafter, a method of controlling the electronic device 100 and an operation of the electronic device 100 performing the same according to the fourth embodiment of the present invention will be described in detail with reference to the accompanying drawings.

17 is a flowchart illustrating a control method of the electronic device 100 according to a fourth embodiment of the present disclosure. 18 is a diagram for describing a method of controlling the electronic device 100 according to the fourth embodiment of the present disclosure.

Referring to FIG. 17, the controller 180 receives a first image corresponding to a left eye image and a second image corresponding to a right eye image through the plurality of cameras 121a and 121b (S601). In addition, a preview image is obtained through at least one of the plurality of cameras 121a and 121b and the obtained preview image is displayed on the display area of the display module 151 (S602). The preview image may be a first image input through the first camera 121a or a second image input through the second camera 121b. Also, the preview image may be an image obtained by overlapping the first image and the second image. When the preview image displayed on the display area is a composite image of the first image and the second image, this may be a preview image of the stereoscopic image generated by the electronic device 100.

When a specific object included in the preview image is selected while the preview image is displayed on the screen (S603), the controller 180 controls the depth value of the stereoscopic image based on the selected object (S604). Here, the method of controlling the depth value of the stereoscopic image based on the selected object is performed in the same manner as the method of varying the depth value of the stereoscopic image based on the selected object in the first embodiment of the present invention. Omit.

Thereafter, the controller 180 continuously acquires the movement of the selected object through image recognition. When the depth value of the selected object changes as the selected object moves (S605), the depth value of the stereoscopic image is controlled based on the selected object as in step S604 (S604). That is, the depth value of the stereoscopic image is changed again so that the depth value in the stereoscopic image of the selected object becomes the reference value.

18 illustrates an example of controlling a depth value of a stereoscopic image based on the movement of the selected object.

Referring to FIG. 18, the first object 18a is selected in the preview image 18 (S701). Accordingly, the controller 180 varies the depth value of the stereoscopic image based on the first object 18a. That is, the total depth value of the stereoscopic image is controlled such that the depth value in the stereoscopic image of the first object 18a becomes a reference value, for example, “0 position”. In this state, since the second object 18b is located behind the first object 18a, a three-dimensional effect is generated so that the second object 18b appears to go further behind the "0 position".

Thereafter, as the first object 18a moves, the depth value of the first object 18a is changed (S702). Accordingly, the controller 180 resets the depth value of the stereoscopic image based on the first object 18a. In this state, since the second object 18b is positioned in front of the first object 18a, a three-dimensional appearance that protrudes further than "0 position" occurs.

According to the fourth embodiment of the present disclosure, when the object selected as the reference moves, the electronic device 100 automatically changes the depth value of the stereoscopic image based on the movement of the object. Therefore, the user does not need to reset the depth value of the stereoscopic image through a button operation when the object moves, thereby increasing user convenience.

The method for controlling an electronic device according to the present invention described above may be provided by recording on a computer-readable recording medium as a program for executing in a computer.

The control method of an electronic device according to the present invention can be executed through software. When implemented in software, the constituent means of the present invention are code segments that perform the necessary work. The program or code segments may be stored in a processor readable medium or transmitted by a computer data signal coupled with a carrier in a transmission medium or communication network.

The computer-readable recording medium includes a mode type recording device in which data that can be read by a computer system is stored. Examples of the computer-readable recording device include ROM, RAM, CD-ROM, DVD-ROM, DVD-RAM, magnetic tape, floppy disk, hard disk, optical data storage device, and the like. The computer readable recording medium can also be distributed over network coupled computer devices so that the computer readable code is stored and executed in a distributed fashion.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. The present invention is not limited to the drawings, and all or some of the embodiments may be selectively combined so that various modifications may be made.

Claims (20)

A plurality of cameras for acquiring an external image; And
A control unit for generating a stereoscopic image by synthesizing the first image and the second image obtained by the plurality of cameras, and varying the depth value of the stereoscopic image based on the zoom state of the plurality of cameras
.
The method of claim 1,
The controller may vary the depth value of the stereoscopic image by varying a synthesis position of the first image and the second image.
The method of claim 1,
Further comprising a display module,
The controller may display a third image acquired using at least one of the first image and the second image through the display module, and the depth value of the specific object selected from the third image may be increased. And the depth value of the stereoscopic image is changed to be a reference value.
The method of claim 3,
And the reference value is a value that varies according to the zoom state.
The method of claim 3,
The display module is implemented as a touch screen,
The controller selects the specific object based on a point touched on the touch screen.
The method of claim 3,
And the third image is a stereoscopic image obtained by synthesizing the first image and the second image.
The method of claim 3,
And the third image is the first image.
The method of claim 1,
The zoom state of the plurality of cameras is an optical zoom state of the plurality of cameras.
A plurality of cameras for acquiring an external image; And
A first image and a second image acquired through the plurality of cameras are synthesized to generate a stereoscopic image. When the distance between the plurality of points multi-touched on the touch screen is changed, the depth of the stereoscopic image is based on the changed distance. Control to change the value
.
10. The method of claim 9,
The controller may vary the depth value of the stereoscopic image by varying a synthesis position of the first image and the second image.
10. The method of claim 9,
Further includes a touch screen,
And the controller is configured to display the preview image of the stereoscopic image on the touch screen and to vary the depth value of the preview image based on the variable depth value of the stereoscopic image.
touch screen;
A plurality of cameras for acquiring an external image; And
A first image and a second image obtained through the plurality of cameras are synthesized to generate a stereoscopic image, a scroll object is displayed on the touch screen, and the first image and the second image are based on positions of the scroll object. Control unit to change the synthesis position of
.
The method of claim 12,
The controller may be configured to display the preview image of the stereoscopic image on the touch screen and to change the depth value of the preview image based on the changed composition position when the synthesis position of the first image and the second image is changed. Electronic equipment.
Display module;
A plurality of cameras for acquiring an external image; And
The display module generates a stereoscopic image by synthesizing the first image and the second image acquired by the plurality of cameras, and displays the third image obtained by using at least one of the first image and the second image. A control unit configured to display through and varying a depth value of the stereoscopic image based on a movement of a specific object selected from the third image
.
The method of claim 14,
The display module is implemented as a touch screen,
The controller selects the specific object based on a point touched on the touch screen.
The method of claim 14,
The controller may vary the depth value of the stereoscopic image such that the depth value of the selected specific object is a specific value.
The method of claim 16,
The controller may vary the depth value of the stereoscopic image such that the depth value of the stereoscopic image of the specific object becomes the specific value when the depth value of the stereoscopic image of the specific object changes as the specific object moves. An electronic device characterized by the above-mentioned.
The method of claim 14,
The controller may vary the depth value of the stereoscopic image by varying a synthesis position of the first image and the second image.
Generating a stereoscopic image by synthesizing a first image and a second image acquired through a plurality of cameras; And
Varying a depth value of the stereoscopic image based on a zoom state of the plurality of cameras
Control method of an electronic device comprising a.
Generating a stereoscopic image by synthesizing a first image and a second image acquired through a plurality of cameras; And
Varying a depth value of the stereoscopic image based on a movement of a specific object selected from the stereoscopic image
Control method of an electronic device comprising a.

Images