KR101847915B1 - Mobile terminal and wide full-hd implementation method thereof - Google Patents

Abstract

The present invention relates to a mobile terminal capable of realizing a wide-HD image using a dual camera and an implementation method thereof, and more particularly, to a mobile terminal device capable of realizing a wide-view image (FOV) The first and second viewing angles are overlapped with each other to generate a wide full-HD image, thereby providing a wider viewing angle than a full-HD image using a conventional single camera module Images can be displayed.

Description

TECHNICAL FIELD [0001] The present invention relates to a mobile terminal and a wide-

The present invention relates to a mobile terminal capable of realizing a wide-HD image using a dual camera, and a method of implementing the wide-HD.

The mobile terminal may be configured to perform various functions. Examples of such various functions include a data and voice communication function, a function of photographing a video or a moving image through a camera, a voice storage function, a music file playback function through a speaker system, and an image or video display function. Some mobile terminals include additional functions to execute games, and some other mobile terminals are also implemented as multimedia devices. Moreover, recent mobile terminals can receive a broadcast or multicast signal to view a video or television program.

Further, efforts for supporting and increasing the functions of the mobile terminal continue. Such efforts include not only changes and improvements in structural components that form the mobile terminal, but also improvements in software or hardware. Among them, the touch function of the mobile terminal allows a user who is unfamiliar with the button / key input to conveniently perform the operation of the terminal by using the touch screen. In recent years, not only simple input but also user interface (UI) Is becoming an important function of Accordingly, as the touch function is applied to a mobile terminal in various forms, development of a user interface (UI) corresponding thereto is further demanded.

Generally, a camera module of a mobile terminal is provided with a CMOS image sensor (hereinafter abbreviated as a CMOS sensor), and each sensor responsive to RGB is combined with several tens of thousands to several million pixels to detect a photographed image. The image sensed by the CMOS sensor of the camera module has an aspect ratio, that is, an aspect ratio, of 4: 3 for pixel resolution.

However, full-HD video usually has an aspect ratio of 16: 9. As a result, due to the difference in aspect ratio between the image output from the camera module and the full-HD image, the entire horizontal line is maintained in the image sensed by the one camera module, and the vertical line is partially reduced or skipped, HD image is generated.

However, since one camera module has a limited camera viewing angle (FOV), a full-HD image using an image output from the camera module is limited to a range of the camera viewing angle (FOV).

Accordingly, it is an object of the present invention to provide a mobile terminal capable of realizing a wide-HD video having a wider viewing angle than a full-HD video using a dual camera, and a method of realizing the wide full-HD.

According to an aspect of the present invention, there is provided a wide-HD method for a mobile terminal, including: outputting an image having first and second viewing angles in first and second camera modules; And synthesizing the two images based on an image portion in which the first and second viewing angles overlap, thereby outputting a wide full-HD image.

The first and second camera modules may be a left camera module or a right camera module.

The first and second camera modules are operated simultaneously or sequentially.

The image of the first viewing angle is an image having a resolution smaller than the resolution of 2608 × 1468, and the image of the second viewing angle is an image having an HD resolution of 1280 × 720.

The wide-full HD image has a size of a sum of an image of the first viewing angle and an area of the second viewing angle that do not overlap.

The step of outputting the wide full-HD image comprises interpolating neighboring cells of the second viewing angle image using the super resolution to make the second viewing angle image the size of the first viewing angle image; Generating a temporary image by synthesizing the two images based on a portion where the first and second viewing angles overlap each other, and downscaling the generated temporary image to output a wide-full HD image .

The temporary image is an image having a resolution of 2608 × 1468, and the wide full-HD image is an image having a 1920 × 1080 resolution having an aspect ratio of 16: 9.

Downscaling an image of a first viewing angle outputted from the first camera module and outputting a full-HD image when the first and second camera modules are sequentially operated; And the second camera is operated to synthesize the two images based on the overlapping portions of the first and second viewing angles to output a wide full-HD image, and the center of the screen is divided into a wide full-HD To the image.

According to an aspect of the present invention, there is provided a mobile terminal including first and second camera modules for outputting images of first and second viewing angles; And a controller for synthesizing the two images based on the overlapping portions of the first and second viewing angles to output a wide-HD video.

The first and second camera modules are left or right camera modules.

The first and second camera modules are operated simultaneously or sequentially.

The image of the first viewing angle has an image resolution smaller than the resolution of 2608 × 1468, and the image of the second viewing angle has an HD resolution of 1280 × 720.

The control unit outputs a wide-full HD image having a size obtained by summing an image of the first viewing angle and an area of the second viewing angle that do not overlap.

Wherein the controller interpolates neighboring cells of the second viewing angle image using the super resolution to make the image of the second viewing angle be a size of the first viewing angle image, and then, based on the overlapped portion of the first and second viewing angles, Synthesizes the images to generate a temporary image, downscales the generated temporary image, and outputs a wide-full HD image.

The temporary image is an image having a resolution of 2608 × 1468, and the wide full-HD image has a 1920 × 1080 resolution having an aspect ratio of 16: 9.

Wherein the controller outputs the full-HD image by downscaling the image of the first viewing angle outputted from the first camera module according to the operation sequence when the first and second camera modules are sequentially operated, and when the second camera is operated, After synthesizing the two images based on the overlapping portions of the first and second viewing angles to output a wide full-HD image, the center of the image displayed on the display unit is changed to the wide full-HD image in the full-HD image .

As described above, according to the present invention, in the image generated by the left camera module using the image output from the dual camera module (dual camera), the wide-HD video It is possible to implement a wider image (wide image) than a full-HD image generated using an image output from one camera module, thereby providing a more vivid image to the user.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention;
2 is a block diagram of a wireless communication system in which a mobile terminal may operate in accordance with an embodiment of the present invention.
3 is an example of a dual camera structure provided in a mobile terminal.
4 is an example of implementing a full-HD image using an image captured by one camera module.
5 is a view showing a feature of an image photographed by a dual camera.
6 shows an example of generating a wide full-HD image by synthesizing images captured by a dual camera.
FIG. 7 is a flowchart illustrating a method of implementing wide-HD by synthesizing images photographed by respective camera modules when the left and right cameras are simultaneously operated in the present invention.
8 is an example of synthesizing an actual image according to the flowchart of FIG.
FIG. 9 is a flowchart illustrating a method of implementing wide-HD by synthesizing images photographed by respective camera modules when sequentially operating right and left cameras in the present invention. FIG.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, it should be noted that the above-mentioned "module" and "part"

The terminal may be implemented in various forms. For example, the terminal described in this specification may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) And fixed terminals such as a digital TV, a desktop computer, and the like. In the following description, it is assumed that the terminal is a mobile terminal. However, it will be readily apparent to those skilled in the art that the configuration according to the following description may be applied to the fixed terminal, except for components specifically configured for mobile use.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. 1 shows a mobile terminal having various components. However, not all illustrated components are required. A mobile terminal may be implemented by more components than the illustrated components, or a mobile terminal may be implemented by fewer components.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more components that allow wireless communication between the mobile terminal 100 and the wireless communication system or wireless communication between the mobile terminal 100 and a network on which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcasting signals using various broadcasting systems. In particular, the broadcasting receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) Only Digital Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

In addition, the mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data depending on a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and the wireless Internet module 113 can be built in or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. A typical example of the position information module 115 is a Global Position System (GPS) module. According to the present technology, the GPS module calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain three-dimensional current position information according to latitude, longitude, and altitude It can be calculated accurately. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module can calculate speed information by continuously calculating the current position in real time.

An audio / video (A / V) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display module 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like. Particularly, when the touch pad has a mutual layer structure with the display module 151 described later, it can be called a touch screen.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. Also, it is responsible for a sensing function related to whether or not the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141. This will be discussed later in connection with touch screens.

The sensing unit 140 includes a geomagnetic sensor for calculating a moving direction when a user moves, a gyro sensor for calculating a rotating direction, and an acceleration sensor.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, Video input / output (I / O) ports, earphone ports, and the like.

Here, the identification module is a chip that stores various information for authenticating the use right of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identity module (SIM) ), A Universal Subscriber Identity Module (" USIM "), and the like. In addition, an apparatus having an identification module (hereinafter referred to as 'identification device') can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device.

The interface unit 170 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, Various command signals may be transmitted to the mobile terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display module 151, an audio output module 152, and an alarm unit 153.

The display module 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed.

Meanwhile, as described above, when the display module 151 and the touch pad have a mutual layer structure to constitute a touch screen, the display module 151 can be used as an input device in addition to the output device. The display module 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display 3D display). Some of these displays can be configured to be transparent so that they can be viewed from outside. This may be referred to as a transparent display. A typical example of the transparent display is a transparent organic light emitting diode (TOLED) or the like. In addition, there may be two or more display modules 151 according to the embodiment of the mobile terminal 100. For example, the mobile terminal 100 may be provided with an external display module (not shown) and an internal display module (not shown) at the same time. The touch screen may be configured to detect not only the touch input position and area but also the touch input pressure.

The audio output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 outputs an acoustic signal related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for informing occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. When a call signal is received or a message is received, the alarm unit 153 can output a vibration to notify it. Alternatively, when the key signal is input, the alarm unit 153 can output the vibration by the feedback to the key signal input. The user can recognize the occurrence of an event through the vibration output as described above. Of course, a signal for notifying the occurrence of an event may also be output through the display module 151 or the sound output module 152.

The memory 160 may store a program for processing and controlling the control unit 180 and may store a function for temporarily storing input / output data (e.g., a phone book, a message, a still image, . In addition, the memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory) SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read- And an optical disc. Also, the mobile terminal 100 may operate a web storage for performing a storage function of the memory 160 on the Internet.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the control unit 180 as a battery, and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, And may be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. In addition, the software codes may be stored in the memory 160 and executed by the control unit 180. [

The terminal 100 shown in Fig. 1 is configured to be operable in a communication system capable of transmitting data through a frame or packet, including a wired / wireless communication system and a satellite-based communication system .

Hereinafter, a communication system capable of operating a terminal according to the present invention will be described with reference to FIG.

The communication system may use different air interfaces and / or physical layers. For example, wireless interfaces that can be used by communication systems include, but are not limited to, Frequency Division Multiple Access ('FDMA'), Time Division Multiple Access ('TDMA'), Code Division Multiple Access (CDMA), Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE)), Global System for Mobile Communications (GSM) . Hereinafter, for the sake of convenience of description, the description will be limited to CDMA. However, the present invention is applicable to all communication systems including CDMA wireless communication systems.

2, the CDMA wireless communication system includes a plurality of terminals 100, a plurality of base stations (BSs) 270, and base station controllers (BSCs) 275 , And a mobile switching center ('MSC') 280. MSC 280 is configured to be coupled to a Public Switched Telephone Network (" PSTN ") 290, and is also configured to be coupled to BSCs 275. BSCs 275 may be coupled in pairs with BS 270 through a backhaul line. The backhaul line may be provided according to at least one of E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL or xDSL. Thus, a plurality of BSCs 275 may be included in the system shown in FIG.

Each BS 270 may comprise at least one sector, and each sector may comprise an omnidirectional antenna or an antenna pointing to a particular direction of radial from BS 270. [ In addition, each sector may include two or more antennas of various types. Each BS 270 may be configured to support a plurality of frequency assignments and each of the plurality of frequency assignments has a specific spectrum (e.g., 1.25 MHz, 5 MHz, etc.).

The intersection of sector and frequency assignment may be referred to as a CDMA channel. BS 270 may be referred to as a Base Station Transceiver Subsystem (BTSs). In this case, the word "base station" may be referred to as a combination of one BSC 275 and at least one BS 270. [ The base station may also indicate a "cell site ". Alternatively, each of the plurality of sectors for a particular BS 270 may be referred to as a plurality of cell sites.

2, a broadcasting transmitter (BT) 295 transmits a broadcasting signal to the terminals 100 operating in the system. The broadcast receiving module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT 295.

In addition, FIG. 2 illustrates several Global Positioning System ('GPS') satellites 300. The satellites 300 help to locate at least one of the plurality of terminals 100. Although two satellites are shown in FIG. 2, useful location information may be obtained by two or more satellites. The location information module 115 shown in FIG. 1 cooperates with satellites 300 to obtain desired location information. Here, you can track your location using all of the technologies that can track your location, as well as your GPS tracking technology. Also, at least one of the GPS satellites 300 may optionally or additionally be responsible for satellite DMB transmission.

Among the typical operations of a wireless communication system, the BS 270 receives a reverse link signal from the various terminals 100. At this time, the terminals 100 are connecting a call, transmitting or receiving a message, or performing another communication operation. Each of the reverse link signals received by the particular base station 270 is processed by the particular base station 270. The data resulting from the processing is transmitted to the connected BSC 275. The BSC 275 provides call resource allocation and mobility management functions, including the organization of soft handoffs between the base stations 270. The BSC 275 also transmits the received data to the MSC 280 and the MSC 280 provides additional transmission services for connection with the PSTN 290. [ Similarly, the PSTN 290 connects to the MSC 280, the MSC 280 connects to the BSCs 275, and the BSCs 275 communicate with the BSs 270 ).

The present invention proposes a method for implementing a full-HD image having an aspect ratio of 16: 9 using an image captured by two camera modules (hereinafter referred to as sensors) provided in a mobile terminal. That is, according to the present invention, when two camera modules are separated by 2.4 cm and a first image having a first viewing angle and a second image having a second viewing angle are outputted, the viewing angle of the first and second images overlap each other Common parts) are synthesized to realize a wide-full HD image.

3 is an example of a dual camera structure provided in a mobile terminal.

As shown in FIG. 3, the dual camera included in the mobile terminal includes a left sensor and a right sensor for sensing a photographed image. The left sensor and the right sensor are located about 2.4 cm away from each other in order to realize a high-quality image or a normal three-dimensional image. Accordingly, the two camera modules output the first image having the first viewing angle (FOV) and the second image having the second viewing angle (FOV).

4 is an example of implementing a full-HD image using an image captured by one camera module.

As shown in FIG. 4, when the full-HD mode is selected, cropping a part of a vertical line from an image of 2608 × 1920 pixels photographed by the left camera module to produce an image having a resolution lower than 2608 × 1468 , The image is downscaled by a resizer (ISP resizer) to finally create a full-HD image (1920 x 1080 resolution) having an aspect ratio of 16: 9. The generated full-HD image is stored in the memory 160 Or displayed on the display unit 151. [

5 is a view showing a feature of an image photographed by a dual camera.

5, since the two camera modules (left and right sensors) are located at a distance of about 2.4 cm from each other, the images photographed by the respective camera modules do not overlap with the overlapping area A due to the difference in viewing angle (FOV) There are unoverlapped areas (B) and (C).

 The present invention combines images taken by two camera modules (left and right sensors) (images including non-overlapping regions) to obtain a wider wide-HD image that is wider than a full-HD image captured by one camera module And outputs it. That is, a wide-full HD image is realized by synthesizing the overlapping parts (common parts) of the viewing angles of the images output from the dual camera module. The generated wide-HD video is stored in the memory 160 or displayed on the display unit 151.

In addition, the present invention adjusts the output of the wide-HD video and the focus of the corresponding image differently when the left and right camera modules are all operating or sequentially operating.

6 is an example of generating a wide-HD video by synthesizing images captured by a dual camera.

6, when the wide-HD mode is selected in the dual camera mode, the left camera module (left sensor) displays a video having a resolution smaller than the 2608 × 1468 resolution (screen size) And the right camera module (right sensor) processes a second image having a resolution of 2608 x 1920 to output an image having a camera field of view (FOV) of HD resolution (1280 x 720).

A video signal processing unit (not shown) combines the images output from the left and right gamera modules using super resolution to generate a 2608 × 1468 temporary image. That is, the video processing unit processes the HD resolution image (1280 × 720) using the super resolution to produce an image of a size (resolution) similar to the image output from the left camera module. The super resolution is a pixel having no resolution through a pixel interpolation, for example, a resolution of 1280 x 720 pixels. The super resolution is a resolution of a size (resolution) similar to the image output from the left camera module, Of the image.

In particular, when combining images output from the left and right Gamera modules, the video processing unit overlaps only overlapped areas in the corresponding images. That is, the two images are combined so that the right edge of the non-overlapping area of the image output from the left camera module coincides with the right edge of the image output from the right camera module.

As a result, the temporary image has a size including only the non-overlapping area of the image output from the right camera module in the image output from the left camera module. Therefore, the size of the provisional image is larger than the area that is not overlapped with the image output from the conventional left camera module.

The generated temporary image is resized by a resizer (ISP resizer) and output as a final wide full-HD image having a resolution of 1920 × 1080.

FIG. 7 is a flowchart illustrating a method of implementing wide-HD according to an embodiment of the present invention, in which images captured by the respective camera modules are simultaneously synthesized when the left and right cameras are simultaneously operated. FIG. For example. In particular, since the video signal processor can be included in the control unit 180, the control unit 180 will be described in terms of control operations.

As shown in FIG. 7, the user selects the full-HD mode (full-HD function) in the state in which both the left and right cameras are operated (dual camera mode) (S10, S11).

Once the full-HD mode is selected, the control unit 180 controls the left and right camera modules, and the left camera module photographs the inside of the office as shown in FIG. 8 and displays a resolution smaller than the 2608 × 1468 resolution (screen size) (S12). The right camera module (right sensor) captures an image having a different viewing angle from the left camera module and outputs an image of HD resolution (1280 x 720) (S13).

Accordingly, the controller 180 combines the images output from the left and right gamera modules using super resolution to generate a temporary image having a resolution of 2608 × 1468 (S14, S15). At this time, the controller 180 generates neighboring pixels which are not included in the HD resolution image photographed by the right camera through pixel interpolation to produce images of a size (resolution) similar to the image output from the left camera module. In addition, when the images output from the left and right Gamera modules are combined, the controller 180 overlaps only overlapped areas in the corresponding images. Therefore, the temporary image has a form that is included in the image output from the left camera module as much as an area that does not overlap in the images output from the right camera module.

Accordingly, the controller 180 downscales the generated temporary image through an ISP resizer to generate a wide-HD video (1920 x 1080 resolution) having an aspect ratio of 16: 9 and finally outputs And the output wide-HD video (1920 x 1080 resolution) is displayed on the display unit.

The present invention can implement a wide-HD video in a state in which both the left and right cameras are operated, but the present invention is not limited to this, and the right camera may be operated in a state of outputting a full-HD video through the left camera module, Images can be displayed. In this case, the center of the screen (focus) must be adjusted.

FIG. 9 is a flowchart illustrating a method of implementing a wide-HD according to the present invention by synthesizing images taken by respective camera modules when left and right cameras are sequentially operated.

When the user selects the full-HD function (mode) in the state where the left camera module is operated (S20, S21), the left camera module photographs the subject under the control of the controller 180 and obtains a resolution of 2608 × 1468 (S22). ≪ / RTI >

Accordingly, the controller 180 downscales the image output from the left camera module through the resizer (ISP resizer) to display the full-HD image (1920 x 1080 resolution) on the display unit (S23). In this case, the center of the screen is the image output from the left camera module.

When the user operates the right camera module (right sensor) (S24), the right camera module (right sensor) captures an image having a different viewing angle from the left camera module under the control of the controller 180 and outputs the HD resolution (1280x720) (S25).

The controller 180 combines the images output from the left and right gamera modules using super resolution to generate a temporary image having a resolution of 2608 × 1468 and outputs the temporary image at steps S26 and S27. At this time, the controller 180 generates neighboring pixels that are not included in the HD resolution image photographed by the right camera through pixel interpolation, to produce images of a size (resolution) similar to the image output from the left camera module.

Accordingly, the controller 180 down-scales the generated temporary image through an ISP resizer to generate a wide-HD video (1920 x 1080 resolution) having an aspect ratio of 16: 9 and then displays it on a display unit 151). In this case, the control unit 180 adjusts the center of the previous screen to the wide full-HD image (1920 x 1080 resolution) on the image output from the left camera module, and then displays the wide screen on the display unit (S28).

For the sake of convenience of explanation, the present invention has been described by taking a wide full-HD image when the left camera module is operated first and the right camera module is operated later. However, the present invention is not limited to this, And the same result can be obtained when the left camera module is operated later. That is, the control unit 180 detects the operation sequence of the two camera modules and performs a control operation so that the same result is obtained.

Also, in the present invention, the camera module and the camera are used in the same meaning, and the image size and the resolution are used in the same meaning.

As described above, according to the present invention, a full-HD image is generated using an image output from a dual camera module (dual camera), and thus a full-HD image generated using an image output from one camera module is generated A wide image (wide image) can be implemented, and a more vivid image can be provided to the user.

Further, according to an embodiment of the present invention, the above-described method can be implemented as computer-readable code on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . Further, the computer may include a control unit of the terminal.

The mobile terminal described above can be applied to not only the configuration and method of the embodiments described above but also all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments It is possible.

110: wireless communication unit 111: broadcast receiving module
112: mobile communication module 113; Wireless Internet Module
140; Sensing unit 150: output unit
151: display unit 160: memory
180:

Claims (18)

delete delete delete delete delete delete delete delete A first camera module for outputting a first image of a first viewing angle;
The first and second viewing angles are set such that the first and second viewing angles are formed on the respective sides of the first and second images, A second camera module positioned close to the module,
(a) when the full-HD mode is selected in a state in which the first camera module is operated, down-scaling the first image to display a full-HD image having an aspect ratio of 16: 9,
(b) if the second camera module is operated in a state in which the full-HD image is displayed, peripheral pixels not in the second image are generated through pixel interpolation to make the second image into a first image size,
(c) generating a temporary image by combining the non-overlapping image portion of the second image with the first image based on the overlapping portion of the first and second viewing angles, and then downscaling the temporary image to obtain a 16: And generating a wide full-HD image having an aspect ratio of < RTI ID = 0.0 > 1, < / RTI > The apparatus of claim 9, wherein the first and second camera modules
As the left and right camera modules, the first and second camera modules are brought close to each other so that image portions that do not overlap with the first and second viewing angles are formed on the side portions of the first and second images, respectively, Wherein the mobile terminal is located at a predetermined position. The apparatus of claim 9, wherein the first and second camera modules
Wherein the mobile terminal is operated simultaneously or sequentially. 10. The method of claim 9, wherein the first image of the first viewing angle
And the second image having the second viewing angle has an HD resolution of 1280 x 720. The mobile terminal according to claim 1, 10. The apparatus of claim 9, wherein the control unit
And combines the first and second images so that the non-overlapping areas of the second image are added to the right edge of the non-overlapping area of the first image. delete 10. The method of claim 9,
Wherein the wide-HD video has a resolution of 2608 x 1468, and the wide-HD video has a resolution of 1920 x 1080 with an aspect ratio of 16: 9. delete 10. The apparatus of claim 9, wherein the control unit
And the center of the image displayed on the display unit is changed from the full-HD image to the wide-HD image when the temporary image is generated. The mobile terminal of claim 9, further comprising a display unit for displaying the generated wide-HD video and a memory for storing the generated wide-HD video.

Images