KR20130032782A - Mobile terminal and wide full-hd implementation method thereof - Google Patents

Abstract

PURPOSE: A mobile terminal and a wide full-HD implementing method using a dual camera thereof are provided to implement a wide full-HD image having a view angle wider than an existing full-HD image by using a dual camera. CONSTITUTION: A first camera module outputs an image of a first view angle. A second camera module outputs an image of a second view angle. A control unit(180) outputs a wide full-HD image by synthesizing the two image with each other based on an image part overlapped with the first and the second view angles. The first and the second camera modules are left and right camera modules. The first and the second modules are sequentially or simultaneously operated. [Reference numerals] (110) Wireless communication unit; (111) Broadcast receiving module; (112) Mobile communication module; (113) Wireless internet module; (114) Local area communication module; (115) Location information module; (120) A/V input unit; (121) Camera; (122) Microphone; (130) User input unit; (140) Sensing unit; (150) Output unit; (151) Display unit; (152) Sound output module; (153) Alarm unit; (160) Memory; (170) Interface unit; (180) Control unit; (181) Multimedia module; (190) Power supply unit;

Description

Wide Full-HD Implementation Using Mobile Terminal and Its Dual Cameras {MOBILE TERMINAL AND WIDE FULL-HD IMPLEMENTATION METHOD THEREOF}

The present invention relates to a mobile terminal capable of realizing a wide full-HD image using a dual camera and a method for implementing a wide full-HD thereof.

The mobile terminal may be configured to perform various functions. Examples of such various functions include a data and voice communication function, a function of photographing a video or a moving image through a camera, a voice storage function, a music file playback function through a speaker system, and an image or video display function. Some mobile terminals include additional functionality to play games, while others are implemented as multimedia devices. Moreover, recent mobile terminals can receive broadcast or multicast signals to watch video or television programs.

Further, efforts for supporting and increasing the functions of the mobile terminal continue. The foregoing efforts include not only changes and improvements in the structural components forming the mobile terminal, but also improvements in software or hardware. Among them, the touch function of the mobile terminal allows a user who is unfamiliar with the button / key input to conveniently perform the operation of the terminal by using the touch screen. In recent years, not only simple input but also user interface (UI) Is becoming an important function of Accordingly, as the touch function is applied to a mobile terminal in various forms, development of a user interface (UI) corresponding thereto is further demanded.

In general, a camera module of a mobile terminal is provided with a CMOS image sensor (hereinafter, abbreviated as CMOS sensor) to detect photographed images by combining each sensor responding to RGB with tens of thousands to millions of pixels. The image detected by the CMOS sensor of the camera module has a 4: 3 aspect ratio, that is, an aspect ratio, for pixel resolution.

But full-HD video usually has an aspect ratio of 16: 9. As a result, due to the difference in aspect ratio between the image output from the camera module and the full-HD image, the vertical line is partially reduced or skipped by skipping the entire horizontal line in the image detected by the one camera module. Create HD video.

However, since one camera module has a limited camera field of view (FOV), the full-HD image using the image output from the camera module also has a limitation that is limited to the range of the camera field of view (FOV).

Accordingly, an object of the present invention is to provide a mobile terminal capable of realizing a wide full-HD image having a wider viewing angle than a conventional full-HD image using a dual camera, and a wide full-HD implementation method thereof.

In order to achieve the above object, a wide full-HD implementation method of a mobile terminal according to an embodiment of the present invention includes: outputting an image having first and second viewing angles from a first and a second camera module; And synthesizing the two images based on the image portion where the first and second viewing angles overlap, and outputting a wide full-HD image.

The first and second camera modules may be left camera modules or right camera modules.

The first and second camera modules are operated simultaneously or sequentially.

The image of the first viewing angle is an image having a resolution smaller than 608 × 1468 resolution, and the image of the second viewing angle is an image having an HD resolution of 1280 × 720.

The wide-Full HD image has a size obtained by adding up regions of the first viewing angle that are not overlapped with the second viewing angle.

The outputting of the wide full-HD image may include interpolating neighboring cells of the second viewing angle image using a super resolution to make the second viewing angle image the size of the first viewing angle image; And generating a temporary image by synthesizing the two images based on the portion where the first and second viewing angles overlap, and outputting a wide-full HD image by downscaling the generated temporary image. .

The temporary image is an image having a resolution of 2608 × 1468, and the wide full-HD image is an image having a 1920 × 1080 resolution having an aspect ratio of 16: 9.

Outputting a full-HD image by downscaling an image of a first viewing angle output from the first camera module when the first and second camera modules are sequentially operated; And outputting a wide full-HD image by synthesizing the two images based on a portion where the first and second viewing angles overlap when the second camera is operated, and centers the screen on the wide full-HD image. The method may further include changing to an image.

In order to achieve the above object, a mobile terminal according to an embodiment of the present invention, the first and second camera module for outputting the image of the second viewing angle; And a controller for synthesizing the two images based on a portion where the first and second viewing angles overlap, and outputting a wide full-HD image.

The first and second camera modules are left or right camera modules.

The first and second camera modules are operated simultaneously or sequentially.

The image of the first viewing angle is an image having a resolution smaller than 608 × 1468 resolution, and the image of the second viewing angle has an HD resolution of 1280 × 720.

The control unit outputs a wide-Full HD image having a size obtained by adding the overlapping regions of the first viewing angle image and the second viewing angle image.

The control unit interpolates the surrounding cells of the second viewing angle image by using super resolution to make the image of the second viewing angle the size of the first viewing angle image, and then, based on the portion where the first and second viewing angles overlap, The video is synthesized to generate a temporary image, and the scaled image is downscaled to output a wide-full HD image.

The temporary image is an image having a resolution of 2608 × 1468, and the wide full-HD image has a 1920 × 1080 resolution having an aspect ratio of 16: 9.

The controller outputs a full-HD image by downscaling the image of the first viewing angle output from the first camera module according to the operation sequence when the first and second camera modules are sequentially operated, and outputs the full-HD image when the second camera is operated. After synthesizing the two images on the basis of the overlapping portions of the first and second viewing angles, the wide full HD image is output and the center of the image displayed on the display unit is changed from the full HD image to the wide full HD image. .

As described above, in the present invention, a wide full-HD image further including a region not overlapped among images output from the right camera module to an image generated from the left camera module using an image output from the dual camera module (dual camera). By generating a, it is possible to implement a wider image (wide image) than the full-HD image generated by using the image output from the existing one camera module has the effect of providing a more vibrant image to the user.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention;
2 is a block diagram of a wireless communication system in which a mobile terminal may operate in accordance with an embodiment of the present invention.
3 is an example of a dual camera structure provided in the mobile terminal.
4 illustrates an example of implementing a full-HD image using an image captured by one camera module.
5 is a view showing features of an image captured by a dual camera.
6 is an example of synthesizing images captured by a dual camera to generate a wide full-HD image.
FIG. 7 is a flowchart illustrating a wide full-HD implementation method by synthesizing images captured by each camera module when the left and right cameras are operated simultaneously in the present invention.
8 is an example of synthesizing an actual image according to the flowchart of FIG. 7;
FIG. 9 is a flowchart illustrating a method for implementing wide full-HD by synthesizing images photographed by each camera module when the left and right cameras are sequentially operated in the present invention. FIG.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Therefore, it should be noted that the "module" and "unit" may be used interchangeably with each other.

The terminal may be implemented in various forms. For example, a terminal described herein includes a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, and the like. And fixed terminals such as digital TVs, desktop computers, and the like. In the following description, it is assumed that the terminal is a mobile terminal. However, it will be readily apparent to those skilled in the art that the configuration according to the following description may be applied to the fixed terminal, except for components specifically configured for mobile use.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. 1 shows a mobile terminal having various components. However, not all illustrated components are required. A mobile terminal may be implemented by more components than the illustrated components, or a mobile terminal may be implemented by fewer components.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more components that allow wireless communication between the mobile terminal 100 and the wireless communication system or wireless communication between the mobile terminal 100 and a network on which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcasting signals using various broadcasting systems. In particular, the broadcasting receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) Only Digital Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

In addition, the mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data depending on a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and the wireless Internet module 113 can be built in or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short range communication module 114 refers to a module for short range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. A typical example of the position information module 115 is a Global Position System (GPS) module. According to the current technology, the GPS module calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain three-dimensional current position information according to latitude, longitude, and altitude It can be calculated accurately. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module can calculate speed information by continuously calculating the current position in real time.

An audio / video (A / V) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display module 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like. Particularly, when the touch pad has a mutual layer structure with the display module 151 described later, it can be called a touch screen.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. Also, it is responsible for a sensing function related to whether or not the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141. This will be discussed later in connection with touch screens.

The sensing unit 140 includes a geomagnetic sensor for calculating a moving direction when a user moves, a gyro sensor for calculating a rotating direction, and an acceleration sensor.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, Video input / output (I / O) ports, earphone ports, and the like.

Here, the identification module is a chip that stores various information for authenticating the use right of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identity module (SIM) ), A Universal Subscriber Identity Module (" USIM "), and the like. In addition, an apparatus having an identification module (hereinafter referred to as 'identification device') can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device.

The interface unit 170 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, Various command signals may be transmitted to the mobile terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display module 151, an audio output module 152, and an alarm unit 153.

The display module 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed.

Meanwhile, as described above, when the display module 151 and the touch pad have a mutual layer structure to constitute a touch screen, the display module 151 can be used as an input device in addition to the output device. The display module 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display 3D display). Some of these displays can be configured to be transparent so that they can be viewed from outside. This may be referred to as a transparent display. A typical example of the transparent display is a transparent organic light emitting diode (TOLED) or the like. In addition, there may be two or more display modules 151 according to the embodiment of the mobile terminal 100. For example, the mobile terminal 100 may be provided with an external display module (not shown) and an internal display module (not shown) at the same time. The touch screen may be configured to detect not only the touch input position and area but also the touch input pressure.

The audio output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 outputs an acoustic signal related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for informing occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. When a call signal is received or a message is received, the alarm unit 153 can output a vibration to notify it. Alternatively, when the key signal is input, the alarm unit 153 can output the vibration by the feedback to the key signal input. The user can recognize the occurrence of an event through the vibration output as described above. Of course, a signal for notifying the occurrence of an event may also be output through the display module 151 or the sound output module 152.

The memory 160 may store a program for processing and controlling the controller 180 and may provide a function for temporarily storing input / output data (for example, a phone book, a message, a still image, a video, etc.). It can also be done. In addition, the memory 160 may store data on vibration and sound of various patterns output when a touch input on the touch screen is performed.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory) SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read- And an optical disc. Also, the mobile terminal 100 may operate a web storage for performing a storage function of the memory 160 on the Internet.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the control unit 180 as a battery, and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, And may be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. In addition, the software codes may be stored in the memory 160 and executed by the control unit 180. [

The terminal 100 shown in Fig. 1 is configured to be operable in a communication system capable of transmitting data through a frame or packet, including a wired / wireless communication system and a satellite-based communication system .

Hereinafter, a communication system capable of operating a terminal according to the present invention will be described with reference to FIG.

The communication system may use different air interfaces and / or physical layers. For example, wireless interfaces that can be used by communication systems include, but are not limited to, Frequency Division Multiple Access ('FDMA'), Time Division Multiple Access ('TDMA'), Code Division Multiple Access (CDMA), Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE)), Global System for Mobile Communications (GSM) . Hereinafter, for convenience of description, the description will be limited to CDMA. However, the present invention is applicable to all communication systems including CDMA wireless communication systems.

2, the CDMA wireless communication system includes a plurality of terminals 100, a plurality of base stations (BSs) 270, and base station controllers (BSCs) 275 , And a mobile switching center ('MSC') 280. The MSC 280 is configured to be connected to a public switched telephone network (PSTN) 290 and is also configured to be connected to BSCs 275. BSCs 275 may be coupled in pairs with BS 270 through a backhaul line. The backhaul line may be provided according to at least one of E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. Thus, a plurality of BSCs 275 may be included in the system shown in FIG.

Each BS 270 may comprise at least one sector, and each sector may comprise an omnidirectional antenna or an antenna pointing to a particular direction of radial from BS 270. [ In addition, each sector may include two or more antennas of various types. Each BS 270 may be configured to support a plurality of frequency assignments, each of which has a specific spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of sectors and frequency assignments may be called a CDMA channel. BS 270 may be referred to as a Base Station Transceiver Subsystem (BTSs). In this case, the word "base station" may be referred to as a combination of one BSC 275 and at least one BS 270. [ The base station may also indicate “cell site”. Alternatively, each of the plurality of sectors for a particular BS 270 may be referred to as a plurality of cell sites.

2, a broadcasting transmitter (BT) 295 transmits a broadcasting signal to the terminals 100 operating in the system. The broadcast receiving module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT 295.

In addition, FIG. 2 illustrates several Global Positioning System ('GPS') satellites 300. The satellites 300 help to locate at least one of the plurality of terminals 100. Although two satellites are shown in FIG. 2, useful location information may be obtained by two or more satellites. The location information module 115 shown in FIG. 1 cooperates with satellites 300 to obtain desired location information. Here, the location can be tracked using not only the GPS tracking technology but also all the technologies that can track the location. Also, at least one of the GPS satellites 300 may optionally or additionally be responsible for satellite DMB transmission.

Among the typical operations of a wireless communication system, the BS 270 receives a reverse link signal from the various terminals 100. At this time, the terminals 100 are connecting a call, transmitting or receiving a message, or performing another communication operation. Each of the reverse link signals received by the particular base station 270 is processed by the particular base station 270. The data resulting from the processing is transmitted to the connected BSC 275. The BSC 275 provides call resource allocation and mobility management functions, including the organization of soft handoffs between the base stations 270. The BSC 275 also transmits the received data to the MSC 280 and the MSC 280 provides additional transmission services for connection with the PSTN 290. [ Similarly, the PSTN 290 connects to the MSC 280, the MSC 280 connects to the BSCs 275, and the BSCs 275 communicate with the BSs 270 ).

The present invention proposes a method for realizing a full-HD image having a 16: 9 aspect ratio by using images captured by two camera modules (hereinafter referred to as sensors) provided in a mobile terminal. That is, according to the present invention, two camera modules are separated from each other by 2.4 cm so that the viewing angles of the first and second images overlap when the first image having the first viewing angle and the second image having the second viewing angle are output ( Common parts) to synthesize wide-full HD video.

3 is an example of a dual camera structure provided in a mobile terminal.

As illustrated in FIG. 3, the dual camera provided in the mobile terminal includes a left sensor and a right sensor that detect a captured image. The left sensor and the right sensor are positioned about 2.4 cm away to produce a high quality image or a 3D stereoscopic image. Accordingly, the two camera modules output a first image having a first view angle (FOV) and a second image having a second view angle (FOV).

4 illustrates an example of implementing a full-HD image using an image captured by one camera module.

As shown in FIG. 4, when a full-HD mode is selected, a part of the vertical line is cropped from an image of 2608 × 1920 pixels captured by the left camera module to create an image having a resolution lower than 2608 × 1468. The image is down-scaled by an ISP resizer to finally produce a full-HD image (1920 × 1080 resolution) having an aspect ratio of 16: 9. ) Or is displayed on the display unit 151.

5 is a diagram illustrating the characteristics of an image photographed by a dual camera.

Referring to FIG. 5, since the two camera modules (left and right sensors) are located about 2.4 cm apart from each other, an image captured by each camera module does not overlap with an area A overlapped by a field of view (FOV) difference. Unoverlapped areas B and C exist.

 The present invention combines images taken from two camera modules (left and right sensors) (images including non-overlapped regions) to produce wider Full-HD images that are wider than full-HD images taken from one camera module. Create and print That is, a wide-full HD image is realized by synthesizing a portion (common portion) where the viewing angles of the images output from the dual camera module overlap. The generated wide full-HD image is stored in the memory 160 or displayed on the display unit 151.

In addition, the present invention adjusts the output of the wide full-HD image and the focus of the image differently when both the left and right camera modules are in operation or sequentially.

6 shows an example of synthesizing images captured by a dual camera to generate a wide full-HD image.

As shown in FIG. 6, when the wide full-HD mode is selected in the dual camera mode, the left camera module (left sensor) has an image of a resolution smaller than 2608 × 1468 resolution (screen size) in which part of the vertical line is cut off as before. The right camera module (right sensor) processes a second image of 2608 × 1920 resolution and outputs an image having a camera field of view (FOV) of HD resolution (1280 × 720).

The video signal processor (not shown) generates a 2608 × 1468 temporary image by combining the images output from the left and right camera modules using super resolution. That is, the video processor processes an image having an HD resolution (1280 × 720) using super resolution to produce an image having a size (resolution) similar to the image output from the left camera module. The super resolution is to create a pixel that is missing through pixel interporation, for example, a peripheral pixel that is not at 1280 × 720 resolution, and receives a plurality of HD-size images and is similar in size to the image output from the left camera module. To make a video.

In particular, when the video processor combines the images output from the left and right camera modules, only the overlapped areas of the video are overlapped with each other. That is, the two images are combined such that the right edge of the non-overlapping region of the image output from the left camera module coincides with the right edge of the image output from the right camera module.

As a result, the temporary image has a size in which an image output from the left camera module includes only a region that does not overlap among images output from the right camera module. Therefore, the size of the temporary image is larger than the region not overlapped with the image output from the conventional left camera module.

The generated temporary image is scaled by an ISP resizer and output as a final wide full-HD image having 1920 × 1080 resolution.

FIG. 7 is a flowchart illustrating a method of implementing wide full-HD by synthesizing images captured by each camera module when simultaneously operating left and right cameras, and FIG. 8 is a diagram illustrating a method of synthesizing an actual image according to the flowchart of FIG. 7. One example. In particular, since the video signal processor may be included in the controller 180, it will be described in terms of the control operation by the controller 180.

As shown in FIG. 7, the user selects a full-HD mode (full-HD function) in a state in which both left and right cameras are operated (dual camera mode) (S10 and S11).

Once the full-HD mode is selected, the controller 180 controls the left and right camera modules, and the left camera module captures the interior of the office as shown in FIG. 8 to have a resolution smaller than 2608 × 1468 resolution (screen size). The video is output (S12). In addition, the right camera module (right sensor) captures an image having a different viewing angle from the left camera module and outputs an image having an HD resolution (1280 × 720) (S13).

Accordingly, the controller 180 generates a temporary image having a resolution of 2608 × 1468 by combining the images output from the left and right camera modules using super resolution (S14, S15). In this case, the controller 180 generates peripheral pixels that are not present in the HD resolution image captured by the right camera through pixel interporation to produce an image having a size (resolution) similar to the image output from the left camera module. In addition, the controller 180 may overlap only the overlapped areas in the corresponding image when combining the images output from the left and right camera modules. Accordingly, the temporary image has a form in which an image output from the left camera module is further included as much as a region that does not overlap among images output from the right camera module.

Therefore, the controller 180 down scales the generated temporary image through an ISP resizer to generate a wide full-HD image (1920 × 1080 resolution) having an aspect ratio of 16: 9 and finally output the result. The output wide full-HD image (1920 × 1080 resolution) is displayed on the display unit.

The present invention can implement a wide full-HD video in a state in which both the left and right cameras are operated, but the present invention is not limited thereto, and the right-side camera is operated while the full-HD video is output through the left camera module. We can begin video. In this case, the center of the screen must be adjusted.

FIG. 9 is a flowchart illustrating a method for implementing wide full-HD by synthesizing images photographed by each camera module when the left and right cameras are sequentially operated in the present invention.

First, when the user selects the full-HD function (mode) while operating the left camera module (S20, S21), the left camera module captures a subject under the control of the controller 180 to display a 2608 × 1468 resolution (screen size). In operation S22, an image having a resolution smaller than) is output.

Therefore, the controller 180 downscales the image output from the left camera module through an ISP resizer and displays a full-HD image (1920 × 1080 resolution) on the display unit (S23). In this case, the center of the screen is an image output from the left camera module.

Thereafter, when the user operates the right camera module (right sensor) (S24), the right camera module (right sensor) captures an image having a different viewing angle from the left camera module according to the control by the controller 180, and then sets an HD resolution (1280 × 720). The video is output (S25).

The controller 180 generates a temporary image having a resolution of 2608 × 1468 by combining the images output from the left and right camera modules using super resolution (S26, S27). In this case, the controller 180 generates pixels of a size (resolution) similar to that of the image output from the left camera module by generating peripheral pixels that are not present in the HD resolution image captured by the right camera through pixel interpolation.

Therefore, the controller 180 downscales the generated temporary image through an ISP resizer to generate a wide full-HD image (1920 × 1080 resolution) having an aspect ratio of 16: 9, and then displays the display unit ( 151). In this case, the controller 180 adjusts the center of the previous screen from the image output from the left camera module to the wide full-HD image (1920 × 1080 resolution) and displays it on the display unit (S28).

In addition, the present invention has been described using a wide full-HD image when the left camera module is operated first and the right camera module is operated later for convenience of description, but is not limited thereto, and the right camera module operates first. The same result can be obtained when the left camera module is operated later. That is, the controller 180 detects the operation order of the two camera modules and performs the control operation to produce the same result.

In the present invention, the camera module and the camera are used in the same sense, and the image size and resolution are also used in the same sense.

As described above, the present invention generates a wide full-HD image by using an image output from a dual camera module (dual camera), and thus, is more than a full-HD image generated by using an image output from a single camera module. The wide image (wide image) can be implemented to provide a more vivid image to the user.

Further, according to an embodiment of the present invention, the above-described method can be implemented as computer-readable code on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . Further, the computer may include a control unit of the terminal.

The mobile terminal described above can be applied to not only the configuration and method of the embodiments described above but also all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments It is possible.

110: wireless communication unit 111: broadcast receiving module
112: mobile communication module 113; Wireless Internet Module
140; Sensing unit 150: output unit
151: display unit 160: memory
180:

Claims (18)

Outputting an image of a first viewing angle from the first camera module;
Outputting a second view angle image from the second camera module; and
And synthesizing the two images based on the portion of the image in which the first and second viewing angles overlap, and outputting a wide full-HD image. The method of claim 1, wherein the first and second camera module
A wide full-HD implementation method of a mobile terminal, characterized in that the left camera module or the right camera module. The method of claim 1, wherein the first and second camera module
Wide full-HD implementation method of a mobile terminal, characterized in that the simultaneous or sequential operation. The image of claim 1, wherein the first view angle is
The resolution of less than 608 × 1468 resolution, the second viewing angle image of the wide full-HD implementation method of the mobile terminal, characterized in that having a HD resolution of 1280 × 720. The method of claim 1, wherein the wide-full HD video is
And a region in which the non-overlapping regions of the image of the first viewing angle and the image of the second viewing angle are added together. The method of claim 1, wherein the outputting the wide full HD video is performed.
Interpolating peripheral cells of the second viewing angle image using super resolution to make the second viewing angle image the size of the first viewing angle image;
Generating a temporary image by synthesizing the two images based on the overlapping portions of the first and second viewing angles; and
And downscaling the generated temporary image to output a wide-full HD image. The method of claim 1, wherein the temporary image
2608 × 1468, and the wide full-HD image has a 1920 × 1080 resolution having a 16: 9 aspect ratio. The method of claim 1, wherein the first and second camera modules are sequentially operated.
Outputting a full-HD image by downscaling an image of a first viewing angle output from the first camera module; And
When the second camera is operated, the two images are synthesized based on the overlapping portions of the first and second viewing angles to output a wide full-HD image, and the center of the screen is the wide full-HD image. A wide full-HD implementation method of a mobile terminal further comprising the step of changing to. A first camera module for outputting an image of a first viewing angle;
A second camera module for outputting a second viewing angle image;
And a controller for synthesizing the two images and outputting a wide full-HD image based on the portion of the image in which the first and second viewing angles overlap. The method of claim 9, wherein the first and second camera module
Mobile terminal, characterized in that the left or right camera module. The method of claim 9, wherein the first and second camera module
Mobile terminal, characterized in that the simultaneous or sequential operation. 10. The method of claim 9, wherein the first view angle of the image
A mobile terminal having a resolution smaller than a resolution of 608 × 1468, and the second viewing angle image has an HD resolution of 1280 × 720. 10. The apparatus of claim 9, wherein the control unit
And a wide-full HD image having a size obtained by adding up the overlapping regions of the first viewing angle image and the second viewing angle image. 10. The apparatus of claim 9, wherein the control unit
A super resolution is used to interpolate neighboring cells of the second viewing angle image to make the second viewing angle image the size of the first viewing angle image, and then synthesize the two images based on the overlapping portions of the first and second viewing angles. And generating a temporary image and downscaling the generated temporary image to output a wide-full HD image. The method of claim 9, wherein the temporary image
And a 2608 × 1468 resolution, wherein the wide full-HD image has a 1920 × 1080 resolution having a 16: 9 aspect ratio. 10. The apparatus of claim 9, wherein the control unit
When the first and second camera modules are sequentially operated, the full-HD image is output by downscaling the image of the first viewing angle output from the first camera module according to the operation sequence, and when the second camera is operated, the first and second camera modules are output. A mobile terminal, characterized in that for synthesizing two images based on a portion where the second viewing angles overlap, to output a wide full-HD image. 17. The apparatus of claim 16, wherein the control unit
And changing the center of the image displayed on the display unit from the full-HD image to the wide full-HD image. The mobile terminal of claim 9, further comprising a memory for storing the generated wide full-HD image and a display unit for displaying the generated wide-HD image.

Images