KR100681189B1 - Mobile station having plural image processing function and control method thereof - Google Patents

Abstract

The present invention relates to a mobile communication terminal having a processing function of a plurality of images and a control method thereof. The present invention includes a plurality of cameras for photographing each image of an object at different positions or angles; An image processor converting a plurality of image image data photographed by the plurality of cameras into digital data and temporarily storing the image data; and converting the image by finding a corresponding point between the plurality of images to generate an image in a specific direction; And a controller for controlling the overall operation of the mobile communication terminal and storing the image image generated by the image processor in a memory or outputting the image to a display unit. The image processing unit applies a morphing technique, and converts the plurality of image image data into digital data to temporarily store an image storage module; A corresponding point search and connection module for searching for a corresponding point among a plurality of images stored in the image temporary storage module and connecting the changed points; And an image conversion module configured to generate the image in a specific direction by transforming the image image over time. Accordingly, the morphing technique receives images from a plurality of cameras, generates an image in a specific direction, and has various image conversion functions.

Mobile Communications, Multiple Image, Camera, Image, Location, Angle, Morphing, Shooting

Description

MOBILE STATION HAVING PLURAL IMAGE PROCESSING FUNCTION AND CONTROL METHOD THEREOF}

1 is a block diagram showing a mobile communication terminal having a processing function of a plurality of images according to the present invention;

FIG. 2 is a block diagram illustrating in detail the image processor of FIG. 1; FIG.

3 is a flowchart illustrating a control method of a mobile communication terminal having a processing function of a plurality of images according to the present invention.

4 and 5 are conceptual diagrams for explaining the morphing technique according to the present invention.

<Description of the symbols for the main parts of the drawings>

10: first camera 11: second camera

12: image processing unit 13: audio processing unit

14: display unit 15: memory

16 control unit 17 key input unit

18: transmitting unit 19: receiving unit

20: duplexer 121: video temporary storage module

122: correspondence point search and connection module 123: video conversion module

ANT: Antenna SPK: Speaker

MIC: Microphone

The present invention relates to a mobile communication terminal and a control method thereof, and more particularly, to a mobile communication terminal having a processing function of a plurality of images and a control method thereof.

Due to the technological advancement of the camera itself and the rapid development of the display capable of displaying the image obtained through this, the recently developed mobile communication terminals (including mobile phones and PDAs) have become increasingly common to have cameras and image processing functions. I'm going.

As described above, the mobile communication terminal to which the image processing function is added includes a camera for capturing an image, an image signal processor for processing an image signal captured by the camera, and a display unit for displaying an image signal processed by the image signal processor. Equipped.

Here, the camera may use a CCD or a CMOS sensor, and the display unit may use an LCD.

However, in the mobile communication terminal to which the conventional image processing function as described above is provided, only one camera is provided for one terminal. For example, when photographing a person, a face image of one's front, side, or a specific direction is taken. In order to do this, the user had to change the direction of his face pose toward the camera.

In addition, since the image photographed by one camera is very simple, there is a problem that it is not possible to provide more various image conversion functions in accordance with the user's needs.

Accordingly, the present invention has been made to solve the above-described problems, and by receiving images from a plurality of cameras using a morphing technique to generate an image of a specific direction desired, and to have a variety of image conversion functions It is an object of the present invention to provide a mobile communication terminal having a processing function of a plurality of images and a control method thereof.

A mobile communication terminal having a processing function of a plurality of images according to the present invention for achieving the above object comprises: a plurality of cameras for photographing each image of one object at different positions or angles; By converting a plurality of video image data photographed by the plurality of cameras into a plurality of digital image data to temporarily store, search for a corresponding portion between the plurality of temporarily stored digital image data, and modify the image of the corresponding portion desired An image processor for generating an image of a direction; And a controller configured to store the image of the specific direction generated by the image processor in a memory or output the image to a display unit.

The image processor generates an image in a specific direction by applying a morphing technique.

The image processing unit may further include: an image temporary storage module configured to temporarily convert a plurality of image image data photographed by the plurality of cameras into digital image data and temporarily store the digital image data; A corresponding point search and connection module for searching a portion corresponding to a plurality of images stored in the image temporary storage module and connecting the changed points; And an image conversion module configured to generate an image of a specific direction by transforming the image image over time.

At least one of the plurality of cameras is preferably a removable camera detachable from the main body of the mobile communication terminal.

In addition, a control method of a mobile communication terminal having a function of processing a plurality of images according to the present invention, the method comprising the steps of photographing each image of a single object at different positions or angles with a plurality of cameras; By converting a plurality of video image data photographed by the plurality of cameras into digital image data and temporarily storing the plurality of video image data, searching for a portion corresponding to the temporarily stored plurality of digital image data, and modifying the image of the corresponding portion in a desired specific direction. Generating an image; And outputting the image in the specific direction to a display unit.

In the generating of the image, an image of a specific direction is generated by applying a morphing technique.

The generating of the image may include converting a plurality of image image data photographed from the plurality of cameras into digital image data and temporarily storing the image image data; Searching for a portion corresponding to a plurality of digital image data stored in the image temporary storage module and connecting the changed points; And transforming the video image over time to generate an image in a specific direction.

Hereinafter, exemplary embodiments of the present invention will be described with reference to the accompanying drawings.

1 is a block diagram illustrating a mobile communication terminal having a processing function of a plurality of images according to the present invention, and FIG. 2 is a block diagram illustrating the image processor of FIG. 1 in detail.

As shown, the present invention includes the first and second cameras 10 and 11, the image processing unit 12, the audio processing unit 13, the display unit 14, the memory 15, the control unit 16, and the key input unit. (17), the transmitter 18, the receiver 19, and the duplexer 20.

The first and second cameras 10 and 11 perform a function of photographing each image of one object at different positions or angles. The camera is a camera that can adjust the focus and distance, and can improve the quality of the captured video screen.

The image processing unit 12 converts the two or more pieces of video image data into digital data and temporarily stores them, and finds a corresponding point between the plurality of images, transforms the image, and generates an image of a specific direction. In this case, the image processor 12 preferably uses a morphing technique.

Accordingly, the image processing unit 12 receives two image images of left and right through two cameras 10 and 11 attached to the mobile communication terminal of the present invention, and generates a front face image through a morphing technique. Can be.

To this end, the image processor 12 includes an image temporary storage module 121, a corresponding point search and connection module 122, and an image conversion module 123.

The image temporary storage module 121 converts two or more image image data captured by the first and second cameras 10 and 11 into digital data and temporarily stores the converted image data.

The corresponding point search and connection module 122 searches for a corresponding point among a plurality of images stored in the image temporary storage module 121 and connects the changed points.

The image conversion module 123 transforms the image image over time to generate an image of a specific direction.

The audio processor 13 is controlled by the controller 16, modulates a voice signal input through the microphone MIC to a radio signal, and demodulates a radio signal received through the receiver 19 to generate a speaker SPK. The audio signal is sent to the camera.

The key input unit 17 includes numeric keys for general telephone communication and function keys for setting various functions of the mobile communication terminal. For example, the function keys which may be located in the key input unit 17 may focus and distance adjustment keys for controlling operations of the cameras 10 and 11, and a preview screen output from the cameras 10 and 11. It may consist of keys for storing or displaying.

The controller 16 controls the overall operation of the mobile communication terminal, and stores the video image generated by the image processor 12 in the memory 15 or outputs it to the display unit 14.

The memory 15 stores a program for controlling the operation of the mobile communication terminal, and also stores a video image data input, generated or converted while the program is being executed.

The display unit 14 displays an image captured by the camera 10 or a video image stored in a memory on a screen.

Meanwhile, the duplexer 20 communicates with the base station through the antenna ANT so that the signal from the transmitter 18 is transmitted to the base station through the antenna ANT, and the signal from the base station through the antenna ANT Received by the receiving unit 19.

The receiver 19 is controlled by the controller 16 and receives a radio signal output from the duplexer 20. The transmitter 18 transmits the modulated radio signal from the audio unit 13 to the duplexer 20.

In addition, at least one camera of the plurality of cameras 10 and 11 is configured as a detachable camera detachable from a main body of a mobile communication terminal. It is desirable to make this possible.

3 is a flowchart illustrating a method of controlling a mobile communication terminal having a processing function of a plurality of images according to the present invention, and FIGS. 4 and 5 are conceptual views illustrating a morphing technique according to the present invention. To describe the operation of in more detail as follows.

As shown, the present invention first receives two image images of left and right through, for example, two cameras 10 and 11 attached to the mobile communication terminal (S110 to S120).

Thereafter, the image processing unit 12 converts two or more image image data into digital data and temporarily stores the image data, and finds a corresponding point between the plurality of images, transforms the image, and generates an image of a specific direction.

In this case, the image processor 12 preferably applies a morphing technique.

Looking at the process in which the morphing technique is applied in detail, the image temporary storage module 121 temporarily converts two or more image image data captured by the first and second cameras 10 and 11 into digital data and temporarily stores them. .

Thereafter, the corresponding point search and connection module 122 searches for a corresponding point among a plurality of images stored in the image temporary storage module 121 and connects the changed points (S130).

The image conversion module 123 transforms the image image according to time to generate an image of a desired specific direction (S140).

Accordingly, the image processing unit 12 receives two image images of left and right through two cameras 10 and 11 attached to the mobile communication terminal of the present invention, and generates a front face image through a morphing technique. Can be.

Here, the morphing technique is a technique for gradually changing an image, and morphing requires two or more images such as an original image and an image to be changed, and transforms the image by finding a corresponding point between the plurality of images. . In particular, it is mainly used in movies using computer graphics, and can express extremely natural image processing technology.

Two-dimensional morphing puts two consecutive images, connects changing points (eyes to eyes or mouths), inputs a time, and the computer processes the change process.

At this time, the lighting should be matched between the images to be changed, and it is desirable to match the points corresponding to the objects to be transformed on the screen as much as possible.

Thereafter, the video image generated by the image processor 12 is output to the screen through the display unit 14 (S150).

Although the above has been illustrated and described with respect to the preferred embodiments of the present invention, the present invention is not limited to the above-described embodiments, the present invention without departing from the gist of the invention claimed in the claims Anyone with a variety of variations will be possible.

As described above, according to the mobile communication terminal having a processing function of a plurality of images according to the present invention and a control method thereof, for example, when photographing a person, in order to capture a face image of the front, side, or a specific direction of the user, It is not necessary to change the direction of the face pose of the user to face a plurality of video images taken from any angle using a plurality of cameras of the present invention using a morphing technique to generate an image of a specific direction, such as a front face, etc. It can be effective.

In addition, by taking a video image of various angles and positions with two or more cameras and morphing them, there is an effect of providing a more various image conversion function according to the user's needs.

Claims (7)

A plurality of cameras for photographing each image of an object at different positions or angles; By converting a plurality of video image data photographed by the plurality of cameras into a plurality of digital image data to temporarily store, search for a corresponding portion between the plurality of temporarily stored digital image data, and modify the image of the corresponding portion desired An image processor for generating an image of a direction; And a controller for storing the image of the specific direction generated by the image processor in a memory or outputting the image to a display unit. The method of claim 1, The image processing unit is a mobile communication terminal having a processing function of a plurality of images, characterized in that for generating an image of a specific direction by applying a morphing technique. The method according to claim 1 or 2, The image processor An image temporary storage module for converting a plurality of image image data photographed from the plurality of cameras into digital image data and temporarily storing the image image data; A corresponding point search and connection module for searching a portion corresponding to a plurality of images stored in the image temporary storage module and connecting the changed points; And a video conversion module for transforming the video image according to time to generate an image of a specific direction desired. The method of claim 1, At least one of the plurality of cameras is a mobile communication terminal having a processing function of a plurality of images, characterized in that the removable camera detachable from the main body of the mobile communication terminal. Photographing each image of one object at a different position or angle with a plurality of cameras; By converting a plurality of video image data photographed by the plurality of cameras into digital image data and temporarily storing the plurality of video image data, searching for a portion corresponding to the temporarily stored plurality of digital image data, and modifying the image of the corresponding portion in a desired specific direction. Generating an image; And outputting the image of the specific direction to a display unit. The method of claim 5, A control method of a mobile communication terminal having a processing function of a plurality of images, characterized by generating a video in a specific direction by applying a morphing technique. The method of claim 5 or 6, wherein the generating of the image comprises: Converting a plurality of video image data photographed from the plurality of cameras into digital image data and temporarily storing the digital image data; Searching for a portion corresponding to a plurality of digital image data stored in the image temporary storage module and connecting the changed points; And modifying the video image according to time to generate an image in a specific direction desired.

Images