KR20070073241A - Method for video communication using real-time video conversion and mobile communication terminal implementing the same - Google Patents

Abstract

A video communication method using real-time video compensation technology and a mobile communication terminal for realizing the method are provided to automatically convert into a figure at a certain view angle regardless of the view angle of a camera during video communication, so as to show the converted figure to the other party, thereby always showing a consistent particular pose to the other party. An object is recognized from each frame image taken through a camera, and a particular part of the object is extracted(S301). The extracted part is replaced with a prestored image of the corresponding part to reconfigure the corresponding frame images(S303-S313). An image consisting of the reconfigured frame images is transmitted to the other party's terminal together with a voice signal(S315).

Description

Method for video communication using real-time video conversion and mobile communication terminal implementing the same}

1 is a block diagram illustrating an internal configuration of a mobile communication terminal according to the present invention.

Figure 2 illustrates an embodiment of the table configuration of the image DB in the present invention.

3 is a flowchart showing sequentially each step of the video call method according to the present invention.

The present invention relates to a method for performing a video call using a real-time image correction technology and a mobile communication terminal for implementing the same, and more particularly, to extract a specific portion of a subject from each frame image of an image captured by a digital camera. An image extraction module, a frame reconstruction module for reconstructing a corresponding frame image by replacing an image of the extracted region with a pre-stored image of the corresponding region, and transmitting an image comprising the reconstructed frame image to a counterpart terminal together with an audio signal. The present invention relates to a mobile communication terminal including an image communication module and an image DB storing images photographed in advance for each part of a subject.

In general, there may be a shooting angle and a shooting distance most favorable to the other party in a video call, or there may be a specific shooting angle and a shooting distance most preferred by the user. However, in order to satisfy such conditions, it is very cumbersome to make a deliberate direction to maintain the attitude and distance in each video call, and it may not be possible to perform such a situation depending on the situation. There was a problem that could not perform a video call in the state.

As a way to solve this problem, Korean Patent No. 10-469727 discloses a video communication terminal and a method for placing a caller's face in the center of the screen, specifically, an image captured by a camera Extracts the caller's face area from the caller's face, grasps the pixels of the extracted face area, and corrects the angle of view distortion for the part that does not appear on the screen to correspond to the pixel. have.

However, such a technique merely corrects the user to be positioned at the center of the screen, and there is no mention of a means for correcting the view angle or correcting the shooting distance. I couldn't.

The present invention has been proposed to solve the above problems, when performing a video call using a mobile communication terminal to provide a means for automatically converting to a certain point of view regardless of the point of view of the camera to show to the other party Its purpose is to.

Another object of the present invention is to provide a means for automatically converting the call to a certain distance from the camera regardless of the shooting distance of the camera in the video call.

The present invention for achieving the above object is a mobile communication terminal for performing a video call through a digital camera, the image extraction module for extracting a specific portion of the subject from each frame image of the image taken by the camera, A frame reconstruction module for reconstructing the frame image by replacing the extracted region image with a pre-stored image of the corresponding region, and an image communication module and a subject for transmitting an image composed of the reconstructed frame image to a counterpart terminal together with an audio signal. It includes an image DB for storing the pre-recorded images for each part, the image stored in the image DB is an image taken in advance for each part of the subject at various camera views (view angles).

The apparatus may further include a viewpoint determination module configured to determine a viewpoint of a camera currently being photographed by comparing the extracted region image with images previously photographed at various camera views of the region. The reconstruction module performs frame reconstruction only when the current viewpoint is different from the preset viewpoint.

In addition, the distance detection module to determine the distance (distance) to the subject by comparing the image of the extracted region with the image previously photographed for the region, and the image stored in advance for the corresponding region to match the current distance An accumulation conversion module for converting may be further included, and the frame reconstruction module reconstructs the frame by replacing the image of the extracted portion with the accumulation conversion image.

The display apparatus may further include a display unit for providing a photographing angle selecting interface for selecting a predetermined photographing angle for capturing an image to be stored in the image DB, and a photographing part selecting interface for selecting a predetermined photographing part. .

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. First, in adding reference numerals to the elements of each drawing, it should be noted that the same elements are denoted by the same reference numerals as much as possible even if they are shown in different drawings. In the following description of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.

1 is a block diagram illustrating an internal configuration of a mobile communication terminal according to the present invention.

The input unit 210 may use various devices such as a keypad, a jog shuttle, a point stick, and a touch screen, and is used when a user selects a desired function or inputs information. In the present invention, in particular, the start and end of the video call can be selected, and the operation of the digital camera 250 can be selected in order to pre-record an image to be stored in the image DB of the memory 230.

The display unit 220 is intended to show a variety of information for operating a mobile terminal to the user and is mainly implemented through an LCD (Liquid Crystal Display), in the present invention, in particular in the user to pre-image the image to be stored in the image DB It provides a shooting angle selection interface that allows the user to select a shooting angle, and a shooting site selection interface that allows the user to select a shooting portion of the subject. Here, the shooting angle selection interface provides a menu for selecting from a predetermined angle such as 10 °, 30 °, 60 °, or a shooting point such as front, left, right, up, down, and the like. The interface preferably provides a menu that allows the user to select from predetermined site names such as eyes, nose, mouth, ears, forehead, hair, and the like.

The memory unit 230 stores various programs and data necessary for the mobile communication terminal to operate, and is implemented with various devices such as erasable programmable read only memory (EPROM), static random access memory (SRAM), and flash memory. In the present invention, an image DB for storing the image of each part of the subject and each camera viewpoint which is used to replace the image of the subject captured by the camera with the image of the preset camera viewpoint during video communication is stored. Looking at the specific table structure of such an image DB with reference to Figure 2, it can be seen that it consists of a photographing time field 201 and a plurality of photographing part field (203). In addition, a camera view angle and a photographing distance to be used as reference values in a video call are preset in a specific area of the memory unit 230.

The wireless communication unit 240 transmits and receives voice, image, and control information to and from the base station wirelessly, and receives the call signal sent by the mobile communication terminal of the other party through the antenna and transmits it to the control unit 270 or memory. The data stored in the unit 230 is transmitted to the base station through the antenna.

The controller 260 controls the operation of each component so that the mobile communication terminal can operate smoothly and has a baseband signal processing circuit for processing the baseband signal from the wireless communication unit 240.

In the present invention, the image extraction module 261 extracts an image of a specific portion of the subject from each frame image of the image captured by the digital camera 250 during the video call, and the image of the extracted portion corresponds. And a frame reconstruction module 262 for reconstructing the corresponding frame image by substituting a pre-stored image of the part, and an image communication module 263 for transmitting an image of the reconstructed frame image to the counterpart terminal together with an audio signal.

Optionally, a viewpoint determination module 264 for grasping the viewpoint of the camera currently being photographed by comparing the extracted region image with images previously photographed at various camera views for the region; The distance detection module 265 which grasps the distance from the subject by comparing the extracted image of the extracted part with an image previously photographed with respect to the corresponding part, and the image stored in advance for the corresponding part according to the current distance. Accumulation conversion module 266 for converting so that may be further included.

The modules 261 ˜ 266 as described above may be implemented in a hardware / software manner in the control unit 260, but may be implemented in pure software and stored in the memory unit 230 by the control unit 260 implemented as a general purpose processor. It can also be loaded and executed.

In addition, the voice processing unit 270 converts and amplifies a digital voice signal into an analog voice signal and outputs it to the speaker SP, or amplifies and converts a voice signal from a microphone MIC into a digital signal. In the present invention, a mobile communication terminal may be a mobile phone, a PDA, a PMP, a notebook computer, a telematics, an IP phone, or the like.

Hereinafter, a method of performing a video call with a corrected image using a mobile communication terminal having the above configuration will be described in detail. For reference, FIG. 3 is a flowchart sequentially illustrating each step of the video call method according to the present invention.

When the video call is started and the digital camera of the mobile communication terminal is operated, the specific region image of the subject is extracted from each frame image constituting the image captured by the camera (S301). In general, during a video call, the subject becomes the user who is making the call, and separates a specific part such as an eye, a nose, a mouth, and an ear from each frame image forming an image of a photographed face of the user.

Subsequently, the camera currently being photographed by comparing the extracted image of the specific region with the images of the view angles of the corresponding regions previously stored in the image DB and analyzing the degree of inclination of the image or the perspective of each region. The photographing point of time is determined (S303), and the distance between the camera and the subject currently being photographed is determined by comparing the size of the subject contour of each image (S305).

Here, when it is determined that the identified distance is different from the preset shooting distance set in the mobile communication terminal by more than a predetermined error range (S307), the accumulation is converted in a manner of enlarging or reducing the corresponding image of the image DB ( S309).

In addition, when it is determined that the identified shooting time point is different from the shooting time point set in the mobile communication terminal by more than a predetermined error range (S311), the image DB reads an image of the time point set for the corresponding area from the image DB. The frame image is reconstructed by replacing the corresponding portion of the image (S313). Since this reconstruction process should be applied to the image of each region extracted from the frame image, it is repeatedly performed as many as the extracted regions. In addition, when there is a scale conversion in steps S307 to S309, steps S311 to 313 are performed on an image that has been performed to scale conversion among images of the corresponding photographing time point.

The image composed of the reconstructed frame image is an image that is converted to fit a specific shooting time and shooting distance preset by the user, and the video call is transmitted by transmitting the image to the other party with the audio signal (S315).

In the foregoing detailed description of the present invention, specific embodiments have been described, but various modifications are possible without departing from the scope of the present invention. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be defined not only by the scope of the following claims, but also by those equivalent to the scope of the claims.

According to the present invention having the above configuration, when performing a video call using the mobile communication terminal can be automatically converted to the appearance of a certain camera point of view regardless of the point of view of the camera to show to the other party on purpose at the time of the video call You don't have to produce the poses you want to show, and the distance you shoot is also automatically converted to a phone call at a certain distance, so you can always show a consistent specific pose to the other party.

Claims (10)

A method for performing a video call in a mobile communication terminal having a digital camera, Recognizing a subject from each frame image of the image photographed by the camera and extracting a specific portion of the subject; Reconstructing the frame image by replacing the extracted region with a pre-stored image of the region; Transmitting an image comprising the reconstructed frame image to a counterpart terminal together with an audio signal; Video call method using a real-time video correction technology comprising a. The method of claim 1, wherein the pre-stored image The video call method using a real-time image correction technology, characterized in that the image is recorded in advance and stored in a particular camera view angle (view angle) for the portion. The method of claim 2, The method may further include determining a viewpoint of a camera currently being photographed by comparing the extracted region image with images previously photographed at various camera view angles of the region. The video reconstruction step is performed when the identified current time point is different from the time point previously set by the user for the video call in the mobile communication terminal. The method according to any one of claims 1 to 3, Comparing the extracted image of the region with the image previously photographed for the region to determine the distance (distance) to the subject, and accumulating and transforming the image stored in advance for the region to match the current distance More, And the image reconstruction step is performed by replacing the extracted portion with the accumulated converted image. The method of claim 1, And pre-splitting the frame image of the image of the subject photographed at various camera view angles for each predetermined part, and storing the subject in advance. In a mobile communication terminal for making a video call through a digital camera, An image extraction module for extracting a specific portion of the subject from each frame image of the image photographed by the camera; A frame reconstruction module for reconstructing the frame image by replacing the extracted image of the portion with a pre-stored image of the portion; An image communication module configured to transmit an image comprising the reconstructed frame image to a counterpart terminal together with an audio signal; And An image DB for storing images photographed in advance for each part of the subject; A mobile communication terminal capable of a video call with real-time correction, including. The method of claim 6, wherein the image stored in the image DB A mobile communication terminal capable of making a video call with real-time correction, characterized in that the image is photographed in advance for each part of the subject at various camera views. The method of claim 7, wherein The apparatus may further include a viewpoint determination module configured to determine a viewpoint of a camera currently being photographed by comparing the extracted portion of the image with images previously photographed at various camera views of the portion. The frame reconstruction module is a mobile communication terminal capable of a video call with real-time correction, characterized in that the frame reconstruction only when the current time point is different from the user preset time point. The method according to any one of claims 6 to 8, A distance grasping module that grasps the distance from the subject by comparing the extracted image of the extracted part with an image previously photographed with respect to the corresponding part, and converts an image stored in advance for the corresponding part to fit the current distance; Accumulation conversion module is further included, And the frame reconstruction module reconstructs the frame by replacing the image of the extracted portion with the accumulated converted image. The method of claim 6, wherein the mobile communication terminal And a display unit for providing a shooting angle selection interface for selecting a predetermined shooting angle for shooting an image to be stored in the image DB, and a shooting site selection interface for selecting a predetermined shooting region. Mobile communication terminal capable of video call with real-time correction.

Images