KR101303203B1 - Videotelephony apparatus and method for making full face image - Google Patents

Abstract

PURPOSE: Front image generation video call device and method are provided to perform a call while having eye contact with other callers by generating an image in which a caller faces forward by applying a sight angle of the caller to a generated stereoscopic image. CONSTITUTION: A stereoscopic image generation unit (109) generates a respective caller image photographed by a camera unit (107) into a stereoscopic image. A control unit (110) detects the location of the caller's eyes in the stereoscopic image. The control unit calculates a sight angle of the caller. An image conversion unit (111) inclines a facial part of the caller included in the stereoscopic image based on the location of eye of the detected caller and generates a front image. [Reference numerals] (101) Transceiver unit; (102) Data processing unit; (103) Audio processing unit; (104) Movement detection unit; (105) Key input unit; (106) Display unit; (107) Camera unit; (108) Image processing unit; (109) Image generation unit; (110) Control unit; (111) Image conversion unit

Description

Videotelephony Apparatus and Method for Making Full Face Image}

The present invention relates to a video call device and method for converting the appearance of the caller included in the image taken during the video call to the image of the front view.

As the technology for digital cameras develops day by day, video call terminals equipped with digital cameras in communication devices are widely used. When the video call terminal operates in the video call mode, the video call terminal may perform a call function while mutually transmitting and receiving images taken by the communication terminal and the camera of the other party. For example, when a portable video call terminal is described as an example, a caller generally views an image of his or her face with a camera mounted on the portable communication terminal within an arm length while holding the communication terminal in his or her hand. Operate the video call terminal to transmit to the portable communication terminal. At this time, the caller manipulates the angle of the camera or the position of the video call terminal so that his / her face is captured more accurately while checking the image of himself / herself while the video taken by the camera is displayed on his video call terminal image. .

However, since the camera position of the general video call terminal is located above the display unit, there is a difference between the time when the caller looks at the video call terminal and the time when the camera captures the caller. Therefore, since the camera is positioned above the position of the caller's eye looking at the display of the video call terminal, the camera takes the caller obliquely from the top to the bottom of the mobile video call terminal. Unable problem occurs.

The present invention is to solve the above-described problems, due to the difference between the point of view of the caller looking at the video call device and the point of time to shoot the caller in the camera installed in the video call device is taken with the caller's eyes leaned to a certain angle An object of the present invention is to provide a video call generating apparatus and method for generating a front image correcting an image to a front view.

According to an aspect of the present invention, there is provided a front image generating video call apparatus comprising: a camera unit including a plurality of cameras positioned at an upper end or a lower end of a video call apparatus to photograph a caller at different viewpoints; A stereoscopic image generator for generating a stereoscopic image by combining the caller images respectively photographed by the camera unit; Detects the caller's eye position in the stereoscopic image and calculates the caller's gaze angle, which is an angle generated when the extension line of the gaze looking at the caller's eye from the camera unit intersects the extension line of the gaze looking at the display of the video communication device. A control unit; And an image converter configured to generate a front image by tilting a participant's face part included in the stereoscopic image by a caller's eye angle based on the eye position of the caller detected by the controller.

The front image generating video call apparatus may further include a motion sensor configured to measure a tilt of the video call apparatus, and the controller may include a camera using a distance between the camera and the caller and a tilt angle measured by the motion sensor. It is preferable to calculate the caller's gaze angle, which is an angle generated when the extension line of the gaze facing the caller's eyes and the caller's gaze facing the display of the video communication device intersect.

In addition, the control unit, the caller gaze angle θ by the formula,

Where h is the distance from the center of the display to the camera, and Z is the distance between the camera and the caller's eye.

To calculate using

The distance Z between the camera unit and the caller is expressed as

Where B is the distance between the plurality of cameras, F is the focal length of the camera lens, and d is the displacement value generated by the plurality of cameras.

It is preferable to calculate using.

In addition, the control unit, the caller gaze angle θ by the formula,

Where h is the vertical axis of the video call device and the vertical height of the camera part and Z is the distance between the camera part and the caller's eye while the video call device is inclined at a specific angle by the user.

The central axis of the video call device and the vertical height h of the camera unit are

(Where α is the angle at which the video call device is tilted relative to the vertical axis)

To calculate using

The distance Z between the camera unit and the caller is expressed as

Where B is the distance between the plurality of cameras, F is the focal length of the camera lens, and d is the displacement value generated by the plurality of cameras.

It is preferable to calculate using.

In addition, the camera unit has two cameras are arranged symmetrically at the top or bottom of the video call device or symmetrically arranged at the top and bottom of the video call device, and the three-dimensional image generating unit is a stereo to the caller image respectively captured by the camera unit. It is preferable to generate a stereoscopic image by applying a stereo matching method.

In addition, the front image generating video call apparatus further includes a touch input unit that supports a touch type input, and the control unit includes a stereoscopic image mode that generates a stereoscopic image when a scroll input in a specific direction is input through the touch input unit. It is preferable to carry out.

In addition, the motion detection sensor is preferably a gyroscope sensor or an inclination sensor.

A method of generating a front image of a caller in a video call apparatus, comprising: (a) photographing a caller's video in each of a plurality of cameras; (b) generating a stereoscopic image by applying a stereo matching method to the video of the caller photographed in step (a); (c) The eye of the caller looking at the caller's eye from the camera using the distance between the camera and the caller and the distance between the camera and the caller's eye set based on the detected eye position by detecting the caller's eye position in the stereoscopic image. Calculating a gaze angle, which is an angle generated when an extension line of and an extension line of a line of sight of a caller looking at a display unit of a video communication device cross each other; And (d) generating a front image by tilting a participant's face part included in the stereoscopic image by the caller's eye angle based on the detected caller's eye position.

In addition, step (c),

Caller's eye angle θ,

Where h is the distance from the display center of the video caller to the camera, Z is the distance between the camera and the caller's eye,

The distance Z between the camera and the caller,

Where B is the distance between the plurality of cameras, F is the focal length of the camera lens, and d is the displacement value generated by the plurality of cameras.

The front image generating method characterized in that the calculation using.

In addition, in the step (a), it is preferable that the two cameras are arranged symmetrically at the top or bottom of the video call device or symmetrically arranged at the top and bottom of the video call device.

A method of generating a front image of a caller in a video call apparatus, comprising: (a) photographing a caller's video in each of a plurality of cameras; (b) generating a stereoscopic image by applying a stereo matching method to the video of the caller photographed in step (a); (c) measuring an inclination angle of the video call device in the motion detection sensor; (d) Viewing the caller's eyes from the camera by detecting the caller's eye position in the stereoscopic image and using the distance between the camera and the caller set based on the detected eye position and the tilt angle measured by the motion sensor. Calculating a gaze angle, which is an angle generated when an extension line of the gaze and an extension line of the gaze of the caller looking at the display unit of the video communication device cross each other; And (e) generating a front image by tilting a participant's face part included in the stereoscopic image by the caller's eye angle based on the detected caller's eye position.

(d) step,

Caller's eye angle θ,

(Where h is the center axis of the video call device and the vertical height of the camera, Z is the distance between the camera and the caller's eye while the video call device is inclined at a certain angle by the user),

The center axis of the video call device and the vertical height h of the camera are

(Where α is the angle at which the video call device is tilted with respect to the vertical axis),

The distance Z between the camera and the caller,

Where B is the distance between the plurality of cameras, F is the focal length of the camera lens, and d is the displacement value generated by the plurality of cameras.

It is preferable to calculate using.

before step (a), determining whether a scroll input in a specific direction for executing a stereoscopic image mode for generating a stereoscopic image through the touch input unit is input from the user; Switching the normal video mode to a stereoscopic video mode when it is determined that a scroll input in a specific direction is input from the user; .

In the step (a), the two cameras may be arranged symmetrically on the top or bottom of the video call device or symmetrically arranged on the top and bottom of the video call device.

According to the present invention, a caller and the other party can make a call by using the caller's gaze angle to the stereoscopic image generated by using the caller's images photographed by a plurality of cameras to create an image in which the caller faces the front. This allows the video caller to feel a natural call such as talking while actually looking at the other person's face.

1 is a block diagram of a video call apparatus according to a first embodiment of the present invention.
2 is a diagram illustrating a principle of recognizing stereoscopic shapes by a person according to a first exemplary embodiment of the present invention.
3 is a first exemplary diagram showing a principle of generating a front image of a caller according to a first embodiment of the present invention.
4 is a second exemplary view showing a principle of generating a front image of a caller according to the first embodiment of the present invention.
5 is a conceptual diagram for obtaining a caller gaze angle according to a first embodiment of the present invention.
6 is a diagram illustrating a principle of obtaining a displacement value according to the first embodiment of the present invention.
7 is a flowchart illustrating a process of generating a front image in the video call apparatus according to the first embodiment of the present invention.
8 is a block diagram of a video call device according to a second embodiment of the present invention.
9 is a conceptual diagram for obtaining a caller gaze angle according to a second embodiment of the present invention.
10 is a flowchart illustrating a process of generating a front image in a video call apparatus according to a second embodiment of the present invention.

With reference to the accompanying drawings, a preferred embodiment of the present invention will be described in more detail, but already known technical parts will be omitted or compressed for the sake of brevity of description.

For convenience of description, the portable video call device will be described as the first embodiment and the fixed video call device according to the second embodiment.

1 is a block diagram of a video call apparatus according to a first embodiment of the present invention, Figure 2 is a view showing a principle that a person recognizes a stereoscopic according to a first embodiment of the present invention.

Referring to FIG. 1, the video call apparatus 100 according to the first embodiment of the present invention includes a transceiver 101, a data processor 102, an audio processor 103, a motion sensor 104, and a key input unit. 105, a display unit 106, a camera unit 107, an image processor 108, an image generator 109, a controller 110, and an image converter 111. Here, the video call device 100 is preferably a mobile communication terminal supporting a wired or wireless communication method.

The transceiver 101 transmits and receives video signals generated between video call devices of the other party through a communication network.

The data processor 102 converts an image signal transmitted / received with the video call device of the other party into a signal that can be processed by the video call device 100 or converts the image data generated by the video call device 100 into a signal that can be transmitted. Here, the data processor 102 may include a modem and a codec, and the codec includes a data codec for processing packet data and an audio codec for processing a signal such as voice.

The audio processor 103 reproduces the received audio signal output from the audio codec of the data processor 102 through the speaker or transmits the transmission audio signal generated from the microphone to the audio codec of the data processor 102.

The motion sensor 104 is a sensor for detecting the degree of movement of the video call device 100, the motion sensor 104 according to the first embodiment of the present invention is a video call device 100 by the caller Detects the degree of inclination forward or backward relative to the caller. Here, the motion sensor 104 is preferably a gyroscope sensor or tilt sensor.

The key input unit 105 includes keys for inputting numbers and letters and function keys for setting various functions. Here, in the embodiment of the present invention, for convenience of description, it is assumed that the key input unit 105 is a touch screen device combined with the display unit 106.

The display unit 106 is an output device capable of outputting an image, and outputs an image of the counterpart photographed by the counterpart's video call device.

The camera unit 107 is a camera sensor for capturing an image of a caller and converting the photographed optical signal into an image signal which is an electrical signal. The camera unit 107 includes at least two cameras. Here, the camera unit 107 is composed of at least two or more cameras to generate a three-dimensional (3D) image of the caller, at least two or more cameras are symmetrically installed at the top or bottom of the display, or two or more cameras are at the top It is installed symmetrically on the top and bottom, respectively, to shoot the caller in each camera. Here, in the first embodiment of the present invention, for convenience of description, it will be described on the assumption that two cameras are installed symmetrically on the upper end of the display unit 106.

The image processor 108 converts the image signal photographed by the camera unit 107 into frame data, which is display data, and the image processor 108 converts the image signals respectively output from the camera unit 107 in units of frames. The video data generated by the processing is generated, and the frames are simultaneously converted into a predetermined color and size.

In addition, the image processing unit 108 includes an image codec, and compresses the frame displayed on the display unit 106 in a predetermined manner or restores the compressed frame to the original frame.

The image generator 109 synthesizes the image frames photographed by the left camera and the right camera of the camera unit 107 in a preset method to generate a stereoscopic image. Here, the image generator 109 preferably generates a stereoscopic image of the left image and the right image captured by the two cameras by using a stereo matching method. The principle of generating a stereoscopic image will be described in detail with reference to the accompanying drawings.

In general, as shown in FIG. 2, a person feels three-dimensional by synthesizing the image seen from the left eye and the image seen from the right eye. Here, the stereo matching method is a method of generating a stereoscopic image by using two images similarly to the principle that the human senses stereoscopic.

The controller 110 tracks the caller's eye position in the stereoscopic image of the caller generated by the image generator 109, and compares the tilt angle measured by the motion sensor 104 with the camera unit 107 and the caller's eye. Caller's line of view angle, which is an angle generated when an extension line of the gaze facing the eye of the caller in the camera unit 107 and an extension line of the gaze facing the display unit 106 of the video call device 100 intersect using the distance. Calculate Here, a detailed process of calculating the caller's gaze angle in the controller 110 will be described in detail with reference to the accompanying drawings.

In addition, the controller 110 activates a stereoscopic image mode that converts the general image into a stereoscopic image when a scroll input occurs in a preset direction in the key input unit 105 during the normal image mode in which the general image can be called. Here, the scroll input direction input through the key input unit 105 may be a scroll input in a variety of directions, such as from bottom to top, top to bottom, left to right, right to left, etc. In one embodiment of the present invention For convenience of explanation, it is assumed that the user switches from the normal image mode to the stereoscopic image mode when the user scrolls down from the bottom.

The image converting unit 111 generates the front image, which is an image in which the caller faces the front, by tilting the caller's face included in the stereoscopic image by the caller's eye angle based on the caller's eye position estimated by the controller 110. . In this case, the front image generated by the image converter 111 is converted into an image signal by the data processor 102 and then transmitted to the video call device of the other party through the transceiver 101, and the display unit of the video call device of the other party The caller will output the image facing the front.

3 is a first exemplary diagram illustrating a principle of generating a front image of a caller according to the first embodiment of the present invention, and FIG. 4 is a principle of generating a front image of a caller according to the first embodiment of the present invention. It is a 2nd example figure which shows.

3 and 4 are diagrams illustrating principles of generating stereoscopic and frontal images of a caller using two cameras, and FIG. 3 illustrates a case in which the camera unit 107 is symmetrically positioned above the display unit 106. 4 is a diagram illustrating a case in which the camera unit 107 is positioned symmetrically with respect to the display unit 106. Here, FIG. 3 and FIG. 4 are a method of generating a stereoscopic image and a frontal image using two caller images captured by two cameras. FIG. 3 and FIG. 4 will be described together for convenience of description. .

Referring to FIGS. 3 and 4, when two cameras of the camera unit 107 respectively photograph callers (3a and 4b), each of the calls photographed by the camera positioned horizontally or vertically symmetrically in the image generator 109 A 3D stereoscopic image of a caller is generated through steps 3b and 4b of generating a disparity map using stereo matching on the child's image (3c and 4c). Here, the stereo matching technique is one of the image synthesis techniques widely used by those skilled in the art, and a detailed description of the stereo matching technique will be omitted in the first embodiment of the present invention.

5 is a conceptual diagram for obtaining a caller's gaze angle according to a first embodiment of the present invention, and FIG. 6 is a view illustrating a principle for obtaining a displacement value according to the first embodiment of the present invention.

FIG. 5 is a conceptual diagram conceptually illustrating a relationship between a video call device and a caller for calculating a caller's gaze angle in the controller 110, θ is a caller's gaze angle, and α is a user based on a vertical axis of the video call device. The angle tilted by, Z is the distance between the camera unit 107 and the caller's eye, h is the camera unit 107 on the central axis of the video call device in a state that the video call device is inclined at a specific angle by the caller. The vertical height to l, denotes the vertical length of the video call device.

Here, Equation 1 for obtaining the caller eye angle θ is

In order to obtain the caller's eye angle θ, the distance between the camera unit 107 and the caller's eye Z, the camera unit 107 at the central axis of the video call apparatus with the video call device tilted at a specific angle by the caller. The vertical height h up to

Here, Equation 2 for obtaining the vertical height h from the central axis of the video call device to the camera unit 107 in a state where the video call device is inclined at a specific angle by the caller,

Where l denotes the vertical length of the video call device 100 and α denotes an angle at which the video call device 100 measured by the motion sensor 104 is inclined with respect to the vertical axis.

In addition, Equation 3 to obtain the distance Z between the camera unit 107 and the caller's eye,

B denotes a distance between respective cameras constituting the camera unit 107, F denotes a focal length of the camera lens, and d denotes a disparity value generated by a plurality of cameras. Here, the displacement value d is a value representing a distance difference between subjects in two caller images captured by two cameras of the camera unit 107 as shown in FIG. 6, and the image generating unit 109 applies a stereo matching technique. It is calculated in the process.

7 is a flowchart illustrating a process of generating a front image in the video call apparatus according to the first embodiment of the present invention. Here, in an embodiment of the present invention, for convenience of description, the user switches from a general video mode in which a general general video call is provided to a stereoscopic video mode to provide a stereoscopic video call through a preset scroll input to provide a call service. It is assumed that it is used. In addition, the stereoscopic image mode will be described on the assumption that the user is executed by matching with the downward scroll input of scrolling from the bottom to the top in a touch manner with the key input unit 105.

Referring to FIG. 7, the controller 110 determines whether a downward scroll input for executing a stereoscopic image mode occurs from the user through the key input unit 105 (S710).

If it is determined in step S710 that the downward scroll input occurs, the controller 110 switches the current normal video mode to the stereoscopic image mode (S711). If it is determined in step S710 that the downward scroll input does not occur, the controller ( 110 maintains the current normal video mode (S713).

Subsequently, the camera unit 107 photographs the caller who looks at the display unit 106 of the video call apparatus 100 (S720).

Subsequently, the image processor 108 generates a stereoscopic image by applying stereo matching techniques to the two caller images captured by the camera unit 107 (S730).

Subsequently, the controller 110 estimates the caller's eye position from the stereoscopic image generated in step S730 (S740), and the motion detection sensor 104 calculates an angle at which the video call device 100 is inclined (S750).

Subsequently, the controller 110 calculates the caller's gaze angle using the tilt angle measured by the motion sensor 104 and the distance between the camera unit 107 and the caller's eye (S760).

Subsequently, the image converter 111 generates a front image in which the caller face of the stereoscopic image is tilted upward by the caller eye angle calculated in step S760 based on the estimated caller's eye position in step S740 (S770).

Subsequently, the controller 110 determines whether a call termination command is input from the user through the key input unit 105 (S780), and if it is determined that a call termination command is input through the key input unit 105, the controller 110 terminates the current connection. (S790).

In addition, the controller 110 determines whether a call termination command is input from the user through the key input unit 105 while performing step S713 (S715), and if it is determined that a call termination command is input through the key input unit 105, the current connection is performed. End the current call (S790).

If the call termination command is not input in step S715, step S710 is performed.

8 is a block diagram of a video call device according to a second embodiment of the present invention. Here, for the convenience of description, the description of the similar parts to the configuration of the video call apparatus according to the first embodiment of the present invention will be omitted.

Referring to FIG. 8, the video call apparatus 800 according to the second embodiment of the present invention includes a transceiver 801, a data processor 802, an audio processor 803, a command receiver 805, and a display 806. ), A camera unit 807, an image processor 808, an image generator 809, a controller 810, and an image converter 811. Here, the video call device 800 supports a video call through a wired or wireless communication method, and is preferably a smart TV, a conference call device, or the like that can be fixed to a wall or a desk.

The command receiving unit 805 is a device for receiving a specific command related to a video call from a caller, and includes a key input device for inputting a command exposed to the outside of the video call device 800 or a video call related command from the outside. It is preferable that it is a receiving device capable of receiving a signal.

The display unit 806 is an output device capable of outputting an image, and outputs an image of the counterpart photographed by the video call device of the counterpart.

The camera unit 807 transmits the images captured by the plurality of cameras to the image processor 808.

The image processor 808 generates image data processed by the image signal photographed by the camera unit 807 in units of frames, and simultaneously converts the frames to a predetermined color and size to be transmitted to the image generator 809.

The image generator 809 generates a stereoscopic image by synthesizing the image frames photographed by the left camera and the right camera of the camera unit 807 transmitted from the image processor 808 in a preset method.

The controller 810 tracks the caller's eye position in the stereoscopic image of the caller generated by the image generator 809, and displays the camera at the center of the video call device 800 and the distance between the camera unit 807 and the caller's eye. When the extension line of the gaze facing the eye of the caller in the camera unit 807 crosses the extension line of the gaze facing the display unit 806 of the video call device 800 by using the distance between the parts 807. Calculates the caller's eye angle, which is the angle. Here, a detailed process of calculating the caller's gaze angle in the controller 810 will be described in detail with reference to the accompanying drawings.

The image converter 811 tilts the caller's face included in the stereoscopic image upward by the caller's gaze angle based on the caller's eye position estimated by the controller 810 to generate a front view image of the caller facing the front. The converted front image is converted into an image signal by the data processor 802 and then transmitted to the video call device of the other party through the transceiver 101.

9 is a conceptual diagram for obtaining a caller gaze angle according to a second embodiment of the present invention.

9 is a conceptual diagram conceptually illustrating a relationship between a video call device and a caller for calculating a caller's gaze angle in the controller 810, θ is a caller's gaze angle, and Z is a camera unit 807 and an eye of a caller. The distance between the two h represents the distance between the camera portion 807 at the center of the video call device (800).

Here, Equation 5 for obtaining the caller eye angle θ is

In order to determine the caller's eye angle θ, the distance Z between the camera unit 807 and the caller's eye, and the distance h between the camera unit 807 at the center of the video call device 800 must be obtained first.

Here, the distance h between the camera unit 807 and the center of the video call device 800 is a value set in advance when the video call device 800 is manufactured.

In addition, the distance Z between the camera unit 807 and the caller's eye is a value calculated in the process of applying the stereo matching technique as in the first exemplary embodiment of the present invention.

Therefore, the caller's gaze angle θ may be calculated through a predetermined value h and a value Z calculated by the stereo matching technique and equation (5).

10 is a flowchart illustrating a process of generating a front image in a video call apparatus according to a second embodiment of the present invention.

Referring to FIG. 10, the camera unit 807 photographs a caller looking at the display unit 806 of the video call device 800 (S1010).

Subsequently, the image processing unit 808 generates a stereoscopic image by applying stereo matching techniques to the two caller images captured by the camera unit 807 (S1020).

Subsequently, the controller 810 estimates the caller's eye position from the stereoscopic image generated in step S1020 (S1030).

Subsequently, the controller 810 calculates the caller's gaze angle using the distance between the camera unit 807 and the distance between the camera unit 807 and the caller's eye at the center of the preset video call device 800. (S1040).

Subsequently, the image converter 811 generates a front image in which the caller's face of the stereoscopic image is tilted upward by the caller's eye angle calculated in step S1040 based on the estimated caller's eye position in step S1030 (S1050).

Subsequently, the controller 810 determines whether a call termination command is input from the user through the command receiving unit 805 (S1060), and when it is determined that the call termination command is input through the command receiving unit 805, ends the call currently connected. (S1070).

The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art to which the present invention pertains may make various modifications and variations without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

100, 800: video call device 101, 801: transceiver
102, 802: data processor 103, 803: audio processor
104: motion detection sensor 105: key input unit
106, 806: display unit 107, 807: camera unit
108, 808: image processor 109, 809: image generator
110, 810: control unit 111, 811: image conversion unit
805: command receiving unit

Claims (14)

In a video call device,
A camera unit including a plurality of cameras positioned at an upper side or a lower side of the video call apparatus to capture a caller at different viewpoints;
A stereoscopic image generation unit for generating a stereoscopic image by combining the caller images respectively photographed by the camera unit;
A call that detects the eye position of the caller in the stereoscopic image and is an angle generated when the extension line of the gaze facing the eye of the caller from the camera unit intersects the extension line of the gaze facing the display of the video call device. A controller for calculating an eye gaze angle; And
And an image converter configured to generate a front image by tilting a participant's face part included in the stereoscopic image by the caller's eye angle based on the eye position of the caller detected by the controller.
The front image generating video call device,
Further comprising a; motion detection sensor for measuring the tilt of the video call device,
The control unit,
By using the distance between the camera and the caller and the inclination angle measured by the motion sensor, the extension line of the eye looking at the caller's eye at the camera unit and the caller looking at the display unit of the video call device. And a caller gaze angle, which is an angle generated when an extension line of the gaze intersects.
delete The method of claim 1,
The control unit,
The caller gaze angle θ by the equation,

(Where h is the distance from the center of the display portion of the video call device to the camera portion, Z is the distance between the camera portion and the caller's eye)
To calculate using
A distance Z between the camera unit and the caller

Where B is the distance between the plurality of cameras, F is the focal length of the camera lens, and d is the displacement value generated by the plurality of cameras.
Front image generating video call device, characterized in that for calculating using.
The method of claim 1,
The control unit,
The caller gaze angle θ by the equation,

(Where h is the vertical axis of the video call device and the vertical height of the camera part while the video call device is inclined at a specific angle by the user, and Z is the distance between the camera part and the eye of the caller)
To calculate using
The central axis of the video call device and the vertical height h of the camera unit is

(Where α is the angle at which the video call device is tilted with respect to the vertical axis)
To calculate using
A distance Z between the camera unit and the caller

Where B is the distance between the plurality of cameras, F is the focal length of the camera lens, and d is the displacement value generated by the plurality of cameras.
Front image generating video call device, characterized in that for calculating using.
The method according to claim 3 or 4,
The camera unit includes:
Two cameras are arranged symmetrically at the top or bottom of the video call device or symmetrically arranged at the top and bottom of the video call device,
The stereoscopic image generating unit,
And generating a stereoscopic image by applying a stereo matching method to each caller image photographed by the camera unit.
5. The method of claim 4,
The front image generating video call device,
Further comprising; a touch input unit for supporting a touch type input,
The control unit,
And a stereoscopic image mode for generating a stereoscopic image when a scroll input of a specific direction is input through the touch input unit.
The method according to claim 6,
The motion detection sensor,
A front image generating video call device, characterized in that the gyroscope sensor or the tilt sensor.
delete delete delete In the video call apparatus for generating a front image of the caller,
(a) capturing a video of the caller in each of the plurality of cameras;
(b) generating a stereoscopic image by applying a stereo matching method to the video of the caller photographed in step (a);
(c) measuring an inclination angle of the video call device in a motion sensor;
(d) detecting the eye position of the caller from the stereoscopic image and using the distance between the camera and the caller set based on the detected eye position and the tilt angle measured by the motion sensor; Calculating a gaze angle, which is an angle generated when an extension line of the gaze facing the eye of the caller and an extension line of the gaze gazing at the display unit of the video call device cross each other; And
(e) generating a front image by tilting a participant's face part included in the stereoscopic image by the caller's gaze angle based on the detected eye position of the caller;
Front image generating method comprising a.
The method of claim 11,
The step (d)
The caller gaze angle θ by the equation,

Where h is the center axis of the video call device and the vertical height of the camera, Z is the distance between the camera and the caller's eye while the video call device is inclined at a specific angle by the user. Calculate,
The central axis of the video call device and the vertical height h of the camera is expressed by

(Where α is calculated using an angle of inclination of the video call device with respect to the vertical axis),
The distance Z between the camera and the caller is expressed as:

Where B is the distance between the plurality of cameras, F is the focal length of the camera lens, and d is the displacement value generated by the plurality of cameras.
The front image generating method characterized in that the calculation using.
13. The method of claim 12,
Before the step (a)
Determining whether a scroll input in a specific direction for executing a stereoscopic image mode for generating a stereoscopic image through the touch input unit is input from the user; And
And when the scroll input of the specific direction is determined to be input by the user, switching from the general image mode to the stereoscopic image mode.
The method of claim 13,
The step (a)
Two cameras are arranged symmetrically on the top or bottom of the video call device or the top and bottom symmetrical arrangement on the top and bottom of the video call device.

Images