KR101879813B1 - Handphone for taking picture with eye contact - Google Patents

Abstract

The present invention relates to an image capturing mobile phone capable of image capturing in a state of eye contact at the time of operation of the phone in a video call mode or a self-portrait mode. An embodiment of the present invention includes: a mobile phone housing having a screen mounting groove formed of a left side, a right side, an upper side, and a lower side; a touch screen panel which is embedded in the screen mounting groove and can simultaneously perform input and display functions; a camera which is installed at one or more longitudinal sides of the left and right sides and captures a user himself/herself and creates his/her own image when the user operates a video call mode or a self-portrait mode; and a controller for displaying a user′s image and the other party′s image on the touch screen panel when operating in the video call mode and displaying the user′s image on the touch screen panel when operating in the self-portrait mode.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a hand-

The present invention relates to an image capturing cellular phone capable of image capturing in a state of being in a state of eye alignment at the time of a video call or self-portrait photographing.

When talking to the other party, it is common to face each other's eyes. Communicators share not only the auditory sound but also visually the other person's eyes while communicating and improving the quality of communication.

Since the position of the camera for the video call or the self-camera is located at the top of the mobile phone, it is not easy to match the view when the video call or the self-portrait is taken. In other words, in the case of a video call, if I look in the other party's eyes, the camera that utilizes my video sends me the party looking at the bottom, and when I look at the camera to see that I'm watching the party, I myself will not be able to gaze exactly at the other person's eyes.

Even in the case of a self-portrait, if I take a picture of a taken image properly, my gaze is looking down, and if I look at the camera to take an image looking straight, the composition of the photo I hold may be distorted.

Korean Utility Model No. 20-2015-0004150

SUMMARY OF THE INVENTION The present invention provides a mobile phone capable of capturing an image in a state of eye-catching at the time of a video call or a self-portrait photograph.

An embodiment of the present invention is a mobile phone comprising: a mobile phone housing having a screen mounting groove formed of a left side, a right side, an upper side, and a lower side; A touch screen panel which is embedded in the screen mount groove and can simultaneously perform input and display; A camera installed at one or more longitudinal sides of the left side and the right side to photograph the user himself / herself and generate a self-image when operating in a video communication mode or a self-portrait mode; A control unit for displaying the user's image and the other party's image on the touch screen panel when operating in the video communication mode and displaying the user's image on the touch screen panel when operating in the self-portrait mode; And a counterpart image correcting unit for correcting a pupil position of a counterpart so that the pupil position of the counterpart is positioned on the same height line as the camera installation height in the video call mode, When the camera installation height is assumed, the camera installation height is provided on the left side or the right side adjacent to the upper half of the longitudinal axis of the touch screen panel.

delete

delete

delete

Wherein the counterpart image correction unit comprises: a counterpart pupil position determination module for determining a counterpart pupil position in the counterpart image when operating in the video communication mode; And a counterpart image position correcting module for correcting the counterpart image position in real time so that the counterpart pupil position is located on the same height line as the camera installation height, wherein the controller matches the counterpart image position during the video call, The other party's image can be displayed on the touch screen panel.

The eye-catching image capturing cellular phone has a single camera structure provided with a camera on one of the left and right sides, or a first camera installed on the left side and a second camera installed on the right side And has a dual camera structure installed therein.

When the two cameras are installed in the dual camera structure, the eye-catching image capturing cellular phone is configured to use the first image captured through the first camera and the second image captured through the second camera, And a stereoscopic image processing unit for generating a stereoscopic image of the subject, which is displayed by the controller, to the control unit.

When the two cameras are installed in the dual camera structure, the eye-catching image capturing cellular phone is configured to use the first image captured through the first camera and the second image captured through the second camera, And a person's image synthesizing processing unit for generating an image of the person to be examined and providing the generated image to the control unit.

Wherein the user's image synthesis processing unit generates a virtual user image that looks at the front side by matching a first feature point extracted from the first user's first image and a second feature point extracted from the second user's second image with each other have.

According to the embodiment of the present invention, the camera may be provided on the vertical axis of the mobile phone so that eye alignment can be performed during a video call or a self-portrait photograph.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a perspective view of an eye-catching imaging camera phone according to an embodiment of the present invention; FIG.
2 is a block diagram of a configuration of a video imaging mobile phone according to an embodiment of the present invention;
3 is a view showing a video call appearance of a video shooting mobile phone equipped with a camera according to an embodiment of the present invention.
FIG. 4 and FIG. 5 are views illustrating a method of correcting a counterpart image according to an embodiment of the present invention. FIG.
FIG. 6 is an exemplary view showing a camera installation position according to an embodiment of the present invention. FIG.
FIG. 7 is a block diagram of a stereoscopic image-capturing mobile phone having a stereoscopic image processing unit and an image synthesizing unit according to an embodiment of the present invention; FIG.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and how to achieve them, will be apparent from the following detailed description of embodiments thereof taken in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the exemplary embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of the invention to those skilled in the art. And the present invention is only defined by the scope of the claims. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

FIG. 1 is a perspective view of an eye-catching image capturing mobile phone according to an embodiment of the present invention, FIG. 2 is a block diagram of an image capturing mobile phone according to an embodiment of the present invention, FIG. 4 and FIG. 5 are views illustrating a method of correcting a counterpart image according to an embodiment of the present invention.

In the present invention, the camera 140 is installed at the eye position of the screen to be taken by the user himself or herself when the user operates the video communication mode or the self-camera mode. The position of the camera 140 is determined to be the position where the eye position of the other party is highest when the video call is stochastically performed. The position of the eye of the received image to be displayed on the screen is adjusted to the installation line of the camera 140 in real time using the pattern recognition technology (the eye alignment correction function) , And the eye contact correction function is processed by the soft selection function so that it can be selected according to the user's necessity. Will be described in detail below with reference to Figs. 1 to 5. Fig.

The image capturing mobile phone 100 according to the present invention will be described with reference to a smart phone as an example of the smartphone as shown in FIG. 1, but it may be a desktop PC, a tablet PC, a slate PC slate PC, a notebook computer, and the like. Of course, it is needless to say that the terminal to which the present invention is applicable is not limited to the above-described type, but may include both terminals capable of communicating with external devices.

1 and 2, the image capturing mobile phone 100 includes a communication unit 110, a memory 120, a mobile phone housing 101, a touch screen panel 130, a camera 140, and a controller 150 ). In addition, a counterpart image correction unit 160 may be further included.

The communication unit 110 is a module that performs a function of communicating with the outside through a mobile communication network. When performing mobile communication such as 3G or 4G, the communication unit 110 includes an RF transmitter (not shown) for up converting and amplifying the frequency of a radio- An RF receiver (not shown) for low-noise amplifying the received radio signal and down-converting the frequency, and the like.

The memory 120 is a ROM or a RAM and is a storage body in which information data necessary for driving a mobile phone is permanently stored or temporarily stored. For reference, the memory 120 may be a flash memory, a Compact Flash card, an SD card (Secure Digital Card), an SM card (Smart Media Card), an MMC card (Multi-Media Card) A memory stick, or the like, which can input / output information, or may be provided in a separate device.

The mobile phone housing 101 is provided with a screen mounting groove formed of a left side 101a, a right side 101b, an upper side 101c and a lower side 101d as the main housing of the image capturing cellular phone 100.

The touch screen panel 130 is an input / output module that is embedded in the screen mount groove and can simultaneously perform input and display. The touch screen panel 130 is a display window provided on a front surface of a mobile phone to provide a touch screen screen capable of simultaneously performing input and display, and is a display window for displaying a work screen, and includes a graphical user interface (GUI) Graphic User Interface).

The camera 140 is a module that is installed on a longitudinal side of at least one of the left side 101a and the right side 101b and generates an image. The camera 140 photographs the user himself / herself in the video communication mode and the self- . The camera 140 is installed on the upper side 101c of the mobile phone housing 101 so that the user can not obtain accurate eye contact during the video call or self-portrait photographing. However, the present invention is not limited to the case where the camera 140 is installed on the left side 101a or the right side 101b, not on the upper side 101c, It is possible to make a correct eye contact at the time of self-photographing.

For reference, the camera 140 may include a lens assembly, a filter, a photoelectric conversion module, and an analog / digital conversion module. The lens assembly includes a zoom lens, a focus lens, and a compensation lens. The photoelectric conversion module converts light from an optical system (OPS) into an electrical analog signal. The analog / digital conversion module processes the analog signal from the photoelectric conversion module (OEC), removes the high frequency noise, adjusts the amplitude Then, it converts it into an image of a digital signal.

The control unit 150 is a module implemented as an MCU (Main Control Unit) capable of operation. The control unit 150 displays the original image and the opposite side image on the touch screen panel 130 when operating in the video call mode, And displays his / her image on the touch screen panel 130.

The camera 140 is installed on at least one of the left side 101a and the right side 101b of the mobile phone housing 101. At this time, the installation point of the camera 140 may include one or more of the following installation conditions .

One is that when the other party's image is displayed on the entire screen of the touch screen panel 130 when operating in the video call mode, the ergonomic big data analysis results show that the eye position of the opponent in the entire screen of the touch screen panel 130 The height position at which the camera 140 has the highest probability of being displayed is determined as the height of the installation point of the camera 140. The height position of the screen display of the other party image is different according to the form of the mobile phone mount during the video call. Accordingly, the probability that the opponent's eye position is displayed using the big data about the opponent's eye position at the time of video communication is highest After calculating the height position, the height position is determined as the height of the installation point of the camera.

The height of the installation position of the camera 140 installed on the left side 101a or the right side 101b is the height of the installation of the camera 140 The left side 101a or the right side 101b adjacent to the half upper half of the longitudinal axis of the vehicle. In general, since the entire face appears on the screen at the time of video call or self-portrait photographing, the camera 140 is installed at the upper half of the longitudinal axis of the touch screen panel 130, which is highly likely to locate the eyes.

On the other hand, since the relative eye position of the received image in a video call can be shaken while making a video call, when a user makes a conversation while glancing at the opponent's eyes, the direction of the user's eyes also changes. For example, when the direction of the user's eyes is downward for eye contact with the other party, the camera 140 installed on the left side or the right side 101b of the mobile phone housing 101 has a fixed height, It can not be done.

In consideration of this point, the image capturing cellular phone 100 of the present invention includes a counterpart image correcting unit 160 (an image capturing unit) for correcting the pupil position of the counterpart to be positioned on the same height line as the installation height of the camera 140 .

The counterpart image correction unit 160 includes a counterpart eye position determination module and a counterpart image position correction module.

The partner's pupil position determination module grasps the position of the partner's pupil in the partner image when operating in the video communication mode. It is possible to grasp the position of the pupil of the partner in the partner image using various existing image extraction algorithms.

The counterpart image position correction module corrects the other party's image position in real time so that the pupil position of the counterpart is positioned on the same height line as the installation height of the camera 140. [ For example, when the pupil position of the opponent is located on the lower side of the touch screen panel 130 as shown in FIG. 4, the position of the opponent pupil is positioned on the same height line as the height of the camera 140, So as to compensate in real time. In contrast, when the pupil position of the partner is located on the upper side of the touch screen panel 130 as shown in FIG. 5, the partner image position is lowered so that the pupil position of the partner is positioned on the same height line as the installation height of the camera 140 It corrects in real time. For reference, such an eye contact correction function can be implemented to be processed by a soft selection function so as to select whether or not to use according to a user's need.

The control unit 150 displays the other party's image on the touch screen panel 130 while matching the other party's video position during the video call.

FIG. 6 is an exemplary view showing a camera installation position according to an embodiment of the present invention, and FIG. 7 is a block diagram of an imaging imaging mobile phone having a stereoscopic image processing unit and a user's image synthesis processing unit according to an embodiment of the present invention.

The camera 140 is installed on at least one of the left side 101a and the right side 101b as described above. For example, as shown in Fig. 6 (a), only the left side 101a The camera 140 may have a single camera 140 structure in which the camera 140 is installed or may have a single camera 140 structure in which the camera 140 is installed only on the right side 101b as shown in Fig. have.

Or a dual camera 140 in which a camera 140 is installed on both the left side 101a and the right side 101b as shown in Fig. 6 (c) A first camera 140a provided on the left side 101a and a second camera 140b provided on the right side 101b.

Under the structure of the dual camera 140, the original image can be generated stereoscopically at the time of generation, or can be generated as an image of the front side.

First, a communication unit 110, a memory 120, a mobile phone housing 101, a touch screen panel 130, a camera 140, a control unit 150 And a counterpart image correction unit 160. The stereoscopic image processing unit 170 may further include a stereoscopic image processing unit 170. [

The stereoscopic image processing unit 170 generates a three-dimensional stereoscopic image that is three-dimensionally displayed using a first image of the user, which is captured through the first camera 140a, and a second image of the user, which is captured through the second camera 140b And provides it to the control unit 150. That is, the left-side image of the user and the right-side image of the user are combined to generate a three-dimensional stereoscopic image of the user, and the stereoscopic image is provided to the controller 150. A software algorithm for composing stereoscopic images by synthesizing two images may be applied to various known stereoscopic image production algorithms.

The control unit 150 may display the stereoscopic image of the user on the mobile phone of the user himself or herself, and may display the stereoscopic image on the mobile phone of the other user by transmitting the stereoscopic image to the mobile phone of the user.

Meanwhile, the dual camera 140 further includes a user's own image synthesis processing unit 180 in order to make the user's image always look ahead. The personal image synthesis processing unit 180 generates a personal image to be used as a front face by using the first image of the user to be photographed through the first camera 140a and the second image of the user to be photographed through the second camera 140b To the control unit 150.

To this end, the user's image synthesis processing unit 180 generates a virtual user image that looks at the front side by matching the first feature point extracted from the first user image and the second feature point extracted from the second user image. For example, the position and shape of the eyebrow are extracted from the first image, the position and shape of the pupil are extracted to identify the first feature point, the position and shape of the eyebrow are extracted from the second image, So as to grasp the second characteristic point. Then, the virtual eye image is generated by comparing the eyebrows and eye pupils of the first image with the eye points of the second eye image and the eye points of the user's second eye to gaze at the front face. For reference, when comparing the face image taken at the left side 101a of the mobile phone with the face image taken at the center point of the mobile phone with reference to the reference person at the time of manufacturing the mobile phone, information on the first difference and information on the right side 101b And a face image taken at a center point of the mobile phone, so as to have information on the second difference value in advance. Using the first difference value, the first image of the user is converted into an image of gazing at the front side, the second image of the user is converted into the image of gazing at the front side by using the second difference value, It is possible to generate a hypothetical image of a person who finally gazes at the front face by correcting the image.

The embodiments of the present invention described above are selected and presented in order to assist those of ordinary skill in the art from among various possible examples. The technical idea of the present invention is not necessarily limited to or limited to these embodiments Various changes, modifications, and other equivalent embodiments are possible without departing from the spirit of the present invention.

100: Video shooting mobile phone
110:
120: Memory
130: Touch screen panel
140: camera
150:
160:

Claims (9)

A mobile phone housing provided with a screen mounting groove formed of a left side, a right side, an upper side, and a lower side;
A touch screen panel which is embedded in the screen mount groove and can simultaneously perform input and display;
A camera installed at one or more longitudinal sides of the left side and the right side to photograph the user himself / herself and generate a self-image when operating in a video communication mode or a self-portrait mode;
A control unit for displaying the user's image and the other party's image on the touch screen panel when operating in the video communication mode and displaying the user's image on the touch screen panel when operating in the self-portrait mode; And
And a counterpart image correcting unit for correcting the pupil position of the opponent to be positioned on the same height line as the height of the camera when the image communication mode is operated,
When the height of the installation point of the camera installed on the left side or the right side is taken as the camera installation height, the camera installation height is a height of the camera installed on the left side or the right side adjacent to the upper half of the longitudinal axis of the touch screen panel Possible video shooting cell phone.
delete delete delete The apparatus according to claim 1,
A partner pupil position determination module for determining the pupil position of the partner in the partner image when operating in the video communication mode; And
And a counterpart image position correction module that corrects the counterpart image position in real time so that the counterpart pupil position is located on the same height line as the camera installation height,
Wherein the control unit matches a counterpart video position during a video call to display a counterpart video on a touch screen panel.
The eye-catching image capturing cellular phone according to claim 1,
A single camera structure having a camera installed on a longitudinal side of one of the left side and the right side,
Or a dual camera structure in which a first camera installed on the left side and a second camera installed on the right side are installed.
[7] The method of claim 6, wherein when the two cameras are installed in the dual camera structure,
A stereoscopic image processing unit for generating a three-dimensional stereoscopic image that is three-dimensionally displayed using a first image of the user, which is captured through the first camera, and a second image of the user, which is captured through the second camera, and provides the three-
The eye-catching video shooting cell phone including.
[7] The method of claim 6, wherein when the two cameras are installed in the dual camera structure,
A first image synthesized by the first image generating unit and a second image synthesized by the second camera, the first image being obtained through the first camera and the second image being obtained through the second camera;
The eye-catching video shooting cell phone including.
9. The apparatus according to claim 8,
Wherein the virtual self image is generated by matching a first feature point extracted from the first image and a second feature point extracted from the second image to look at the front face.

Images