KR20100022634A - Apparatus for controlling the zoom lens of the camera module and method of the same - Google Patents

Abstract

PURPOSE: A zoom lens control device of a camera module and a control method thereof are provided to enable an automatic zoom in operation about a face when a zoom in target is escaped from the center of a display screen, thereby improving the convenience of a user. CONSTITUTION: A zoom lens control device of a camera module includes a zoom lens unit(110), a face recognition unit(120), a zoom lens control unit(130), and a zoom lens operation unit(140). The zoom lens unit receives the image of a subject. The face recognition unit recognizes a face from the image of the subject received to the zoom lens unit. The zoom lens control unit decides the operation direction of the zoom lens unit to arrange a face in the center of a screen. The zoom lens operation unit operates the zoom lens unit toward a direction decided by the zoom lens control unit.

Description

Apparatus for controlling the zoom lens of the camera module and Method of the same}

The present invention relates to a zoom lens control device and a control method of a camera module, and more particularly, to a zoom-in operation of a zoom lens around a face of a subject in a camera module capable of recognizing a face of a subject. The present invention relates to a zoom lens control apparatus and a control method of a camera module capable of enlarging and placing a face of a subject in a center of a display screen.

Recently, mobile devices such as cellular phones are equipped with a camera module mounted with an image pickup device such as a CCD image sensor or a CMOS image sensor. Such a camera module has a high degree of pixel and high functionality, and thus has a similar degree to that of a general high specification digital camera. Equipped with the performance.

On the other hand, such a camera module for a mobile device has a zoom-in function and a function of recognizing a specific part of a subject to enlarge a specific part of a subject and display it on a display screen, more specifically, a person (subject) Equipped with a facial recognition function to recognize the face of). 6 and 7 show an example of performing a zoom in function in the conventional camera module for a mobile device.

As shown in FIG. 6, a face of a person, which is a subject, is recognized and displayed on a display screen by a camera module for a mobile device of the related art. In this case, a rectangular box is disposed around the face to indicate that the face is recognized.

However, when the zoom-in function is performed in order to enlarge a specific portion of a subject in the conventional camera module, as shown in FIG. This is because the zoom lens of the camera module is zoomed in based on the center of the zoom lens, that is, the center point of the display screen, rather than the zoom in function of the human face.

For this reason, as shown in FIG. 7, there is a problem in that the face of the person is zoomed in from the display screen. In order to display the face of the person zoomed in on the display screen, the mobile device with the camera module installed must be moved toward the face. There was inconvenience in using.

The present invention is a camera module capable of face recognition, the zoom lens control device and control of the camera module that can be arranged by placing the face area in the center of the display screen by performing a zoom in function around the face area of the subject It is an object to provide a method.

In order to achieve the above object of the present invention, the present invention provides a zoom lens unit for receiving an image of a subject, a face recognition unit for recognizing a face part from an image of the subject received from the zoom lens unit, and a center of a display screen. A zoom lens control unit for finding the center point of the face area to determine the driving direction of the zoom lens unit, and a zoom lens driving unit driving the zoom lens unit in the direction determined by the zoom lens control unit to locate and enlarge the face unit in the zoom region; A zoom lens controller of the camera module can be provided.

Here, the face recognition unit detects feature elements such as two eyes and lips at the face portion, and transmits coordinates of the two eyes and lips to the zoom lens controller.

The zoom lens controller may calculate a center point of the face from coordinates of two eyes and lips of the face portion, and calculate a tilting / panning angle of the zoom lens unit.

The zoom lens driver may be driven to correspond to a center point and a tilting / panning angle of the face portion transmitted from the zoom lens controller to arrange the face portion on the center portion of the display screen.

The zoom lens driver may be configured to zoom in on the face part after arranging the face part in the center of the display screen.

In addition, the zoom lens driving unit is configured to place the face portion at the center portion of the display screen and simultaneously zoom in to the face portion.

In the zoom lens control method of the camera module according to the present invention, in the zoom lens control method of a camera module having a zoom lens for enlarging and outputting a subject, (a) recognizes the face portion of the subject and is separated from the face portion. A face recognition mode setting step of detecting coordinates of two eyes and lips, and (b) calculating a tilting / panning angle for calculating a center point of the face portion and a tilting / panning angle of the zoom lens from the coordinates of the two eyes and lips (C) receiving a zoom in signal for receiving a zoom in signal for driving the zoom in on the face part, and (d) a center point of the face part such that the face part is disposed on the center of the display screen; A zoom lens control step of determining a driving direction of the zoom lens, and (e) a zoom lens driving step of driving the zoom lens corresponding to the driving direction of the zoom lens; Include.

Here, the coordinates of the two eyes and the lips of the face part recognized in the step (a) are stored in the memory after the coordinates and tilting / panning angle of the center point of the face part are calculated in real time in the step (b). It is characterized by.

In the step (a), when the face part is moved, a coordinate and a tilting / panning angle of the center point corresponding to the moved face part are calculated and stored in another area of the memory.

Also, in the step (b), the center point of the zoom lens is the center of the triangle composed of the two eyes and the lips, and the tilting / panning angle is the center point of the face area from the distance of the display screen and the center of the display screen. It is characterized by being calculated by the ratio of the distance to.

Further, in the step (c), it is characterized in that the zoom-in is driven to the face portion corresponding to the application time of the zoom-in signal applied from the outside.

In addition, the zoom lens is zoom-in driving with respect to the face part after the tilting / panning driving of the zoom lens for arranging the face part on the center of the display screen in step (e).

In the step (e), the tilting / panning driving of the zoom lens for arranging the face portion on the center of the display screen and the zoom-in driving of the zoom lens with respect to the face portion are performed simultaneously.

According to the present invention, the face recognition unit recognizes the face part of the subject and calculates the tilting / panning angle of the zoom lens part with respect to the center point and the center point of the face part, thereby zooming in and driving the zoom lens around the face part of the subject. The present invention may provide a zoom lens control apparatus and a control method of a camera module which may be disposed to be enlarged by arranging a face portion at a center portion of a display screen.

In addition, even when the zoom-in object is away from the center of the display screen, the zoom-in driving of the face part can be performed automatically, thereby providing a camera module having a very high usability.

Hereinafter, a zoom lens control apparatus and a control method of a camera module according to a preferred embodiment of the present invention with reference to the accompanying drawings will be described in detail.

As shown in FIG. 1, the zoom lens controller 100 of the camera module according to an exemplary embodiment of the present invention includes a zoom lens unit 110 for receiving an image of a subject and a zoom lens unit 110. A face recognition unit 120 that recognizes a face part from an image of a subject, a zoom lens controller 130 that determines a driving direction of the zoom lens unit 110 by finding a center point of a face recognized by the face recognition unit 120, and And a zoom lens driver 140 for driving the zoom lens unit 110 in the direction determined by the zoom lens controller 130.

The zoom lens unit 110 is built in the camera module to receive an image of an external subject. The zoom lens unit 110 includes a plurality of lens groups to transfer the image of the subject to an image sensor inside the camera module. Zoom in / out is driven to zoom in and display on the display screens. In addition, the zoom lens unit 110 may be autofocused by a conventional autofocus method in order to increase the resolution of an image displayed on a display screen.

The face recognizing unit 120 is for recognizing a face from a subject received by the zoom lens unit 110. The face recognizing unit 120 extracts information on the edge portion of the face received from the zoom lens unit 110 and extracts the extracted edge portion information. Detects feature elements such as two eyes, nose and lips. The face part may be recognized according to the detected feature element. The method for detecting the face area in the face recognition unit 120 is already known, and a detailed description of the face detection method will be omitted. However, in order to find the center point of the face part of the present invention, coordinates of two eyes and lips should be detected among various feature elements of the face.

The zoom lens controller 130 detects a center point of the face using the feature of the face detected from the face recognition unit 120, that is, the coordinates of the two eyes and the coordinates of the lips, and the center point is the two eyes and the lips. It can be calculated using a formula to calculate the center of a triangle made up.

For example, when the coordinates of the two eyes are A and B, and the coordinates of the lips are C, the coordinates of the center point of the face may be calculated by the following Equation 1.

For example, if the coordinates of both eyes and the lips are A (0,0), B (10,0), C (5,10), the center coordinates of the face calculated according to Equation 1 are It is the same as [Equation 2].

That is, when the coordinates of the two eyes and the coordinates of the lips are (0,0), (10,0), and (5,10), the coordinates of the center point of the face may be set to (5,3.1). Coordinates of the facial feature elements are stored in the memory 150 or the like, and when the zoom lens driver 140 performs a zoom in function on the face, the coordinates of the center point may be transmitted to the zoom lens driver 140.

On the other hand, [Equation 1] as described above is an embodiment for finding the face center point of the present invention, the present invention is not limited to this, and different from the above Equation 1 to find the center point of the face Manner may be used.

In addition, the zoom lens controller 130 must tilt and pan the zoom lens unit 110 in order to place the face whose center point is obtained in the center of the display screen. The tilting / panning angle of the zoom lens unit 110 may be obtained by a ratio of the distance between the center of the display screen and the center of the face Cnew.

As shown in FIG. 2, the horizontal length of the entire display screen is referred to as W, the center point of the face is Cnew, the center point of the zoom lens unit 110 is Corg, and the tilting / panning angle is α. If the angle of the zoom lens unit 110 is β, the tilting / panning angle α can be obtained by Equation (3). (W and β can be changed in the design of the camera module.)

Meanwhile, in [Equation 3] and FIG. 2, it is assumed that Corg and Cnew lie on the same line in the X-axis direction, but when the coordinates of Cnew are not on the same line with respect to Corg, that is, the XY plane The tilting / panning angle α can be obtained even when placed at a random position. For example, for Corg, if Cnew is placed above the right diagonal line and is Corg (0,0), Cnew (5,8), then Cnew coordinates are defined as X-axis coordinates (5,0) and Y-axis coordinates (0,8). The driving direction of the zoom lens unit 110 may be set by calculating the tilting / panning angles by dividing by.

On the other hand, [Equation 3] as described above is an embodiment for setting the driving direction of the zoom lens unit 110 of the present invention, the present invention is not limited to this, tilting the zoom lens unit 110 In order to calculate the panning angle, a method different from the above Equation 3 may be used.

The zoom lens driver 140 receives the center point of the subject's face and the tilting / panning angle calculated from the zoom lens controller 130, and tilts / panes the zoom lens unit 110 so that the face area is positioned at the center of the display screen. At the same time it is zoomed in to enlarge the face area.

3 is a flowchart illustrating a zoom lens control method by the zoom lens controller of the camera module illustrated in FIG. 1.

In the zoom lens control method of the camera module of the present invention, a face recognition mode setting step (S110), a center point and a tilting / panning angle calculation step (S120), a zoom-in signal receiving step (S130), and a zoom lens control step for the center point ( S140) and the zoom lens driving step (S150).

The face recognition mode setting step (S110) is performed as the user selects the face recognition mode. In this case, the face region is searched and selected by the face recognition unit 120 from the image of the subject received by the zoom lens unit 110. . Subsequently, two eye and lips feature elements are detected from the information on the edge of the face area and the face area, and the coordinates of the eyes and the lips are transmitted to the zoom lens controller 130 (S110).

Next, the zoom lens controller 130 adjusts the tilting / panning angle of the center point of the face and the zoom lens unit 110 from the coordinates of the feature elements transmitted from the face recognition unit 120, specifically, the coordinates of the two eyes and the lips. Calculate. The calculated center point and tilting / panning angle of the face are stored in the memory 150 and the like. In this case, when the face of the subject is moving, that is, when the coordinates of the feature elements of the face change, the face recognition unit 120 transmits the coordinates of the moved face feature elements to the zoom lens controller 130, and the zoom lens controller 130. ) Calculates a new center point and tilting / panning angle of the face and stores it in the memory 150. Here, the center point of the face and the tilting / panning angle of the zoom lens unit 110 may be calculated by [Equation 1] and [Equation 3], but may be calculated by other methods.

Next, when the zoom-in signal is received from the user, the zoom lens controller 130 approaches the memory 150, reads the center point and angle of the face corresponding to the facial feature element currently recognized by the face recognition unit 120, and zooms it. The lens driver 140 transmits the data (S130).

Finally, the zoom lens driver 140 moves the face region to the center of the display screen by moving the zoom lens 110 to correspond to the coordinates of the center point and the panning or tilting angle transmitted from the zoom lens controller 130. The zoom-in function of the face area is performed in response to the application time of the zoom-in signal transmitted from the user (S140 and S150).

4 and 5 illustrate an embodiment of a zoom lens control process of the camera module with reference to the inspection method of FIG. 3.

As shown in FIG. 4, when the face recognition mode is selected by the user, the face area is recognized from the image received by the zoom lens unit 110, and a square box is positioned in the face area. When the face region is recognized, the coordinates of the feature elements (two eyes and the lips) are detected from the face region and transmitted to the zoom lens controller 130, and the zoom lens controller 130 uses the coordinates of the feature elements to tilt and center the face. The panning angle is calculated and stored in the memory 150. In this case, when the face region is moved, it is natural that the center point and the tilting / panning angle of the face in the moved region are calculated and stored in real time.

As shown in FIG. 5, the zoom lens unit 110 performs a zoom-in function around the face area, and thus the face area is enlarged and disposed at the center of the display screen. In this case, the zoom lens driver 140 is driven corresponding to the center point of the face area and the tilting / panning angle transmitted from the zoom lens control unit 130. First, the face area is placed at the center of the display screen and the user zooms in. The face area may be zoomed in to correspond to a signal. Alternatively, the face area may be zoomed in at the same time as the face area.

Although the zoom lens control apparatus and control method of the camera module of the present invention have been described above with reference to a preferred embodiment of the present invention, modifications, changes, and various modifications can be made without departing from the spirit of the present invention. It is obvious to

1 is a schematic diagram of an apparatus for controlling a zoom lens of a camera module according to the present invention;

2 is a schematic diagram of calculating the center point and tilting / panning angle of the face area;

3 is a schematic flowchart of a zoom lens control method of a camera module according to the present invention;

4 and 5 are schematic views showing zoom in driving in the inspection method of FIG. And

6 and 7 are schematic diagrams illustrating zoom-in driving of a camera module of the related art.

<Explanation of symbols for main parts of drawing>

100: zoom lens control unit 110: zoom lens unit

120: face recognition unit 130: zoom lens control unit

140: zoom lens driver 150: memory

Claims (13)

A zoom lens unit which receives an image of a subject; A face recognition unit recognizing a face part from an image of a subject received by the zoom lens unit; A zoom lens controller which locates a face center point to determine the driving direction of the zoom lens unit so as to arrange and enlarge the face region at the center of a display screen; And And a zoom lens driving unit for driving the zoom lens unit in a direction determined by the zoom lens control unit. The method according to claim 1, The face recognition unit detects feature elements such as two eyes and lips at the face part, and transmits the coordinates of the two eyes and lips to the zoom lens controller. The method according to claim 2, And the zoom lens controller calculates a center point of the face from coordinates of two eyes and lips of the face part, and calculates a tilting / panning angle of the zoom lens part. The method according to claim 3, The zoom lens driver is driven to correspond to a center point of the face portion and a tilting / panning angle transmitted from the zoom lens controller to arrange the face portion at the center portion of the display screen. Device. The method according to claim 4, And the zoom lens driving unit is configured to zoom in on the face part after arranging the face part in the center of the display screen. The method according to claim 4, The zoom lens driving unit of the camera module, characterized in that the zoom-in driving for the face portion at the same time as the face portion is disposed on the center portion of the display screen. In the zoom lens control method of a camera module having a zoom lens for enlarging and outputting a subject, a face recognition mode setting step of recognizing a face part of the subject and detecting coordinates of two eyes and lips from the face part; (b) a tilting / panning angle calculating step of calculating a tilting / panning angle of the center point of the face portion and the zoom lens from the coordinates of the two eyes and the lips; (c) a zoom in signal receiving step of receiving a zoom in signal for zoom in driving on the face part; (d) a zoom lens control step of determining a driving direction of a zoom lens with respect to a center point of the face portion such that the face portion is disposed on the center of the display screen; And (e) a zoom lens driving step of driving the zoom lens corresponding to the driving direction of the zoom lens. The method according to claim 7, The coordinates of the two eyes and the lips of the face part recognized in step (a) are stored in the memory after the coordinates and tilting / panning angles of the center point of the face part are calculated in real time in step (b). Zoom lens control method of the camera module. The method according to claim 8, In the step (a), when the face portion is moved, the zoom lens control of the camera module, characterized in that the coordinates and tilting / panning angle of the center point corresponding to the moved face portion are calculated and stored in another area of the memory. Way. The method according to claim 7, In the step (b), the center point of the zoom lens is the center of the triangle composed of the two eyes and the lips, and the tilting / panning angle is from the distance of the display screen and the center of the face to the center point of the face portion. Zoom lens control method of a camera module, characterized in that calculated by the ratio of the distance. The method according to claim 7, In the step (c), the zoom lens control method of the camera module, characterized in that the zoom-in drive for the face portion corresponding to the application time of the zoom-in signal applied from the outside. The method according to claim 7, The zoom lens of the camera module, wherein the zoom lens is zoomed in and driven on the face part after the tilting / panning driving of the zoom lens arranging the face part on the center of the display screen in step (e). Control method. The method according to claim 7, In the step (e), the tilting / panning driving of the zoom lens for arranging the face portion on the center of the display screen and the zoom-in driving of the zoom lens with respect to the face portion are simultaneously performed. How to control the zoom lens.

Images