KR20100116040A - Apparatus and method for processing image - Google Patents

Abstract

PURPOSE: An image processing apparatus and a method thereof for maximizing the convenience of a user are provided to supply various zoom functions using a face recognition method in a pre-view state for taking a picture. CONSTITUTION: A face region detecting unit(110) detects face regions in a pre-view image of frame unit received from an image acquiring unit. A zoom reference setup unit(130) sets up the face region into a zoom reference point. A zoom processing unit(140) receives a zoom signal in a first mode. The zoom processing unit performs the zoom process of a pre-view screen around the zoom reference point.

Description

Image processing apparatus and method {Apparatus and Method for Processing Image}

The present invention relates to an image processing apparatus and a method, and more particularly, an image capable of detecting a face region using a face recognition technique in a preview state for capturing an image and providing various zooming functions around the face region. It relates to a processing technique.

In general, the digital image photographing apparatus refers to a device that acquires an image of a subject and generates digital information such as a still image or a moving image file. For example, a digital image capturing apparatus may mean a digital camera, a digital camcorder, and the like, and recently, a photographing or video capturing function is added to a wireless communication terminal such as a mobile terminal.

Such digital imaging apparatuses are realized in a compact and lightweight device configuration by improving the integration of image capturing elements and digital information processing chips, and their utilization is rapidly increasing as user interfaces, entertainment, and network functions are enhanced. The trend is expected to accelerate further considering the development trend of ubiquitous digital devices.

In general, a digital image capturing apparatus acquires an image of a subject, converts it into an electrical signal, processes the image, and displays the image in a preview state through a display panel such as an LCD (Liquid Crystal Display). The user performs focusing and zoom in / zoom out while viewing the image displayed through the display panel to adjust the screen composition as desired and then press the shutter. The digital imaging apparatus then acquires an image or starts capturing a video in response to the operation of the shutter.

However, when the conventional digital image capturing apparatus performs zoom in or zoom out in the preview state, the size of the image is adjusted based on the central portion of the screen regardless of the position of the subject. For example, if a person who is a subject is zoomed in while being positioned at the edge of the preview screen, the screen is not enlarged based on the person but is enlarged based on the center of the screen. Therefore, in this case, the person should be moved to the center of the preview screen by moving the digital imaging apparatus.

However, in this conventional case, it is inconvenient to manually move the digital imaging apparatus in order to move the person to the center portion of the preview screen. If the shooting is performed in an environment in which the digital imaging apparatus cannot be moved toward the person, As the enlargement of the image through zoom-in continues, there is a problem that a person may disappear from the preview screen.

In addition, the conventional digital image capturing apparatus may not edit only a specific subject of interest among images in the preview screen. For example, assuming that a first person is located in a right part of the preview screen and a second person is located in a left part away from the first person in a preview screen including a plurality of people. If the user wants to take a picture including only the second person, the user may separately capture the first person and the second person by using a digital imaging apparatus, and then synthesize the image obtained later or combine the first person and the second person. After capturing the image including the image, it is necessary to delete the remaining persons except the first person and the second person from the image and edit the image again.

As such, the conventional digital image capturing apparatus includes problems that do not maximize the convenience of the user in the preview state. Therefore, there is an urgent need for a technology that can satisfy various requirements from the user in the preview state.

SUMMARY The present invention has been made in an effort to provide an image processing apparatus and method capable of maximizing user convenience by providing various zoom functions using a face recognition technique in a preview state for image capturing.

In order to solve this technical problem, the present invention provides an image processing apparatus in one aspect. The image processing apparatus includes a face region detection unit detecting N (N is an integer of 1 or more) face regions in a preview image received in units of frames from the image acquisition unit; A zoom reference setting unit which sets at least one face area of the N face areas as a zoom reference point; And a zoom processor configured to receive a zoom signal and to zoom the preview screen around the zoom reference point in response to the received zoom signal.

The image processing apparatus may further include a selector configured to select at least one of the N face regions detected by the face region detector. In this case, the zoom reference setting unit may set at least one selected face area as the zoom reference point.

The selector may display an icon representing the N face regions detected by the face region detector on a preview screen, and select a face region corresponding to an icon selected from a user among the icons.

The zoom processor may set a zoom magnification in the second mode and zoom the preview screen according to the set zoom magnification around the zoom reference point. Also, in the second mode, the zoom processor may receive a zoom signal and zoom the zoomed preview screen based on the zoom reference point according to the received zoom signal.

In the second mode, when the zoom reference point has a plurality of zoom reference points, the zoom processor divides the preview screen into a plurality of split screens so as to correspond to the plurality of zoom reference points, respectively, corresponding to the divided screens according to the set magnification. You can zoom around the zoom reference point. In addition, in the second mode, the zoom processor may receive a zoom signal and zoom each of the zoomed divided screens based on the corresponding zoom reference point according to the received zoom signal.

The face region detector may transmit the number information indicating the number N of the detected face regions to the voice output unit. In this case, the voice output unit may output a message informing the number N of the detected face regions as voice.

The image processing apparatus may further include a capturing control unit which acquires an image zoomed by the zoom processing unit according to a control signal received from the shutter unit.

On the other hand, in order to solve the above technical problem, the present invention provides an image processing method from another aspect. The image processing method comprises: detecting N (N is an integer of 1 or more) face regions in a preview image in a frame unit; Setting at least one face area of the N face areas as a zoom reference point; And in the first mode, zooming the preview screen around the zoom reference point in response to a zoom signal.

The image processing method may further include selecting at least one face area among the detected N face areas. In this case, in the setting of the at least one face area as the zoom reference point, the at least one selected face area may be set as the zoom reference point.

The selecting may include displaying an icon representing the detected N face areas on a preview screen; And selecting a face area corresponding to an icon selected from the user.

The image processing method may further include zooming the preview screen centering on the zoom reference point according to a preset zoom ratio in the second mode. The image processing method may further include transmitting number information indicating the number N of the detected face regions to a voice output unit.

As described above, according to the present invention, various zoom functions using a face recognition technique in a preview state for capturing an image may be provided. For example, the image capturing apparatus according to the present invention may zoom in or zoom out the preview screen centered on a person in accordance with a zoom signal, or may zoom in or zoom out the preview screen centered on a person according to a specific magnification. . In addition, the preview screen may be divided, or a function of notifying the number of people in the preview screen by voice may be provided. Therefore, there is an advantage to maximize the convenience of the user.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. In the preferred embodiment of the present invention described below, specific technical terms are used for clarity of content. However, the invention is not limited to the particular term selected, and it is to be understood that each specific term includes all technical synonyms that operate in a similar manner to achieve a similar purpose.

1 is a block diagram showing a configuration of a digital image photographing apparatus including an image processing apparatus according to a preferred embodiment of the present invention.

As shown in FIG. 1, the digital image capturing apparatus 1 includes an image acquisition unit 10, a display unit 50, a shutter unit 20, a zoom signal input unit 60, a storage unit 30, and an audio output. The unit 40 and the image processing unit 100 may be included.

The image acquisition unit 10 may perform a function of acquiring an image in a frame unit and transmitting the acquired image in a frame unit to the image processing unit 100. For example, in the preview state, the image acquisition unit 10 may acquire a preview image in units of frames and transmit the obtained preview image to the image processing unit 100. The image acquisition unit 10 may include a camera for acquiring an image signal and a conversion module for converting the image signal acquired by the camera into digital data.

The preview state may refer to a state in which an image, which is currently acquired, is displayed in real time through the display unit 50 in order to facilitate photographing when the digital image photographing apparatus 1 is driven. Such a preview state may be referred to as a live view state.

The display unit 50 may perform a function of displaying an image received from the image processing unit 100. For example, the display unit 50 may perform a function of receiving a preview image processed by the image processor 100 from the image processor 100 and displaying a preview screen. Preferably, the display unit 50 may include an image display function including a touch screen panel and include an information input function for receiving information from a user.

The shutter unit 20 may generate a control signal for commanding photographing or capturing a video according to a request from a user, and may transmit the generated control signal to the image processor 100.

The zoom signal input unit 60 may generate a zoom signal, for example, a zoom in or zoom out signal according to a request from a user, and transmit a zoom signal to the image processor 100.

The storage unit 30 may perform a function of storing data. For example, the storage unit 30 may store an image acquired by the image processing unit 100. The storage unit 30 may be, for example, a flash memory, a secure digital (SD) memory card, a multi media card (MMC), a smart media card (SMC), a universal serial bus (USB) memory, or the like.

The voice output unit 40 may perform a function of outputting various voices through the speaker. For this purpose, the voice output unit 40 may include, for example, a voice processing unit and a speaker. The voice output unit 40 may receive a specific information signal from the image processor 100 and may output a message corresponding to the received information signal as voice.

The image processor 100 may process an image in a frame unit transmitted from the image acquirer 10 and transmit the processed image to the display unit 50. The image processor 100 may provide various zoom processing functions in a preview state of the digital image capturing apparatus 10 by using a face recognition function. For example, the image processor 100 detects at least one face region from the preview image received from the image acquirer 10, and uses the information of the detected face region to detect a first mode function, a second mode function, and a person. Guidance functions and the like can be provided.

Hereinafter, the configuration and detailed operations of the image processor 100 will be described in detail.

FIG. 2 is a block diagram illustrating the configuration of the image processing unit 100 illustrated in FIG. 1, and illustrates the configuration of an image processing apparatus according to an exemplary embodiment of the present invention.

As illustrated in FIG. 2, the image processor 100 may include a face region detector 110, a selector 120, a zoom reference setter 130, a zoom processor 140, a photographing controller 150, and the like. Can be.

The face region detector 110 may receive a preview image in units of frames from the image acquirer 10, and detect N (N is an integer of 1 or more) face regions from the received preview image. For example, the face region detector 110 may detect a face region by recognizing a face included in the preview image by using a face recognition technique. Since the face recognition technique is currently known in various techniques, an appropriate technique may be selected according to an implementation environment.

Meanwhile, the face area detector 110 may transmit the number information of the detected face area to the voice processor 40 for the person guide function. For example, the face region detector 110 may detect N face regions from the preview image and transmit the number information indicating the number N of detected face regions to the voice processor 40. In this case, the voice processor 40 may output a guide message corresponding to the number information as voice.

The selector 120 may perform a function of selecting M (M is an integer of 1 or more) face areas from the N face areas detected by the face area detector 110. For example, the selector 120 displays an icon representing N face areas detected by the face area detector 110 on a corresponding preview screen displayed by the display unit 50, and a user selects a specific icon. In this case, a face area corresponding to the icon may be selected.

The zoom reference setting unit 130 may perform a function of setting the face area selected by the selection unit 120 as the zoom reference point. For example, the zoom reference setting unit 130 receives information of the M face areas selected by the selection unit 120 from the selection unit 120 and sets M zoom reference points corresponding to the received information, respectively. Can be.

The zoom processor 140 may perform a function of zooming the preview screen based on the zoom reference point set by the zoom reference setting unit 130. The zoom processor 140 may operate in the first mode or the second mode according to the set operation mode. The operation mode of the zoom processing unit 140 may be set according to the input of a specific key provided in the digital image capturing apparatus 1, or a specific user interface (eg, a setting window, selection) provided by the zoom processing unit 140. Menu, etc.). In the latter case, the zoom processor 140 may display a user interface for setting the operation mode in the preview state.

In the first mode, the zoom processor 140 may perform real-time zoom processing based on the zoom reference point set by the zoom reference setting unit 130. For example, the zoom processor 140 may receive a zoom signal from the zoom signal input unit 60 in the first mode. The zoom processor 140 may enlarge or reduce the preview image and transmit the zoomed image to the display unit 50 while the set zoom reference point is located at the center of the preview screen according to the received zoom signal.

In the second mode, the zoom processing unit 140 sets the zoom magnification and zooms the preview screen around the zoom reference point set by the zoom reference setting unit 130 according to the set zoom magnification. For example, the zoom processor 140 may enlarge the preview image according to the set zoom ratio in the second mode, and edit the preview image so that the set reference point is at the center of the preview screen, and transmit the edited preview image to the display 50. have.

In the second mode, if there are a plurality of zoom reference points, the zoom processor 140 divides the preview screen into a plurality of split screens so as to correspond to the number of zoom reference points, and each split screen centers on the corresponding zoom reference points. You can zoom by the magnification set to.

The zoom magnification may be set according to input of a specific key provided in the digital image capturing apparatus 10, or may be set through a user interface (eg, a setting window, a setting menu, etc.) provided by the zoom processing unit 140. It may be. In the latter case, the zoom processor 140 may display a graphic interface for setting the operation mode in the preview state.

Meanwhile, in the second mode, the zoom processing unit 140 may zoom the preview screen zoomed at the set magnification around the zoom reference point according to the zoom signal received from the zoom signal input unit 60. When the preview screen is divided into a plurality of zoomed split screens, the zoom processor 140 may zoom each split screen based on the corresponding zoom reference point according to the zoom signal received from the zoom signal input unit 60. It may be.

The capturing controller 150 may perform a function of acquiring an image zoomed by the zoom processor 140 according to a control signal received from the shutter unit 20. For example, the photographing controller 150 may receive a control signal from the shutter unit 20, and the still image processed in the first mode or the second mode by the zoom processor 140 in response to the received control signal. Alternatively, a video may be acquired and stored in the storage unit 30. That is, the capturing controller 150 may acquire a digital picture or a video that is variously edited by the image processor 100 on the preview screen.

The configuration and operation of the image processing apparatus according to the preferred embodiment of the present invention have been described above. Hereinafter, an image processing technique based on such an image processing apparatus will be described in a methodological manner.

3 is a flowchart illustrating a flow of an image processing method according to an exemplary embodiment of the present invention.

As shown in FIG. 3, first, when the power of the digital image capturing apparatus 10 is turned on, the digital image capturing apparatus 10 previews the image acquired by the image capturing unit 10 in real time. It becomes a state.

In this case, the image processing apparatus provided in the digital image capturing apparatus 1, that is, the image processing unit 100 receives a preview image in units of frames from the image acquisition unit 10 (step: S1), and receives N from the received preview image. Dog face areas are detected (step S2). For example, assuming that four people are included in the received preview image, the image processor 100 may detect four faces included in the preview image by using a face recognition technique.

Subsequently, the image processor 100 may display an icon representing the detected N face regions on the preview screen corresponding to the preview image (step S3).

4 is an exemplary diagram for describing an icon displayed by the image processor 100.

As shown in FIG. 4, there are four people P1, P2, P3, and P4 on the preview screen PV, and the people P1, P2, and P4 on the faces of each person P1, P2, P3, and P4. Icons I1, I2, I3, and I4 representing the face areas of P3 and P4 are displayed.

In this case, the user may select a desired icon from the displayed icon. Then, the image processing unit 100 selects the face area corresponding to the icon selected by the user (step: S4), and sets the selected face area as the zoom reference point (step: S5).

Next, the image processing unit 100 determines the currently set operation mode (step: S6). The setting time point of the operation mode is not particularly limited and may be performed at an appropriate time according to an implementation environment. For example, the setting of the operation mode may be performed when the preview state starts, after detecting a face region, selecting a face region, setting a zoom reference point, and the like. In addition, the determination time of the operation mode may vary in various ways according to the implementation environment. For example, the determination of the operation mode may be performed at a specific time after the operation mode is set.

As a result of determining the operation mode, when the operation mode is the first mode, the image processor 100 may perform a real time zoom processing function based on a first mode function, for example, a set zoom reference point (step S7). On the other hand, when the operation mode is the second mode, the image processor 100 may perform a second processing function, for example, a zoom processing function by setting a zoom magnification based on the set zoom reference point (step S8).

Subsequently, the image processing unit 100 may acquire the zoomed image in the first mode or the second mode according to the control signal received from the shutter unit 20 (step S9). Accordingly, the user may acquire various edited images as a picture or a video in the first mode or the second mode.

5 is a flowchart for describing an operation flow of the image processing unit 100 in the first mode.

As shown in FIG. 5, in the first mode, the user may manipulate the zoom signal input unit 60 to zoom in, for example, the preview screen. Accordingly, the zoom signal input unit 60 may output a zoom signal in response to a user's manipulation. Then, the image processor 100 may receive a zoom signal output from the zoom signal input unit 60 (step S11).

When the zoom signal is received, the image processor 100 may zoom the preview screen based on the zoom reference point set according to the received zoom signal (step S12). For example, the image processor 100 may enlarge the preview image according to the zoom signal and edit the preview image so that the set zoom reference point is located at the center of the preview screen, and display the preview image on the preview screen.

6 is an exemplary diagram illustrating a preview screen zoomed by the image processor 100.

As shown in FIG. 6, it is assumed that the screen PVI before the zoom-in process includes four people P1, P2, P3, and P4, and among these, a face region of P1 is selected as the zoom reference point. In the preview mode PVA1 zoomed in the first mode, the preview image is enlarged around the face area of the selected P1.

Conventionally, when zooming in, the image is enlarged based on the center portion of the preview screen, but in the present invention, a zoom-in function is provided centering on a specific person of interest. Therefore, the user can provide a more convenient zoom in function in the preview state.

7 is a flowchart illustrating an operation flow of the image processor 100 in a second mode.

As shown in FIG. 7, in the second mode, first, the image processor 100 sets a zoom magnification (step S21). For example, the image processor 100 may set a zoom magnification according to information input from a user or a preset magnification.

Subsequently, the image processor 100 may determine whether the set zoom reference point is one or a plurality of individuals (step S22). When there is only one zoom reference point, the image processing unit 100 zooms the preview screen around the set zoom reference point according to the set zoom factor (step S24). For example, the image processor 100 may enlarge the preview image according to the set zoom factor, and edit the preview image so that the set reference point is at the center of the preview screen.

Meanwhile, when there are a plurality of zoom reference points, the image processing unit 100 divides the preview screen into a plurality of split screens so as to correspond to the number of zoom reference points, and each split screen is set based on the corresponding zoom reference points. Zooming by the magnification is possible (step S23). For example, the image processing unit 100 edits the preview image to generate preview images each of which the set zoom reference point is centered and enlarged by a set magnification, and synthesizes the generated preview images and displays them on one preview screen. can do.

FIG. 8 is a diagram illustrating a preview screen zoomed by the image processing unit 100 in the second mode, and illustrates a case where two zoom reference points are provided.

As shown in FIG. 8, it is assumed that the screen PVI before the zoom-in process includes four people P1, P2, P3, and P4, and among these, the face regions of P1 and P4 are selected as the zoom reference point. In the preview mode PVA2 zoomed in the second mode, the split screen SP1 enlarged around the face area of the selected P1 and the split screen SP4 enlarged around the face area of the selected P2 are displayed. Therefore, even in the preview state, it is possible to provide a convenient zoom function for variously editing an image around at least one person desired by the user.

After zooming the preview screen according to the set zoom ratio in the second mode as described above, the image processing unit 100 receives the zoom signal from the zoom signal input unit 60 and adjusts the zoom reference point according to the received zoom signal. You can also zoom the preview screen around. If the preview screen is divided into a plurality of split screens, each split screen may be zoomed around the corresponding zoom reference point according to the zoom signal received from the zoom signal input unit 60.

On the other hand, the image processing unit 100 may provide a personnel guidance function. In detail, the image processor 100 may detect N face regions from the preview image and transmit the number information indicating the number N of the face regions to the audio output unit 40 of the digital image processing apparatus 10.

In this case, the voice output unit 40 may output a guide message corresponding to the number information as voice. For example, the voice output unit 40 indicates that "N people currently exist in the preview screen." Voice messages such as

This personnel guide function is easy when the user takes a self-photographing yourself. Because in the case of a digital imaging apparatus that is not equipped with a two-way camera, the user can not see the preview screen directly during self-shooting, it is not known whether their face is properly included in the camera angle. Thus, in this case, the voice guidance function can be quite effective.

Although the present invention has been described above with reference to its preferred embodiments, those skilled in the art will variously modify the present invention without departing from the spirit and scope of the invention as set forth in the claims below. And can be practiced with modification. Accordingly, modifications of the embodiments of the present invention will not depart from the scope of the present invention.

1 is a block diagram showing a configuration of a digital image photographing apparatus including an image processing apparatus according to a preferred embodiment of the present invention.

FIG. 2 is a block diagram illustrating a configuration of the image processor shown in FIG. 1.

3 is a flowchart illustrating a flow of an image processing method according to an exemplary embodiment of the present invention.

4 is an exemplary diagram for describing an icon displayed by an image processor.

5 is a flowchart for describing an operation flow of an image processor in a first mode.

6 is an exemplary diagram illustrating a preview screen zoomed by an image processor.

7 is a flowchart illustrating an operation flow of an image processor in a second mode.

8 is an exemplary diagram illustrating a preview screen zoomed by an image processor of a second mode.

<Description of the symbols for the main parts of the drawings>

1: digital video recording device

10: image acquisition unit

20: shutter unit

30: storage

40: audio output unit

50: display unit

60: zoom signal input unit

100: image processing unit

110: face area detection unit

120: selection unit

130: zoom reference setting unit

140: zoom processing unit

150: shooting control unit

Claims (15)

A face region detector for detecting N (N is an integer of 1 or more) face regions in a preview image received in units of frames from the image acquisition unit; A zoom reference setting unit which sets at least one face area of the N face areas as a zoom reference point; And And a zoom processor configured to receive a zoom signal and zoom the preview screen around the zoom reference point in response to the received zoom signal. The display apparatus of claim 1, further comprising: a selector configured to select at least one of the N face regions detected by the face region detector. The zoom reference setting unit sets the at least one selected facial area as the zoom reference point. The method of claim 2, wherein the selection unit And displaying, by the face region detector, icons representing the detected N face regions on a preview screen, and selecting a face region corresponding to an icon selected by a user. The method of claim 1, wherein the zoom processing unit, The image processing apparatus of claim 2, wherein a zoom magnification is set and the preview screen is zoomed based on the set zoom magnification around the zoom reference point. The image of claim 4, wherein in the second mode, the zoom processor receives a zoom signal and zooms the zoomed preview screen based on the zoom reference point according to the received zoom signal. Processing unit. The display apparatus of claim 4, wherein the zoom processor divides the preview screen into a plurality of split screens so as to correspond to the plurality of zoom reference points in the second mode. And zooming each of the divided screens based on a corresponding zoom reference point. The method of claim 6, wherein in the second mode, the zoom processing unit receives a zoom signal and zooms each of the zoomed divided screens based on the corresponding zoom reference point according to the received zoom signal. Image processing device. The apparatus of claim 1, wherein the face area detector transmits the number information indicating the number N of the detected face areas to a voice output unit, so that the voice output unit outputs a message indicating the number N of the detected face areas as voice. An image processing apparatus, characterized in that to enable. The image processing apparatus according to claim 1, further comprising a photographing control unit which acquires an image zoomed by the zoom processing unit according to a control signal received from the shutter unit. In the image processing method using an image processing device, Detecting N (N is an integer of 1 or more) face regions in the preview image on a frame-by-frame basis; Setting at least one face area of the N face areas as a zoom reference point; And And zooming the preview screen around the zoom reference point in a first mode in response to a zoom signal. The method of claim 10, further comprising selecting at least one face region of the detected N face regions, The setting of the at least one face area as a zoom reference point may include setting the at least one selected face area as the zoom reference point. The method of claim 11, wherein the selecting step, Displaying an icon representing the detected N face regions on a preview screen; And And selecting a face area corresponding to an icon selected from a user. The image processing method of claim 10, further comprising zooming the preview screen around the zoom reference point according to a preset zoom magnification in the second mode. The method of claim 13, wherein when the zoom reference points are plural in the second mode, zooming the preview screen may include: Dividing a preview screen into a plurality of split screens to correspond to the plurality of zoom reference points; And And zooming each of the divided screens with respect to the corresponding zoom reference point according to the set magnification. The image processing method of claim 10, further comprising transmitting number information indicating the number N of the detected face regions to a voice output unit.

Images