KR101335626B1 - Digital image processing apparatus wherein user's face is monitored - Google Patents

Abstract

The present invention provides a digital image processing apparatus for photographing the front side, and includes a user-face detection unit for monitoring whether a user's face appears in the rear side.

Description

Digital image processing apparatus wherein user's face is monitored}

1 is a perspective view showing the front and top appearance of a digital camera as a digital image processing apparatus according to the present invention.

FIG. 2 is a rear view showing a rear outer shape of the digital camera of FIG. 1;

FIG. 3 is a diagram showing the overall configuration of the digital camera of FIG. 1. FIG.

4 is a flow chart showing the main algorithm of the digital camera processor of FIG.

5 is a flowchart illustrating an algorithm in which reference contour information of a user face is obtained and stored in the setting mode of FIG. 4.

6 is a flowchart illustrating an algorithm of the shooting mode of FIG. 4 when the security shooting function is set.

FIG. 7 is a flowchart illustrating an algorithm of a function of performing focusing according to a user face in the preview mode of FIG. 4.

8 is a flowchart illustrating an algorithm of a function of controlling a color LCD panel according to a user face in the preview mode of FIG. 4.

9 is a flowchart illustrating an algorithm of the photographing mode of FIG. 4 when the composite photographing function is set.

FIG. 10 is a diagram illustrating an example of an image captured by the composite photographing of FIG. 9.

 <Explanation of symbols for the main parts of the drawings>

1 ... digital camera, 11 ... self-timer lamp,

12 ... flash, 13 ... shutter release button,

15 ... function buttons, 16 ... ASR mode button,

17 ... power button, 19 ... flash-light sensor, 20 ... lens, 22 ... camera-status lamp,

23 ... special-effect button, 24 ... camera strap hook,

25 ... earphone connection, MIC ... microphone,

SP ... speaker, 35 ... display panel,

36 ... + / - button, 39 ... Zoom / 9 split / volume button,

42 ... play / printer button, 43 ... mode button,

OPS ... main optical system, OEC ... main photoelectric conversion unit, M _Z ... zoom motor, M _F ... focus motor,

M _A ... aperture motor, 501 primary analog-to-digital converter,

502 ... timing circuit, 503 ... real time clock,

504 ... DRAM, 505 ... EEPROM, 506 ... memory card interface, 507 ... digital camera processor, 508 ... RS232C interface, 509 ... video filter, 21a ... USB connection, 21b ... RS232C connection, 21c ... video output, 510 ... lens driver, 511 ... flash controller, 512 ... microcontroller, INP ... user input ... audio processor, 514 ... LCD driver, 62 ... flash memory, 49 ... secondary lens unit,

48 ... user-face detection, 45 ... secondary optics,

46 ... secondary photoelectric converter, 47 ... secondary analog-to-digital converter.

The present invention relates to a digital image processing apparatus, and more particularly, to a digital image processing apparatus that performs photographing on the front side.

As a typical digital image processing apparatus, for example, a digital camera of U.S. Patent No. 6,097,431 (entitled "Method and system for reviewing and navigating among images on an image capture unit") is exemplified.

Conventional digital image processing apparatuses as described above do not have convenient functions mediated by users.

An object of the present invention is to provide a digital image processing apparatus that can have convenient functions via a user.

In order to achieve the above object, the present invention provides a digital image processing apparatus for photographing the front side, and includes a user-face detection unit for monitoring whether a user's face appears at the rear side.

According to the digital image processing apparatus of the present invention, reference contour information of a user's face may be obtained and stored from the preview image data of the user-face detector according to a user's setting. Accordingly, the following convenient functions may be provided through the user.

First, in the photographing mode, the photographing of the front side may be performed only when the current contour information from the preview image data of the user-face detector is equal to the reference contour information.

Second, current contour information from the preview image data of the user-face detector is periodically compared with the reference contour information, so that focusing may be performed only when the current contour information is the same as the reference contour information.

Third, the current contour information from the preview image data of the user-face detection unit is periodically compared with the reference contour information, and if the current contour information is the same as the reference contour information, the display panel is turned on and the current contour information is If not equal to the reference contour information, the display panel may be turned off.

Fourth, the rear image from the user-face detector may be synthesized with the front image captured by the photographing in the photographing mode. For example, even if the user photographs from the rear of the digital camera, the user's face may be included in the captured image of the front.

Fifth, a function of the orientation sensor may be performed using user face information from the preview image data of the user-face detector.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

Timer lamp 11, flash 12, shutter release button 13, and ASR (Advanced Shake) 13 are provided on the front and the top of the digital camera 1 as a digital image processing apparatus according to the present invention, Reduction button 16, a power button 17, a lens unit 20, a microphone MIC, and a speaker SP.

The self-timer lamp 11 operates during the set time from when the shutter release button 13 is depressed to when it starts capturing an image in the self-timer mode. In addition, the self-timer lamp 11 generates auxiliary light according to the user's selection.

The ASR mode button 16 is used to compensate for camera shake. The ASR mode button 16 is also used as a lock button. For example, when the ASR mode button 16 is pressed for less than one second, the image stabilization function is performed. When the ASR mode button 16 is pressed for more than one second, the lock function in the playback mode is performed.

The shutter release button 13 has a two-stage structure. That is, when the user operates the wide angle-zoom button 39 _W and the tele-zoom button 39 _T and then presses the shutter release button 13 by one step, the SH1 signal from the shutter release button 13 is turned on ), And the SH2 signal from the shutter release button 13 is turned on when the second stage is pressed. In the still image shooting mode and the moving image shooting mode, an image is captured after the SH2 signal is turned on. In the continuous shooting mode, images are captured continuously while the SH1 signal is on.

Referring to FIG. 2, at the rear of the digital camera 1 according to the present invention, the auxiliary lens unit 49, the function buttons 15, the camera-state lamp 22, the special-effect button 23, the camera Strap 24, earphone connection 25, display panel 35, +/- button 36, zoom / 9 split / volume button 39, playback / printer button 42, and mode button 43 There is.

The auxiliary lens unit 49 is included in the auxiliary optical system (45 in FIG. 3) of the user-face detection unit (48 in FIG. 3), and is provided to monitor whether a user face appears behind. The user-face detection unit 48 will be described in detail with reference to FIGS. 3 to 10.

The function buttons 15 are used by the user to perform specific functions of the digital camera 1 and are used as direction-movement buttons of the active cursor in the menu screen of the display panel 35, And is used to switch between the file and the recording medium.

The camera-state lamp 22 is used to show various operating states of the camera. The special-effect button 23 is used to provide special effects to the image to be photographed.

In the case of this embodiment, the display panel 35 employs a touch screen method. The +/- button 36 is used to adjust the shutter speed for night view shooting and the like.

The zoom / 9split / volume button 39 is used to perform a zooming operation in shooting or playback mode, to display nine pictures in a single playback mode, or to adjust the volume of audio. Used for

The reproduction / printer button 42 is used for switching between the reproduction mode and the preview mode or for direct output to the printer.

The mode button 43 is used to select a PMP (Portable Media Player) mode or various shooting modes.

Fig. 3 shows the overall configuration of the digital camera 1 of Fig. Referring to Figs. 1 to 3, the overall configuration and operation of the digital camera 1 of Fig. 1 will be described as follows.

The main optical system OPS including the lens unit 20 and the filter unit (not shown) optically processes the light from the front subject. The lens unit 20 of the main optical system OPS includes a zoom lens, a focus lens, and a compensation lens. When the user presses the zoom / 9 division / volume button 39 included in the user input unit INP in the preview mode or the moving image shooting mode, a corresponding signal is input to the micro controller 512. Accordingly, as the microcontroller 512 controls the lens driver 510, the zoom motor M _Z is driven to move the zoom lens.

Meanwhile, in the automatic focusing mode, the main controller built in the digital camera processor 507 controls the driving unit 510 through the micro controller 512 to drive the focus motor M _F. Thus, the focus lens is moved. In this process, the number of drive steps of the focus motor M _F , for example, the position of the focus lens where the high frequency component of the image signal is the largest, is set. Reference symbol M _A denotes a motor for driving an aperture (not shown).

The main photoelectric conversion unit OEC of the charge coupled device (CCD) converts light from the main optical system OPS into an electrical analog image signal. Here, the digital camera processor 507 controls the timing circuit 502 to control the operations of the main photoelectric converter OEC and the main analog-to-digital converter 501. The main CDS-ADC (Correlation Double Sampler and Analog-to-Digital Converter) element 501 as the main analog-to-digital converter unit processes the analog video signal from the main photoelectric converter (OEC) to remove the high frequency noise. After adjusting the amplitude, it is converted into digital image data.

The real-time clock 503 provides time information to the digital camera processor 507. The digital camera processor 507 processes the digital image data from the CDS-ADC element 501 to generate digital image data classified into luminance and chroma signals.

The self-timer lamp 11 and the camera-status lamp 22, etc., are provided in the light emitting part LAMP driven by the microcontroller 512 according to control signals from the digital camera processor 507 incorporating the main controller. This includes.

The user input unit INP includes a shutter release button 13, function buttons 15, an ASR mode button 16, a power button 17, a special-effect button 23, a +/- button 36, A zoom / nine division / volume button 39, a playback / printer button 42, a mode button 43, and the like.

In the DRAM (Dynamic Random Access Memory) 504, digital image data from the digital camera processor 507 is temporarily stored. An algorithm necessary for the operation of the digital camera processor 507 is stored in an EEPROM (Electrically Erasable and Programmable Read Only Memory) 505. In the memory card interface (MCI) 506, the user's memory card is detached. In the flash memory (FM), setting data necessary for the operation of the digital camera processor 507 is stored. In the memory card interface 506, a plurality of memory cards are detached and removed as user's recording media.

Digital image data from the digital camera processor 507 is input to the LCD driver 514, whereby an image is displayed on the display panel 35.

In the interface unit 21, the digital image data from the digital camera processor 507 can be transmitted by serial communication via a universal serial bus (USB) connection 21a or an RS232C interface 508 and its connection 21b. It may be transmitted as a video signal through the video filter 509 and the video output unit 21c.

The audio processor 513 outputs the audio signal from the microphone MIC to the digital camera processor 507 or the speaker SP, and outputs the audio signal from the digital camera processor 507 to the speaker SP. .

On the other hand, the micro controller 512 controls the operation of the flash controller 511 in accordance with the signal from the flash-light amount sensor 19 to drive the flash 12. [

Finally, the user-face detector 48 monitors whether the user's face appears behind. The user-face detector 48 includes an auxiliary optical system 45, an auxiliary photoelectric converter 46 of a complementary metal-oxide-semiconductor (CMOS), and an auxiliary Correlation Double Sampler and an auxiliary analog-to-digital converter. Analog-to-Digital Converter) element 47 is included.

The auxiliary optical system 45 including the auxiliary lens unit 49 and the filter unit (not shown) optically processes the light from the rear side. The auxiliary photoelectric conversion unit 46 of the CMOS converts the light from the auxiliary optical system 45 into an electrical analog image signal. Here, the digital camera processor 507 controls the timing circuit 502 to control the operation of the auxiliary photoelectric converter 46 and the auxiliary CDS-ADC element 47. The auxiliary CDS-ADC element 47 processes the analog video signal from the auxiliary photoelectric conversion section 46, removes the high frequency noise, adjusts the amplitude, and converts the digital video data.

FIG. 4 shows a main algorithm of the digital camera processor 507 of FIG. A main algorithm of the digital camera processor 507 of FIG. 3 will be described with reference to FIGS. 1 to 4 as follows.

When operation power is applied to the digital camera 1, the digital camera processor 507 executes initialization (step S1). When this initialization step S1 is executed, the digital camera processor 507 performs a preview mode (step S2). In this preview mode, the input image is displayed on the display panel 35.

Next, when the SH1 signal as the first stage signal from the shutter release button 13 is in the On state (step S3), the digital camera processor 507 performs the shooting mode (step S4).

Next, when signals corresponding to the setting mode are input from the input signals from the user input unit INP (step S5), a setting mode for setting the operating conditions according to the input signals from the user input unit INP is performed (Step S6).

On the other hand, if no termination signal is generated (step S7), the digital camera processor 507 determines whether a conversion signal to another arbitrary mode has been generated (step S8).

If no conversion signal to another mode is generated in step S8, the digital camera processor 507 repeats step S2 and the following steps. If a conversion signal to another arbitrary mode is generated in step S8, the digital camera processor 507 repeats the step S2 and the subsequent steps after performing the corresponding mode (step S9).

5 illustrates an algorithm in which reference contour information of a user face is obtained and stored in the setting mode S5 of FIG. 4. The algorithm of FIG. 5 will be described with reference to FIGS. 3 and 5 as follows.

If the SH1 signal, which is the first-stage signal from the shutter release button (13 in Fig. 1), is turned on (step S51) by the user's operation, the digital camera processor 507 previews the user-face detection unit 48. (Preview) The reference contour information of the user's face is obtained from the image data (step S52). In other words, reference contour information of the user's face is obtained from the preview image data from the auxiliary CDS-ADC element 47. Here, the well-known contour recognition algorithm is used. In summary, whether to contour is determined according to the gray level difference between adjacent pixels.

Next, the digital camera processor 507 stores the obtained reference contour information of the user's face in the flash memory 62 (step S53).

Then, the digital camera processor 507 displays the message " save completed " on the color LCD panel (step S54).

Accordingly, reference contour information of the user's face may be obtained and stored from the preview image data of the user-face detector 48.

FIG. 6 shows an algorithm of the shooting mode S4 of FIG. 4 when the security shooting function is set. Referring to Figures 3 and 6, the algorithm of Figure 6 will be described.

First, the digital camera processor 507 obtains current contour information from the preview image data of the user-face detection unit 48 (step S601). That is, the current outline information is obtained from the preview image data from the auxiliary CDS-ADC element 47.

Next, the digital camera processor 507 temporarily stores the obtained current contour information in the DRAM 504 (step S603).

Next, the digital camera processor 507 determines whether the current contour information temporarily stored in the DRAM 504 is equal to the reference contour information (see FIG. 5) (step S605).

If the current outline information is not the same as the reference outline information in step S605, the digital camera processor 507 displays the message "The user cannot be photographed because it is different" on the color LCD panel (step S607).

If the current outline information is not the same as the reference outline information in step S605, the digital camera processor 507 continues the following steps.

The digital camera processor 507 determines whether the SH2 signal, which is the two-stage signal from the shutter release button 13 in FIG. 1, is on (step S609).

If the SH2 signal is not On in step S609, the digital camera processor 507 determines whether the SH1 signal, which is the first stage signal from the shutter release button 13, is in the On state (step S611). .

If the SH1 signal, which is the first-stage signal from the shutter release button 13, is in the on state in step S611, since the user intends to capture, the step S609 is performed again. If the SH1 signal, which is the first-stage signal from the shutter release button 13 in the step S611, is in the off state, the intention of photographing by the user has disappeared, so that the digital camera processor 507 terminates the execution of this algorithm.

If the SH2 signal is On in step S609, since the user has pressed the shutter release button 13 completely, the digital camera processor 507 continues the following steps.

The digital camera processor 507 generates an image file in the memory card (step S613).

Next, the digital camera processor 507 captures an image (step S615). More specifically, the digital camera processor 507 processes digital image data from the CDS-ADC element 501 to generate digital image data classified into luminance and chroma signals, and generates the generated digital image data in the DRAM 504. Save it temporarily).

Next, the digital camera processor 507 compresses the video data temporarily stored in the DRAM 504 (step S617).

Finally, the digital camera processor 507 stores the compressed image data in a new image file of the memory card (step S619).

According to the algorithm of FIG. 6 described above, in the shooting mode in which the security shooting function is set, the current contour information from the preview image data of the user-face detection unit 48 is forward only when the same as the reference contour information. Photographing is performed.

FIG. 7 illustrates an algorithm of a function of performing focusing according to a user face in the preview mode S2 of FIG. 4. Referring to Figures 3 and 7, the algorithm of Figure 7 will be described.

First, the digital camera processor 507 obtains current contour information from the preview image data of the user-face detection unit 48 (step S71). That is, the current outline information is obtained from the preview image data from the auxiliary CDS-ADC element 47.

Next, the digital camera processor 507 temporarily stores the obtained current contour information in the DRAM 504 (step S73).

Next, the digital camera processor 507 judges whether or not the current contour information temporarily stored in the DRAM 504 is the same as the reference contour information (see FIG. 5) (step S75).

If the current outline information is the same as the reference outline information in step S605, the digital camera processor 507 performs focusing (step S77).

Steps S71, S73, S75, and S77 are repeated periodically.

According to the algorithm of FIG. 7 as described above, current contour information from the preview image data of the user-face detection unit 48 is periodically compared with the reference contour information, and focusing only when the current contour information is the same as the reference contour information. This can be done. Accordingly, since focusing is performed only when necessary, a power saving effect can be obtained, and a focusing time can be drastically reduced when the shooting mode is performed.

FIG. 8 shows an algorithm of a function of controlling the color LCD panel 35 of FIG. 3 according to a user face in the preview mode S2 of FIG. 4. Referring to Figures 3 and 8, the algorithm of Figure 8 will be described.

First, the digital camera processor 507 obtains current contour information from the preview image data of the user-face detection unit 48 (step S81). That is, the current outline information is obtained from the preview image data from the auxiliary CDS-ADC element 47.

Next, the digital camera processor 507 temporarily stores the obtained current contour information in the DRAM 504 (step S83).

Next, the digital camera processor 507 determines whether or not the current contour information temporarily stored in the DRAM 504 is the same as the reference contour information (see FIG. 5) (step S85).

Next, in step S85, if the current outline information is equal to the reference outline information, the color LCD panel 35 is turned on (step S87).

If the current outline information is not the same as the reference outline information in step S85, the color LCD panel 35 is turned off (step S89).

Steps S81, S83, S85, S87, and S89 are repeatedly performed periodically.

According to the algorithm of FIG. 8 as described above, if the current contour information from the preview image data of the user-face detection unit 48 is periodically compared with the reference contour information, and if the current contour information is equal to the reference contour information, the color LCD panel If 35 is on and the current contour information is not equal to the reference contour information, the color LCD panel 35 is off. Accordingly, since focusing is performed only when necessary, power saving effects can be obtained and user convenience can be increased.

9 shows an algorithm of the shooting mode S4 of FIG. 4 when the synthetic shooting function is set. FIG. 10 shows an example of an image captured by the composite photographing of FIG. 9. Referring to Figures 3, 9, and 10, the algorithm of Figure 9 will be described.

The digital camera processor 507 determines whether the SH2 signal, which is the two-stage signal from the shutter release button 13 in FIG. 1, is on (step S91).

If the SH2 signal is not On in step S91, the digital camera processor 507 determines whether the SH1 signal, which is the first-stage signal from the shutter release button 13, is in the ON state (step S92). .

If the SH1 signal, which is the first-stage signal from the shutter release button 13, is in the on state in step S92, since the user intends to take a picture, step 91 is performed again. If the SH1 signal, which is the first-stage signal from the shutter release button 13 in the above step S92, is in the off state, the user's intention to shoot is lost, and therefore the digital camera processor 507 terminates the execution of the algorithm.

If the SH2 signal is On in step S91, since the user presses the shutter release button 13 completely, the digital camera processor 507 continues the following steps.

The digital camera processor 507 generates an image file in the memory card (step S93).

Next, the digital camera processor 507 captures the front image 10 (step S94). More specifically, the digital camera processor 507 processes digital image data from the main CDS-ADC element 501 to generate digital image data classified into luminance and chroma signals, and converts the generated digital image data into DRAM (DRAM). 504) temporarily.

Next, the digital camera processor 507 captures the rear image 10a (step S95). In more detail, the digital camera processor 507 processes the digital image data from the auxiliary CDS-ADC element 47 of the user-face detection unit 48 to generate digital image data classified into luminance and chroma signals, The generated digital image data is temporarily stored in the DRAM 504.

Next, the digital camera processor 507 synthesizes the front image 10 and the rear image 10a of the image data temporarily stored in the DRAM 504 (step S96, see FIG. 10).

Next, the digital camera processor 507 compresses the data of the synthesized image (step S97).

Finally, the digital camera processor 507 stores the compressed image data in a new image file of the memory card (step S98).

According to the algorithm of FIG. 9 as described above, the rear image from the user-face detector 48 is synthesized to the front image captured by the photographing in the photographing mode. For example, even if the user photographs from the rear of the digital camera, the user's face may be included in the captured image of the front.

As described above, according to the digital image processing apparatus according to the present invention, reference contour information of the user's face may be obtained and stored from the preview image data of the user-face detector according to the user's setting. Accordingly, the following convenient functions may be provided through the user.

First, in the photographing mode, forward photographing may be performed only when the current contour information from the preview image data of the user-face detector is equal to the reference contour information.

Second, current contour information from the preview image data of the user-face detector is periodically compared with the reference contour information, so that focusing may be performed only when the current contour information is the same as the reference contour information.

Third, the current contour information from the preview image data of the user-face detection unit is periodically compared with the reference contour information, and if the current contour information is the same as the reference contour information, the display panel is turned on, and the current contour information is If not equal to the reference contour information, the display panel may be turned off.

Fourth, the rear image from the user-face detector may be combined with the front image captured by the photographing in the photographing mode. For example, even if the user photographs from the rear of the digital camera, the user's face may be included in the captured image of the front.

The present invention is not limited to the above-described embodiments, but can be modified and improved by those skilled in the art within the spirit and scope of the invention defined in the claims. For example, a function of the orientation sensor may be performed using user face information from the preview image data of the user-face detector.

Claims (10)

In the digital image processing apparatus for photographing the front, A user-face detection unit for monitoring whether a user's face appears in the rear, And reference contour information of a user's face is obtained from the preview image data of the user-face detector according to a user's setting, and stored. The method of claim 1, The main optical system facing forward; A main photoelectric conversion unit converting light from the main optical system into an electrical analog image signal, and And a main analog-to-digital converter configured to convert the analog image signal from the main photoelectric converter into digital image data. The method of claim 2, wherein the user-face detection unit, The rear facing auxiliary optical system, An auxiliary photoelectric conversion unit converting light from the auxiliary optical system into an electrical analog image signal, and And an auxiliary analog-to-digital converter for converting an analog image signal from the auxiliary photoelectric converter into digital image data. The method of claim 3, The main photoelectric conversion unit is a photoelectric conversion unit of a charge coupled device (CCD), And the auxiliary photoelectric converter is a photoelectric converter of a complementary metal-oxide-semiconductor (CMOS). The method of claim 3, And digital image data from the primary analog-digital converter and the secondary analog-digital converter. delete The method of claim 1, And in the photographing mode, photographing the front side is performed only when the current contour information from the preview image data of the user-face detector is equal to the reference contour information. The method of claim 1, And current contour information from the preview image data of the user-face detector is periodically compared with the reference contour information so that focusing is performed only when the current contour information is equal to the reference contour information. The method of claim 1, The current contour information from the preview image data of the user-face detector is periodically compared with the reference contour information, and if the current contour information is the same as the reference contour information, the display panel is turned on and the current contour information is the reference. The display panel is turned off if not equal to the contour information. The method of claim 1, And a rear image from the user-face detector is synthesized with the front image captured by the photographing in the photographing mode.

Images