JP2012119912A - Imaging device, image processing device, imaging method, and image processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prevent disclosing of a taken image with photographer's face imaged on a reflecting object within the taken image, against photographer's intention.SOLUTION: An imaging device is provided with: photographer storage means 34 which stores face image information of the photographer; inversion means 36 which inverts an image horizontally; face detection means 38 which detects a face image from the taken image; face checking means 40 which checks at least one of a face image detected from the horizontally-inverted taken image and a face image detected from a taken image which is not inverted horizontally and is horizontally inverted by the inversion means 36 with the face image information stored in the photographer storage means 34 and detects that the photographer's face is imaged on the reflecting object within the taken image; and a CPU 60 which controls warning of the imaging of the photographer's face in the taken image when the imaging of the photographer's face is detected.

Description

  The present invention relates to a photographing apparatus, an image processing apparatus, a photographing method, and an image processing method that can prevent a photographer's face from being disclosed while being reflected on a reflector in a photographed image.

  Patent Document 1 includes a database of a specific person's face, and when a face of a person who is not registered in the database is detected in a captured image, an encryption process is performed to hide that person's face, A configuration for protecting human privacy is disclosed.

  In Patent Document 2, the appearance shape and characteristics of the camera itself are recorded in the camera, and the feature similarity determination and the camera detection are performed with an image obtained by horizontally inverting the recording data and a captured image captured by placing a mirror. A configuration is disclosed in which when the camera itself is detected, a portion of the camera itself is cut out and recorded.

JP 2004-62560 A JP 2010-14085 A

  When shooting with a camera, in a shooting scene in which a reflecting object such as a mirror exists as shown in FIG. 19, the photographer may be reflected in the reflecting object in the shot image. In particular, in a compact digital camera that does not have an optical viewfinder and looks at the LCD screen on the back as an electronic viewfinder from the face, the photographer's face appears when there is a mirror or other reflective object near the main subject within the field of view. Easy to capture.

  Therefore, even if the photographer wants to keep the face private, if the photographer is not aware of the reflection of the face, the photographed image will be disclosed as it is against the photographer's intention. It was. For example, if an image captured by a photographer is uploaded to a blog on the Internet or uploaded as an image for an electronic auction, personal identification (that is, personal information leakage) occurs.

  The invention described in Patent Document 1 is intended to protect the privacy of the subject, but is independent of whether or not the photographer is reflected in the reflecting object. Since the human face is generally asymmetrical, If the detected face does not match, privacy protection cannot be achieved.

  The invention described in Patent Document 2 can obtain an image of the camera casing, but does not achieve the privacy protection of the photographer.

  The present invention has been made in view of such circumstances, and an object of the present invention is to prevent a photographer's face from being disclosed while being reflected against a photographer's intention on a reflector in a photographed image. .

  To achieve the above object, the present invention provides a photographer storage means for storing face image information indicating a photographer's face image, a photographing means for photographing a subject, a reversing means for performing left-right reversal of an image, A face for detecting a face image from at least one of the photographed image obtained by the photographing means and horizontally reversed by the reversing means and the photographed image obtained by the photographing means and not horizontally reversed by the reversing means. A detection means, and at least one face image of a face image detected from the left-right inverted photographed image and a face image detected from the left-right inverted photographed image and left-right inverted by the inversion means; Collating means for collating the face image information stored in the photographer storage means and detecting that the photographer's face is reflected on the reflecting object in the photographed image; When a photograph of the photographer's face is detected, a warning notification indicating that the photographer is reflected in the photographed image, and an image process that makes it impossible to visually identify the face image in the photographed image And a control means for controlling at least one of the prohibition of the main photographing and the photographing which prevents the photographer's face image appearing in the photographed image from being visually recognized. To do.

  In other words, in a shooting scene where there is a reflection object such as a mirror, using the face image reversed left and right for verification, it is reliably detected that the photographer's face is reflected in the reflection object in the shooting image. Since control such as notification is performed, it is possible to prevent the photographer's face from being reflected on the reflecting object in the photographed image while being reflected against the photographer's intention.

  In one embodiment of the present invention, the face detection means includes a photographed image obtained by the photographing means and horizontally reversed by the reversing means, and a photograph obtained by the photographing means and not horizontally reversed by the reversing means. The face image is detected from both images.

  Further, the present invention provides a photographer face image acquisition means for acquiring a photographer's face image, a reversing means for horizontally reversing the photographer's face image acquired by the photographer face image acquisition means, and the left / right reversal. A photographer storage means for storing face image information indicating the photographed face image of the photographer, a photographing means for photographing a subject, a face detection means for detecting a face image from the photographed image obtained by the photographing means, The face image detected by the face detection means and the face image information stored in the photographer storage means are collated, and the photographer's face is reflected in the reflecting object in the photographed image. A collation means to detect, and when a photograph of the photographer's face is detected, a warning notification indicating that the photographer is reflected in the photographed image, and a visual inspection of the face image in the photographed image. Image processing that makes it impossible to distinguish There is provided a photographing apparatus comprising: a control means for controlling at least one of main photographing that prohibits shadows and makes it impossible to visually identify a photographer's face image reflected in a photographed image. .

  That is, in a shooting scene where there is a reflection object such as a mirror, the photographer's face is reflected in the reflection object in the photographed image by using the photographer's face image information reversed left and right for verification. Since the detection and the control such as warning notification are performed, it is possible to prevent the photographer's face from being reflected on the reflecting object in the photographed image while being reflected against the photographer's intention.

  In one embodiment of the present invention, an external appearance shape storage device for storing at least one of the external appearance shape of the photographing apparatus and the reversed external appearance shape of the photographing apparatus, and the photographing means is provided. The appearance shape stored in the device appearance shape storage means is selected from at least one of a photographed image reversed left and right by the reversing means and a photographed image obtained by the photographing means and not horizontally reversed by the reversing means. An apparatus detecting means for detecting, and the control means detects the appearance shape by the apparatus detecting means even when the collating means does not detect that the photographer's face image is reflected in the photographed image. Is detected, the control is performed when the reflection of the photographer's face is detected. In other words, even if it is determined that there is a mismatch in the collation by the photographer's face image, if the reflection of the photographing apparatus is detected, it is highly likely that the photographer's face is also reflected. Therefore, it is possible to reliably prevent the photographer's face from being exposed to the reflection object while being reflected against the photographer's intention. For example, even when a part of the photographer's face is hidden by the casing of the photographing apparatus, but other parts of the face are reflected on the reflecting object, control such as warning notification is reliably performed.

  In one embodiment of the present invention, the device detection means is a photographed image obtained by the photographing means and horizontally reversed by the reversing means, and a photographing obtained by the photographing means and not horizontally reversed by the reversing means. The appearance shape is detected from both images.

  In one embodiment of the present invention, a light emitting unit that is disposed on the front surface of the housing of the photographing apparatus and emits light with a specific light emission pattern, a light emission pattern detecting unit that detects a light emission pattern of the light emitting unit from the photographed image, The control means performs control when the photographer's face is reflected in the photographed image when the specific light emission pattern is detected by the light emission pattern detection means. . In other words, even if it is determined that there is a mismatch by collation with the photographer's face image, the photographer's face may also be reflected if a specific light emission pattern that emits light from the front surface of the housing of the photographing apparatus is detected. Therefore, it is possible to reliably prevent the photographer's face from being reflected on the reflecting object in the photographed image while being reflected against the photographer's intention. For example, even when a part of the photographer's face is hidden by the casing of the photographing apparatus, but other parts of the face are reflected on the reflecting object, control such as warning notification is reliably performed.

  In one embodiment of the present invention, a specific design displayed on the front surface of the housing of the photographing apparatus, a specific shape, a pattern or a color, a specific design combining these, and a design obtained by inverting the specific design Design detection means for detecting the design stored in the design storage means from at least one of a captured image obtained by the photographing means and a photographed image reversed left and right by the reversing means And when the design is detected by the design detection means even when the collation means does not detect that the photographer's face image is reflected in the photographed image. Is characterized by performing control when the photographer's face is reflected in the photographed image. In other words, even if it is determined that there is a mismatch in the collation by the photographer's face image, if the reflection of the photographing apparatus is detected, it is highly likely that the photographer's face is also reflected. Therefore, it is possible to reliably prevent the photographer's face from being exposed to the reflection object while being reflected against the photographer's intention.

  In one embodiment of the present invention, a photographing device for photographing a photographer's face image is provided on the rear surface of the housing of the photographing apparatus. That is, by taking a photograph of the photographer's face from the back of the casing, it is possible to avoid the trouble of the photographer.

  In one embodiment of the present invention, a personal authentication information input device for inputting photographer's authentication information and a database of the person's face image information are accessed to correspond to the photographer's authentication information. A database interface for acquiring face image information is provided. That is, since the photographer's face image is specified by personal authentication, the credibility of the photographer's face image recognition is increased.

  In one embodiment of the present invention, the collating means performs collation by luminance instead of collation by color when performing image collation. That is, even when the influence of the object color of the reflecting object is large, the reflection on the reflecting object in the captured image can be reliably detected. For example, even when a face is reflected in a red car, the reflection can be detected.

  According to the present invention, it is possible to prevent the photographer's face from being disclosed while being reflected against the photographer's intention on the reflecting object in the photographed image.

1 is a block diagram illustrating an example of a photographing apparatus according to a first embodiment. 6 is a flowchart illustrating an example of an imaging process in the imaging apparatus according to the first embodiment. Explanatory drawing showing an example of warning display Flowchart showing a first example of photographer recognition processing Flowchart showing a second example of photographer recognition processing The block diagram which shows an example of the imaging device in 2nd Embodiment. The flowchart which shows the example of an imaging | photography process in the imaging device of 2nd Embodiment. The block diagram which shows an example of the imaging device in 3rd Embodiment. The block diagram which shows an example of the imaging device in 4th Embodiment A block diagram showing an example of an imaging device in a 5th embodiment Flowchart showing an example of photographing process in the photographing apparatus of the fifth embodiment A block diagram showing an example of an imaging device in a 6th embodiment The flowchart which shows the example of an imaging | photography process in the imaging device of 6th Embodiment. A block diagram showing an example of an imaging device in a 7th embodiment Flowchart illustrating an example of photographing processing in the photographing apparatus of the seventh embodiment A block diagram showing an example of an imaging device in an 8th embodiment Flowchart showing an example of photographer recognition processing in the eighth embodiment Flowchart illustrating an example of photographing processing in the photographing apparatus of the eighth embodiment Explanatory drawing showing the shooting scene and the state of the photographer where there is a reflector

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

<First Embodiment>
FIG. 1 is a block diagram illustrating a camera 10 as an example of a photographing apparatus according to the first embodiment.

  In FIG. 1, the camera 10 of this example includes a photographing lens 12, an image sensor 14, a timing generator (hereinafter referred to as “TG”) 16, an A / D conversion circuit 18, a dot sequential frame sequential conversion circuit 20, and an RGB / YC conversion circuit. 22, an image buffer 24, a compression circuit 26, an LCD 30, and a CPU 60.

  The photographing lens 12 includes a zoom lens, a focus lens, an iris (aperture), and the like. The zoom lens and the focus lens are provided so as to be movable along the optical axis of the photographing lens 12. When the zoom lens is moved, the photographing magnification changes. Further, focusing is performed by moving the focus lens. Further, the amount of light received by the image sensor 14 is adjusted by changing the aperture amount (aperture amount) of the iris.

  The image sensor 14 is composed of a CMOS image sensor, a CCD image sensor, or the like. The image sensor 14 photoelectrically converts subject light imaged by the photographing lens 12 on a light receiving surface on which photoelectric conversion elements (imaging pixels) are arranged, and outputs an analog image signal (captured image). The image sensor 14 has a so-called electronic shutter function, and when a shutter pulse signal is input from the TG 16, the charge accumulated so far is swept out and erased. That is, the charge accumulation time (shutter speed) in the image sensor 14 is adjusted by the TG 16. The exposure amount in the image sensor 14 is determined by the shutter speed of the electronic shutter and the iris diaphragm amount.

  The analog image signal output from the image sensor 14 is converted into a digital image signal by the A / D conversion circuit 18, converted from dot sequential to frame sequential by the dot sequential frame sequential conversion circuit 20, and RGB / YC conversion circuit. The R (red) signal, G (green) signal, and B (blue) signal are converted into Y (luminance) signals and C (color) signals by 22 and output to the image buffer 24.

  The image pickup means 11 for taking an image of the subject is configured including the taking lens 12, the image pickup device 14, the TG 16, the A / D conversion circuit 18, the dot sequential frame sequential conversion circuit 20, the RGB / YC conversion circuit 22, and the image buffer 24. The

  The captured image temporarily stored in the image buffer 24 is data-compressed by the compression circuit 26 and recorded on the recording medium 28.

  A CPU (Central Processing Unit) 60 controls each unit of the camera 10 by executing a predetermined program.

  The camera 10 according to the present embodiment includes a photographer recognition unit 32 that recognizes a photographer and acquires photographer information including a photographer's face image, and a photographer that stores photographer information including the photographer's face image information. A storage means 34; a left / right reversing means 36 for horizontally reversing the image; a face detecting means 38 for detecting a face image from a captured image obtained by the imaging means 11 and horizontally reversed by the left / right reversing means 36; 38, the photographer's face image information stored in the photographer storage means 34 is collated with the face image detected by the photographer 38, and it is detected that the photographer's face is reflected in the reflecting object in the photographed image. Face collation means 40 is provided.

  The photographer storage unit 34 is configured by a nonvolatile storage device such as an EEPROM. The face detection means 38 and the face collation means 40 are constituted by, for example, a microcomputer or a circuit device.

  The photographer recognizing means 32 is provided, for example, on the rear surface of the housing of the camera 10 and includes a sub camera (small photographing device) for photographing a photographer's face image and a control device such as a microcomputer. The For example, the control device shoots a subject with the imaging unit 11 and shoots a photographer with a sub camera when a later-described release button (shutter switch) is pressed. Thereby, a photographer's face image can be acquired reliably.

  The photographer recognizing means 32 accesses the personal authentication information input device for inputting the photographer's authentication information and the database storing the person's face image information, and the photographer's authentication information 32 is inputted to the photographer's authentication information. You may comprise including the database interface which acquires face image information. For example, a contact-type personal authentication input device that inputs personal authentication information using a fingerprint, a vein, or the like is provided on a portion of the camera 10 housing such as a grip that is held by a photographer. A fingerprint detection device may be provided in a later-described release button (shutter switch). When a release button is provided with a fingerprint detection device, it is preferable in that a photographer who inputs a shooting instruction can be reliably detected.

  The operation unit 70 is an instruction input device for the user to input various instructions to the camera 10. In this example, a zoom button and a release button (shutter switch) are included. The release button is a two-stage type, and accepts a shooting preparation instruction when the first switch (S1) is turned on and accepts a shooting instruction when the second switch (S2) is turned on.

  The LCD (Liquid Crystal Display Device) 30 is used as an electronic viewfinder for live view display that displays in real time a live view image (through image) imaged continuously in time by the imaging means 11. A display device other than the LCD may be used.

  FIG. 2 is a flowchart illustrating an example of shooting processing in the camera 10 of the first embodiment. This process is executed according to a program under the control of the CPU 60.

  For example, when the release button of the operation unit 70 is pressed, this process is started.

  First, photographer recognition is performed by the photographer recognition means 32 to acquire face image information indicating the photographer's face image (step S2). The face image information may be the face image itself, but the feature amount of the face (such as the relative positional relationship and shape of the eyes, nose, and mouth) may be detected from the face image, and the feature amount of the face may be used as the face image information.

  Next, the acquired photographer's face image information is stored in the photographer storage means 34 (step S4).

  Next, the subject is photographed by the imaging means 11 (step S6).

  Next, a captured image is acquired from the image buffer 24 (step S8).

  Next, the captured image is horizontally reversed by the left / right reversing means 36 (step S10).

  Next, the face detection means 38 detects a face image from the captured image that has been reversed left and right (step S12).

  It is determined whether or not a face image has been detected (step S14). If a face image is detected, the face image detected from the photographed image is taken as the photographer's face stored in the photographer storage means 34. It collates with image information (step S16).

  It is determined whether or not the faces match based on the collation result (step S18). If it is determined that the faces match, it is determined that the photographer's face is reflected on the reflecting object in the captured image (step S20). Then, a warning display indicating that the photographer is reflected in the photographed image is performed (step S22). An example of the warning display is shown in FIG. As shown in FIG. 3, a frame may be displayed so that not only the warning but also the position of the detected face can be understood.

  The warning notification is not limited to display, and may be performed by sound output or the like.

  Further, when the photographer's reflection is detected, the CPU 60 may perform display control for conspicuously displaying the photographer's face image reflected in the photographed image together with a warning. That is, it is easy for the photographer to understand where the face is reflected.

  Further, in this example, a case has been described in which a warning notification indicating that a photographer is reflected on a reflecting object in a captured image is given, but the present invention is not limited thereto.

  Further, for example, when the photographer's reflection is detected, the CPU 60 may perform image processing that makes it impossible to visually discriminate the face image in the photographed image. For example, image processing that lowers (darkens) the brightness of the face image, image processing that changes the color reproduction that reduces the color of the face image, and image processing that blurs the face image.

  For example, if the CPU 60 detects the photographer's reflection by half-pressing the shutter switch (inputting a shooting preparation instruction) and determines that the photographer is shooting, the shutter switch is fully pressed (inputting the shooting instruction). Even if it is done, control which prohibits this photography may be performed. In other words, the photographed image is not recorded on the recording medium 28 even if the shutter switch S2 on is detected.

  Further, for example, the CPU 60 may perform shooting control so that the photographer's face image that appears in the shot image cannot be visually discriminated during the main shooting. For example, when a photographer's reflection is detected, shooting at the time of actual shooting is performed by shooting control such as automatic exposure control (AE), automatic focusing control (AF), automatic white balance adjustment (AWB), and flash light control. The photographer's face image that appears in the image cannot be visually identified. If a photographer's reflection is detected when a live view image (through image) is displayed, do not perform AE, AF, AWB, or flash dimming using face detection (ignore the photographer's face). Also good. The portion of the reflecting object in the photographed image may be blurred by flash forced light emission and flash light emission amount increase. Further, in the configuration in which the photographing lens 12 is provided with a polarizing filter (not shown in FIG. 1), the CPU 60 rotates the polarizing filter (up to 180 at the time of actual photographing) when the photographer's reflection is detected. Control) so that the photographer is not reflected. The polarizing filter may be rotated 180 degrees to set the angle at which the reflection is minimal.

  FIG. 4 is a flowchart showing a first detailed example of step S2 of FIG. In this example, a photographer is photographed with a sub camera (not shown in FIG. 1) on the rear surface of the housing (step S202), and a face image is detected from the photographed image of the sub camera by the face detection means 38 (step S204). Then, recognition processing of the photographer's face image is performed (step S206). In this example, in the face image recognition process, the feature amount of the photographer's face parts (eyes, nose, mouth, etc.) is calculated, and the feature amount is stored in the photographer storage means 34 as face image information ( Step S4 in FIG. That is, the feature amount indicating the face image is stored instead of storing the face image itself.

  FIG. 5 is a flowchart showing a second detailed example of step S2 of FIG. In this example, the fingerprint sensor installed on the housing grip (camera grip) accepts input of the photographer's authentication information (step S212), and the face image information corresponding to the authentication information is stored in the database interface (shown in FIG. 1). Is omitted from the predetermined database (step S214). The acquired photographer's face image information is stored in the photographer storage means 34 (step S4 in FIG. 2).

  2 to 4 show only an example of the photographing process, and do not exclude a process different from these.

  For example, face image information photographed from a plurality of angles is stored in the photographer storage unit 34, and the face collation unit 40 selects face image information corresponding to the photographing angle of view from the photographer storage unit 34. You may make it acquire and perform collation.

  Whether the specific person stored in the photographer storage means 34 is actually on the subject side or holding the camera, without a sub-camera on the back of the housing or a photographer's contact type personal authentication device In the case of a camera configuration that cannot be discriminated, it is assumed that the specific object is holding the camera 10 except during the self-timer shooting, and there is a possibility that the specific person is on the subject side only during the self-timer shooting. It may be considered. In this case, when the self-timer shooting or the self-timer shooting for a specific time (for example, 10 seconds) or more is set by the operation unit 70, it is assumed that the specific person is on the subject side, and the face matching unit 40 performs face matching. It may not be performed.

  Further, a reversing unit that performs both left-right reversal and vertical reversal may be provided, and the face collating unit 40 may perform collation using both the left-right reversed image and the vertically reversed image.

Second Embodiment
Next, a second embodiment will be described.

  FIG. 6 is a block diagram illustrating an example of a camera according to the second embodiment. In addition, the same code | symbol was attached | subjected to what was shown in FIG. Below, a different point from 1st Embodiment is demonstrated and the description is abbreviate | omitted about the content demonstrated in 1st Embodiment.

  In FIG. 6, the camera 10 according to the present embodiment detects a housing image of the camera 10 from a camera appearance shape storage unit 42 that stores the appearance shape of the camera 10 and a captured image that is horizontally reversed by the left / right reversing unit 36. Camera housing detection means 44 and camera collation means 46 for collating the housing image detected by camera housing detection means 44 with the external shape of camera 10 stored in camera external shape storage means 42 are provided. . In the present embodiment, even when the face matching unit 40 does not detect that the photographer's face image is reflected in the photographed image, the CPU 60 detects the appearance shape by the device detection unit. The control is performed when the reflection of the photographer's face is detected.

  The camera external shape storage means 42 is configured by a nonvolatile storage device such as an EEPROM. The camera housing detection unit 44 and the camera collation unit 46 are constituted by, for example, a microcomputer or a circuit device.

  FIG. 7 is a flowchart illustrating an example of shooting processing in the camera 10 of the second embodiment. This process is executed according to a program under the control of the CPU 60.

  Steps S2 and S4 are the same as in the first embodiment.

  In this embodiment, the camera external shape storage means 42 stores in advance the external shape information of the camera itself (step S5).

  Steps S6 to S22 are the same as in the first embodiment.

  If it is determined from the collation result of the face collating means 40 that the faces do not match, the camera housing detecting means 44 detects a camera housing image (appearance shape) from the captured image that is horizontally reversed (step S30). . It is determined whether or not a camera housing image has been detected (step S32). If a camera housing image is detected, the camera housing image detected from the captured image is stored in the camera external shape storage means 42. It collates with the made appearance shape (step S34). It is determined whether or not the appearance shapes match based on the collation result (step S36). If it is determined that they match, the photographing apparatus 10 is reflected in the photographed image, so that the photographer's face is also photographed. (Step S20), and a warning display indicating that the photographer is reflected in the captured image is performed (step S22).

  Although the case where the case image of the camera 10 is detected from the captured image that has been horizontally reversed by the left-right reversing unit 36 has been described as an example, the captured image is acquired from the image buffer 24 and the captured image that is not horizontally reversed. Therefore, a case image that is reversed left and right by a reflector may be detected. In this case, the camera appearance shape storage means 42 stores an appearance shape that is reversed left and right in advance.

<Third Embodiment>
Next, a third embodiment will be described.

  FIG. 8 is a block diagram illustrating an example of a camera according to the third embodiment. In addition, the same code | symbol was attached | subjected to what was shown in FIG. 6 (2nd Embodiment). Below, a different point from 2nd Embodiment is demonstrated, and the description is abbreviate | omitted about the content demonstrated in 2nd Embodiment.

  In the present embodiment, the face detection unit 38 and the camera housing detection unit 44 also perform detection from a captured image that is not horizontally reversed.

  Next, steps different from those of the second embodiment will be described with reference to the flowchart of FIG.

  In step S12, the face detection unit 38 detects a face image from the captured image that is horizontally reversed, and also detects a face image from a captured image that is not horizontally reversed. In step S14, even if a face image is not detected from the captured image that is horizontally reversed, if a face image is detected from the captured image that is not horizontally reversed, the process proceeds to step S16.

  In step S30, the camera housing detection unit 44 detects the housing image from the captured image that is horizontally reversed, and also detects the housing image from the captured image that is not horizontally reversed. In step S32, even if the case image is not detected from the left-right reversed captured image, if the case image is detected from the left-right reversed captured image, the process proceeds to step S34.

  According to the present embodiment, if it is clear from a personal authentication device such as a sub-camera or a fingerprint sensor on the back of the housing that the photographer is holding the camera 10, the photographer is reflected twice. It is possible to detect accurately even if it is included.

  When it is not possible to determine whether the photographer is on the subject side (for example, when the sub camera and the personal authentication device are not mounted on the camera 10), the collation result using the horizontally reversed captured image and the left and right Whether the photographer is reflected in the reflected object in the photographed image by comparing the result of the comparison using the photographed image that is not reversed, for example, whether the photographer is properly photographed by self-timer photography. May be determined. That is, the CPU 60 sets the difference between the face image detected from the left-right reversed captured image and the face image stored in the photographer storage unit 34 in advance without being left-right reversed as Δr, and the left-right reversed photographing. When the difference between the face image detected from the image and the face image stored in advance in the photographer storage means 34 without being reversed left and right is Δn, if Δr> Δn, the reflection in the photographed image If Δr <Δn, it is determined that the photographer himself was actually reflected. In this case, it is effective to improve the detection accuracy by distinguishing the face image without reflection and the face image reflected once, on the assumption that the reflection twice is rare.

<Fourth embodiment>
Next, a fourth embodiment will be described.

  FIG. 9 is a block diagram illustrating an example of a camera according to the fourth embodiment. In addition, the same code | symbol was attached | subjected to what was shown in FIG. 6 (2nd Embodiment). Below, a different point from 2nd Embodiment is demonstrated, and the description is abbreviate | omitted about the content demonstrated in 2nd Embodiment.

  In the present embodiment, the face collating unit 40 and the camera collating unit 46 collate with luminance instead of collating with color when performing image collation. As shown in FIG. 9, the left / right reversing means 36 of this example performs only left / right reversal by inputting only the luminance signal among the Y (luminance) signal and the CrCb (color) signal constituting the captured image. That is, the face detection unit 38 detects a face image from a photographed image consisting only of a luminance signal, and the face collation unit 40 performs collation based only on the luminance. Further, the camera housing detection unit 44 detects the housing image from the photographed image consisting only of the luminance signal, and the camera collation unit 46 performs collation based only on the luminance.

  The collation based on the captured image that is not horizontally reversed may have a lower priority than the collation based on the captured image that is horizontally reversed. For example, the photographer storage means 34 stores the photographer's face image information that is horizontally reversed and the photographer's face image that is not horizontally reversed. The face collating means 40 collates the face image detected from the left-right reversed photographed image with the photographer's face image that has been horizontally reversed in advance in the photographer storage means 34, and from the photographed image that has not been horizontally reversed. The detected face image is collated with the photographer's face image that has not been horizontally reversed in the photographer storage means 34.

  For example, when a match is detected by collation of the face image detected from the left-right reversed photographed image, the CPU 60 forcibly prohibits the main photographing and detects the face image detected from the photographed image not horizontally reversed. If a match is detected in the collation, only a warning is displayed and the actual photographing is permitted. This is because in the latter case, it is not easy to determine whether the reflection is twice or whether the photographer himself is properly photographed by a self-timer or the like.

<Fifth Embodiment>
Next, a fifth embodiment will be described.

  FIG. 10 is a block diagram illustrating an example of a camera according to the fifth embodiment. In addition, the same code | symbol was attached | subjected to what was shown in FIG. 6 (2nd Embodiment). Below, a different point from 2nd Embodiment is demonstrated and the description is abbreviate | omitted about the content demonstrated in 1st Embodiment and 2nd Embodiment.

  In FIG. 10, the camera 10 of the present embodiment is disposed on the front surface of the casing of the photographing apparatus and emits light with a specific light emission pattern and stores a specific light emission pattern emitted from the light emission means 50. A pattern storage means 52 and a light emission pattern detection means 54 for detecting the light emission pattern of the light emission means 50 from the captured image obtained by the imaging means 11 are provided. In this embodiment, even if the CPU 60 does not determine that the photographer's face is reflected in the photographed image by the face collating unit 40, the light emitting pattern detecting unit 54 detects a specific light emitting pattern from the photographed image. When it is detected, it is determined that the photographer's face is reflected in the photographed image.

  The light emitting means 50 includes, for example, an LED (light emitting diode), a sub-LCD (sub-liquid crystal display device), and the like. The light emission pattern storage means 52 is comprised by non-volatile storage devices, such as EEPROM, for example. The light emission pattern detecting means 54 is constituted by, for example, a microcomputer or a circuit device.

  FIG. 11 is a flowchart illustrating an example of a photographing process in the camera 10 according to the fifth embodiment. This process is executed according to a program under the control of the CPU 60.

  Steps S2 to S22 and steps S30 to 36 are the same as in the second embodiment.

  If it is determined that the faces do not match (No in step S18), and it is determined that the faces do not match the external shape information (No in step S36), the light emitting unit 50 uses the light emission pattern stored in the light emission pattern storage unit 52. Light is emitted from the front surface of the housing (step S40), and photographing is performed by the imaging means 11 (step S42). A photographed image is acquired from the image buffer 24 (step S44), and a specific light emission pattern is detected from the photographed image by the light emission pattern detecting means 54 (step S46). It is determined whether or not the light emission pattern detected by the light emission pattern detection means 54 matches the light emission pattern stored in the light emission pattern storage means 52 (step S48). Is detected), the process proceeds to step S20. As described above, in this embodiment, the face collating unit 40 does not determine that the photographer's face is reflected in the photographed image, and the camera collating unit 46 reflects the camera 10 in the photographed image. Even if it is not determined, if the specific light emission pattern is detected from the photographed image by the light emission pattern detecting means 54, the control when the reflection of the photographer's face is detected in the photographed image is performed. Details of the control are as described in the first embodiment.

<Sixth Embodiment>
Next, a sixth embodiment will be described. In the present embodiment, the design displayed on the front surface of the housing of the camera 10 is detected from the captured image.

  FIG. 12 is a block diagram illustrating an example of a camera according to the sixth embodiment. In addition, the same code | symbol was attached | subjected to what was shown in FIG. 6 (2nd Embodiment). Below, a different point from 2nd Embodiment is demonstrated and the description is abbreviate | omitted about the content demonstrated in 1st Embodiment and 2nd Embodiment.

  In FIG. 12, the camera 10 according to the present embodiment includes a design storage unit 56 that stores a specific design displayed on the front surface of the housing of the camera 10, and a design storage unit that is obtained from the photographed image that is reversed by the left / right reversing unit 36. Design detecting means 58 for detecting a specific design stored in 56. The design storage means 56 is configured by a nonvolatile storage device such as an EEPROM. The design detection means 58 is constituted by a microcomputer or a circuit device, for example.

  The specific design is a specific shape, pattern or color or a combination thereof. For example, the logo of the camera 10, the logo of the manufacturer of the camera 10, etc. are mentioned.

  In this embodiment, even if the CPU 60 does not determine that the photographer's face is reflected in the photographed image by the face collating means 40, the design detection means 58 detects a specific design from the photographed image. If it is determined that the photographer's face is reflected in the photographed image.

  FIG. 13 is a flowchart illustrating an example of shooting processing in the camera 10 of the sixth embodiment. This process is executed according to a program under the control of the CPU 60.

  Steps S2 to S22 and steps S30 to 36 are the same as in the second embodiment.

  When it is determined that the faces do not match (No in step S18), and the appearance shapes are determined not to match (No in step S36), the design detection unit 58 uses the design storage unit from the left-right inverted image. The specific design stored in 56 is detected (step S50). It is determined whether or not the design detected by the design detection means 58 matches the design stored in the design storage means 56 (step S52). If they match (that is, a specific design is detected from the photographed image). ), Go to step S20. As described above, in this embodiment, the face collating unit 40 does not determine that the photographer's face is reflected in the photographed image, and the camera collating unit 46 reflects the camera 10 in the photographed image. Even if it is not determined, if the design detector 58 detects a specific design from the captured image, it is determined that the photographer's face is reflected in the captured image.

  As described above, in this embodiment, the face collating unit 40 does not determine that the photographer's face is reflected in the photographed image, and the camera collating unit 46 reflects the camera 10 in the photographed image. Even if it is not determined, if a specific design is detected from the photographed image by the design detection means 58, control is performed when the photographer's face is reflected in the photographed image. Details of the control are as described in the first embodiment.

  Although the case where the design is detected from the captured image reversed left and right by the left-right reversing unit 36 has been described as an example, the captured image is acquired from the image buffer 24 and the reflected image is captured from the captured image that is not reversed horizontally. You may detect the design reversed horizontally. In this case, the design storage means 56 stores in advance a left-right inverted design.

<Seventh embodiment>
Next, a seventh embodiment will be described. In this embodiment, after detecting a face image from a photographed image, the face image is horizontally reversed.

  FIG. 14 is a block diagram illustrating an example of a camera according to the seventh embodiment. In addition, the same code | symbol was attached | subjected to what was shown in FIG. 1 (1st Embodiment). Below, a different point from 1st Embodiment is demonstrated and the description is abbreviate | omitted about the content demonstrated in 1st Embodiment.

  In FIG. 14, the face detection unit 38 detects a face image from a captured image obtained by the imaging unit 11 and not horizontally reversed by the left-right reversing unit 36. The left / right reversing means 36 horizontally reverses the face image detected from the photographed image by the face detecting means 38. The face collating means 40 collates the face image detected from the photographed image not horizontally reversed and reversed left and right by the right and left reversing means 36 with the face image information stored in the photographer storage means 34 to obtain the photographed image. It is detected that the photographer's face is reflected in the reflecting object.

  FIG. 15 is a flowchart illustrating an example of a photographing process in the camera 10 of the seventh embodiment. This process is executed according to a program under the control of the CPU 60.

  Steps S2 to S8 and steps S14 to S22 are the same as in the first embodiment.

  In the present embodiment, in step S70, the face detection unit 38 acquires a photographed image from the image buffer 24 and detects the face image. Next, in step S72, the left and right inversion unit 36 converts the face image to the left and right. Invert.

<Eighth Embodiment>
Next, an eighth embodiment will be described. In the present embodiment, the photographer's face image is stored in reverse horizontally.

  FIG. 16 is a block diagram illustrating an example of the camera 10 according to the eighth embodiment. In addition, the same code | symbol was attached | subjected to what was shown in FIG. 12 (6th Embodiment). In the following, items different from the sixth embodiment will be described, and description of already described items will be omitted.

  In the camera 10 of the present embodiment shown in FIG. 16, the photographer recognition means 32 acquires the photographer's face image and performs face image recognition processing. The left / right reversing means 36 of the present embodiment flips the photographer's face image acquired by the photographer recognition means 32 horizontally. The photographer storage means 34 stores the face image that has been horizontally reversed by the left-right reversing means 36.

  The face collating means 40 collates the face image directly detected from the photographed image by the face detecting means 38 with the left-right inverted face image stored in the photographer storage means 34, and reflects in the photographed image. Detect that the photographer's face is reflected in the object.

  FIG. 17 is a flowchart illustrating an example of a photographer recognition process in the camera 10 according to the eighth embodiment. This process is executed according to a program under the control of the CPU 60.

  Steps S202 to S204 are the same as the steps in the first embodiment shown in FIG.

  In step S205, the left / right reversing means 36 right / left reverses the photographer's face image obtained by photographing the photographer with the sub camera on the back of the housing.

  In step S206, the photographer recognizing means 32 calculates the feature amount of the parts (eyes, nose, mouth, etc.) of the photographer's face, and stores the feature amount in the photographer storage means 34 as face image information. That is, the feature amount of the face image that has been horizontally reversed is stored in advance.

  FIG. 18 is a flowchart illustrating an example of a photographing process in the camera 10 according to the eighth embodiment. This process is executed according to a program under the control of the CPU 60.

  Steps S2 to S8, steps S14 to S22, and S30 to S52 are the same as in the sixth embodiment. In the present embodiment, in step S12, the face detection unit 38 acquires a captured image that has not been left / right determined from the image buffer 24, and detects a face image. Therefore, in step S16, the face image detected from the photographed image that has not been horizontally reversed and the photographer's face image information that has been previously horizontally reversed stored in the photographer storage unit 34 are collated.

  As described above, the first embodiment to the eighth embodiment have been described separately for the convenience of explanation, but it goes without saying that these embodiments may be implemented singly or in possible combinations.

  The application of the present invention is not particularly limited to a digital camera or a video camera, and can be applied to other devices such as a mobile phone, a portable player, and a small personal computer. That is, the present invention can be applied to various electronic devices (imaging devices) provided with photographing means and various electronic devices (image processing devices) having an image processing function.

  The present invention is not limited to the examples described in the present specification and the examples illustrated in the drawings, and various design changes and improvements may be made without departing from the spirit of the present invention.

  DESCRIPTION OF SYMBOLS 10 ... Imaging device, 11 ... Imaging means, 14 ... Imaging device, 24 ... Image buffer, 28 ... Recording medium, 30 ... LCD (display means), 32 ... Photographer recognition means, 34 ... Photographer storage means, 36 ... Left and right Inversion means, 38 ... face detection means, 40 ... face collation means, 42 ... camera appearance shape storage means, 44 ... camera housing detection means, 46 ... camera collation means, 50 ... light emission means, 52 ... light emission pattern storage means, 54 ... light emission pattern detection means, 56 ... design storage means, 58 ... design detection means, 60 ... CPU, 70 ... operation unit,

Claims (28)

Photographer storage means for storing face image information indicating a photographer's face image;
Photographing means for photographing the subject;
Reversing means for reversing the image horizontally;
A face image is detected from at least one of the photographed image obtained by the photographing means and horizontally reversed by the reversing means and the photographed image obtained by the photographing means and not horizontally reversed by the reversing means. Face detection means;
At least one of the face image detected from the left-right reversed photographed image and the face image detected from the non-left-right reversed photographed image and left-right reversed by the reversing means, and the photographer storage means Collating means for collating with the face image information stored in the photographed image, and detecting that the photographer's face is reflected in the reflecting object in the photographed image;
When a photograph of the photographer's face is detected, a warning notification indicating that the photographer is reflected in the photographed image, and an image process that makes it impossible to visually identify the face image in the photographed image Control means for controlling at least one of the prohibition of the main shooting and the shooting that makes it impossible to visually identify the photographer's face image reflected in the shot image;
An imaging apparatus comprising:   The face detection means is configured to detect the face image from both a photographed image obtained by the photographing means and horizontally reversed by the reversing means and a photographed image obtained by the photographing means and not horizontally reversed by the reversing means. The imaging apparatus according to claim 1, wherein detection is performed. Photographer face image acquisition means for acquiring a photographer's face image;
Reversing means for horizontally reversing the photographer's face image acquired by the photographer face image acquiring means;
Photographer storage means for storing face image information indicating the photographer's face image that has been horizontally reversed;
Photographing means for photographing the subject;
Face detecting means for detecting a face image from a photographed image obtained by the photographing means;
The face image detected by the face detection means and the face image information stored in the photographer storage means are collated, and the photographer's face is reflected in the reflecting object in the photographed image. Matching means to detect;
When a photograph of the photographer's face is detected, a warning notification indicating that the photographer is reflected in the photographed image, and an image process that makes the face image in the photographed image indistinguishable visually Control means for controlling at least one of the prohibition of the main photographing and the main photographing which makes it impossible to visually identify the photographer's face image reflected in the photographed image;
An imaging apparatus comprising: A device external shape storage means for storing at least one of the external shape of the photographing device and the external shape of the photographing device reversed left and right;
At least one of a photographed image obtained by the photographing means and reversed left and right by the reversing means and a photographed image obtained by the photographing means and not horizontally reversed by the reversing means is stored in the device appearance shape storage means. A device detecting means for detecting the external shape being formed,
The control means does not detect that the photographer's face image is reflected in the photographed image by the collating means, but if the appearance detection is detected by the apparatus detection means, the photographing means 4. The photographing apparatus according to claim 1, wherein control is performed when reflection of a person's face is detected. 5.   The apparatus detection means is configured to obtain the appearance shape from both a photographed image obtained by the photographing means and horizontally reversed by the reversing means and a photographed image obtained by the photographing means and not horizontally reversed by the reversing means. The imaging apparatus according to claim 4, wherein detection is performed. A light emitting means disposed on the front surface of the housing of the photographing apparatus and emitting light in a specific light emission pattern;
A light emission pattern detection means for detecting a light emission pattern of the light emission means from the photographed image,
2. The control unit according to claim 1, wherein when the specific light emission pattern is detected by the light emission pattern detection unit, the control unit performs control when a photographer's face is reflected in the captured image. The imaging device according to any one of 5 to 5.   The photographing apparatus according to claim 6, wherein the specific light emission pattern is a specific light emission pattern by blinking, light emission color, or a combination thereof. Design storage means for storing a specific design displayed on the front surface of the housing of the photographing apparatus, a specific shape, a pattern or a color, or a specific design combining these and a design obtained by inverting the specific design;
Design detection means for detecting the design stored in the design storage means from at least one of the photographed image obtained by the photographing means and the photographed image reversed left and right by the reversing means,
When the design is detected by the design detection means even when the control means does not detect that the photographer's face image is reflected in the captured image by the collating means, The apparatus according to any one of claims 1 to 7, wherein control is performed when a photographer's face is reflected in the camera.   The design detection means detects the design from both a photographed image obtained by the photographing means and horizontally reversed by the reversing means and a photographed image obtained by the photographing means and not horizontally reversed by the reversing means. The photographing apparatus according to claim 8, wherein:   The photographing apparatus according to claim 1, wherein a photographing device for photographing a photographer's face image is provided on a rear surface of the housing of the photographing apparatus.   A personal authentication information input device for inputting photographer authentication information, and a database interface for accessing a database storing person face image information and acquiring the photographer face image information corresponding to the photographer authentication information The photographing apparatus according to claim 1, wherein the photographing apparatus is provided.   12. The photographing apparatus according to claim 1, wherein the collating unit performs collation by luminance instead of collation by color when performing image collation. The inversion means performs both left-right inversion and up-down inversion,
The photographing apparatus according to any one of claims 1 to 12, wherein the collating unit performs collation using both a horizontally inverted image and a vertically inverted image.   The photographing apparatus according to claim 13, wherein the collating unit performs collation by giving priority to the vertically inverted image over the horizontally inverted image. The photographer storage means stores face image information photographed from a plurality of angles,
15. The photographing apparatus according to claim 1, wherein the collating unit performs collation by selecting face image information corresponding to a photographing angle of view from the photographer storage unit.   2. The control unit according to claim 1, wherein when the photographer's reflection is detected, the control unit performs display control for conspicuously displaying the photographer's face image reflected in the photographed image together with a warning. The photographing apparatus according to any one of 15.   When the photographer's reflection is detected, the control means is at least one of image processing for reducing the brightness of the face image, image processing for reducing the color of the face image, and image processing for blurring the face image. The image capturing apparatus according to claim 1, wherein the image processing is performed.   When the photographer's reflection is detected, the control means captures the captured image in the actual image by at least one of exposure control, focus control, white balance adjustment, and flash light control. The photographing apparatus according to any one of claims 1 to 16, wherein a face image of a person cannot be visually identified. With a polarizing filter,
17. The control device according to claim 1, wherein when the photographer's reflection is detected, the control unit performs control so that the photographer is not reflected by rotating the polarizing filter during the actual photographing. The imaging device according to any one of the above.   The photographing apparatus according to any one of claims 1 to 19, wherein the collating unit does not perform collation at the time of self-timer photographing or self-timer photographing by a timer longer than a specific time. Storage means for storing face image information indicating a photographer's face image;
Reversing means for reversing the image horizontally;
A face detection unit for detecting a face image from at least one of the photographed image obtained by photographing an arbitrary subject and reversed left and right by the reversing unit and the photographed image not horizontally reversed by the reversing unit; ,
At least one of the face image detected from the left-right reversed photographed image and the face image detected from the left-right reversed photographed image and left-right reversed by the reversing means, and stored in the storage means Collating means for collating the face image information being detected, and detecting that a photographer's face is reflected in a reflecting object in the photographed image;
When a photograph of the photographer's face is detected, a warning notification indicating that the photographer is reflected in the photographed image and the face image in the photographed image cannot be visually discriminated. Control means for controlling at least one of image processing;
An image processing apparatus comprising: Image acquisition means for acquiring a photographer's face image;
Reversing means for horizontally flipping the photographer's face image acquired by the image acquiring means;
Storage means for storing face image information indicating the photographer's face image that has been horizontally reversed;
Photographing means for photographing an arbitrary subject;
Face detecting means for detecting a face image from a photographed image obtained by the photographing means;
By comparing the face image detected by the face detection means with the face image information stored in the storage means, it is detected that the photographer's face is reflected in the reflecting object in the photographed image. Matching means;
When a photograph of the photographer's face is detected, a warning notification indicating that the photographer is reflected in the photographed image and the face image in the photographed image cannot be visually discriminated. Control means for controlling at least one of image processing;
An image processing apparatus comprising: A photographing method using photographing means, storage means for storing photographer's face image information, and reversing means for performing left-right reversal of the image,
Photographing a subject by the photographing means;
Reversing the photographed image obtained by the photographing means by the reversing means;
Detecting a face image from the left-right inverted photographed image;
The face image detected from the left-right reversed photographed image is compared with the face image information stored in the storage means, and the photographer's face is reflected in the reflecting object in the photographed image. Detecting step;
With
When a photograph of the photographer's face is detected, a warning notification indicating that the photographer is reflected in the photographed image, and an image process that makes it impossible to visually identify the face image in the photographed image A photographing method characterized by performing at least one of prohibition of main photographing and main photographing that makes it impossible to visually identify a photographer's face image reflected in the photographed image. A photographing method using photographing means, storage means for storing photographer's face image information, and reversing means for performing left-right reversal of the image,
Photographing a subject by the photographing means;
Detecting a face image from a photographed image obtained by the photographing means;
Reversing the detected face image horizontally by the reversing means;
Collating the left and right inverted face image with the face image information stored in the storage means, and detecting that the photographer's face is reflected in the reflecting object in the captured image;
With
When a photograph of the photographer's face is detected, a warning notification indicating that the photographer is reflected in the photographed image, and an image process that makes it impossible to visually identify the face image in the photographed image A photographing method characterized by performing at least one of prohibition of main photographing and main photographing that makes it impossible to visually identify a photographer's face image reflected in the photographed image. An image acquisition means for acquiring a photographer's face image, a reversing means for horizontally reversing the image, a storage means, and a photographing method using the photographing means,
Acquiring a photographer's face image by the image acquisition means;
Reversing the acquired photographer's face image by the reversing means;
Storing the face image information indicating the photographer's face image reversed in the left-right direction in the storage means;
Photographing a subject by the photographing means;
Detecting a face image from a photographed image obtained by the photographing means;
Collating the detected face image with the face image information stored in the storage means to detect that the photographer's face is reflected in the reflecting object in the captured image;
With
When a photograph of the photographer's face is detected, a warning notification indicating that the photographer is reflected in the photographed image, and an image process that makes it impossible to visually identify the face image in the photographed image A photographing method characterized by performing at least one of prohibition of main photographing and main photographing that makes it impossible to visually identify a photographer's face image reflected in the photographed image. An image processing method using storage means for storing photographer's face image information and reversing means for performing left-right reversal of the image,
Reversing the captured image obtained by photographing an arbitrary subject by the reversing means;
Detecting a face image from the left-right inverted photographed image;
The face image detected from the left-right reversed photographed image is compared with the face image information stored in the storage means, and the photographer's face is reflected in the reflecting object in the photographed image. Detecting step;
With
When a photograph of the photographer's face is detected, a warning notification indicating that the photographer is reflected in the photographed image and the face image in the photographed image cannot be visually discriminated. An image processing method characterized by performing at least one of image processing. An image processing method using storage means for storing photographer's face image information and reversing means for performing left-right reversal of the image,
Detecting a face image from a photographed image obtained by photographing an arbitrary subject;
Reversing the detected face image horizontally by the reversing means;
Collating the left and right inverted face image with the face image information stored in the storage means, and detecting that the photographer's face is reflected in the reflecting object in the captured image;
With
When a photograph of the photographer's face is detected, a warning notification indicating that the photographer is reflected in the photographed image and the face image in the photographed image cannot be visually discriminated. An image processing method characterized by performing at least one of image processing. An image acquisition means for acquiring a photographer's face image, an inversion means for performing left-right inversion of the image, and an image processing method using a storage means,
Acquiring a photographer's face image by the image acquisition means;
Reversing the acquired photographer's face image by the reversing means;
Storing the face image information indicating the photographer's face image reversed in the left-right direction in the storage means;
Detecting a face image from a photographed image obtained by photographing an arbitrary subject;
Collating the detected face image with the face image information stored in the storage means to detect that the photographer's face is reflected in the reflecting object in the captured image;
When a photograph of the photographer's face is detected, a warning notification indicating that the photographer is reflected in the photographed image and the face image in the photographed image cannot be visually discriminated. An image processing method characterized by performing at least one of image processing.

Images