JP2013115656A - Photographing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a photographed image with a face part or the like processed by a simple operation.SOLUTION: A photographing apparatus comprises: an imaging unit that outputs a photographed image obtained by photographing a subject; a detection unit that detects a specific region in the photographed image as a non-public region; and a composition control unit that, in photographing the subject, combines a mask image covering at least part of the non-public region with the photographed image, thereby generating a composite image. This disables recognition of the non-public region, and enables protection of personal information or the like even when the image including the non-public region is recorded, transmitted, or the like.

Description

  The present invention relates to a photographing apparatus suitable for photographing a photographed image for uploading.

  2. Description of the Related Art In recent years, portable devices (photographing devices) with a photographing function such as digital cameras have various photographing functions by making full use of image processing. Some photographing devices have a communication function, and an image obtained by photographing can be transmitted to another device or a network.

  For example, it is possible to upload a photographed image obtained by photographing the daily life that occurred around you to a network such as the Internet and share it with a third party for enjoyment. However, when photographing a city landscape or the like, a human face or the like may be included in the photographed image unintentionally. If such a photographed image is shared, it is not preferable from the viewpoint of portrait rights and privacy.

  Therefore, Patent Document 1 discloses a technique for protecting privacy by applying a mosaic to a face portion in an image.

JP 2009-284235 A

  However, the technique disclosed in Patent Document 1 has a problem in that settings necessary for mosaic processing are complicated.

  An object of the present invention is to provide a photographing apparatus that can obtain a photographed image obtained by processing a face portion or the like with a simple operation.

  An imaging device according to the present invention includes an imaging unit that outputs a captured image obtained by capturing a subject, a detection unit that detects a specific region in the captured image as a non-public region, And a synthesis control unit that synthesizes a mask image covering at least a part of the non-public area with the captured image to generate a synthesized image.

  According to the present invention, it is possible to obtain a photographed image obtained by processing a face portion or the like with a simple operation.

1 is a block diagram illustrating a circuit configuration of a photographing apparatus according to an embodiment of the present invention. Explanatory drawing for demonstrating the utilization form of synthetic | combination mode. Explanatory drawing for demonstrating a picked-up image and a synthesized image. The flowchart for demonstrating camera control. The flowchart for demonstrating the synthetic | combination image creation process in FIG. Explanatory drawing for demonstrating the memory content of the temporary memory | storage part 14 typically. Explanatory drawing for demonstrating the memory content of the temporary memory | storage part 14 typically. Explanatory drawing for demonstrating the memory content of the temporary memory | storage part 14 typically. Explanatory drawing which shows the example of a display of a synthesized image.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram showing a circuit configuration of a photographing apparatus according to an embodiment of the present invention. In this embodiment, at the time of shooting, it is possible to detect a face portion or the like in a shot image as a non-public area, and to shoot in a mode in which a mask image is synthesized in this area (hereinafter referred to as a synthesis mode). To do. The imaging device of the present embodiment may be configured to always perform imaging in the synthesis mode, or may be configured to be able to switch between a normal mode for processing a captured image as it is and a synthesis mode.

  In FIG. 1, an imaging device body 10 has an imaging unit 11 constituted by an imaging element such as a CCD or a CMOS sensor. The imaging unit 11 photoelectrically converts the subject image from the interchangeable lens 20 provided on the front surface of the imaging device body 10 to obtain a captured image signal.

  The interchangeable lens 20 has a photographic optical system 21 that guides a subject image to the imaging unit 11 of the photographic device body 10. The photographing optical system 21 includes a lens storage portion 21a having a cylindrical portion and a ring-shaped operation portion 22 for driving and controlling the lens. The operation unit 22 is configured to be rotatable in the circumferential direction of the lens storage unit 21a and to be slidable in the optical axis direction.

  The rotation operation determination unit 23 is configured by, for example, a photocoupler or an encoder, and outputs an operation signal based on the rotation operation of the operation unit 22 to the control unit 25. The slide position determination unit 24 includes, for example, a plurality of switches and the like, and outputs an operation signal based on the slide operation of the operation unit 22 to the control unit 25. The control unit 25 is configured by a microcomputer or the like.

  The operation signal from the rotation operation determination unit 23 corresponds to the rotation position of the operation unit 22, and the control unit 25 generates a focus signal corresponding to the rotation position of the operation unit 22 and controls the drive unit 26. The photographing optical system 21 is provided with a plurality of lenses (not shown), and a drive unit 26 configured by a motor or the like drives these lenses to change the lens position, and performs zoom control and focus control. By rotating the operation unit 22, focus fine adjustment according to the rotation operation is performed.

  The slide position determination unit 24 can be configured to be able to determine two states as the slide position of the operation unit 22. The control unit 25 switches between the normal mode and the pan focus mode as the focusing mode based on the slide position determination result. For example, when the slide position determination unit 24 indicates that the slide position is one position, the control unit 25 sets the normal mode and performs fine focus adjustment based on the rotation operation of the operation unit 22.

  On the other hand, if it is indicated that the slide position is the other position, the control unit 25 controls the drive unit 26 to drive the lens, and performs pan focus control so that a specific distance is in focus. . In this case, the control unit 25 changes the pan focus setting distance based on the rotation operation of the operation unit 22.

  The photographing optical system 21 is provided with a focus control unit 21 b, and the focus control unit 21 b outputs a signal corresponding to the lens position to the focus position determination unit 27. The focus position determination unit 27 determines the focus position based on the output of the focus control unit 21 b and outputs the determination result to the control unit 25. The focus conversion unit 25a of the control unit 25 is given the determination result of the rotation operation and the determination result of the focus position, performs conversion between the rotation operation of the operation unit 22 and the moving amount of the lens, and the focus position is based on the rotation operation. The drive unit 26 is controlled so as to be in a predetermined position.

  The interchangeable lens 20 is provided with a communication unit 28. The photographing device main body 10 is provided with a communication unit 13. The communication unit 28 transmits and receives information to and from the communication unit 13 of the photographing apparatus main body 10 via a predetermined transmission path. When communication with the communication unit 13 of the photographing apparatus main body 10 is established, the control unit 25 can cause the communication unit 28 and 13 to transmit lens information stored in a memory (not shown) to the photographing apparatus main body 10. As a result, the photographing apparatus main body 10 can recognize what zoom function the interchangeable lens 20 has, the magnification of the zoom lens, the focal length, the brightness number, the focusing mode, and the like. The control unit 25 is configured to be controlled by the signal processing and control unit 12 by being supplied with a control signal from the signal processing and control unit 12 of the photographing apparatus main body 10 via the communication units 13 and 28.

  In the present embodiment, various interchangeable lenses can be employed. FIG. 1 shows an example in which an interchangeable lens capable of setting a focus mode by the rotatable and slidable operation unit 22 is shown. However, the pan focus mode may be set on the photographing apparatus main body side. An interchangeable lens that does not have a mode setting function, a communication function, or the like may be employed, or a lens that is not interchangeable may be employed.

  The imaging unit 11 of the imaging apparatus main body 10 is driven and controlled by the signal processing and control unit 12 to capture a subject through the interchangeable lens 20 and output a captured image. The signal processing and control unit 12 outputs a driving signal for the imaging element to the imaging unit 11 and reads a captured image from the imaging unit 11. The signal processing and control unit 12 performs predetermined signal processing, for example, color adjustment processing, matrix conversion processing, noise removal processing, and other various signal processing on the read captured image.

  In the present embodiment, the photographic device main body 10 is provided with a temporary storage unit 14 and a face detection unit 16. The temporary storage unit 14 can temporarily store a captured image after signal processing by the signal processing and control unit 12. Further, the signal processing and control unit 12 gives the captured image to the face detection unit 16.

  The face detection unit 16 detects the face of a person in the captured image by a known face detection method. For example, the face detection unit 16 may employ a technique for detecting a person's face by sequentially comparing a plurality of grayscale images obtained by modeling facial brightness characteristics and a captured image. In addition, the face detection unit 16 can determine the facial expression by using a database that stores, for example, the angle of the mouth corner, the angle of the corner of the eye in the case of a smile, and the shadow characteristics of the facial parts. Furthermore, the face detection unit 16 can determine the age, sex, and the like of the photographed person by using a database that stores the facial feature values of a large number of persons.

  The signal processing and control unit 12 is given the detection result of the face detection unit 16. The signal processing and control unit 12 includes a size and position determination unit 12a. The size and position determination unit 12a determines the size and position of the face in the captured image based on the detection result of the face detection. To do. Further, the signal processing and control unit 12 includes a contrast determination unit 12b, and the contrast determination unit 12b determines the contrast of the face portion in the captured image and its surroundings. The contrast determination unit 12b is also used for the focusing process of the interchangeable lens 20.

  The signal processing and control unit 12 gives the captured image after the signal processing to the temporary storage unit 14. The signal processing and control unit 12 reads out a mask image stored in the ROM 15 and stores it in the temporary storage unit 14 at the time of photographing. In addition to the mask image stored in the ROM 15, the signal processing and control unit 12 may read out an image recorded in a memory (not shown) as a mask image and store it in the temporary storage unit 14. Good.

  The signal processing and control unit 12 includes a resizing processing unit 12c and a synthesis control unit 12d. The resize processing unit 12c reads the mask image stored in the temporary storage unit 14, and performs a mask image enlargement or reduction process (hereinafter referred to as a resize process) according to the determination result of the size and the position determination unit 12a. Do. The compositing control unit 12d reads the captured image stored in the temporary storage unit 14, and converts the mask image (face composite image) resized according to the size of the face to the size and position of the position determination unit 12a. According to the determination result, a composite image synthesized at the position of the face portion of the photographed image is generated. The composite control unit 12d stores the composite image in the composite image storage unit 14a of the temporary storage unit 14.

  The signal processing and control unit 12 reads out the captured image, the mask image, and the composite image stored in the temporary storage unit 14 and gives them to the display unit 19. The display unit 19 is configured by an LCD (liquid crystal display panel) or the like, and displays an image given from the signal processing and control unit 12.

  In addition, the signal processing and control unit 12 can read and compress the captured image and the composite image stored in the temporary storage unit 14, and can apply the compressed image to the recording unit 17 for recording. As the recording unit 17, for example, a card interface can be adopted, and the recording unit 17 can record image information, audio information, and the like on a recording medium such as a memory card.

  The photographing device body 10 is also provided with an operation determination unit 18. The operation determination unit 18 has a release button (not shown), various switches for setting a shooting mode, and the like, and generates an operation signal based on a user operation and supplies the operation signal to the signal processing and control unit 12. The signal processing and control unit 12 controls each unit based on the operation signal.

  Further, the photographing apparatus main body 10 is provided with a touch panel 19a. For example, by providing the touch panel 19a on the display screen of the display unit 19, an operation signal corresponding to the position on the display screen pointed by the user with a finger can be generated. Accordingly, the user can easily perform a selection operation or the like on the image displayed on the display screen of the display unit 19.

  The signal processing and control unit 12 controls each unit to set a shooting mode based on a user operation, and realize a shooting function according to each shooting mode. For example, when the operation signal based on the operation of a switch (not shown) for instructing the synthesis mode is input from the operation determination unit 18, the signal processing and control unit 12 can set the synthesis mode. .

  Further, when the pan focus mode is set by the slide operation of the operation unit 22, the signal processing and control unit 12 may automatically set the synthesis mode. Further, the signal processing and control unit 12 may set the synthesis mode when the autofocus mode is set or when the release button is completely pressed within a predetermined time (pressed at a stroke).

  In the synthesis mode, the signal processing and control unit 12 performs a mask image synthesis process, a mask image change process, and a mask image removal process for removing a mask image synthesized from the synthesized image in accordance with a user operation. It can be implemented for each face. In addition, the signal processing and control unit 12 can display the captured image, the mask image, and the combined image at the time of the mask image composition processing, change processing, and removal processing, and the captured image and composite image after these processing can be displayed. The recording unit 17 can be given and recorded.

  The photographing apparatus main body 10 is provided with a communication unit 31, which is controlled by the signal processing and control unit 12 to transmit the composite image recorded in the recording unit 17 to a transmission path (not shown) such as the Internet. It can be transmitted to other devices via the network. For example, the signal processing and control unit 12 can set a mode for automatically transmitting a composite image recorded in the recording unit 17 by the communication unit 31.

  Next, the operation of the embodiment configured as described above will be described with reference to FIGS. FIG. 2 is an explanatory diagram for explaining how to use the synthesis mode, and FIG. 3 is an explanatory diagram for explaining a captured image and a synthesized image.

  In the present embodiment, the pan focus mode can be set. In the pan focus mode, by setting the pan focus distance in advance, it is not necessary to focus at the time of shooting. When the pan focus mode is set, for example, when taking a picture of a favorite landscape during a walk or the like, it is easy to shoot without missing a photo opportunity. When a photographed image is uploaded to a recording area on a network and the photograph is shared, the photograph is often taken by such a photographing method.

  FIG. 2A shows an example of a scene where such a photographing method is adopted. The photographer 41 is walking on the road 42. In front of the photographer 41, a landscape such as a building group 43 or a tower 44 can be seen. Here, it is assumed that the photographer 41 intends to photograph a landscape in front. As shown in FIG. 2B, the photographer 41 takes a picture by holding the camera 46 with the hand 45. In this case, a person 47 may exist within the shooting range. The pan focus mode is suitable for quick shooting. In such shooting, focusing is not necessary and easy shooting is possible, but an unintended person may be shot. In such a case, uploading the captured image as it is for image sharing is not preferable from the viewpoint of protecting personal information.

  Therefore, in the present embodiment, a composition mode in which a mask image is synthesized with such a person's face or the like is employed at the time of photographing so that the person in the photographed image cannot be identified. FIG. 3A shows a captured image, and FIG. 3B shows a composite image.

  FIG. 3A shows a state in which a building image 52 and a person image 53 are captured in the captured image 51. An image 51 shows a state in which an image 54 of a human face is captured. FIG. 3B shows an example of a composite image 51b in which the mask image 55 is combined with the face image 54 of the person in the photographed image of FIG. As is clear from the comparison between FIGS. 3A and 3B, in the composite image 51b in FIG. 3B, most of the face image 54 is covered by the mask image 55, and the composite image 51b It is not possible to specify the person who is shown in

  Next, camera control that enables the synthesis mode will be described with reference to FIGS. FIG. 4 is a flowchart for explaining camera control, and FIG. 5 is a flowchart for explaining the composite image creation processing in FIG. 6 to 8 are explanatory diagrams for schematically explaining the storage contents of the temporary storage unit 14.

  Note that FIG. 4 shows an example in which the user mode for specifying the auto focus mode and the pan focus mode is detected and the composition mode is set, but other predetermined operations, for example, a shutter button that is pressed in two stages is shortened. The combination mode may be set by detecting a pressing operation that finishes pressing at once, and the combination mode may always be set at the time of shooting regardless of the user operation.

  For example, when the photographer slides the operation unit 22 of the interchangeable lens 20, the control unit 25 can set the pan focus mode. Information indicating that the pan focus mode has been set is supplied from the control unit 25 to the signal processing and control unit 12 of the photographing apparatus body 10 via the communication units 28 and 31. In this way, the pan focus mode can be set and the mode can be automatically shifted to the composition mode by a simple operation of sliding the focusing operation unit 22.

  Further, the transition from the normal mode to the composition mode may be performed by detecting the posture or vibration of the photographing apparatus body 10. For example, when an attempt is made to quickly shoot, a state in which the posture is not stable, such as when the photographic device main body 10 is held at the photographing position, or a state in which the vibration of the photographic device main body 10 is increased immediately before, occurs. Therefore, it is possible to shift to the synthesis mode by detecting such a state.

  In step S1 of FIG. 4, the signal processing and control unit 12 determines whether or not the shooting mode is set. Assume that the shooting mode is instructed. In this case, the signal processing and control unit 12 performs through image display and face detection in step S2. The signal processing and control unit 12 takes a photographed image from the imaging unit 11 and performs predetermined signal processing. The signal processing and control unit 12 outputs the captured image after the signal processing to the face detection unit 16, and gives the captured image after the signal processing to the display unit 19 to display a through image.

  Further, the signal processing and control unit 12 reads out the mask image from the ROM 15 and stores it in the temporary storage unit 14. FIG. 6 schematically shows that four mask images FA, FC, MA, and MC are stored in the storage area 61 of the temporary storage unit 14.

  The signal processing and control unit 12 determines whether or not the autofocus mode is designated in step S3. If so, the signal processing and control unit 12 sets the autofocus mode in step S4, and determines whether or not the photographing operation is performed in step S5. judge.

  Here, it is assumed that the photographer performs photographing by operating the release button or the like. In this case, the signal processing and control unit 12 proceeds to the next step S6 and determines whether or not autofocus or pan focus is set.

  When autofocus or pan focus is not set, the signal processing and control unit 12 sets the normal mode and performs shooting and compression recording (step S7). That is, the signal processing and control unit 12 captures a photographed image from the imaging unit 11 by pressing the release button, and performs predetermined signal processing. The signal processing and control unit 12 compresses the captured image after the signal processing, gives it to the recording unit 17 and records it. Further, in step S8, the signal processing and control unit 12 gives the recorded photographed image to the display unit 19 to display the REC view (step S8).

  The signal processing and control unit 12 ends the REC view display after a predetermined time has elapsed from the start of the REC view display (Step S9). In the next step S11, the signal processing and control unit 12 determines whether or not the recorded captured image can be communicated (step S11). 31 is controlled and the recorded photographed image is transmitted to a predetermined network.

  Here, it is assumed that the photographer performs an operation for designating the auto focus mode and the pan focus mode, and an operation for pressing the shutter button in a short time (pressing at once). In this case, the signal processing and control unit 12 sets the synthesis mode.

  For example, when photographing, the photographer slides the operation unit 22 of the interchangeable lens 20 to designate the pan focus mode, and the signal processing and control unit 12 proceeds from step S6 to step S15. Then, shooting and temporary storage for the synthesis mode are performed.

  Steps S15 to S24 show processing in the synthesis mode. The signal processing and control unit 12 captures a captured image transferred from the imaging unit 11 by pressing the release button and performs signal processing, and then provides the captured image after the signal processing to the temporary storage unit 14 to temporarily store the captured image. In step S <b> 16, the signal processing and control unit 12 creates a mask image (face part composite image), and creates a composite image synthesized with the captured image.

  FIG. 5 shows an example of a specific flow for creating a composite image.

  The face detection unit 16 is supplied with a photographed image obtained by a photographing operation such as a release button from the signal processing and control unit 12, and the face detection unit 16 performs face detection processing in the photographed image. Further, the face detection unit 16 detects the gender of the person and whether or not the child is a child from the face in the captured image, and also detects the facial expression. The detection result of the face detection unit 16 is given to the signal processing and control unit 12.

  Based on the detection result of the face detection unit 16, the signal processing and control unit 12 determines whether or not the face is female in step S51 and whether or not the face is a child in steps S52 and 53. To do. The signal processing and control unit 12 selects the male mask image MA for the male from the temporary storage unit 14 for the face determined to be a male adult (step S57). . Similarly, the signal processing and control unit 12 selects a mask image MC for a male child from the temporary storage unit 14 for the face determined to be a male child (step S56), and the face is female. For the face part determined to be an adult, the mask image FA for female adults is selected from the temporary storage part 14 (step S55), and the face part determined to be a female child is temporarily stored. A mask image FC for a female child is selected from the portion 14 (step S54), and is used as a face composite image.

  The size and position determination unit 12a of the signal processing and control unit 12 determines the size and position of the face in the captured image based on the detection result of the face detection unit 16 (step S60). The resizing processing unit 12c resizes the mask image selected for each face according to the size of each face (step S61). Further, in step S62, the signal processing and control unit 12 determines the facial expression for each face in the captured image, and selects and deforms the mask image according to the facial expression. For example, when a plurality of mask images are prepared for each sex and each adult and child, the mask image can be selected according to the facial expression. Furthermore, the selected mask image can be deformed according to the facial expression.

  Further, the contrast determination unit 12b of the signal processing and control unit 12 determines the contrast of the face portion in the captured image and its surroundings (step S64). The signal processing and control unit 12 makes the contrast of the selected mask image sufficiently higher or lower than the contrast of the face part (step S65). In addition to the face contrast, the background contrast and color determination results may be used. Further, the thickness of the contour may be switched. In that case, a step of determining the contrast and color around the face may be provided before step S65.

  In the synthesis mode, it may be better to clearly indicate that the face is being processed. For this reason, for example, the face contrast is obtained, and a mask image having a higher contrast than the contrast is synthesized so that it is clear that the face has been replaced with the mask image. Alternatively, the face color may be detected and the mask image may be corrected to a color darker than the face color. For a person with a dark face, a light mask image may be superimposed on the face. For example, when a person with a black face is photographed, a method of combining a mask image of a white flower on the face can be considered. Further, a mask image in which contrast and color tone are emphasized may be synthesized with the face background. As a result, the image can be seen separately from the background and the face so that the viewer can easily recognize that the image is a mask image, and can be made clear and not unnatural.

  The composite control unit 12d of the signal processing and control unit 12 generates a composite image in which the mask image selected and resized, deformed, or the like is superimposed on the face of the photographed image, and stores the composite image in the temporary storage unit 14 Store in the unit 14a.

  FIG. 7 shows an example of the captured image 62a, the mask images FA, FC, MA, MC, and the composite image 62b stored in the temporary storage unit 14 and the composite image storage unit 14a. FIG. 7 shows an example corresponding to the captured images of FIGS. 3A and 3B. The temporarily stored captured image 62a includes a person image, and the signal processing and control unit 12 In this example, it is determined that this person is a female child and a mask image FC for a female child is selected. In the example of FIG. 7, the signal processing and control unit 12 generates a composite image 62a in which the mask image FC that has been selected and resized, deformed, and the like is superimposed on the person's face portion of the captured image 62a. It is shown that.

  When the composite image is created, the signal processing and control unit 12 starts REC view display before recording the composite image in step S17. The signal processing and control unit 12 reads the composite image from the composite image storage unit 14a and gives it to the display unit 19 for display. Thus, the composite image shown in FIG. 3B is displayed on the display screen of the display unit 19.

  Until a predetermined time has elapsed since the start of the REC view display, the mask image can be canceled and set in steps S21 to S24. An operation in which the user selects a face portion (hereinafter referred to as a composite face portion) in which a mask image in the captured image is combined, for example, touches the position of the composite face portion on the display screen of the display unit 19 provided with the touch panel 19a. When the operation is performed (step S21), an operation signal corresponding to this operation is given to the signal processing and control unit 12, and the signal processing and control unit 12 generates an image obtained by removing the mask image from the composite image ( In step S22), the image is stored in the composite image storage unit 14a.

  FIG. 8 shows this example, and the mask image is removed from the image 62b stored in the composite image storage unit 14a. The signal processing and control unit 12 gives the image 62b shown in FIG. That is, the image shown in FIG. 3A is displayed on the display screen of the display unit 19. For convenience of explanation, an image that has been combined once may be referred to as a combined image even if the mask image is removed.

  In this state, when the user performs an operation of selecting a face in the image, for example, an operation of touching the position of the face on the display screen of the display unit 19 (step S23), an operation signal corresponding to this operation is generated. The signal processing and control unit 12 is provided with the signal processing and control unit 12 to generate a combined image obtained by combining the mask image on the image again (step S24), and stores the combined image in the combined image storage unit 14a. That is, in this case, the composite image 62b shown in FIG. 7 is stored in the composite image storage unit 14a. The signal processing and control unit 12 gives the composite image 62b shown in FIG. That is, the image shown in FIG. 3B is displayed again on the display screen of the display unit 19.

  The mask image can be canceled and set until a predetermined time has elapsed from the start of the REC view display. When the predetermined time has elapsed, the signal processing and control unit 12 proceeds from step S18 to step S19. Then, the image stored in the composite image storage unit 14a is given to the recording unit 17 for storage. The signal processing and control unit 12 ends the REC view display in step S20, and then proceeds to step S11. In this way, in step S12, it is possible to record and upload a composite image in which the mask image is combined with the face of the person in the captured image.

  In the example of FIG. 4, the composite image can be displayed and confirmed even during manual focus. The signal processing and control unit 12 determines whether or not auto focus or pan focus is specified in steps S3 and S31. If neither is specified, whether or not the face is touched in step S32. Determine. When the face part on the display screen is touched during the REC view display before the release button is pressed, the signal processing and control unit 12 shifts the process to step S33 to display the composite image. . Note that the processing in step S33 is the same as that in step S16, and the selected mask image is subjected to processing such as resizing and deformation on the face portion of the person in the REC view image and is displayed after being synthesized. .

  If the shooting mode is not designated, the signal processing and control unit 12 determines whether or not the reproduction mode is designated in step S41. When the reproduction mode is designated, the signal processing and control unit 12 reads out the image recorded in the recording unit 17, performs predetermined signal processing such as expansion processing, and then provides it to the display unit 19 for reproduction. Display. The signal processing and control unit 12 determines whether or not a reproduction image change operation has been performed in step S43, and if there is a change operation for specifying another image, reads the specified other image. Then, after performing predetermined signal processing such as expansion processing, it is given to the display unit 19 to be reproduced and displayed (step S44).

  If the signal processing and control unit 12 determines in step S41 that the reproduction mode is not designated, it determines whether or not a communicable and untransmitted image is recorded in the recording unit 17 in step S45. If there is an untransmitted image that can be communicated, the signal processing and control unit 12 reads out the untransmitted image and causes the communication unit 31 to transmit it on the network in step S46.

  In the flowchart of FIG. 4, the example in which the mask image is canceled and set in steps S <b> 21 to S <b> 24 has been described. However, in addition to the mask image cancellation and setting, the mask image may be changed. . For example, the signal processing and control unit 12 may display a part or the whole of the mask image stored in the temporary storage unit 14 so as to be superimposed on the composite image at the time of rec view display. FIG. 9 is an explanatory view showing a display example in this case. In FIG. 9, a mask image 73 is combined with a face portion 72 of a person in the REC view image 71. A plurality of selectable mask images 74 are arranged and displayed in a predetermined area of the REC view image 71.

  It is assumed that the user performs an operation of specifying mask images before and after the change. For example, by touching a mask image to be selected as a mask image after change from the displayed mask images and sliding it to the position of the composite face or face to be changed, that is, by dragging, Such a specification is possible.

  In response to this operation, the signal processing and control unit 12 selects a mask image designated by the user, and uses the size and position determination unit 12a, the contrast determination unit 12b, the resizing processing unit 12c, and the synthesis control unit 12d. After the selected mask image is subjected to processing such as resizing and deformation, the processed mask image is replaced with the mask image of the designated synthetic face portion or newly synthesized to the face portion. Thereby, it is possible to freely set, change, and cancel the mask image during the REC view display period.

  As described above, in the present embodiment, at the time of shooting, it is possible to generate a composite image in which the mask image is automatically superimposed on the face portion of the person in the shot image. Thereby, even when a photographed image recorded immediately after photographing is uploaded to the network, personal information of the photographed person can be protected. In addition, the photographer selects whether to record a composite image in which the mask image is combined at the time of shooting or to record a normal shot image in which the mask image is not combined, and specifies the mask image with a simple operation. And can be synthesized. Furthermore, the transition from the normal mode to the composition mode can be performed by an extremely simple operation such as a pan focus mode setting operation, and the operability is excellent.

  In the above embodiment, the transition from the normal mode to the composition mode is performed by detecting a change in the physical state of the photographing apparatus body. However, the mode transition is performed according to the state of the photographed image. May be. For example, when a person is located at a sufficient size in the center of the photographed image at the time of photographing operation, it can be considered that the person is intended to photograph as a subject, so the normal mode is set. Conversely, the movement of the subject in the through image is detected, and it is determined that a person who moves away from the center of the screen or a person whose movement amount is large is an object that is not intended to be photographed. You may make it set the synthetic | combination mode which synthesize | combines a mask image with a face part. Also, among the people in the through image, the moving person is determined as a subject that is not intended for shooting, and a mask image is synthesized. Also good.

  In the above embodiment, an example of synthesizing a mask image that covers substantially the entire face of a person has been described. However, a mask image that covers only a part of the face such as the eyes and the surroundings, the face and the face Obviously, a mask image covering up to the surrounding portion or a mask image covering the entire person may be synthesized.

  In the above embodiment, an example has been described in which only a composite image stored in the composite image storage unit is uploaded and given to the recording unit for recording. However, the same applies not only to the composite image but also to the captured image before synthesis. May be recorded. Further, the composite image stored in the composite image storage unit by the signal processing and control unit is compressed and then given to the communication unit and uploaded to the network. The photographed image before the synthesis is recorded after being compressed. You may make it record by giving to a part.

  In the above-described embodiment, the example of detecting a human face from a captured image and synthesizing a mask image has been described. However, an area in the captured image that is desired to be kept private, for example, a signboard or an address in the captured image. The present invention can be similarly applied to an apparatus that detects a character string image such as a display and synthesizes a mask image that covers the character string image.

  Furthermore, in the above-described embodiment, the digital camera is used as the photographing device. However, the camera may be a digital single-lens reflex camera or a compact digital camera, and may be used for moving images such as video cameras and movie cameras. Of course, a camera may be used, and a camera built in a personal digital assistant (PDA) such as a mobile phone or a smartphone may of course be used.

  The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

  It should be noted that even if the operation flow in the claims, the description, and the drawings is described using “first,” “next,” etc. for convenience, it is essential to carry out in this order. It doesn't mean. In addition, it goes without saying that the steps constituting these operation flows can be omitted as appropriate for portions that do not affect the essence of the invention.

    DESCRIPTION OF SYMBOLS 10 ... Imaging device main body, 11 ... Imaging part, 12 ... Signal processing and control part, 12a ... Size and position determination part, 12b ... Contrast determination part, 12c ... Resize processing part, 12d ... Composition control part, 13, 28, DESCRIPTION OF SYMBOLS 31 ... Communication part, 14 ... Temporary memory | storage part, 14a synthetic | combination image memory | storage part, 16 ... Face detection part, 17 ... Recording part, 19 ... Display part, 19a ... Touch panel, 21 ... Shooting optical system, 22 ... Operation part, 23 ... Rotation operation determination unit, 24 ... slide position determination unit, 25 ... control unit, 26 ... drive unit.

Claims (10)

An imaging unit for outputting a photographed image obtained by photographing a subject;
A detection unit that detects a specific area in the captured image as a non-public area;
An imaging apparatus comprising: a synthesis control unit configured to generate a synthesized image by synthesizing a mask image covering at least a part of the non-public area with the taken image when photographing the subject. The photographing apparatus according to claim 1, wherein the composition control unit automatically sets a composition mode for compositing the mask image in response to a predetermined user operation. The photographing apparatus according to claim 2, wherein the predetermined user operation is an operation of designating an autofocus mode or a pan focus mode or an operation of pressing a release button at once. The detector is
The photographing device according to any one of claims 1 to 3, wherein a human face is detected as the non-public area. The photographing apparatus according to claim 1, further comprising a display control unit configured to display the composite image before recording or transmitting the photographed image. The detection unit detects features of the person's face,
The photographing apparatus according to claim 4, wherein the combination control unit selects a mask image to be combined with the captured image from a plurality of mask images based on a detection result of the detection unit. The imaging apparatus according to claim 6, wherein the composition control unit resizes the mask image and composes the captured image based on a detection result of the detection unit. The detection unit detects a background contrast of the face of the person,
The imaging apparatus according to claim 4, wherein the synthesis control unit enhances the mask image based on a contrast detection result by the detection unit. The photographing apparatus according to claim 5, wherein the composition control unit is capable of canceling the composition of the mask image in response to a user operation on the composite image displayed by the display control unit. In response to a user operation on the composite image displayed by the display control unit, the composite control unit can cancel the composite of the combined mask image and composite another mask image. The imaging device according to claim 5.

Images