JP6406966B2 - IMAGING DEVICE, IMAGING DEVICE CONTROL METHOD, IMAGING DEVICE CONTROL PROGRAM - Google Patents

Description

  The present invention relates to an imaging apparatus, an imaging apparatus control method, and an imaging apparatus control program.

  Conventionally, various skin analysis devices have been provided as means for grasping skin information such as rough skin and wrinkles. Patent Document 1 proposes a facial skin analysis device that acquires a face image, selects an analysis area in the image, performs image analysis on the selected analysis area, and displays the analysis result on a display unit. Yes.

  As an example of the operation of such skin analysis means, for example, an analysis area may be set for each face part, a skin image may be analyzed for each face part, and the results may be compared. In such a case, for example, the entire face may be photographed to obtain an image of the entire face so as to include a plurality of face parts to be analyzed. Here, since each face part is located at a different depth in the face, it is possible that some face parts are in focus and other face parts are not in focus at the time of shooting. The portion of the entire face image that is not in focus is not necessarily suitable as an image for analysis.

  When photographing a subject having a depth as well as the face, a part of the subject may not be focused.

JP2012-232128A

  The present invention provides an imaging apparatus, an imaging apparatus control method, and an imaging apparatus control program capable of easily acquiring focused images of a plurality of portions having different depths in order to analyze a subject having a depth. .

One aspect of the image pickup apparatus of the present invention, have a depth, generating a lens for forming an optical image of a subject including a face, the image data for analysis on the basis of the optical image formed on the light receiving surface The focus position according to the face part in the imaging device, the focus changing unit for changing the focus position of the lens, the face determining unit for recognizing a facial part from the face in the image data, and the focus changing unit. A control unit that causes the image sensor to generate the image data in focus for each of the face parts having different depths, the image data generated by the image sensor, and a skin image. A pattern determination unit that compares the sample data for each face part .

The method of one embodiment of an imaging apparatus of the present invention, have a depth, and changing the focus position of the lens for forming an optical image of a subject including a face, is formed on the light receiving surface of the imaging device Based on the optical image, sequentially causing the image sensor to generate a plurality of analysis image data , changing the focus position according to the face part recognized from the face in the image data, Causing the image sensor to sequentially generate the image data in focus for each of the face parts having different depths; and the image data generated by the image sensor and skin image sample data. Comparing each face part .

The control program of one embodiment of an imaging apparatus of the present invention, focused on the computer, have a depth, to change the focus position of the lens for forming an optical image of a subject including a face, on the light receiving surface of the imaging device A procedure for causing the image sensor to sequentially generate a plurality of image data for analysis based on the optical image, a procedure for changing the focus position according to a face part recognized from a face in the image data, A procedure for causing the image sensor to generate the image data in focus for each of the face parts having different depths sequentially, the image data generated by the image sensor, and skin image sample data. The procedure for comparing each face part is executed.

  According to the present invention, it is possible to provide an imaging device, an imaging device control method, and an imaging device control program capable of easily acquiring focused images of a plurality of portions having different depths in order to analyze a subject having a depth. .

FIG. 1 is a block diagram illustrating an outline of a configuration example of an imaging apparatus according to the first embodiment. FIG. 2 is a schematic diagram illustrating an example of an appearance of the imaging apparatus according to the first embodiment. FIG. 3 is a diagram for explaining a transition from the first state to the second state of the imaging apparatus. FIG. 4 is a diagram illustrating an example of a shooting situation using the imaging device in the second state. FIG. 5 is a diagram illustrating an example of the display of the imaging apparatus. FIG. 6 is a flowchart illustrating an operation example of the imaging apparatus 1 according to each embodiment. FIG. 7 is a flowchart illustrating an operation example of the skin check mode process according to the first embodiment. FIG. 8 is a diagram illustrating an example of display in the skin check mode process. FIG. 9 is a diagram for explaining the depth of each face part. FIG. 10 is a diagram illustrating an example of the display of the face part determination result. FIG. 11 is a flowchart illustrating an operation example of the skin check mode process according to the second embodiment. FIG. 12 is a diagram illustrating an example of display in the skin check mode process according to the second embodiment. FIG. 13 is a flowchart illustrating an operation example of the skin check mode process according to the third embodiment. FIG. 14 is a diagram illustrating an example of the movement operation of the face guide frame. FIG. 15 is a diagram illustrating an example of a face part size changing operation.

[First Embodiment]
A configuration of the imaging apparatus according to the present embodiment will be described. The imaging apparatus according to the present embodiment has a function of acquiring an image of the photographer's own face and determining whether the photographer's skin condition is good based on this image. FIG. 1 is a block diagram illustrating an outline of a configuration of an imaging apparatus 1 according to the present embodiment. As illustrated in FIG. 1, the imaging device 1 includes an imaging unit 2, a focus change unit 3, a recording unit 5, an operation unit 7, a posture detection unit 8, a control unit 10, and a display unit 22. . The display unit 22 includes the touch panel 4 and the display panel 6.

  The imaging unit 2 includes a lens 2a, an imaging element 2b, and a diaphragm 2c. The lens 2a is one or a plurality of lenses, and forms an optical image on the light receiving surface of the image sensor 2b based on a light beam emitted from a subject. The image sensor 2b generates an image signal (image data) based on the optical image formed on the light receiving surface. The diaphragm 2c adjusts the amount of light flux.

  The focus changing unit 3 changes the position of the lens 2a based on a signal input from the control unit 10 in order to change the focus position. The focus changing unit 3 includes, for example, an encoder that detects the position of the lens 2a and a drive unit that moves the lens 2a.

  The recording unit 5 records image data. The recording unit 5 includes an image database (DB) 5a. The image DB 5a records an image serving as a reference for inspection to be compared with the object image. The data that can be compared with the object image at the time of inspection is not limited to the image. This data may be an image itself, a feature amount indicating the feature, or a simplified image pattern, or a numerical value such as a color or contrast. It is not always easy to match the positions and enlargement ratios of images, and the comparison results vary depending on the exposure level, light source, and white balance. For this reason, the reference image for inspection is suitable for checking the degree of coincidence with the object image by enlarging or reducing the image itself or shifting the position of the image. It may be possible to change the exposure level and white balance. Specifically, the image DB 5a may have a plurality of images with different conditions for comparison to perform one determination, or may have data separated for each color. Furthermore, since the evaluation criteria of the image may change for each part of the object, it is preferable that the image DB 5a classifies and records the image for each part of the object. This part is assumed to be a part that can be classified by image determination. In the present embodiment, the image DB 5a includes skin image sample data. This skin image sample data is image data representing various skin states of each face part. Here, the face parts include, for example, a person's forehead, eyelids, corners of eyes, nose, nose wings, cheeks, and the like. The skin condition includes, for example, a baby-like skin condition or a rough skin condition. In addition to the case of determining the skin of the face, it is also possible to assume the use of determining the roughness of the palm. In this case, it is possible to apply such as making it possible to determine the part of the finger or its base. Of course, even if it is not a skin condition, it may be possible to determine a wound or a rash.

  The operation unit 7 includes, for example, a button that detects pressing, a cross key, or a dial that detects a rotation angle, and detects a user operation and outputs a signal. These buttons and the like constitute a later-described release switch (SW) 23, front switch (SW) 26, and the like.

  The display unit 22 includes the display panel 6 and the touch panel 4. The display panel 6 is, for example, a liquid crystal display or an organic EL display. The display panel 6 displays an image based on the image signal input from the control unit 10. A touch panel 4 is provided on the display panel 6. The touch panel 4 outputs a signal based on the touch position.

  The posture detection unit 8 includes, for example, an acceleration sensor that detects the vertical and horizontal orientations of the imaging device 1, that is, the vertical and horizontal orientations of the imaging device 2b. As will be described later, the display unit 22 is displaced with respect to the camera body. The posture detection unit 8 includes an encoder that detects the rotation angle of the display unit 22 with respect to the camera body. The orientation of the imaging device 2b and the rotation angle of the display unit 22 with respect to the camera body are collectively referred to as the orientation of the imaging device 1.

  The control unit 10 includes a central processing unit (CPU) or an application specific integrated circuit (ASIC), and performs various calculations. The control unit 10 includes a face determination unit 10a, a focus control unit 10b, a pattern determination unit 10c, a recording control unit 10d, an operation determination unit 10e, a display control unit 10f, and a display direction determination unit 10g.

  The face determination unit 10a detects facial features such as eyes and mouth included in the image. The face determination unit 10a extracts a face included in the image based on the detection result. Further, the face determination unit 10a extracts face parts included in the face based on features such as eyes and mouth and the extracted face.

  The focus control unit 10 b sets the focus position of the lens 2 a and inputs a signal related to the focus position to the focus change unit 3.

  For each facial part, the pattern determination unit 10c compares the image extracted from the image data with the image related to the skin image sample data of the corresponding facial part, and the features of these images, such as color or contrast, etc. The degree of feature matching is determined.

  The recording control unit 10d controls reading and writing of image data to the recording unit 5 including reading and writing of image data to the image DB 5a.

  The operation determination unit 10 e determines a signal input from the operation unit 7 and the touch panel 4. Based on the determined signal, the operation of each unit of the imaging apparatus 1 is controlled, such as causing the diaphragm 2c to adjust the amount of light or causing the imaging unit 2 to perform shooting.

  The display direction determination unit 10g determines the orientation of the image to be displayed on the display panel 6, for example, the vertical direction of the display, and the possibility of mirror display based on the attitude of the imaging device 1 detected by the attitude detection unit 8.

  The display control unit 10f causes the display panel 6 to display an image based on the image data, for example, an image such as a captured image, an icon, or a face guide frame to be described later, in a direction based on the determination by the display direction determination unit 10g. Control.

  The appearance of the imaging device 1 will be described. FIG. 2 is a diagram illustrating an appearance of the imaging apparatus 1. FIG. 2A is a diagram illustrating an appearance of the imaging apparatus 1 in the first state. FIG. 2B is a diagram illustrating an appearance of the imaging device 1 in the second state. As illustrated in FIG. 2A, the imaging device 1 includes a camera body 21, a display unit 22, and a hinge 25.

  The camera body 21 is provided with main elements of the imaging device 1 such as the imaging unit 2, the focus changing unit 3, the recording unit 5, and the control unit 10. On the other hand, the display unit 22 is provided with the display panel 6 and the touch panel 4 as described above. The hinge 25 is attached to the upper surface 21 c of the camera body 21 and the upper surface 22 c of the display unit 22 so that the display unit 22 can rotate with respect to the camera body 21. In addition, the rotation angle of the display unit 22 with respect to the camera body 21 is detected by providing the hinge 25 with the encoder of the posture detection unit 8 described above.

  In the camera main body 21, the direction in which the imaging unit 2 captures an image, that is, the direction in which the lens 2a faces is referred to as the front, and the opposite direction is referred to as the rear. The direction in which the hinge 25 of the camera body 21 is attached is referred to as “upward”, and the opposite direction is referred to as “downward”. Further, when the front surface 21c of the camera body 21 is directed upward and the front is viewed from the rear, the right side and the left side are defined.

  In the first state, the display unit 22 is disposed behind the camera body 21 and the display surface of the display panel 6 faces rearward. On the other hand, in the second state, the display unit 22 is disposed above the camera body 21, the display surface of the display panel 6 faces frontward, and is turned upside down as shown in FIG. The camera body 21 is used so as to be located on the ceiling side.

  In the present embodiment, the release SW 23 used for the release operation in the first state is provided on the right side of the upper surface 21 c of the camera body 21. Therefore, in the first state, the user operates the release SW 23 with the right hand index finger while checking the through image on the display unit 22 by holding the imaging device 1 with the imaging unit 2 facing the subject. Can do.

  In the second state, the release SW 23 is positioned between the camera body 21 and the display unit 22, and the user cannot operate the release SW 23. Therefore, in the second state, the front surface SW 26 provided on the front surface 21a that is the front surface of the camera body 21 is used for the release operation. In the first state, the front surface SW 26 is used for setting parameters of the imaging apparatus 1. The parameters to be set are optical parameters such as shutter speed and aperture value. This parameter may be an image processing parameter such as contrast or color correction.

  As shown in FIG. 2B, in the second state, the display panel 6 displays an icon 6a for setting parameters and an icon 6b for selecting a skin check mode.

  FIG. 3 shows an example of a state of transition of the imaging device 1 from the first state to the second state. FIG. 3A shows the imaging device 1 in the first state. FIG. 3D shows the imaging device 1 in the second state. 3B and 3C show the state of the imaging device 1 during the transition from the first state to the second state. When the imaging apparatus 1 that has been using the imaging apparatus 1 in the first state illustrated in FIG. 3A is shifted to the second state, the user holds the camera body 21 and is illustrated in FIG. In this way, the display unit 22 is lifted upward so that the display surface of the display unit 22 faces the lens 2a of the camera body 21 as shown in FIG. Thereafter, the user reverses the top and bottom of the imaging device 1 to enter the second state.

  FIG. 4 shows an example of a shooting situation using the imaging device 1 in the second state. As illustrated in FIG. 4, the user A holds the imaging device 1 in the second state so that the lens 2 a faces its own direction. At this time, the display surface of the display panel 6 on which the through image is displayed faces the direction of the user A. As a result, the user A can take a picture while confirming the size or position of the face of the user A himself / herself displayed on the display panel 6. Further, the user A can take a picture of himself / herself by an operation with one hand by performing a release operation with the front surface SW 26 arranged on the same surface as the lens 2a.

  FIG. 5 shows an example of the display of the imaging apparatus 1 in the first state and the second state. FIG. 5A shows the display state in the first state, and FIG. 5B shows the display state in the second state. In the first state shown in FIG. 5A, the subject B located in front of the camera body 21 is photographed using the lens 2a, and is passed through the display panel 6 arranged rearwardly behind the camera body 21. Images and captured images are displayed. Such a display state in the first state is referred to as a first display state.

  On the other hand, in the second state shown in FIG. 5B, the user A located in front of the camera body 21 is photographed by the lens 2a, and is passed through the display panel 6 arranged facing the front above the camera body 21. Images and captured images are displayed. In the second state, the orientation of the display panel 6 with respect to the imaging device 2b is reversed as compared with the first state. Therefore, in the second state, the image displayed on the display panel 6 is rotated so that the image displayed on the display panel 6 in the first state is upside down. Furthermore, the image displayed on the display panel 6 may be a horizontally reversed image so that the user A can see a through image displayed on the display panel 6 as if he / she sees himself / herself in the mirror. Such a left-right inverted image display is called a mirror display. Such a display state is referred to as a second display state.

  An operation of the imaging apparatus 1 according to the present embodiment will be described. FIG. 6 is a flowchart showing the operation of the imaging apparatus 1 according to this embodiment. The imaging apparatus 1 starts its operation when the power is turned on, for example.

  In step S101, the control unit 10 determines whether a shooting mode is selected. If it is determined in step S101 that the shooting mode is selected, the process proceeds to step S102.

  If it is determined in step S101 that the shooting mode has not been selected, the process proceeds to step S117. In step S117, the control unit 10 performs other mode processing. In the other mode processing, for example, processing related to a reproduction mode for reproducing an image is performed. Here, description regarding other mode processing is omitted. After the other mode processing is performed, the processing returns to step S101.

  In step S102, the control unit 10 causes the image sensor 2b to start acquiring a through image. Thereafter, the process proceeds to step S103.

  In step S103, the control unit 10 determines whether the state of the imaging device 1 is the second state. That is, in this process, based on the output of the posture detection unit 8, it is determined whether the posture of the image sensor 2 b is inverted in the vertical direction and the display unit 22 is unfolded with respect to the camera body 21. The When it is determined that the imaging device 1 is not in the second state, that is, it is determined that the orientation of the imaging device 2b is not inverted in the vertical direction, or the display unit 22 is not expanded with respect to the camera body 21. If so, the process proceeds to step S104.

  In step S104, the control unit 10 causes the display panel 6 to display the through image acquired by the image sensor 2b. At this time, the through image is displayed in the first display state.

  In step S105, the control unit 10 displays the icons on the display panel 6 in a normal layout. In the normal layout, for example, a current mode display such as a shooting mode or notification icons for various functions are displayed in the same direction as the through image display direction.

  In step S106, the control unit 10 determines whether or not an operation by the user on the front surface SW 26 is detected. If it is determined in step S106 that front SW 26 has not detected an operation by the user, the process proceeds to step S108. If it is determined in step S106 that front SW 26 has detected an operation by the user, the process proceeds to step S107.

  In step S <b> 107, the control unit 10 changes the parameter in accordance with an operation by the user on the front surface SW 26. Thereafter, the process proceeds to step S108.

  In step S108, the control unit 10 determines whether or not the release SW 23 has been operated. When it is determined in step S108 that the release SW 23 has not been operated, the process returns to step S101. If it is determined in step S108 that the release SW 23 has been operated, the process proceeds to step S109.

  In step S109, the control unit 10 performs a shooting operation and causes the image sensor 2b to acquire image data. The acquired image is subjected to general image processing, and the processed image is recorded in the recording unit 5. Thereafter, the process returns to step S101.

  In step S103, when it is determined that the state of the image pickup apparatus 1 is the second state, that is, the display unit 22 is unfolded with respect to the camera body 21, and the posture of the image pickup element 2b is inverted in the vertical direction. When it is determined that there is, the process proceeds to step S110.

  In step S110, the control unit 10 causes the display panel 6 to display the acquired through image in the second display state.

  In step S111, the control unit 10 displays the icons on the display panel 6 in a reversed layout. In the reversed layout, for example, a parameter setting icon 6a and a skin check mode icon 6b are displayed in the same direction as the through image along with notification icons for various functions.

  In step S112, the control unit 10 determines whether or not the skin check mode icon 6b displayed on the display panel 6 is touched, that is, whether or not the skin check mode is selected. When it is determined that the skin check mode icon 6b displayed on the display panel 6 has not been touched, the process proceeds to step S113.

  In step S113, the control unit 10 sets the self-photographing mode. The setting of the self-photographing mode is a setting used when the user photographs the user himself / herself in the second display state. This setting is, for example, a setting in which the parameter setting is performed based on the operation of the icon 6a and the release operation is performed using the front surface SW 26.

  In step S114, the control unit 10 determines whether or not a press on the front surface SW 26 is detected, that is, whether or not a release operation is detected. When it is determined that the front surface SW 26 is not pressed, the process returns to step S101. When it is determined that a press on front SW 26 has been detected, the process proceeds to step S115.

  In step S115, the control unit 10 performs a shooting operation on the imaging unit 2, and causes the imaging device 2b to acquire image data. The acquired image is subjected to general image processing, and the processed image is recorded in the recording unit 5. Thereafter, the process returns to step S101.

  If it is determined in step S112 that the skin check mode icon 6b has been touched, the process proceeds to step S116.

  In step S116, the control unit 10 performs a skin check mode process. Thereafter, the process returns to step S101.

  The skin check mode process according to the present embodiment will be described. FIG. 7 is a flowchart showing the operation of the skin check mode process according to the present embodiment. In step S201, the control unit 10 performs display related to the skin check mode process. FIG. 8 is a diagram illustrating an example of display in the skin check mode process. As illustrated in FIG. 8, the control unit 10 displays the face guide frame 6 c on the through image displayed on the display panel 6. The face guide frame 6c is provided sufficiently large so as to indicate the most part of the display area, that is, the imaging area. The user adjusts the shooting area so that the face of the subject is aligned with the face guide frame 6c. In this way, the face guide frame 6c assists the user in photographing so that the face guide frame 6c and the face overlap. A detailed skin condition determination can be performed by photographing a face using most of the imaging area.

  In step S201, the control unit 10 displays the skin image sample 6e and the return icon 6d on the display panel 6, as shown in FIG. The skin image sample 6e is an image based on the skin image sample data recorded in the image DB 5a. In the present embodiment, the skin image sample 6e represents a skin condition similar to that of a baby. The return icon 6d is an icon for inputting an instruction to end the skin check mode process and return the process to camera control.

  In step S202, the control unit 10 detects a face from a through image based on a facial feature, for example, a feature such as an eye or a mouth.

  In step S203, the control unit 10 determines whether or not a face matching the size of the face guide frame 6c has been detected. When it is determined that a face that matches the size of the face guide frame 6c is detected, the process proceeds to step S205. When it is determined that a face matching the size of the face guide frame 6c has not been detected, the process proceeds to step S204.

  In step S204, the control unit 10 determines whether or not the return icon 6d has been touched. When it is determined that the return icon 6d has not been touched, the process returns to step S201. When it is determined that the return icon 6d has been touched, the skin check mode process ends.

  In step S205, the control unit 10 detects a face part. Here, the face parts to be detected are, for example, the forehead, the eyelids, the corners of the eyes, the nose, the nose wings, and the cheeks. The detected face parts are shown by broken lines in FIG. 8, forehead part 6ca, starboard part 6cba, port part 6cbb, right eye part 6cca, left eye part 6ccb, nose part 6cd, right nose wing part 6cea, left nose wing part 6ceb, right cheek part 6cfa, and left cheek part 6cfb are displayed on the display panel 6. In the present embodiment, it is assumed that all the face parts are detected from the face. By displaying the facial parts, the user can grasp the facial parts that are the analysis target.

  In steps S206 to S211, each detected face part is photographed while changing the focus position, and the skin condition is determined based on the obtained image. The focus position setting will be described. FIG. 9 is a diagram schematically showing a view of the face as the subject from the side and the position of the lens 2a, and is a diagram for explaining the depth of the face part. Each face part has a different depth, such as the depth of the forehead relative to the depth of the nose. When the focus position of the lens 2a matches a face part, the focus position may not match another face part. The imaging device 1 changes the focus position every time the face part is photographed in order to adjust the focus position to all the face parts. That is, for example, the imaging device 1 first sets the lens 2a so as to focus on the nose part 6cd, and then performs imaging, and then focuses on the forehead part 6ca, the right nose wing part 6cea, and the left nose wing part 6ceb. In this way, the lens 2a is set to shoot, and then the lens 2a is set so as to focus on the starboard part 6cba and port part 6cbb. Finally, the right eye corner part 6cca and left eye butt are shot. The lens 2a is set so as to focus on the part 6ccb, the right cheek part 6cfa, and the left cheek part 6cfb, and shooting is performed.

  In step S206, the control unit 10 adjusts the focus position so that one of the face parts detected by the face determination unit 10a has not yet been photographed and the skin state has been determined. Update settings.

  In step S207, the control unit 10 causes the focus changing unit 3 to change the focus position in accordance with the setting of the focus position.

  In step S208, the control unit 10 performs a shooting operation and causes the image sensor 2b to acquire image data. The image data obtained by this photographing operation is data of an image in which a certain face part is in focus.

  In step S209, the control unit 10 extracts a face part corresponding to the setting of the focus position from the image data acquired by the image sensor 2b. That is, for the face part in focus in the obtained image, the image of the part of the face part is extracted from the image.

  In step S210, the control unit 10 determines the skin state of the facial part based on the extracted image. That is, in this process, the extracted face part image is compared with the skin image of the sample data, and the skin state is determined. Here, the skin image sample data used for comparison represents a baby-like skin state displayed on the display panel 6 as the skin image sample 6e. This determination is made according to the degree of matching of the features of the extracted facial parts, for example, the color or contrast, and the features of the skin image sample data.

  In step S211, the control unit 10 determines whether or not the skin state determination has been completed for all the face parts detected by the face determination unit 10a. In step S211, when it is determined that the determination of the skin state has been completed for all the face parts, the process proceeds to step S212.

  In step S211, when it is determined that the face part determination for all the face parts is not completed, the process returns to step S206. That is, in the skin check mode process, the processes in step S206 and step S211 are repeated so that face part determination is performed on all face parts detected by the face determination unit 10a.

  In step S <b> 212, the control unit 10 displays the face part determination results for all face parts on the display panel 6.

  An example of the display of the determination result will be described. FIG. 10 shows an example of the display of the determination result of the skin condition of the facial part. In the present embodiment, in the determination of the skin condition, a characteristic display is performed on the face part determined to have a high degree of matching with the “baby-like” image sample data. For example, the right cheek part 6cfa shown in FIG. 10 is filled with a text display 6f “This is like a baby”. On the other hand, unfilled face parts are face parts that have been determined not to have a high degree of matching with a baby-like image sample, such as color or contrast. For example, a display of “good” may be superimposed on the face part that is “baby-like”.

  In step S213, the control unit 10 determines whether an operation corresponding to the end of the skin check mode process has been performed. That is, in this process, it is determined whether the return icon 6d has been touched or the photographed face Aa has changed. The change in the face Aa includes, for example, a change in which the face determination unit 10a does not detect a face that matches the size of the face guide frame 6c.

  When it is determined in step S213 that an operation corresponding to the end of the skin check mode process has not been performed, the process returns to step S212.

  If it is determined in step S213 that an operation corresponding to the end of the skin check mode process has been performed, the process proceeds to step S214. In step S214, the control unit 10 clears the display of the face guide frame 6c and the result of face part determination. Thereafter, the skin check mode process ends.

  As described above, the imaging apparatus 1 according to the present embodiment can sequentially acquire a plurality of images for analyzing the skin state of a facial part having a different depth by photographing with the focus position adjusted for each facial part. . The user can easily obtain the determination result of the skin condition performed based on the obtained plurality of images.

  In this embodiment, shooting is performed while changing the focus position while aiming at the face part of the subject. However, even if shooting is performed multiple times sequentially while changing the focal length from near to far, multiple analyzes are performed. Images can be acquired. If the operation of calculating the depth of each face part and adjusting the focus position is omitted, the processing related to camera control is reduced.

  Further, the analysis target is not limited to the skin state of the face Aa. When an object having a depth is imaged and analysis is performed based on the obtained image, an image for analysis can be easily acquired by using the technique according to the present embodiment. Thus, the imaging device 1 of the present embodiment is not limited to analyzing the skin condition of the face, but can be applied to other uses. That is, the imaging apparatus 1 can be applied to an observation apparatus and an inspection apparatus other than an imaging apparatus including a camera, and can also be applied to an application such as a smartphone. That is, in this imaging apparatus 1, the points of focus position change in the depth direction of the observation target and feature determination for each part of the target are important. Therefore, the image detection unit, the part detection unit of the image classified by image detection, the focus control unit that performs the optimum focus control for each part, and the good focus image obtained for each classified image part are determined. If there is a database of possible determination images, this is the scope of the present invention. Note that the image comparison is not limited to simple overlaying, but exposure, white balance, position, etc. can be adjusted in order to improve the accuracy of coincidence. The comparison result does not necessarily have to be an absolute value and may be a relative numerical value.

  Further, if the lens 2a is provided with a zoom lens, it is possible to acquire image data for analyzing a more microscopic area than the image data for analysis acquired in the present embodiment.

  Further, a multi-lens lens may be provided in the lens 2a to acquire image data for analysis having a different angle of view.

[Second Embodiment]
In the present embodiment, a screen for detecting a face and a screen for displaying the analysis result of the face are displayed in different areas of the display panel 6. In the description of the configuration and operation according to the present embodiment, the description of the same parts as those of the first embodiment is omitted.

  An operation of the imaging apparatus 1 according to the present embodiment will be described. FIG. 11 is a flowchart showing the operation of the skin check mode process according to the present embodiment. In step S301, the control unit 10 performs display related to the skin check mode process of the present embodiment. FIG. 12 shows an example of display according to the present embodiment. As illustrated in FIG. 12, the control unit 10 causes the display panel 6 to display a through image screen 6g and a skin condition determination screen 6h. For example, a face image of a through image is displayed on the determination screen 6h, and a determination result is superimposed on the face image. The face image displayed on the determination screen 6h may not be a through image, but may be a still image taken at any time. In step S <b> 301, the control unit 10 displays a return icon 6 d on the display panel 6. In addition, the control unit 10 displays the face guide frame 6c on the through image screen 6g.

  In step S <b> 302, the control unit 10 detects a face from a through image based on a facial feature, for example, a feature such as an eye or a mouth.

  In step S303, the control unit 10 determines whether or not a face matching the size of the face guide frame 6c has been detected. When it is determined that a face that matches the size of the face guide frame 6c is detected, the process proceeds to step S305. When it is determined that a face matching the size of the face guide frame 6c has not been detected, the process proceeds to step S304.

  In step S304, the control unit 10 determines whether or not the return icon 6d has been touched. When it is determined that the return icon 6d has not been touched, the process returns to step S301. When it is determined that the return icon 6d has been touched, the skin check mode process ends.

  In step S305, the face determination unit 10a of the control unit 10 detects a face part. In step S306, the control unit 10 updates the setting of the focus position so that one of the face parts detected by the face determination unit 10a has not been subjected to face part determination yet is in focus. In step S307, the control unit 10 causes the focus changing unit 3 to change the focus position according to the setting of the focus position.

  In step S308, the control unit 10 performs a shooting operation and causes the image sensor 2b to acquire image data. Image data in which a certain face part is focused is acquired by this photographing. In step S309, the control unit 10 extracts a part of the face part corresponding to the setting of the focus position from the image data acquired by the image sensor 2b. In step S310, the control unit 10 performs face part determination.

  In step S311, the face part image extracted by the pattern determination unit 10c is recorded in the recording unit 5. The image data of the extracted facial parts is referred to as skin enlarged image data.

  In step S312, the control unit 10 causes the display panel 6 to display an enlarged skin image 6i based on the enlarged skin image data, as shown in FIG. Note that the enlarged skin image 6i and the skin image sample may be displayed side by side.

  In step S313, the control unit 10 causes the determination screen 6h to display the determination result for the face part for which the determination of the skin condition has been completed. An example of a display in which the results of face part determination are combined will be described with reference to FIG. In the present embodiment, the face part on the determination screen 6h is painted out for the face part determined to have the skin condition of “Baby”. FIG. 12 shows that the port part 6cbb, the left eye corner part 6ccb, the left cheek part 6cfb, the left nose wing part 6ceb, the nose part 6cd, the right nose wing part 6cea and the right cheek part 6cfa are judged to be “baby-like” and are filled. It represents the state that is.

  In step S314, the control unit 10 determines whether or not the determination of the skin state has been completed for all detected face parts. When it is determined that the determination of the skin condition has not been completed for all the face parts, the process returns to step S306. That is, determination of the skin state regarding the face part is performed one after another in steps S306 to S313, and the determination results displayed on the determination screen 6h increase one after another. In step S314, when it is determined that the determination of the skin state has been completed for all the face parts, the process proceeds to step S315.

  In step S315, the control unit 10 stands by until an operation corresponding to the end of the skin check mode process is detected. That is, it waits until a touch on the return icon 6d or a change in the face Aa is detected. Thereafter, the process proceeds to step S316.

  When it is determined in step S316 that an operation corresponding to the end of the display of the face part determination result has been performed, the control unit 10 clears the display of the face guide frame 6c and the result of the face part determination. Thereafter, the skin check mode process ends.

  As described above, in the present embodiment, the through image screen 6g for detecting the face and the determination screen 6h for displaying the analysis result of the face are displayed in different areas. The user can perform each operation while visually recognizing the face part determination result. Also, the user can grasp the “baby-like” facial parts while watching the process of gradually painting the facial parts.

[Third Embodiment]
In the present embodiment, the position and size of the face guide frame 6c displayed on the display panel 6 can be changed. In the description of the configuration and operation according to the present embodiment, the description of the same parts as the configuration and operation of the first embodiment is omitted.

  An operation of the imaging apparatus 1 according to the present embodiment will be described. FIG. 13 is a flowchart showing the operation of the skin check mode process according to the present embodiment.

  In step S <b> 401, the control unit 10 displays the face guide frame 6 c on the through image displayed on the display panel 6.

  In step S402, the control unit 10 determines whether an operation for moving the position of the face guide frame 6c has been performed. If it is determined in step S402 that an operation for changing the size of the face part has not been performed, the process proceeds to step S404.

  When it is determined that an operation for changing the size of the face part has been performed, the control unit 10 changes the position and size of the face guide frame 6c based on the change in step S403. Thereafter, the process proceeds to step S404.

  The change of the face guide frame 6c will be described. FIG. 14 is a diagram illustrating an example of the movement operation of the face guide frame 6c. When detecting the touch operation or the slide operation by the user's hand Ab on the touch panel 4, the imaging apparatus 1 according to the present embodiment moves the position of the face guide frame 6 c according to the touch operation or the slide operation.

  In the present embodiment, the user can specify the position of the detection area where the face part is to be detected. FIG. 15 is a diagram illustrating an example of an operation for changing the position and size of the detection area of the face part. The imaging apparatus 1 can change the position of the area where the face part is to be detected in the face guide frame 6c, or can enlarge or reduce the size of the area, for example, by a slide operation by the user on the touch panel 4. .

  The change of the position or size of the face guide frame 6c and the face part may be configured to be performed by an operation of a cross key, a slide bar, a button, or the like.

  In step S404, the control unit 10 detects a face from the through image. In step S405, the control unit 10 determines whether a face matching the size of the face guide frame 6c has been detected. If it is determined in step S405 that no face that matches the size of the face guide frame 6c has been detected, the process proceeds to step S406. In step S406, the control unit 10 determines whether or not the return icon 6d has been touched. When it is determined in step S406 that the return icon 6d has not been touched, the process returns to step S401. If it is determined in step S406 that the return icon 6d has been touched, the skin check mode process ends. On the other hand, when it is determined in step S405 that a face matching the size of the face guide frame 6c has been detected, the process proceeds to step S407. In step S407, the face determination unit 10a of the control unit 10 detects a face part.

  In step S408, the control unit 10 updates the focus position setting so that one of the face parts detected by the face determination unit 10a is in focus. Thereafter, in step S409, the control unit 10 causes the focus changing unit 3 to change the focus position in accordance with the setting of the focus position.

  In step S410, the control unit 10 causes the imaging unit 2 to perform shooting. In step S411, the control unit 10 extracts a part of the face part corresponding to the focus position setting from the acquired image data. In step S412, the control unit 10 determines the skin condition of the extracted face part.

  In step S413, the control unit 10 determines whether the determination of the skin state of all the detected face parts has been completed. When it is determined in step S413 that the face part determination for all the face parts has not been completed, the process returns to step S408. Thereafter, the processes according to steps S408 to S413 are repeated for the face parts for which face part determination has not been completed. On the other hand, when it is determined in step S413 that the face part determination for all the face parts has been completed, the process proceeds to step S414.

  In step S414, the control unit 10 displays the face image and the result of face part determination for all the face parts on the display panel 6. In step S415, the control unit 10 determines whether the return icon 6d has been touched or whether the face Aa has changed. In step S415, when it is determined that the return icon 6d is not touched and when it is determined that the face Aa has not changed, the process returns to step S414. On the other hand, in step S415, when the return icon 6d is touched or when it is determined that the face Aa has changed, the process proceeds to step S416.

  In step S416, the control unit 10 clears the display of the face guide frame 6c and the result of face part determination. After step S416, the skin check mode process according to the present embodiment ends.

  As described above, the imaging apparatus 1 according to the present embodiment is characterized in that the position and size of the face guide frame 6 c displayed on the display panel 6 are changed by operating the touch panel 4. By this operation, the user can easily align the face guide frame 6c with the position of the user's face Aa, and the imaging device 1 can easily detect the face parts. Further, in the present embodiment, the area where the face part should be detected can be designated by the user. As a result, face parts can be detected accurately.

  Each process performed by the imaging apparatus 1 in the above-described embodiment may be stored as a program that can be executed. This program is stored in a storage medium of an external storage device such as a memory card (ROM card, RAM card, etc.), magnetic disk (floppy (registered trademark) disk, hard disk, etc.), optical disk (CD-ROM, DVD, etc.), semiconductor memory, etc. The above-described processing can be executed by reading the stored program and controlling the operation by the read program.

  DESCRIPTION OF SYMBOLS 1 ... Imaging device, 2 ... Imaging part, 2a ... Lens, 2b ... Imaging element, 3 ... Focus change part, 4 ... Touch-panel, 5 ... Recording part, 5a ... Image database, 6 ... Display panel, 6a ... Icon of parameter setting 6b ... Skin check mode icon, 6c, 6ga ... Face guide frame, 6ca ... Forehead part, 6cba ... Starboard part, 6cbb ... Port part, 6cca ... Right eye part, 6ccb ... Left eye part, 6cd ... Nose part 6ce ... right nose wing part, 6ceb ... left nose wing part, 6cfa ... right cheek part, 6cfb ... left cheek part, 6d ... back icon, 6e ... skin image sample, 6f ... text display, 6g ... through image screen, 6h ... judgment Screen, 6i ... Skin condition parts, 7 ... Operation part, 8 ... Posture detection part, 10 ... Control part, 10 ... Face determination unit, 10b ... Focus control unit, 10c ... Pattern determination unit, 10d ... Recording control unit, 10e ... Operation determination unit, 10f ... Display control unit, 10g ... Display direction determination unit, 21 ... Camera body, 22 ... Display Panel, 23 ... Release switch, 25 ... Hinge, 26 ... Front switch.

Claims (6)

Have a depth, and a lens for forming an optical image of a subject including a face,
An image sensor that generates image data for analysis based on the optical image formed on the light receiving surface;
A focus changing unit for changing the focus position of the lens;
A face determination unit that recognizes a face part from a face in the image data;
A control unit that causes the focus change unit to change the focus position in accordance with the face part, and causes the image sensor to sequentially generate the image data in focus for each of the face parts having different depths. When,
A pattern determination unit that compares the image data generated by the image sensor and skin image sample data for each facial part;
An imaging apparatus comprising: The imaging apparatus further includes a display unit that displays an image,
The imaging device according to claim 1 , wherein the display unit displays a result of comparison by the pattern determination unit and an enlarged image of the facial part created for each facial part. The imaging apparatus further includes a display unit that displays an image,
The image displayed on the display unit includes a through image area that displays the image data generated by the image sensor as a through image, and the face image captured using the image sensor by the pattern determination unit. The imaging apparatus according to claim 1 , further comprising: a determination result area that displays an image on which the comparison result is superimposed. A display unit that displays an image of the face imaged using the image sensor and a face guide frame indicating an index of the position of the face in the image;
An operation unit for detecting an operation, and
The face guide frame is moved or enlarged or reduced according to the operation detected by the operation unit,
The face determination unit recognizes the face part using the position and size of the face guide frame.
The imaging device according to claim 1 . And to have a depth, to change the focus position of the lens for forming an optical image of a subject including a face,
Based on the optical image formed on the light receiving surface of the image sensor, sequentially causing the image sensor to generate a plurality of image data for analysis;
Changing the focus position according to the face part recognized from the face in the image data;
Causing the imaging device to sequentially generate the image data in focus for each of the face parts having different depths;
Comparing the image data generated by the image sensor and skin image sample data for each facial part;
A method for controlling an imaging apparatus comprising: On the computer,
Steps have a depth, to change the focus position of the lens for forming an optical image of a subject including a face,
A procedure for causing the image sensor to sequentially generate a plurality of image data for analysis based on the optical image formed on the light receiving surface of the image sensor;
A procedure for changing the focus position according to the face part recognized from the face in the image data,
A step of causing the image sensor to generate the image data in focus for each of the face parts having a plurality of different depths sequentially;
A procedure for comparing the image data generated by the image sensor and skin image sample data for each facial part,
The control program of the imaging device for causing

Images