JP2014116789A - Photographing device, control method therefor, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To contribute to appropriate acquisition of information on a subject, and contribute to easy acquisition of an image and information desired by a user.SOLUTION: A photographing device comprises: a photographing unit; an identification unit that identifies one or two or more subjects included in a subject image acquired by the photographing unit; a distance estimation unit that estimates a subject distance to each subject; and a subject information estimation unit that estimates subject information on the basis of the subject distance.

Description

  The present invention relates to a photographing apparatus, a control method thereof, and a program.

  In recent years, users have used cameras for various purposes. For example, a user photographs a person, a landscape, a meal, etc. with a camera. Further, the user may take a document and use the camera as a substitute for the scanner. When a user shoots a predetermined subject with a camera, information desired by the user differs depending on the subject.

  Patent Document 1 discloses a technique for extracting shooting condition data at the time of shooting and extracting information about the subject from the shooting condition data.

JP 2005-108027 A

  The disclosure of the above prior art document is incorporated herein by reference. The following analysis has been made from the viewpoint of the present invention.

  As described above, the information desired by the user differs depending on the subject. For example, consider a case where the user wants to photograph a specific plant as a subject. In that case, it is preferable that the area of the main subject (such as a plant to be photographed) is photographed more clearly than the other subjects (background).

  Also, consider a case where the user wants to classify captured images for each plant. In that case, it is preferable to extract the region of the plant to be imaged. Therefore, when the user wants to classify the photographed image for each plant, the user needs to photograph so that the region of the plant to be photographed is extracted. Furthermore, the user needs to input information on the plant to be imaged.

  On the other hand, when taking a landscape photograph published in a magazine with a camera, the user may use the camera instead of a scanner. In that case, it is preferable that the entire landscape photograph to be photographed is photographed clearly.

  In the technique disclosed in Patent Document 1, the user is required to appropriately set shooting conditions such as a focal length. In other words, with the technique disclosed in Patent Document 1, the user cannot obtain information about the subject unless the shooting conditions are set appropriately.

  Accordingly, there is a demand for an imaging apparatus that contributes to appropriately acquiring information related to a subject and contributes to easily acquiring images and information desired by a user, and a control method and program thereof.

  According to the first aspect of the present invention, an imaging unit, an identification unit that identifies one or more subjects included in the subject image acquired by the imaging unit, and a subject distance to each subject are estimated. An imaging device is provided that includes a distance estimation unit and a subject information estimation unit that estimates subject information based on the subject distance.

According to a second aspect of the present invention, there is provided a control method for controlling a photographing apparatus including a photographing unit, the step of identifying one or more subjects included in a subject image, and the subject up to each subject. There is provided a control method for an imaging apparatus, including a distance estimation step for estimating a distance and a subject information estimation step for estimating subject information based on the subject distance.
Note that the present method is linked to a specific machine called an imaging apparatus including an imaging unit.

According to the third aspect of the present invention, a computer that controls a photographing device including a photographing unit performs processing for identifying one or more subjects included in a subject image, and estimates a subject distance to each subject. And a subject information estimating process for estimating subject information based on the subject distance are provided.
This program can be recorded on a computer-readable storage medium. The storage medium may be non-transient such as a semiconductor memory, a hard disk, a magnetic recording medium, an optical recording medium, or the like. The present invention can also be embodied as a computer program product.

  According to each aspect of the present invention, there is provided an imaging device, a control method, and a program that contribute to appropriately acquiring information related to a subject and that contribute to easily acquiring an image desired by a user and information. Is done.

It is a figure for demonstrating the outline | summary of one Embodiment. It is a top view which shows an example of the whole structure of the imaging device 1 which concerns on 1st Embodiment. It is a block diagram which shows an example of the internal structure of the imaging device 1 which concerns on 1st Embodiment. 4 is a flowchart illustrating an example of an operation of the photographing apparatus 1 according to the first embodiment. It is a figure which shows an example of the estimated distance. It is a figure which shows an example of the estimated distance. It is a figure which shows an example of the estimated distance. It is a block diagram which shows an example of the internal structure of the imaging device 1a which concerns on 2nd Embodiment. It is a figure which shows an example of the process which correct | amends inclination. It is a flowchart which shows an example of operation | movement of the imaging device 1a which concerns on 2nd Embodiment.

  First, an outline of an embodiment will be described with reference to FIG. Note that the reference numerals of the drawings attached to the outline are attached to the respective elements for convenience as an example for facilitating understanding, and the description of the outline is not intended to be any limitation.

  As described above, the information desired by the user differs depending on the subject. Therefore, an imaging apparatus that contributes to appropriately acquiring information related to the subject and that easily contributes to acquiring images and information desired by the user is desired.

  Therefore, an imaging apparatus 100 shown in FIG. 1 is provided as an example. The imaging apparatus 100 includes an imaging unit 101, an identification unit 102 that identifies one or more subjects included in the subject image acquired by the imaging unit, a distance estimation unit 103 that estimates a subject distance to each subject, A subject information estimation unit 104 that estimates subject information based on the subject distance.

  First, the imaging apparatus 100 identifies a subject included in the subject image. The imaging apparatus 100 may identify a plurality of subjects. Then, the photographing apparatus 100 estimates the subject distance of each subject. Here, the subject distance means a distance from the photographing apparatus 100 to the subject.

  Then, the image capturing apparatus 100 estimates subject information based on the subject distance. The subject information means information related to the subject. Therefore, the image capturing apparatus 100 does not require the user to input information regarding the subject. Therefore, the imaging device 100 contributes to appropriately acquiring information related to the subject, and contributes to easily acquiring images and information desired by the user.

  Hereinafter, specific embodiments will be described in more detail with reference to the drawings.

[First Embodiment]
The first embodiment will be described in more detail with reference to the drawings.

  FIG. 2 is a plan view illustrating an example of the overall configuration of the imaging apparatus 1 according to the present embodiment. FIG. 2A is a front view of the photographing apparatus 1. FIG. 2B is a rear view of the photographing apparatus 1. In the following description, the surface in the direction of the photographing unit 10 is the front surface. On the other hand, the surface facing the imaging unit 10 is the back surface.

  The photographing apparatus 1 includes a photographing unit 10, a display unit 20, and an operation unit 30. This is not intended to limit the photographing apparatus 1 to the form shown in FIG. For example, a mobile phone, a smartphone, a game machine, a tablet PC, a PDA (Personal Data Assistants: personal digital assistant), a digital camera, a digital video camera, and the like also correspond to the photographing apparatus 1 according to the present embodiment.

  The imaging unit 10 acquires an image of a subject.

  The display unit 20 displays an image or the like acquired by the imaging unit 10. The display unit 20 is preferably a liquid crystal panel, an organic EL (Electro Luminescence) panel, or the like.

  The operation unit 30 is an operation key or the like that receives a user operation on the photographing apparatus 1. The operation unit 30 includes a shutter button. The operation unit 30 may be a touch sensor. There are various types of touch sensor methods including a capacitance method, but any method can be used. Note that FIG. 2 is not intended to limit the position of the operation unit 30 to the back surface of the photographing apparatus 1. The operation unit 30 may be disposed on the front surface or the side surface of the photographing apparatus 1.

  The operation unit 30 may be a touch panel integrated with the display unit 20. Then, the photographing apparatus 1 may perform an operation on an icon or the like displayed on the display unit 20 as an operation on the operation unit 30. At that time, there are various types of touch panel configurations, input detection methods, etc., but the details are not limited.

  FIG. 3 is a diagram illustrating an example of the internal configuration of the photographing apparatus 1. The photographing apparatus 1 includes a photographing unit 10, a display unit 20, an operation unit 30, a storage unit 40, and a control unit 50. The control unit 50 includes an identification unit 51, a distance estimation unit 52, a subject information estimation unit 53, and a shooting condition determination unit 54. For the sake of simplicity, FIG. 3 mainly describes modules related to the imaging apparatus 1 according to the present embodiment. In addition, since the display part 20 and the operation part 30 are as above-mentioned, further description is abbreviate | omitted.

  The imaging unit 10 generates a subject image as described above. Specifically, the imaging unit 10 includes a lens (not shown) and an image sensor (not shown). First, the optical signal collected by the lens forms an image on the light receiving surface of the image sensor. The imaging device converts the received optical signal into an electrical signal (analog signal). And the imaging | photography part 10 produces | generates a to-be-photographed image based on the electrical signal which the image pick-up element converted. Note that when a shooting condition determination unit 54 described later determines shooting conditions, the shooting unit 10 generates a subject image based on the determined shooting conditions. In the following description, the image data generated by the imaging unit 10 is referred to as a subject image. In the following description, the subject image before the shutter button is pressed is referred to as a captured image. A subject image stored by pressing the shutter button is called a captured image.

  Furthermore, it is preferable that the imaging unit 10 can acquire information regarding the subject distance. For example, the photographing unit 10 may be a stereo camera in which two lenses are arranged horizontally. In the case of a stereo camera, the distance estimation unit 52 can estimate the distance from the imaging unit 10 to the subject based on the parallax between the two lenses.

  Alternatively, the photographing unit 10 may be a light field camera. The light field camera includes a plurality of small lenses arranged in an array between a main lens and an image sensor. The light field camera then records the light rays incident on the small lenses arranged on the array. That is, the light field camera can acquire a plurality of parallax images. Therefore, in the case of a light field camera, the distance estimation unit 52 can estimate the distance from the imaging unit 10 to the subject based on light rays incident on a plurality of small lenses.

  Alternatively, the photographing unit 10 may include a visible light camera and an infrared camera. The visible light camera captures images based on visible light. In addition, the infrared camera, for example, calculates the time until the infrared ray is irradiated and reflected back to the subject. The distance estimation unit 52 can estimate the distance from the photographing unit 10 to the subject based on the infrared rays incident on the infrared camera.

  Alternatively, the imaging unit 10 may include an image sensor that can receive visible light and infrared light. Specifically, the imaging unit 10 may include an imaging element in which a region where visible light is incident and a region where infrared light is incident are independently configured. In that case, the distance estimation unit 52 can estimate the distance from the imaging unit 10 to the subject based on the infrared rays incident on the imaging element. Although there are various configurations of the photographing unit 10, the details are not limited.

  The storage unit 40 stores information necessary for the operation of the photographing apparatus 1. For example, the storage unit 40 stores dictionary data for identification. The storage unit 40 preferably stores an image registered in advance as dictionary data. In addition, it is preferable that the memory | storage part 40 memorize | stores the dictionary data for every kind of object.

  The control unit 50 controls the entire photographing apparatus 1 and controls each unit shown in FIG. The control unit 50 can also be realized by a computer program that causes a computer mounted on the photographing apparatus 1 to execute processing of the photographing apparatus 1 using its hardware.

  The identification unit 51 identifies a subject included in the captured image acquired by the imaging unit 10. The identification unit 51 may identify one or more subjects included in the captured image. Specifically, it is preferable that the identification unit 51 identifies the subject on the basis of the collation result between the captured image and a predetermined image registered in advance.

  The identification unit 51 may remove a subject having a predetermined area or less from the identification target in the captured image. Furthermore, for example, when the identification unit 51 detects a plurality of types of subjects, the subject having the largest area may be a main subject (hereinafter referred to as a main subject).

  The distance estimation unit 52 estimates the subject distance to each subject. Here, the subject distance means the distance from the self-photographing device 1 to the subject. There are various methods for estimating the subject distance, but the details are not limited.

  For example, when the distance estimation unit 52 estimates the subject distance, a technique disclosed in Japanese Patent Application Laid-Open No. 2010-0779807 may be used. Specifically, the distance estimation unit 52 first estimates the distance of the position in the real space corresponding to each feature point in the subject area. Then, the distance estimation unit 52 calculates the number of feature points existing at each distance. That is, the distance estimation unit 52 associates the number of feature points with the estimated distance. Then, the distance estimation unit 52 may estimate the distance having the maximum number of feature points in the subject area as the subject distance of the subject. This is not intended to limit the method of estimating the subject distance.

  Furthermore, the distance estimation unit 52 preferably estimates the relative distance of the subject distance of each subject. For example, the distance estimation unit 52 preferably estimates the difference between the subject distance of the main subject and the subject distance of another subject as a relative distance. Here, the distance estimation unit 52 may estimate the difference between the subject distance of the main subject and the background distance as a relative distance. The distance estimation unit 52 may estimate a relative distance between two or more subjects.

  The subject information estimation unit 53 estimates subject information based on the subject distance. Specifically, it is preferable that the subject information estimation unit 53 estimates subject information based on at least either the subject distance or the relative distance. Here, the subject information means information including at least one of the number of dimensions of the subject, the subject area, and the type of subject.

  The shooting condition determination unit 54 determines shooting conditions based on the subject information. Specifically, it is preferable that the shooting condition determination unit 54 determines the shooting condition based on at least one of the estimated number of dimensions of the subject, the subject area, and the type of the subject. Here, the photographing condition preferably includes at least one of parameters of focal length, brightness, color tone, saturation, shutter speed, exposure, and white balance.

  When the distance estimation unit 52 estimates the relative distance between two or more subjects, the shooting condition determination unit 54 may determine the shooting condition based on the relative distance. In that case, the distance estimation unit 52 may estimate the number of dimensions of the subject based on the relative distance. Then, the shooting condition determination unit 54 may determine shooting conditions based on the estimated number of dimensions of the subject.

  For example, consider a case where the distance estimation unit 52 estimates the relative distance between two or more subjects. And when the relative distance between subjects exceeds a predetermined threshold, it is estimated that those subjects are arranged in different positions. That is, these subjects are considered to be three-dimensional objects. In that case, it is preferable that the shooting condition determination unit 54 determines the shooting conditions so that the subject region becomes a clear shot image. On the other hand, when the relative distance between the subjects is equal to or less than a predetermined threshold, those subjects may be pictures (two-dimensional objects) drawn on a plane. In that case, it is preferable that the imaging condition determination unit 54 determines the imaging condition so that the area including the subject (planar area) becomes a clear captured image.

  Next, the operation of the photographing apparatus 1 according to this embodiment will be described.

  FIG. 4 is a flowchart showing an example of the operation of the photographing apparatus 1 according to the present embodiment.

  In step S1, the imaging unit 10 generates a captured image. In step S2, the identification unit 51 extracts an image feature from the captured image. And it changes to step S3.

  Here, the image features include information such as edges and corners. Moreover, it is preferable that the identification part 51 extracts a different image feature according to the types of objects to be identified. Furthermore, when the type of an object to be identified is set in advance, the identifying unit 51 preferably extracts an image feature necessary for identifying the object.

  For example, when the person's face is set as an object to be identified, the identification unit 51 preferably extracts features such as a person's eyes and nose from the captured image as image features. Further, when the type of the object to be identified is not set, the identification unit 51 preferably extracts the image feature according to the type of the object included in the dictionary data. That is, the identification unit 51 may extract a plurality of types of image features from the captured image.

  In step S3, the identification unit 51 identifies the subject included in the captured image. Here, when a plurality of types of image features are extracted from the captured image, the identification unit 51 identifies a subject for each type of object. Needless to say, the identification unit 51 may perform processing such as size change and rotation of the captured image in accordance with the dictionary data when performing the collation processing. Furthermore, it goes without saying that the identification unit 51 may perform identification processing using a part of the extracted image features.

  In step S4, the distance estimation unit 52 estimates the subject distance. In step S5, the subject information estimation unit 53 estimates subject information based on the subject distance. In step S6, the shooting condition determining unit 54 determines shooting conditions based on the subject information.

  FIG. 5 is a diagram illustrating an example of an estimated distance for a two-dimensional object. FIG. 5A is a diagram illustrating an example of a positional relationship between the imaging device 1 and a subject. FIG.5 (b) is a figure which shows an example of the distance estimated in the case of Fig.5 (a). In FIG. 5B, points P221 and P222 indicate subject distances of the flowers 221 and 222, respectively. Specifically, the point P221 indicates the distance estimated by the distance estimation unit 52 as the distance from the imaging device 1 to the flower 221. A point P222 indicates the distance estimated by the distance estimation unit 52 as the distance from the imaging device 1 to the flower 222.

  Here, FIG. 5A is a diagram in which a plane 223 on which the flower 221 and the flower 222 are drawn is arranged in front of the photographing apparatus 1. Then, it is assumed that the difference between the distance indicated by the point P221 and the distance indicated by the point P222 shown in FIG. 5B is equal to or less than a predetermined threshold value. In that case, the imaging condition determination unit 54 estimates that the subject located at a distance on the extension line L1 connecting the point P221 and the point P222 is an object drawn on a plane. In the case of FIG. 5A, for example, the imaging condition determination unit 54 may determine the focal length as a distance corresponding to the straight line L1.

  FIG. 6 is a diagram illustrating an example of an estimated distance for a three-dimensional object. FIG. 6A is a diagram illustrating an example of a positional relationship between the imaging device 1 and a subject. FIG. 6B is a diagram illustrating an example of the distance estimated in the case of FIG. In FIG. 6B, points P231 and P232 indicate distances to the flowers 231 and 232, respectively. Specifically, the point P231 indicates the distance estimated by the distance estimation unit 52 as the distance from the imaging device 1 to the flower 231. A point P232 indicates the distance estimated by the distance estimation unit 52 as the distance from the imaging device 1 to the flower 232.

  Here, FIG. 6A is a diagram in which a flower 231 and a flower 232 are arranged in front of the photographing apparatus 1. The flower 232 is arranged behind the flower 231 toward the photographing apparatus 1. Therefore, as shown in FIG. 6B, the distance indicated by the point P231 is smaller than the distance indicated by the point P232. Therefore, the imaging condition determination unit 54 estimates the flower 231 and the flower 232 as a three-dimensional object. In the case of FIG. 6A, for example, the shooting condition determination unit 54 may determine shooting conditions such as brightness and focal length so that the flowers 231 or the flowers 232 are clear.

  FIG. 7 is a diagram illustrating an example of an estimated distance for a three-dimensional object and a two-dimensional object. FIG. 7A is a diagram illustrating an example of a positional relationship between the imaging device 1 and a subject. FIG.7 (b) is a figure which shows an example of the distance estimated in the case of Fig.7 (a). And in FIG.7 (b), the point P241 shows the distance to the flower 241. FIG. A straight line L2 indicates the distance to the plane 242.

  Here, FIG. 7A is a diagram in which a flower 241 is arranged in front of the photographing apparatus 1. A flat surface 242 is disposed behind the flower 241. Here, as shown in FIG. 7B, the point P241 is not on the straight line L2. Therefore, the imaging condition determination unit 54 estimates the flower 241 as a three-dimensional object. In the case of FIG. 7A, for example, the imaging condition determination unit 54 may determine the maximum focal length as the distance corresponding to the straight line L2.

  In step S7, the control unit 50 determines whether or not the shutter button has been pressed. When the shutter button is pressed (Yes branch in step S7), the photographing unit 10 photographs under the determined photographing condition (step S8). And the control part 50 preserve | saves a picked-up image (step S9). Specifically, the control unit 50 stores the captured image in the storage unit 40.

  On the other hand, when the shutter button is not pressed (No branch of step S7), the process returns to step S1 and the process is continued. The control unit 50 may display (preview display) the captured image on the display unit 20 until the shutter button is pressed.

[Modification 1]
As a first modification of the photographing apparatus 1 according to the first embodiment, the distance estimation unit 52 may estimate the subject distance based on the size of the subject in the captured image. Specifically, the storage unit 40 may store the size of the subject in the captured image in association with the distance from the photographing apparatus 1 to the subject. That is, the storage unit 40 may store a correspondence relationship between the size of the subject in the captured image and the distance from the photographing apparatus 1 to the subject as a table or a function for each type of subject.

  As described above, the photographing apparatus 1 according to the present embodiment identifies a subject from a captured image. Furthermore, the imaging device 1 according to the present embodiment estimates subject information based on the distance from the imaging device 1 to the subject. Therefore, the imaging device 1 according to the present embodiment contributes to appropriately acquiring information related to the subject, and contributes to easily acquiring images and information desired by the user.

[Second Embodiment]
Next, the second embodiment will be described in more detail with reference to the drawings.

  In the present embodiment, a captured image is processed. Specifically, in this embodiment, the captured image is processed into an image suitable for application input.

  FIG. 8 is a diagram illustrating an example of an internal configuration of the photographing apparatus 1a according to the present embodiment. 8, the same components as those in FIG. 3 are denoted by the same reference numerals, and the description thereof is omitted. The difference between the imaging device 1 and the imaging device 1a is that the control unit 50a includes an image processing unit 55.

  The image processing unit 55 processes the captured image. Specifically, it is preferable that the image processing unit 55 processes the captured image based on at least one of the shooting conditions, the subject distance, and the application.

  For example, consider a case where the control unit 50a inputs a captured image to an application that classifies objects (for example, plants) included in the captured image. In that case, it is preferable that the photographing condition determination unit 54 determines the photographing condition so that the plant as a subject becomes clear. And it is preferable that the image process part 55 extracts the area | region (area | region of the plant of classification | category object) of a target object. This is because if the image (background area or the like) other than the object is included, the classification accuracy of the object may be reduced in the application.

  Furthermore, the image processing unit 55 may change the brightness, saturation, and the like of the object area in accordance with the application. Further, the image processing unit 55 may perform image processing so that the resolution of the object region is improved according to the application. For example, the image processing unit 55 first extracts an object region. And the image process part 55 may produce | generate the enlarged image which raised the resolution between adjacent pixels based on the extracted image.

  Alternatively, the image processing unit 55 may correct, for example, the pixel value of the portion where the light is reflected in the region of the object based on the surrounding pixel values. Note that this is not intended to limit the processing performed by the image processing unit 55. The image processing unit 55 preferably performs various kinds of image processing according to the application.

  When the photographing unit 10 is a light field camera, the image processing unit 55 may change the focal position of the photographed image. This is because the light field camera includes a plurality of lenses having different focal points. Therefore, the light field camera can easily generate an image with the focal position changed.

  The image processing unit 55 may change the processing based on the subject information. For example, consider a case where the subject information estimation unit 53 estimates that the subject is a two-dimensional object based on the subject distance. In that case, the user may have used the photographing apparatus 1a instead of the scanner. Therefore, the image processing unit 55 may detect a plane including the subject. Then, the image processing unit 55 may generate an image in which the detected inclination of the plane is corrected and store the image in the storage unit 40.

  FIG. 9 is a diagram illustrating an example of processing for correcting inclination. In the case of FIG. 9A, a plane 303 on which a flower 301 and a flower 302 are drawn is arranged in front of the photographing apparatus 1a. In the case of FIG. 9A, the imaging condition determination unit 54 estimates that the flower 301 and the flower 302 are two-dimensional objects based on the relative distance between the flower 301 and the flower 302. In that case, the image processing unit 55 detects an area corresponding to the plane 303 from the captured image. Then, the image processing unit 55 may correct the inclination of the detected region and generate an image 313 shown in FIG.

  Next, the operation of the photographing apparatus 1a according to this embodiment will be described.

  FIG. 10 is a flowchart illustrating an example of processing for processing a captured image when the captured image is used as an input image of the application.

  In step S101, the image processing unit 55 determines whether or not the captured image is to be an input image of the application. When the captured image is used as the input image of the application (Yes branch in step S101), the process proceeds to step S102. When the captured image is not used as the input image of the application (No branch in step S101), the processing for processing the captured image is terminated.

  In step S102, the image processing unit 55 determines whether or not a predetermined object such as an object requested by the application is included in the captured image. When the application does not specify the target object, for example, the image processing unit 55 may determine whether or not there is a main subject exceeding a predetermined area in the captured image.

  When the predetermined object is included in the captured image (Yes branch in step S102), the process proceeds to step S103. When the predetermined object is not included in the photographed image (No branch in step S102), the processing for processing the photographed image is ended.

  In step S <b> 103, the image processing unit 55 extracts a region of the target object according to the application. In step S104, the image processing unit 55 processes the image in the region of the target object according to the application. In step S105, the control unit 50a converts the processed image into an input image of the application.

  As described above, in the photographing apparatus 1a according to the present embodiment, the photographed image is processed based on the application. That is, in the photographing apparatus 1a according to the present embodiment, the user does not need to process the photographed image according to the application. Therefore, the imaging device 1a according to the present embodiment further contributes to easily acquiring images and information desired by the user.

  In the above-described embodiment, the imaging apparatus has been described as executing an application. However, it goes without saying that a device different from the photographing device may execute the application. In that case, the imaging device may transmit the captured image (including the processed image) to a device that executes the application.

  A part or all of the above embodiments can be described as in the following supplementary notes, but is not limited thereto.

  (Additional remark 1) It is as the imaging device which concerns on a said 1st viewpoint.

  (Additional remark 2) The said distance estimation part is an imaging device of Additional remark 1 which estimates the relative distance of the said subject distance of each said subject.

  (Supplementary note 3) The photographing apparatus according to supplementary note 2, wherein the subject information estimation unit estimates the subject information based on at least either the subject distance or the relative distance.

  (Supplementary note 4) The photographing apparatus according to any one of supplementary notes 1 to 3, wherein the subject information includes at least one of a dimension number of a subject, a subject region, and a subject type.

  (Additional remark 5) The imaging device as described in any one of Additional remarks 1 thru | or 4 provided with the imaging condition determination part which determines an imaging condition based on the said to-be-photographed object information.

  (Supplementary note 6) The photographing apparatus according to any one of supplementary notes 1 to 5, further comprising an image processing unit that processes the subject image based on at least one of the subject information, the subject distance, and an application.

  (Supplementary note 7) The photographing apparatus according to any one of supplementary notes 1 to 6, wherein the distance estimation unit estimates the subject distance based on a size of the subject in the subject image.

  (Additional remark 8) It is as the control method of the imaging device concerning the said 2nd viewpoint.

  (Supplementary note 9) The method for controlling the photographing apparatus according to supplementary note 8, wherein in the distance estimation step, a relative distance of the subject distances of the subjects is estimated.

  (Supplementary note 10) The method of controlling the photographing apparatus according to supplementary note 9, wherein in the subject information estimation step, the subject information is estimated based on at least either the subject distance or the relative distance.

  (Additional remark 11) The control method of the imaging device as described in any one of additional remark 8 thru | or 10 including the process of determining imaging | photography condition based on the said to-be-photographed object information.

  (Supplementary note 12) The method for controlling the photographing apparatus according to any one of supplementary notes 8 to 11, including a step of processing the subject image based on at least one of the subject information, the subject distance, and an application.

  (Supplementary note 13) The method for controlling an imaging device according to any one of supplementary notes 8 to 12, wherein, in the distance estimation step, the subject distance is estimated based on a size of the subject in the subject image.

  (Additional remark 14) It is as the program which concerns on the said 3rd viewpoint.

  (Additional remark 15) The program of Additional remark 14 which estimates the relative distance of the said object distance of each said object in the said distance estimation process.

  (Supplementary note 16) The program according to supplementary note 15, wherein in the subject information estimation process, the subject information is estimated based on at least either the subject distance or the relative distance.

  (Additional remark 17) The program of Additional remarks 14 thru | or 16 which performs the process which determines imaging | photography conditions based on the said to-be-photographed object information.

  (Additional remark 18) The program as described in any one of additional remark 14 thru | or 17 which performs the process which processes the said to-be-photographed image based on at least any one of the said to-be-photographed object information, the to-be-photographed object distance, and an application.

  (Supplementary note 19) The program according to any one of claims 14 to 18, wherein in the distance estimation processing, the subject distance is estimated based on a size of the subject in the subject image.

  The disclosure of the cited patent document is incorporated herein by reference. Within the scope of the entire disclosure (including claims) of the present invention, the embodiments and examples can be changed and adjusted based on the basic technical concept. In addition, various combinations of various indication elements (including each element of each claim, each element of each embodiment or example, each element of each drawing, etc.) within the scope of the claims of the present invention, Selection is possible. That is, the present invention of course includes various variations and modifications that could be made by those skilled in the art according to the entire disclosure including the claims and the technical idea. In particular, with respect to the numerical ranges described in this document, any numerical value or small range included in the range should be construed as being specifically described even if there is no specific description.

DESCRIPTION OF SYMBOLS 1, 1a, 100 Image pick-up device 10, 101 Image pick-up part 20 Display part 30 Operation part 40 Storage part 50 Control part 51,102 Identification part 52,103 Distance estimation part 53,104 Subject information estimation part 54 Shooting condition determination part 55 Image processing Part 221, 222, 231, 232, 241, 301, 302 flower 223, 242, 303 plane 313 image

Claims (9)

A shooting section;
An identification unit for identifying one or more subjects included in the subject image acquired by the photographing unit;
A distance estimation unit for estimating a subject distance to each subject;
A subject information estimation unit for estimating subject information based on the subject distance;
An imaging apparatus comprising:   The imaging apparatus according to claim 1, wherein the distance estimation unit estimates a relative distance of the subject distances of the subjects.   The imaging device according to claim 2, wherein the subject information estimation unit estimates the subject information based at least on either the subject distance or the relative distance.   The imaging device according to any one of claims 1 to 3, wherein the subject information includes at least any one of a dimensionality of a subject, a subject region, and a subject type.   The imaging apparatus according to claim 1, further comprising an imaging condition determining unit that determines imaging conditions based on the subject information.   The imaging apparatus according to claim 1, further comprising an image processing unit that processes the subject image based on at least one of the subject information, the subject distance, and an application.   The imaging apparatus according to claim 1, wherein the distance estimation unit estimates the subject distance based on a size of the subject in the subject image. A control method for controlling a photographing apparatus including a photographing unit,
Identifying one or more subjects included in the subject image;
A distance estimation step of estimating a subject distance to each subject;
Subject information estimation step for estimating subject information based on the subject distance;
A control method for an imaging apparatus, comprising: In a computer that controls a photographing apparatus including a photographing unit,
A process of identifying one or more subjects included in the subject image;
A distance estimation process for estimating a subject distance to each subject;
Subject information estimation processing for estimating subject information based on the subject distance;
A program that executes

Images