JP6508259B2 - Imaging device and program - Google Patents

Description

The present invention is an imaging apparatus, and a program.

  An image processing apparatus is disclosed which extracts an area from a captured image based on a histogram of feature amounts of the image and identifies the extracted area (see Patent Document 1).

JP-A-4-10079

  However, the image processing apparatus disclosed in Patent Document 1 has a problem that it is not possible to extract an area in which a person pays attention from an input image, that is, an area of a main subject can not be appropriately extracted.

The present invention has been made in view of the above, and an object thereof is to provide a proper extraction can be that an imaging apparatus that, and a program area of the main subject from the input image.

The present invention has been made to solve the above-described problem, and is an imaging apparatus for performing an imaging operation for imaging a subject, which is included in an image extracted based on color information and luminance information. The setting unit includes: a setting unit configured to set one of the region and the second region as a specific region; and a control unit configured to control the imaging operation based on information included in the specific region. The imaging device is configured to set the first area as the specific area even when the luminance of the second area is higher than the luminance of the first area when the first area has specific color information. .

Further, the present invention is an imaging apparatus for performing an imaging operation for imaging a subject, which is one of a first area and a second area included in an image extracted by color information and inertia moment information. And a control unit configured to control the imaging operation based on information included in the specific area , wherein the setting unit is configured to set the first area to have red color information. When it has, even if it is a case where the moment of inertia of the 2nd field is smaller than the moment of inertia of the 1st field, it is an imaging device which sets up the 1st field as the specified field.

Further, the present invention is an imaging apparatus for performing an imaging operation for imaging a subject, which is one of a first area and a second area included in an image extracted by color information and inertia moment information. And a control unit that controls the imaging operation based on the information included in the specific area, and the setting unit is configured to set the color information of the first area to yellow. And when the second area has blue color information, the first area is set as the specific area even if the moment of inertia of the second area is smaller than the moment of inertia of the first area. It is an imaging device to set.

Further, the present invention is an imaging apparatus for performing an imaging operation for imaging a subject, which is one of a first area and a second area included in an image extracted by color information and saturation information. And a control unit that controls the imaging operation based on the information included in the specific area , the setting section may be configured to set the first area to specify specific color information. When it has, even if it is a case where the saturation of the 2nd field is higher than the saturation of the 1st field, it is an imaging device which sets up the 1st field as the specific field.

Further, the present invention is an imaging apparatus for performing an imaging operation for imaging a subject, which is one of a first area and a second area included in an image extracted by color information and distance information. A setting unit configured to set a region as a specific region; and a control unit configured to control the imaging operation based on information included in the specific region , the setting unit including the first region having red color information In this case, even if the distance from the field angle center position to the center of gravity position of the second area is shorter than the distance from the field angle center position to the center of gravity position of the first area, the first area It is an imaging device set as.

Further, the present invention is an imaging apparatus for performing an imaging operation for imaging a subject, which is one of a first area and a second area included in an image extracted by color information and distance information. A setting unit configured to set a region as a specific region; and a control unit configured to control the imaging operation based on information included in the specific region , wherein the setting unit is configured to set the first region to have yellow color information When the second area has blue color information, the distance from the angle of view center position to the center of gravity of the second area is greater than the distance from the angle of view center position to the center of gravity of the first area. The imaging device is configured to set the first area as the specific area even when Y is short.

Further, the present invention is an imaging apparatus for performing an imaging operation for imaging a subject, which is one of a first area and a second area included in an image extracted based on color information and area information. A setting unit configured to set a region as a specific region; and a control unit configured to control the imaging operation based on information included in the specific region , the setting unit including the first region having red color information In this case, the imaging device may set the first area as the specific area even if the area of the second area is larger than the area of the first area.

Further, the present invention is an imaging apparatus for performing an imaging operation for imaging a subject, which is one of a first area and a second area included in an image extracted based on color information and area information. A setting unit configured to set a region as a specific region; and a control unit configured to control the imaging operation based on information included in the specific region , wherein the setting unit is configured to set the first region to have yellow color information And, when the second area has blue color information, even if the area of the second area is larger than the area of the first area, the imaging is performed in which the first area is set as the specific area It is an apparatus .

Further, the present invention is a program for performing an imaging operation for imaging a subject, the computer including any one of a first area and a second area included in an image extracted by color information and luminance information. It is a procedure of setting one area as the specific area, and when the first area has specific color information, the second area may have higher luminance than that of the first area. It is a program for executing a procedure of setting one region as the specific region and a procedure of controlling the imaging operation based on information of the specific region .

Further, the present invention is a program for performing an imaging operation for imaging a subject, and in a computer, any one of a first area and a second area included in an image extracted by color information and inertia moment information. The step of setting one of the regions as the specific region, wherein the first region has red color information, and the moment of inertia of the second region is smaller than the moment of inertia of the first region; The program is also a program for executing the procedure of setting the first region as the specific region and the procedure of controlling the imaging operation based on the information of the specific region .

Further, the present invention is a program for performing an imaging operation for imaging a subject, and in a computer, any one of a first region and a second region included in an image extracted by color information and saturation information. The step of setting one of the regions as the specific region, in the case where the first region has specific color information, the saturation of the second region is higher than the saturation of the first region, The program is also a program for executing the procedure of setting the first region as the specific region and the procedure of controlling the imaging operation based on the information of the specific region .

Further, the present invention is a program for performing an imaging operation for imaging a subject, which is one of a first area and a second area included in an image extracted by color information and distance information in a computer. In the procedure of setting one of the regions as the specific region, when the first region has red color information, the distance from the angle of view center position to the center of gravity of the first region is greater than the distance from the angle of view center position. Even when the distance to the center of gravity of the second area is short, a procedure of setting the first area as the specific area, and a procedure of controlling the imaging operation based on information of the specific area, Is a program to execute.

Further, the present invention is a program for performing an imaging operation for imaging a subject, the computer including any one of a first area and a second area included in an image extracted by color information and area information. In the procedure of setting one of the regions as the specific region, when the first region has red color information, the second region may have a larger area than the area of the first region. It is a program for executing a procedure of setting one region as the specific region and a procedure of controlling the imaging operation based on information of the specific region .

Further, the present invention is a program for performing an imaging operation for imaging a subject, and in a computer , any one of a first area and a second area included in an image extracted by color information and inertia moment information. A step of setting one of the regions as the specific region, wherein the first region has yellow color information and the second region has blue color information, the moment of inertia of the first region And setting the first area as the specific area even if the moment of inertia of the second area is smaller than the second area, and controlling the imaging operation based on the information of the specific area. It is a program to make it run.

Further, the present invention is a program for performing an imaging operation for imaging a subject, which is one of a first area and a second area included in an image extracted by color information and distance information in a computer . In the procedure of setting one of the regions as the specific region, in the case where the first region has yellow color information and the second region has blue color information, and procedures for setting the first region even if the distance to the center of gravity position is short of the second region from the angle of view center position than the distance to the center of gravity of the area as the specific area, the specific area is It is a program for performing the procedure which controls the said imaging operation based on the information to have .

Further, the present invention is a program for performing an imaging operation for imaging a subject, the computer including any one of a first area and a second area included in an image extracted by color information and area information. It is a procedure of setting one area as a specific area, and in the case where the first area has yellow color information and the second area has blue color information, the area of the first area is larger than the area of the first area. In order to execute the procedure of setting the first region as the specific region and the procedure of controlling the imaging operation based on the information of the specific region even when the area of the second region is large Is a program of

  According to the present invention, the area extraction device can appropriately extract the area of the main subject from the input image.

It is a block diagram showing composition of a lens barrel, an imaging device provided with a field extraction device, and a storage medium in one embodiment of the present invention. FIG. 6 is a diagram illustrating an example of a region extracted from an image according to an embodiment of the present invention. FIG. 6 depicts an example of an area extracted from an image based on a modified threshold in an embodiment of the present invention. It is a figure showing the coordinate system of uniform color space. It is a flowchart showing the procedure of the process to focus on the area | region in one Embodiment of this invention. It is a flowchart showing the procedure of the process which sets a high priority to a reddish area | region in one Embodiment of this invention. It is a flowchart showing the procedure of the process which sets a high priority to a reddish area, a yellowish area, and a blueish area in one embodiment of the present invention. It is a flowchart showing the procedure of the process which determines a high priority in order of a reddish area, a yellowish area, and a blue system area in one embodiment of the present invention. It is a flowchart showing the procedure of the process which sets a high priority to a reddish area, a yellowish area, a blueish area, and a high-intensity area in one embodiment of the present invention. It is a flowchart showing the procedure of the process which sets low priority compared with the other extracted area | region in one Embodiment of this invention to a low-intensity area | region.

  An embodiment of the present invention will be described in detail with reference to the drawings. In FIG. 1, configurations of the imaging apparatus 100 including the lens barrel 111, the area extracting device 140, and the storage medium 200 are represented by a block diagram. The imaging device 100 captures an optical image incident from the lens barrel 111, and stores the obtained image in the storage medium 200 as a still image or a moving image.

First, the configuration of the lens barrel 111 will be described.
The lens barrel 111 includes a focus adjustment lens (hereinafter referred to as an “AF (Auto Focus) lens”) 112, a lens drive unit 116, an AF encoder 117, and a lens barrel control unit 118. The lens barrel 111 may be detachably connected to the imaging device 100 or may be integral with the imaging device 100.

  The AF lens 112 is driven by the lens driving unit 116, and guides an optical image to a light receiving surface (photoelectric conversion surface) of the image sensor 119 of the imaging unit 110 described later.

  The AF encoder 117 detects the movement of the AF lens 112, and outputs a signal corresponding to the movement amount of the AF lens 112 to the lens barrel control unit 118. Here, the signal corresponding to the movement amount of the AF lens 112 may be, for example, a sine wave signal whose phase changes according to the movement amount of the AF lens 112.

  The lens barrel control unit 118 controls the lens drive unit 116 in accordance with a drive control signal input from the CPU 190 of the imaging device 100. Here, the drive control signal is a control signal for driving the AF lens 112 in the optical axis direction. The lens barrel control unit 118 changes, for example, the number of steps of the pulse voltage output to the lens driving unit 116 according to the drive control signal.

  Further, the lens barrel control unit 118 outputs the position (focus position) of the AF lens 112 in the lens barrel 111 to the CPU 190 based on a signal according to the movement amount of the AF lens 112. Here, the lens barrel control unit 118 integrates the signal according to the movement amount of the AF lens 112 according to the movement direction of the AF lens 112, for example, thereby moving the AF lens 112 in the lens barrel 111 ( The position) may be calculated.

  The lens drive unit 116 drives the AF lens 112 according to the control of the lens barrel control unit 118 to move the AF lens 112 in the optical axis direction in the lens barrel 111.

Next, the configuration of the imaging device 100 will be described.
The imaging device 100 includes an imaging unit 110, an area extraction device 140, a display unit 150, a buffer memory unit 130, an operation unit 180, a storage unit 160, a CPU 190, and a communication unit 170.

  The imaging unit 110 includes an imaging element 119 and an A / D (Analog / Digital) conversion unit 120. The imaging unit 110 is controlled by the CPU 190 according to the set imaging conditions (for example, the aperture value, the exposure value, etc.).

  The imaging element 119 has a photoelectric conversion surface, converts an optical image formed on the photoelectric conversion surface by the lens barrel 111 (optical system) into an electric signal, and outputs the electric signal to the A / D conversion unit 120. The imaging device 119 may be configured by, for example, a complementary metal oxide semiconductor (CMOS). In addition, the imaging element 119 may convert an optical image into an electrical signal in a partial region of the photoelectric conversion surface (image cutout).

  In addition, the imaging element 119 causes the A / D conversion unit 120 to store an image obtained when the imaging instruction from the user is received via the operation unit 180 in the storage medium 200. On the other hand, in a state where the imaging element 119 does not receive a photographing instruction from the user via the operation unit 180, A / D conversion is performed on the buffer memory unit 130 and the display unit 150 by using continuously obtained images as through images. Output via the unit 120.

  The A / D conversion unit 120 digitizes the electrical signal converted by the imaging device 119 and outputs an image that is a digital signal to the buffer memory unit 130.

  The operation unit 180 includes, for example, a power switch, a shutter button, a multi-selector (cross key), or other operation keys, and receives an operation input of the user by being operated by the user, and a signal corresponding to the received operation input Are output to the CPU 190.

  The region extraction device 140 performs image processing on the image stored in the buffer memory unit 130 based on the image processing condition stored in the storage unit 160. The image subjected to the image processing is stored in the storage medium 200 via the communication unit 170.

  In addition, the area extraction device 140 extracts an area from the image stored in the buffer memory unit 130 based on the image feature amount, and determines the priority in the extracted area. In addition, the region extraction device 140 causes the storage unit 160 to store information indicating the extracted region. Here, the information indicating the area is, for example, information indicating the distribution of the area, information indicating the image feature amount of the area, and information indicating the priority defined for the area.

  The display unit 150 displays an image obtained by the imaging unit 110, an operation screen, and the like. The display unit 150 is, for example, a liquid crystal display.

  The buffer memory unit 130 stores the image captured by the imaging unit 110.

  The storage unit 160 stores a determination condition referred to by the CPU 190 at the time of scene determination, an imaging condition associated with each scene determined by the scene determination, information indicating an area, and the like.

  The CPU 190 controls the imaging unit 110 in accordance with the set imaging conditions (for example, the aperture value and the exposure value). Further, the CPU 190 acquires information indicating an area from the area extraction device 140. Further, the CPU 190 outputs a drive control signal to the lens barrel control unit 118 of the lens barrel 111 based on the information indicating the region, thereby setting the priority set by the region extraction device 140 among the regions extracted from the image. Adjust the focus to focus on the high area. Thus, an image including an area with high priority is captured by the imaging unit 110 in a state in which the optical system focuses on the area with high priority.

  The CPU 190 sets focus adjustment (AF), exposure adjustment (AE), white balance adjustment (AWB), and a subject image as pre-processing or post-processing of image processing based on information indicating a region. Settings for tracking (objects), settings for determining whether or not a night scene, settings for color correction processing, settings for enlarged display of an object image, settings for panning display, settings for optimization of brightness linked to zoom magnification, etc. Control.

  Further, the CPU 190 controls setting of a tone curve (gradation curve), setting of whether or not to perform simultaneous shooting of a still image and a moving image, and the like based on information indicating an area.

  Further, the CPU 190 sets whether or not to continuously shoot as pre-processing or post-processing based on the information indicating the area, and setting of switching of an object image to be focused in continuous shooting, and continuous change of the focal length Setting of the light emission unit (not shown) of the imaging apparatus 100, the setting of the change of the exposure amount, the setting of whether or not to change the shutter speed, and the like are controlled.

  Further, based on the “signal according to the operation input” input from the operation unit 180, the CPU 190 causes the region extraction device 140 to process an image in the still image format or the moving image format.

  The communication unit 170 is connected to a removable storage medium 200 such as a card memory, and writes, reads, or erases information (image data, information indicating an area, etc.) to the storage medium 200.

  The storage medium 200 is a storage unit detachably connected to the imaging apparatus 100, and stores information (image data, information indicating a region, and the like). The storage medium 200 may be integral with the imaging device 100.

Next, details of the region extraction device 140 will be described.
The area extraction device 140 includes a feature amount calculation unit 141, an area extraction unit 142, and a priority setting unit 143.

  The feature amount calculation unit 141 acquires an image captured by the imaging unit 110 from the buffer memory unit 130. In addition, the feature amount calculation unit 141 calculates an image feature amount for each of a plurality of features (for example, color information, saturation information, brightness (lightness) information, texture, edge) in the image acquired from the buffer memory unit 130. Then, the calculated image feature amount is output to the region extraction unit 142.

  The region extraction unit 142 acquires the image feature amount calculated by the feature amount calculation unit 141. In addition, the region extraction unit 142 acquires an image captured by the imaging unit 110 from the buffer memory unit 130. The area extraction unit 142 extracts an area from the image captured by the imaging unit 110 based on image feature amounts (for example, color information, saturation information, and luminance information). Here, the area extracted by the area extraction unit 142 is the area of the subject included in the image acquired from the buffer memory unit 130.

  In addition, the area extraction unit 142 extracts an area from an image binarized outside the fixed area and the predetermined area defined as the image feature amount (hereinafter referred to as “binary image”), and extracts the extracted area. Assign a label (labeling). Here, the predetermined range is determined by dividing the image feature amount by the upper limit and the lower limit of the predetermined threshold. Also, the threshold may be defined as, for example, “average value + coefficient × standard deviation” based on the average value (Ave) and the standard deviation (σ) of the image feature amounts in the image.

  FIG. 2 shows an example of the area extracted from the image. The region extraction unit 142 extracts an image based on luminance (hereinafter, referred to as “Y image”) from the image captured by the imaging unit 110. The region extraction unit 142 corrects (for example, gamma correction) the luminance (input value) of the image captured by the imaging unit 110, and calculates the corrected luminance (output value).

  The area extraction unit 142 divides the corrected luminance (output value) into a plurality of ranges. In FIG. 2, it is assumed that the corrected luminance is divided into divisions 1 to 4 as an example. The area extraction unit 142 generates a binary image for each section. Thereby, when the range upper limit of category 1 is “average value + K1 × standard deviation” and the range lower limit of category 1 is “average value + K2 × standard deviation”, the binary image of category 1 has a high brightness area. Is included.

  The region extraction unit 142 extracts the high brightness region 300 as a binary image (region image) representing the search result by searching for the distribution of the high brightness regions included in the binary image of Section 1. Similarly, the region extraction unit 142 extracts the middle luminance region 310 in the region image by searching for the middle luminance region included in the binary image of Section 2. In addition, the region extraction unit 142 extracts the low-luminance region 320 in the region image by searching for the low-luminance region included in the binary image of the segment 4.

  Similarly, the region extraction unit 142 divides the corrected color information Cr into a plurality of ranges. In FIG. 2, it is assumed that the corrected color information Cr is divided into divisions 5 to 8 as an example. The area extraction unit 142 generates a binary image for each section. Thereby, when the range upper limit of Category 5 is “average value + K3 × standard deviation” and the range lower limit of Category 5 is “average value + K4 × standard deviation”, the binary image of Category 5 is a reddish region Is included.

  The region extraction unit 142 extracts the reddish region 400 in the region image by searching for the distribution of the reddish region included in the binary image of the division 5. Similarly, the region extraction unit 142 extracts the pink region 410 in the region image by searching for a pink region included in the binary image of the segment 6. In addition, the region extraction unit 142 extracts the green region 420 in the region image by searching for the green region included in the binary image of the segment 8.

  Similarly, the region extraction unit 142 divides the corrected color information Cb into a plurality of ranges. In FIG. 2, it is assumed that the corrected color information Cb is divided into divisions 9 to 12 as an example. The area extraction unit 142 generates a binary image for each section. Thereby, when the range upper limit of division 9 is “average value + K5 × standard deviation” and the range lower limit of division 9 is “average value + K6 × standard deviation”, the binary image of division 9 has a blue-based area Is included.

  The region extraction unit 142 extracts the blue region 500 in the region image by searching for the distribution of the blue region included in the binary image of the segment 9. Similarly, the region extraction unit 142 extracts the water color region 510 in the region image by searching the water color region included in the binary image of the division 10. In addition, the region extraction unit 142 extracts the yellow region 520 in the region image by searching for the yellow region included in the binary image of the segment 12.

  In addition, for the luminance area, a lowest luminance area with lower luminance may be extracted. Here, the area extraction unit 142 changes the threshold to a lower value, and extracts an area having a luminance lower than the changed threshold. In this way, the region extraction unit 142 can extract, for example, the lowest luminance region in which a black subject is imaged, not the low luminance region 320 in which the region in which a shadow is imaged is included. .

  FIG. 3 shows an example of a region extracted from the image based on the changed threshold. In FIG. 3, it is assumed that the threshold for delimiting the division 3 and the division 4 is changed to a lower value. As a result, the area in which the shadow is imaged is excluded from the low luminance area 320, and the lowest luminance area 321 in which only the black subject is imaged is extracted as the area image.

  Returning to FIG. 1, the description of the configuration of the region extraction device 140 will be continued. The priority setting unit 143 determines, in the area extracted by the area extraction unit 142, the priority indicating the area that a person may be paying more attention to. The priority setting unit 143 determines the priority of the area according to the evaluation value calculated for each area.

  For example, the priority setting unit 143 determines an evaluation value for each area according to the distance from the center of the angle of view to the center of gravity of the area. Here, the priority setting unit 143 determines a higher evaluation value in the area distributed closer to the center of the angle of view. Also, for example, the priority setting unit 143 determines the evaluation value in the area according to the inertia moment of the area. The priority setting unit 143 sets a high evaluation value in a region where the moment of inertia is small (concentrated at the center of gravity). Also, for example, the priority setting unit 143 determines an evaluation value in the area according to the area (the number of pixels) of the area. The priority setting unit 143 determines a higher evaluation value for the area closer to the predetermined area.

  In addition, the priority setting unit 143 determines the priority of the area extracted by the area extraction unit 142 in accordance with the predetermined hue. Here, the priority setting unit 143 determines the priority in the area extracted by the area extraction unit 142 according to the hue angle in the uniform color space (L * a * b * color system).

  FIG. 4 shows a coordinate system of uniform color space. L * is the lightness index. Further, a * and b * are chromaticity indexes (chromaticness indexes). Here, the positive direction of a * represents red, and the negative direction of a * represents green. On the other hand, the positive direction of b * represents yellow, and the negative direction of b * represents blue. Moreover, h (= tan-1 (b * / a *)) is a hue angle (metric hue angle). Further, C * (= √ ((a *) 2 + (b *) 2)) is saturation. Further, R (= √ ((L *) 2 + (a *) 2 + (b *) 2))) is a distance (color difference) from the origin.

  The priority setting unit 143 sets the extracted regions of red (the red-based region 400 in FIG. 2), yellow (the yellow-based region 520 in FIG. 2) and blue (the blue-based region 500 in FIG. 2) Determine high priority compared to the extracted area of the color of. Here, the priority setting unit 143 may determine, in each of the extracted regions, a high priority in the order of the red extracted region, the yellow extracted region, and the blue extracted region.

  In addition, the priority setting unit 143 determines the priority of the area extracted by the area extraction unit 142 according to the saturation (C *). For example, the priority setting unit 143 sets high priority to the extracted area having high saturation.

  In addition, the priority setting unit 143 sets the priority in the area extracted based on the luminance (Y) by the area extraction unit 142 in accordance with the lightness (L *) according to the luminance. For example, the priority setting unit 143 sets high priority to the extracted area having high lightness.

  In addition, the priority setting unit 143 sets another extracted area in the extracted area of the luminance higher than the predetermined first threshold (in FIG. 2, the threshold that is the boundary between the division 1 and the division 2). We set high priority in comparison with. In addition, the priority setting unit 143 sets the red extracted area (red area 400 in FIG. 2), the yellow extracted area (yellow area 520 in FIG. 2), and the luminance higher than the first threshold. A high priority is determined in each extracted region in the order of the extracted region (high brightness region 300 in FIG. 2) and the blue extracted region (blue region 500 in FIG. 2).

  In addition, the priority setting unit 143 outputs an area (a minimum brightness area in FIG. 2) in which the brightness is lower than a predetermined second threshold (a threshold at the boundary between the sections 3 and 4 in FIG. 2). At 320), a lower priority is defined compared to other extracted regions.

  In addition, the priority setting unit 143 compares the extracted region having a luminance lower than the second threshold value changed by the region extracting unit 142 (the low luminance region 320 in FIG. 3) with other extracted regions. Low priority.

  Further, the priority setting unit 143 sets the priority in the extracted area according to the distance R (see FIG. 4) from the origin in the coordinate system of the uniform color space. For example, in the coordinate system of the uniform color space, the priority setting unit 143 sets high priority to the extracted region located at a position where the distance (color difference) from the origin is long.

  The priority setting unit 143 causes the storage unit 160 to store the priority determined for each area as information indicating the area.

Next, the procedure of processing of the region extraction device will be described.
FIG. 5 is a flowchart showing a procedure of processing until focusing on an area. The feature amount calculation unit 141 takes in the captured image (through image or through image sequence) from the buffer memory unit 130 (step S1), and performs basic image processing on the taken image (step S1) S2).

  The region extraction unit 142 reads the captured image for each image feature (for example, YCrCb) via the buffer memory unit 130 (step S3). The region extraction unit 142 creates a binarized image based on a plurality of image feature amounts in the read image (step S4). In addition, the area extraction unit 142 extracts an area from the binarized image, and assigns a label to the extracted area (step S5).

  If there are areas in the image that are estimated to be noise, the area extraction unit 142 removes those areas from the image. In addition, when the region presumed to be the background is present in the image, the region extraction unit 142 removes the region from the image (step S6).

  The priority setting unit 143 sets priorities in the area extracted by the area extraction unit 142 (step S7). Further, the area extraction unit 142 shapes the area whose priority is determined by the priority setting unit 143 into a rectangle so as to fit the AF evaluation area (step S8). The CPU 190 executes contrast scan (focus adjustment processing) based on the contrast value of the AF evaluation area (step S9). Further, the CPU 190 gives priority to an area in which an object in close proximity is imaged based on the result of the contrast scan, and brings the area into focus (step S10).

Next, the procedure of the process (see step S7 in FIG. 5) in which the region extraction device determines the priority will be described.
<On the case of setting high priority in the red region>
FIG. 6 is a flowchart showing the procedure of processing for setting high priority in the reddish region. Here, up to three predetermined areas are selected as an example. The priority setting unit 143 determines whether a red-based area exists in the area (see FIG. 2) extracted based on the binary image (step Sa1).

  If there is no reddish area (step Sa1-NO), the priority setting unit 143 selects areas other than the reddish area in descending order of evaluation value (step Sa2). Then, the priority setting unit 143 registers the reddish area (if present) and the selected area in the storage unit 160 (see FIG. 1) as the area of the subject (step Sa3). On the other hand, if there is a red-based area in step Sa1 (step Sa1-YES), the priority setting unit 143 sets the priority of the red-based area to priority 1, and advances the process to step Sa2.

  Thus, in the example shown in FIG. 2, the reddish area 400 is defined as the area of the main subject of priority 1. Further, among the areas other than the reddish area 400, the area having the first evaluation value is defined as the area of the main subject with priority 2. Further, among the areas other than the reddish area 400, the area having the second evaluation value is defined as the area of the main subject of priority 3.

Regarding the case where high priority is set for the reddish region, the yellowish region and the blueish region>
FIG. 7 is a flowchart showing a procedure of processing for setting high priority in the reddish region, the yellowish region and the blueish region. Here, up to three predetermined areas are selected as an example. The priority setting unit 143 determines whether a red-based area, a yellow-based area or a blue-based area is present in the area (see FIG. 2) extracted based on the binary image (step Sb1).

  When there is neither a reddish region, a yellowish region nor a blueish region (step Sb1-NO), and the total number of the reddish region, the yellowish region and the blueish region is less than 3, priority is set The part 143 selects the remaining areas in the descending order of evaluation value, and determines the high priority in the selected area in the order of evaluation value (step Sb2). Then, the priority setting unit 143 registers all the selected areas in the storage unit 160 (see FIG. 1) as the areas of the subject (step Sb3).

  On the other hand, if there is a reddish region, a yellowish region, or a blueish region in step Sb1 (step Sb1-YES), the priority setting unit 143 selects these regions in descending order of evaluation value and selects the region The highest priority is determined in the order of evaluation value, and the process proceeds to step Sb2 (step Sb4). The same priority may be set for the reddish region, the yellowish region, and the bluish region.

  Thereby, in the example shown in FIG. 2, the area having the highest evaluation value among the reddish area 400, the yellowish area 520, and the bluish area 500, for example, the yellowish area 520 is a main subject of priority 1 It is defined as an area. Further, among the red-based area 400, the yellow-based area 520, and the blue-based area 500, an area having the second highest evaluation value, for example, the red-based area 400, is defined as the area of the main subject of priority 2. Further, among the red-based area 400, the yellow-based area 520, and the blue-based area 500, an area having the third highest evaluation value, for example, the blue-based area 500 is defined as the area of the main subject of priority 3. Note that, for example, when there is no blue-based area 500, the area with the highest evaluation value may be defined as the area of the main subject with priority 3.

Regarding the case where high priority is determined in the order of reddish region, yellowish region, and blueish region>
FIG. 8 is a flowchart showing a procedure of processing for setting high priority in the order of the reddish area, the yellowish area, and the bluish area. Here, up to three predetermined areas are selected as an example. The priority setting unit 143 determines whether a red-based area exists in the area (see FIG. 2) extracted based on the binary image (step Sc1).

  If there is no reddish area (step Sc1-NO), the priority setting unit 143 determines whether a yellowish area exists in the area extracted based on the binary image (step Sc2). If there is no yellowish area (step Sc2-NO), the priority setting unit 143 determines whether there is a blue area in the area extracted based on the binary image (step Sc3).

  If there is no bluish region (step Sc3-NO), and if the total number of the reddish region, the yellowish region, and the bluish region is less than three, the priority setting unit 143 evaluates the remaining regions as evaluation values. The highest priority is selected in the order of evaluation value in the selected area (step Sc4). Then, the priority setting unit 143 registers all the selected regions in the storage unit 160 (see FIG. 1) as the regions of the subject (step Sc5).

  On the other hand, if there is a red-based area in step Sc1 (step Sc1-YES), the priority setting unit 143 sets priority 1 in the red-based area, and proceeds to step Sc2 (step Sb6). In step Sc2, if there is a red-based area (step Sc1-YES), the priority setting unit 143 sets priority 1 in the red-based area, and proceeds to step Sc2 (step Sb6).

  In step Sc2, if there is a yellowish area (step Sc2-YES), the priority setting unit 143 sets priority 1 or 2 in the yellowish area, and advances the process to step Sc3 (step Sb7). In step Sc3, when there is a blue-based area (step Sc3-YES), the priority setting unit 143 determines the priority 1, 2 or 3 in the blue-based area, and advances the process to step Sc4 (step Sb8). ).

  Thus, in the example shown in FIG. 2, the reddish area 400 is defined as the area of the main subject of priority 1. Also, the yellowish area 520 is defined as an area of the main subject of priority 2. In addition, the blue area 500 is defined as the area of the main subject of priority 3.

<About the case where high priority is determined in the reddish region, the yellowish region, the blueish region, and the high luminance region>
FIG. 9 is a flowchart showing a procedure of processing for setting high priority in a reddish region, a yellowish region, a blueish region, and a high luminance region. Here, up to three predetermined areas are selected as an example. The priority setting unit 143 determines whether a red-based area, a yellow-based area or a blue-based area is present in the area (see FIG. 2) extracted based on the binary image (step Sd1).

  When there is neither a reddish region, a yellowish region, a blueish region nor a high luminance region (step Sd1-NO), the total number of the reddish region, the yellowish region, the blueish region and the high luminance region is less than 3 If yes, the priority setting unit 143 selects the remaining areas in the descending order of the evaluation value, and determines the high priorities in the selected area in the order of the evaluation value (step Sd2). Then, the priority setting unit 143 registers all the selected areas in the storage unit 160 (see FIG. 1) as the areas of the subject (step Sd3).

  On the other hand, when there is a reddish region, a yellowish region, a blueish region, or a high luminance region in step Sd1 (step Sd1-YES), the priority setting unit 143 selects these regions in descending order of evaluation value. The high priority is determined in the order of evaluation value in the selected area, and the process proceeds to step Sd2 (step Sd4). The same priority may be set for the reddish region, the yellowish region, the blueish region, and the high luminance region.

  Thereby, in the example shown in FIG. 2, among the red-based area 400, the yellow-based area 520, the blue-based area 500, and the high luminance area 300, the area having the highest evaluation value, for example, the red-based area 400 has priority. It is defined as the area of one main subject. Also, among the red-based area 400, the yellow-based area 520, the blue-based area 500, and the high-brightness area 300, the area having the second highest evaluation value, for example, the yellow-based area 520, is defined as the area of the main subject of priority 2. Be Also, among the red-based area 400, the yellow-based area 520, the blue-based area 500, and the high-brightness area 300, an area having the third highest evaluation value, for example, the high-brightness area 300 Be

<About the case where low priority is determined in the low luminance region compared to other extracted regions>
FIG. 10 is a flowchart showing a procedure of processing for setting a low priority in a low luminance region as compared to other extracted regions. Here, up to three predetermined areas are selected as an example. The priority setting unit 143 selects areas other than the low luminance area in the descending order of the evaluation value, and determines the high priority in the evaluation value order in the selected area (step Se1).

  In addition, when the total number of areas other than the low luminance area is less than 3, the priority setting unit 143 selects the remaining areas in descending order of evaluation value, and determines high priorities in the selected area in the order of evaluation value Step Se2). Further, the priority setting unit 143 registers all the selected areas as the areas of the subject in the storage unit 160 (see FIG. 1) (step Se3).

  Thereby, in the example shown in FIG. 2, the lowest luminance area 320 in which a black subject is captured that is not the low luminance area included in the division 3 is the area of the subject when no other area is extracted from the image. Are registered in the storage unit 160 as

As described above, the region extraction device 140 extracts the predetermined region from the image based on the color information included in the image data of the input image, and the region extraction unit 142 extracts the predetermined region. And a priority setting unit 143 for setting the priority according to predetermined color information in the area.
With this configuration, the region extraction device 140 determines the priority of the region extracted from the image according to the predetermined color information. Thus, the region extraction device can appropriately extract the region of the main subject from the input image.

  Also, the priority setting unit 143 sets the priority according to the hue angle (h) in the uniform color space (L * a * b * color system, CIELab color space) in the area extracted by the area extraction unit 142. Determine Thus, the region extraction apparatus can appropriately extract the region of the main subject from the input image according to the hue angle.

  Also, in the priority setting unit 143, when the region extraction unit 142 extracts a predetermined region from the image based on the color information of the red component, the yellow component, and the blue component included in the image data, the extraction is performed In the area, a high priority is determined in comparison with the area extracted based on color information other than the red component, the yellow component, and the blue component included in the image data. Thus, the region extraction apparatus can appropriately extract the regions of the main subject of red, yellow and blue from the input image.

  Further, the priority setting unit 143 is extracted based on the area extracted based on the color information of the red component, the area extracted based on the color information on the yellow component, and the color information on the blue component included in the image data. In the order of the areas, set high priority. Thus, the region extraction apparatus can appropriately extract the region of the main subject with high priority in the order of the red component, the yellow component, and the blue component from the input image.

  Further, the priority setting unit 143 determines the priority according to the saturation (C *) of the area extracted by the area extraction unit 142. Thus, the region extraction device can appropriately extract the region of the main subject with high saturation from the input image.

  In addition, the region extraction unit 142 extracts a predetermined region from the image based on the luminance information included in the image data, and the priority setting unit 143 detects the predetermined region according to the luminance of the region extracted by the region extraction unit 142. , Determine the priority. Thus, the region extraction apparatus can appropriately extract the region of the main subject with high luminance from the input image.

  In addition, the area extraction unit 142 extracts an area having a luminance higher than a predetermined first threshold, and the priority setting unit 143 sets the area having the luminance higher than the first threshold to the extracted area. Set high priority compared to the extracted area. Thus, the region extraction apparatus can appropriately extract the region of the main subject with high luminance from the input image.

  Also, the priority setting unit 143 may select the area extracted based on the color information of the red component, the area extracted based on the color information of the yellow component, the area of luminance higher than the first threshold, and the area of the blue component. High priority is determined in the order of regions extracted based on color information. As a result, the region extraction apparatus can appropriately extract the region of the main subject that is higher in the order of the red component, the yellow component, the high luminance, and the blue component from the input image.

  In addition, the area extraction unit 142 extracts an area having a luminance lower than a predetermined second threshold, and the priority setting unit 143 sets another area to the extracted area having a luminance lower than the second threshold. Define a lower priority compared to the extracted area. As a result, the region extraction apparatus can appropriately extract the region of the main subject that is not a low luminance region (for example, a region in which a shadow is captured) from the input image.

  In addition, the area extraction unit 142 changes the second threshold to a lower value, and extracts an area having a luminance lower than the changed second threshold, and the priority setting unit 143 determines that the changed second threshold is higher than the changed second threshold. Also, the extracted area of low luminance is given a low priority in comparison with other extracted areas. Thus, the region extraction device can appropriately extract the region of the main subject from the input image.

  Also, the priority setting unit 143 determines the priority according to the distance (color difference) from the origin in the coordinate system of the uniform color space. As a result, the region extraction apparatus can appropriately extract the region of the black main subject that is not the region where the shadow is captured from the input image.

  In addition, the region extraction unit 140 extracts a predetermined region from the image based on the saturation information included in the image data of the input image, the region extraction unit 142 and the region extracted by the region extraction unit 142, And a priority setting unit 143 that determines the priority according to a predetermined saturation. Thus, the region extraction device can appropriately extract the region of the main subject from the input image.

  In addition, the region extraction device 140 extracts in advance a region extraction unit 142 that extracts a predetermined region from the image based on luminance information included in the image data of the input image, and a region extracted by the region extraction unit 142 in advance. And a priority setting unit 143 that determines the priority according to the determined luminance. Thus, the region extraction device can appropriately extract the region of the main subject from the input image.

In addition, the region extraction device 140 is based on the distance (color difference) from the origin in the coordinate system of the uniform color space (L * a * b * color system) representing the color information included in the image data of the input image. And an area extraction unit 142 for extracting a predetermined area from the image, and a priority setting unit 143 for determining the priority according to the distance in the area extracted by the area extraction unit 142.
Thus, the region extraction device can appropriately extract the region of the main subject from the captured image according to at least one of hue, saturation, and lightness.

The imaging apparatus 100 further includes a region extraction device 140, and a CPU 190 that adjusts the focus by an optical system (for example, the AF lens 112) so as to focus on a high priority region among the regions extracted by the region extraction device 140. And an imaging unit configured to capture an image including the high priority area in a state in which the high priority area is in focus.
With this configuration, the region extraction device 140 appropriately extracts the region of the main subject from the input image. Thus, the imaging apparatus 100 can capture an image including the area of the main subject in a state in which the area of the main subject is in focus.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes design and the like within the scope of the present invention.

  Also, the program for realizing the area extraction device and the imaging device described above is recorded in a computer-readable recording medium, and the computer system reads the program recorded in the recording medium and executes the program. Execution processing may be performed. Note that the “computer system” referred to here may include an OS and hardware such as peripheral devices.

  The "computer system" also includes a homepage providing environment (or display environment) if the WWW system is used. In addition, “computer readable recording medium” refers to flexible disks, magneto-optical disks, ROMs, writable nonvolatile memories such as flash memories, portable media such as CD-ROMs, hard disks incorporated in computer systems, etc. Storage devices.

Furthermore, the “computer-readable recording medium” is a volatile memory (for example, DRAM (Dynamic Memory) inside a computer system that becomes a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line). As Random Access Memory), it is assumed that the program which holds the program for a fixed time is included.
The program may be transmitted from a computer system in which the program is stored in a storage device or the like to another computer system via a transmission medium or by transmission waves in the transmission medium. Here, the “transmission medium” for transmitting the program is a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.
Further, the program may be for realizing a part of the functions described above. Furthermore, it may be a so-called difference file (difference program) that can realize the above-described functions in combination with a program already recorded in the computer system.

DESCRIPTION OF SYMBOLS 100 ... Imaging device, 110 ... Imaging part, 111 ... Lens-barrel, 140 ... Area extraction device, 141 ... Feature-value calculation part, 142 ... Area extraction part, 143 ... Priority setting part

Claims (40)

An imaging apparatus for performing an imaging operation for imaging a subject, comprising:
A setting unit configured to set any one of a first area and a second area included in the image extracted by the color information and the luminance information as a specific area ;
A control unit that controls the imaging operation based on information included in the specific area ;
The setting unit sets the first area as the specific area even when the luminance of the second area is higher than the luminance of the first area when the first area has specific color information. Imaging device . The setting unit sets the first area as the specific area even when the luminance of the second area is higher than the luminance of the first area, when the first area has red color information. The imaging device according to claim 1. The setting unit sets the first area as the specific area even when the luminance of the second area is higher than the luminance of the first area when the second area has color information of yellow. The imaging device according to claim 2. When the second area has blue color information, the setting unit sets the first area as the specific area even when the luminance of the second area is higher than the luminance of the first area. The imaging device according to claim 2. In the case where the first area has yellow color information and the second area has blue color information, the setting unit has a case where the luminance of the second area is higher than the luminance of the first area. The imaging apparatus according to claim 1, wherein the first area is set as the specific area. An imaging apparatus for performing an imaging operation for imaging a subject, comprising:
A setting unit configured to set any one of a first area and a second area included in the image extracted as color information and moment of inertia information as a specific area;
A control unit that controls the imaging operation based on information included in the specific area ;
When the first area has red color information, the setting unit sets the first area as the specific area even if the moment of inertia of the second area is smaller than the moment of inertia of the first area. Imaging device to set. When the second area has yellow color information, the setting unit sets the first area as the specific area even when the moment of inertia of the second area is smaller than the moment of inertia of the first area. The imaging device according to claim 6 which sets up. The setting unit sets the first area as the specific area even when the moment of inertia of the second area is smaller than the moment of inertia of the first area when the second area has blue color information. The imaging device according to claim 6 which sets up. An imaging apparatus for performing an imaging operation for imaging a subject, comprising:
A setting unit configured to set any one of a first area and a second area included in the image extracted as color information and moment of inertia information as a specific area ;
A control unit that controls the imaging operation based on information included in the specific area ;
In the setting unit, when the first area has yellow color information and the second area has blue color information, the moment of inertia of the second area is greater than the moment of inertia of the first area. An imaging apparatus which sets the first area as the specific area even when the area is small. An imaging apparatus for performing an imaging operation for imaging a subject, comprising:
A setting unit configured to set any one of a first area and a second area included in the image extracted by the color information and the saturation information as a specific area ;
A control unit that controls the imaging operation based on information included in the specific area ;
When the first area has specific color information, the setting unit sets the first area as the specific area even when the saturation of the second area is higher than the saturation of the first area. Imaging device to set. The setting unit sets the first area as the specific area even when the saturation of the second area is higher than the saturation of the first area when the first area has red color information. The imaging device according to claim 10, wherein the setting is performed. The setting unit sets the first area as the specific area even when the saturation of the second area is higher than the saturation of the first area when the second area has yellow color information. The imaging device according to claim 11 which sets up. When the second area has blue color information, the setting unit sets the first area as the specific area even if the saturation of the second area is higher than the saturation of the first area. The imaging device according to claim 11 which sets up. In the setting unit, when the first area has yellow color information and the second area has blue color information, the saturation of the second area is higher than the saturation of the first area. 11. The imaging device according to claim 10, wherein the first area is set as the specific area even when the area is high. An imaging apparatus for performing an imaging operation for imaging a subject, comprising:
A setting unit configured to set any one of a first area and a second area included in the image extracted as color information and distance information as a specific area ;
A control unit that controls the imaging operation based on information included in the specific area ;
When the first area has red color information, the setting unit is from the center of the angle of view to the center of gravity of the second area rather than the distance from the center of angle of view to the center of gravity of the first area. An imaging device in which the first area is set as the specific area even when the distance is short. When the second area has yellow color information, the setting unit is from the center of the angle of view to the center of gravity of the second area rather than the distance from the center of the angle of view to the center of gravity of the first area. The imaging device according to claim 15, wherein the first area is set as the specific area even when the distance is short. When the second area has blue color information, the setting unit is from the center of the angle of view to the center of gravity of the second area rather than the distance from the center of angle of view to the center of gravity of the first area. The imaging device according to claim 15, wherein the first area is set as the specific area even when the distance is short. An imaging apparatus for performing an imaging operation for imaging a subject, comprising:
A setting unit configured to set any one of a first area and a second area included in the image extracted as color information and distance information as a specific area ;
A control unit that controls the imaging operation based on information included in the specific area ;
When the first area has yellow color information and the second area has blue color information, the setting unit is more than a distance from the angle of view center position to the barycentric position of the first area. The imaging device which sets said 1st field as said specific field, even when the distance from said field angle center position to the gravity center position of said 2nd field is short. An imaging apparatus for performing an imaging operation for imaging a subject, comprising:
A setting unit configured to set any one of a first area and a second area included in the image extracted as color information and area information as a specific area ;
A control unit that controls the imaging operation based on information included in the specific area ;
The setting unit sets the first area as the specific area even when the area of the second area is larger than the area of the first area when the first area has red color information. Imaging device . The setting unit sets the first area as the specific area even when the area of the second area is larger than the area of the first area when the second area has yellow color information. The imaging device according to claim 19. The setting unit sets the first area as the specific area even when the area of the second area is larger than the area of the first area when the second area has blue color information. The imaging device according to claim 19. An imaging apparatus for performing an imaging operation for imaging a subject, comprising:
A setting unit configured to set any one of a first area and a second area included in the image extracted as color information and area information as a specific area ;
A control unit that controls the imaging operation based on information included in the specific area ;
When the setting unit determines that the first region has yellow color information and the second region has blue color information, the area of the second region is larger than the area of the first region. And an imaging device configured to set the first area as the specific area. The imaging device according to any one of claims 1 to 22, wherein the control unit performs exposure adjustment as the imaging operation based on information included in the specific area. The imaging device according to any one of claims 1 to 23, wherein the control unit performs white balance adjustment as the imaging operation based on information included in the specific area. The imaging device according to any one of claims 1 to 24, wherein the control unit performs tracking as the imaging operation based on information included in the specific area. The imaging device according to any one of claims 1 to 25, wherein the control unit determines, as the imaging operation, whether a night scene is or not, based on information included in the specific area. The imaging device according to any one of claims 1 to 26, wherein the control unit performs a correction process as the imaging operation based on information included in the specific area. The imaging device according to claim 27, wherein the control unit performs a color correction process as the imaging operation based on information included in the specific area. The imaging device according to any one of claims 1 to 28, wherein the control unit magnifies a part of the image displayed on the display unit as the imaging operation based on the information included in the specific area. . The imaging device according to any one of claims 1 to 29, wherein the control unit performs gradation adjustment as the imaging operation based on information included in the specific region. The imaging device according to any one of claims 1 to 30, wherein the control unit adjusts a light emission amount of a light emitting unit that emits light as the imaging operation based on information included in the specific region. The imaging device according to any one of claims 1 to 31, wherein the control unit changes a shutter speed as the imaging operation based on information included in the specific area. A program for performing an imaging operation for imaging a subject,
On the computer
It is a procedure of setting any one of the first area and the second area included in the image extracted as color information and luminance information as a specific area, wherein the first area is a specific color information And setting the first area as the specific area even if the luminance of the second area is higher than the luminance of the first area .
A procedure for controlling the imaging operation based on information of the specific area;
A program to run a program. A program for performing an imaging operation for imaging a subject,
On the computer
It is a procedure which sets any one field among the 1st field and the 2nd field included in a picture extracted by color information and inertia moment information as a specific field, and the 1st field is red color information And setting the first region as the specific region even if the moment of inertia of the second region is smaller than the moment of inertia of the first region ;
A procedure for controlling the imaging operation based on information of the specific area;
A program to run a program. A program for performing an imaging operation for imaging a subject,
On the computer
It is a procedure of setting any one of the first area and the second area included in the image extracted as color information and saturation information as a specific area, wherein the first area is specific color information And setting the first area as the specific area even if the saturation of the second area is higher than the saturation of the first area ;
A procedure for controlling the imaging operation based on information of the specific area;
A program to run a program. A program for performing an imaging operation for imaging a subject,
On the computer
It is a procedure of setting any one of the first area and the second area included in the image extracted as color information and distance information as a specific area, wherein the first area is red color information In the case of having, if the distance from the field angle center position to the center of gravity position of the second region is shorter than the distance from the field angle center position to the center of gravity position of the first region, the first region is specified Procedure to set as area ,
A procedure for controlling the imaging operation based on information of the specific area;
A program to run a program. A program for performing an imaging operation for imaging a subject,
On the computer
It is a procedure of setting any one of the first area and the second area included in the image extracted as color information and area information as a specific area, wherein the first area is red color information And setting the first area as the specific area even if the area of the second area is larger than the area of the first area ,
A procedure for controlling the imaging operation based on information of the specific area;
A program to run a program. A program for performing an imaging operation for imaging a subject,
On the computer
It is a procedure which sets any one field among the 1st field and the 2nd field included in a picture extracted by color information and inertia moment information as a specific field, and the 1st field is yellow color information And when the second area has blue color information, the first area may be the specific area even if the moment of inertia of the second area is smaller than the moment of inertia of the first area. The steps to set as
A procedure for controlling the imaging operation based on information of the specific area;
A program to run a program. A program for performing an imaging operation for imaging a subject,
On the computer
It is a procedure of setting any one of a first area and a second area included in an image extracted as color information and distance information as a specific area, wherein the first area is yellow color information And when the second area has blue color information, the distance from the angle of view center position to the center of gravity of the second area is greater than the distance from the angle of view center position to the center of gravity of the first area. Setting the first area as the specific area even if the distance is short ;
A procedure for controlling the imaging operation based on information of the specific area;
A program to run a program. A program for performing an imaging operation for imaging a subject,
On the computer
It is a procedure of setting any one of the first area and the second area included in the image extracted as color information and area information as a specific area, wherein the first area has yellow color information And when the second area has blue color information, the first area is set as the specific area even if the area of the second area is larger than the area of the first area. Steps and
A procedure for controlling the imaging operation based on information of the specific area;
A program to run a program.

Images