JP2018195989A - Image processing apparatus, image processing method, and program - Google Patents

Abstract

To make it possible to perform correct area recognition even if image features such as colors are changed.SOLUTION: From meta information added to an image recorded in a recording unit (106), a control unit (107) acquires information on an adjustment made to the image. An area discrimination processing unit (112) discriminates a subject area on the basis of the feature information of the image. Further, when discrimination of the subject area is performed, the control unit (107), on the basis of the acquired adjustment information, causes a signal processing unit (104) to process the adjusted image in order to make it closer to feature information different from the feature information of the adjusted image.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program for processing an image.

  In Non-Patent Document 1, based on features such as color information and edge components of an image, it is determined that a portion in which almost the same color gently continues for various objects in the image is a region representing the same object, A technique is disclosed in which a color changing portion is determined as a boundary region with another object. Thus, according to the technique described in Non-Patent Document 1, it is possible to specify the area of each object. Further, Patent Document 1 discloses a technique for recognizing a sky region based on a feature amount that an edge region is hardly included in the sky blue and the sky region when, for example, a sky region is extracted as a subject region. Is disclosed. In addition, as one of the image quality adjustment functions, the digital camera, for example, changes the color of the image greatly from the standard color, for example, changes the sky color from blue to purple, or makes the color saturation extremely It may have a function to make it larger.

Comaniciu, D.: Meer, P., "Robust analysis of feature spaces: color image segmentation", Computer Vision and Pattern Recognition, 1997. Preceedings., 1997 IEEE Computer Society Conference on Volume, Issue, 17-19 Jun 1997, Page : 750-755.

JP 2009-110137 A

  However, when, for example, the characteristics such as the color of the image are greatly changed from the standard value by the image quality adjustment function or the like, when the sky region is recognized by the technique described in Patent Document 1, for example, May not be recognized correctly as empty.

  Accordingly, an object of the present invention is to enable correct area recognition even for an image in which the characteristics of the image such as a color are changed.

  The present invention provides an acquisition means for acquiring information relating to adjustment performed on the image from meta information added to the image, a determination means for determining a subject area based on image feature information, and the adjustment When the subject area is determined for the image subjected to the adjustment, the feature area is brought closer to the feature information different from the feature information of the image subjected to the adjustment based on the acquired information related to the adjustment. And processing means for performing processing on the image subjected to the adjustment.

  According to the present invention, it is possible to perform correct area recognition even for an image in which the characteristics of the image such as a color are changed.

It is a figure which shows the example of schematic structure of the image processing apparatus of this embodiment. It is a flowchart of the recognition process of 1st Embodiment. It is explanatory drawing of the example of an image and color matrix conversion of 1st Embodiment. It is a flowchart of the area | region discrimination | determination process of 1st Embodiment. It is a flowchart of the recognition process of 2nd Embodiment. It is explanatory drawing of the color matrix conversion in the case of 2nd Embodiment. It is a flowchart of the recognition process of 3rd Embodiment. It is a flowchart of the recognition process of 4th Embodiment. It is a figure which shows the schematic structural example of the image processing apparatus of 7th Embodiment. It is a figure which shows the schematic structural example of the image processing apparatus of 8th Embodiment.

Preferred embodiments of the present invention will be described below with reference to the accompanying drawings.
<First Embodiment>
FIG. 1 shows a schematic configuration example of an imaging apparatus as an application example of the image processing apparatus of the present embodiment. FIG. 2 shows processing for recognizing a specific subject area from an image by the imaging apparatus of the present embodiment. The flowchart is shown. The imaging apparatus of the present embodiment can be applied not only to various mobile terminals such as digital cameras, digital video cameras, smartphones and tablet terminals having camera functions, but also to industrial cameras, in-vehicle cameras, medical cameras, etc. is there.

First, the schematic configuration of the imaging apparatus shown in FIG. 1 will be described.
In FIG. 1, an imaging unit 101 includes a lens, a diaphragm, a shutter, an imaging device, and a drive circuit thereof. The color filter is arranged. The imaging element of the imaging unit 101 outputs an RGB analog imaging signal by photoelectrically converting an optical image formed on an imaging surface by an imaging lens (not shown). The analog imaging signal output from the imaging unit 101 is converted into digital image data by the A / D conversion unit 102 and sent to the WB processing unit 103.

  The imaging control unit 111 controls the lens focus, zoom position, aperture value, shutter speed, imaging device drive circuit, and the like of the imaging unit 101 under instructions from the control unit 107. Then, the imaging control unit 111 stores various types of shooting information such as a focus and zoom position, an aperture value, a shutter speed, a driving state of the imaging device, and a shooting date and time at the time of shooting an image via a bus (RAM) 109. Memorize temporarily.

  The WB processing unit 103 performs a known white balance (hereinafter referred to as WB) process on the RGB image data under the control of the control unit 107. In addition to the so-called auto white balance (AWB) processing, the WB processing unit 103 according to the present embodiment can perform image quality adjustment processing such as adjusting the color temperature by changing the WB setting value. Image data that has undergone WB processing in the WB processing unit 103 is sent to the signal processing unit 104. Further, when the white balance setting value (WB setting value) of the AWB processing in the WB processing unit 103 and the image quality adjustment processing by changing the WB setting value are performed, information such as the WB setting value used in the image quality adjustment processing is as follows: The data is temporarily stored in the RAM 109 via the bus 108.

  The signal processing unit 104 performs color signal processing including known noise suppression processing, luminance signal processing, and color matrix conversion processing under the control of the control unit 107, and image data including luminance data Y and color difference data U and V. (Hereinafter referred to as YUV image data). These YUV image data are temporarily stored in the RAM 109 via the bus 108. Information indicating the presence or absence of noise suppression processing in the signal processing unit 104, setting information for luminance signal processing, and setting information for color matrix conversion are temporarily stored in the RAM 109 via the bus 108.

  The bus 108 is connected to each unit such as the signal processing unit 104, the display unit 105, the recording unit 106, and the control unit 107. These units exchange data, control signals, and the like via the bus 108. In the following description, description of data and the like being exchanged via the bus 108 is omitted.

  The control unit 107 includes a CPU (central processing unit) and controls the operations of the WB processing unit 103, the signal processing unit 104, the imaging control unit 111, the area determination processing unit 112, the display unit 105, the recording unit 106, and the like. Various calculations are performed according to the above. In addition, the control unit 107 uses the YUV image data temporarily stored in the RAM 109 from the signal processing unit 104, and generates an image file including the YUV image data. At this time, the control unit 107 displays information regarding development processing and image quality adjustment of the captured image, such as various types of shooting information in the RAM 109, WB setting value information, noise suppression processing presence / absence information, and color matrix conversion setting information. It is added as meta information to the header of the file. In the present embodiment, the color matrix conversion setting information added as meta information to the header is information indicating which of a plurality of types of color matrix conversions prepared in advance in the imaging apparatus is used. . In the case of the imaging apparatus of the present embodiment, the coefficient value (color gain) for color matrix conversion can be adjusted by the user. When the coefficient value is adjusted by the user, the meta information includes information indicating that the coefficient value of the color matrix conversion has been adjusted by the user, and the adjusted coefficient value or what adjustment was made. Is also included in the adjustment amount representing. In the following description, information related to development processing of a captured image and information related to image quality adjustment performed at the time of image shooting are collectively referred to as a development parameter. In addition, the image data of the image file may be compressed and encoded by an encoder (not shown) or the like.

The recording unit 106 includes a recording medium such as a detachable large-capacity semiconductor memory, and records and reproduces the above-described image file and the like on the recording medium.
The display unit 105 is supplied with the YUV image data processed by the signal processing unit 104 via the bus 108, generates a display video signal from the image data, and displays the video based on the video signal on the screen of the display device. Display above. The display unit 105 can also display on the screen a video based on the image data reproduced by the recording unit 106 from the recording medium.

  A ROM (Read Only Memory) 110 stores various control and arithmetic processing programs according to the present embodiment executed by the CPU of the control unit 107, various initial setting information determined in advance. In the case of the present embodiment, the initial setting information stored in the ROM 110 includes setting information representing each of a plurality of color matrix conversions for changing the colors of the image, and each of the plurality of color matrix conversions used Coefficient values (color gain) and the like are also included. The plurality of color matrix conversions include a standard color matrix conversion described later and a plurality of other color matrix conversions different from the standard color matrix conversion. The program stored in the ROM 110 is read out, developed in the RAM 109, and executed by the CPU of the control unit 107. The RAM 109 is used for temporary storage of the above-described image data, data being processed in each unit, various setting information, and the like in addition to the development of the program read from the ROM 110.

  The area determination processing unit 112 acquires a captured image or an image recorded on the recording medium of the recording unit 106 under the control of the control unit 107, and determines a specific subject area from the acquired image. Perform recognition processing. Although details will be described later, the area discrimination processing unit 112 detects an area where the same color continues and an area where the color changes rapidly based on the color information of the image and the feature information such as the edge component. Then, the area determination processing unit 112 recognizes an area that continues to have substantially the same color as the color target value as a specific subject area, and recognizes an area in which the color rapidly changes as a boundary area with another subject or the like. Perform the process. Here, when a blue sky region is given as an example of a specific subject region, the blue sky region is generally a region in which blue continues almost uniformly and has a feature that no edge component is included. . In this example, the area determination processing unit 112 recognizes an area where blue is set as the color target value and the blue continues almost uniformly as a blue sky area. In the present embodiment, the specific subject area is not limited to the blue sky area. For example, a sky area such as white or gray during cloudy weather or rainy weather, or an area in which almost the same color continues smoothly even when not in the sky. It may be an area of an object or the like that it has. Note that the area determination process may be performed by the CPU of the control unit 107 executing the program according to the present embodiment.

  In addition, the image pickup apparatus according to the present embodiment has a function of largely changing the color of an image from a standard color or greatly changing the color saturation as one of image quality adjustment functions. . As an example in which the color of the image is largely changed from the standard color, for example, the sky color is changed from blue to purple. Thus, the process of changing the color of the image by the image quality adjustment function can be realized by performing another color matrix conversion instead of the standard color matrix conversion, for example. Hereinafter, in the imaging apparatus of this embodiment, a case where another color matrix conversion is performed instead of the standard color matrix conversion by the image quality adjustment function when an image is taken will be described as an example. In the present embodiment, the standard color matrix conversion is color matrix conversion in which coefficient values are set to obtain an image in which the sky color is standard blue when the subject is sky, for example. On the other hand, it is assumed that another color matrix conversion is a color matrix conversion in which coefficient values are set to change the sky color from standard blue to another color (for example, purple). As described above, when image quality adjustment is performed to perform color matrix conversion that is significantly different from the standard color matrix conversion, the image after the image quality adjustment has a hue compared to the image obtained by the standard color matrix conversion. It will be very different.

FIGS. 3A and 3B are diagrams used for explaining the hue change of an image when color matrix conversion having a coefficient value different from that of the standard color matrix conversion is performed.
FIG. 3A shows an example of a captured image, and it is assumed that the captured image includes a sky region 300, a person region 310, and another object region 320 (for example, the ground). FIG. 3B plots the color difference values in the UV space when the first and second color matrix conversions having different coefficient values are performed on the photographed image example of FIG. 3A. FIG. In FIG. 3B, the horizontal axis indicates the U component of the color difference, and the vertical axis indicates the V component of the color difference. The first color matrix conversion is a standard color matrix conversion, and it is assumed that the coefficient value used in the color matrix conversion is set to a value that makes the sky blue a standard blue, for example. On the other hand, in the second color matrix conversion, for example, it is assumed that coefficient values are set such that, for example, the sky blue color is changed to a color different from blue (for example, purple) by image quality adjustment processing. In the case of FIG. 3B, the value 301 indicates the average value of the sky region 300 when the first color matrix conversion is performed, and the value 302 is the sky region 300 when the second color matrix conversion is performed. It is assumed that the average value of is shown. Further, the value 311 indicates the average value of the person area 310 when the first color matrix conversion is performed, and the value 312 indicates the average value of the person area 310 when the second color matrix conversion is performed. To do.

  Here, when the area determination processing unit 112 of this embodiment determines, for example, an empty area, it is usually determined whether the color range of the subject area is within the blue range by the first color matrix conversion, and the blue color is determined. The subject area determined to be within the range is recognized as an empty area. For this reason, for example, in the case of an image in which the hue is changed due to the second color matrix conversion at the time of image capture, the determination process of whether or not it is in the blue range according to the first color matrix conversion is performed. The sky cannot be correctly recognized as an empty area. In other words, since the color of the sky area of the image subjected to the second color matrix conversion is changed to purple, the area determination processing unit 112 determines the sky as an area outside the blue range, and is not a sky area. It will be recognized. As described above, in the case of an image whose hue is greatly changed by the second color matrix conversion, the recognition accuracy in the region discrimination processing unit 112 is lowered.

  Therefore, the image capturing apparatus according to the present embodiment performs a region determination process on the image whose hue has been changed by the second color matrix conversion, after performing a color matrix conversion process so as to approach the hue by the first color matrix conversion. The area determination process by the unit 112 is performed. As described above, the imaging apparatus according to the present embodiment has a function of correctly recognizing a specific subject area in an image even if the hue is greatly changed by color matrix conversion. This function will be described in detail.

  In the following description, the above-described YUV image data file is recorded on the recording medium of the recording unit 106, and a specific subject area recognition process is performed on the image of the file read from the recording medium. Take as an example. As described above, the image file includes development parameters as header meta-information. As described above, the development parameters include color matrix conversion setting information, WB setting values, and the like for the captured image. It is included.

  FIG. 2 is a flowchart showing a flow of processing until a specific subject area is recognized from an image in the imaging apparatus of the present embodiment. 2 is performed by the control unit 107 and the area determination processing unit 112. Note that the processing of the flowchart in FIG. 2 may be executed by a hardware configuration, or a part may be realized by a software configuration and the rest by a hardware configuration. When the process is executed by the software configuration, the process of the flowchart in FIG. 2 is realized by the CPU executing a program stored in the ROM 110, for example. The program according to the present embodiment may be prepared in advance in the ROM 110, or read from a removable semiconductor memory or the like, or downloaded from a network such as the Internet (not shown) and loaded into the RAM 109. Also good. In the following description, steps S201 to S204 of each process in FIG. 2 are abbreviated as S201 to S204. The same applies to other flowcharts described later.

  In the imaging apparatus according to the first embodiment, when performing recognition processing of a specific subject area (in this example, an empty area), the control unit 107 first executes an image file from a recording medium via the recording unit 106 as processing of S201. To get. It is assumed that the image file acquired from the recording medium is designated in advance by the user or the like. Then, the control unit 107 acquires color matrix conversion setting information from the development parameters included in the meta information of the header of the image file. Further, the control unit 107 acquires a coefficient value corresponding to the setting information of the color matrix conversion acquired from the meta information of the image file from the above-described various initial setting information stored in the ROM 110. Further, the control unit 107 also acquires a standard color matrix conversion coefficient value from the above-described various initial setting information stored in the ROM 110. Hereinafter, coefficient values of standard color matrix conversion (first color matrix conversion) will be referred to as standard MTX parameters. Note that when the meta information of the image file includes information such as a coefficient value for color matrix conversion and an adjustment amount for image quality adjustment processing, the control unit 107 may acquire such information from the meta information. After S201, the control unit 107 advances the process to S202.

  In step S202, the control unit 107 determines whether the coefficient value corresponding to the color matrix conversion setting information acquired from the meta information of the image file is the same as the standard MTX parameter (first color matrix conversion coefficient value). Determine whether or not. If the control unit 107 determines that the standard MTX parameter is the same as the standard MTX parameter (YES), the process proceeds to S204. On the other hand, if the control unit 107 determines that the standard MTX parameter is different (NO), that is, if it is determined that the coefficient value is the second color matrix conversion coefficient in this example, the process proceeds to S203. Proceed.

  In S203, the control unit 107 sends the image data of the image file to the signal processing unit 104, and color matrix conversion is performed in which the color of the image approaches the standard color of the image subjected to color matrix conversion using the standard MTX parameters. The signal processing unit 104 is controlled to be performed. In the example of FIG. 3B described above, the control unit 107 sets a coefficient value such that color matrix conversion is performed so that the value 302 in FIG. 3B approaches the value 301, and the color based on the coefficient value is set. The signal processing unit 104 is controlled to perform matrix conversion. For example, the control unit 107 uses the color difference between the average value (value 301) of the sky region by the first color matrix conversion and the average value (value 302) of the sky region by the second color matrix conversion. Then, the coefficient value of the color matrix conversion that brings the value 302 close to the value 301 is obtained. Then, the control unit 107 sets the coefficient value for the signal processing unit 104. In the case of this embodiment, since the image of the image file is an image in which the sky region is made purple by the second color matrix conversion, the sky region is changed to a color close to blue by performing the color matrix conversion in S203. The generated image is generated. Note that the color matrix conversion for the image data may be performed by the control unit 107. After S203, the control unit 107 advances the process to S204.

  In S204, when the color matrix conversion in S203 is performed, the control unit 107 sends the image data after the color matrix conversion to the region determination processing unit 112 to perform the region determination processing. On the other hand, if it is determined in S202 that the standard MTX parameter is the same as the standard MTX parameter (YES), the control unit 107 sends the image data of the image file acquired from the recording unit 106 to the region determination processing unit 112 to perform region determination processing. To do. As described above, when it is determined that the standard MTX parameter is not determined in S202, the region determination process performed in S204 is performed on the image after the color matrix conversion is performed in S203. That is, since the image after the color matrix conversion in S203 is, for example, an image in which the color of the sky region is close to blue, the region determination processing unit 112 determines whether or not the image is within the normal blue range. Therefore, it is possible to correctly recognize the blue sky area. On the other hand, if the standard MTX parameter is determined in S202, the area determination process in S204 is performed on the image of the image file. Since the empty area of the image at this time is originally blue, the area determination process is performed. The unit 112 can correctly recognize the blue sky region.

FIG. 4 is a detailed flowchart of the area determination process performed by the area determination processing unit 112 in S204 of FIG.
In S401 of FIG. 4, the area determination processing unit 112 acquires image data (YUV image data) of an image file under the control of the control unit 107. Then, the area determination processing unit 112 generates a small area that connects adjacent areas having similar colors and luminances by using a known superpixel (hereinafter referred to as SP) method for the image. Process. As a result, the image of the image file is divided into small regions having similar colors and brightness.

In next step S402, the area determination processing unit 112 calculates the average value Ysp of the luminance Y and the average values Usp and Vsp of the colors (color differences U and V) for each SP.
In the next step S403, the area determination processing unit 112 calculates the difference SUB between the YUV average value (Ysp, Usp, Vsp) for each SP and the reference pixel value (Ysk, Usk, Vsk) by the following equation (1). Ask for. The reference pixel values (Ysk, Usk, Vsk) are the YUV values corresponding to the sky blue color obtained by the standard color matrix conversion (first color matrix conversion), and the colors in the area determination processing of this embodiment It is a target value. Further, the area determination processing unit 112 determines whether or not the difference SUB between the average value of YUV (Ysp, Usp, Vsp) for each SP and the reference pixel value (Ysk, Usk, Vsk) is within a predetermined threshold value. Determine.

  SUB = SQRT ((Ysp-Ysk) ^ 2 + (Usp-Usk) ^ 2 + (Vsp-Vsk) ^ 2) Equation (1)

  The area determination processing unit 112 proceeds to S404 when it is determined in S402 that the difference SUB is within the threshold (YES), whereas when it is determined that the difference SUB exceeds the threshold (NO). The process proceeds to S405.

  When the process proceeds to S404, the area determination processing unit 112 sets the SP that is the object of determination in S402 as an SP included in the empty area. On the other hand, when the process proceeds to S405, the area determination processing unit 112 sets the SP that is the determination target in S402 as an SP that is not included in the empty area. After S404 or S405, the area determination processing unit 112 advances the process to S406.

  In S406, the area determination processing unit 112 determines whether or not the processing from S402 onward has been performed for all the SPs in the image, and determines that there is an unprocessed SP remaining (NO). Returns the processing to S402, and performs the processing after S402 on the unprocessed SP. On the other hand, if it is determined that the processing of all SPs has been completed (YES) in S406, the control unit 107 ends the processing of the flowchart of FIG.

  As described above, the image pickup apparatus according to the first embodiment uses the standard color matrix conversion to change the color of an image when the color matrix conversion performed at the time of shooting is significantly different from the standard color matrix conversion. The area recognition process is performed after the color is approximated. Thereby, according to the imaging device of the first embodiment, accurate region recognition can be performed even for an image whose color has been changed at the time of shooting or the like.

  In the present embodiment, the sky region is taken as an example of the subject region to be recognized. However, the subject region to be recognized may be a region such as an object or a plant. In this embodiment, an example in which the subject area to be recognized is a single area such as an empty area has been described. However, for example, a plurality of areas having the same color and a plurality of areas having different colors are used. It is also possible to simultaneously perform the recognition process.

  Furthermore, in this embodiment, when calculating the difference SUB between the average value for each SP and the reference pixel value, an example in which the value of the YUV color space is used is given. It may be a value such as a color space, Lab color space, XYZ color space, or the like. In the present embodiment, the example in which the difference SUB is detected in SP units has been described. However, processing is performed in average values or block units including peripheral pixels of pixels in normal pixel units, pixel units, or SP units. May be.

<Second Embodiment>
Hereinafter, a second embodiment of the present invention will be described.
FIG. 5 shows a flowchart of the recognition processing in the second embodiment, and FIG. 6 illustrates the hue change of the image when color matrix conversion different from the standard color matrix conversion is performed in the second embodiment. The figure is shown.
In the second embodiment, when color matrix conversion that is predicted to reduce the recognition accuracy of a region is performed, the region determination is stopped to prevent a region recognition error from occurring. In the second embodiment, detailed description of the same processing and configuration as in the first embodiment is omitted.

  First, color matrix conversion in the second embodiment will be described with reference to FIG. In the case of the second embodiment, it is assumed that a third color matrix conversion may be performed in addition to the first color matrix conversion and the second color matrix conversion described above when an image is captured. It is assumed that the third color matrix conversion is a color matrix conversion in which the recognition accuracy of the region is predicted to decrease.

  FIG. 6 is a diagram in which values in the UV space are plotted when any one of the first, second, and third color matrix conversions is performed. Similar to the example of FIG. 3B described above, the horizontal axis of FIG. 6 indicates the U component and the vertical axis indicates the V component. A value 601 in FIG. 6 indicates an average value of the sky region when the above-described first color matrix conversion is performed, and a value 602 indicates an average value of the sky region when the above-described second color matrix conversion is performed. Is shown. A value 603 indicates an average value of the sky region when the third color matrix conversion is performed. Further, a value 611 in FIG. 6 indicates an average value of the purple region when the first color matrix conversion is performed, and a value 613 is a purple region different from the sky when the third color matrix conversion is performed. The average value is shown. In other words, when the third color matrix conversion is performed, as shown in FIG. 6, the hue between the sky region (value 603) by the second color matrix conversion and the originally different region (value 613) from the sky region is changed. Are almost identical (feature information is almost identical). That is, in this case, the color information cannot distinguish the purple sky region from the purple region different from the sky. For this reason, if the sky region is recognized for the image that has undergone the third color matrix conversion, a purple region that is different from the sky is erroneously identified as a sky region, and the recognition accuracy decreases. End up. Therefore, in the second embodiment, when the third color matrix conversion, that is, the color matrix conversion in which the recognition accuracy of the region is predicted to be lowered is performed on the captured image, the empty region is detected. Stop recognition.

Such specific object region recognition processing in the second embodiment will be described with reference to the flowchart of FIG.
In step S501, the control unit 107 acquires an image file as in step S201 described above, and further acquires setting information for color matrix conversion from the development parameters of the meta information. Further, as described above, the control unit 107 acquires the coefficient value corresponding to the color matrix conversion setting information acquired from the meta information of the image file and the standard MTX parameter from the initial setting information of the ROM 110. In the case of the second embodiment, the control unit 107 also acquires the coefficient value of the third color matrix conversion that is predicted to decrease the recognition accuracy of the area from the initial setting information of the ROM 110. Hereinafter, the coefficient value of the third color matrix conversion is set as a third MTX parameter. After S501, the control unit 107 advances the process to S502.

  In step S502, the control unit 107 determines whether the coefficient value corresponding to the color matrix conversion setting information included in the meta information of the image file is the same as the third MTX parameter. If the control unit 107 determines that the third MTX parameter is the same as the third MTX parameter (YES), the process proceeds to S506. On the other hand, if the control unit 107 determines that the third MTX parameter is different (NO), the control unit 107 advances the process to S503.

  In step S503, the control unit 107 determines whether the coefficient value according to the color matrix conversion setting information acquired from the meta information is the same as the standard MTX parameter. If the control unit 107 determines that the standard MTX parameter is the same (YES), the process proceeds to S505. On the other hand, if the control unit 107 determines that the standard MTX parameter is different (NO), that is, if it is determined that the coefficient value is the second color matrix conversion coefficient in this example, the process proceeds to S504. The processing from S503 to S505 is the same as the processing from S202 to S204 in FIG.

  When the process proceeds to S506, the control unit 107 stops the recognition process of the empty area in the area determination processing unit 112 and ends the process of the flowchart of FIG. That is, in the case of an image that has been subjected to the third color matrix conversion, the recognition accuracy is lowered when the region determination of the sky region is performed. Therefore, the control unit 107 performs the region determination of the sky region by the region determination processing unit 112. End the process without sending them.

  As described above, in the second embodiment, the region determination of the sky region is stopped for an image that has undergone color matrix conversion in which recognition accuracy is expected to decrease as in the third color matrix conversion. To do. As a result, according to the second embodiment, it is possible to reduce false detection of an empty region and perform accurate region recognition.

<Third Embodiment>
Hereinafter, a third embodiment will be described.
In the third embodiment, as in the first and second embodiments, the color matrix conversion that brings the color of the image subjected to the second color matrix conversion closer to the standard color by the first color matrix conversion is performed. Instead, the color target value of the sky area during the area determination process is corrected. In the third embodiment, detailed description of the same processing and configuration as those in the first and second embodiments is omitted.

FIG. 7 is a flowchart of recognition processing in the third embodiment.
In step S701, the control unit 107 acquires an image file as in step S501 described above, and further acquires setting information for color matrix conversion from the development parameters of the meta information. In addition, as in S501 described above, the control unit 107 acquires, from the initial setting information in the ROM 110, a coefficient value corresponding to the color matrix conversion setting information acquired from the meta information of the image file and the standard MTX parameter. In addition, the third MTX parameter is also acquired. After S701, the control unit 107 advances the process to S702.

  In step S702, the control unit 107 determines whether the coefficient value corresponding to the color matrix conversion setting information included in the meta information of the image file is the same as that in the third MTX parameter, as in step S502 described above. Determine. If the control unit 107 determines that the third MTX parameter is the same as that of the third MTX parameter (YES), the controller 107 does not perform determination of the empty region as in the case of the second embodiment described above. 7 is terminated. On the other hand, if the control unit 107 determines that the third MTX parameter is different (NO), the control unit 107 advances the process to S703. In the flowchart of FIG. 7, an example in which the third MTX parameter is also used is given as in the second embodiment. However, in the third embodiment, processing related to the third MTX parameter is not necessarily performed. It does not have to be done.

  When the processing proceeds to S703, the control unit 107 determines whether or not the same as the standard MTX parameter, similarly to the above-described S503, and proceeds to S705 if it is determined that it is the same (YES). On the other hand, if it is determined in S703 that it is not the same as the standard MTX parameter (NO), that is, if it is determined that the coefficient value is the second color matrix conversion coefficient, the control unit 107 advances the process to S704.

  When the processing proceeds to S704, the control unit 107 determines the color target value used by the region determination processing unit 112 in the subsequent step S705 for the region determination processing from the above-described reference pixel value (Ysk, Usk, Vsk) as the corrected color target value. Change to (Yskn, Uskn, Vskn). In this case, the reference pixel value (Ysk, Usk, Vsk) is a blue pixel value, and the image of the image file has the sky color made purple by the second color matrix conversion. Therefore, the control unit 107 changes the color target value in the area determination process from the reference pixel value (Ysk, Usk, Vsk) to the purple corrected color target value (Yskn, Uskn, Vskn). After S704, the control unit 107 advances the process to S705.

In step S <b> 705, the control unit 107 causes the region discrimination processing unit 112 to perform an empty region recognition process.
The area determination process in the case of the third embodiment is substantially the same as the process described with reference to the flowchart of FIG. However, in the case of the third embodiment, the processing of S403 is different. Since S401, S402, S404, S405, and S406 are substantially the same as those described above, their description is omitted.
Here, when the process proceeds to the process of S705 after the process of S704, the corrected color target values (Yskn, Uskn, Vskn) are set in the area determination processing unit 112. For this reason, the area determination processing unit 112 calculates the difference SUB in S403 according to Expression (2) in which Ysk, Usk, and Vsk in Expression (1) are replaced with Yskn, Uskn, and Vskn. That is, in the equation (2), the difference SUB between the average value (Ysp, Usp, Vsp) of YUV for each SP and the corrected color target value (Yskn, Uskn, Vskn) is calculated.

  SUB = SQRT ((Ysp−Yskn) ^ 2 + (Usp−Uskn) ^ 2 + (Vsp−Vskn) ^ 2) Equation (2)

Then, the area determination processing unit 112 determines whether or not the difference SUB according to Expression (2) is within a predetermined threshold, and if it is determined that it is within the threshold, the SP is an SP included in the empty area. Set as. On the other hand, the area determination processing unit 112 sets the SP as an SP that is not included in the empty area when it is determined that the difference SUB according to Expression (2) exceeds the threshold value.
If it is determined in S703 that the parameters are the same as the standard MTX parameters and the process proceeds to S705, the same reference pixel values (Ysk, Usk, Vsk) as those described above are set in the area determination processing unit 112. The same determination process as in S403 described above is performed.

  As described above, in the third embodiment, when the color matrix conversion performed at the time of shooting is significantly different from the standard color matrix conversion, the color target value used for the region determination processing is performed at the time of shooting. Change to the corrected color target value that has been corrected according to the color matrix conversion. As a result, according to the third embodiment, it is possible to perform accurate region recognition even for an image whose color has been changed during shooting or the like.

<Fourth Embodiment>
Hereinafter, a fourth embodiment will be described.
In the fourth embodiment, as an image quality adjustment process for a captured image, for example, a case where the WB setting value is significantly changed from the WB setting value obtained by the AWB process (AWB setting value set under normal shooting conditions). To That is, when image quality adjustment processing for adjusting the color temperature setting value of the WB is performed, the WB setting value after the adjustment is a WB setting value different from the AWB setting value. In the following description, the AWB set value is referred to as a standard WB parameter, and the WB set value adjusted to a value different from the AWB set value is referred to as an adjusted WB parameter. As image quality adjustment processing for changing the WB setting value from the standard WB parameter to the adjustment WB parameter, for example, the color temperature setting value of the WB is significantly lower than that of the standard WB parameter so that the blue color of the blue sky is extremely darkened. Processing is assumed. In the fourth embodiment, detailed description of the same processing and configuration as in the first embodiment is omitted. In the case of the fourth embodiment, the signal processing unit 104 performs standard color matrix conversion (first color matrix conversion), and the second and third color matrix conversions as in the above-described embodiment. Is not done.

FIG. 8 is a flowchart of recognition processing in the fourth embodiment.
In FIG. 8, when performing recognition processing of a specific subject area (empty area), the control unit 107 first acquires an image file from the recording medium via the recording unit 106 as processing of S801. Further, the control unit 107 acquires WB setting value information from the development parameters included in the meta information in the header of the image file. Here, in the case of the fourth embodiment, the WB setting value in the meta information is subjected to image quality adjustment processing for adjusting the WB color temperature setting value in addition to the AWB setting value that is a standard WB parameter. Adjustment WB parameters for the case are also included. After S801, the control unit 107 advances the process to S802.

  In step S802, the control unit 107 determines whether the adjustment WB parameter when the image quality adjustment process is performed is the same as the standard WB parameter. If the control unit 107 determines that the standard WB parameter is the same (YES), the process proceeds to S804. On the other hand, if the control unit 107 determines that the standard WB parameter is different (NO), the control unit 107 advances the process to step S803.

  In step S803, the control unit 107 sends image data obtained by performing RGB conversion on the YUV image data of the image file to the WB processing unit 103, and an image obtained by performing WB processing using the standard WB parameter on the image (WB of the AWB). (Gain processing approaching the image after processing) is performed. For example, the R and B WB setting values in the standard WB parameter are WB gains (WRst and WBst), and the R and B WB setting values in the adjustment WB parameter are WB gains (WRc and WBc). In this case, the WB gain (WR, WB) of the gain processing that approximates the image by the WB processing of the standard WB parameter can be expressed by Expression (3) and Expression (4). Therefore, in step S803, the control unit 107 performs gain processing based on the WB gains (WR, WB) of Expressions (3) and (4) on the image data obtained by converting the YUV image data of the image file into RGB. The WB processing unit 103 is controlled. The gain processing in S803 may be performed by the control unit 107. Further, the signal processing unit 104 may perform processing for converting YUV image data into RGB image data.

WR = WRst / WRc Formula (3)
WB = WBst / WBc formula (4)

  In step S804, if the gain processing is performed in step S803, the control unit 107 converts the image data after the gain processing into, for example, YUV image data in the signal processing unit 104, and then performs region determination processing. The data is sent to the unit 112 to perform the area discrimination process. On the other hand, if it is determined that the standard WB parameter is the same as the standard WB parameter (YES) in S802, the control unit 107 sends the image data of the image file acquired from the recording unit 106 to the region determination processing unit 112 and performs region determination processing. To do. As described above, when it is determined in S802 that the region determination process is not a standard WB parameter, the area determination process performed in S804 is performed on the image after the gain process is performed in S803. That is, since the image after the gain processing in S803 is an image in which the color of the sky region is close to the blue color in the standard AWB, for example, the region determination processing unit 112 determines whether the image is within the normal blue range. By determining whether or not, it is possible to correctly recognize the blue sky region. On the other hand, if the standard WB parameter is determined in step S802, the region determination processing in step S804 is performed on the image of the image file, and the empty region of the image at this time is the standard AWB blue color. The discrimination processing unit 112 can correctly recognize the blue sky area. Note that the processing in the region determination processing unit 112 is the same as that in the first embodiment described above, and thus detailed description thereof is omitted.

  As described above, in the fourth embodiment, when the WB setting value set at the time of image shooting is an adjustment WB parameter that is significantly different from the standard WB parameter, the image is approximated to the image by the WB processing of the standard WB parameter. Recognition processing is performed after gain processing is performed. Thereby, according to the imaging device of the fourth embodiment, it is possible to perform accurate region recognition even for an image in which the WB setting value is changed during shooting or the like and the color temperature setting is greatly changed. It becomes.

<Fifth Embodiment>
The fifth embodiment will be described below.
When image quality adjustment processing is performed to change the WB setting value at the time of shooting, the image after the WB processing with the changed WB setting value may be an image in which the recognition accuracy of the region is expected to decrease. Conceivable. When the WB process in which the recognition accuracy of the region is predicted to decrease is performed in this manner, as in the second embodiment, the control unit 107 performs the region determination processing unit 112 as the fifth embodiment. The area determination process at may be stopped. As a result, it is possible to prevent an area recognition error from occurring. In other words, according to the fifth embodiment, even when the WB process is performed in which the recognition accuracy of the region is predicted to decrease, the false detection of the empty region is performed as in the second embodiment described above. Therefore, it is possible to perform accurate area recognition.

<Sixth Embodiment>
The sixth embodiment will be described below.
In the above-described fourth embodiment, an example in which the WB gain process is performed on the image after the WB process using the adjustment WB parameter so as to approach the image after the WB process using the standard WB parameter is described. The color target value may be corrected as in the embodiment. In other words, as the sixth embodiment, the control unit 107 uses the area discrimination processing unit 112 instead of performing gain processing to approximate the image after WB processing with the standard WB parameter to the image after WB processing with the adjusted WB parameter. Correct the color target value for the sky area. As a result, according to the sixth embodiment, it is possible to perform accurate region recognition even for an image in which, for example, the color temperature is changed by performing WB processing using the adjusted WB parameter at the time of shooting or the like.

<Seventh Embodiment>
The seventh embodiment will be described below.
In the seventh embodiment, different color matrix conversions are performed on captured images, one image after color matrix conversion is recorded, and the other image after color matrix conversion is used for recognition processing. This is an example. The other image after color matrix conversion is used only for recognition processing, and the image file is not recorded. In the seventh embodiment, one color matrix conversion applied to the recorded image is the second color matrix conversion described above, and the other color matrix conversion applied to the image used for the recognition process is the first color. Matrix transformation is used.

FIG. 9 is a diagram illustrating a schematic configuration of an imaging apparatus according to the seventh embodiment. In the configuration of FIG. 9, the same components as those in FIG. 1 are denoted by the same reference numerals as those in FIG. 1, and detailed description thereof is omitted.
The image data that has been subjected to WB processing by the WB processing unit 103 is sent to the signal processing unit 104 and the signal processing unit 905. Similarly to the above, the signal processing unit 104 and the signal processing unit 905 perform known signal suppression processing, luminance signal processing, color signal processing including color matrix conversion processing, and the like, and output YUV image data. However, in the case of the seventh embodiment, the signal processing unit 104 performs color signal processing by the second color matrix conversion, and the signal processing unit 905 performs color signal processing by the first color matrix conversion. The image data after the signal processing by the signal processing unit 104 is output as YUV image data that is shot and recorded, as in the first embodiment described above. On the other hand, the image data after the signal processing by the signal processing unit 905 is sent to the region discrimination processing unit 906.

  In the seventh embodiment, the processing in the region determination processing unit 906 is the same as that described with reference to the flowchart of FIG. 4 of the first embodiment described above, and detailed description thereof is omitted. However, in the case of the seventh embodiment, the area determination processing unit 906 calculates the SP average value (Ysp, Usp, Vsp) from the YUV image data that has been subjected to the first color matrix conversion in the signal processing unit 905. The area determination processing unit 906 compares the YUV average value (Ysp, Usp, Vsp) of the SP with the reference pixel values (Ysk, Usk, Vsk) of the empty area, so that the SP is an empty area. Recognition processing is performed to determine whether or not. Here, in the image subjected to the first color matrix conversion, for example, since the sky color is originally blue, it is possible to recognize the sky region with high accuracy. Note that, in the case of the seventh embodiment, the image data that has undergone the first color matrix conversion is discarded, for example, after the region discrimination processing has been performed.

  In the case of the seventh embodiment, information on the recognition result by the area discrimination processing unit 906 is sent to the control unit 107. The control unit 107 uses the recognition result information sent from the region discrimination processing unit 906 as meta information in the header of the image file generated from the image data after the second color matrix conversion by the signal processing unit 104. Deploy. Then, the image file is recorded on the recording medium by the recording unit 106. In the case of the seventh embodiment, the image recorded after the second color matrix conversion and the image recognized after the first color matrix conversion are originally the same image. For this reason, the subject area recognized from the image after the first color matrix conversion has a one-to-one correspondence with the subject area in the image after the second color matrix conversion. As a result, when an image recorded after the second color matrix conversion at the time of image capture is reproduced later, the specific subject area is determined based on the information of the recognition result arranged in the meta information of the image file. (Empty area) can be correctly recognized.

As described above, in the seventh embodiment, information obtained as a result of performing the first and second color matrix conversion on the captured image and performing the area determination on the image after the first color matrix conversion is obtained as the second information. This is arranged as meta information of the image file after color matrix conversion. Therefore, according to the seventh embodiment, it is possible to perform accurate region recognition later even for an image whose color has been changed during shooting or the like.
In the case of the seventh embodiment, the image data that has undergone the first color matrix conversion is discarded after the area discrimination processing, but is recorded together with the image file that has undergone the second color matrix conversion. Also good.

<Eighth Embodiment>
The eighth embodiment will be described below.
In the eighth embodiment, each captured image is subjected to WB processing with different WB setting values, an image after WB processing with one WB setting value is recorded, and WB processing with the other WB setting value is recorded. This is an example in which a later image is used for recognition processing. The image after WB processing using the other WB setting value is used only for recognition processing, and the image file is not recorded. In the eighth embodiment, one WB setting value applied to a recorded image is the aforementioned adjustment WB parameter, and the other WB setting value applied to an image used for recognition processing is a reference WB parameter. . In the eighth embodiment, detailed description of the same processing and configuration as those of the above-described fourth embodiment is omitted.

FIG. 10 is a diagram illustrating a schematic configuration of an imaging apparatus according to the eighth embodiment. In the configuration of FIG. 10, the same reference numerals as those in FIGS. 1 and 9 are given to the same components as those in FIGS. 1 and 9, and the detailed description thereof will be omitted.
The RGB image data output from the A / D conversion unit 102 is sent to the WB processing unit 103 and the WB processing unit 1005. The WB processing unit 103 and the WB processing unit 1005 perform known WB processing as described above. However, in the case of the eighth embodiment, the WB processing unit 103 performs WB processing using an adjustment WB parameter different from the standard WB parameter as in the case of the above-described fourth embodiment, while the WB processing unit 1005. Then, WB processing is performed using standard WB parameters. The image data after the WB processing by the WB processing unit 103 is sent to the signal processing unit 104, and the image data after the WB processing by the WB processing unit 1005 is sent to the signal processing unit 1006.

  Similarly to the above, the signal processing unit 104 and the signal processing unit 1006 perform known noise suppression processing, luminance signal processing, color signal processing including color matrix conversion processing, and the like, and output YUV image data. In the case of the eighth embodiment, the signal processing unit 104 and the signal processing unit 1006 perform standard color matrix conversion (first color matrix conversion), and perform the second color matrix conversion as described above. Absent. The image data after the signal processing by the signal processing unit 104 is output as YUV image data that is shot and recorded, as in the first embodiment described above. On the other hand, the image data after the signal processing by the signal processing unit 1006 is sent to the region discrimination processing unit 1007.

  In the case of the eighth embodiment, in the area discrimination processing unit 1007, the WB processing unit 1005 performs WB processing using standard WB parameters, and after the standard color matrix conversion is performed by the signal processing unit 1006, RGB conversion is further performed. Area discrimination processing using image data is performed. Since the processing of the region determination processing unit 1007 is the same as the region determination processing in the above-described fourth embodiment, detailed description thereof is omitted. In the eighth embodiment, the image data that has been subjected to the WB process using the standard WB parameter is discarded after the area determination process, for example.

  In the case of the eighth embodiment, information on the recognition result by the region discrimination processing unit 1007 is sent to the control unit 107. The control unit 107 performs the WB process different from the standard WB parameter, further performs the standard color matrix conversion, and outputs the recognition result information sent from the area determination processing unit 1007 to the image file generated from the image data. And added as meta information. Then, the image file is recorded on the recording medium by the recording unit 106. In the case of the eighth embodiment, the image recorded after the process using the adjustment WB parameter and the image recognized after the process using the standard WB parameter are originally the same image. For this reason, the subject area recognized from the image processed by the standard WB parameter has a one-to-one correspondence with the subject area in the image processed by the adjustment WB parameter. As a result, when an image that has been subjected to WB processing with a WB setting value different from the standard WB parameter at the time of image capture is played back later, the identification is performed based on the recognition result information arranged in the meta information of the image file. Thus, the subject area (empty area) can be correctly recognized.

As described above, in the eighth embodiment, for a captured image, WB processing and standard color matrix conversion using standard WB parameters, and WB processing and standard color matrix conversion using WB setting values different from the standard WB parameters. And done. Then, the information of the region discrimination result using the image related to the WB process by the standard WB parameter is arranged as meta information of the image file related to the WB process by the WB setting value different from the standard WB parameter. Therefore, according to the eighth embodiment, it is possible to perform accurate region recognition even for an image in which the WB setting value is changed at the time of shooting or the like and the color temperature setting is greatly changed.
In the case of the eighth embodiment, the image data related to the WB process using the standard WB parameter is discarded after the area determination process, but is recorded together with the image file related to the WB process different from the standard WB parameter. May be.

<Ninth Embodiment>
In the first to eighth embodiments described above, examples in which only one of color matrix conversion and WB processing is different from standard color matrix conversion and standard WB processing as image quality adjustment processing have been described. . In the ninth embodiment, as an image quality adjustment process, an example is given in which both the color matrix conversion and the WB process are different from the standard color matrix conversion and the standard WB process, respectively.

  That is, in the ninth embodiment, any of the processes described in the first to third and seventh embodiments described above and any of the processes described in the fourth to sixth and eighth embodiments described above. Is adjusted as appropriate. For example, if neither the color matrix conversion nor the WB process is a process in which a decrease in recognition accuracy of the region is predicted, the configuration and process of any of the first, third, and seventh embodiments, The configuration and processing of any of the sixth and eighth embodiments are performed in combination. In addition, for example, when a decrease in recognition accuracy of a region is predicted in color matrix conversion, the configuration and processing described in the second embodiment and the configuration of any of the fourth, sixth, and eighth embodiments And processing is performed in combination. On the other hand, when a decrease in the recognition accuracy of the region is predicted in the WB processing, the configuration and processing of any of the first, third, and seventh embodiments, and the configuration and processing of the fifth embodiment To do a combination. Thus, according to the ninth embodiment, accurate region recognition is possible even when image quality adjustment processing of both color matrix conversion and WB processing is performed.

<Other embodiments>
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in the computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

  The above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed as being limited thereto. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

  101: imaging unit, 103, 1005: WB processing unit, 104, 905, 1006: signal processing unit, 107: control unit, 106: recording unit, 109: RAM, 110: ROM, 112, 906, 1007: area discrimination processing Part

Claims (13)

Acquisition means for acquiring information on adjustments made to the image from meta information added to the image;
Discriminating means for discriminating a subject area based on feature information of an image;
When the subject area is determined for the image that has been subjected to the adjustment, based on the acquired information relating to the adjustment, the feature information is brought closer to feature information that is different from the feature information of the image that has been subjected to the adjustment. Processing means for performing processing on the image subjected to the adjustment,
An image processing apparatus comprising: Acquisition means for acquiring information on adjustments made to the image from meta information added to the image;
Discriminating means for discriminating a subject area based on feature information of an image;
In the case where the subject area is determined for the image subjected to the adjustment, the feature information set when the subject area is determined from the image based on the acquired information on the adjustment. Setting means for setting a target value to a target value close to the characteristic information of the image subjected to the adjustment;
An image processing apparatus comprising: First processing means for adjusting feature information of an image using a standard set value;
Second processing means for adjusting feature information of the image using a setting value different from the standard setting value;
A discriminating means for discriminating a subject area based on feature information of an image adjusted by the standard setting value;
Control means for adding, as meta information, information indicating the determined subject area to an image that has been adjusted with a setting value different from the standard setting value;
An image processing apparatus comprising: The adjustment applied to the image is a process of adjusting at least the color of the image;
The image processing apparatus according to claim 1, wherein the feature information used for the determination is at least color information of the image.   The image processing apparatus according to claim 4, wherein the color adjusting process includes at least one of a process for adjusting a color by color matrix conversion and a process for adjusting a white balance. The process of adjusting the color by the color matrix conversion is a process of performing color matrix conversion with a coefficient value different from the coefficient coefficient of the initially set color matrix conversion,
The image processing apparatus according to claim 5, wherein the process of adjusting the white balance is a process of adjusting a white balance by a white balance setting value different from a white balance setting value by auto white balance.   7. The image processing apparatus according to claim 1, wherein the determination unit groups areas where the feature information of the image is close, and determines the grouped area as the subject area.   The determination means, as the adjustment to be performed on the image, when the adjustment is made so that the feature information of the subject area and the feature information of the area different from the subject area are substantially the same. 8. The image processing apparatus according to claim 1, wherein the determination is stopped.   The image processing apparatus according to claim 1, wherein the adjustment is performed on a captured image. An acquisition step of acquiring information related to adjustments made to the image from meta information added to the image;
When the subject region is determined for the image subjected to the adjustment, based on the acquired information related to the adjustment, the feature information is different from the feature information of the image subjected to the adjustment. A processing step for performing processing on the image subjected to the adjustment;
A discriminating step for discriminating a subject area based on feature information of the image after the processing is performed on the image subjected to the adjustment;
An image processing method for an image processing apparatus, comprising: An acquisition step of acquiring information related to adjustments made to the image from meta information added to the image;
When the subject area is determined for the image subjected to the adjustment, the target for the image feature information set when the subject area is determined from the image based on the acquired information on the adjustment. A setting step of setting a value to a target value close to the feature information of the image subjected to the adjustment;
A determination step of determining the subject area from the adjusted image using the set target value;
An image processing method for an image processing apparatus, comprising: A first processing step of adjusting image feature information using standard set values;
A second processing step of adjusting the feature information of the image using a setting value different from the standard setting value;
A discriminating step for discriminating a subject area based on feature information of an image that has been adjusted by the standard setting value;
A control step of adding information indicating the determined subject area as meta information to an image that has been adjusted with a setting value different from the standard setting value;
An image processing method for an image processing apparatus, comprising:   The program for functioning a computer as each means of the image processing apparatus of any one of Claim 1 to 9.

Images