JP2013196373A - Image processing apparatus, image processing program and image processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily extract the order of arrangement of sign areas of a color chip without losing the design property of the color chip.SOLUTION: An image processing apparatus 10 searches for contour points of a measurement area of a color patch on an image, and obtains the total value of the number of contour points and contour point numbers for each proximity area in proximity to the measurement area. The image processing apparatus 10 uses a representative value calculated from the total value of the number of the contour points and the contour point numbers held in each proximity area to associate the proximity area with the order of arrangement of the sign areas of the color patch, that is, the clockwise or anti-clockwise order of arrangement revolving around the measurement area.

Description

  The present invention relates to an image processing apparatus, an image processing program, and an image processing method.

  Techniques for measuring colors are known for the purpose of skin diagnosis and design. When performing such color measurement, a dedicated colorimeter such as a photoelectric colorimeter or a spectrophotometer can be used. However, since the dedicated colorimeter is an expensive device, it is easy for the end user. It is difficult to use.

  For this reason, a camera or a digital camera mounted on a portable terminal may be used instead of a dedicated colorimeter. In this way, when taking a picture using a camera, the measurement part of the object to be measured for color is affected by the light source such as sunlight or illumination. There is a light / dark difference between the color of the measurement site.

  For this reason, a through-hole for exposing the skin that is the measurement site in the center is used as the skin measurement area, and the image is photographed with a camera using a color patch that is arranged so that multiple color marking areas surround it. A method of correcting the color of the measurement site shown in the captured image is conceivable. Such a technique utilizes the fact that the color patch affected by the light source is reflected in the image in the same manner as the measurement part by performing imaging while the color patch is attached in the vicinity of the measurement part. That is, in the above method, based on the amount of change between the color patch color stored in advance and the color patch color that appears in the image, the color of the measurement site that appears in the image is changed to the color that the measurement site originally has. A correction amount for correction is calculated.

  Thus, before obtaining the amount of change in the above correction, it is necessary to take out the sign areas arranged around the measurement area in order of circulation. As a technique for extracting the arrangement order of the marking areas, a position mark embedded in a ring target is detected, a photographed image is searched so that the position mark coincides with a vertex of a triangle having a predetermined shape, and a ring is obtained therefrom. A measurement method has been proposed for discriminating each of the regions constituting the.

JP 2011-50504 A

  However, the above-described prior art has a problem in that the order of arrangement of the marking areas of the color targets cannot be easily extracted without impairing the design of the color targets such as color patches.

  That is, in the measurement method described above, a position mark must be attached to the ring target, and design is impaired. In addition, in the measurement method described above, even if a position mark is attached, if the ring target is photographed from an oblique direction instead of the front, it becomes difficult to identify because the triangle is deformed. It is necessary to reset the triangle every time the number of areas is changed. In addition, in order to extract the arrangement order of regions without providing a position mark or the like, it is conceivable to determine the joining relationship for each region by a combination, but in that case, the processing becomes complicated due to the determination of the combination. .

  The disclosed technology has been made in view of the above, and an image processing apparatus, an image processing program, and an image processing method capable of easily extracting the order of arrangement of the marking areas of the color targets without impairing the design of the color targets The purpose is to provide.

  An image processing apparatus disclosed in the present application includes an acquisition unit that acquires an image, and a grouping unit that groups pixels having similar pixel values between adjacent pixels among the pixels included in the image. Further, the image processing device includes a color plane included in the image among the grouped areas, and a display surface on which the color marking area is formed and a through-hole penetrating the back surface of the display surface. And a selection unit for selecting a color measurement region formed by the through holes of the color targets respectively formed on the both sides of the display surface with the through holes interposed therebetween. Furthermore, the image processing apparatus includes a numbering unit that numbers each contour pixel that forms the contour of the measurement region on the image. Further, the image processing apparatus extracts, for each contour pixel of the measurement region, a corresponding contour pixel that is closest to the contour pixel of the measurement region from the contour pixels that form the contour of each region. Have Furthermore, the image processing apparatus includes an assigning unit that assigns a contour pixel number of the measurement region to the corresponding contour pixel. Further, each time the corresponding contour pixel is extracted, the image processing apparatus has the number of corresponding contour pixels that the region has in the region from which the corresponding contour pixel is extracted, and the region has The update unit updates the total value of the contour pixel numbers of the measurement region assigned to the corresponding contour pixels. Further, the image processing device calculates a representative value of the region for each region by using a total value of the contour pixel numbers of the measurement region and the number of the corresponding contour pixels assigned to the corresponding contour pixel. Part. Further, the image processing apparatus uses the representative value calculated for each area to arrange the areas in the order of arrangement of the marking areas of the color targets in the clockwise or counterclockwise arrangement around the measurement area. It has the matching part matched.

  According to one aspect of the image processing apparatus disclosed in the present application, there is an effect that the arrangement order of the marking areas of the color targets can be easily extracted without impairing the design of the color targets.

FIG. 1 is a top view of the color patch according to the first embodiment. FIG. 2 is a block diagram illustrating a functional configuration of the image processing apparatus according to the first embodiment. FIG. 3 is a diagram illustrating an example of an image in which a color patch is captured. FIG. 4 is a diagram illustrating an example of the grouping result. FIG. 5 is a diagram illustrating an example of corresponding contour points. FIG. 6 is a diagram illustrating an example of arrangement order data. FIG. 7 is a diagram illustrating the arrangement order on the color patches. FIG. 8 is a diagram illustrating an example of the arrangement order data. FIG. 9 is a diagram illustrating the distance from the center coordinate of the measurement region to the outer edge of the proximity region. FIG. 10 is a diagram illustrating a numerical example of the distance illustrated in FIG. FIG. 11 is a diagram illustrating an example of mapping. FIG. 12 is a diagram illustrating an example of the mapping output. FIG. 13 is a flowchart of an overall process procedure of the image processing apparatus according to the first embodiment. FIG. 14 is a flowchart illustrating the procedure of the first association process according to the first embodiment. FIG. 15 is a flowchart (1) illustrating the procedure of the second association process according to the first embodiment. FIG. 16 is a flowchart (2) illustrating the procedure of the second association process according to the first embodiment. FIG. 17 is a diagram for explaining a modification. FIG. 18 is a schematic diagram illustrating an example of a computer that executes an image processing program according to the first and second embodiments.

  Embodiments of an image processing apparatus, an image processing program, and an image processing method disclosed in the present application will be described below in detail with reference to the drawings. Note that this embodiment does not limit the disclosed technology. Each embodiment can be appropriately combined within a range in which processing contents are not contradictory.

[Structure of color patch 1]
First, the structure of the color patch according to the present embodiment will be described. FIG. 1 is a top view of the color patch 1 according to the first embodiment. In the example of FIG. 1, a top view when the display surface of the color patch 1 is viewed from the top with the display surface on which the color marking area is formed as the top and the back surface of the display surface in contact with the object whose color is to be measured as the bottom. Indicates. In the following, it is assumed that the color of a person's skin is measured using the color patch 1 in order to provide a skin diagnosis service.

  As shown in FIG. 1, the color patch 1 is attached to or placed on a subject whose color is to be measured, and then is imaged together with the measurement region. This is for reflecting the affected color patch 1.

  Here, in the color patch 1 according to the present embodiment, a through hole 3 penetrating the display surface and the back surface of the color patch 1 is formed. Thus, the through-hole 3 is formed in the central portion of the color patch 1 when the color patch 1 is affixed to the subject whose color is to be measured. This is for exposing as a measurement region. Thus, when the subject's skin is exposed from the through-hole 3, the marking areas C1 to C16 formed on the display surface of the color patch 1 are arranged so as to surround the subject's skin.

  For this reason, in the color patch 1 according to the present embodiment, it is possible to bring the respective marking areas arranged in an annular shape around the through hole 3 to be close to the measurement site without omission. Therefore, the color patch 1 according to the present embodiment can make the portion closer to the measurement site larger than the conventional color patch in which the color markings are two-dimensionally arranged in a matrix.

  Furthermore, in the color patch 1 according to the present embodiment, the marking areas C1, C6, C9, and C14 of the same color are formed on both sides of the display surface with the through hole 3 interposed therebetween. Furthermore, the same marking areas C2, C5, C10, and C13 are also formed on both sides of the display surface with the through hole 3 interposed therebetween. Further, the same marking areas C3, C8, C11, and C16 are also formed on both sides of the display surface with the through hole 3 interposed therebetween. Furthermore, the same marking areas C4, C7, C12 and C15 are also formed on both sides of the display surface with the through hole 3 interposed therebetween.

  The marking areas C1, C6, C9 and C14, the marking areas C2, C5, C10 and C13, the marking areas C3, C8, C11 and C16, and the marking areas C4, C7, C12 and C15 shown in FIG. Is an area on the display surface on which the same color is marked. Among these, the marking area C1 and the marking area C9 are arranged in pairs facing each other. Furthermore, the marking area C6 and the marking area C14 are also arranged in pairs facing each other. In addition, the marking areas C2, C5, C10 and C13, the marking areas C3, C8, C11 and C16 and the marking areas C4, C7, C12 and C15 are also different from the marking areas C1, C6, C9 and C14. Are different, but the mutual positional relationship is the same.

  As described above, the marking areas of the same color are arranged so as to face each other because the color of the marking area of the color patch 1 originally changes and the color of the marking area of the color patch 1 that appears in the image together with the measurement site. This is because an accurate change amount is calculated when the image processing apparatus 10 described later corrects the skin color of the subject appearing in the image using the amount.

  That is, it may be insufficient to reproduce the color of the subject's skin simply by observing the amount of change in one marking area. This is because the influence on the subject's skin by the light source is not necessarily uniform over the entire measurement region. Therefore, in the color patch 1 according to the present embodiment, in order to reflect a non-uniform change in the amount of change, the same color is used at the position of the pair close to both ends of the contour representing the measurement region or the position of the pair equivalent thereto. The marking areas were arranged in pairs. As a result, the paired marking areas among the marking areas of the same color are affected by the light source at positions close to or opposite to the ends of the contour that represents the measurement area. Therefore, it is possible to accurately calculate the amount of change in the color of the portion sandwiched between the paired marking areas among the marking areas of the same color. Furthermore, in the color patch 1 according to the present embodiment, four types of colors and two pairs of marking areas for the same color can be reflected in the image. Therefore, it is possible to cause the image processing apparatus 10 described later to calculate the amount of change reflecting the influence of the light source over the entire measurement region.

  Furthermore, when arranging the marking area | region of the same color as a pair, it is preferable to arrange | position symmetrically about the center of the through-hole 3 as a reference | standard. For example, as shown in FIG. 1, a pair of a marking area C1 and a marking area C9, or a pair of a marking area C6 and a marking area C14 are arranged facing each other with the same size and the same shape. To do. Further, the marking areas C2, C5, C10 and C13, the marking areas C3, C8, C11 and C16, and the marking areas C4, C7, C12 and C15, as well as C1, C6, C9 and C14, are two sets. Are arranged symmetrically. As a result, the amount of change in the marking area adjacent to the measurement area is calculated on the diagonal line of the measurement area, and the amount of change that equally reflects the influence of the label area of the same size and shape on the light source is calculated. It becomes possible.

  As described above, in the color patch 1 according to the present embodiment, it is possible to bring the respective marking areas arranged in an annular shape around the through hole 3 to be close to the measurement site without omission. Further, when the color patch 1 according to the present embodiment is photographed together with the measurement site, the amount of change in the color of the portion sandwiched between the paired labeling areas among the labeling areas of the same color from the photographed image. Can be calculated accurately. Therefore, when correcting the color of the measurement region shown in the image using the amount of change in the color of the marking area arranged in the color patch 1, the probability of reproducing the original color of the measurement region or a color close thereto is increased. be able to. Therefore, according to the color patch 1 according to the present embodiment, the color measurement accuracy can be improved.

  Further, in the color patch 1 according to the present embodiment, white marking areas W1 to W4 are arranged at a predetermined interval, for example, an interval of 90 degrees. For this reason, it is possible to correct the white balance by using the pixel values when the four white marking areas W1 to W4 adjacent to the measurement area appear in the image.

  Furthermore, in the color patch 1 according to the present embodiment, the outer shape of the color patch 1 is formed in an annular shape by forming the shape of the through hole 3 forming the outer periphery of the display surface and the inner periphery of the display surface in a circular shape. As a result, the measurement area photographed together with the measurement site by the camera 11 to be described later can be circular, and the outer shape of the color patch 1 can be circular. For this reason, even if the display surface of the color patch 1 is not photographed from the front but photographed from various directions other than the front, the photographed image displays the measurement area and the color patch 1 on the subject's skin. Surface deformation can be suppressed to an elliptical shape. Therefore, it is possible to easily detect the measurement region and the display surface from the captured image.

  In addition, in the color patch 1 according to the present embodiment, the display surface is divided into two layers of an outer ring and an inner ring, and the marking areas C1, C6, C9, and C14, the marking area C2, C5, C10, and C13, marking areas C3, C8, C11, and C16, and marking areas C4, C7, C12, and C15 are arranged. For this reason, it is possible to efficiently arrange a larger number of marking areas as compared with the case where the marking areas are arranged without being divided into an outer ring and an inner ring.

  Note that the colors to be displayed in the marking areas C1, C6, C9 and C14, the marking areas C2, C5, C10 and C13, the marking areas C3, C8, C11 and C16, and the marking areas C4, C7, C12 and C15. Any color can be adopted. Preferably, a color similar to skin color is employed. For example, in the case where four color marking areas are arranged, a color distributed in a position surrounding an extension of an area where human skin color is generally distributed in RGB (Red-Green-Blue color model) space, for example, skin color A reddish or yellowish color can be used. In addition, the color of the marking area displayed on the display surface of the color patch 1 may be colored by printing, or may be colored by other methods.

[Image processing device]
Subsequently, a functional configuration of the image processing apparatus according to the present embodiment will be described. FIG. 2 is a block diagram illustrating a functional configuration of the image processing apparatus according to the first embodiment. 2 measures the color of the measurement area formed by the through hole 3 of the color patch 1 included in the image photographed by the camera 11 or the like, the marking area that surrounds the measurement area. Image processing for specifying the arrangement order is executed.

  As an aspect of the image processing apparatus 10, the image processing apparatus 10 can be implemented by installing an image processing program for providing the image processing service on a personal computer connected with a digital camera or a mobile terminal such as a smartphone equipped with a camera function. As another aspect, it may be implemented as a Web server that executes the above-described image processing program, or may be implemented as a cloud that provides image processing services through outsourcing.

  As illustrated in FIG. 2, the image processing apparatus 10 includes a camera 11, a storage unit 13, and a control unit 15. Note that the image processing apparatus 10 includes various functional units included in known computers other than the functional units illustrated in FIG. 2, such as various input devices, audio output devices, and communication interfaces for communicating with external devices. It does not matter as having the functional part.

  The camera 11 is an imaging device using a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like. As an implementation example of the camera 11, a digital camera may be connected, or the camera can be used when the camera is mounted in advance, such as a mobile terminal. Although the case where the image processing apparatus 10 includes the camera 11 is illustrated here, the image does not necessarily need to include the camera 11 when an image can be acquired via a network or a storage device.

  The storage unit 13 is a storage device that stores various programs such as an OS (Operating System) executed by the control unit 15 and an image processing program. As one aspect of the storage unit 13, a storage device such as a semiconductor memory element such as a flash memory, a hard disk, or an optical disk is given. The storage unit 13 is not limited to the type of storage device described above, and may be a RAM (Random Access Memory) or a ROM (Read Only Memory).

  The storage unit 13 stores measurement area data 13a, corresponding contour point data 13b, and arrangement order data 13c as an example of data used in a program executed by the control unit 15. In addition to the measurement area data 13a and the corresponding contour point data 13b, the storage unit 13 can also store master data in which the RGB values of the marking area of the color patch 1 are defined.

  The measurement area data 13a is data related to the measurement area. Hereinafter, the pixels forming the contour of the region are referred to as “contour points”, and the numbers assigned to the contour points of the measurement region may be referred to as “contour point numbers”. As one aspect of the measurement region data 13a, there is data in which the region number assigned to the measurement region, the contour point number of each contour point in the measurement region, and the position information of each contour point are associated with each other. As an example, the measurement area data 13a is registered by the numbering unit 15d when the outline point number is assigned to each outline point of the measurement area.

  Corresponding contour point data 13b is data relating to the contour point of the region closest to the contour point of the measurement region. Hereinafter, the contour point of the region having the closest distance to the contour point of the measurement region may be referred to as “corresponding contour point” in the sense of the contour point of the region corresponding to the contour point of the measurement region. As one mode of the corresponding contour point data 13b, for each region number assigned to the region, the number of corresponding contour points that the region has, and the total value of the contour point numbers assigned to the corresponding contour points that the region has, Are associated with each other. As an example, when the corresponding contour point is extracted, the corresponding contour point data 13b includes the number of corresponding contour points associated with the region number of the region from which the corresponding contour point is extracted and the contour given to the corresponding contour point. The total value of the point numbers is updated by the update unit 15g described later.

  The arrangement order data 13 c is data relating to the arrangement order of the color patches 1. The “arrangement order” referred to here includes the arrangement order of areas close to the measurement area of the color patch 1 and the arrangement order of areas arranged outside the proximity area starting from the measurement area. Hereinafter, an area close to the measurement area may be referred to as “proximity area”. Furthermore, in the following, a region arranged outside the adjacent region starting from the measurement region may be referred to as an “outer region”.

  As one aspect of the arrangement order data 13c, data in which the arrangement order in the case where the outline of the measurement area is rotated clockwise, the area number of the proximity area, and the area number of the outer area can be used. As an example, when the order number data 13c is associated with the area number of the adjacent area and the arrangement order, the arrangement order of the area numbers of the adjacent areas of the two arrangement orders is the first association unit 15j described later. Registered by As another example, the arrangement order data 13c is registered in the second association unit 15k, which will be described later, when the area numbers of the outer area and the arrangement order are associated with each other. Is done.

  The control unit 15 has an internal memory for storing programs defining various processing procedures and control data, and executes various processes using these. As shown in FIG. 2, the control unit 15 includes an acquisition unit 15a, a grouping unit 15b, a selection unit 15c, a numbering unit 15d, an extraction unit 15e, an assignment unit 15f, an update unit 15g, and a calculation unit. 15h and a first association unit 15j. Furthermore, the control unit 15 includes a second association unit 15k, a penetrating region determination unit 15m, and an output unit 15n.

  The acquisition unit 15a is a processing unit that acquires an image. As one aspect, the acquisition unit 15a acquires an image photographed by the camera 11. As another uniformity, the acquisition unit 15a can also acquire an image via a network such as the Internet or a LAN (Local Area Network). As a further aspect, the acquisition unit 15a can also acquire an image from a storage device such as a memory card or a USB (Universal Serial Bus) memory.

  The grouping unit 15b is a processing unit that groups pixels having similar pixel values between adjacent pixels among the pixels included in the image. As one aspect, the grouping unit 15b is configured such that, among pixels included in the image acquired by the acquisition unit 15a, a pixel whose luminance is a predetermined threshold, for example, 100 or more, is an R component and a G component between adjacent pixels. And pixels having similar B components are grouped. As described above, the grouping is performed by narrowing down to pixels that are equal to or greater than the threshold value by excluding the pixels other than the pixels corresponding to the skin that are assumed to be exposed in the indication area and the measurement area of the color patch 1 from the grouping target. This is to improve accuracy and efficiency. Thereafter, the grouping unit 15b assigns an area number for identifying the area to the area obtained as a result of the grouping.

  Here, a specific example of grouping will be described with reference to FIGS. 3 and 4. FIG. 3 is a diagram illustrating an example of an image in which the color patch 1 is captured. FIG. 4 is a diagram illustrating an example of the grouping result. When grouping is performed on the image shown in FIG. 3, 23 areas of area numbers 1 to 23 shown in FIG. 4 are extracted. As shown in FIG. 3, when an image is picked up after the color patch 1 is applied to the skin of the subject person, as shown in FIG. The grouping result can be obtained in a state where irrelevant areas are mixed. In the example of FIG. 4, regions useful for color measurement such as the skin measurement region exposed from the through hole 3 and the marking region of the color patch 1 are extracted as region numbers 2 to 23 (excluding region number 12). The At the same time, an area such as a background that is not related to the color patch 1 is extracted as area number 1 or area number 12.

  The selection unit 15c is a processing unit that selects a region corresponding to the measurement region formed by the through hole 3 of the color patch 1 from the regions grouped by the grouping unit 15b. As an aspect, the selection unit 15 c selects a region having a shape corresponding to the shape of the through hole 3 of the color patch 1. For example, when the shape of the through hole 3 is circular as in the color patch 1 shown in FIG. 1, the region number 11 having a circular shape among the region numbers 1 to 23 shown in FIG. What is necessary is just to select as a measurement area | region. At this time, when the display surface of the color patch 1 is not photographed from the front, the shape of the through hole 3 may be deformed. In this case, an area number having an elliptical shape may be selected as the measurement area. In addition, when the shape of the through hole of the color patch 1 is not a circle but a polygon, an area having an area number whose shape is the previous polygon may be selected as the measurement area.

  The numbering unit 15d is a processing unit that numbers each contour point that forms the contour of the measurement region on the image. As one aspect, the numbering unit 15d uses the upper left point of the image as the origin, the X direction is the width direction of the image, and the Y axis is the height direction. A pixel having a small value is set as a starting point, and a contour point in the measurement region is searched clockwise from the starting point. Then, the numbering unit 15d assigns contour point numbers to the contour points of the measurement region in the search order. Thereafter, the numbering unit 15d associates the region number of the measurement region, the contour point number of each contour point, and the position information of each contour point, and registers them in the storage unit 13 as the measurement region data 13a. Here, the case where the pixel having the smallest Y coordinate among the contour points in the measurement region is exemplified as the starting point, but any contour point in the measurement region can be used as the starting point. Here, it is assumed that numbers are assigned in ascending order to the contour points of the measurement region. However, the disclosed apparatus is not limited to this, and numbers can be assigned in descending order.

  The extraction unit 15e is a processing unit that extracts, for each contour point in the measurement region, a corresponding contour point that is closest to the contour point in the measurement region, for each contour point in the measurement region, using the measurement region data 13a. As one aspect, the distance between the contour points between the contour point closest to the measurement region and the contour point of the measurement region is calculated for each region. Then, the extracting unit 15e extracts a contour point having a short distance from the contour point of the measurement region as a corresponding contour point. In this way, the extraction unit 15e repeatedly executes a process of extracting corresponding contour points for all contour points in the measurement region.

  The assigning unit 15f is a processing unit that assigns the contour point number of the contour point of the measurement region to the corresponding contour point. As one aspect, when the corresponding contour point is extracted by the extraction unit 15e, the assigning unit 15f assigns the contour point number of the contour point of the measurement region to the corresponding contour point.

  The update unit 15g is a processing unit that updates the corresponding contour point data 13b. As an aspect, the update unit 15g obtains the region number of the region from which the corresponding contour point is extracted from the corresponding contour point data 13b stored in the storage unit 13 every time the corresponding contour point is extracted by the extraction unit 15e. The following processing is executed for the corresponding contour point data. That is, the updating unit 15g increments the number of corresponding contour points of the area by one, and adds the total value of the contour point numbers assigned to the corresponding contour points of the area to the corresponding contour points extracted this time. The update is performed to add the contour point numbers.

  The calculation unit 15h is a processing unit that calculates the representative value of each region by using the corresponding contour point data 13b. As one aspect, when the corresponding contour points are extracted over all the contour points in the measurement region, the calculation unit 15h refers to the corresponding contour point data 13b and acquires the maximum number of corresponding contour points. Then, the calculation unit 15h calculates a threshold value for filtering an inappropriate area for inclusion in the order of arrangement of the marking areas by multiplying the maximum number of corresponding contour points by a predetermined coefficient, for example, 5%. Subsequently, the calculation unit 15h reads the corresponding contour point data 13b in which the number of corresponding contour points exceeds the previously calculated threshold value in the corresponding contour point data 13b. As a result, the corresponding contour point data 13b in which the number of corresponding contour points is equal to or less than the threshold value is excluded. After that, the calculation unit 15h performs a calculation to divide the total value of the contour point numbers assigned to the corresponding contour points for each corresponding contour point data 13b read out earlier by the number of corresponding contour points. An average value of different contour point numbers is calculated as a representative value of each region. In this example, the filtering threshold is calculated from the maximum number of corresponding contour points. However, only the corresponding contour point data 13b in which the number of corresponding contour points is zero may be excluded and read. Absent.

  In this way, the calculation unit 15h filters the corresponding contour point data 13b used for associating the adjacent regions in the order of arrangement using the threshold derived from the maximum number of corresponding contour points. As a result, it is possible to prevent the region numbers such as the outer region that does not have the corresponding contour point or the minute region that causes noise even if it has the corresponding contour point from being arranged and correlated.

  FIG. 5 is a diagram illustrating an example of corresponding contour points. In the example of FIG. 5, each square cell indicates a corresponding contour point. The numbers in the squares indicate the contour point numbers assigned to the corresponding contour points in each region from the contour points in the measurement region. Among these corresponding contour points, corresponding contour points belonging to the same region are filled with the same color. As shown in FIG. 5, after the contour point numbers 1 to 7 are continued, the contour point numbers 8 to 9 are skipped, and the contour point numbers 10 to 11 are the corresponding contour points of the same region. The number is nine. In this case, divide “49 = 1 + 2 + 3 + 4 + 5 + 6 + 7 + 10 + 11”, which is the sum of the contour point numbers of the corresponding contour points, by the number of corresponding contour points “9”. The representative value is calculated as “5”. Further, after the contour point numbers 8 to 9 are continued, the contour point numbers 10 to 11 are skipped, and the contour point numbers 12 to 17 are corresponding contour points in the same region, and the number of corresponding contour points is eight. Become. In this case, “104 = 8 + 9 + 12 + 13 + 14 + 15 + 16 + 17”, which is the sum of the contour point numbers of the corresponding contour points, is divided by the number of corresponding contour points “8”. The value is calculated as “13”. Further, contour point numbers 18 to 20 are corresponding contour points in the same region, and the number of corresponding contour points is three. In this case, the representative value is calculated as “19” by dividing “57 = 18 + 19 + 20”, which is the sum of the contour point numbers of the corresponding contour points, by the number of corresponding contour points “3”.

  The first associating unit 15j is a processing unit that associates the region number of the adjacent region close to the measurement region of the color patch 1 with the arrangement order when the contour of the measurement region is rotated clockwise. Here, as an example, a case is assumed in which region numbers are associated with each other in the arrangement order when the contour of the measurement region is rotated clockwise. In this case, the first association unit 15j associates the region numbers in order from the region number of the region with the small representative value calculated by the calculation unit 15h. Thereafter, the first association unit 15j registers the arrangement order of the area numbers of the adjacent areas in the storage unit 13 as the arrangement order data 13c.

  As a result, the arrangement order of the adjacent areas close to the measurement area of the color patch 1 among the grouped areas is specified. The proximity area includes a white marking area penetrating the inner circumference and the outer circumference of the color patch 1 in addition to the non-white marking area arranged on the inner circumference among the marking areas of the color patch 1.

  FIG. 6 is a diagram illustrating an example of the arrangement order data 13c. FIG. 7 is a diagram illustrating the arrangement order on the color patch 1. Arrangement order data 13c shown in FIG. 6 is the one at the time when the arrangement order of the area numbers of the adjacent areas is associated with one of the two arrangement orders. As shown in FIG. 6, region numbers 2, 6, 10, 14, 17, 20, 21, 19, 15, 13, 9, and 5 among the regions of region numbers 1 to 23 shown in FIG. Indicates that it has been identified. The arrangement order data 13c shown in FIG. 6 indicates that the area of area number 2 shown in FIG. 4 is associated with the arrangement order 1 shown in FIG. Furthermore, the arrangement order data 13c shown in FIG. 6 indicates that the area of area number 6 shown in FIG. 4 is associated with the arrangement order 2 shown in FIG. Furthermore, the arrangement order data 13c shown in FIG. 6 indicates that the area of area number 10 shown in FIG. 4 is associated with the arrangement order 3 shown in FIG. Similarly, the arrangement order data 13c shown in FIG. 6 includes the area numbers 14, 17, 20, 21, 19, 15, 13, 9, 5, and 5 shown in FIG. 4 in the arrangement orders 4 to 12 shown in FIG. Is associated as a proximity region.

  The second association unit 15k is a processing unit that associates the arrangement order of the outer areas existing outside the proximity area with the area numbers of the areas in accordance with the arrangement order of the area numbers of the proximity areas. As an aspect, the second association unit 15k starts from the center coordinates (CX, CY) of the measurement area, and is located outside the proximity area via the center coordinates (AX, AY) of the proximity area. Search for pixels up to the region. Then, when the pixel search reaches an area existing outside the proximity area, the second association unit 15k additionally registers the arrangement order of the area numbers of the outside area of the proximity area in the arrangement data 13c.

  As a result, the arrangement order of the outer areas existing outside the adjacent area in the grouped areas is specified. The outer area includes a white marking area penetrating the inner and outer circumferences of the color patch 1 in addition to the non-white marking areas arranged on the outer circumference in the marking areas of the color patch 1. In the following, the white marking area that penetrates the inner and outer circumferences of the color patch 1 may be referred to as a “penetrating area”.

  FIG. 8 is a diagram illustrating an example of the arrangement order data 13c. The arrangement order data 13c shown in FIG. 8 is the data when the arrangement order of the area numbers of the remaining outer areas is associated. As shown in FIG. 8, the region numbers 1, 4, 8, 18, 23, 22, 16, 7, and 3 among the regions of region numbers 1 to 23 shown in FIG. 4 are identified as outer regions. . The arrangement order data 13c shown in FIG. 8 indicates that the area of area number 1 shown in FIG. 4 is associated with the arrangement orders 1, 4, 7, and 10 as the outer area. These arrangement order actually corresponds to the white marking area that is the penetration area, but when the outer area is associated, the arrangement order is the penetration area, that is, the background area where the outer area 1 is not the marking area. It has not been determined. This is discriminated by a penetrating region discriminating unit 15m described later.

  The penetration region determination unit 15m is a processing unit that determines a penetration region. As one aspect, when the outer area is searched for all the adjacent areas by the second associating section 15k, the penetrating area determining section 15m extends from the center coordinates (CX, CY) of the measurement area to the outer edge of the adjacent area. It is determined that the arrangement order with the longest distance is the penetrating region. Here, in the example of the color patch 1, there is a regularity that the white marking area that is the penetrating area is arranged so as to skip two arrangement orders. Therefore, the penetration area determination unit 15 further determines that the arrangement order L + 3, the arrangement order L + 6, and the arrangement order L + 9 are further penetration areas in addition to the arrangement order L that is previously determined to be the penetration area.

  FIG. 9 is a diagram illustrating the distance from the center coordinate of the measurement region to the outer edge of the proximity region. FIG. 10 is a diagram illustrating a numerical example of the distance illustrated in FIG. As shown in FIG. 9, the search is performed from the center coordinates (CX, CY) of the measurement area to the outer area existing outside the proximity area via the center coordinates (AX, AY) of each proximity area. In the process, the distance from the center coordinates (CX, CY) of the measurement area to the outer edge of each adjacent area is measured. Assuming that the measurement result of this distance is that of FIG. 10, it is determined that the arrangement order 1 having the distance of the maximum value “185” is the through region. Such determination is made by penetrating the inner and outer peripheries of the color patch 1 rather than the distance to the outer edge of the marking region of a color other than white arranged in two layers, the inner and outer peripheries of the color patch 1. This is because the regularity that the distance to the white marking area is long is used. The reason for paying attention to the maximum value among the distances is to more accurately determine the arrangement order of the through regions. In this way, when one arrangement order with a penetrating area is determined, the remaining markings are further utilized by further utilizing the regularity that the white marking area that is the penetrating area is arranged by jumping two arrangement orders. It is possible to further determine the arrangement order 4, 7, and 10 in which the areas are present.

  The output unit 15n is a processing unit that outputs the RGB value of each marking area of the color patch 1 to a predetermined output destination using the arrangement order data 13c and the discrimination result of the penetrating area. Here, in the following, it is assumed that the output format of the data to the output destination is a format that outputs the RGB values of the white marking areas W1 to W4 and the RGB values of the marking areas C1 to C16 of colors other than white. Furthermore, it is assumed that the luminance of the marking area C1 is higher than the luminance of the marking area C2. Note that the above RGB values are average values of the RGB values of the pixels constituting each marking area.

  The output unit 15n performs mapping between the area number associated with the arrangement order, the white marking areas W1 to W4, and the marking areas C1 to C16 of colors other than white. Specify the order of mapping output from the mapping output.

  Explaining this, the color patch 1 includes the inner and outer marking areas sandwiched between the penetrating area of the color patch 1 and the penetrating area adjacent to the 90-degree area with the color of the inner marking area every 90 degrees. If it is arranged so that the colors of the outer marking areas are switched, there is regularity. By utilizing this, the output unit 15n is one adjacent to the adjacent region having a larger arrangement order than the arrangement order L determined as the through region in the arrangement order of the arrangement order data 13c, that is, one right side of the through region. It is determined whether the brightness of the adjacent area is greater than the brightness of the outer area. The reason why the adjacent area and the outer area adjacent to each other are compared in this manner is that the influence of the light source is small when viewed locally. Furthermore, the luminance is compared because the influence of the light source is less influenced by the light source than the RGB value, and it is not necessary to assume a case where the magnitude relationship between the luminance of the adjacent area and the outer area is reversed by shooting. Because.

  When the brightness of the proximity area is higher than the brightness of the outside area, it can be determined that the order of arrangement of the proximity area and the outside area corresponds to the order of arrangement of the marking areas defined in the data output format. In this case, the output unit 15n starts from the arrangement order L of the penetrating areas without shifting the arrangement order, and uses the area numbers associated with each arrangement order as the white marking areas W1 to W4 and the white color. It maps with the marking area | regions C1-C16 of colors other than. On the other hand, when the brightness of the proximity area is less than or equal to the brightness of the outside area, it can be determined that the order of arrangement of the proximity area and the outside area deviates from the order of alignment of the marking areas defined in the data output format. In this case, the output unit 15n shifts the arrangement order so that the arrangement order L + 3 of the penetrating area one prior to the arrangement order L of the through areas becomes the arrangement order L. Accordingly, the output unit 15n shifts the original arrangement order L + 3 to the arrangement order L, shifts the original arrangement order L + 6 to the arrangement order L + 3, shifts the original arrangement order L + 9 to the arrangement order L + 6, and restores the original arrangement order. The order L is shifted to the order L + 9. In this way, the color patches 1 appearing in the image are shifted in the arrangement order when they are rotated 90 degrees. Thereafter, the output unit 15n starts from the arrangement order L of the through areas after the shift, and uses the area numbers associated with each arrangement order as the white indication areas W1 to W4 and the indication areas C1 to C16 of colors other than white. And mapping.

  For example, an area number in the arrangement order L that is the first element of the penetrating area is mapped to the marking area W1. In addition, the area number of the arrangement order L + 3 which is the second element of the penetrating area is mapped to the marking area W2. In addition, the area number of the arrangement order L + 6 that is the third element of the penetrating area is mapped to the marking area W3. Further, the area number of the arrangement order L + 9, which is the fourth element of the penetrating area, is mapped to the marking area W4. These marking areas W1 to W4 are white marking areas that are penetration areas. For this reason, since there are no outer areas in the marking areas W1 to W4, the area numbers of the adjacent areas of the arrangement order L, the arrangement order L + 3, the arrangement order L + 6, and the arrangement order L + 9 are mapped.

  Furthermore, the area number of the adjacent area of the arrangement order L + 1 that is one order ahead of the arrangement order L that is the first element of the penetrating area is mapped to the marking area C1. Further, the area number of the outer area of the marking area C1 is mapped to the marking area C2. In addition, the area number of the adjacent area in the arrangement order that is one order ahead of the arrangement order of the indication area C1 is mapped to the indication area C3. Further, the area number of the outer area of the marking area C3 is mapped to the marking area C4. Here, since the labeling area W2 is sandwiched between the labeling area C5 and the labeling area C3, the area numbers of the adjacent areas that are two orders ahead of the ordering order of the labeling area C3 are mapped. Further, the area number of the outer area of the marking area C5 is mapped to the marking area C6. In addition, the area number of the adjacent area in the arrangement order that is one order ahead of the arrangement order of the indication area C6 is mapped to the indication area C7. Further, the area number of the outer area of the marking area C7 is mapped to the marking area C8. Here, since the labeling area W3 is sandwiched between the labeling area C9 and the labeling area C7, the area numbers of the adjacent areas that are two orders ahead of the ordering order of the labeling area C7 are mapped. Further, the area number of the outer area of the marking area C9 is mapped to the marking area C10. In addition, the area number of the adjacent area in the arrangement order one order ahead of the arrangement order of the indication area C9 is mapped to the indication area C11. Further, the area number of the outer area of the marking area C11 is mapped to the marking area C12. Here, since the marking area W4 is sandwiched between the marking area C13 and the marking area C11, the area numbers of the adjacent areas in the order of arrangement two orders ahead of the order of the marking area C11 are mapped. Further, the area number of the outer area of the marking area C13 is mapped to the marking area C14. In addition, the area number of the adjacent area in the arrangement order that is one order ahead of the arrangement order of the indication area C13 is mapped to the indication area C15. Further, the area number of the outer area of the marking area C15 is mapped to the marking area C16.

  Here, a specific example of mapping will be described with reference to FIG. FIG. 11 is a diagram illustrating an example of mapping. As shown in FIG. 11, the area of area number 2 shown in FIG. 4 is mapped to the white marking area W <b> 1 of the color map 1. Further, the area of area number 14 shown in FIG. 4 is mapped to the white marking area W2 of the color map 1. Further, the area of area number 21 shown in FIG. 4 is mapped to the white marking area W3 of the color map 1. Further, the area of area number 13 shown in FIG. 4 is mapped to the white marking area W4 of the color map 1. 4 is mapped to the color marking area C1 of the color map 1. Further, the area of area number 4 shown in FIG. Further, the area number 10 shown in FIG. 4 is mapped to the color marking area C3 of the color map 1. Further, the area number 8 shown in FIG. 4 is mapped to the color marking area C4 of the color map 1. Further, the area number 17 shown in FIG. 4 is mapped to the color marking area C5 of the color map 1. Furthermore, the area of area number 18 shown in FIG. Furthermore, the area of area number 20 shown in FIG. Further, the area of area number 23 shown in FIG. Furthermore, the area of area number 19 shown in FIG. Further, the area of area number 22 shown in FIG. Further, the area of area number 15 shown in FIG. Further, the area of area number 16 shown in FIG. Further, the area number 9 shown in FIG. 4 is mapped to the color marking area C13 of the color map 1. Furthermore, the area of area number 7 shown in FIG. Furthermore, the area of area number 5 shown in FIG. Further, the area of area number 3 shown in FIG. 4 is mapped to the color marking area C16 of the color map 1.

  Thereafter, the output unit 15n calculates an average value of the RGB values of the pixels included in the marking area for each of the white marking areas W1 to W4 and the marking areas C1 to C16 of colors other than white. In addition, the output unit 15n outputs the RGB values calculated for each of the white marking areas W1 to W4 and the marking areas C1 to C16 of colors other than white to a predetermined output destination. At this time, the output unit 15n can also output the RGB values inherent in the colors of the respective marking areas together with the RGB values of the respective marking areas.

  FIG. 12 is a diagram illustrating an example of the mapping output. As shown in FIG. 12, the RGB values of the pixels included in each of the marking areas of the mapped white marking areas W1 to W4 and the marking areas C1 to C16 of colors other than white shown in FIG. The average value of is calculated. In addition, together with the average value of the RGB values calculated for each of the white marking areas W1 to W4 and the marking areas C1 to C16 of colors other than white, the RGB values inherent in the colors of each marking area are Is output.

  As an example of the output destination, the RGB value of the measurement region that appears in the image using the RGB value inherent in the color of the indication region of the color patch 1 and the amount of change in the RGB value of the color of the indication region that appears in the image is used. There is a color measurement program to be corrected. Such a color measurement program does not necessarily need to be executed in the image processing apparatus 10, and may be output to an external device in which the color measurement program is executed.

  Note that various integrated circuits and electronic circuits can be employed for the control unit 15. In addition, a part of the functional unit included in the control unit 15 may be another integrated circuit or an electronic circuit. For example, an ASIC (Application Specific Integrated Circuit) is an example of the integrated circuit. Examples of the electronic circuit include a central processing unit (CPU) and a micro processing unit (MPU).

[Process flow]
Next, a processing flow of the image processing apparatus 10 according to the present embodiment will be described. Here, after (1) overall processing executed by the image processing apparatus 10 is described, (2) first association processing and (3) second association processing executed as a sub-flow of the overall processing are described. To do.

(1) Overall Processing FIG. 13 is a flowchart illustrating a procedure of overall processing of the image processing apparatus 10 according to the first embodiment. The entire process is started when an image is acquired by the acquisition unit 15a. As shown in FIG. 13, when an image is acquired (step S101), the image processing apparatus 10 groups pixels having similar pixel values between adjacent pixels among the pixels included in the image (step S102). .

  Then, the image processing apparatus 10 selects an area corresponding to the measurement area formed by the through hole 3 of the color patch 1 from the grouped areas (step S103).

  Thereafter, the image processing apparatus 10 executes “first association processing” that associates the region number of the proximity region close to the measurement region of the color patch 1 with the arrangement order when the contour of the measurement region is rotated clockwise. (Step S104).

  Subsequently, the image processing apparatus 10 executes “second association processing” that associates the arrangement order of the outer areas existing outside the proximity area with the area numbers of the areas in accordance with the arrangement order of the area numbers of the proximity areas. (Step S105).

  The image processing apparatus 10 then arranges the arrangement order L having the longest distance from the center coordinates (CX, CY) of the measurement area to the outer edge of the proximity area, and the arrangement orders L + 3 and L + 6 in the arrangement order and a certain rule. And L + 9 are determined to be through regions (step S106).

  Subsequently, the image processing apparatus 10 determines whether or not the luminance of the adjacent region having a larger arrangement order than the arrangement order L determined as the through region in the arrangement order of the arrangement order data 13c is larger than the luminance of the outer area. Is determined (step S107).

  At this time, if the brightness of the proximity area is equal to or less than the brightness of the outside area (No in step S107), the arrangement order of the proximity area and the outside area is different from the alignment order of the marking area defined in the data output format. Can be determined. In this case, the image processing apparatus 10 shifts the arrangement order so that the arrangement order L + 3 of the penetrating area one prior to the arrangement order L of the penetration areas becomes the arrangement order L (step S108). In addition, the image processing apparatus 10 starts from the arrangement order L of the through areas after the shift, and uses the area numbers associated with each arrangement order as the white indication areas W1 to W4 and the indication areas of colors other than white. Mapping is performed with C1 to C16 (step S109).

  On the other hand, when the brightness of the proximity area is higher than the brightness of the outside area (Yes in step S107), the arrangement order of the proximity area and the outside area corresponds to the order of arrangement of the marking areas defined in the data output format. Can be determined. In this case, the image processing apparatus 10 does not shift the arrangement order, but uses the arrangement order L of the penetrating areas as a starting point, and assigns the area numbers associated with each arrangement order to the white marking areas W1 to W4 and Mapping is performed with the marking areas C1 to C16 of colors other than white (step S109).

  Thereafter, the image processing apparatus 10 outputs a predetermined output together with the RGB values of the respective marking areas W1 to W4 and C1 to C16 together with the RGB values of the respective marking areas W1 to W4 and C1 to C16. The data is output first (step S110), and the process is terminated.

(2) First Association Processing FIG. 14 is a flowchart illustrating a procedure of first association processing according to the first embodiment. This first association process is a process corresponding to step S104 shown in FIG. 13, and is executed after the measurement region is selected.

  As shown in FIG. 14, first, the image processing apparatus 10 initializes the value of the register for representative value calculation, which holds the total number of the corresponding contour points and the contour point numbers for each region, to zero (step S301). Subsequently, the image processing apparatus 10 assigns a contour point number to each contour point in the measurement region (step S302). Thereafter, the image processing apparatus 10 executes initialization for setting an initial value, for example, a number at which the contour point number starts, to the counter A that counts the contour point number of the measurement region (step S303).

  Then, until the value of the contour point number counter A exceeds the number of all contour points in the measurement region, that is, the last contour point number (No in step S304), the processing from step S305 to step S315 described below is repeatedly executed. To do.

  In other words, the image processing apparatus 10 initializes the value of the register for the shortest distance that holds the pair of the area number and the shortest distance (step S305). For example, the region number value is initialized to zero, and the distance at which the shortest distance value can be considered larger than the distance between the contour point of the measurement region and the contour point of the region, for example, the number of pixels in the width of the image + Initialized to the number of pixels at the height of the image. Then, the image processing apparatus 10 executes initialization for setting an initial value, for example, a number at which the region number starts, to the counter B that counts the region number (step S306).

  Then, the image processing apparatus 10 determines whether the value of the area number counter B is equal to or smaller than the total number of areas (step S307). At this time, if the value of the area number counter B is equal to or less than the total number of areas (Yes in step S307), the image processing apparatus 10 further determines whether the value of the area number counter B is not the area number of the measurement area. Determination is made (step S308). If the value of the area number counter B is the area number of the measurement area (No at step S308), the process proceeds to step S312.

  If the value of the area number counter B is not the area number of the measurement area (Yes at step S308), the image processing apparatus 10 executes the following process. In other words, the image processing apparatus 10 determines the distance between the contour point between the contour point closest to the measurement region and the contour point A of the measurement region among the contour points of the region corresponding to the region number of the counter B. d is calculated (step S309).

  At this time, when the distance d between the contour points is smaller than the value of the register for the shortest distance (Yes in step S310), the image processing apparatus 10 stores the value of the register for the shortest distance in the counter B. The number and distance d are updated (step S311). Then, the image processing apparatus 10 increments the value of the area number counter B by one (step S312), and proceeds to the process of step S307. If the distance d between contour points is equal to or greater than the value of the register for the shortest distance (No at Step S310), the process proceeds to Step S312 without updating the value of the register for the shortest distance.

  Thereafter, when the value of the region number counter B exceeds the total number of regions (No in step S307), the image processing apparatus 10 executes the following processing. In other words, the image processing apparatus 10 increments the value of the number of corresponding contour points corresponding to the region number held in the shortest distance register among the number of corresponding contour points held in the representative value calculation register. (Step S313).

  Subsequently, the image processing apparatus 10 sets the contour point to the total value of the contour point numbers corresponding to the area number held in the shortest distance register among the total values of the contour point numbers held in the representative value calculation register. The value of the number counter A is added (step S314). Then, the image processing apparatus 10 increments the value of the contour point number counter A by one (step S315), and proceeds to the processing of step S304.

  Thereafter, when the value of the contour point number counter A exceeds the number of all contour points in the measurement area, that is, the last contour point number (No in step S304), the image processing apparatus 10 executes the following processing. In other words, the image processing apparatus 10 is inconvenient to include in the order of arrangement of the marking areas by multiplying the maximum number of corresponding contour points among the number of corresponding contour points held in the representative value calculation register by a predetermined coefficient. A threshold value for filtering an appropriate region is calculated (step S316).

  Subsequently, the image processing apparatus 10 calculates the total number of the contour point numbers and the number of corresponding contour points of the region number whose number of corresponding contour points held in the representative value calculation register is equal to or less than the threshold value calculated in step S316. It excludes from the calculation object of a representative value (step S317).

  After that, the image processing apparatus 10 performs the calculation for dividing the total value of the contour point numbers held in the representative value calculation register by the number of corresponding contour points, by the region number, thereby performing the contour point by region number. The average value of the numbers is calculated as a representative value for each region (step S318).

  Thereafter, the image processing apparatus 10 associates the region numbers in order from the region number of the region with the small representative value calculated in step S318 (step S319), and ends the processing.

(3) Second Association Processing FIGS. 15 and 16 are flowcharts illustrating the procedure of the second association processing according to the first embodiment. This second association process is a process corresponding to step S105 shown in FIG. 13, and is executed after the first association process shown in FIG. 14 is executed.

  As shown in FIG. 15, the image processing apparatus 10 includes a longest outer edge distance register that holds the longest outer edge distance that is the area number having the longest outer edge distance and the longest outer edge distance from the center of the measurement area to the outer edge of the adjacent area. Initialization is set to set an initial value, for example, zero (step S501).

  Subsequently, the image processing apparatus 10 calculates the coordinates (CX, CY) of the center of the measurement region (step S502). Then, the image processing apparatus 10 performs initialization to set an initial value, for example, the region number of the adjacent region corresponding to the first arrangement order, in the counter A that counts the region number of the adjacent region (step S503).

  At this time, the following steps S506 to S516 are repeatedly executed until the area numbers of all adjacent areas are counted by the area number counter A of the adjacent areas (No in step S504).

  That is, the image processing apparatus 10 calculates the coordinates (AX, AY) of the center of the proximity area corresponding to the area number held in the counter A (step S505). Then, the image processing apparatus 10 calculates the XY increment of a straight line from the center of the measurement region to the center of the proximity region (step S506).

  For example, the above XY increment can be calculated as follows. That is, the image processing apparatus 10 calculates the X difference and the Y difference between the coordinates (AX, AY) of the center of the proximity area and the coordinates (CX, CY) of the center of the measurement area. At this time, if the absolute value of the X difference is smaller than the absolute value of the Y difference, the image processing apparatus 10 calculates the X increment by dividing the X difference by the absolute value of the Y difference. In addition, the image processing apparatus 10 sets the Y increment to “1” if the Y difference is positive, and sets the Y increment to “−1” if the Y difference is negative. On the other hand, when the absolute value of the Y difference is equal to or smaller than the absolute value of the X difference, the image processing apparatus 10 calculates the Y increment by dividing the Y difference by the absolute value of the X difference. In addition, the image processing apparatus 10 sets the X increment to “1” if the X difference is positive, and sets the X increment to “−1” if the X difference is negative. Such an XY increment makes it possible to search for pixels one by one.

  Subsequently, the image processing apparatus 10 searches the coordinate counter (X, Y) of the search pixel that searches from the center coordinate (CX, CY) of the measurement region to the outer region via the center coordinate (AX, AY) of the proximity region. ) Is initialized to set an initial value, for example, the coordinates (CX, CY) of the center of the measurement region (step S507).

  Then, the image processing apparatus 10 determines whether or not the coordinates (X, Y) of the search pixel are within the image (step S508). At this time, if the coordinates (X, Y) of the search pixel are in the image (Yes in step S508), the image processing apparatus 10 determines whether the coordinates (X, Y) of the search pixel is in the proximity region. Is further determined (step S509).

  Here, when the coordinates (X, Y) of the search pixel are within the proximity region (Yes in step S509), the image processing apparatus 10 determines the coordinates (CX, CY) of the search pixel from the coordinates (CX, CY) of the measurement region. A distance d to (X, Y) is calculated (step S510).

  At this time, when the distance d to the search pixel is larger than the longest outer edge distance held in the register for the longest outer edge distance (Yes in step S511), the image processing apparatus 10 executes the following process. That is, the image processing apparatus 10 updates the value of the longest outer edge distance held in the register for the longest outer edge distance to the distance d calculated in step S510, and the proximity of the value of the longest outer edge area held in the counter A. The region number is updated to the region number (step S512). Thereafter, the image processing apparatus 10 adds the XY increment calculated in step S506 to the coordinate counter (X, Y) of the search pixel (step S513), and proceeds to the process of step S508.

  On the other hand, when the distance d to the search pixel is less than or equal to the longest outer edge distance held in the longest outer edge distance register (No in step S511), the image processing apparatus 10 executes the following process. That is, the image processing apparatus 10 adds the XY increment calculated in step S506 to the coordinate counter (X, Y) of the search pixel without executing the update of the register for the longest outer edge distance (step S513), and step S508. Move on to processing.

  When the coordinates (X, Y) of the search pixel are outside the proximity region (No in step S509), the image processing apparatus 10 determines whether the coordinates (X, Y) of the search pixel is outside the measurement region. Is determined (step S514).

  At this time, if the coordinates (X, Y) of the search pixel are within the measurement region (No in step S514), the image processing apparatus 10 adds the XY calculated in step S506 to the coordinate counter (X, Y) of the search pixel. The increment is added (step S513), and the process proceeds to step S508.

  On the other hand, when the coordinates (X, Y) of the search pixel are outside the measurement region (Yes in step S514), the search pixel is not located in the proximity region and the measurement region, but has reached the outer edge of the proximity region. Recognize. In this case, the image processing apparatus 10 associates the region numbers of the outer regions that include the coordinates (X, Y) of the search pixels in the order of the adjacent regions having the region numbers held in the counter A (step S515). After that, the image processing apparatus 10 updates the value of the area number counter A of the adjacent area to the area number of the adjacent area in the next arrangement order (step S516), and proceeds to step S504.

  Even when the coordinates (X, Y) of the search pixel are not in the image (No in step S508), the image processing apparatus 10 sets the value of the counter number of the area number of the adjacent area to the area of the adjacent area in the next arrangement order. The number is updated (step S516), and the process proceeds to step S504.

  Thereafter, when the area numbers of all adjacent areas are counted by the area number counter A of the adjacent areas (Yes in step S504), the image processing apparatus 10 ends the process.

[Effect of Example 1]
As described above, the image processing apparatus 10 according to the present embodiment uses the sum of the number of contour points and the contour point number of each adjacent region obtained by searching the contour points of the measurement region of the color patch 1 on the image. The representative values are obtained and the areas are associated in the order of arrangement. Therefore, in the image processing apparatus 10 according to the present embodiment, the arrangement order can be specified without adding a mark or the like to the color patch 1. Furthermore, in the image processing apparatus 10 according to the present embodiment, the order of arrangement of the marking areas can be obtained by processing centering on the four arithmetic operations without determining the joining relation of the marking areas by combination.

  Therefore, according to the image processing apparatus 10 according to the present embodiment, the arrangement order of the marking areas of the color patch 1 can be easily extracted without impairing the design of the color patch 1. Furthermore, in the image processing apparatus 10 according to the present embodiment, the arrangement order of the marking areas of the color patch 1 can be extracted regardless of the presence / absence of a boundary line that divides the marking areas, so that versatility can be improved.

  Although the embodiments related to the disclosed apparatus have been described above, the present invention may be implemented in various different forms other than the above-described embodiments. Therefore, another embodiment included in the present invention will be described below.

[Application example]
For example, in the first embodiment, the case where the area including the pixel is regarded as the outer area when the search pixel leaves the adjacent area when the area numbers of the outer areas are associated with each other in order is illustrated. At this stage, it is not necessary to determine the outer region.

  In other words, the disclosed apparatus can add processing for excluding a small region even in the outer region. For example, when searching in the direction from the center of the measurement area to the center of each proximity area, the coordinates of the start and end of the proximity area are recorded, and the start and end of the area are also searched when searching for candidates for the outer area of the proximity area. Are recorded, and the widths of the proximity region and the outside region candidate are calculated from these coordinates. Then, when the widths of the proximity area and the outside area candidate are equal, the disclosed apparatus records the outside area candidate as the outside area corresponding to the proximity area. On the other hand, when the widths of the proximity area and the outside area candidate are not equal, the disclosed apparatus determines that the outside area candidate is not a corresponding outside area, and continues the process of searching for the next area. Such a procedure makes it possible to exclude a very small area between the adjacent area and the outer area, and to take out the outer area of the regular area.

[Modification]
In the first embodiment, the image processing corresponding to the color patch 1 shown in FIG. 1 is illustrated, but the number of areas and the size of the areas are different if the color patch has the same regularity as the color patch 1. However, it is possible to similarly specify the order of arrangement of the marking areas. FIG. 17 is a diagram for explaining a modification. As in the color patch 5 shown in FIG. 17, the adjacent region and the outer region are not two at every 90 degrees, but one each, and even when the size of each region is different, The arrangement order of the marking areas can be specified.

[Distribution and integration]
In addition, each component of each illustrated apparatus does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution / integration of each device is not limited to that shown in the figure, and all or a part thereof may be functionally or physically distributed or arbitrarily distributed in arbitrary units according to various loads or usage conditions. Can be integrated and configured. For example, a part of the function units 15a to 15n in the control unit 15 may be connected as an external device of the image processing apparatus 10 via a network. Further, the functions of the image processing apparatus 10 described above may be realized by another apparatus having a part of the function units 15a to 15n in the control unit 15 and connected through a network to cooperate. .

[Image processing program]
The various processes described in the above embodiments can be realized by executing a prepared program on a computer such as a personal computer or a workstation. In the following, an example of a computer that executes an image processing program having the same function as that of the above-described embodiment will be described with reference to FIG.

  FIG. 18 is a schematic diagram illustrating an example of a computer that executes an image processing program according to the first and second embodiments. As illustrated in FIG. 18, the computer 100 includes an operation unit 110a, a speaker 110b, a camera 110c, a display 120, and a communication unit 130. Further, the computer 100 includes a CPU 150, a ROM 160, an HDD 170, and a RAM 180. These units 110 to 180 are connected via a bus 140.

  As shown in FIG. 18, the HDD 170 stores in advance an image processing program 170a that exhibits the same functions as the function units 15a to 15n in the control unit 15 shown in the first embodiment. The image processing program 170a may be appropriately integrated or separated as in the case of the components of the functional units 15a to 15n in the control unit 15 shown in FIG. In other words, all data stored in the HDD 170 need not always be stored in the HDD 170, and only data necessary for processing may be stored in the HDD 170.

  Then, the CPU 150 reads the image processing program 170 a from the HDD 170 and develops it in the RAM 180. As a result, as shown in FIG. 18, the image processing program 170a functions as an image processing process 180a. The image processing process 180a expands various data read from the HDD 170 in an area allocated to itself on the RAM 180 as appropriate, and executes various processes based on the expanded data. Note that the image processing process 180a includes processing executed by the functional units 15a to 15n in the control unit 15 shown in FIG. 2, for example, processing shown in FIG. 13 to FIG. In addition, each processing unit virtually realized on the CPU 150 does not always require that all processing units operate on the CPU 150, and only a processing unit necessary for the processing needs to be virtually realized.

  Note that the image processing program 170a is not necessarily stored in the HDD 170 or the ROM 160 from the beginning. For example, each program is stored in a “portable physical medium” such as a flexible disk inserted into the computer 100, so-called FD, CD-ROM, DVD disk, magneto-optical disk, or IC card. Then, the computer 100 may acquire and execute each program from these portable physical media. In addition, each program is stored in another computer or server device connected to the computer 100 via a public line, the Internet, a LAN, a WAN, etc., and the computer 100 acquires and executes each program from these. It may be.

1 Color patch 3 Through hole C1, C2, C3, C4, C5, C6, C7, C8, C9, C10, C11, C12, C13, C14, C15, C16 Marking area W1, W2, W3, W4 White marking area DESCRIPTION OF SYMBOLS 10 Image processing apparatus 11 Camera 13 Memory | storage part 13a Measurement area data 13b Corresponding outline point data 13c Arrangement order data 15 Control part 15a Acquisition part 15b Grouping part 15c Selection part 15d Numbering part 15e Extraction part 15f Assignment part 15g Update part 15h Calculation part 15j 1st matching part 15k 2nd matching part 15m Penetrating area discrimination | determination part 15n Output part

Claims (4)

An acquisition unit for acquiring images;
A grouping unit that groups pixels having similar pixel values between adjacent pixels among the pixels included in the image;
Among the grouped areas, the color markers included in the image, the display surface on which the color marking region is formed, and the through hole penetrating the back surface of the display surface are formed, and the marking region of the same color is formed A selection unit for selecting a color measurement region formed by through holes of color targets respectively formed on both sides of the display surface across the through hole;
A numbering unit for numbering each contour pixel forming the contour of the measurement region on the image;
For each contour pixel of the measurement region, an extraction unit that extracts a corresponding contour pixel that is the closest to the contour pixel of the measurement region out of the contour pixels that form the contour of each region;
An assigning unit for assigning a contour pixel number of the measurement region to the corresponding contour pixel;
Each time the corresponding contour pixel is extracted, the number of corresponding contour pixels that the region has for the region from which the corresponding contour pixel is extracted, and the corresponding contour pixel that the region has An update unit for updating the total number of contour pixel numbers in the measurement region;
Using a total value of the number of contour pixels of the measurement region assigned to the corresponding contour pixel and the number of the corresponding contour pixels, a calculation unit that calculates a representative value of the region for each region;
Using a representative value calculated for each area, and an association unit that associates the areas in the clockwise or counterclockwise order around the measurement area, which is the order of the color target marking areas. An image processing apparatus.   2. The image processing according to claim 1, wherein the calculation unit calculates the representative value for a region where the number of the corresponding contour pixels is larger than a threshold set from the number of the corresponding contour pixels having the maximum number. apparatus. On the computer,
Get an image,
Grouping pixels having similar pixel values between adjacent pixels among the pixels included in the image;
Among the grouped areas, the color markers included in the image, the display surface on which the color marking region is formed, and the through hole penetrating the back surface of the display surface are formed, and the marking region of the same color is formed Select a color measurement area formed by the through holes of the color targets formed on both sides of the display surface across the through hole,
Number each contour pixel that forms the contour of the measurement area on the image,
For each contour pixel of the measurement region, extract the corresponding contour pixel that is the closest to the contour pixel of the measurement region from the contour pixels that form the contour of each region,
Giving a contour pixel number of the measurement region to the corresponding contour pixel,
Each time the corresponding contour pixel is extracted, the number of corresponding contour pixels that the region has for the region from which the corresponding contour pixel is extracted, and the corresponding contour pixel that the region has Update the total number of contour pixel numbers in the measurement area,
Using the total value of the contour pixel numbers of the measurement region assigned to the corresponding contour pixel and the number of the corresponding contour pixels, a representative value of the region is calculated for each region,
Using the representative value calculated for each area, the process of associating the areas with the order of the marking areas of the color targets in the clockwise or counterclockwise order of circulating around the measurement area is performed. An image processing program. Computer
Get an image,
Grouping pixels having similar pixel values between adjacent pixels among the pixels included in the image;
Among the grouped areas, the color markers included in the image, the display surface on which the color marking region is formed, and the through hole penetrating the back surface of the display surface are formed, and the marking region of the same color is formed Select a color measurement area formed by the through holes of the color targets formed on both sides of the display surface across the through hole,
Number each contour pixel that forms the contour of the measurement area on the image,
For each contour pixel of the measurement region, extract the corresponding contour pixel that is the closest to the contour pixel of the measurement region from the contour pixels that form the contour of each region,
Giving a contour pixel number of the measurement region to the corresponding contour pixel,
Each time the corresponding contour pixel is extracted, the number of corresponding contour pixels that the region has for the region from which the corresponding contour pixel is extracted, and the corresponding contour pixel that the region has Update the total number of contour pixel numbers in the measurement area,
Using the total value of the contour pixel numbers of the measurement region assigned to the corresponding contour pixel and the number of the corresponding contour pixels, a representative value of the region is calculated for each region,
Using the representative value calculated for each area, the process of associating the areas in the clockwise or counterclockwise order that circulates around the measurement area, which is the order of the marking areas of the color targets, is performed. An image processing method.

Images