JP2000339442A - Picture coloring method, picture coloring device and recording medium recording picture coloring block - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce calculation quantity at the time of referring to a colored line picture and judging closed areas where the same colors are painted. SOLUTION: Feature quantity extraction processing parts 15 and 16 separate all closed areas of a reference line picture and a line picture being a colored object. A color candidate list generation processing part 17 calculates features, calculates the change of feature quantity among the closed areas with the combination of the closed areas of the reference line picture, which are obtained by calculating the features, and the closed areas of the line pictures being the colored objects, sequences all the closed areas of the reference line picture in order from the smallest change of the feature quantity at every closed area of the line picture of the colored object and takes a corresponding relation. Color information corresponding to all the closed areas of the reference line picture is obtained from a reference picture and the overlap of color information is omitted from the corresponding relation of all the closed areas of the reference line picture against the closed area of the line picture of the colored object. A color candidate list is generated on all the closed areas of the line picture being the colored object. A colored object line picture coloring processing part 18 automatically colors the highest color on the line picture of the colored object.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image coloring apparatus for coloring a plurality of line images.

[0002]

2. Description of the Related Art Conventionally, line drawings drawn on paper in animation production have been transferred to cells and colored by hand with a paintbrush. In recent years, this work has been replaced by digital painting in which a line drawing drawn on paper is converted into digital data by a scanner and colored on a computer, and the spread has begun. As a result, the task of coloring cells, which has been very difficult in the past, has been greatly simplified. However, it is still necessary to manually color digitized line image data one by one. There is also a technique in which a plurality of line images are colored at once by specifying a common painting start coordinate (seed point) of an area to be painted in the same color by overlapping a plurality of line images (Japanese Patent No. 2835752, No. 9-134422).

[0003] Japanese Patent No. 2835752 discloses, for example, when coloring a plurality of continuous line drawings, extracting the center of gravity position of a closed area and the length and width of a circumscribed rectangle as feature quantities, and using the feature quantities to close each closed color picture. The region is colored in association with the closed region of the colored image. This makes it possible to associate a relatively small movement area with a colored area and color those areas with the same color.

Japanese Patent Application Laid-Open No. Hei 9-134422 discloses a method for color-coding a closed region of a line drawing by correlating one coordinate point determined in the closed region of the line drawing and a color type selected corresponding to the coordinate point. On the other hand, when the coordinate points are located in the same closed area in the subsequent line drawing, the color type corresponding to the recorded coordinate point is called and added in the closed area, so that continuous It is a quick and efficient coloring process for moving original images.

[0005]

SUMMARY OF THE INVENTION Patent No. 2835752
In the reference, only the position of the center of gravity of the closed region and the length and width of the circumscribed rectangle are extracted and used as feature data, and there is a problem that the amount of calculation for calculating the position of the center of gravity of an arbitrary shape is large.

Japanese Unexamined Patent Publication No. Hei 9-134422 discloses a method in which, when a plurality of uncolored line drawings are overlapped as closed regions which are semantically the same and are to be painted in the same color, seeds having the same coordinates in the plurality of line drawings are used. This is to use points to paint the corresponding closed areas of multiple achromatic videos at a stretch, so there is a coordinate where several semantically the same closed areas that should be painted in the same color overlap in multiple line drawings It is premised that only areas with relatively small movements can be associated, and that requires much judgment by the operator.

SUMMARY OF THE INVENTION It is an object of the present invention to reduce the amount of calculation when determining a closed area to be painted with the same color by referring to a colored cell image, and it is necessary for an operator to determine the degree of overlap between a plurality of line images. An object of the present invention is to provide an image coloring method, an apparatus, and a recording medium on which an image coloring program is recorded.

[0008]

According to the image coloring method of the present invention, original line drawing data (hereinafter referred to as reference line drawing) of sample already colored image data (hereinafter referred to as reference drawing) read from a storage device. ), A reference line drawing closed region separation processing step of separating all the closed regions constituting the reference line drawing, and a reference line drawing extracting one or more types of feature values other than the center of gravity of the closed region of the extracted reference line drawing. A closed region feature amount extraction processing step, and a chromatic object line drawing closed region that separates all closed regions constituting line object data to be colored (hereinafter referred to as a chromatic object line drawing) read from the storage device; A separation processing stage, and a chromatic color target line drawing closed area feature value extraction processing stage for extracting one or more types of characteristic amounts other than the center of gravity of the closed region of the extracted chromatic color target line image And a combination of all the closed regions of the obtained reference line drawing and all the closed regions of the chromatic object line drawing, and calculates a change amount of the characteristic amount between them, and calculates the characteristic for each closed region of the chromatic object line drawing. All the closed areas of the reference line drawing are ordered in ascending order of the amount of change, and a correspondence is obtained. The color information corresponding to all the closed areas of the reference line drawing is obtained from the reference picture, and the reference line drawing for the closed area of the target color drawing is obtained. A color candidate list creation processing step of creating a color candidate list for all closed regions of the chromatic object line drawing by eliminating duplication of color information from the correspondence relationship of all closed regions of Has a coloring target line drawing coloring step of coloring the color at the head of each color candidate list to the coloring target line drawing.

A first feature of the present invention is that the position of the center of gravity of a closed region is not used as a feature amount. This is because the amount of calculation for calculating the position of the center of gravity of an arbitrary shape is extremely large.

In the present invention, a) the coordinates of the center of the smallest rectangle circumscribing the closed area b) the area of the smallest rectangle circumscribing the closed area c) the aspect ratio of the smallest rectangle circumscribing the closed area d) the closed area E) Ratio of b and d above f) Perimeter of closed area g) Ratio of f to square root of d, etc. are used as feature quantities.

Instead of devoting a large amount of calculation to detecting the position of the center of gravity, a process of searching for a similar shape with high accuracy using these plural feature amounts can be realized.

A second feature of the present invention is that all the closed regions constituting the reference line drawing and the chromatic object line drawing are separated, and all the closed regions of the reference line drawing obtained by calculating their characteristic amounts. In all combinations between and the feature values of all the closed regions of the color target line image, the change amount of the feature amount between them is calculated, and the change amount of the characteristic amount is small for each closed region of the color target line image. All the closed areas of the reference line drawing are ordered in order to obtain a correspondence relationship, color information corresponding to all the closed areas of the reference line drawing is obtained from the reference picture, and the closed areas of the reference line drawing with respect to the closed areas of the coloring target line drawing are obtained. By eliminating the duplication of color information from the correspondence relationship, a color candidate list is created for all the closed regions of the chromatic object line drawing, so that all the closed regions of the chromatic object line drawing can be reliably determined. The color of the top-level to create a color candidate list to have the order is to color automatically to the color target line drawing. As a result, no unpainting occurs.

A third feature of the present invention is that a seed point is set at an arbitrary position within the closed area in order to associate a closed area between the reference picture and the achromatic line drawing by a shape and a position independently of the seed point. Can be set appropriately by a program, and there is no need for the operator to consider at all such as the degree of overlap between a plurality of line drawings, and the processing automatically proceeds without any need for asking the operator for judgment. In addition, even when a painting error occurs, the color candidate list can be displayed and changed anywhere in the closed area, so that the operator does not need to be aware of the seed point in the first place.

A fourth feature of the present invention resides in that a colored object line drawing which has been colored is presented to a user, and a created color candidate list is presented for a closed area requested by the user. By changing the color of the closed area designated by selecting a color on the color candidate list to the selected color, the minimum area of the mouse pointer on the screen can be used to change the color of the closed area to the wrong color. Colors can be easily checked and corrected. In addition, the corrected colored object line drawing and the color object line drawing are newly defined as reference pictures / reference line drawings, and the automatic coloring of the color object line drawing after the corrected colored object line drawing is recalculated. By giving the instruction, it is possible to reduce errors in the automatic coloring of the line object to be colored after the correction work.

A fifth feature of the present invention is that, when coloring a reference picture, an alias is given to the color in advance when the color is designated, and the alias is presented together with the color candidate list to be presented to the user. Then, the user can more easily and surely specify the color.

[0016]

Next, embodiments of the present invention will be described with reference to the drawings.

Referring to FIG. 1, an image coloring apparatus according to a first embodiment of the present invention comprises a storage device 11, an image reading processing unit 12, a reference line drawing closed region separation processing unit 13, and a chromatic color target line drawing closed region separation process. Unit 14, reference line drawing closed area feature extraction processing unit 15, chromatic object line drawing closed area feature extraction processing unit 16, color candidate list creation processing unit 17, chromatic object line drawing coloring processing unit 18, and colored object line drawing The storage processing unit 19 is configured.

The storage device 11 stores a reference line drawing, a reference picture, and a color object line drawing as shown in FIG. 14, and also stores a colored object line drawing obtained as a result of the processing.

The image reading processing unit 12 reads out a reference line drawing, a reference picture, and a line drawing to be colored from the storage device 11, and performs the next line drawing to be colored using the same reference picture and reference line drawing. Only the coloring target line image is read from the storage device 11.

The reference line drawing closed area separation processing section 13 extracts all the closed areas constituting the reference line drawing.
Since it is premised that coloring is performed on digital data, all the closed areas to be colored and colored must be completely closed areas by boundaries (the colors are not necessarily black). .

There are various methods for separating a closed area in a still image. Here, as an example, a method of assigning different numbers to all closed areas constituting a reference line drawing will be described. FIG. 2 shows an example of the format of the reference line drawing closed area data created as a result. As shown in this figure, a closed area number to which each belongs is assigned as closed area data corresponding to each pixel. Special value (maximum value that can be taken in FIG. 2) for pixels belonging to the boundary line
To indicate that they are on the boundary line, and at the same time, completely protect the boundary line from later coloring processing. The size in the x direction and the y direction is equal to the number of pixels (x _size , y _size ) in the x direction and the y direction of the reference line drawing.

FIG. 3 shows an example of the processing performed here. First, the maximum value (MAX) of all possible data of the closed area
VALUE) (step 21). MAXV
ALUE is selected so as to be larger than the number of closed regions constituting the reference line drawing. Next, for example, the closed area number starts from 0, and (x, y) = (0,
0) (steps 22 and 2).
3). First, using (0,0) as a seed point, the closed area data of the corresponding pixel of the reference line drawing is MAXVALU.
In the case of E and the color of the corresponding pixel of the reference line drawing is white (the boundary line other than black—the color tress line is also treated as a boundary line by this processing), the reference line drawing (0,
The value of the reference line drawing closed area data connected from 0) is M
An area of AXVALUE in which the pixel of the corresponding reference line drawing is white is filled with reference line drawing closed region data 0 (steps 24 to 27). After all target reference line drawing closed area data are filled with 0, the closed area data is set to 1
In a similar manner, a pixel whose reference line drawing closed area data value is MAXVALUE and the color of the corresponding pixel of the reference line drawing is white is searched for, and the same process is repeated using the pixel as the next seed point. As a result, a boundary line separating the reference line drawing into a closed region has MAXVALUE on the reference line drawing closed region data, and all other closed regions are numbered and separated by an integer from 0 for each different closed region. In the closed area numbering process (FIG. 3B), (x, y) is first converted to (a, b)
(Step 31), and a and b are respectively x _size ,
y is smaller than y _size , (a, b) in the reference line drawing is white, and (a, b) of the closed area data is MAXVALUE
, The specified value (closed area number) is inserted in (a, b) of the closed area data (steps 32 to 34), the value of a is ± 1, and the value of b is ± 1 (step 32). 35-38),
The closed area numbering process (step 27) is recursively called.

The chromatic object line drawing closed area separation processing unit 14
The same processing as that performed by the reference line image closed area separation processing unit 13 is also performed on the line object to be colored. In the example described above, as a result, the boundary line that separates the chromatic object line drawing into a closed region is also represented by M on the chromatic object line drawing closed region data.
AXVALUE is entered, and other closed regions are numbered and separated by an integer from 0 for each different closed region (x
₍ color _size , y _size ) is obtained.

The reference line drawing closed region feature value extraction processing unit 15 extracts the feature value of each closed region separated by the reference line drawing closed region separation processing unit 13. Here, the following seven examples are given as examples of the feature amounts (FIG. 4). 1. The coordinates of the center of the rectangle circumscribing the closed area (Fig. 4
(1)) 2. 2. The area of a rectangle circumscribing the closed region (FIG. 4 (2)) 3. Aspect ratio of the rectangle circumscribing the closed area (FIG. 4 (3)) 4. Number of pixels constituting closed area (FIG. 4 (4)) 5. Ratio of above 2 and 4 (FIG. 4 (5)) 6. Length of outer periphery of closed region (FIG. 4 (6)) The ratio of the square root of 6 and 4 above. However, in FIG. 4, the boundary is drawn in the closed region for easy understanding, but in the example described above, the boundary is actually included in the separated closed region. Absent.

A method of calculating the above-described feature quantities 1 to 7 will be described.

The minimum value of x of the rectangle circumscribing the closed area i,
The maximum value, the minimum value of y and the maximum value are x_min(i), x
_max(i), y_min(i), y_max(i), a rectangle circumscribing closed area i
The x and y coordinates of the center of the shape are center (i).
x, center (i) .y, a rectangle circumscribing the closed area i
Area is area_rec (i), rectangle circumscribing closed area i
The aspect ratio of the shape is assumed to be aspect_ratio (i), the closed area i
Pixel (i) is the number of pixels constituting
The number of pixels forming the outer periphery is assumed to be circular (i). 1. Calculation of feature amount 1 (FIG. 5) First, parameter x_min(i), y_min(i), x_max(i), y
_maxInitialization of (i) is performed (FIG. 5A). Closed area number i
Initialization (step 41), x_min(i) = x_size, Y
_min(i) = y_size, X_max(i) = 0, y_max(i) = 0 initial
The conversion is performed for all areas (steps 42 to 44).
Next, the coordinates (cen) of the center of the rectangle circumscribing the closed area i
ter (i) .x, center (i) .y) (FIG. 5)
(B)). The coordinates (x, y) of the closed area i are scanned and i
Is filled with the closed area number of the coordinates (x, y) (step 51,
52, 53), if the closed area number i does not indicate a boundary line
If x <x_minIf (i) x is x_min(i) and x> x
_maxIf (i) x is x_max(i) and y <y_min(i)
If y_min(i) and y> y_maxFor (i), y is y
_max(i) (steps 54 and 55). Scan finished
Then, the area number i is initialized (step 71), and the closed area
The coordinates of the center of the rectangle circumscribing i (center (i).
x, center (i) .y) (steps 72 to 72).
74). 2. Calculation of feature amount 2 (FIG. 6) First, similarly to the case of feature amount 1, parameter x_min(i),
y_min(i), x_max(i), y_maxInitialize (i) (Fig. 6
(A)). Next, a rectangular area ar circumscribing the closed region i
ea_rec (i) is calculated (FIG. 6B). Processing is special
As in the case of collection 1, step 73 is used instead of step 73.
Perform 75. 3. Calculation of feature amount 3 (FIG. 7) First, the parameter x is set in the same manner as in the case of feature amounts 1 and 2.
_min(i), y_min(i), x_max(i), y_maxInitialize (i)
(FIG. 7 (a)). Next, the length of the rectangle circumscribing the closed area i
Calculate the aspect ratio aspect_ratio (i) (FIG. 7)
(B)). The processing is the same as that for the feature amount 1,
The process of step 76 is performed instead of 3. 4. Calculation of feature amount 4 (FIG. 8) First, an area, which is a parameter necessary for calculation of feature amount 4,
Initialize the number of pixels pixels [i] of i (see FIG.
8 (a)). This replaces step 43 in FIG.
The processing of step 45 is performed. Next, a closed region i is formed.
The number of pixels to be calculated is calculated (FIG. 8B). This is shown in FIG.
The processing of step 56 is performed instead of step 55 of (b).
Steps 71 to 74 are not performed. 5. Calculation of feature value 5 (FIG. 9) First, a parameter x required for calculation of feature value 5_min(i), y
_min(i), x_max(i), y _max(i), initializing pixels (i)
(FIG. 9A). This corresponds to step 4 in FIG.
The process of step 46 is performed instead of 3. Next, in the closed area
Ratio of the area of the circumscribed rectangle to the number of pixels ratio_rec
tpix (i) is calculated (FIG. 9B). This is the figure
The processing of step 57 is performed instead of step 55 of 5 (b).
And perform step 77 instead of step 73.
U. 6. Calculation of feature value 6 (FIG. 10) First, a parameter required for calculation of feature value 6,
First the number of pixels that constitute the outer periphery of area i, circular (i)
(FIG. 10A). This corresponds to the step shown in FIG.
Step 47 is performed instead of step 43. Next, the closed area i
Calculates the circumference circum (i) of FIG.
(B)). Before starting the scan in each y direction, one before
(Previous closed area data) number i of the closed area data detected
_oldThe maximum value i_max(Step 5
8). The value of the closed area data of i = (x, y) indicates the boundary line
If not, i_old<I_maxAnd i @ i_oldWhether
(Step 59), and if “No”, i is a riff.
Return to step 52 because it is a point on the outer frame of the reference line drawing
If "Yes", the number of pixels circum (i),
circuit [i_old] Is incremented by 1 (step
60), i_oldIs set to the value of i (step 61). 7. Calculation of feature value 7 (FIG. 11) First, a closed region which is a parameter required for calculation of feature value 7
The number of pixels constituting i, pixels (i), and the closed area i
Initializes the number of pixels circum (i) constituting the outer periphery of
(FIG. 11A). This is the step shown in FIG.
Step 48 is performed instead of 43. Next, outside the closed area i
Number of pixels constituting the circumference and pixels constituting the closed area i
Calculate the ratio of the square root of the number shape (i) (FIG. 11)
(B)). This follows step 54 of FIG.
Step 62 is added.

FIG. 12 shows a configuration in which each feature value is calculated with a small amount of calculation by simultaneously calculating feature values 1 to 7. Steps 49, 63 and 78 are performed instead of steps 48, 62 and 77 in FIG.

As described above, the feature amounts (hereinafter, feature amount 1) are set for all the closed regions constituting the reference line drawing.
Is calculated for each closed area as shown in Table 1.

[0029]

[Table 1] The chromatic object line drawing closed region feature amount extraction processing unit 16 performs the same processing as the reference line image closed region feature amount extraction processing unit 15 on the chromatic object line image. As a result, the above-mentioned feature amount is stored for each of all the closed regions constituting the color target line drawing.

First, the color candidate list creation processing unit 17 calculates the above-mentioned feature amount for all combinations between all the closed regions of the chromatic color target line drawing and all the closed regions of the reference line drawing whose closed regions have been separated in the above processing. Calculate the change. The definition of the change depends on the feature value. For example, in the case of the feature amount 1, it is appropriate to set the distance between the coordinates, and in the case of the feature amounts 2 to 5, it is appropriate to use the ratio as the change. There may be some types of feature values that were not included in the above example, but are appropriate to be used as a change in the feature value with a difference. If all the above-mentioned changes are smaller than 1 in the closed area of the line object to be colored and the closed area of all the reference line drawings, the reciprocal is taken, sorted in ascending order of the value, arranged and stored (Table 2).

[0031]

[Table 2] Tables 2 to 5 show cases where the reference line drawing is composed of four closed regions. Tables 2 to 5 do not particularly describe the number of closed regions forming the chromatic color target line image, but there is no problem in the processing even if the reference line image and the chromatic color target line image have different numbers of closed regions.

Next, each variation is normalized for the closed region of the chromatic object line image obtained above. Regarding the change amount of each feature amount between the closed region of a certain color target line drawing and all the closed regions of the reference line drawing, here, as an example, the smaller the change amount of the feature amount calculated above, the smaller the value is. In the case where the calculated set of the closed region of the chromatic object line drawing and the closed region of the reference line drawing can be considered to be close with respect to the feature (all of the above five feature amounts used as examples here are applicable). Value V
The _min to 0.0, explaining that normalizing the maximum value V _max of the feature variation 1.0. The value _Vorg between them is converted into the following value V by a simple linear transformation.

[0033]

(Equation 1) This normalization is calculated for all changes. Table 3 shows an example of the results.

[0034]

[Table 3] Next, the changes calculated for each feature amount are integrated and evaluated. Variations of the above feature values (V ₁ , V ₂ , V ₃ , V ₄ ,
Weighting of evaluation from the user about the V ₅₎ can be specified. Each value of weight and _{W 1, W 2, W 3} , W 4, W 5.
Where they _{weights, 0.0 <W 1, W 2} , W 3, W 4, W 5 <1.0 will be described as applied are normalized to. Using the values of these weights, an integrated change between each of all the closed regions of the reference line drawing with respect to all of the closed regions of the coloring target line drawing is obtained by the following equation.

[0035]

(Equation 2) This calculation is performed between each of all the closed regions of the reference line drawing for all the closed regions of all the coloring target line drawings,
Sort in ascending order of values (Table 4).

[0036]

[Table 4] Next, a color corresponding to the closed area of the reference line drawing is extracted from the reference drawing. When the same color is painted on the reference picture in a plurality of closed areas of the reference line drawing, the top of the above list is left and duplication is eliminated. As a result, as a result, a color candidate list was created in a probable order for all the closed regions of the color object line drawing (Table 5).

[0037]

[Table 5] It is also possible for the user to set a threshold value for the change of each feature amount. In this case, the combination of the closed region of the chromatic object line drawing and the closed region of the reference line drawing in which even one variation of the feature amount exceeds the threshold value is calculated after the integrated variation is calculated by the equation (2) and sorted. It must be later on the list than the value that did not exceed the threshold value in all the changes in the feature amount. Perform that operation during normalization.
In this case, the maximum value that does not exceed the threshold value in equation (1) is V
_{If the} value does not exceed the threshold as _max , the same normalization processing as in equation (1) is performed. For the value exceeding the threshold, a value satisfying the following condition is given. For example, when the threshold value is exceeded for the feature amount 1,

[0038]

(Equation 3) Is satisfied, even if all other standardized feature amount changes are 0, the integrated change amount is when all the standardized feature amount changes are 1. Since the change is larger than the integrated change of the color candidate list, it is possible to create a color candidate list by performing sorting including the value, and to exclude the color candidate list from the color candidate list. When W ₁ = 0 in the above equation, the value becomes indefinite in the equation, but in this case, whatever value is put in V _ex1 , it is not evaluated at all by the equation (2).

Further, if this threshold value is used, when a closed area is necessarily large on a line drawing as in the effect of the camera approaching the object or the object approaching the camera, the change of the feature amounts 2 and 4 becomes larger. If it becomes smaller, it is treated the same as the one exceeding the threshold. Conversely, when the closed area is always small on the line drawing, such as in an effect in which the camera moves away from the object or the object moves away from the camera, the feature amount 2
If the amount of change of 4 is larger, the same treatment as that exceeding the threshold is performed, so that the color candidate list obtained for all the closed regions of the resulting colored object line drawing is made more probable. can do.

The chromatic object line drawing coloring processing section 18 applies the highest color in the color candidate list for all closed regions of the chromatic object line drawing obtained in the above processing to all the corresponding closed regions of the chromatic object line drawing. To paint. Various methods are also conceivable for the coloring method. Here, a method according to the method for separating a closed region described above as an example in FIG. 13 will be described.

Coloring is started with a certain coordinate (x, y) in a closed area to be colored in the target line drawing to be colored as a seed point (steps 81 to 83).
If (x, y) is appropriate as a coordinate value, and the chromatic object line drawing closed area data at the coordinates (x, y) is equal to the closed area data of the chromatic object line image specified, the chromatic object line image The value of the designated color is entered in the coordinates of (steps 91 to 94). Then, in order to perform the same processing for the upper, lower, left, and right coordinates, the values of x and y are respectively ± 1 (steps 95 to 98), and recursive calls are performed. This prevents irrelevant colors from being colored in the irrelevant closed area, and the boundary is completely protected. The colored subject line drawing storage processing unit 19 stores the colored subject line image painted in the above process in the storage device 11. This processing is a general one and will not be described in detail.

After the above processing is completed, the next line image to be colored is read out, and the same processing is performed for coloring. When the same reference picture / reference line drawing is used, the image reading processing unit 12 is instructed only to read the next color object line drawing while retaining all the information about the reference picture / reference line drawing already held. In this case, it is not necessary to perform the processes in the reference line drawing closed region separation processing unit 13 and the reference line drawing closed region feature amount extraction processing unit 15. Also,
If the colored line drawing that has been colored in the above process and the line drawing that is the source of the coloring are newly used as the reference picture / reference line drawing, all information is converted from the line drawing target line drawing to the reference line drawing. After shifting from the color object line drawing to the reference picture, the image reading processing unit 12 is instructed to read the next color object line image, and the same processing is performed thereafter to perform coloring. When a new reference picture / reference line drawing is designated, the same processing described here is repeated.

FIG. 15 is a block diagram of an image coloring apparatus according to a second embodiment of the present invention. This embodiment includes a colored object line drawing / color candidate list / closed area information storage processing unit 101 instead of the colored object line image storage processing unit 19 of the first embodiment in FIG. A color object line drawing / color candidate list / closed area information read processing unit 102, a colored object line drawing presenting unit 103, a colored object line drawing color correction processing unit 104, and a colored object line image storage processing unit 105 It is newly prepared.

In the first embodiment, the colored object line drawing / color candidate list / closed area information storage processing unit 101 stores only the colored object line image which has been colored in the first embodiment, but is created in the first embodiment. The corresponding color candidate list and the separated closed area data created in the first embodiment are also stored. The storage device 11 stores all designated color object line drawings.

The colored object line drawing / color candidate list / closed area information reading processing unit 102 is a result of performing the coloring process on all the designated line objects to be colored.
The color candidate list and the closed area information corresponding to the colored line object to be colored are sequentially read from the storage device 11 according to a user's instruction.

The colored subject line drawing presentation unit 103 displays the colored subject line image on a display device (CRT, LCD, or the like). This process is a general process and will not be described in detail.

Colored object line drawing color correction processing unit 104
When the user clicks the mouse button on the closed area pointed by the mouse pointer on the colored object line drawing presented on the display device by the colored object line drawing presenting unit 103, the mouse pointer is indicated by the coordinates of the mouse pointer. Since the closed area number is known, the color candidate list created in the first embodiment corresponding to the number, stored in the storage device 11 in the second embodiment, and read out is displayed in the order in which the colored object line image has been colored. Is displayed on the color candidate list, and by selecting a color candidate with the mouse pointer on the color candidate list, the color of the corresponding closed area previously pointed by the mouse pointer is selected from the color of the selected color candidate list. Change to Thus, even if there is an error in the color selected in the first embodiment, the correct color has a high probability of being at the top of the color candidate list, so that the color can be easily changed with a small amount of movement of the mouse pointer. is there.

FIG. 16 shows an example of the displayed color candidate list. The order of the displayed color candidates is the same as the order of the color candidate list obtained in the first embodiment, and the color of the topmost color in the list is colored first. By presenting the color candidate list only by the color itself, it becomes difficult to select a similar color when many similar colors are used. Therefore, in FIG. 16, the color data values are also displayed side by side. Also, (R, G,
B) When (255, 255, 255) is treated as transparent, the difference from white (254, 254, 254) is difficult to recognize on the screen. This also makes it easier for the user to distinguish by displaying the color data, but in addition, in FIG. 16, a display (in FIG. 16, the word “transparent”) that is easy to understand that it is transparent is overlaid on the color display area. This makes it easy for the user to recognize it.

If the selected color is different from the already painted color, the color of the closed area is repainted to a newly designated color.
For this process, for example, the process of FIG. 13 can be diverted as it is.

Colored object line drawing storage processing unit 105
Saves in the storage device 11 the colored line object to be colored changed in the above processing. The corresponding color candidate list may be the same as the color candidate list already stored in the storage device, and is not newly stored.

In the first embodiment, when all the colored line objects to be colored which have been automatically colored are manually confirmed and corrected, the above processing is repeated. Alternatively, the colored object line drawing that has been confirmed and corrected manually is used as a new reference picture, and the original line object coloring object is used as a reference line drawing, from the colored object line drawing corrected manually. When re-automatic coloring is performed on the subsequent line to be colored, the instruction to change the reference picture / line and the instruction to recalculate the line to be colored after the corrected line to be colored are sent to the image read processing unit 12, so that the image reading processing unit 12 can be used. Automatic coloring of the subsequent color object line drawing can be performed more reliably by using the colored object line drawing that has been corrected in the work.

FIG. 17 is a block diagram of an image coloring apparatus according to a third embodiment of the present invention. In the present embodiment, a colored object line drawing / color candidate list / closed area information storage processing unit 101 of the second embodiment, a colored object line drawing color correction processing unit 10
4 includes a colored object line drawing / color candidate list / closed area information storage processing unit 101 'and a colored object line drawing color correction processing unit 104' instead of the color object list creation / storage processing unit 106 An alias list read processing unit 107 is newly provided.

The color alias list creating / storing unit 106 assigns an alias to the color used in the sequence and saves the color prior to the color correction of the closed area according to the second embodiment. For example, as shown in FIG. 18, a name that is intuitively understandable at the time of color correction in the second embodiment is registered here. The color alias list is stored in the form shown in Table 6.

[0054]

[Table 6] The color alias list reading unit 107 reads one or a plurality of color alias lists stored in the storage device 11.

Colored object line drawing color correction processing unit 10
4 ′ is 1 read by the color alias list reading unit 107
One or a plurality of color alias lists are displayed according to the corresponding color list of the color candidate list displayed by the colored line object color correction processing unit 104 of the second embodiment (FIG. 1).
9). This makes it possible to check and correct misapplications more easily and intuitively than in the second embodiment.

Referring to FIG. 20, an image coloring apparatus according to a fourth embodiment of the present invention comprises an input device 110 and a storage device 11.
1, 112, an output device 113, a recording medium 114, and a data processing device 115. The input device 110 is for inputting an image or the like. The storage device 111 corresponds to the storage device 11 in FIG. 1, FIG. 15, and FIG. The storage device 112 is a main storage device. The output device 113 is for displaying an image or the like. Recording medium 114 is FD
(Floppy disk), CD-ROM, MO (magneto-optical disk), and other recording media on which an image coloring program composed of the components shown in FIGS. 1, 15, and 17 is recorded. The data processing device 115 is a CPU that reads an image coloring program from the recording medium 114 and executes the program.

[0057]

According to the invention of the first, thirteenth, and sixteenth aspects (first invention), it is possible to reduce the amount of calculation when determining a closed area in which the same closed area is painted by referring to a colored line drawing, and A color candidate list is created for all the closed areas of the target color image in a probable order, and the highest color is automatically applied to the color target color image, so that no unpainting occurs.

According to the eleventh, fourteenth, and seventeenth inventions (the second invention), it is possible to easily check and change the color applied in the first invention when there is an error, thereby reducing the labor of the coloring operator. Can be further reduced.

According to the invention of claims 12, 15 and 18,
The painting error can be corrected more easily than in the second invention, and the labor of the coloring operator can be further reduced.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of an image coloring device according to a first embodiment of the present invention.

FIG. 2 is a diagram illustrating an example of a format of reference line drawing closed area data.

FIG. 3 is a flowchart illustrating a process of a reference line drawing closed area separation processing unit 13;

FIG. 4 is a diagram illustrating an example of a feature amount of a separated closed region.

FIG. 5 is a flowchart illustrating a method for calculating a feature quantity 1;

FIG. 6 is a flowchart illustrating a method for calculating a feature quantity 2;

FIG. 7 is a flowchart illustrating a method of calculating a feature value 3;

FIG. 8 is a flowchart illustrating a method for calculating a feature quantity 4;

FIG. 9 is a flowchart illustrating a method for calculating a feature value 5;

FIG. 10 is a flowchart illustrating a calculation method of a feature value 6;

FIG. 11 is a flowchart showing a method for calculating a feature value 7;

FIG. 12 is a flowchart illustrating a calculation method for calculating a plurality of feature amounts simultaneously.

FIG. 13 is a flowchart illustrating a method of coloring a corresponding closed region of a color target line image with the highest color in the obtained color candidate list.

FIG. 14 is a diagram illustrating an example of a color object line drawing, a reference line drawing, and a reference picture.

FIG. 15 is a configuration diagram of an image coloring device according to a second embodiment of the present invention.

FIG. 16 is a diagram illustrating an example of a method for easily performing color correction in the second embodiment.

FIG. 17 is a configuration diagram of an image coloring device according to a third embodiment of the present invention.

FIG. 18 is an explanatory diagram of a color alias list creation storage unit 106 according to the third embodiment.

FIG. 19 is a diagram illustrating an example in which a color alias list is displayed together with a color candidate list presented to a user in the second embodiment.

FIG. 20 is a configuration diagram of an image coloring device according to a fourth embodiment of the present invention.

[Explanation of symbols]

REFERENCE SIGNS LIST 11 storage device 12 image reading processing unit 13 reference line drawing closed region separation processing unit 14 chromatic object line drawing closed region separation processing unit 15 reference line drawing closed region feature amount extraction processing unit 16 chromatic object target line drawing closed region feature extraction processing unit 17 colors Candidate list creation processing unit 18 Color object line drawing coloring processing unit 19 Colored object line drawing storage processing unit 21-28, 31-38, 41-49, 51-63, 7
1-78 Steps 81-83, 91-98 Steps 101, 101 ′ Colored line drawing / color candidate list / closed area information storage processor 102 Colored line drawing / color candidate list / color candidate list / closed area information read processing Unit 103 Painted colored object line drawing presenting unit 104, 104 'Colored colored object line drawing color correction processing unit 105 Colored colored object line drawing storage processing unit 106 Color alias list creation storage unit 107 Color alias list read processing unit 110 Input device 111, 112 Storage device 113 Output device 114 Recording medium 115 Data processing device

Continued on front page F term (reference) 5B050 AA10 BA07 BA08 BA12 DA04 EA03 EA05 EA07 EA09 EA12 EA22 EA24 FA09 5B057 BA24 BA25 CA01 CA08 CA12 CA16 CB01 CB08 CB12 CB16 CC03 CE09 CE11 CE16 CE17 DA08 DB02 DC06 DC09 DC03

Claims (18)

[Claims] An original line drawing data (hereinafter referred to as a reference line drawing) of a sample already colored image data (hereinafter referred to as a reference picture) read from a storage device.
And a reference line drawing closed region separation processing step of separating all the closed regions constituting the reference line drawing, and one of the closed regions of the extracted reference line drawing other than the center of gravity.
A reference line drawing closed region feature amount extraction processing step of extracting more than two types of feature amounts; and all closed lines constituting color object line image data (hereinafter referred to as color object line drawings) read from the storage device. A chromatic color target line drawing closed region separation processing stage for separating a region, and a chromatic color target line drawing closed region feature value extraction processing stage for extracting one or more types of features other than the center of gravity of the closed region of the extracted chromatic color target line drawing And calculating the amount of change in the characteristic amount between each of the obtained reference line drawings in combination with all the closed regions in the reference line drawing and all the closed regions in the coloring target line drawing. All the closed areas of the reference line art are ordered in ascending order of the amount of change, and a correspondence is obtained. The color information corresponding to all the closed areas of the reference line art is obtained from the reference picture, and the color object line art is closed. A color candidate list creation processing step of creating a color candidate list for all closed regions of the chromatic target line image by eliminating duplication of color information from the correspondence relationship of all closed regions of the reference line image to A coloring target line drawing coloring step of coloring a color at the head of each color candidate list to the coloring target line drawing with respect to the closed region. 2. The reference line drawing closed region extracting step initializes closed region data provided corresponding to each pixel forming the reference line drawing with a boundary value that is larger than the maximum value of the closed region number. Step: Initializing the x, y coordinates and the closed area number at the start of scanning of the reference line drawing, and sequentially scanning the reference line drawing, and the pixel of the coordinates in the reference line drawing is white and (x, y) If the closed area data of the coordinate is the boundary value, a process of assigning the closed area number as a closed area data to a pixel in the closed area including the (x, y) coordinate is performed, and the coordinate in the reference line drawing is performed. If the pixel is other than the above, there is a step of incrementing the closed region number by +1. In the process of assigning the closed region number, the coordinates are substituted into the processing coordinates, and the process in the reference line drawing is performed. While the pixel of the processing coordinates is white and the value of the closed area data is the boundary value, while moving the processing coordinates one pixel at a time up, down, left and right, the closed area number is assigned to the closed area data of the processing coordinates. In the same manner as the reference line image closed area separation processing, the chromatic object line image closed area separation processing assigns a closed area number as closed area data of each closed area of the chromatic color target line image, thereby obtaining 2. The method according to claim 1, wherein the closed area is separated.
The described method. 3. The reference line drawing closed area feature amount extraction processing step and the chromatic object target line image closed area feature amount extraction step include: a minimum value of an x coordinate, a minimum value of a y coordinate, and x of a rectangle circumscribing each closed area. Initializing the maximum value of the coordinate and the maximum value of the y coordinate; and the minimum value and the maximum value of the x coordinate of the rectangle circumscribing each closed region.
obtaining a minimum value and a maximum value of the y coordinate; and calculating the center coordinates of a rectangle circumscribing each closed region from the minimum value, the maximum value of the x coordinate and the minimum value and the maximum value of the y coordinate as the feature amount. 3. The method of claim 2, comprising: 4. The reference line drawing closed area feature value extraction processing step and the chromatic color target line image closed area feature value extraction step include: a minimum value of the x coordinate, a minimum value of the y coordinate, and x of a rectangle circumscribing each closed area. Initializing the maximum value of the coordinate and the maximum value of the y coordinate; and the minimum value and the maximum value of the x coordinate of the rectangle circumscribing each closed region.
calculating a minimum value and a maximum value of the y coordinate, and calculating the area of a rectangle circumscribing each closed region from the minimum value, the maximum value of the x coordinate and the minimum value and the maximum value of the y coordinate as the feature amount. 3. The method of claim 2, comprising: 5. The reference line drawing closed area feature value extraction processing step and the chromatic object target line drawing closed area feature value extraction step include: a minimum value of an x coordinate, a minimum value of ay coordinate of a rectangle circumscribing each closed area, x Initializing the maximum value of the coordinate and the maximum value of the y coordinate; obtaining the minimum value, maximum value and minimum value of the y coordinate of the rectangle circumscribing each closed area; The method according to claim 2, further comprising calculating an aspect ratio of a rectangle circumscribing an area from the minimum and maximum values of the x coordinate and the minimum and maximum values of the y coordinate as the feature amount. 6. The reference line drawing closed area feature value extraction processing step and the chromatic color target line image closed area feature value extraction step include: initializing the number of pixels of each closed area; and sequentially scanning the closed area data. , The number of pixels +1
Obtaining the number of pixels as the feature quantity by incrementing. 7. The reference line drawing closed area feature value extraction processing step and the chromatic object target line drawing closed area feature value extraction step include: a minimum value of an x coordinate, a minimum value of ay coordinate of a rectangle circumscribing each closed area, x Initializing the maximum value of the coordinates, the maximum value of the y coordinate, and the number of pixels; and sequentially scanning the closed area data, and if the closed area data of the point does not indicate a boundary line, the x coordinate of the closed area Calculating the minimum and maximum values of the y-coordinate and incrementing the number of pixels by +1; and determining the area of the rectangle circumscribing each closed area by the minimum, maximum and y-coordinates of the x-coordinate. 3. The method according to claim 2, further comprising calculating from the minimum value and the maximum value, and dividing the area by the pixel to obtain the feature amount. 4. 8. The reference line image closed area feature amount extraction processing step and the chromatic object line image closed area feature amount extraction step include a step of initializing an outer peripheral length of each closed area, and a previously detected closed area. The maximum value is set as pre-closed area data that is data, the closed area data is sequentially scanned, the value of the closed area data at the coordinates does not indicate a boundary line, and the number of the previous closed area data is If the number is smaller than the maximum value and the number of the closed area data is not equal to the number of the previous closed area data, the outer circumference of the closed area and the outer circumference of the previous closed area data are incremented by +1. 3. The method according to claim 2, further comprising a step of obtaining the outer peripheral length of each closed region as the feature amount by repeating the numbering. 9. The reference line drawing closed area feature value extraction processing step and the chromatic color target line image closed area feature value extraction step include: initializing the number of pixels and the length of the outer periphery of each closed area; The maximum value is set as the closed area data that is the closed area data, and the closed area data is sequentially scanned. If the value of the closed area data at the coordinates does not indicate a boundary line, the number of pixels is incremented by +1. If the number of the previous closed area data is smaller than the maximum value and the number of the closed area data is not equal to the number of the previous closed area data, the outer circumference of the closed area and the outer circumference of the closed area of the previous closed area data are incremented by +1. Then, by repeatedly entering the number of the closed area data into the number of the previous closed area data, obtaining the outer periphery of each closed area, and for each closed area, the length of the closed area is determined. 3. The method according to claim 2, further comprising the step of: dividing by the square root of the number of pixels constituting the closed region, and setting the result as the feature amount. 10. The coloring object line drawing coloring processing step,
A certain coordinate (x, y) in a closed area to be colored in the target color drawing to be colored is put into processing coordinates,
It is appropriate as the coordinate value of the coordinates for processing, and the chromatic object line drawing closed area data of the coordinates (x, y) is the same as the closed area data of the chromatic object line drawing, and the coordinates (x, y,
As long as the color of y) is different from the designated color image, the designated color value is inserted into the processing coordinates of the color object line drawing, and the same processing is performed while shifting the processing coordinates up, down, left, and right by one pixel. Item 10. The method according to any one of Items 2 to 9. 11. A colored object line drawing / color candidate list / closed area information reading process for reading out the stored colored object line drawing, color candidate list, and closed area data from the storage device, and reading out the coloring. The colored object line drawing is presented to the user, and the color candidate list for each closed region of the colored object line drawing is presented according to the user's request. Colored line drawing color correction processing for changing the color of the closed area designated by selecting a color on the color candidate list to a color on the color candidate list selected by the user, and coloring with the changed color The method according to any one of claims 1 to 10, further comprising a colored object line drawing storing process of storing the already colored object line image in a storage device. 12. A color alias list creation / storing process for previously creating a color alias list of an alias corresponding to the color information and storing the same in a storage device, and a color alias list reading process for reading the color alias list from the storage device. 12. The method according to claim 11, wherein the colored object line drawing color correction processing further comprises the step of adding a color alias to the list of color candidates to be displayed. 13. A storage device in which a plurality of image data are stored; an image read processing unit for reading image data from the storage device; and a sample already read from the storage device by the image read processing unit. A reference line drawing closed area separation processing unit for separating all closed regions constituting the reference line drawing from the original line drawing data (hereinafter referred to as reference line drawing) of the colored image data (hereinafter referred to as reference picture); 1 other than the center of gravity of the closed area of the reference line drawing
A reference line drawing closed area feature value extraction processing unit that extracts more than two or more types of feature values; and line image data to be colored (hereinafter referred to as a color object line drawing) read from the storage device by the image reading processing unit. A chromatic object line drawing closed area separation processing unit that separates all closed regions constituting the chromatic object line image, and a chromatic object line drawing that extracts one or more types of feature values other than the center of gravity of the closed region of the extracted chromatic object line drawing A region feature amount extraction processing unit, calculates a change amount of the feature amount between each of the obtained reference line drawings in combination with all the closed regions of the obtained reference line drawings and all the closed regions of the chromatic color target line drawings, and For each closed area, order all closed areas of the reference line drawing in ascending order of the amount of change of the feature amount and take a correspondence, and obtain color information corresponding to all closed areas of the reference line drawing from the reference picture. A color candidate list creation processing unit that creates a color candidate list for all the closed regions of the chromatic object line drawing by eliminating duplication of color information from the correspondence relationship between all the closed regions of the reference line image and the closed region of the line object to be colored An image coloring apparatus comprising: a coloring object line drawing coloring processing section for coloring a color at the head of each color candidate list for the coloring object line drawing for all closed regions of the coloring object line drawing. 14. A colored object storing a color candidate list corresponding to a colored object line image which has been colored by the object color drawing part and closed area data separated by the image coloring device in a storage device. A target line drawing / color candidate list / closed area information storage processing unit; and a colored object line drawing / color candidate list / closed which reads out the stored colored object line drawing, color candidate list, and closed area information from the storage device. A region information reading processing unit, a colored object line drawing presenting unit that presents the read colored object line drawing read to the user, and a user that displays a color candidate list for each closed region of the colored object line drawing. Is displayed according to the request of the user, and the user selects a color on the color candidate list to change the color of the specified closed area to a color on the color candidate list selected by the user. color 14. The apparatus according to claim 13, further comprising: a correction processing unit; and a colored object line drawing storage processing unit that stores the colored object line image whose color has been changed in the storage device. 15. A color alias list creating / storing unit that creates a color alias list of an alias corresponding to color information in advance and saves it in a storage device, and a color alias list reading unit that reads the color alias list from the storage device. 15. The apparatus according to claim 14, wherein the colored object line drawing color correction processing unit adds a color alias to a color candidate list to be displayed. 16. Original line drawing data (hereinafter referred to as a reference line drawing) of sample already colored image data (hereinafter referred to as a reference picture) read from a storage device.
And a reference line drawing closed region separation process for separating all the closed regions constituting the reference line drawing, and one of the closed regions of the extracted reference line drawing other than the center of gravity.
Reference line drawing closed area feature amount extraction processing for extracting more than kinds of feature amounts, and all closed areas constituting line image data to be colored (hereinafter referred to as a color object line drawing) read from the storage device. A color object line drawing closed region separation process for separating the image data, a color object line image closed region feature value extraction process for extracting one or more types of features other than the center of gravity of the extracted closed region of the color object line image, For each combination of the closed area of the reference line drawing and the closed area of the chromatic object line drawing, the amount of change in the feature amount between them is calculated, and the change in the characteristic amount for each closed area of the chromatic object line drawing is calculated. All the closed areas of the reference line art are ordered in ascending order to obtain a correspondence, and color information corresponding to all the closed areas of the reference line art is obtained from the reference picture, and a reference to the closed area of the chromatic object line art is obtained. A color candidate list creation process for creating a color candidate list for all closed regions of the chromatic color target line image by eliminating duplication of color information from the correspondence relationship of all closed regions of the reference line image; A recording medium for recording an image coloring program for causing a computer to execute a color object line drawing coloring process for coloring a color at the head of each color candidate list for a region to a color object line drawing. 17. A color-finished storage device which stores in a storage device a color candidate list corresponding to a colored object line drawing which has been colored by the colored object line drawing coloring process and closed area data separated by the image coloring program. A color object line drawing / color candidate list / closed area information storing process; and a stored colored object line image / color candidate list / color candidate list / Closed area information reading processing, colored colored object line drawing presentation processing that presents the read colored object line drawing read out to the user, and a color candidate list for each closed area of the colored object line drawing painted by the user The colored object that is presented according to the request of the user and changes the color of the specified closed area to the color on the color candidate list selected by the user by selecting the color on the color candidate list 17. The recording medium according to claim 16, further comprising: a color target line drawing color correcting process; and a colored target color drawing line image storing process of storing a colored target line drawing whose color has been changed in the storage device. 18. A color alias list creating / storing process for creating a color alias list of aliases corresponding to color information in advance and saving the same in a storage device, and a color alias list reading process for reading the color alias list from the storage device. 17. The recording medium according to claim 16, wherein said colored object line drawing color correction processing adds a color alias to a color candidate list to be displayed.